2025-07-23 15:11:38,128 - INFO - Using existing project ['default-domain', 'k8s-default'](dfa7c748-3288-40a3-80e9-cddd7aa70dae) 2025-07-23 15:11:38,150 - DEBUG - Namespace ctest-new-default-87190310 not present 2025-07-23 15:11:38,162 - INFO - Created namespace ctest-new-default-87190310 2025-07-23 15:11:41,170 - DEBUG - Namespace ctest-non-default-09023056 not present 2025-07-23 15:11:41,181 - INFO - Created namespace ctest-non-default-09023056 2025-07-23 15:11:44,213 - DEBUG - Pod ctest-pod-28211090 not present 2025-07-23 15:11:44,213 - INFO - Creating Pod ctest-pod-28211090 2025-07-23 15:11:44,245 - DEBUG - Pod : ctest-pod-28211090 UUID is c5e543ed-849d-4636-962e-6950003f9046 2025-07-23 15:11:44,257 - DEBUG - Pod ctest-pod-88152784 not present 2025-07-23 15:11:44,258 - INFO - Creating Pod ctest-pod-88152784 2025-07-23 15:11:44,284 - DEBUG - Pod : ctest-pod-88152784 UUID is 18958e4f-0139-43ca-a919-0cc271b89539 2025-07-23 15:11:44,290 - DEBUG - Pod ctest-pod-31079829 not present 2025-07-23 15:11:44,290 - INFO - Creating Pod ctest-pod-31079829 2025-07-23 15:11:44,329 - DEBUG - Pod : ctest-pod-31079829 UUID is 8a25b2fd-ec08-4f72-89a1-30e667bafd9c 2025-07-23 15:11:44,345 - DEBUG - Pod ctest-pod-23683019 not present 2025-07-23 15:11:44,346 - INFO - Creating Pod ctest-pod-23683019 2025-07-23 15:11:44,465 - DEBUG - Pod : ctest-pod-23683019 UUID is 2c9631c0-c720-4bef-a411-9c04bd873ccd 2025-07-23 15:11:44,468 - DEBUG - Pod ctest-pod-36146978 not present 2025-07-23 15:11:44,469 - INFO - Creating Pod ctest-pod-36146978 2025-07-23 15:11:44,501 - DEBUG - Pod : ctest-pod-36146978 UUID is 3b2cce74-07c3-49cb-9690-4c2ffad9662b 2025-07-23 15:11:44,509 - DEBUG - Pod ctest-pod-55776982 not present 2025-07-23 15:11:44,509 - INFO - Creating Pod ctest-pod-55776982 2025-07-23 15:11:44,538 - DEBUG - Pod : ctest-pod-55776982 UUID is 0a4be0fa-009b-467c-8055-18e294a66027 2025-07-23 15:11:44,542 - DEBUG - Pod ctest-pod-85527797 not present 2025-07-23 15:11:44,542 - INFO - Creating Pod ctest-pod-85527797 2025-07-23 15:11:44,564 - DEBUG - Pod : ctest-pod-85527797 UUID is d44525ad-559c-4a41-9d84-f55bfbe78710 2025-07-23 15:11:44,571 - DEBUG - Pod ctest-pod-56387139 not present 2025-07-23 15:11:44,572 - INFO - Creating Pod ctest-pod-56387139 2025-07-23 15:11:44,595 - DEBUG - Pod : ctest-pod-56387139 UUID is cd2a55a6-c2a3-4faf-8e0a-fff1bad38f7e 2025-07-23 15:11:44,893 - INFO - Project default-domain:k8s-ctest-new-default-87190310 for Namespace ctest-new-default-87190310 is seen in contrail-api 2025-07-23 15:11:44,893 - DEBUG - Project uuid in Contrail is f987a2e8-0509-4cb5-b58e-604543580317 2025-07-23 15:11:45,120 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NamespaceDatabaseList?namespace_uuid=a49062bd-37ca-4124-bacc-0237bee47c20 2025-07-23 15:11:45,131 - INFO - Namespace ctest-new-default-87190310 with uuid a49062bd-37ca-4124-bacc-0237bee47c20 found in kube manager 2025-07-23 15:11:45,132 - INFO - Namespace ctest-new-default-87190310 verification passed 2025-07-23 15:11:45,406 - INFO - Project default-domain:k8s-ctest-non-default-09023056 for Namespace ctest-non-default-09023056 is seen in contrail-api 2025-07-23 15:11:45,407 - DEBUG - Project uuid in Contrail is a38c29d5-a3b5-4341-8f50-e39016f8e5ea 2025-07-23 15:11:45,407 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NamespaceDatabaseList?namespace_uuid=8428130e-365d-477f-ba4b-95a3cb269974 2025-07-23 15:11:45,426 - INFO - Namespace ctest-non-default-09023056 with uuid 8428130e-365d-477f-ba4b-95a3cb269974 found in kube manager 2025-07-23 15:11:45,427 - INFO - Namespace ctest-non-default-09023056 verification passed 2025-07-23 15:11:45,434 - DEBUG - Pod ctest-pod-28211090 not in running state.Currently in Pending 2025-07-23 15:11:50,441 - DEBUG - Pod ctest-pod-28211090 not in running state.Currently in Pending 2025-07-23 15:11:55,450 - INFO - Pod ctest-pod-28211090 is in running state.Got IP 10.47.255.251 2025-07-23 15:11:55,474 - DEBUG - Pod ctest-pod-28211090 has vmi 59228190-67d7-11f0-8615-fa163e7f42e0 2025-07-23 15:11:55,474 - INFO - Verified pod ctest-pod-28211090 in contrail-api 2025-07-23 15:11:55,489 - DEBUG - VMI 59228190-67d7-11f0-8615-fa163e7f42e0 is active in agent 10.0.0.61 2025-07-23 15:11:55,490 - INFO - Verified Pod ctest-pod-28211090 in agent 10.0.0.61 2025-07-23 15:11:55,490 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=c5e543ed-849d-4636-962e-6950003f9046 2025-07-23 15:11:55,498 - INFO - Pod ctest-pod-28211090 with uuid c5e543ed-849d-4636-962e-6950003f9046 found in kube manager 2025-07-23 15:11:55,499 - INFO - Pod ctest-pod-28211090 verification passed 2025-07-23 15:11:55,509 - DEBUG - Pod ctest-pod-88152784 not in running state.Currently in Pending 2025-07-23 15:12:00,518 - INFO - Pod ctest-pod-88152784 is in running state.Got IP 10.47.255.250 2025-07-23 15:12:00,539 - DEBUG - Pod ctest-pod-88152784 has vmi 599dd002-67d7-11f0-8615-fa163e7f42e0 2025-07-23 15:12:00,539 - INFO - Verified pod ctest-pod-88152784 in contrail-api 2025-07-23 15:12:00,553 - DEBUG - VMI 599dd002-67d7-11f0-8615-fa163e7f42e0 is active in agent 10.0.0.61 2025-07-23 15:12:00,554 - INFO - Verified Pod ctest-pod-88152784 in agent 10.0.0.61 2025-07-23 15:12:00,554 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=18958e4f-0139-43ca-a919-0cc271b89539 2025-07-23 15:12:00,564 - INFO - Pod ctest-pod-88152784 with uuid 18958e4f-0139-43ca-a919-0cc271b89539 found in kube manager 2025-07-23 15:12:00,565 - INFO - Pod ctest-pod-88152784 verification passed 2025-07-23 15:12:00,575 - INFO - Pod ctest-pod-31079829 is in running state.Got IP 10.47.255.249 2025-07-23 15:12:00,603 - DEBUG - Pod ctest-pod-31079829 has vmi 5a429858-67d7-11f0-8615-fa163e7f42e0 2025-07-23 15:12:00,603 - INFO - Verified pod ctest-pod-31079829 in contrail-api 2025-07-23 15:12:00,617 - DEBUG - VMI 5a429858-67d7-11f0-8615-fa163e7f42e0 is active in agent 10.0.0.57 2025-07-23 15:12:00,617 - INFO - Verified Pod ctest-pod-31079829 in agent 10.0.0.57 2025-07-23 15:12:00,618 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=8a25b2fd-ec08-4f72-89a1-30e667bafd9c 2025-07-23 15:12:00,627 - INFO - Pod ctest-pod-31079829 with uuid 8a25b2fd-ec08-4f72-89a1-30e667bafd9c found in kube manager 2025-07-23 15:12:00,628 - INFO - Pod ctest-pod-31079829 verification passed 2025-07-23 15:12:00,636 - INFO - Pod ctest-pod-23683019 is in running state.Got IP 10.47.255.248 2025-07-23 15:12:00,700 - DEBUG - Pod ctest-pod-23683019 has vmi 5ad5c13c-67d7-11f0-8615-fa163e7f42e0 2025-07-23 15:12:00,700 - INFO - Verified pod ctest-pod-23683019 in contrail-api 2025-07-23 15:12:00,713 - DEBUG - VMI 5ad5c13c-67d7-11f0-8615-fa163e7f42e0 is active in agent 10.0.0.61 2025-07-23 15:12:00,714 - INFO - Verified Pod ctest-pod-23683019 in agent 10.0.0.61 2025-07-23 15:12:00,715 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=2c9631c0-c720-4bef-a411-9c04bd873ccd 2025-07-23 15:12:00,721 - INFO - Pod ctest-pod-23683019 with uuid 2c9631c0-c720-4bef-a411-9c04bd873ccd found in kube manager 2025-07-23 15:12:00,722 - INFO - Pod ctest-pod-23683019 verification passed 2025-07-23 15:12:00,730 - INFO - Pod ctest-pod-36146978 is in running state.Got IP 10.47.255.247 2025-07-23 15:12:00,749 - DEBUG - Pod ctest-pod-36146978 has vmi 5b53c06e-67d7-11f0-8615-fa163e7f42e0 2025-07-23 15:12:00,749 - INFO - Verified pod ctest-pod-36146978 in contrail-api 2025-07-23 15:12:00,762 - DEBUG - VMI 5b53c06e-67d7-11f0-8615-fa163e7f42e0 is active in agent 10.0.0.57 2025-07-23 15:12:00,762 - INFO - Verified Pod ctest-pod-36146978 in agent 10.0.0.57 2025-07-23 15:12:00,763 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=3b2cce74-07c3-49cb-9690-4c2ffad9662b 2025-07-23 15:12:00,769 - INFO - Pod ctest-pod-36146978 with uuid 3b2cce74-07c3-49cb-9690-4c2ffad9662b found in kube manager 2025-07-23 15:12:00,769 - INFO - Pod ctest-pod-36146978 verification passed 2025-07-23 15:12:00,862 - INFO - Pod ctest-pod-85527797 is in running state.Got IP 10.47.255.245 2025-07-23 15:12:00,885 - DEBUG - Pod ctest-pod-85527797 has vmi 5c69dd6c-67d7-11f0-8615-fa163e7f42e0 2025-07-23 15:12:00,885 - INFO - Verified pod ctest-pod-85527797 in contrail-api 2025-07-23 15:12:00,897 - DEBUG - VMI 5c69dd6c-67d7-11f0-8615-fa163e7f42e0 is active in agent 10.0.0.57 2025-07-23 15:12:00,897 - INFO - Verified Pod ctest-pod-85527797 in agent 10.0.0.57 2025-07-23 15:12:00,898 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=d44525ad-559c-4a41-9d84-f55bfbe78710 2025-07-23 15:12:00,907 - INFO - Pod ctest-pod-85527797 with uuid d44525ad-559c-4a41-9d84-f55bfbe78710 found in kube manager 2025-07-23 15:12:00,908 - INFO - Pod ctest-pod-85527797 verification passed 2025-07-23 15:12:00,916 - INFO - Pod ctest-pod-55776982 is in running state.Got IP 10.47.255.246 2025-07-23 15:12:00,937 - DEBUG - Pod ctest-pod-55776982 has vmi 5bde1ff2-67d7-11f0-8615-fa163e7f42e0 2025-07-23 15:12:00,938 - INFO - Verified pod ctest-pod-55776982 in contrail-api 2025-07-23 15:12:00,952 - DEBUG - VMI 5bde1ff2-67d7-11f0-8615-fa163e7f42e0 is active in agent 10.0.0.61 2025-07-23 15:12:00,952 - INFO - Verified Pod ctest-pod-55776982 in agent 10.0.0.61 2025-07-23 15:12:00,953 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=0a4be0fa-009b-467c-8055-18e294a66027 2025-07-23 15:12:00,961 - INFO - Pod ctest-pod-55776982 with uuid 0a4be0fa-009b-467c-8055-18e294a66027 found in kube manager 2025-07-23 15:12:00,962 - INFO - Pod ctest-pod-55776982 verification passed 2025-07-23 15:12:00,972 - INFO - Pod ctest-pod-56387139 is in running state.Got IP 10.47.255.244 2025-07-23 15:12:01,037 - DEBUG - Pod ctest-pod-56387139 has vmi 5cffd6aa-67d7-11f0-8615-fa163e7f42e0 2025-07-23 15:12:01,037 - INFO - Verified pod ctest-pod-56387139 in contrail-api 2025-07-23 15:12:01,051 - DEBUG - VMI 5cffd6aa-67d7-11f0-8615-fa163e7f42e0 is active in agent 10.0.0.61 2025-07-23 15:12:01,051 - INFO - Verified Pod ctest-pod-56387139 in agent 10.0.0.61 2025-07-23 15:12:01,052 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=cd2a55a6-c2a3-4faf-8e0a-fff1bad38f7e 2025-07-23 15:12:01,059 - INFO - Pod ctest-pod-56387139 with uuid cd2a55a6-c2a3-4faf-8e0a-fff1bad38f7e found in kube manager 2025-07-23 15:12:01,060 - INFO - Pod ctest-pod-56387139 verification passed 2025-07-23 15:12:01,061 - INFO - ================================================================================ 2025-07-23 15:12:01,062 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-07-23 15:12:01,062 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-07-23 15:12:01,836 - DEBUG - Nothing to compare xmpp stats {'10.0.0.57': {'10.0.0.65': '0', '10.0.0.27': '0'}, '10.0.0.61': {'10.0.0.41': '0', '10.0.0.65': '0'}} with 2025-07-23 15:12:01,836 - INFO - Initial checks done. Running the testcase now 2025-07-23 15:12:01,837 - INFO - 2025-07-23 15:12:01,910 - DEBUG - [Pod ctest-pod-28211090] Cmd: echo ctest-pod-28211090 > /usr/share/nginx/html/index.html, Output: 2025-07-23 15:12:01,968 - DEBUG - [Pod ctest-pod-88152784] Cmd: echo ctest-pod-88152784 > /usr/share/nginx/html/index.html, Output: 2025-07-23 15:12:02,038 - DEBUG - [Pod ctest-pod-31079829] Cmd: echo ctest-pod-31079829 > /usr/share/nginx/html/index.html, Output: 2025-07-23 15:12:02,096 - DEBUG - [Pod ctest-pod-23683019] Cmd: echo ctest-pod-23683019 > /usr/share/nginx/html/index.html, Output: 2025-07-23 15:12:02,102 - DEBUG - Service ctest-nginx-svc-35804264 not present 2025-07-23 15:12:02,102 - INFO - Creating service ctest-nginx-svc-35804264 2025-07-23 15:12:02,140 - INFO - Created Service ctest-nginx-svc-35804264 2025-07-23 15:12:02,147 - WARNING - Service UUID 893d72c6-1e73-4faa-88ff-220249dff45a not yet found in contrail-api 2025-07-23 15:12:03,156 - INFO - Validated that Service ctest-nginx-svc-35804264 is seen in contrail-api 2025-07-23 15:12:03,156 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_LoadbalancerDatabaseList?x=893d72c6-1e73-4faa-88ff-220249dff45a 2025-07-23 15:12:03,162 - INFO - Service ctest-nginx-svc-35804264 with uuid 893d72c6-1e73-4faa-88ff-220249dff45a found in kube manager 2025-07-23 15:12:03,162 - INFO - Service ctest-nginx-svc-35804264 verification passed 2025-07-23 15:12:04,238 - DEBUG - [Pod ctest-pod-36146978] Cmd: wget http://10.107.191.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.57:80 (10.107.191.57:80) ctest-pod-88152784 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-23 15:12:04,238 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd wget http://10.107.191.57:80/ -O - -T 5 -t 1 passed 2025-07-23 15:12:04,238 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd output: Connecting to 10.107.191.57:80 (10.107.191.57:80) ctest-pod-88152784 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-23 15:12:04,293 - DEBUG - [Pod ctest-pod-36146978] Cmd: wget http://10.107.191.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.57:80 (10.107.191.57:80) ctest-pod-88152784 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-23 15:12:04,294 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd wget http://10.107.191.57:80/ -O - -T 5 -t 1 passed 2025-07-23 15:12:04,294 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd output: Connecting to 10.107.191.57:80 (10.107.191.57:80) ctest-pod-88152784 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-23 15:12:04,342 - DEBUG - [Pod ctest-pod-36146978] Cmd: wget http://10.107.191.57:80/ -O - -T 5 -t 1 , Output: ctest-pod-88152784 Connecting to 10.107.191.57:80 (10.107.191.57:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-23 15:12:04,342 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd wget http://10.107.191.57:80/ -O - -T 5 -t 1 passed 2025-07-23 15:12:04,342 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd output: ctest-pod-88152784 Connecting to 10.107.191.57:80 (10.107.191.57:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-23 15:12:04,396 - DEBUG - [Pod ctest-pod-36146978] Cmd: wget http://10.107.191.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.57:80 (10.107.191.57:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-88152784 2025-07-23 15:12:04,396 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd wget http://10.107.191.57:80/ -O - -T 5 -t 1 passed 2025-07-23 15:12:04,396 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd output: Connecting to 10.107.191.57:80 (10.107.191.57:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-88152784 2025-07-23 15:12:04,453 - DEBUG - [Pod ctest-pod-36146978] Cmd: wget http://10.107.191.57:80/ -O - -T 5 -t 1 , Output: ctest-pod-88152784 Connecting to 10.107.191.57:80 (10.107.191.57:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-23 15:12:04,454 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd wget http://10.107.191.57:80/ -O - -T 5 -t 1 passed 2025-07-23 15:12:04,454 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd output: ctest-pod-88152784 Connecting to 10.107.191.57:80 (10.107.191.57:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-23 15:12:04,510 - DEBUG - [Pod ctest-pod-36146978] Cmd: wget http://10.107.191.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.57:80 (10.107.191.57:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-28211090 2025-07-23 15:12:04,510 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd wget http://10.107.191.57:80/ -O - -T 5 -t 1 passed 2025-07-23 15:12:04,510 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd output: Connecting to 10.107.191.57:80 (10.107.191.57:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-28211090 2025-07-23 15:12:04,510 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-28211090': 1, 'ctest-pod-88152784': 5} 2025-07-23 15:12:04,578 - DEBUG - [Pod ctest-pod-85527797] Cmd: wget http://10.107.191.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.57:80 (10.107.191.57:80) writing to stdout ctest-pod-88152784 - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-23 15:12:04,578 - DEBUG - [Pod Pod ctest-pod-85527797] Cmd wget http://10.107.191.57:80/ -O - -T 5 -t 1 passed 2025-07-23 15:12:04,578 - DEBUG - [Pod Pod ctest-pod-85527797] Cmd output: Connecting to 10.107.191.57:80 (10.107.191.57:80) writing to stdout ctest-pod-88152784 - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-23 15:12:04,637 - DEBUG - [Pod ctest-pod-85527797] Cmd: wget http://10.107.191.57:80/ -O - -T 5 -t 1 , Output: ctest-pod-28211090 Connecting to 10.107.191.57:80 (10.107.191.57:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-23 15:12:04,637 - DEBUG - [Pod Pod ctest-pod-85527797] Cmd wget http://10.107.191.57:80/ -O - -T 5 -t 1 passed 2025-07-23 15:12:04,637 - DEBUG - [Pod Pod ctest-pod-85527797] Cmd output: ctest-pod-28211090 Connecting to 10.107.191.57:80 (10.107.191.57:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-23 15:12:04,637 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-28211090': 1, 'ctest-pod-88152784': 1} 2025-07-23 15:12:04,643 - DEBUG - Network policy ingress-on-service not present 2025-07-23 15:12:04,644 - INFO - Creating Network Policy ingress-on-service 2025-07-23 15:12:04,673 - INFO - Network policy found in k8s 2025-07-23 15:12:04,674 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=da33f31f-0209-4228-8013-e889bc42c30b 2025-07-23 15:12:04,684 - INFO - Network Policy ingress-on-service with uuid da33f31f-0209-4228-8013-e889bc42c30b found in kube manager 2025-07-23 15:12:04,725 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-07-23 15:12:04,727 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-07-23 15:12:04,728 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=da33f31f-0209-4228-8013-e889bc42c30b 2025-07-23 15:12:04,786 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=da33f31f-0209-4228-8013-e889bc42c30b 2025-07-23 15:12:04,839 - WARNING - Network policy with name ingress-on-service not found in agent 2025-07-23 15:12:06,842 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=da33f31f-0209-4228-8013-e889bc42c30b 2025-07-23 15:12:06,878 - INFO - Network policy with name ingress-on-service found in agent 2025-07-23 15:12:06,879 - INFO - Network Policy ingress-on-service verification passed 2025-07-23 15:12:11,932 - DEBUG - [Pod ctest-pod-36146978] Cmd: wget http://10.107.191.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:12:11,932 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd wget http://10.107.191.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:12:11,932 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:12:16,988 - DEBUG - [Pod ctest-pod-36146978] Cmd: wget http://10.107.191.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:12:16,988 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd wget http://10.107.191.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:12:16,988 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:12:22,035 - DEBUG - [Pod ctest-pod-36146978] Cmd: wget http://10.107.191.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:12:22,035 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd wget http://10.107.191.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:12:22,035 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:12:27,099 - DEBUG - [Pod ctest-pod-36146978] Cmd: wget http://10.107.191.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:12:27,099 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd wget http://10.107.191.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:12:27,099 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:12:32,147 - DEBUG - [Pod ctest-pod-36146978] Cmd: wget http://10.107.191.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:12:32,147 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd wget http://10.107.191.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:12:32,147 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:12:37,204 - DEBUG - [Pod ctest-pod-36146978] Cmd: wget http://10.107.191.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:12:37,204 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd wget http://10.107.191.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:12:37,204 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:12:42,265 - DEBUG - [Pod ctest-pod-36146978] Cmd: wget http://10.107.191.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:12:42,265 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd wget http://10.107.191.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:12:42,265 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:12:47,315 - DEBUG - [Pod ctest-pod-36146978] Cmd: wget http://10.107.191.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:12:47,315 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd wget http://10.107.191.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:12:47,315 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:12:52,367 - DEBUG - [Pod ctest-pod-36146978] Cmd: wget http://10.107.191.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:12:52,367 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd wget http://10.107.191.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:12:52,367 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:12:57,425 - DEBUG - [Pod ctest-pod-36146978] Cmd: wget http://10.107.191.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:12:57,425 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd wget http://10.107.191.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:12:57,425 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:12:57,425 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-28211090': 0, 'ctest-pod-88152784': 0} 2025-07-23 15:12:57,489 - DEBUG - [Pod ctest-pod-55776982] Cmd: wget http://10.107.191.57:80/ -O - -T 5 -t 1 , Output: ctest-pod-28211090 Connecting to 10.107.191.57:80 (10.107.191.57:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-23 15:12:57,489 - DEBUG - [Pod Pod ctest-pod-55776982] Cmd wget http://10.107.191.57:80/ -O - -T 5 -t 1 passed 2025-07-23 15:12:57,489 - DEBUG - [Pod Pod ctest-pod-55776982] Cmd output: ctest-pod-28211090 Connecting to 10.107.191.57:80 (10.107.191.57:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-23 15:12:57,551 - DEBUG - [Pod ctest-pod-55776982] Cmd: wget http://10.107.191.57:80/ -O - -T 5 -t 1 , Output: ctest-pod-28211090 Connecting to 10.107.191.57:80 (10.107.191.57:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-23 15:12:57,551 - DEBUG - [Pod Pod ctest-pod-55776982] Cmd wget http://10.107.191.57:80/ -O - -T 5 -t 1 passed 2025-07-23 15:12:57,551 - DEBUG - [Pod Pod ctest-pod-55776982] Cmd output: ctest-pod-28211090 Connecting to 10.107.191.57:80 (10.107.191.57:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-23 15:12:57,602 - DEBUG - [Pod ctest-pod-55776982] Cmd: wget http://10.107.191.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.57:80 (10.107.191.57:80) ctest-pod-88152784 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-23 15:12:57,602 - DEBUG - [Pod Pod ctest-pod-55776982] Cmd wget http://10.107.191.57:80/ -O - -T 5 -t 1 passed 2025-07-23 15:12:57,602 - DEBUG - [Pod Pod ctest-pod-55776982] Cmd output: Connecting to 10.107.191.57:80 (10.107.191.57:80) ctest-pod-88152784 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-23 15:12:57,602 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-28211090': 2, 'ctest-pod-88152784': 1} 2025-07-23 15:13:02,655 - DEBUG - [Pod ctest-pod-85527797] Cmd: wget http://10.107.191.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:13:02,655 - DEBUG - [Pod Pod ctest-pod-85527797] Cmd wget http://10.107.191.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:13:02,655 - DEBUG - [Pod Pod ctest-pod-85527797] Cmd output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:13:07,703 - DEBUG - [Pod ctest-pod-85527797] Cmd: wget http://10.107.191.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:13:07,703 - DEBUG - [Pod Pod ctest-pod-85527797] Cmd wget http://10.107.191.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:13:07,703 - DEBUG - [Pod Pod ctest-pod-85527797] Cmd output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:13:12,751 - DEBUG - [Pod ctest-pod-85527797] Cmd: wget http://10.107.191.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:13:12,751 - DEBUG - [Pod Pod ctest-pod-85527797] Cmd wget http://10.107.191.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:13:12,751 - DEBUG - [Pod Pod ctest-pod-85527797] Cmd output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:13:17,807 - DEBUG - [Pod ctest-pod-85527797] Cmd: wget http://10.107.191.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:13:17,807 - DEBUG - [Pod Pod ctest-pod-85527797] Cmd wget http://10.107.191.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:13:17,807 - DEBUG - [Pod Pod ctest-pod-85527797] Cmd output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:13:22,860 - DEBUG - [Pod ctest-pod-85527797] Cmd: wget http://10.107.191.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:13:22,860 - DEBUG - [Pod Pod ctest-pod-85527797] Cmd wget http://10.107.191.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:13:22,860 - DEBUG - [Pod Pod ctest-pod-85527797] Cmd output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:13:27,928 - DEBUG - [Pod ctest-pod-85527797] Cmd: wget http://10.107.191.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:13:27,928 - DEBUG - [Pod Pod ctest-pod-85527797] Cmd wget http://10.107.191.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:13:27,928 - DEBUG - [Pod Pod ctest-pod-85527797] Cmd output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:13:32,984 - DEBUG - [Pod ctest-pod-85527797] Cmd: wget http://10.107.191.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:13:32,984 - DEBUG - [Pod Pod ctest-pod-85527797] Cmd wget http://10.107.191.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:13:32,984 - DEBUG - [Pod Pod ctest-pod-85527797] Cmd output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:13:38,039 - DEBUG - [Pod ctest-pod-85527797] Cmd: wget http://10.107.191.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:13:38,039 - DEBUG - [Pod Pod ctest-pod-85527797] Cmd wget http://10.107.191.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:13:38,039 - DEBUG - [Pod Pod ctest-pod-85527797] Cmd output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:13:43,091 - DEBUG - [Pod ctest-pod-85527797] Cmd: wget http://10.107.191.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:13:43,091 - DEBUG - [Pod Pod ctest-pod-85527797] Cmd wget http://10.107.191.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:13:43,091 - DEBUG - [Pod Pod ctest-pod-85527797] Cmd output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:13:48,147 - DEBUG - [Pod ctest-pod-85527797] Cmd: wget http://10.107.191.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:13:48,147 - DEBUG - [Pod Pod ctest-pod-85527797] Cmd wget http://10.107.191.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:13:48,147 - DEBUG - [Pod Pod ctest-pod-85527797] Cmd output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:13:48,147 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-28211090': 0, 'ctest-pod-88152784': 0} 2025-07-23 15:13:50,202 - DEBUG - [Pod ctest-pod-55776982] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=2.819 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.436 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.707 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.436/1.320/2.819 ms 2025-07-23 15:13:50,202 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-55776982 with expectation True passed 2025-07-23 15:13:52,252 - DEBUG - [Pod ctest-pod-36146978] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.540 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.480 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.757 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.480/0.925/1.540 ms 2025-07-23 15:13:52,253 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-36146978 with expectation True passed 2025-07-23 15:13:54,308 - DEBUG - [Pod ctest-pod-85527797] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.760 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.484 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.461 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.461/0.901/1.760 ms 2025-07-23 15:13:54,308 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-85527797 with expectation True passed 2025-07-23 15:13:54,357 - DEBUG - [Pod ctest-pod-55776982] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-23 15:13:54,358 - DEBUG - [Pod Pod ctest-pod-55776982] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-07-23 15:13:54,358 - DEBUG - [Pod Pod ctest-pod-55776982] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-23 15:13:54,358 - INFO - wget check of of http://10.47.255.251 from ctest-pod-55776982 passed 2025-07-23 15:13:54,411 - DEBUG - [Pod ctest-pod-55776982] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-23 15:13:54,411 - DEBUG - [Pod Pod ctest-pod-55776982] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-07-23 15:13:54,411 - DEBUG - [Pod Pod ctest-pod-55776982] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-23 15:13:54,411 - INFO - wget check of of http://10.47.255.250 from ctest-pod-55776982 passed 2025-07-23 15:13:59,471 - DEBUG - [Pod ctest-pod-36146978] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-07-23 15:13:59,472 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-07-23 15:13:59,472 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-07-23 15:13:59,472 - INFO - wget check of of http://10.47.255.250 from ctest-pod-36146978 passed 2025-07-23 15:14:04,534 - DEBUG - [Pod ctest-pod-56387139] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-07-23 15:14:04,534 - DEBUG - [Pod Pod ctest-pod-56387139] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-07-23 15:14:04,534 - DEBUG - [Pod Pod ctest-pod-56387139] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-07-23 15:14:04,534 - INFO - wget check of of http://10.47.255.251 from ctest-pod-56387139 passed 2025-07-23 15:14:04,544 - INFO - Updating Network Policy ingress-on-service 2025-07-23 15:14:09,614 - DEBUG - [Pod ctest-pod-36146978] Cmd: wget http://10.107.191.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:14:09,614 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd wget http://10.107.191.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:14:09,614 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:14:14,670 - DEBUG - [Pod ctest-pod-36146978] Cmd: wget http://10.107.191.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:14:14,670 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd wget http://10.107.191.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:14:14,670 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:14:19,731 - DEBUG - [Pod ctest-pod-36146978] Cmd: wget http://10.107.191.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:14:19,732 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd wget http://10.107.191.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:14:19,732 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:14:24,784 - DEBUG - [Pod ctest-pod-36146978] Cmd: wget http://10.107.191.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:14:24,784 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd wget http://10.107.191.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:14:24,784 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:14:29,844 - DEBUG - [Pod ctest-pod-36146978] Cmd: wget http://10.107.191.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:14:29,844 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd wget http://10.107.191.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:14:29,844 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:14:34,904 - DEBUG - [Pod ctest-pod-36146978] Cmd: wget http://10.107.191.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:14:34,904 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd wget http://10.107.191.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:14:34,904 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:14:39,961 - DEBUG - [Pod ctest-pod-36146978] Cmd: wget http://10.107.191.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:14:39,961 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd wget http://10.107.191.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:14:39,961 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:14:45,020 - DEBUG - [Pod ctest-pod-36146978] Cmd: wget http://10.107.191.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:14:45,021 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd wget http://10.107.191.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:14:45,021 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:14:50,077 - DEBUG - [Pod ctest-pod-36146978] Cmd: wget http://10.107.191.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:14:50,077 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd wget http://10.107.191.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:14:50,077 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:14:55,135 - DEBUG - [Pod ctest-pod-36146978] Cmd: wget http://10.107.191.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:14:55,136 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd wget http://10.107.191.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:14:55,136 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd output: Connecting to 10.107.191.57:80 (10.107.191.57:80) wget: download timed out 2025-07-23 15:14:55,136 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-28211090': 0, 'ctest-pod-88152784': 0} 2025-07-23 15:14:55,192 - DEBUG - [Pod ctest-pod-55776982] Cmd: wget http://10.107.191.57:80/ -O - -T 5 -t 1 , Output: ctest-pod-88152784 Connecting to 10.107.191.57:80 (10.107.191.57:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-23 15:14:55,192 - DEBUG - [Pod Pod ctest-pod-55776982] Cmd wget http://10.107.191.57:80/ -O - -T 5 -t 1 passed 2025-07-23 15:14:55,192 - DEBUG - [Pod Pod ctest-pod-55776982] Cmd output: ctest-pod-88152784 Connecting to 10.107.191.57:80 (10.107.191.57:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-23 15:14:55,254 - DEBUG - [Pod ctest-pod-55776982] Cmd: wget http://10.107.191.57:80/ -O - -T 5 -t 1 , Output: ctest-pod-88152784 Connecting to 10.107.191.57:80 (10.107.191.57:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-23 15:14:55,254 - DEBUG - [Pod Pod ctest-pod-55776982] Cmd wget http://10.107.191.57:80/ -O - -T 5 -t 1 passed 2025-07-23 15:14:55,255 - DEBUG - [Pod Pod ctest-pod-55776982] Cmd output: ctest-pod-88152784 Connecting to 10.107.191.57:80 (10.107.191.57:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-23 15:14:55,318 - DEBUG - [Pod ctest-pod-55776982] Cmd: wget http://10.107.191.57:80/ -O - -T 5 -t 1 , Output: ctest-pod-28211090 Connecting to 10.107.191.57:80 (10.107.191.57:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-23 15:14:55,318 - DEBUG - [Pod Pod ctest-pod-55776982] Cmd wget http://10.107.191.57:80/ -O - -T 5 -t 1 passed 2025-07-23 15:14:55,318 - DEBUG - [Pod Pod ctest-pod-55776982] Cmd output: ctest-pod-28211090 Connecting to 10.107.191.57:80 (10.107.191.57:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-23 15:14:55,319 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-28211090': 1, 'ctest-pod-88152784': 2} 2025-07-23 15:14:55,373 - DEBUG - [Pod ctest-pod-85527797] Cmd: wget http://10.107.191.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.191.57:80 (10.107.191.57:80) ctest-pod-28211090 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-23 15:14:55,373 - DEBUG - [Pod Pod ctest-pod-85527797] Cmd wget http://10.107.191.57:80/ -O - -T 5 -t 1 passed 2025-07-23 15:14:55,373 - DEBUG - [Pod Pod ctest-pod-85527797] Cmd output: Connecting to 10.107.191.57:80 (10.107.191.57:80) ctest-pod-28211090 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-23 15:14:55,432 - DEBUG - [Pod ctest-pod-85527797] Cmd: wget http://10.107.191.57:80/ -O - -T 5 -t 1 , Output: ctest-pod-88152784 Connecting to 10.107.191.57:80 (10.107.191.57:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-23 15:14:55,432 - DEBUG - [Pod Pod ctest-pod-85527797] Cmd wget http://10.107.191.57:80/ -O - -T 5 -t 1 passed 2025-07-23 15:14:55,432 - DEBUG - [Pod Pod ctest-pod-85527797] Cmd output: ctest-pod-88152784 Connecting to 10.107.191.57:80 (10.107.191.57:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-23 15:14:55,432 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-28211090': 1, 'ctest-pod-88152784': 1} 2025-07-23 15:14:57,486 - DEBUG - [Pod ctest-pod-55776982] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.551 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.437 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.476 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.437/0.821/1.551 ms 2025-07-23 15:14:57,486 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-55776982 with expectation True passed 2025-07-23 15:14:59,540 - DEBUG - [Pod ctest-pod-36146978] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.661 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.481 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.552 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.481/0.898/1.661 ms 2025-07-23 15:14:59,540 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-36146978 with expectation True passed 2025-07-23 15:15:01,592 - DEBUG - [Pod ctest-pod-85527797] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.850 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.448 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.514 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.448/0.937/1.850 ms 2025-07-23 15:15:01,593 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-85527797 with expectation True passed 2025-07-23 15:15:01,653 - DEBUG - [Pod ctest-pod-55776982] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-23 15:15:01,653 - DEBUG - [Pod Pod ctest-pod-55776982] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-07-23 15:15:01,653 - DEBUG - [Pod Pod ctest-pod-55776982] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-23 15:15:01,653 - INFO - wget check of of http://10.47.255.251 from ctest-pod-55776982 passed 2025-07-23 15:15:01,707 - DEBUG - [Pod ctest-pod-55776982] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-23 15:15:01,707 - DEBUG - [Pod Pod ctest-pod-55776982] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-07-23 15:15:01,707 - DEBUG - [Pod Pod ctest-pod-55776982] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-23 15:15:01,708 - INFO - wget check of of http://10.47.255.250 from ctest-pod-55776982 passed 2025-07-23 15:15:06,768 - DEBUG - [Pod ctest-pod-36146978] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-07-23 15:15:06,768 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-07-23 15:15:06,769 - DEBUG - [Pod Pod ctest-pod-36146978] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-07-23 15:15:06,769 - INFO - wget check of of http://10.47.255.250 from ctest-pod-36146978 passed 2025-07-23 15:15:06,831 - DEBUG - [Pod ctest-pod-56387139] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-23 15:15:06,831 - DEBUG - [Pod Pod ctest-pod-56387139] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-07-23 15:15:06,831 - DEBUG - [Pod Pod ctest-pod-56387139] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-23 15:15:06,831 - INFO - wget check of of http://10.47.255.251 from ctest-pod-56387139 passed 2025-07-23 15:15:06,832 - INFO - Deleting Network Policy : ingress-on-service 2025-07-23 15:15:06,833 - INFO - Deleting service : ctest-nginx-svc-35804264 2025-07-23 15:15:07,582 - DEBUG - No XMPP flaps were noticed during the test