2026-02-04 09:47:06,080 - INFO - Using existing project ['default-domain', 'k8s-default'](909b3c5c-ff3e-4972-b8da-33962354eb62) 2026-02-04 09:47:06,097 - DEBUG - Namespace ctest-new-default-52336627 not present 2026-02-04 09:47:06,105 - INFO - Created namespace ctest-new-default-52336627 2026-02-04 09:47:09,109 - DEBUG - Namespace ctest-non-default-20495000 not present 2026-02-04 09:47:09,128 - INFO - Created namespace ctest-non-default-20495000 2026-02-04 09:47:12,153 - DEBUG - Pod ctest-pod-16721773 not present 2026-02-04 09:47:12,154 - INFO - Creating Pod ctest-pod-16721773 2026-02-04 09:47:12,203 - DEBUG - Pod : ctest-pod-16721773 UUID is b95b53db-c0a5-4222-a100-cafe111d169d 2026-02-04 09:47:12,205 - DEBUG - Pod ctest-pod-52709566 not present 2026-02-04 09:47:12,206 - INFO - Creating Pod ctest-pod-52709566 2026-02-04 09:47:12,246 - DEBUG - Pod : ctest-pod-52709566 UUID is 7728e6ac-0eac-4248-9a1c-e54629c940c1 2026-02-04 09:47:12,249 - DEBUG - Pod ctest-pod-44633537 not present 2026-02-04 09:47:12,249 - INFO - Creating Pod ctest-pod-44633537 2026-02-04 09:47:12,276 - DEBUG - Pod : ctest-pod-44633537 UUID is 36ece26e-8e93-41ae-81a8-99504c8875ac 2026-02-04 09:47:12,279 - DEBUG - Pod ctest-pod-03191714 not present 2026-02-04 09:47:12,279 - INFO - Creating Pod ctest-pod-03191714 2026-02-04 09:47:12,309 - DEBUG - Pod : ctest-pod-03191714 UUID is 5c1a855a-1e08-427b-957f-f84c9c1c431d 2026-02-04 09:47:12,312 - DEBUG - Pod ctest-pod-24568058 not present 2026-02-04 09:47:12,312 - INFO - Creating Pod ctest-pod-24568058 2026-02-04 09:47:12,354 - DEBUG - Pod : ctest-pod-24568058 UUID is 2a936f5d-6cd2-4f37-8f76-0354f09af517 2026-02-04 09:47:12,358 - DEBUG - Pod ctest-pod-60840314 not present 2026-02-04 09:47:12,358 - INFO - Creating Pod ctest-pod-60840314 2026-02-04 09:47:12,379 - DEBUG - Pod : ctest-pod-60840314 UUID is d8a94f96-932d-4a45-824a-7b0965e0eac2 2026-02-04 09:47:12,381 - DEBUG - Pod ctest-pod-78901148 not present 2026-02-04 09:47:12,381 - INFO - Creating Pod ctest-pod-78901148 2026-02-04 09:47:12,402 - DEBUG - Pod : ctest-pod-78901148 UUID is 54b734ca-70ad-43ab-bf0f-217bea9c7efd 2026-02-04 09:47:12,407 - DEBUG - Pod ctest-pod-62359897 not present 2026-02-04 09:47:12,407 - INFO - Creating Pod ctest-pod-62359897 2026-02-04 09:47:12,428 - DEBUG - Pod : ctest-pod-62359897 UUID is b274d07d-6b00-41e1-9716-d00da84a4466 2026-02-04 09:47:12,650 - INFO - Project default-domain:k8s-ctest-new-default-52336627 for Namespace ctest-new-default-52336627 is seen in contrail-api 2026-02-04 09:47:12,650 - DEBUG - Project uuid in Contrail is 5ad5af2a-66b7-4bc3-aad0-8f0ae945c252 2026-02-04 09:47:12,778 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_NamespaceDatabaseList?namespace_uuid=7c70bd76-3355-4082-a5af-84a715e9b42e 2026-02-04 09:47:12,782 - INFO - Namespace ctest-new-default-52336627 with uuid 7c70bd76-3355-4082-a5af-84a715e9b42e found in kube manager 2026-02-04 09:47:12,782 - INFO - Namespace ctest-new-default-52336627 verification passed 2026-02-04 09:47:12,952 - INFO - Project default-domain:k8s-ctest-non-default-20495000 for Namespace ctest-non-default-20495000 is seen in contrail-api 2026-02-04 09:47:12,952 - DEBUG - Project uuid in Contrail is 1b158203-737c-4668-b378-032970847ce9 2026-02-04 09:47:12,952 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_NamespaceDatabaseList?namespace_uuid=ce58788f-65e6-4443-b8a5-21f129bf3fb7 2026-02-04 09:47:12,963 - INFO - Namespace ctest-non-default-20495000 with uuid ce58788f-65e6-4443-b8a5-21f129bf3fb7 found in kube manager 2026-02-04 09:47:12,964 - INFO - Namespace ctest-non-default-20495000 verification passed 2026-02-04 09:47:12,969 - DEBUG - Pod ctest-pod-16721773 not in running state.Currently in Pending 2026-02-04 09:47:17,977 - DEBUG - Pod ctest-pod-16721773 not in running state.Currently in Pending 2026-02-04 09:47:22,984 - INFO - Pod ctest-pod-16721773 is in running state.Got IP 10.47.255.251 2026-02-04 09:47:22,995 - DEBUG - Pod ctest-pod-16721773 has vmi 7bd0706e-01ae-11f1-8d66-fa163eab6240 2026-02-04 09:47:22,995 - INFO - Verified pod ctest-pod-16721773 in contrail-api 2026-02-04 09:47:23,005 - DEBUG - VMI 7bd0706e-01ae-11f1-8d66-fa163eab6240 is active in agent 10.0.0.41 2026-02-04 09:47:23,005 - INFO - Verified Pod ctest-pod-16721773 in agent 10.0.0.41 2026-02-04 09:47:23,005 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_VirtualMachineDatabaseList?x=b95b53db-c0a5-4222-a100-cafe111d169d 2026-02-04 09:47:23,008 - INFO - Pod ctest-pod-16721773 with uuid b95b53db-c0a5-4222-a100-cafe111d169d found in kube manager 2026-02-04 09:47:23,009 - INFO - Pod ctest-pod-16721773 verification passed 2026-02-04 09:47:23,017 - INFO - Pod ctest-pod-52709566 is in running state.Got IP 10.47.255.250 2026-02-04 09:47:23,071 - DEBUG - Pod ctest-pod-52709566 has vmi 7c462570-01ae-11f1-8d66-fa163eab6240 2026-02-04 09:47:23,071 - INFO - Verified pod ctest-pod-52709566 in contrail-api 2026-02-04 09:47:23,081 - DEBUG - VMI 7c462570-01ae-11f1-8d66-fa163eab6240 is active in agent 10.0.0.41 2026-02-04 09:47:23,081 - INFO - Verified Pod ctest-pod-52709566 in agent 10.0.0.41 2026-02-04 09:47:23,081 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_VirtualMachineDatabaseList?x=7728e6ac-0eac-4248-9a1c-e54629c940c1 2026-02-04 09:47:23,084 - INFO - Pod ctest-pod-52709566 with uuid 7728e6ac-0eac-4248-9a1c-e54629c940c1 found in kube manager 2026-02-04 09:47:23,085 - INFO - Pod ctest-pod-52709566 verification passed 2026-02-04 09:47:23,090 - INFO - Pod ctest-pod-44633537 is in running state.Got IP 10.47.255.249 2026-02-04 09:47:23,144 - DEBUG - Pod ctest-pod-44633537 has vmi 7cd77732-01ae-11f1-8d66-fa163eab6240 2026-02-04 09:47:23,144 - INFO - Verified pod ctest-pod-44633537 in contrail-api 2026-02-04 09:47:23,154 - DEBUG - VMI 7cd77732-01ae-11f1-8d66-fa163eab6240 is active in agent 10.0.0.41 2026-02-04 09:47:23,154 - INFO - Verified Pod ctest-pod-44633537 in agent 10.0.0.41 2026-02-04 09:47:23,154 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_VirtualMachineDatabaseList?x=36ece26e-8e93-41ae-81a8-99504c8875ac 2026-02-04 09:47:23,158 - INFO - Pod ctest-pod-44633537 with uuid 36ece26e-8e93-41ae-81a8-99504c8875ac found in kube manager 2026-02-04 09:47:23,158 - INFO - Pod ctest-pod-44633537 verification passed 2026-02-04 09:47:23,165 - DEBUG - Pod ctest-pod-03191714 not in running state.Currently in Pending 2026-02-04 09:47:28,176 - INFO - Pod ctest-pod-03191714 is in running state.Got IP 10.47.255.248 2026-02-04 09:47:28,189 - DEBUG - Pod ctest-pod-03191714 has vmi 7d4ab292-01ae-11f1-8d66-fa163eab6240 2026-02-04 09:47:28,189 - INFO - Verified pod ctest-pod-03191714 in contrail-api 2026-02-04 09:47:28,201 - DEBUG - VMI 7d4ab292-01ae-11f1-8d66-fa163eab6240 is active in agent 10.0.0.41 2026-02-04 09:47:28,202 - INFO - Verified Pod ctest-pod-03191714 in agent 10.0.0.41 2026-02-04 09:47:28,202 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_VirtualMachineDatabaseList?x=5c1a855a-1e08-427b-957f-f84c9c1c431d 2026-02-04 09:47:28,206 - INFO - Pod ctest-pod-03191714 with uuid 5c1a855a-1e08-427b-957f-f84c9c1c431d found in kube manager 2026-02-04 09:47:28,206 - INFO - Pod ctest-pod-03191714 verification passed 2026-02-04 09:47:28,212 - DEBUG - Pod ctest-pod-24568058 not in running state.Currently in Pending 2026-02-04 09:47:33,220 - INFO - Pod ctest-pod-24568058 is in running state.Got IP 10.47.255.247 2026-02-04 09:47:33,232 - DEBUG - Pod ctest-pod-24568058 has vmi 7dd45ccc-01ae-11f1-8d66-fa163eab6240 2026-02-04 09:47:33,232 - INFO - Verified pod ctest-pod-24568058 in contrail-api 2026-02-04 09:47:33,244 - DEBUG - VMI 7dd45ccc-01ae-11f1-8d66-fa163eab6240 is active in agent 10.0.0.41 2026-02-04 09:47:33,244 - INFO - Verified Pod ctest-pod-24568058 in agent 10.0.0.41 2026-02-04 09:47:33,244 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_VirtualMachineDatabaseList?x=2a936f5d-6cd2-4f37-8f76-0354f09af517 2026-02-04 09:47:33,250 - INFO - Pod ctest-pod-24568058 with uuid 2a936f5d-6cd2-4f37-8f76-0354f09af517 found in kube manager 2026-02-04 09:47:33,250 - INFO - Pod ctest-pod-24568058 verification passed 2026-02-04 09:47:33,261 - INFO - Pod ctest-pod-78901148 is in running state.Got IP 10.47.255.245 2026-02-04 09:47:33,334 - DEBUG - Pod ctest-pod-78901148 has vmi 7eb756bc-01ae-11f1-8d66-fa163eab6240 2026-02-04 09:47:33,334 - INFO - Verified pod ctest-pod-78901148 in contrail-api 2026-02-04 09:47:33,346 - DEBUG - VMI 7eb756bc-01ae-11f1-8d66-fa163eab6240 is active in agent 10.0.0.41 2026-02-04 09:47:33,347 - INFO - Verified Pod ctest-pod-78901148 in agent 10.0.0.41 2026-02-04 09:47:33,347 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_VirtualMachineDatabaseList?x=54b734ca-70ad-43ab-bf0f-217bea9c7efd 2026-02-04 09:47:33,352 - INFO - Pod ctest-pod-78901148 with uuid 54b734ca-70ad-43ab-bf0f-217bea9c7efd found in kube manager 2026-02-04 09:47:33,353 - INFO - Pod ctest-pod-78901148 verification passed 2026-02-04 09:47:33,359 - INFO - Pod ctest-pod-60840314 is in running state.Got IP 10.47.255.246 2026-02-04 09:47:33,420 - DEBUG - Pod ctest-pod-60840314 has vmi 7e4452f2-01ae-11f1-8d66-fa163eab6240 2026-02-04 09:47:33,420 - INFO - Verified pod ctest-pod-60840314 in contrail-api 2026-02-04 09:47:33,436 - DEBUG - VMI 7e4452f2-01ae-11f1-8d66-fa163eab6240 is active in agent 10.0.0.41 2026-02-04 09:47:33,436 - INFO - Verified Pod ctest-pod-60840314 in agent 10.0.0.41 2026-02-04 09:47:33,436 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_VirtualMachineDatabaseList?x=d8a94f96-932d-4a45-824a-7b0965e0eac2 2026-02-04 09:47:33,448 - INFO - Pod ctest-pod-60840314 with uuid d8a94f96-932d-4a45-824a-7b0965e0eac2 found in kube manager 2026-02-04 09:47:33,448 - INFO - Pod ctest-pod-60840314 verification passed 2026-02-04 09:47:33,454 - INFO - Pod ctest-pod-62359897 is in running state.Got IP 10.47.255.244 2026-02-04 09:47:33,466 - DEBUG - Pod ctest-pod-62359897 has vmi 7f2cb312-01ae-11f1-8d66-fa163eab6240 2026-02-04 09:47:33,467 - INFO - Verified pod ctest-pod-62359897 in contrail-api 2026-02-04 09:47:33,478 - DEBUG - VMI 7f2cb312-01ae-11f1-8d66-fa163eab6240 is active in agent 10.0.0.41 2026-02-04 09:47:33,478 - INFO - Verified Pod ctest-pod-62359897 in agent 10.0.0.41 2026-02-04 09:47:33,478 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_VirtualMachineDatabaseList?x=b274d07d-6b00-41e1-9716-d00da84a4466 2026-02-04 09:47:33,482 - INFO - Pod ctest-pod-62359897 with uuid b274d07d-6b00-41e1-9716-d00da84a4466 found in kube manager 2026-02-04 09:47:33,482 - INFO - Pod ctest-pod-62359897 verification passed 2026-02-04 09:47:33,483 - INFO - ================================================================================ 2026-02-04 09:47:33,483 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2026-02-04 09:47:33,483 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2026-02-04 09:47:33,739 - DEBUG - Nothing to compare xmpp stats {'10.0.0.41': {'10.0.0.129': '0'}} with 2026-02-04 09:47:33,739 - INFO - Initial checks done. Running the testcase now 2026-02-04 09:47:33,739 - INFO - 2026-02-04 09:47:33,803 - DEBUG - [Pod ctest-pod-16721773] Cmd: echo ctest-pod-16721773 > /usr/share/nginx/html/index.html, Output: 2026-02-04 09:47:33,854 - DEBUG - [Pod ctest-pod-52709566] Cmd: echo ctest-pod-52709566 > /usr/share/nginx/html/index.html, Output: 2026-02-04 09:47:33,913 - DEBUG - [Pod ctest-pod-44633537] Cmd: echo ctest-pod-44633537 > /usr/share/nginx/html/index.html, Output: 2026-02-04 09:47:33,966 - DEBUG - [Pod ctest-pod-03191714] Cmd: echo ctest-pod-03191714 > /usr/share/nginx/html/index.html, Output: 2026-02-04 09:47:33,971 - DEBUG - Service ctest-nginx-svc-12990688 not present 2026-02-04 09:47:33,971 - INFO - Creating service ctest-nginx-svc-12990688 2026-02-04 09:47:33,997 - INFO - Created Service ctest-nginx-svc-12990688 2026-02-04 09:47:34,009 - WARNING - Service UUID 4924788b-0b96-4799-b30d-9a81a043ecc9 not yet found in contrail-api 2026-02-04 09:47:35,023 - INFO - Validated that Service ctest-nginx-svc-12990688 is seen in contrail-api 2026-02-04 09:47:35,023 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_LoadbalancerDatabaseList?x=4924788b-0b96-4799-b30d-9a81a043ecc9 2026-02-04 09:47:35,027 - INFO - Service ctest-nginx-svc-12990688 with uuid 4924788b-0b96-4799-b30d-9a81a043ecc9 found in kube manager 2026-02-04 09:47:35,027 - INFO - Service ctest-nginx-svc-12990688 verification passed 2026-02-04 09:47:36,107 - DEBUG - [Pod ctest-pod-24568058] Cmd: wget http://10.98.151.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.151.56:80 (10.98.151.56:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-52709566 2026-02-04 09:47:36,108 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd wget http://10.98.151.56:80/ -O - -T 5 -t 1 passed 2026-02-04 09:47:36,108 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd output: Connecting to 10.98.151.56:80 (10.98.151.56:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-52709566 2026-02-04 09:47:36,158 - DEBUG - [Pod ctest-pod-24568058] Cmd: wget http://10.98.151.56:80/ -O - -T 5 -t 1 , Output: ctest-pod-16721773 Connecting to 10.98.151.56:80 (10.98.151.56:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-04 09:47:36,158 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd wget http://10.98.151.56:80/ -O - -T 5 -t 1 passed 2026-02-04 09:47:36,158 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd output: ctest-pod-16721773 Connecting to 10.98.151.56:80 (10.98.151.56:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-04 09:47:36,158 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-16721773': 1, 'ctest-pod-52709566': 1} 2026-02-04 09:47:36,216 - DEBUG - [Pod ctest-pod-78901148] Cmd: wget http://10.98.151.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.151.56:80 (10.98.151.56:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-52709566 2026-02-04 09:47:36,217 - DEBUG - [Pod Pod ctest-pod-78901148] Cmd wget http://10.98.151.56:80/ -O - -T 5 -t 1 passed 2026-02-04 09:47:36,217 - DEBUG - [Pod Pod ctest-pod-78901148] Cmd output: Connecting to 10.98.151.56:80 (10.98.151.56:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-52709566 2026-02-04 09:47:36,273 - DEBUG - [Pod ctest-pod-78901148] Cmd: wget http://10.98.151.56:80/ -O - -T 5 -t 1 , Output: ctest-pod-16721773 Connecting to 10.98.151.56:80 (10.98.151.56:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-04 09:47:36,273 - DEBUG - [Pod Pod ctest-pod-78901148] Cmd wget http://10.98.151.56:80/ -O - -T 5 -t 1 passed 2026-02-04 09:47:36,273 - DEBUG - [Pod Pod ctest-pod-78901148] Cmd output: ctest-pod-16721773 Connecting to 10.98.151.56:80 (10.98.151.56:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-04 09:47:36,273 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-16721773': 1, 'ctest-pod-52709566': 1} 2026-02-04 09:47:36,278 - DEBUG - Network policy ingress-on-service not present 2026-02-04 09:47:36,278 - INFO - Creating Network Policy ingress-on-service 2026-02-04 09:47:36,296 - INFO - Network policy found in k8s 2026-02-04 09:47:36,296 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=a6e34175-8be2-48bf-bec8-eef35adc37bb 2026-02-04 09:47:36,302 - INFO - Network Policy ingress-on-service with uuid a6e34175-8be2-48bf-bec8-eef35adc37bb found in kube manager 2026-02-04 09:47:36,330 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2026-02-04 09:47:36,330 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2026-02-04 09:47:36,330 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=a6e34175-8be2-48bf-bec8-eef35adc37bb 2026-02-04 09:47:36,355 - WARNING - Network policy with name ingress-on-service not found in agent 2026-02-04 09:47:38,357 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=a6e34175-8be2-48bf-bec8-eef35adc37bb 2026-02-04 09:47:38,391 - INFO - Network policy with name ingress-on-service found in agent 2026-02-04 09:47:38,391 - INFO - Network Policy ingress-on-service verification passed 2026-02-04 09:47:43,448 - DEBUG - [Pod ctest-pod-24568058] Cmd: wget http://10.98.151.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:47:43,449 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd wget http://10.98.151.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:47:43,449 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:47:48,503 - DEBUG - [Pod ctest-pod-24568058] Cmd: wget http://10.98.151.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:47:48,503 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd wget http://10.98.151.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:47:48,503 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:47:53,557 - DEBUG - [Pod ctest-pod-24568058] Cmd: wget http://10.98.151.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:47:53,557 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd wget http://10.98.151.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:47:53,557 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:47:58,607 - DEBUG - [Pod ctest-pod-24568058] Cmd: wget http://10.98.151.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:47:58,607 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd wget http://10.98.151.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:47:58,607 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:48:03,662 - DEBUG - [Pod ctest-pod-24568058] Cmd: wget http://10.98.151.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:48:03,662 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd wget http://10.98.151.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:48:03,662 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:48:08,714 - DEBUG - [Pod ctest-pod-24568058] Cmd: wget http://10.98.151.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:48:08,714 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd wget http://10.98.151.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:48:08,714 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:48:13,764 - DEBUG - [Pod ctest-pod-24568058] Cmd: wget http://10.98.151.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:48:13,764 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd wget http://10.98.151.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:48:13,764 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:48:18,823 - DEBUG - [Pod ctest-pod-24568058] Cmd: wget http://10.98.151.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:48:18,823 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd wget http://10.98.151.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:48:18,823 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:48:23,876 - DEBUG - [Pod ctest-pod-24568058] Cmd: wget http://10.98.151.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:48:23,876 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd wget http://10.98.151.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:48:23,876 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:48:28,926 - DEBUG - [Pod ctest-pod-24568058] Cmd: wget http://10.98.151.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:48:28,927 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd wget http://10.98.151.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:48:28,927 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:48:28,927 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-16721773': 0, 'ctest-pod-52709566': 0} 2026-02-04 09:48:28,991 - DEBUG - [Pod ctest-pod-60840314] Cmd: wget http://10.98.151.56:80/ -O - -T 5 -t 1 , Output: ctest-pod-52709566 Connecting to 10.98.151.56:80 (10.98.151.56:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-04 09:48:28,991 - DEBUG - [Pod Pod ctest-pod-60840314] Cmd wget http://10.98.151.56:80/ -O - -T 5 -t 1 passed 2026-02-04 09:48:28,991 - DEBUG - [Pod Pod ctest-pod-60840314] Cmd output: ctest-pod-52709566 Connecting to 10.98.151.56:80 (10.98.151.56:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-04 09:48:29,046 - DEBUG - [Pod ctest-pod-60840314] Cmd: wget http://10.98.151.56:80/ -O - -T 5 -t 1 , Output: ctest-pod-16721773 Connecting to 10.98.151.56:80 (10.98.151.56:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-04 09:48:29,046 - DEBUG - [Pod Pod ctest-pod-60840314] Cmd wget http://10.98.151.56:80/ -O - -T 5 -t 1 passed 2026-02-04 09:48:29,046 - DEBUG - [Pod Pod ctest-pod-60840314] Cmd output: ctest-pod-16721773 Connecting to 10.98.151.56:80 (10.98.151.56:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-04 09:48:29,046 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-16721773': 1, 'ctest-pod-52709566': 1} 2026-02-04 09:48:34,099 - DEBUG - [Pod ctest-pod-78901148] Cmd: wget http://10.98.151.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:48:34,099 - DEBUG - [Pod Pod ctest-pod-78901148] Cmd wget http://10.98.151.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:48:34,099 - DEBUG - [Pod Pod ctest-pod-78901148] Cmd output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:48:39,157 - DEBUG - [Pod ctest-pod-78901148] Cmd: wget http://10.98.151.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:48:39,157 - DEBUG - [Pod Pod ctest-pod-78901148] Cmd wget http://10.98.151.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:48:39,157 - DEBUG - [Pod Pod ctest-pod-78901148] Cmd output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:48:44,207 - DEBUG - [Pod ctest-pod-78901148] Cmd: wget http://10.98.151.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:48:44,207 - DEBUG - [Pod Pod ctest-pod-78901148] Cmd wget http://10.98.151.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:48:44,207 - DEBUG - [Pod Pod ctest-pod-78901148] Cmd output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:48:49,259 - DEBUG - [Pod ctest-pod-78901148] Cmd: wget http://10.98.151.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:48:49,259 - DEBUG - [Pod Pod ctest-pod-78901148] Cmd wget http://10.98.151.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:48:49,259 - DEBUG - [Pod Pod ctest-pod-78901148] Cmd output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:48:54,311 - DEBUG - [Pod ctest-pod-78901148] Cmd: wget http://10.98.151.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:48:54,311 - DEBUG - [Pod Pod ctest-pod-78901148] Cmd wget http://10.98.151.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:48:54,311 - DEBUG - [Pod Pod ctest-pod-78901148] Cmd output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:48:59,366 - DEBUG - [Pod ctest-pod-78901148] Cmd: wget http://10.98.151.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:48:59,366 - DEBUG - [Pod Pod ctest-pod-78901148] Cmd wget http://10.98.151.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:48:59,366 - DEBUG - [Pod Pod ctest-pod-78901148] Cmd output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:49:04,432 - DEBUG - [Pod ctest-pod-78901148] Cmd: wget http://10.98.151.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:49:04,432 - DEBUG - [Pod Pod ctest-pod-78901148] Cmd wget http://10.98.151.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:49:04,432 - DEBUG - [Pod Pod ctest-pod-78901148] Cmd output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:49:09,487 - DEBUG - [Pod ctest-pod-78901148] Cmd: wget http://10.98.151.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:49:09,488 - DEBUG - [Pod Pod ctest-pod-78901148] Cmd wget http://10.98.151.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:49:09,488 - DEBUG - [Pod Pod ctest-pod-78901148] Cmd output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:49:14,539 - DEBUG - [Pod ctest-pod-78901148] Cmd: wget http://10.98.151.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:49:14,539 - DEBUG - [Pod Pod ctest-pod-78901148] Cmd wget http://10.98.151.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:49:14,539 - DEBUG - [Pod Pod ctest-pod-78901148] Cmd output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:49:19,594 - DEBUG - [Pod ctest-pod-78901148] Cmd: wget http://10.98.151.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:49:19,595 - DEBUG - [Pod Pod ctest-pod-78901148] Cmd wget http://10.98.151.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:49:19,595 - DEBUG - [Pod Pod ctest-pod-78901148] Cmd output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:49:19,595 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-16721773': 0, 'ctest-pod-52709566': 0} 2026-02-04 09:49:21,647 - DEBUG - [Pod ctest-pod-60840314] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.863 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.079 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.073 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.073/0.338/0.863 ms 2026-02-04 09:49:21,647 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-60840314 with expectation True passed 2026-02-04 09:49:23,704 - DEBUG - [Pod ctest-pod-24568058] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.771 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.082 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.096 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.082/0.316/0.771 ms 2026-02-04 09:49:23,704 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-24568058 with expectation True passed 2026-02-04 09:49:25,751 - DEBUG - [Pod ctest-pod-78901148] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.495 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.099 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.084 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.084/0.559/1.495 ms 2026-02-04 09:49:25,751 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-78901148 with expectation True passed 2026-02-04 09:49:25,805 - DEBUG - [Pod ctest-pod-60840314] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-04 09:49:25,806 - DEBUG - [Pod Pod ctest-pod-60840314] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2026-02-04 09:49:25,806 - DEBUG - [Pod Pod ctest-pod-60840314] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-04 09:49:25,806 - INFO - wget check of of http://10.47.255.251 from ctest-pod-60840314 passed 2026-02-04 09:49:25,869 - DEBUG - [Pod ctest-pod-60840314] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-04 09:49:25,869 - DEBUG - [Pod Pod ctest-pod-60840314] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-04 09:49:25,869 - DEBUG - [Pod Pod ctest-pod-60840314] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-04 09:49:25,869 - INFO - wget check of of http://10.47.255.250 from ctest-pod-60840314 passed 2026-02-04 09:49:30,924 - DEBUG - [Pod ctest-pod-24568058] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2026-02-04 09:49:30,924 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2026-02-04 09:49:30,924 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2026-02-04 09:49:30,924 - INFO - wget check of of http://10.47.255.250 from ctest-pod-24568058 passed 2026-02-04 09:49:35,977 - DEBUG - [Pod ctest-pod-62359897] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2026-02-04 09:49:35,977 - DEBUG - [Pod Pod ctest-pod-62359897] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2026-02-04 09:49:35,977 - DEBUG - [Pod Pod ctest-pod-62359897] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2026-02-04 09:49:35,977 - INFO - wget check of of http://10.47.255.251 from ctest-pod-62359897 passed 2026-02-04 09:49:35,985 - INFO - Updating Network Policy ingress-on-service 2026-02-04 09:49:41,060 - DEBUG - [Pod ctest-pod-24568058] Cmd: wget http://10.98.151.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:49:41,060 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd wget http://10.98.151.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:49:41,060 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:49:46,112 - DEBUG - [Pod ctest-pod-24568058] Cmd: wget http://10.98.151.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:49:46,112 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd wget http://10.98.151.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:49:46,112 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:49:51,167 - DEBUG - [Pod ctest-pod-24568058] Cmd: wget http://10.98.151.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:49:51,167 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd wget http://10.98.151.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:49:51,168 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:49:56,215 - DEBUG - [Pod ctest-pod-24568058] Cmd: wget http://10.98.151.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:49:56,215 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd wget http://10.98.151.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:49:56,215 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:50:01,268 - DEBUG - [Pod ctest-pod-24568058] Cmd: wget http://10.98.151.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:50:01,268 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd wget http://10.98.151.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:50:01,268 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:50:06,328 - DEBUG - [Pod ctest-pod-24568058] Cmd: wget http://10.98.151.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:50:06,329 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd wget http://10.98.151.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:50:06,329 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:50:11,380 - DEBUG - [Pod ctest-pod-24568058] Cmd: wget http://10.98.151.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:50:11,380 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd wget http://10.98.151.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:50:11,380 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:50:14,392 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2026-02-04 09:50:24,458 - DEBUG - [Pod ctest-pod-24568058] Cmd: wget http://10.98.151.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:50:24,459 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd wget http://10.98.151.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:50:24,459 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:50:29,514 - DEBUG - [Pod ctest-pod-24568058] Cmd: wget http://10.98.151.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:50:29,514 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd wget http://10.98.151.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:50:29,514 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:50:34,571 - DEBUG - [Pod ctest-pod-24568058] Cmd: wget http://10.98.151.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:50:34,571 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd wget http://10.98.151.56:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:50:34,571 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd output: Connecting to 10.98.151.56:80 (10.98.151.56:80) wget: download timed out 2026-02-04 09:50:34,571 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-16721773': 0, 'ctest-pod-52709566': 0} 2026-02-04 09:50:34,632 - DEBUG - [Pod ctest-pod-60840314] Cmd: wget http://10.98.151.56:80/ -O - -T 5 -t 1 , Output: ctest-pod-52709566 Connecting to 10.98.151.56:80 (10.98.151.56:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-04 09:50:34,633 - DEBUG - [Pod Pod ctest-pod-60840314] Cmd wget http://10.98.151.56:80/ -O - -T 5 -t 1 passed 2026-02-04 09:50:34,633 - DEBUG - [Pod Pod ctest-pod-60840314] Cmd output: ctest-pod-52709566 Connecting to 10.98.151.56:80 (10.98.151.56:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-04 09:50:34,702 - DEBUG - [Pod ctest-pod-60840314] Cmd: wget http://10.98.151.56:80/ -O - -T 5 -t 1 , Output: ctest-pod-16721773 Connecting to 10.98.151.56:80 (10.98.151.56:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-04 09:50:34,702 - DEBUG - [Pod Pod ctest-pod-60840314] Cmd wget http://10.98.151.56:80/ -O - -T 5 -t 1 passed 2026-02-04 09:50:34,702 - DEBUG - [Pod Pod ctest-pod-60840314] Cmd output: ctest-pod-16721773 Connecting to 10.98.151.56:80 (10.98.151.56:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-04 09:50:34,702 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-16721773': 1, 'ctest-pod-52709566': 1} 2026-02-04 09:50:34,785 - DEBUG - [Pod ctest-pod-78901148] Cmd: wget http://10.98.151.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.151.56:80 (10.98.151.56:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-16721773 2026-02-04 09:50:34,785 - DEBUG - [Pod Pod ctest-pod-78901148] Cmd wget http://10.98.151.56:80/ -O - -T 5 -t 1 passed 2026-02-04 09:50:34,785 - DEBUG - [Pod Pod ctest-pod-78901148] Cmd output: Connecting to 10.98.151.56:80 (10.98.151.56:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-16721773 2026-02-04 09:50:34,848 - DEBUG - [Pod ctest-pod-78901148] Cmd: wget http://10.98.151.56:80/ -O - -T 5 -t 1 , Output: ctest-pod-16721773 Connecting to 10.98.151.56:80 (10.98.151.56:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-04 09:50:34,848 - DEBUG - [Pod Pod ctest-pod-78901148] Cmd wget http://10.98.151.56:80/ -O - -T 5 -t 1 passed 2026-02-04 09:50:34,848 - DEBUG - [Pod Pod ctest-pod-78901148] Cmd output: ctest-pod-16721773 Connecting to 10.98.151.56:80 (10.98.151.56:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-04 09:50:34,917 - DEBUG - [Pod ctest-pod-78901148] Cmd: wget http://10.98.151.56:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.151.56:80 (10.98.151.56:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-52709566 2026-02-04 09:50:34,917 - DEBUG - [Pod Pod ctest-pod-78901148] Cmd wget http://10.98.151.56:80/ -O - -T 5 -t 1 passed 2026-02-04 09:50:34,917 - DEBUG - [Pod Pod ctest-pod-78901148] Cmd output: Connecting to 10.98.151.56:80 (10.98.151.56:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-52709566 2026-02-04 09:50:34,917 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-16721773': 2, 'ctest-pod-52709566': 1} 2026-02-04 09:50:36,978 - DEBUG - [Pod ctest-pod-60840314] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.433 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.083 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.090 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.083/0.202/0.433 ms 2026-02-04 09:50:36,979 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-60840314 with expectation True passed 2026-02-04 09:50:39,033 - DEBUG - [Pod ctest-pod-24568058] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.713 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.064 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.122 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.064/0.299/0.713 ms 2026-02-04 09:50:39,033 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-24568058 with expectation True passed 2026-02-04 09:50:41,090 - DEBUG - [Pod ctest-pod-78901148] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.576 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.105 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.090 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.090/0.257/0.576 ms 2026-02-04 09:50:41,091 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-78901148 with expectation True passed 2026-02-04 09:50:41,254 - DEBUG - [Pod ctest-pod-60840314] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-04 09:50:41,254 - DEBUG - [Pod Pod ctest-pod-60840314] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2026-02-04 09:50:41,254 - DEBUG - [Pod Pod ctest-pod-60840314] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-04 09:50:41,254 - INFO - wget check of of http://10.47.255.251 from ctest-pod-60840314 passed 2026-02-04 09:50:41,310 - DEBUG - [Pod ctest-pod-60840314] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-04 09:50:41,363 - DEBUG - [Pod Pod ctest-pod-60840314] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-04 09:50:41,363 - DEBUG - [Pod Pod ctest-pod-60840314] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-04 09:50:41,363 - INFO - wget check of of http://10.47.255.250 from ctest-pod-60840314 passed 2026-02-04 09:50:46,415 - DEBUG - [Pod ctest-pod-24568058] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2026-02-04 09:50:46,415 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2026-02-04 09:50:46,415 - DEBUG - [Pod Pod ctest-pod-24568058] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2026-02-04 09:50:46,415 - INFO - wget check of of http://10.47.255.250 from ctest-pod-24568058 passed 2026-02-04 09:50:46,469 - DEBUG - [Pod ctest-pod-62359897] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-04 09:50:46,469 - DEBUG - [Pod Pod ctest-pod-62359897] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2026-02-04 09:50:46,469 - DEBUG - [Pod Pod ctest-pod-62359897] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-04 09:50:46,469 - INFO - wget check of of http://10.47.255.251 from ctest-pod-62359897 passed 2026-02-04 09:50:46,470 - INFO - Deleting Network Policy : ingress-on-service 2026-02-04 09:50:46,471 - INFO - Deleting service : ctest-nginx-svc-12990688 2026-02-04 09:50:46,727 - DEBUG - No XMPP flaps were noticed during the test