2026-01-13 01:22:11,059 - INFO - Using existing project ['default-domain', 'k8s-default'](4effb4b9-b457-42f2-993e-05256e1f45e1) 2026-01-13 01:22:11,076 - DEBUG - Namespace ctest-new-default-93509249 not present 2026-01-13 01:22:11,083 - INFO - Created namespace ctest-new-default-93509249 2026-01-13 01:22:14,086 - DEBUG - Namespace ctest-non-default-66301112 not present 2026-01-13 01:22:14,091 - INFO - Created namespace ctest-non-default-66301112 2026-01-13 01:22:17,115 - DEBUG - Pod ctest-pod-89987346 not present 2026-01-13 01:22:17,115 - INFO - Creating Pod ctest-pod-89987346 2026-01-13 01:22:17,140 - DEBUG - Pod : ctest-pod-89987346 UUID is 93e4846f-5713-41a6-95cb-fa0771840c98 2026-01-13 01:22:17,145 - DEBUG - Pod ctest-pod-67311895 not present 2026-01-13 01:22:17,147 - INFO - Creating Pod ctest-pod-67311895 2026-01-13 01:22:17,191 - DEBUG - Pod : ctest-pod-67311895 UUID is 1e432bde-1961-4462-acfa-b3b63aa8318d 2026-01-13 01:22:17,193 - DEBUG - Pod ctest-pod-89045891 not present 2026-01-13 01:22:17,194 - INFO - Creating Pod ctest-pod-89045891 2026-01-13 01:22:17,216 - DEBUG - Pod : ctest-pod-89045891 UUID is b342fe07-7e92-42f9-8953-d8d026d27b8d 2026-01-13 01:22:17,220 - DEBUG - Pod ctest-pod-32802169 not present 2026-01-13 01:22:17,221 - INFO - Creating Pod ctest-pod-32802169 2026-01-13 01:22:17,239 - DEBUG - Pod : ctest-pod-32802169 UUID is 1705bbec-e996-476b-a17b-b6ad55ade81d 2026-01-13 01:22:17,245 - DEBUG - Pod ctest-pod-03512710 not present 2026-01-13 01:22:17,245 - INFO - Creating Pod ctest-pod-03512710 2026-01-13 01:22:17,267 - DEBUG - Pod : ctest-pod-03512710 UUID is 49069340-1d5e-44a8-972e-494f3e3fc8f0 2026-01-13 01:22:17,269 - DEBUG - Pod ctest-pod-55079125 not present 2026-01-13 01:22:17,269 - INFO - Creating Pod ctest-pod-55079125 2026-01-13 01:22:17,305 - DEBUG - Pod : ctest-pod-55079125 UUID is 22259ecd-9c79-4c72-bf09-f284d2b0fe8f 2026-01-13 01:22:17,308 - DEBUG - Pod ctest-pod-05481823 not present 2026-01-13 01:22:17,308 - INFO - Creating Pod ctest-pod-05481823 2026-01-13 01:22:17,325 - DEBUG - Pod : ctest-pod-05481823 UUID is 859e9402-35e1-4b9a-b1d5-d30e7b7c4ad6 2026-01-13 01:22:17,326 - DEBUG - Pod ctest-pod-70531961 not present 2026-01-13 01:22:17,327 - INFO - Creating Pod ctest-pod-70531961 2026-01-13 01:22:17,345 - DEBUG - Pod : ctest-pod-70531961 UUID is 05b3d269-883b-40f9-ac69-0751f6d4f8eb 2026-01-13 01:22:17,544 - INFO - Project default-domain:k8s-ctest-new-default-93509249 for Namespace ctest-new-default-93509249 is seen in contrail-api 2026-01-13 01:22:17,544 - DEBUG - Project uuid in Contrail is cfdb89f9-89e1-457c-b640-011d141ce169 2026-01-13 01:22:17,683 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=8a1e9e42-ff83-48d0-88c0-a56828621ba9 2026-01-13 01:22:17,690 - INFO - Namespace ctest-new-default-93509249 with uuid 8a1e9e42-ff83-48d0-88c0-a56828621ba9 found in kube manager 2026-01-13 01:22:17,690 - INFO - Namespace ctest-new-default-93509249 verification passed 2026-01-13 01:22:17,845 - INFO - Project default-domain:k8s-ctest-non-default-66301112 for Namespace ctest-non-default-66301112 is seen in contrail-api 2026-01-13 01:22:17,845 - DEBUG - Project uuid in Contrail is 52b96a2e-de04-427e-a5d7-778ccf9e54e2 2026-01-13 01:22:17,845 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=ad436e5d-054b-4aa5-91ea-9260415a3866 2026-01-13 01:22:17,849 - INFO - Namespace ctest-non-default-66301112 with uuid ad436e5d-054b-4aa5-91ea-9260415a3866 found in kube manager 2026-01-13 01:22:17,849 - INFO - Namespace ctest-non-default-66301112 verification passed 2026-01-13 01:22:17,857 - DEBUG - Pod ctest-pod-89987346 not in running state.Currently in Pending 2026-01-13 01:22:22,864 - DEBUG - Pod ctest-pod-89987346 not in running state.Currently in Pending 2026-01-13 01:22:27,872 - DEBUG - Pod ctest-pod-89987346 not in running state.Currently in Pending 2026-01-13 01:22:32,886 - INFO - Pod ctest-pod-89987346 is in running state.Got IP 10.47.255.251 2026-01-13 01:22:32,897 - DEBUG - Pod ctest-pod-89987346 has vmi 4d578b06-f01e-11f0-896b-fa163e641fed 2026-01-13 01:22:32,897 - INFO - Verified pod ctest-pod-89987346 in contrail-api 2026-01-13 01:22:32,912 - DEBUG - VMI 4d578b06-f01e-11f0-896b-fa163e641fed is active in agent 10.0.0.33 2026-01-13 01:22:32,912 - INFO - Verified Pod ctest-pod-89987346 in agent 10.0.0.33 2026-01-13 01:22:32,912 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=93e4846f-5713-41a6-95cb-fa0771840c98 2026-01-13 01:22:32,916 - INFO - Pod ctest-pod-89987346 with uuid 93e4846f-5713-41a6-95cb-fa0771840c98 found in kube manager 2026-01-13 01:22:32,916 - INFO - Pod ctest-pod-89987346 verification passed 2026-01-13 01:22:32,922 - INFO - Pod ctest-pod-67311895 is in running state.Got IP 10.47.255.250 2026-01-13 01:22:32,977 - DEBUG - Pod ctest-pod-67311895 has vmi 4dcc7204-f01e-11f0-896b-fa163e641fed 2026-01-13 01:22:32,977 - INFO - Verified pod ctest-pod-67311895 in contrail-api 2026-01-13 01:22:32,989 - DEBUG - VMI 4dcc7204-f01e-11f0-896b-fa163e641fed is active in agent 10.0.0.33 2026-01-13 01:22:32,989 - INFO - Verified Pod ctest-pod-67311895 in agent 10.0.0.33 2026-01-13 01:22:32,989 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=1e432bde-1961-4462-acfa-b3b63aa8318d 2026-01-13 01:22:32,992 - INFO - Pod ctest-pod-67311895 with uuid 1e432bde-1961-4462-acfa-b3b63aa8318d found in kube manager 2026-01-13 01:22:32,992 - INFO - Pod ctest-pod-67311895 verification passed 2026-01-13 01:22:32,999 - INFO - Pod ctest-pod-89045891 is in running state.Got IP 10.47.255.249 2026-01-13 01:22:33,055 - DEBUG - Pod ctest-pod-89045891 has vmi 4e64bef6-f01e-11f0-896b-fa163e641fed 2026-01-13 01:22:33,056 - INFO - Verified pod ctest-pod-89045891 in contrail-api 2026-01-13 01:22:33,067 - DEBUG - VMI 4e64bef6-f01e-11f0-896b-fa163e641fed is active in agent 10.0.0.33 2026-01-13 01:22:33,067 - INFO - Verified Pod ctest-pod-89045891 in agent 10.0.0.33 2026-01-13 01:22:33,068 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=b342fe07-7e92-42f9-8953-d8d026d27b8d 2026-01-13 01:22:33,071 - INFO - Pod ctest-pod-89045891 with uuid b342fe07-7e92-42f9-8953-d8d026d27b8d found in kube manager 2026-01-13 01:22:33,072 - INFO - Pod ctest-pod-89045891 verification passed 2026-01-13 01:22:33,077 - INFO - Pod ctest-pod-32802169 is in running state.Got IP 10.47.255.248 2026-01-13 01:22:33,088 - DEBUG - Pod ctest-pod-32802169 has vmi 4ecf3fe2-f01e-11f0-896b-fa163e641fed 2026-01-13 01:22:33,088 - INFO - Verified pod ctest-pod-32802169 in contrail-api 2026-01-13 01:22:33,099 - DEBUG - VMI 4ecf3fe2-f01e-11f0-896b-fa163e641fed is active in agent 10.0.0.33 2026-01-13 01:22:33,099 - INFO - Verified Pod ctest-pod-32802169 in agent 10.0.0.33 2026-01-13 01:22:33,099 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=1705bbec-e996-476b-a17b-b6ad55ade81d 2026-01-13 01:22:33,102 - INFO - Pod ctest-pod-32802169 with uuid 1705bbec-e996-476b-a17b-b6ad55ade81d found in kube manager 2026-01-13 01:22:33,102 - INFO - Pod ctest-pod-32802169 verification passed 2026-01-13 01:22:33,108 - DEBUG - Pod ctest-pod-03512710 not in running state.Currently in Pending 2026-01-13 01:22:38,115 - INFO - Pod ctest-pod-03512710 is in running state.Got IP 10.47.255.247 2026-01-13 01:22:38,167 - DEBUG - Pod ctest-pod-03512710 has vmi 4f4e1a88-f01e-11f0-896b-fa163e641fed 2026-01-13 01:22:38,167 - INFO - Verified pod ctest-pod-03512710 in contrail-api 2026-01-13 01:22:38,179 - DEBUG - VMI 4f4e1a88-f01e-11f0-896b-fa163e641fed is active in agent 10.0.0.33 2026-01-13 01:22:38,179 - INFO - Verified Pod ctest-pod-03512710 in agent 10.0.0.33 2026-01-13 01:22:38,179 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=49069340-1d5e-44a8-972e-494f3e3fc8f0 2026-01-13 01:22:38,183 - INFO - Pod ctest-pod-03512710 with uuid 49069340-1d5e-44a8-972e-494f3e3fc8f0 found in kube manager 2026-01-13 01:22:38,183 - INFO - Pod ctest-pod-03512710 verification passed 2026-01-13 01:22:38,188 - INFO - Pod ctest-pod-05481823 is in running state.Got IP 10.47.255.245 2026-01-13 01:22:38,198 - DEBUG - Pod ctest-pod-05481823 has vmi 50095cee-f01e-11f0-896b-fa163e641fed 2026-01-13 01:22:38,198 - INFO - Verified pod ctest-pod-05481823 in contrail-api 2026-01-13 01:22:38,212 - DEBUG - VMI 50095cee-f01e-11f0-896b-fa163e641fed is active in agent 10.0.0.33 2026-01-13 01:22:38,213 - INFO - Verified Pod ctest-pod-05481823 in agent 10.0.0.33 2026-01-13 01:22:38,213 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=859e9402-35e1-4b9a-b1d5-d30e7b7c4ad6 2026-01-13 01:22:38,216 - INFO - Pod ctest-pod-05481823 with uuid 859e9402-35e1-4b9a-b1d5-d30e7b7c4ad6 found in kube manager 2026-01-13 01:22:38,216 - INFO - Pod ctest-pod-05481823 verification passed 2026-01-13 01:22:38,221 - INFO - Pod ctest-pod-55079125 is in running state.Got IP 10.47.255.246 2026-01-13 01:22:38,273 - DEBUG - Pod ctest-pod-55079125 has vmi 4fabfb76-f01e-11f0-896b-fa163e641fed 2026-01-13 01:22:38,273 - INFO - Verified pod ctest-pod-55079125 in contrail-api 2026-01-13 01:22:38,285 - DEBUG - VMI 4fabfb76-f01e-11f0-896b-fa163e641fed is active in agent 10.0.0.33 2026-01-13 01:22:38,285 - INFO - Verified Pod ctest-pod-55079125 in agent 10.0.0.33 2026-01-13 01:22:38,286 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=22259ecd-9c79-4c72-bf09-f284d2b0fe8f 2026-01-13 01:22:38,289 - INFO - Pod ctest-pod-55079125 with uuid 22259ecd-9c79-4c72-bf09-f284d2b0fe8f found in kube manager 2026-01-13 01:22:38,289 - INFO - Pod ctest-pod-55079125 verification passed 2026-01-13 01:22:38,297 - INFO - Pod ctest-pod-70531961 is in running state.Got IP 10.47.255.244 2026-01-13 01:22:38,347 - DEBUG - Pod ctest-pod-70531961 has vmi 506d715c-f01e-11f0-896b-fa163e641fed 2026-01-13 01:22:38,348 - INFO - Verified pod ctest-pod-70531961 in contrail-api 2026-01-13 01:22:38,360 - DEBUG - VMI 506d715c-f01e-11f0-896b-fa163e641fed is active in agent 10.0.0.33 2026-01-13 01:22:38,360 - INFO - Verified Pod ctest-pod-70531961 in agent 10.0.0.33 2026-01-13 01:22:38,360 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=05b3d269-883b-40f9-ac69-0751f6d4f8eb 2026-01-13 01:22:38,364 - INFO - Pod ctest-pod-70531961 with uuid 05b3d269-883b-40f9-ac69-0751f6d4f8eb found in kube manager 2026-01-13 01:22:38,364 - INFO - Pod ctest-pod-70531961 verification passed 2026-01-13 01:22:38,365 - INFO - ================================================================================ 2026-01-13 01:22:38,365 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2026-01-13 01:22:38,365 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2026-01-13 01:22:38,512 - DEBUG - Nothing to compare xmpp stats {'10.0.0.33': {'10.0.0.22': '0'}} with 2026-01-13 01:22:38,512 - INFO - Initial checks done. Running the testcase now 2026-01-13 01:22:38,512 - INFO - 2026-01-13 01:22:38,573 - DEBUG - [Pod ctest-pod-89987346] Cmd: echo ctest-pod-89987346 > /usr/share/nginx/html/index.html, Output: 2026-01-13 01:22:38,631 - DEBUG - [Pod ctest-pod-67311895] Cmd: echo ctest-pod-67311895 > /usr/share/nginx/html/index.html, Output: 2026-01-13 01:22:38,683 - DEBUG - [Pod ctest-pod-89045891] Cmd: echo ctest-pod-89045891 > /usr/share/nginx/html/index.html, Output: 2026-01-13 01:22:38,751 - DEBUG - [Pod ctest-pod-32802169] Cmd: echo ctest-pod-32802169 > /usr/share/nginx/html/index.html, Output: 2026-01-13 01:22:38,754 - DEBUG - Service ctest-nginx-svc-09080594 not present 2026-01-13 01:22:38,754 - INFO - Creating service ctest-nginx-svc-09080594 2026-01-13 01:22:38,771 - INFO - Created Service ctest-nginx-svc-09080594 2026-01-13 01:22:38,777 - WARNING - Service UUID 8facffad-d16a-48f8-bd3b-c8c9f31c3c61 not yet found in contrail-api 2026-01-13 01:22:39,782 - INFO - Validated that Service ctest-nginx-svc-09080594 is seen in contrail-api 2026-01-13 01:22:39,782 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_LoadbalancerDatabaseList?x=8facffad-d16a-48f8-bd3b-c8c9f31c3c61 2026-01-13 01:22:39,786 - INFO - Service ctest-nginx-svc-09080594 with uuid 8facffad-d16a-48f8-bd3b-c8c9f31c3c61 found in kube manager 2026-01-13 01:22:39,786 - INFO - Service ctest-nginx-svc-09080594 verification passed 2026-01-13 01:22:39,852 - DEBUG - [Pod ctest-pod-03512710] Cmd: wget http://10.108.104.76:80/ -O - -T 5 -t 1 , Output: ctest-pod-67311895 Connecting to 10.108.104.76:80 (10.108.104.76:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-13 01:22:39,853 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd wget http://10.108.104.76:80/ -O - -T 5 -t 1 passed 2026-01-13 01:22:39,853 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd output: ctest-pod-67311895 Connecting to 10.108.104.76:80 (10.108.104.76:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-13 01:22:39,901 - DEBUG - [Pod ctest-pod-03512710] Cmd: wget http://10.108.104.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.104.76:80 (10.108.104.76:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-89987346 2026-01-13 01:22:39,901 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd wget http://10.108.104.76:80/ -O - -T 5 -t 1 passed 2026-01-13 01:22:39,901 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd output: Connecting to 10.108.104.76:80 (10.108.104.76:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-89987346 2026-01-13 01:22:39,901 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-89987346': 1, 'ctest-pod-67311895': 1} 2026-01-13 01:22:39,962 - DEBUG - [Pod ctest-pod-05481823] Cmd: wget http://10.108.104.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.104.76:80 (10.108.104.76:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-89987346 2026-01-13 01:22:39,962 - DEBUG - [Pod Pod ctest-pod-05481823] Cmd wget http://10.108.104.76:80/ -O - -T 5 -t 1 passed 2026-01-13 01:22:39,962 - DEBUG - [Pod Pod ctest-pod-05481823] Cmd output: Connecting to 10.108.104.76:80 (10.108.104.76:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-89987346 2026-01-13 01:22:40,012 - DEBUG - [Pod ctest-pod-05481823] Cmd: wget http://10.108.104.76:80/ -O - -T 5 -t 1 , Output: ctest-pod-67311895 Connecting to 10.108.104.76:80 (10.108.104.76:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-13 01:22:40,012 - DEBUG - [Pod Pod ctest-pod-05481823] Cmd wget http://10.108.104.76:80/ -O - -T 5 -t 1 passed 2026-01-13 01:22:40,012 - DEBUG - [Pod Pod ctest-pod-05481823] Cmd output: ctest-pod-67311895 Connecting to 10.108.104.76:80 (10.108.104.76:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-13 01:22:40,012 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-89987346': 1, 'ctest-pod-67311895': 1} 2026-01-13 01:22:40,015 - DEBUG - Network policy ingress-on-service not present 2026-01-13 01:22:40,016 - INFO - Creating Network Policy ingress-on-service 2026-01-13 01:22:40,028 - INFO - Network policy found in k8s 2026-01-13 01:22:40,028 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=92b72f80-78b0-48ff-9d61-3ca16df16753 2026-01-13 01:22:40,033 - INFO - Network Policy ingress-on-service with uuid 92b72f80-78b0-48ff-9d61-3ca16df16753 found in kube manager 2026-01-13 01:22:40,060 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2026-01-13 01:22:40,061 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2026-01-13 01:22:40,061 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=92b72f80-78b0-48ff-9d61-3ca16df16753 2026-01-13 01:22:40,082 - WARNING - Network policy with name ingress-on-service not found in agent 2026-01-13 01:22:42,083 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=92b72f80-78b0-48ff-9d61-3ca16df16753 2026-01-13 01:22:42,104 - INFO - Network policy with name ingress-on-service found in agent 2026-01-13 01:22:42,105 - INFO - Network Policy ingress-on-service verification passed 2026-01-13 01:22:47,159 - DEBUG - [Pod ctest-pod-03512710] Cmd: wget http://10.108.104.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:22:47,159 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd wget http://10.108.104.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:22:47,159 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:22:52,216 - DEBUG - [Pod ctest-pod-03512710] Cmd: wget http://10.108.104.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:22:52,216 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd wget http://10.108.104.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:22:52,216 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:22:57,270 - DEBUG - [Pod ctest-pod-03512710] Cmd: wget http://10.108.104.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:22:57,270 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd wget http://10.108.104.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:22:57,270 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:23:02,319 - DEBUG - [Pod ctest-pod-03512710] Cmd: wget http://10.108.104.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:23:02,319 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd wget http://10.108.104.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:23:02,319 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:23:07,368 - DEBUG - [Pod ctest-pod-03512710] Cmd: wget http://10.108.104.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:23:07,368 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd wget http://10.108.104.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:23:07,368 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:23:12,420 - DEBUG - [Pod ctest-pod-03512710] Cmd: wget http://10.108.104.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:23:12,420 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd wget http://10.108.104.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:23:12,420 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:23:17,466 - DEBUG - [Pod ctest-pod-03512710] Cmd: wget http://10.108.104.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:23:17,466 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd wget http://10.108.104.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:23:17,466 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:23:22,518 - DEBUG - [Pod ctest-pod-03512710] Cmd: wget http://10.108.104.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:23:22,518 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd wget http://10.108.104.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:23:22,518 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:23:27,571 - DEBUG - [Pod ctest-pod-03512710] Cmd: wget http://10.108.104.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:23:27,571 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd wget http://10.108.104.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:23:27,571 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:23:32,623 - DEBUG - [Pod ctest-pod-03512710] Cmd: wget http://10.108.104.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:23:32,623 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd wget http://10.108.104.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:23:32,623 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:23:32,623 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-89987346': 0, 'ctest-pod-67311895': 0} 2026-01-13 01:23:32,675 - DEBUG - [Pod ctest-pod-55079125] Cmd: wget http://10.108.104.76:80/ -O - -T 5 -t 1 , Output: ctest-pod-89987346 Connecting to 10.108.104.76:80 (10.108.104.76:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-13 01:23:32,675 - DEBUG - [Pod Pod ctest-pod-55079125] Cmd wget http://10.108.104.76:80/ -O - -T 5 -t 1 passed 2026-01-13 01:23:32,675 - DEBUG - [Pod Pod ctest-pod-55079125] Cmd output: ctest-pod-89987346 Connecting to 10.108.104.76:80 (10.108.104.76:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-13 01:23:32,724 - DEBUG - [Pod ctest-pod-55079125] Cmd: wget http://10.108.104.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.104.76:80 (10.108.104.76:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-89987346 2026-01-13 01:23:32,724 - DEBUG - [Pod Pod ctest-pod-55079125] Cmd wget http://10.108.104.76:80/ -O - -T 5 -t 1 passed 2026-01-13 01:23:32,724 - DEBUG - [Pod Pod ctest-pod-55079125] Cmd output: Connecting to 10.108.104.76:80 (10.108.104.76:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-89987346 2026-01-13 01:23:32,777 - DEBUG - [Pod ctest-pod-55079125] Cmd: wget http://10.108.104.76:80/ -O - -T 5 -t 1 , Output: ctest-pod-89987346 Connecting to 10.108.104.76:80 (10.108.104.76:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-13 01:23:32,777 - DEBUG - [Pod Pod ctest-pod-55079125] Cmd wget http://10.108.104.76:80/ -O - -T 5 -t 1 passed 2026-01-13 01:23:32,777 - DEBUG - [Pod Pod ctest-pod-55079125] Cmd output: ctest-pod-89987346 Connecting to 10.108.104.76:80 (10.108.104.76:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-13 01:23:32,831 - DEBUG - [Pod ctest-pod-55079125] Cmd: wget http://10.108.104.76:80/ -O - -T 5 -t 1 , Output: ctest-pod-67311895 Connecting to 10.108.104.76:80 (10.108.104.76:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-13 01:23:32,831 - DEBUG - [Pod Pod ctest-pod-55079125] Cmd wget http://10.108.104.76:80/ -O - -T 5 -t 1 passed 2026-01-13 01:23:32,831 - DEBUG - [Pod Pod ctest-pod-55079125] Cmd output: ctest-pod-67311895 Connecting to 10.108.104.76:80 (10.108.104.76:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-13 01:23:32,831 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-89987346': 3, 'ctest-pod-67311895': 1} 2026-01-13 01:23:37,883 - DEBUG - [Pod ctest-pod-05481823] Cmd: wget http://10.108.104.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:23:37,883 - DEBUG - [Pod Pod ctest-pod-05481823] Cmd wget http://10.108.104.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:23:37,883 - DEBUG - [Pod Pod ctest-pod-05481823] Cmd output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:23:42,943 - DEBUG - [Pod ctest-pod-05481823] Cmd: wget http://10.108.104.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:23:42,943 - DEBUG - [Pod Pod ctest-pod-05481823] Cmd wget http://10.108.104.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:23:42,943 - DEBUG - [Pod Pod ctest-pod-05481823] Cmd output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:23:47,994 - DEBUG - [Pod ctest-pod-05481823] Cmd: wget http://10.108.104.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:23:47,994 - DEBUG - [Pod Pod ctest-pod-05481823] Cmd wget http://10.108.104.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:23:47,995 - DEBUG - [Pod Pod ctest-pod-05481823] Cmd output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:23:53,047 - DEBUG - [Pod ctest-pod-05481823] Cmd: wget http://10.108.104.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:23:53,047 - DEBUG - [Pod Pod ctest-pod-05481823] Cmd wget http://10.108.104.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:23:53,047 - DEBUG - [Pod Pod ctest-pod-05481823] Cmd output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:23:58,098 - DEBUG - [Pod ctest-pod-05481823] Cmd: wget http://10.108.104.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:23:58,098 - DEBUG - [Pod Pod ctest-pod-05481823] Cmd wget http://10.108.104.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:23:58,098 - DEBUG - [Pod Pod ctest-pod-05481823] Cmd output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:24:03,146 - DEBUG - [Pod ctest-pod-05481823] Cmd: wget http://10.108.104.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:24:03,146 - DEBUG - [Pod Pod ctest-pod-05481823] Cmd wget http://10.108.104.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:24:03,146 - DEBUG - [Pod Pod ctest-pod-05481823] Cmd output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:24:08,199 - DEBUG - [Pod ctest-pod-05481823] Cmd: wget http://10.108.104.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:24:08,199 - DEBUG - [Pod Pod ctest-pod-05481823] Cmd wget http://10.108.104.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:24:08,199 - DEBUG - [Pod Pod ctest-pod-05481823] Cmd output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:24:13,258 - DEBUG - [Pod ctest-pod-05481823] Cmd: wget http://10.108.104.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:24:13,258 - DEBUG - [Pod Pod ctest-pod-05481823] Cmd wget http://10.108.104.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:24:13,258 - DEBUG - [Pod Pod ctest-pod-05481823] Cmd output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:24:16,720 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2026-01-13 01:24:26,778 - DEBUG - [Pod ctest-pod-05481823] Cmd: wget http://10.108.104.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:24:26,778 - DEBUG - [Pod Pod ctest-pod-05481823] Cmd wget http://10.108.104.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:24:26,778 - DEBUG - [Pod Pod ctest-pod-05481823] Cmd output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:24:31,832 - DEBUG - [Pod ctest-pod-05481823] Cmd: wget http://10.108.104.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:24:31,832 - DEBUG - [Pod Pod ctest-pod-05481823] Cmd wget http://10.108.104.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:24:31,832 - DEBUG - [Pod Pod ctest-pod-05481823] Cmd output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:24:31,832 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-89987346': 0, 'ctest-pod-67311895': 0} 2026-01-13 01:24:33,883 - DEBUG - [Pod ctest-pod-55079125] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.678 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.081 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.082 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.081/0.280/0.678 ms 2026-01-13 01:24:33,883 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-55079125 with expectation True passed 2026-01-13 01:24:35,943 - DEBUG - [Pod ctest-pod-03512710] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.445 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.075 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.080 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.075/0.200/0.445 ms 2026-01-13 01:24:35,943 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-03512710 with expectation True passed 2026-01-13 01:24:37,998 - DEBUG - [Pod ctest-pod-05481823] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.992 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.102 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.096 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.096/0.396/0.992 ms 2026-01-13 01:24:37,998 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-05481823 with expectation True passed 2026-01-13 01:24:38,054 - DEBUG - [Pod ctest-pod-55079125] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-01-13 01:24:38,054 - DEBUG - [Pod Pod ctest-pod-55079125] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2026-01-13 01:24:38,054 - DEBUG - [Pod Pod ctest-pod-55079125] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-01-13 01:24:38,054 - INFO - wget check of of http://10.47.255.251 from ctest-pod-55079125 passed 2026-01-13 01:24:38,107 - DEBUG - [Pod ctest-pod-55079125] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-01-13 01:24:38,107 - DEBUG - [Pod Pod ctest-pod-55079125] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-01-13 01:24:38,107 - DEBUG - [Pod Pod ctest-pod-55079125] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-01-13 01:24:38,107 - INFO - wget check of of http://10.47.255.250 from ctest-pod-55079125 passed 2026-01-13 01:24:43,158 - DEBUG - [Pod ctest-pod-03512710] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2026-01-13 01:24:43,158 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2026-01-13 01:24:43,159 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2026-01-13 01:24:43,159 - INFO - wget check of of http://10.47.255.250 from ctest-pod-03512710 passed 2026-01-13 01:24:48,221 - DEBUG - [Pod ctest-pod-70531961] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2026-01-13 01:24:48,266 - DEBUG - [Pod Pod ctest-pod-70531961] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2026-01-13 01:24:48,266 - DEBUG - [Pod Pod ctest-pod-70531961] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2026-01-13 01:24:48,266 - INFO - wget check of of http://10.47.255.251 from ctest-pod-70531961 passed 2026-01-13 01:24:48,274 - INFO - Updating Network Policy ingress-on-service 2026-01-13 01:24:53,554 - DEBUG - [Pod ctest-pod-03512710] Cmd: wget http://10.108.104.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:24:53,554 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd wget http://10.108.104.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:24:53,554 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:24:58,602 - DEBUG - [Pod ctest-pod-03512710] Cmd: wget http://10.108.104.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:24:58,602 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd wget http://10.108.104.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:24:58,602 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:25:03,654 - DEBUG - [Pod ctest-pod-03512710] Cmd: wget http://10.108.104.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:25:03,654 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd wget http://10.108.104.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:25:03,654 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:25:08,706 - DEBUG - [Pod ctest-pod-03512710] Cmd: wget http://10.108.104.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:25:08,706 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd wget http://10.108.104.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:25:08,706 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:25:13,749 - DEBUG - [Pod ctest-pod-03512710] Cmd: wget http://10.108.104.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:25:13,749 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd wget http://10.108.104.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:25:13,749 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:25:18,794 - DEBUG - [Pod ctest-pod-03512710] Cmd: wget http://10.108.104.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:25:18,794 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd wget http://10.108.104.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:25:18,794 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:25:23,846 - DEBUG - [Pod ctest-pod-03512710] Cmd: wget http://10.108.104.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:25:23,846 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd wget http://10.108.104.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:25:23,846 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:25:28,895 - DEBUG - [Pod ctest-pod-03512710] Cmd: wget http://10.108.104.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:25:28,895 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd wget http://10.108.104.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:25:28,895 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:25:33,955 - DEBUG - [Pod ctest-pod-03512710] Cmd: wget http://10.108.104.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:25:33,955 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd wget http://10.108.104.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:25:33,955 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:25:39,002 - DEBUG - [Pod ctest-pod-03512710] Cmd: wget http://10.108.104.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:25:39,002 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd wget http://10.108.104.76:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:25:39,002 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd output: Connecting to 10.108.104.76:80 (10.108.104.76:80) wget: download timed out 2026-01-13 01:25:39,002 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-89987346': 0, 'ctest-pod-67311895': 0} 2026-01-13 01:25:39,047 - DEBUG - [Pod ctest-pod-55079125] Cmd: wget http://10.108.104.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.104.76:80 (10.108.104.76:80) ctest-pod-89987346 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-13 01:25:39,048 - DEBUG - [Pod Pod ctest-pod-55079125] Cmd wget http://10.108.104.76:80/ -O - -T 5 -t 1 passed 2026-01-13 01:25:39,048 - DEBUG - [Pod Pod ctest-pod-55079125] Cmd output: Connecting to 10.108.104.76:80 (10.108.104.76:80) ctest-pod-89987346 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-13 01:25:39,120 - DEBUG - [Pod ctest-pod-55079125] Cmd: wget http://10.108.104.76:80/ -O - -T 5 -t 1 , Output: ctest-pod-67311895 Connecting to 10.108.104.76:80 (10.108.104.76:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-13 01:25:39,120 - DEBUG - [Pod Pod ctest-pod-55079125] Cmd wget http://10.108.104.76:80/ -O - -T 5 -t 1 passed 2026-01-13 01:25:39,120 - DEBUG - [Pod Pod ctest-pod-55079125] Cmd output: ctest-pod-67311895 Connecting to 10.108.104.76:80 (10.108.104.76:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-13 01:25:39,120 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-89987346': 1, 'ctest-pod-67311895': 1} 2026-01-13 01:25:39,202 - DEBUG - [Pod ctest-pod-05481823] Cmd: wget http://10.108.104.76:80/ -O - -T 5 -t 1 , Output: ctest-pod-89987346 Connecting to 10.108.104.76:80 (10.108.104.76:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-13 01:25:39,202 - DEBUG - [Pod Pod ctest-pod-05481823] Cmd wget http://10.108.104.76:80/ -O - -T 5 -t 1 passed 2026-01-13 01:25:39,202 - DEBUG - [Pod Pod ctest-pod-05481823] Cmd output: ctest-pod-89987346 Connecting to 10.108.104.76:80 (10.108.104.76:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-13 01:25:39,305 - DEBUG - [Pod ctest-pod-05481823] Cmd: wget http://10.108.104.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.104.76:80 (10.108.104.76:80) ctest-pod-89987346 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-13 01:25:39,306 - DEBUG - [Pod Pod ctest-pod-05481823] Cmd wget http://10.108.104.76:80/ -O - -T 5 -t 1 passed 2026-01-13 01:25:39,306 - DEBUG - [Pod Pod ctest-pod-05481823] Cmd output: Connecting to 10.108.104.76:80 (10.108.104.76:80) ctest-pod-89987346 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-13 01:25:39,388 - DEBUG - [Pod ctest-pod-05481823] Cmd: wget http://10.108.104.76:80/ -O - -T 5 -t 1 , Output: ctest-pod-89987346 Connecting to 10.108.104.76:80 (10.108.104.76:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-13 01:25:39,389 - DEBUG - [Pod Pod ctest-pod-05481823] Cmd wget http://10.108.104.76:80/ -O - -T 5 -t 1 passed 2026-01-13 01:25:39,389 - DEBUG - [Pod Pod ctest-pod-05481823] Cmd output: ctest-pod-89987346 Connecting to 10.108.104.76:80 (10.108.104.76:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-13 01:25:39,452 - DEBUG - [Pod ctest-pod-05481823] Cmd: wget http://10.108.104.76:80/ -O - -T 5 -t 1 , Output: ctest-pod-89987346 Connecting to 10.108.104.76:80 (10.108.104.76:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-13 01:25:39,452 - DEBUG - [Pod Pod ctest-pod-05481823] Cmd wget http://10.108.104.76:80/ -O - -T 5 -t 1 passed 2026-01-13 01:25:39,452 - DEBUG - [Pod Pod ctest-pod-05481823] Cmd output: ctest-pod-89987346 Connecting to 10.108.104.76:80 (10.108.104.76:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-01-13 01:25:39,508 - DEBUG - [Pod ctest-pod-05481823] Cmd: wget http://10.108.104.76:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.104.76:80 (10.108.104.76:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-67311895 2026-01-13 01:25:39,508 - DEBUG - [Pod Pod ctest-pod-05481823] Cmd wget http://10.108.104.76:80/ -O - -T 5 -t 1 passed 2026-01-13 01:25:39,508 - DEBUG - [Pod Pod ctest-pod-05481823] Cmd output: Connecting to 10.108.104.76:80 (10.108.104.76:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-67311895 2026-01-13 01:25:39,508 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-89987346': 4, 'ctest-pod-67311895': 1} 2026-01-13 01:25:41,567 - DEBUG - [Pod ctest-pod-55079125] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.506 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.069 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.092 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.069/0.555/1.506 ms 2026-01-13 01:25:41,567 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-55079125 with expectation True passed 2026-01-13 01:25:43,619 - DEBUG - [Pod ctest-pod-03512710] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.129 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.080 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.105 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.080/0.438/1.129 ms 2026-01-13 01:25:43,619 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-03512710 with expectation True passed 2026-01-13 01:25:45,670 - DEBUG - [Pod ctest-pod-05481823] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.752 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.088 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.090 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.088/0.310/0.752 ms 2026-01-13 01:25:45,670 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-05481823 with expectation True passed 2026-01-13 01:25:45,961 - DEBUG - [Pod ctest-pod-55079125] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-01-13 01:25:45,961 - DEBUG - [Pod Pod ctest-pod-55079125] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2026-01-13 01:25:45,961 - DEBUG - [Pod Pod ctest-pod-55079125] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-01-13 01:25:45,961 - INFO - wget check of of http://10.47.255.251 from ctest-pod-55079125 passed 2026-01-13 01:25:46,010 - DEBUG - [Pod ctest-pod-55079125] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-01-13 01:25:46,010 - DEBUG - [Pod Pod ctest-pod-55079125] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-01-13 01:25:46,010 - DEBUG - [Pod Pod ctest-pod-55079125] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-01-13 01:25:46,010 - INFO - wget check of of http://10.47.255.250 from ctest-pod-55079125 passed 2026-01-13 01:25:51,063 - DEBUG - [Pod ctest-pod-03512710] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2026-01-13 01:25:51,063 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2026-01-13 01:25:51,063 - DEBUG - [Pod Pod ctest-pod-03512710] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2026-01-13 01:25:51,063 - INFO - wget check of of http://10.47.255.250 from ctest-pod-03512710 passed 2026-01-13 01:25:51,116 - DEBUG - [Pod ctest-pod-70531961] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-01-13 01:25:51,117 - DEBUG - [Pod Pod ctest-pod-70531961] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2026-01-13 01:25:51,117 - DEBUG - [Pod Pod ctest-pod-70531961] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-01-13 01:25:51,117 - INFO - wget check of of http://10.47.255.251 from ctest-pod-70531961 passed 2026-01-13 01:25:51,117 - INFO - Deleting Network Policy : ingress-on-service 2026-01-13 01:25:51,118 - INFO - Deleting service : ctest-nginx-svc-09080594 2026-01-13 01:25:51,325 - DEBUG - No XMPP flaps were noticed during the test