2025-12-09 03:29:12,744 - INFO - Using existing project ['default-domain', 'k8s-default'](6f87e962-5db7-498d-bffe-c51c964f0771) 2025-12-09 03:29:12,763 - DEBUG - Namespace ctest-new-default-32592482 not present 2025-12-09 03:29:12,771 - INFO - Created namespace ctest-new-default-32592482 2025-12-09 03:29:15,775 - DEBUG - Namespace ctest-non-default-64400400 not present 2025-12-09 03:29:15,782 - INFO - Created namespace ctest-non-default-64400400 2025-12-09 03:29:18,800 - DEBUG - Pod ctest-pod-32966492 not present 2025-12-09 03:29:18,800 - INFO - Creating Pod ctest-pod-32966492 2025-12-09 03:29:18,855 - DEBUG - Pod : ctest-pod-32966492 UUID is eb2c8199-ce8d-4772-bcc9-f359ddb96224 2025-12-09 03:29:18,864 - DEBUG - Pod ctest-pod-75402815 not present 2025-12-09 03:29:18,864 - INFO - Creating Pod ctest-pod-75402815 2025-12-09 03:29:18,913 - DEBUG - Pod : ctest-pod-75402815 UUID is 98c4b2ff-2a20-43c9-bcee-449bf8495637 2025-12-09 03:29:18,930 - DEBUG - Pod ctest-pod-77375615 not present 2025-12-09 03:29:18,931 - INFO - Creating Pod ctest-pod-77375615 2025-12-09 03:29:18,967 - DEBUG - Pod : ctest-pod-77375615 UUID is ecc73522-141b-44aa-aaaf-9f10b0475571 2025-12-09 03:29:18,970 - DEBUG - Pod ctest-pod-47043717 not present 2025-12-09 03:29:18,970 - INFO - Creating Pod ctest-pod-47043717 2025-12-09 03:29:19,021 - DEBUG - Pod : ctest-pod-47043717 UUID is 6abb0524-1244-4116-aa61-a452c0cbb813 2025-12-09 03:29:19,024 - DEBUG - Pod ctest-pod-46935054 not present 2025-12-09 03:29:19,025 - INFO - Creating Pod ctest-pod-46935054 2025-12-09 03:29:19,057 - DEBUG - Pod : ctest-pod-46935054 UUID is 9c575a78-b520-413b-aa9c-5661da27bd75 2025-12-09 03:29:19,062 - DEBUG - Pod ctest-pod-95582129 not present 2025-12-09 03:29:19,063 - INFO - Creating Pod ctest-pod-95582129 2025-12-09 03:29:19,113 - DEBUG - Pod : ctest-pod-95582129 UUID is 3422a684-39a1-4daf-a8ef-9bab0767d90a 2025-12-09 03:29:19,116 - DEBUG - Pod ctest-pod-43938305 not present 2025-12-09 03:29:19,116 - INFO - Creating Pod ctest-pod-43938305 2025-12-09 03:29:19,145 - DEBUG - Pod : ctest-pod-43938305 UUID is b8c544b8-db61-4782-9ed7-c66f5b35ca6e 2025-12-09 03:29:19,148 - DEBUG - Pod ctest-pod-76242897 not present 2025-12-09 03:29:19,148 - INFO - Creating Pod ctest-pod-76242897 2025-12-09 03:29:19,181 - DEBUG - Pod : ctest-pod-76242897 UUID is 142407ea-5094-448e-a229-fb82b5bcac57 2025-12-09 03:29:19,479 - INFO - Project default-domain:k8s-ctest-new-default-32592482 for Namespace ctest-new-default-32592482 is seen in contrail-api 2025-12-09 03:29:19,479 - DEBUG - Project uuid in Contrail is c5cdf3ab-2495-4c52-9d03-5901250b7740 2025-12-09 03:29:19,652 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NamespaceDatabaseList?namespace_uuid=f46060b6-0311-48c5-9c9a-12a5924d7e9e 2025-12-09 03:29:19,657 - INFO - Namespace ctest-new-default-32592482 with uuid f46060b6-0311-48c5-9c9a-12a5924d7e9e found in kube manager 2025-12-09 03:29:19,657 - INFO - Namespace ctest-new-default-32592482 verification passed 2025-12-09 03:29:19,999 - INFO - Project default-domain:k8s-ctest-non-default-64400400 for Namespace ctest-non-default-64400400 is seen in contrail-api 2025-12-09 03:29:19,999 - DEBUG - Project uuid in Contrail is 1844ba2f-8699-42ac-b2d5-eaabd8fac2b5 2025-12-09 03:29:19,999 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NamespaceDatabaseList?namespace_uuid=01117214-440c-4313-ad00-9132cab44d61 2025-12-09 03:29:20,004 - INFO - Namespace ctest-non-default-64400400 with uuid 01117214-440c-4313-ad00-9132cab44d61 found in kube manager 2025-12-09 03:29:20,005 - INFO - Namespace ctest-non-default-64400400 verification passed 2025-12-09 03:29:20,014 - DEBUG - Pod ctest-pod-32966492 not in running state.Currently in Pending 2025-12-09 03:29:25,022 - DEBUG - Pod ctest-pod-32966492 not in running state.Currently in Pending 2025-12-09 03:29:30,030 - INFO - Pod ctest-pod-32966492 is in running state.Got IP 10.47.255.251 2025-12-09 03:29:30,042 - DEBUG - Pod ctest-pod-32966492 has vmi 401140d4-d4af-11f0-89fa-fa163ea48dd4 2025-12-09 03:29:30,042 - INFO - Verified pod ctest-pod-32966492 in contrail-api 2025-12-09 03:29:30,053 - DEBUG - VMI 401140d4-d4af-11f0-89fa-fa163ea48dd4 is active in agent 10.0.0.22 2025-12-09 03:29:30,054 - INFO - Verified Pod ctest-pod-32966492 in agent 10.0.0.22 2025-12-09 03:29:30,054 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=eb2c8199-ce8d-4772-bcc9-f359ddb96224 2025-12-09 03:29:30,058 - INFO - Pod ctest-pod-32966492 with uuid eb2c8199-ce8d-4772-bcc9-f359ddb96224 found in kube manager 2025-12-09 03:29:30,058 - INFO - Pod ctest-pod-32966492 verification passed 2025-12-09 03:29:30,064 - INFO - Pod ctest-pod-75402815 is in running state.Got IP 10.47.255.250 2025-12-09 03:29:30,122 - DEBUG - Pod ctest-pod-75402815 has vmi 409691a8-d4af-11f0-89fa-fa163ea48dd4 2025-12-09 03:29:30,122 - INFO - Verified pod ctest-pod-75402815 in contrail-api 2025-12-09 03:29:30,133 - DEBUG - VMI 409691a8-d4af-11f0-89fa-fa163ea48dd4 is active in agent 10.0.0.22 2025-12-09 03:29:30,133 - INFO - Verified Pod ctest-pod-75402815 in agent 10.0.0.22 2025-12-09 03:29:30,133 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=98c4b2ff-2a20-43c9-bcee-449bf8495637 2025-12-09 03:29:30,137 - INFO - Pod ctest-pod-75402815 with uuid 98c4b2ff-2a20-43c9-bcee-449bf8495637 found in kube manager 2025-12-09 03:29:30,137 - INFO - Pod ctest-pod-75402815 verification passed 2025-12-09 03:29:30,143 - DEBUG - Pod ctest-pod-77375615 not in running state.Currently in Pending 2025-12-09 03:29:35,156 - INFO - Pod ctest-pod-77375615 is in running state.Got IP 10.47.255.249 2025-12-09 03:29:35,179 - DEBUG - Pod ctest-pod-77375615 has vmi 41444d7a-d4af-11f0-89fa-fa163ea48dd4 2025-12-09 03:29:35,179 - INFO - Verified pod ctest-pod-77375615 in contrail-api 2025-12-09 03:29:35,191 - DEBUG - VMI 41444d7a-d4af-11f0-89fa-fa163ea48dd4 is active in agent 10.0.0.22 2025-12-09 03:29:35,191 - INFO - Verified Pod ctest-pod-77375615 in agent 10.0.0.22 2025-12-09 03:29:35,191 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=ecc73522-141b-44aa-aaaf-9f10b0475571 2025-12-09 03:29:35,196 - INFO - Pod ctest-pod-77375615 with uuid ecc73522-141b-44aa-aaaf-9f10b0475571 found in kube manager 2025-12-09 03:29:35,196 - INFO - Pod ctest-pod-77375615 verification passed 2025-12-09 03:29:35,202 - INFO - Pod ctest-pod-47043717 is in running state.Got IP 10.47.255.248 2025-12-09 03:29:35,267 - DEBUG - Pod ctest-pod-47043717 has vmi 41bacbd0-d4af-11f0-89fa-fa163ea48dd4 2025-12-09 03:29:35,267 - INFO - Verified pod ctest-pod-47043717 in contrail-api 2025-12-09 03:29:35,279 - DEBUG - VMI 41bacbd0-d4af-11f0-89fa-fa163ea48dd4 is active in agent 10.0.0.22 2025-12-09 03:29:35,279 - INFO - Verified Pod ctest-pod-47043717 in agent 10.0.0.22 2025-12-09 03:29:35,279 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=6abb0524-1244-4116-aa61-a452c0cbb813 2025-12-09 03:29:35,283 - INFO - Pod ctest-pod-47043717 with uuid 6abb0524-1244-4116-aa61-a452c0cbb813 found in kube manager 2025-12-09 03:29:35,283 - INFO - Pod ctest-pod-47043717 verification passed 2025-12-09 03:29:35,292 - INFO - Pod ctest-pod-46935054 is in running state.Got IP 10.47.255.247 2025-12-09 03:29:35,346 - DEBUG - Pod ctest-pod-46935054 has vmi 4241ac4a-d4af-11f0-89fa-fa163ea48dd4 2025-12-09 03:29:35,347 - INFO - Verified pod ctest-pod-46935054 in contrail-api 2025-12-09 03:29:35,358 - DEBUG - VMI 4241ac4a-d4af-11f0-89fa-fa163ea48dd4 is active in agent 10.0.0.22 2025-12-09 03:29:35,358 - INFO - Verified Pod ctest-pod-46935054 in agent 10.0.0.22 2025-12-09 03:29:35,358 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=9c575a78-b520-413b-aa9c-5661da27bd75 2025-12-09 03:29:35,362 - INFO - Pod ctest-pod-46935054 with uuid 9c575a78-b520-413b-aa9c-5661da27bd75 found in kube manager 2025-12-09 03:29:35,363 - INFO - Pod ctest-pod-46935054 verification passed 2025-12-09 03:29:35,368 - DEBUG - Pod ctest-pod-43938305 not in running state.Currently in Pending 2025-12-09 03:29:40,375 - INFO - Pod ctest-pod-43938305 is in running state.Got IP 10.47.255.245 2025-12-09 03:29:40,388 - DEBUG - Pod ctest-pod-43938305 has vmi 4326197a-d4af-11f0-89fa-fa163ea48dd4 2025-12-09 03:29:40,388 - INFO - Verified pod ctest-pod-43938305 in contrail-api 2025-12-09 03:29:40,400 - DEBUG - VMI 4326197a-d4af-11f0-89fa-fa163ea48dd4 is active in agent 10.0.0.22 2025-12-09 03:29:40,400 - INFO - Verified Pod ctest-pod-43938305 in agent 10.0.0.22 2025-12-09 03:29:40,400 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=b8c544b8-db61-4782-9ed7-c66f5b35ca6e 2025-12-09 03:29:40,404 - INFO - Pod ctest-pod-43938305 with uuid b8c544b8-db61-4782-9ed7-c66f5b35ca6e found in kube manager 2025-12-09 03:29:40,404 - INFO - Pod ctest-pod-43938305 verification passed 2025-12-09 03:29:40,410 - INFO - Pod ctest-pod-95582129 is in running state.Got IP 10.47.255.246 2025-12-09 03:29:40,463 - DEBUG - Pod ctest-pod-95582129 has vmi 42b67e30-d4af-11f0-89fa-fa163ea48dd4 2025-12-09 03:29:40,463 - INFO - Verified pod ctest-pod-95582129 in contrail-api 2025-12-09 03:29:40,480 - DEBUG - VMI 42b67e30-d4af-11f0-89fa-fa163ea48dd4 is active in agent 10.0.0.22 2025-12-09 03:29:40,480 - INFO - Verified Pod ctest-pod-95582129 in agent 10.0.0.22 2025-12-09 03:29:40,481 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=3422a684-39a1-4daf-a8ef-9bab0767d90a 2025-12-09 03:29:40,486 - INFO - Pod ctest-pod-95582129 with uuid 3422a684-39a1-4daf-a8ef-9bab0767d90a found in kube manager 2025-12-09 03:29:40,486 - INFO - Pod ctest-pod-95582129 verification passed 2025-12-09 03:29:40,492 - INFO - Pod ctest-pod-76242897 is in running state.Got IP 10.47.255.244 2025-12-09 03:29:40,502 - DEBUG - Pod ctest-pod-76242897 has vmi 439599f8-d4af-11f0-89fa-fa163ea48dd4 2025-12-09 03:29:40,502 - INFO - Verified pod ctest-pod-76242897 in contrail-api 2025-12-09 03:29:40,513 - DEBUG - VMI 439599f8-d4af-11f0-89fa-fa163ea48dd4 is active in agent 10.0.0.22 2025-12-09 03:29:40,513 - INFO - Verified Pod ctest-pod-76242897 in agent 10.0.0.22 2025-12-09 03:29:40,513 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=142407ea-5094-448e-a229-fb82b5bcac57 2025-12-09 03:29:40,517 - INFO - Pod ctest-pod-76242897 with uuid 142407ea-5094-448e-a229-fb82b5bcac57 found in kube manager 2025-12-09 03:29:40,517 - INFO - Pod ctest-pod-76242897 verification passed 2025-12-09 03:29:40,517 - INFO - ================================================================================ 2025-12-09 03:29:40,517 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-12-09 03:29:40,517 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-12-09 03:29:40,765 - DEBUG - Nothing to compare xmpp stats {'10.0.0.22': {'10.0.0.33': '0'}} with 2025-12-09 03:29:40,765 - INFO - Initial checks done. Running the testcase now 2025-12-09 03:29:40,765 - INFO - 2025-12-09 03:29:40,828 - DEBUG - [Pod ctest-pod-32966492] Cmd: echo ctest-pod-32966492 > /usr/share/nginx/html/index.html, Output: 2025-12-09 03:29:40,888 - DEBUG - [Pod ctest-pod-75402815] Cmd: echo ctest-pod-75402815 > /usr/share/nginx/html/index.html, Output: 2025-12-09 03:29:40,941 - DEBUG - [Pod ctest-pod-77375615] Cmd: echo ctest-pod-77375615 > /usr/share/nginx/html/index.html, Output: 2025-12-09 03:29:41,003 - DEBUG - [Pod ctest-pod-47043717] Cmd: echo ctest-pod-47043717 > /usr/share/nginx/html/index.html, Output: 2025-12-09 03:29:41,013 - DEBUG - Service ctest-nginx-svc-46577309 not present 2025-12-09 03:29:41,014 - INFO - Creating service ctest-nginx-svc-46577309 2025-12-09 03:29:41,029 - INFO - Created Service ctest-nginx-svc-46577309 2025-12-09 03:29:41,035 - WARNING - Service UUID dcc39c56-2344-47b7-8bc3-d4e43c0be866 not yet found in contrail-api 2025-12-09 03:29:42,040 - INFO - Validated that Service ctest-nginx-svc-46577309 is seen in contrail-api 2025-12-09 03:29:42,040 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_LoadbalancerDatabaseList?x=dcc39c56-2344-47b7-8bc3-d4e43c0be866 2025-12-09 03:29:42,046 - INFO - Service ctest-nginx-svc-46577309 with uuid dcc39c56-2344-47b7-8bc3-d4e43c0be866 found in kube manager 2025-12-09 03:29:42,046 - INFO - Service ctest-nginx-svc-46577309 verification passed 2025-12-09 03:29:43,114 - DEBUG - [Pod ctest-pod-46935054] Cmd: wget http://10.106.101.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.101.6:80 (10.106.101.6:80) ctest-pod-32966492 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-12-09 03:29:43,114 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd wget http://10.106.101.6:80/ -O - -T 5 -t 1 passed 2025-12-09 03:29:43,114 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd output: Connecting to 10.106.101.6:80 (10.106.101.6:80) ctest-pod-32966492 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-12-09 03:29:43,164 - DEBUG - [Pod ctest-pod-46935054] Cmd: wget http://10.106.101.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.101.6:80 (10.106.101.6:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-32966492 2025-12-09 03:29:43,164 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd wget http://10.106.101.6:80/ -O - -T 5 -t 1 passed 2025-12-09 03:29:43,164 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd output: Connecting to 10.106.101.6:80 (10.106.101.6:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-32966492 2025-12-09 03:29:43,211 - DEBUG - [Pod ctest-pod-46935054] Cmd: wget http://10.106.101.6:80/ -O - -T 5 -t 1 , Output: ctest-pod-75402815 Connecting to 10.106.101.6:80 (10.106.101.6:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-12-09 03:29:43,211 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd wget http://10.106.101.6:80/ -O - -T 5 -t 1 passed 2025-12-09 03:29:43,211 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd output: ctest-pod-75402815 Connecting to 10.106.101.6:80 (10.106.101.6:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-12-09 03:29:43,211 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-32966492': 2, 'ctest-pod-75402815': 1} 2025-12-09 03:29:43,270 - DEBUG - [Pod ctest-pod-43938305] Cmd: wget http://10.106.101.6:80/ -O - -T 5 -t 1 , Output: ctest-pod-32966492 Connecting to 10.106.101.6:80 (10.106.101.6:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-12-09 03:29:43,270 - DEBUG - [Pod Pod ctest-pod-43938305] Cmd wget http://10.106.101.6:80/ -O - -T 5 -t 1 passed 2025-12-09 03:29:43,270 - DEBUG - [Pod Pod ctest-pod-43938305] Cmd output: ctest-pod-32966492 Connecting to 10.106.101.6:80 (10.106.101.6:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-12-09 03:29:43,321 - DEBUG - [Pod ctest-pod-43938305] Cmd: wget http://10.106.101.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.101.6:80 (10.106.101.6:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-75402815 2025-12-09 03:29:43,321 - DEBUG - [Pod Pod ctest-pod-43938305] Cmd wget http://10.106.101.6:80/ -O - -T 5 -t 1 passed 2025-12-09 03:29:43,321 - DEBUG - [Pod Pod ctest-pod-43938305] Cmd output: Connecting to 10.106.101.6:80 (10.106.101.6:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-75402815 2025-12-09 03:29:43,321 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-32966492': 1, 'ctest-pod-75402815': 1} 2025-12-09 03:29:43,324 - DEBUG - Network policy ingress-on-service not present 2025-12-09 03:29:43,325 - INFO - Creating Network Policy ingress-on-service 2025-12-09 03:29:43,341 - INFO - Network policy found in k8s 2025-12-09 03:29:43,341 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=35a7fb14-b7ed-444c-b5ae-b168e672be74 2025-12-09 03:29:43,346 - INFO - Network Policy ingress-on-service with uuid 35a7fb14-b7ed-444c-b5ae-b168e672be74 found in kube manager 2025-12-09 03:29:43,375 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-12-09 03:29:43,375 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-12-09 03:29:43,375 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=35a7fb14-b7ed-444c-b5ae-b168e672be74 2025-12-09 03:29:43,398 - WARNING - Network policy with name ingress-on-service not found in agent 2025-12-09 03:29:45,399 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=35a7fb14-b7ed-444c-b5ae-b168e672be74 2025-12-09 03:29:45,426 - INFO - Network policy with name ingress-on-service found in agent 2025-12-09 03:29:45,426 - INFO - Network Policy ingress-on-service verification passed 2025-12-09 03:29:50,482 - DEBUG - [Pod ctest-pod-46935054] Cmd: wget http://10.106.101.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:29:50,482 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd wget http://10.106.101.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:29:50,482 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:29:55,529 - DEBUG - [Pod ctest-pod-46935054] Cmd: wget http://10.106.101.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:29:55,530 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd wget http://10.106.101.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:29:55,530 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:30:00,582 - DEBUG - [Pod ctest-pod-46935054] Cmd: wget http://10.106.101.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:30:00,582 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd wget http://10.106.101.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:30:00,582 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:30:05,633 - DEBUG - [Pod ctest-pod-46935054] Cmd: wget http://10.106.101.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:30:05,634 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd wget http://10.106.101.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:30:05,634 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:30:10,690 - DEBUG - [Pod ctest-pod-46935054] Cmd: wget http://10.106.101.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:30:10,690 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd wget http://10.106.101.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:30:10,690 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:30:15,755 - DEBUG - [Pod ctest-pod-46935054] Cmd: wget http://10.106.101.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:30:15,755 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd wget http://10.106.101.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:30:15,755 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:30:20,809 - DEBUG - [Pod ctest-pod-46935054] Cmd: wget http://10.106.101.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:30:20,809 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd wget http://10.106.101.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:30:20,809 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:30:25,863 - DEBUG - [Pod ctest-pod-46935054] Cmd: wget http://10.106.101.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:30:25,863 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd wget http://10.106.101.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:30:25,863 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:30:30,914 - DEBUG - [Pod ctest-pod-46935054] Cmd: wget http://10.106.101.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:30:30,915 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd wget http://10.106.101.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:30:30,915 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:30:35,966 - DEBUG - [Pod ctest-pod-46935054] Cmd: wget http://10.106.101.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:30:35,966 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd wget http://10.106.101.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:30:35,966 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:30:35,966 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-32966492': 0, 'ctest-pod-75402815': 0} 2025-12-09 03:30:36,030 - DEBUG - [Pod ctest-pod-95582129] Cmd: wget http://10.106.101.6:80/ -O - -T 5 -t 1 , Output: ctest-pod-75402815 Connecting to 10.106.101.6:80 (10.106.101.6:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-12-09 03:30:36,031 - DEBUG - [Pod Pod ctest-pod-95582129] Cmd wget http://10.106.101.6:80/ -O - -T 5 -t 1 passed 2025-12-09 03:30:36,031 - DEBUG - [Pod Pod ctest-pod-95582129] Cmd output: ctest-pod-75402815 Connecting to 10.106.101.6:80 (10.106.101.6:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-12-09 03:30:36,105 - DEBUG - [Pod ctest-pod-95582129] Cmd: wget http://10.106.101.6:80/ -O - -T 5 -t 1 , Output: ctest-pod-75402815 Connecting to 10.106.101.6:80 (10.106.101.6:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-12-09 03:30:36,105 - DEBUG - [Pod Pod ctest-pod-95582129] Cmd wget http://10.106.101.6:80/ -O - -T 5 -t 1 passed 2025-12-09 03:30:36,105 - DEBUG - [Pod Pod ctest-pod-95582129] Cmd output: ctest-pod-75402815 Connecting to 10.106.101.6:80 (10.106.101.6:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-12-09 03:30:36,159 - DEBUG - [Pod ctest-pod-95582129] Cmd: wget http://10.106.101.6:80/ -O - -T 5 -t 1 , Output: ctest-pod-32966492 Connecting to 10.106.101.6:80 (10.106.101.6:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-12-09 03:30:36,159 - DEBUG - [Pod Pod ctest-pod-95582129] Cmd wget http://10.106.101.6:80/ -O - -T 5 -t 1 passed 2025-12-09 03:30:36,159 - DEBUG - [Pod Pod ctest-pod-95582129] Cmd output: ctest-pod-32966492 Connecting to 10.106.101.6:80 (10.106.101.6:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-12-09 03:30:36,159 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-32966492': 1, 'ctest-pod-75402815': 2} 2025-12-09 03:30:41,214 - DEBUG - [Pod ctest-pod-43938305] Cmd: wget http://10.106.101.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:30:41,214 - DEBUG - [Pod Pod ctest-pod-43938305] Cmd wget http://10.106.101.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:30:41,214 - DEBUG - [Pod Pod ctest-pod-43938305] Cmd output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:30:46,266 - DEBUG - [Pod ctest-pod-43938305] Cmd: wget http://10.106.101.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:30:46,266 - DEBUG - [Pod Pod ctest-pod-43938305] Cmd wget http://10.106.101.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:30:46,266 - DEBUG - [Pod Pod ctest-pod-43938305] Cmd output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:30:51,317 - DEBUG - [Pod ctest-pod-43938305] Cmd: wget http://10.106.101.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:30:51,317 - DEBUG - [Pod Pod ctest-pod-43938305] Cmd wget http://10.106.101.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:30:51,318 - DEBUG - [Pod Pod ctest-pod-43938305] Cmd output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:30:56,374 - DEBUG - [Pod ctest-pod-43938305] Cmd: wget http://10.106.101.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:30:56,374 - DEBUG - [Pod Pod ctest-pod-43938305] Cmd wget http://10.106.101.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:30:56,374 - DEBUG - [Pod Pod ctest-pod-43938305] Cmd output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:30:57,811 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2025-12-09 03:31:07,874 - DEBUG - [Pod ctest-pod-43938305] Cmd: wget http://10.106.101.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:31:07,874 - DEBUG - [Pod Pod ctest-pod-43938305] Cmd wget http://10.106.101.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:31:07,874 - DEBUG - [Pod Pod ctest-pod-43938305] Cmd output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:31:12,934 - DEBUG - [Pod ctest-pod-43938305] Cmd: wget http://10.106.101.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:31:12,934 - DEBUG - [Pod Pod ctest-pod-43938305] Cmd wget http://10.106.101.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:31:12,934 - DEBUG - [Pod Pod ctest-pod-43938305] Cmd output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:31:17,997 - DEBUG - [Pod ctest-pod-43938305] Cmd: wget http://10.106.101.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:31:17,997 - DEBUG - [Pod Pod ctest-pod-43938305] Cmd wget http://10.106.101.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:31:17,997 - DEBUG - [Pod Pod ctest-pod-43938305] Cmd output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:31:23,061 - DEBUG - [Pod ctest-pod-43938305] Cmd: wget http://10.106.101.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:31:23,061 - DEBUG - [Pod Pod ctest-pod-43938305] Cmd wget http://10.106.101.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:31:23,061 - DEBUG - [Pod Pod ctest-pod-43938305] Cmd output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:31:28,109 - DEBUG - [Pod ctest-pod-43938305] Cmd: wget http://10.106.101.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:31:28,109 - DEBUG - [Pod Pod ctest-pod-43938305] Cmd wget http://10.106.101.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:31:28,109 - DEBUG - [Pod Pod ctest-pod-43938305] Cmd output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:31:33,161 - DEBUG - [Pod ctest-pod-43938305] Cmd: wget http://10.106.101.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:31:33,161 - DEBUG - [Pod Pod ctest-pod-43938305] Cmd wget http://10.106.101.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:31:33,161 - DEBUG - [Pod Pod ctest-pod-43938305] Cmd output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:31:33,161 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-32966492': 0, 'ctest-pod-75402815': 0} 2025-12-09 03:31:35,209 - DEBUG - [Pod ctest-pod-95582129] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.344 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.066 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.066/0.493/1.344 ms 2025-12-09 03:31:35,210 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-95582129 with expectation True passed 2025-12-09 03:31:37,267 - DEBUG - [Pod ctest-pod-46935054] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.778 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.073 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.100 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.073/0.317/0.778 ms 2025-12-09 03:31:37,267 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-46935054 with expectation True passed 2025-12-09 03:31:39,314 - DEBUG - [Pod ctest-pod-43938305] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.476 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.055 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.066 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.055/0.199/0.476 ms 2025-12-09 03:31:39,315 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-43938305 with expectation True passed 2025-12-09 03:31:39,382 - DEBUG - [Pod ctest-pod-95582129] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-12-09 03:31:39,382 - DEBUG - [Pod Pod ctest-pod-95582129] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-12-09 03:31:39,382 - DEBUG - [Pod Pod ctest-pod-95582129] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-12-09 03:31:39,382 - INFO - wget check of of http://10.47.255.251 from ctest-pod-95582129 passed 2025-12-09 03:31:39,435 - DEBUG - [Pod ctest-pod-95582129] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-12-09 03:31:39,435 - DEBUG - [Pod Pod ctest-pod-95582129] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-12-09 03:31:39,435 - DEBUG - [Pod Pod ctest-pod-95582129] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-12-09 03:31:39,435 - INFO - wget check of of http://10.47.255.250 from ctest-pod-95582129 passed 2025-12-09 03:31:44,482 - DEBUG - [Pod ctest-pod-46935054] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-12-09 03:31:44,482 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-12-09 03:31:44,482 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-12-09 03:31:44,482 - INFO - wget check of of http://10.47.255.250 from ctest-pod-46935054 passed 2025-12-09 03:31:49,535 - DEBUG - [Pod ctest-pod-76242897] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-12-09 03:31:49,536 - DEBUG - [Pod Pod ctest-pod-76242897] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-12-09 03:31:49,536 - DEBUG - [Pod Pod ctest-pod-76242897] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-12-09 03:31:49,536 - INFO - wget check of of http://10.47.255.251 from ctest-pod-76242897 passed 2025-12-09 03:31:49,546 - INFO - Updating Network Policy ingress-on-service 2025-12-09 03:31:54,605 - DEBUG - [Pod ctest-pod-46935054] Cmd: wget http://10.106.101.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:31:54,606 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd wget http://10.106.101.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:31:54,606 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:31:59,653 - DEBUG - [Pod ctest-pod-46935054] Cmd: wget http://10.106.101.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:31:59,654 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd wget http://10.106.101.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:31:59,654 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:32:04,709 - DEBUG - [Pod ctest-pod-46935054] Cmd: wget http://10.106.101.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:32:04,709 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd wget http://10.106.101.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:32:04,709 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:32:09,762 - DEBUG - [Pod ctest-pod-46935054] Cmd: wget http://10.106.101.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:32:09,762 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd wget http://10.106.101.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:32:09,762 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:32:14,807 - DEBUG - [Pod ctest-pod-46935054] Cmd: wget http://10.106.101.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:32:14,807 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd wget http://10.106.101.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:32:14,807 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:32:19,860 - DEBUG - [Pod ctest-pod-46935054] Cmd: wget http://10.106.101.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:32:19,860 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd wget http://10.106.101.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:32:19,860 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:32:24,909 - DEBUG - [Pod ctest-pod-46935054] Cmd: wget http://10.106.101.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:32:24,909 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd wget http://10.106.101.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:32:24,909 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:32:29,961 - DEBUG - [Pod ctest-pod-46935054] Cmd: wget http://10.106.101.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:32:29,961 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd wget http://10.106.101.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:32:29,961 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:32:35,009 - DEBUG - [Pod ctest-pod-46935054] Cmd: wget http://10.106.101.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:32:35,010 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd wget http://10.106.101.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:32:35,010 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:32:40,058 - DEBUG - [Pod ctest-pod-46935054] Cmd: wget http://10.106.101.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:32:40,059 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd wget http://10.106.101.6:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:32:40,059 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd output: Connecting to 10.106.101.6:80 (10.106.101.6:80) wget: download timed out 2025-12-09 03:32:40,059 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-32966492': 0, 'ctest-pod-75402815': 0} 2025-12-09 03:32:40,112 - DEBUG - [Pod ctest-pod-95582129] Cmd: wget http://10.106.101.6:80/ -O - -T 5 -t 1 , Output: ctest-pod-75402815 Connecting to 10.106.101.6:80 (10.106.101.6:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-12-09 03:32:40,113 - DEBUG - [Pod Pod ctest-pod-95582129] Cmd wget http://10.106.101.6:80/ -O - -T 5 -t 1 passed 2025-12-09 03:32:40,113 - DEBUG - [Pod Pod ctest-pod-95582129] Cmd output: ctest-pod-75402815 Connecting to 10.106.101.6:80 (10.106.101.6:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-12-09 03:32:40,171 - DEBUG - [Pod ctest-pod-95582129] Cmd: wget http://10.106.101.6:80/ -O - -T 5 -t 1 , Output: ctest-pod-75402815 Connecting to 10.106.101.6:80 (10.106.101.6:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-12-09 03:32:40,171 - DEBUG - [Pod Pod ctest-pod-95582129] Cmd wget http://10.106.101.6:80/ -O - -T 5 -t 1 passed 2025-12-09 03:32:40,171 - DEBUG - [Pod Pod ctest-pod-95582129] Cmd output: ctest-pod-75402815 Connecting to 10.106.101.6:80 (10.106.101.6:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-12-09 03:32:40,227 - DEBUG - [Pod ctest-pod-95582129] Cmd: wget http://10.106.101.6:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.101.6:80 (10.106.101.6:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-32966492 2025-12-09 03:32:40,227 - DEBUG - [Pod Pod ctest-pod-95582129] Cmd wget http://10.106.101.6:80/ -O - -T 5 -t 1 passed 2025-12-09 03:32:40,227 - DEBUG - [Pod Pod ctest-pod-95582129] Cmd output: Connecting to 10.106.101.6:80 (10.106.101.6:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-32966492 2025-12-09 03:32:40,227 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-32966492': 1, 'ctest-pod-75402815': 2} 2025-12-09 03:32:40,276 - DEBUG - [Pod ctest-pod-43938305] Cmd: wget http://10.106.101.6:80/ -O - -T 5 -t 1 , Output: ctest-pod-32966492 Connecting to 10.106.101.6:80 (10.106.101.6:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-12-09 03:32:40,276 - DEBUG - [Pod Pod ctest-pod-43938305] Cmd wget http://10.106.101.6:80/ -O - -T 5 -t 1 passed 2025-12-09 03:32:40,276 - DEBUG - [Pod Pod ctest-pod-43938305] Cmd output: ctest-pod-32966492 Connecting to 10.106.101.6:80 (10.106.101.6:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-12-09 03:32:40,329 - DEBUG - [Pod ctest-pod-43938305] Cmd: wget http://10.106.101.6:80/ -O - -T 5 -t 1 , Output: ctest-pod-32966492 Connecting to 10.106.101.6:80 (10.106.101.6:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-12-09 03:32:40,330 - DEBUG - [Pod Pod ctest-pod-43938305] Cmd wget http://10.106.101.6:80/ -O - -T 5 -t 1 passed 2025-12-09 03:32:40,330 - DEBUG - [Pod Pod ctest-pod-43938305] Cmd output: ctest-pod-32966492 Connecting to 10.106.101.6:80 (10.106.101.6:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-12-09 03:32:40,383 - DEBUG - [Pod ctest-pod-43938305] Cmd: wget http://10.106.101.6:80/ -O - -T 5 -t 1 , Output: ctest-pod-32966492 Connecting to 10.106.101.6:80 (10.106.101.6:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-12-09 03:32:40,383 - DEBUG - [Pod Pod ctest-pod-43938305] Cmd wget http://10.106.101.6:80/ -O - -T 5 -t 1 passed 2025-12-09 03:32:40,383 - DEBUG - [Pod Pod ctest-pod-43938305] Cmd output: ctest-pod-32966492 Connecting to 10.106.101.6:80 (10.106.101.6:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-12-09 03:32:40,444 - DEBUG - [Pod ctest-pod-43938305] Cmd: wget http://10.106.101.6:80/ -O - -T 5 -t 1 , Output: ctest-pod-32966492 Connecting to 10.106.101.6:80 (10.106.101.6:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-12-09 03:32:40,444 - DEBUG - [Pod Pod ctest-pod-43938305] Cmd wget http://10.106.101.6:80/ -O - -T 5 -t 1 passed 2025-12-09 03:32:40,444 - DEBUG - [Pod Pod ctest-pod-43938305] Cmd output: ctest-pod-32966492 Connecting to 10.106.101.6:80 (10.106.101.6:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-12-09 03:32:40,498 - DEBUG - [Pod ctest-pod-43938305] Cmd: wget http://10.106.101.6:80/ -O - -T 5 -t 1 , Output: ctest-pod-75402815 Connecting to 10.106.101.6:80 (10.106.101.6:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-12-09 03:32:40,499 - DEBUG - [Pod Pod ctest-pod-43938305] Cmd wget http://10.106.101.6:80/ -O - -T 5 -t 1 passed 2025-12-09 03:32:40,499 - DEBUG - [Pod Pod ctest-pod-43938305] Cmd output: ctest-pod-75402815 Connecting to 10.106.101.6:80 (10.106.101.6:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-12-09 03:32:40,499 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-32966492': 4, 'ctest-pod-75402815': 1} 2025-12-09 03:32:42,553 - DEBUG - [Pod ctest-pod-95582129] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.571 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.072 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.076 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.072/0.239/0.571 ms 2025-12-09 03:32:42,553 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-95582129 with expectation True passed 2025-12-09 03:32:44,606 - DEBUG - [Pod ctest-pod-46935054] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.900 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.074 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.081 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.074/0.351/0.900 ms 2025-12-09 03:32:44,606 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-46935054 with expectation True passed 2025-12-09 03:32:46,666 - DEBUG - [Pod ctest-pod-43938305] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.434 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.085 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.061 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.061/0.526/1.434 ms 2025-12-09 03:32:46,666 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-43938305 with expectation True passed 2025-12-09 03:32:46,720 - DEBUG - [Pod ctest-pod-95582129] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-12-09 03:32:46,721 - DEBUG - [Pod Pod ctest-pod-95582129] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-12-09 03:32:46,721 - DEBUG - [Pod Pod ctest-pod-95582129] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-12-09 03:32:46,721 - INFO - wget check of of http://10.47.255.251 from ctest-pod-95582129 passed 2025-12-09 03:32:46,767 - DEBUG - [Pod ctest-pod-95582129] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-12-09 03:32:46,767 - DEBUG - [Pod Pod ctest-pod-95582129] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-12-09 03:32:46,767 - DEBUG - [Pod Pod ctest-pod-95582129] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-12-09 03:32:46,767 - INFO - wget check of of http://10.47.255.250 from ctest-pod-95582129 passed 2025-12-09 03:32:51,817 - DEBUG - [Pod ctest-pod-46935054] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-12-09 03:32:51,817 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-12-09 03:32:51,817 - DEBUG - [Pod Pod ctest-pod-46935054] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-12-09 03:32:51,817 - INFO - wget check of of http://10.47.255.250 from ctest-pod-46935054 passed 2025-12-09 03:32:51,872 - DEBUG - [Pod ctest-pod-76242897] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-12-09 03:32:51,873 - DEBUG - [Pod Pod ctest-pod-76242897] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-12-09 03:32:51,873 - DEBUG - [Pod Pod ctest-pod-76242897] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-12-09 03:32:51,873 - INFO - wget check of of http://10.47.255.251 from ctest-pod-76242897 passed 2025-12-09 03:32:51,873 - INFO - Deleting Network Policy : ingress-on-service 2025-12-09 03:32:51,874 - INFO - Deleting service : ctest-nginx-svc-46577309 2025-12-09 03:32:52,140 - DEBUG - No XMPP flaps were noticed during the test