2025-10-02 01:24:55,189 - INFO - Using existing project ['default-domain', 'k8s-default'](6d0a4379-eb40-447f-8756-f979cdbbe54f) 2025-10-02 01:24:55,216 - DEBUG - Namespace ctest-new-default-01210396 not present 2025-10-02 01:24:55,223 - INFO - Created namespace ctest-new-default-01210396 2025-10-02 01:24:58,227 - DEBUG - Namespace ctest-non-default-00426299 not present 2025-10-02 01:24:58,241 - INFO - Created namespace ctest-non-default-00426299 2025-10-02 01:25:01,270 - DEBUG - Pod ctest-pod-28647913 not present 2025-10-02 01:25:01,271 - INFO - Creating Pod ctest-pod-28647913 2025-10-02 01:25:01,307 - DEBUG - Pod : ctest-pod-28647913 UUID is bd873188-b18f-4cc4-9cfb-b775ea535191 2025-10-02 01:25:01,315 - DEBUG - Pod ctest-pod-48364581 not present 2025-10-02 01:25:01,316 - INFO - Creating Pod ctest-pod-48364581 2025-10-02 01:25:01,357 - DEBUG - Pod : ctest-pod-48364581 UUID is 0d4638f2-20dc-4a78-bd48-b088648dbe7c 2025-10-02 01:25:01,366 - DEBUG - Pod ctest-pod-72193909 not present 2025-10-02 01:25:01,366 - INFO - Creating Pod ctest-pod-72193909 2025-10-02 01:25:01,405 - DEBUG - Pod : ctest-pod-72193909 UUID is 694ca126-ae09-4fcf-96dc-93cc81839d68 2025-10-02 01:25:01,411 - DEBUG - Pod ctest-pod-33500900 not present 2025-10-02 01:25:01,411 - INFO - Creating Pod ctest-pod-33500900 2025-10-02 01:25:01,438 - DEBUG - Pod : ctest-pod-33500900 UUID is 6a1c6847-e4b1-4007-b413-3e523104504d 2025-10-02 01:25:01,443 - DEBUG - Pod ctest-pod-54635483 not present 2025-10-02 01:25:01,444 - INFO - Creating Pod ctest-pod-54635483 2025-10-02 01:25:01,471 - DEBUG - Pod : ctest-pod-54635483 UUID is c7c3e4b6-7a25-4d03-8f69-d7a64a86db79 2025-10-02 01:25:01,480 - DEBUG - Pod ctest-pod-19018627 not present 2025-10-02 01:25:01,481 - INFO - Creating Pod ctest-pod-19018627 2025-10-02 01:25:01,526 - DEBUG - Pod : ctest-pod-19018627 UUID is 12fedc1d-f0f0-4140-be81-ab2caa7c0db4 2025-10-02 01:25:01,529 - DEBUG - Pod ctest-pod-54191403 not present 2025-10-02 01:25:01,530 - INFO - Creating Pod ctest-pod-54191403 2025-10-02 01:25:01,563 - DEBUG - Pod : ctest-pod-54191403 UUID is b63d3a80-601c-487a-9749-629f63de92aa 2025-10-02 01:25:01,566 - DEBUG - Pod ctest-pod-98300861 not present 2025-10-02 01:25:01,567 - INFO - Creating Pod ctest-pod-98300861 2025-10-02 01:25:01,608 - DEBUG - Pod : ctest-pod-98300861 UUID is 1a5ead5f-efc2-4f3b-8f9b-fb41b9900c6e 2025-10-02 01:25:01,879 - INFO - Project default-domain:k8s-ctest-new-default-01210396 for Namespace ctest-new-default-01210396 is seen in contrail-api 2025-10-02 01:25:01,880 - DEBUG - Project uuid in Contrail is 7b5a8398-b61c-461e-9e43-f0e04e3e0af3 2025-10-02 01:25:02,144 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NamespaceDatabaseList?namespace_uuid=2bff9728-8870-4add-adff-9c780c75dee4 2025-10-02 01:25:02,148 - INFO - Namespace ctest-new-default-01210396 with uuid 2bff9728-8870-4add-adff-9c780c75dee4 found in kube manager 2025-10-02 01:25:02,148 - INFO - Namespace ctest-new-default-01210396 verification passed 2025-10-02 01:25:02,474 - INFO - Project default-domain:k8s-ctest-non-default-00426299 for Namespace ctest-non-default-00426299 is seen in contrail-api 2025-10-02 01:25:02,475 - DEBUG - Project uuid in Contrail is af530017-6a4b-490c-b10b-525166d506ab 2025-10-02 01:25:02,475 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NamespaceDatabaseList?namespace_uuid=c9843477-7ace-415c-b8cf-64f403083239 2025-10-02 01:25:02,480 - INFO - Namespace ctest-non-default-00426299 with uuid c9843477-7ace-415c-b8cf-64f403083239 found in kube manager 2025-10-02 01:25:02,480 - INFO - Namespace ctest-non-default-00426299 verification passed 2025-10-02 01:25:02,495 - DEBUG - Pod ctest-pod-28647913 not in running state.Currently in Pending 2025-10-02 01:25:07,505 - DEBUG - Pod ctest-pod-28647913 not in running state.Currently in Pending 2025-10-02 01:25:12,514 - DEBUG - Pod ctest-pod-28647913 not in running state.Currently in Pending 2025-10-02 01:25:17,521 - INFO - Pod ctest-pod-28647913 is in running state.Got IP 10.47.255.250 2025-10-02 01:25:17,573 - DEBUG - Pod ctest-pod-28647913 has vmi 9ff34936-9f2e-11f0-a12c-02428a700a11 2025-10-02 01:25:17,574 - INFO - Verified pod ctest-pod-28647913 in contrail-api 2025-10-02 01:25:17,587 - DEBUG - VMI 9ff34936-9f2e-11f0-a12c-02428a700a11 is active in agent 10.0.0.48 2025-10-02 01:25:17,587 - INFO - Verified Pod ctest-pod-28647913 in agent 10.0.0.48 2025-10-02 01:25:17,588 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=bd873188-b18f-4cc4-9cfb-b775ea535191 2025-10-02 01:25:17,592 - INFO - Pod ctest-pod-28647913 with uuid bd873188-b18f-4cc4-9cfb-b775ea535191 found in kube manager 2025-10-02 01:25:17,592 - INFO - Pod ctest-pod-28647913 verification passed 2025-10-02 01:25:17,599 - INFO - Pod ctest-pod-48364581 is in running state.Got IP 10.47.255.249 2025-10-02 01:25:17,692 - DEBUG - Pod ctest-pod-48364581 has vmi a0a85614-9f2e-11f0-a12c-02428a700a11 2025-10-02 01:25:17,692 - INFO - Verified pod ctest-pod-48364581 in contrail-api 2025-10-02 01:25:17,701 - DEBUG - VMI a0a85614-9f2e-11f0-a12c-02428a700a11 is active in agent 10.0.0.48 2025-10-02 01:25:17,701 - INFO - Verified Pod ctest-pod-48364581 in agent 10.0.0.48 2025-10-02 01:25:17,701 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=0d4638f2-20dc-4a78-bd48-b088648dbe7c 2025-10-02 01:25:17,706 - INFO - Pod ctest-pod-48364581 with uuid 0d4638f2-20dc-4a78-bd48-b088648dbe7c found in kube manager 2025-10-02 01:25:17,706 - INFO - Pod ctest-pod-48364581 verification passed 2025-10-02 01:25:17,713 - INFO - Pod ctest-pod-72193909 is in running state.Got IP 10.47.255.248 2025-10-02 01:25:17,806 - DEBUG - Pod ctest-pod-72193909 has vmi a1a087b2-9f2e-11f0-a12c-02428a700a11 2025-10-02 01:25:17,807 - INFO - Verified pod ctest-pod-72193909 in contrail-api 2025-10-02 01:25:17,815 - DEBUG - VMI a1a087b2-9f2e-11f0-a12c-02428a700a11 is active in agent 10.0.0.48 2025-10-02 01:25:17,816 - INFO - Verified Pod ctest-pod-72193909 in agent 10.0.0.48 2025-10-02 01:25:17,816 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=694ca126-ae09-4fcf-96dc-93cc81839d68 2025-10-02 01:25:17,820 - INFO - Pod ctest-pod-72193909 with uuid 694ca126-ae09-4fcf-96dc-93cc81839d68 found in kube manager 2025-10-02 01:25:17,820 - INFO - Pod ctest-pod-72193909 verification passed 2025-10-02 01:25:17,827 - DEBUG - Pod ctest-pod-33500900 not in running state.Currently in Pending 2025-10-02 01:25:22,835 - INFO - Pod ctest-pod-33500900 is in running state.Got IP 10.47.255.247 2025-10-02 01:25:22,888 - DEBUG - Pod ctest-pod-33500900 has vmi a250fb42-9f2e-11f0-a12c-02428a700a11 2025-10-02 01:25:22,889 - INFO - Verified pod ctest-pod-33500900 in contrail-api 2025-10-02 01:25:22,901 - DEBUG - VMI a250fb42-9f2e-11f0-a12c-02428a700a11 is active in agent 10.0.0.48 2025-10-02 01:25:22,901 - INFO - Verified Pod ctest-pod-33500900 in agent 10.0.0.48 2025-10-02 01:25:22,902 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=6a1c6847-e4b1-4007-b413-3e523104504d 2025-10-02 01:25:22,907 - INFO - Pod ctest-pod-33500900 with uuid 6a1c6847-e4b1-4007-b413-3e523104504d found in kube manager 2025-10-02 01:25:22,907 - INFO - Pod ctest-pod-33500900 verification passed 2025-10-02 01:25:22,914 - INFO - Pod ctest-pod-54635483 is in running state.Got IP 10.47.255.246 2025-10-02 01:25:23,006 - DEBUG - Pod ctest-pod-54635483 has vmi a327beca-9f2e-11f0-a12c-02428a700a11 2025-10-02 01:25:23,007 - INFO - Verified pod ctest-pod-54635483 in contrail-api 2025-10-02 01:25:23,015 - DEBUG - VMI a327beca-9f2e-11f0-a12c-02428a700a11 is active in agent 10.0.0.48 2025-10-02 01:25:23,016 - INFO - Verified Pod ctest-pod-54635483 in agent 10.0.0.48 2025-10-02 01:25:23,016 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=c7c3e4b6-7a25-4d03-8f69-d7a64a86db79 2025-10-02 01:25:23,019 - INFO - Pod ctest-pod-54635483 with uuid c7c3e4b6-7a25-4d03-8f69-d7a64a86db79 found in kube manager 2025-10-02 01:25:23,019 - INFO - Pod ctest-pod-54635483 verification passed 2025-10-02 01:25:23,027 - INFO - Pod ctest-pod-54191403 is in running state.Got IP 10.47.255.244 2025-10-02 01:25:23,120 - DEBUG - Pod ctest-pod-54191403 has vmi a4bad628-9f2e-11f0-a12c-02428a700a11 2025-10-02 01:25:23,121 - INFO - Verified pod ctest-pod-54191403 in contrail-api 2025-10-02 01:25:23,130 - DEBUG - VMI a4bad628-9f2e-11f0-a12c-02428a700a11 is active in agent 10.0.0.48 2025-10-02 01:25:23,131 - INFO - Verified Pod ctest-pod-54191403 in agent 10.0.0.48 2025-10-02 01:25:23,131 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=b63d3a80-601c-487a-9749-629f63de92aa 2025-10-02 01:25:23,135 - INFO - Pod ctest-pod-54191403 with uuid b63d3a80-601c-487a-9749-629f63de92aa found in kube manager 2025-10-02 01:25:23,135 - INFO - Pod ctest-pod-54191403 verification passed 2025-10-02 01:25:23,142 - INFO - Pod ctest-pod-19018627 is in running state.Got IP 10.47.255.245 2025-10-02 01:25:23,237 - DEBUG - Pod ctest-pod-19018627 has vmi a3f304b8-9f2e-11f0-a12c-02428a700a11 2025-10-02 01:25:23,238 - INFO - Verified pod ctest-pod-19018627 in contrail-api 2025-10-02 01:25:23,247 - DEBUG - VMI a3f304b8-9f2e-11f0-a12c-02428a700a11 is active in agent 10.0.0.48 2025-10-02 01:25:23,247 - INFO - Verified Pod ctest-pod-19018627 in agent 10.0.0.48 2025-10-02 01:25:23,247 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=12fedc1d-f0f0-4140-be81-ab2caa7c0db4 2025-10-02 01:25:23,252 - INFO - Pod ctest-pod-19018627 with uuid 12fedc1d-f0f0-4140-be81-ab2caa7c0db4 found in kube manager 2025-10-02 01:25:23,252 - INFO - Pod ctest-pod-19018627 verification passed 2025-10-02 01:25:23,259 - DEBUG - Pod ctest-pod-98300861 not in running state.Currently in Pending 2025-10-02 01:25:28,267 - INFO - Pod ctest-pod-98300861 is in running state.Got IP 10.47.255.243 2025-10-02 01:25:28,318 - DEBUG - Pod ctest-pod-98300861 has vmi a58d3f8c-9f2e-11f0-a12c-02428a700a11 2025-10-02 01:25:28,319 - INFO - Verified pod ctest-pod-98300861 in contrail-api 2025-10-02 01:25:28,329 - DEBUG - VMI a58d3f8c-9f2e-11f0-a12c-02428a700a11 is active in agent 10.0.0.48 2025-10-02 01:25:28,329 - INFO - Verified Pod ctest-pod-98300861 in agent 10.0.0.48 2025-10-02 01:25:28,329 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=1a5ead5f-efc2-4f3b-8f9b-fb41b9900c6e 2025-10-02 01:25:28,335 - INFO - Pod ctest-pod-98300861 with uuid 1a5ead5f-efc2-4f3b-8f9b-fb41b9900c6e found in kube manager 2025-10-02 01:25:28,335 - INFO - Pod ctest-pod-98300861 verification passed 2025-10-02 01:25:28,335 - INFO - ================================================================================ 2025-10-02 01:25:28,335 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-10-02 01:25:28,335 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-10-02 01:25:28,636 - DEBUG - Nothing to compare xmpp stats {'10.0.0.48': {'10.0.0.48': '2'}} with 2025-10-02 01:25:28,636 - INFO - Initial checks done. Running the testcase now 2025-10-02 01:25:28,637 - INFO - 2025-10-02 01:25:28,713 - DEBUG - [Pod ctest-pod-28647913] Cmd: echo ctest-pod-28647913 > /usr/share/nginx/html/index.html, Output: 2025-10-02 01:25:28,784 - DEBUG - [Pod ctest-pod-48364581] Cmd: echo ctest-pod-48364581 > /usr/share/nginx/html/index.html, Output: 2025-10-02 01:25:28,855 - DEBUG - [Pod ctest-pod-72193909] Cmd: echo ctest-pod-72193909 > /usr/share/nginx/html/index.html, Output: 2025-10-02 01:25:28,921 - DEBUG - [Pod ctest-pod-33500900] Cmd: echo ctest-pod-33500900 > /usr/share/nginx/html/index.html, Output: 2025-10-02 01:25:28,925 - DEBUG - Service ctest-nginx-svc-91080530 not present 2025-10-02 01:25:28,925 - INFO - Creating service ctest-nginx-svc-91080530 2025-10-02 01:25:28,942 - INFO - Created Service ctest-nginx-svc-91080530 2025-10-02 01:25:28,947 - WARNING - Service UUID 67ddca30-e7ff-4366-b797-9b791b43f8cb not yet found in contrail-api 2025-10-02 01:25:29,957 - INFO - Validated that Service ctest-nginx-svc-91080530 is seen in contrail-api 2025-10-02 01:25:29,958 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_LoadbalancerDatabaseList?x=67ddca30-e7ff-4366-b797-9b791b43f8cb 2025-10-02 01:25:29,962 - INFO - Service ctest-nginx-svc-91080530 with uuid 67ddca30-e7ff-4366-b797-9b791b43f8cb found in kube manager 2025-10-02 01:25:29,962 - INFO - Service ctest-nginx-svc-91080530 verification passed 2025-10-02 01:25:31,103 - DEBUG - [Pod ctest-pod-54635483] Cmd: wget http://10.101.112.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.112.173:80 (10.101.112.173:80) ctest-pod-48364581 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-02 01:25:31,103 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd wget http://10.101.112.173:80/ -O - -T 5 -t 1 passed 2025-10-02 01:25:31,103 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd output: Connecting to 10.101.112.173:80 (10.101.112.173:80) ctest-pod-48364581 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-02 01:25:31,190 - DEBUG - [Pod ctest-pod-54635483] Cmd: wget http://10.101.112.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.112.173:80 (10.101.112.173:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-28647913 2025-10-02 01:25:31,190 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd wget http://10.101.112.173:80/ -O - -T 5 -t 1 passed 2025-10-02 01:25:31,190 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd output: Connecting to 10.101.112.173:80 (10.101.112.173:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-28647913 2025-10-02 01:25:31,190 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-28647913': 1, 'ctest-pod-48364581': 1} 2025-10-02 01:25:31,265 - DEBUG - [Pod ctest-pod-54191403] Cmd: wget http://10.101.112.173:80/ -O - -T 5 -t 1 , Output: ctest-pod-28647913 Connecting to 10.101.112.173:80 (10.101.112.173:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-02 01:25:31,265 - DEBUG - [Pod Pod ctest-pod-54191403] Cmd wget http://10.101.112.173:80/ -O - -T 5 -t 1 passed 2025-10-02 01:25:31,265 - DEBUG - [Pod Pod ctest-pod-54191403] Cmd output: ctest-pod-28647913 Connecting to 10.101.112.173:80 (10.101.112.173:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-02 01:25:31,337 - DEBUG - [Pod ctest-pod-54191403] Cmd: wget http://10.101.112.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.112.173:80 (10.101.112.173:80) writing to stdout ctest-pod-48364581 - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-02 01:25:31,337 - DEBUG - [Pod Pod ctest-pod-54191403] Cmd wget http://10.101.112.173:80/ -O - -T 5 -t 1 passed 2025-10-02 01:25:31,337 - DEBUG - [Pod Pod ctest-pod-54191403] Cmd output: Connecting to 10.101.112.173:80 (10.101.112.173:80) writing to stdout ctest-pod-48364581 - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-02 01:25:31,337 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-28647913': 1, 'ctest-pod-48364581': 1} 2025-10-02 01:25:31,341 - DEBUG - Network policy ingress-on-service not present 2025-10-02 01:25:31,341 - INFO - Creating Network Policy ingress-on-service 2025-10-02 01:25:31,356 - INFO - Network policy found in k8s 2025-10-02 01:25:31,357 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=0b39e485-bba1-46ad-ab2c-c9466bf2096e 2025-10-02 01:25:31,363 - INFO - Network Policy ingress-on-service with uuid 0b39e485-bba1-46ad-ab2c-c9466bf2096e found in kube manager 2025-10-02 01:25:31,397 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-10-02 01:25:31,397 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-10-02 01:25:31,398 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=0b39e485-bba1-46ad-ab2c-c9466bf2096e 2025-10-02 01:25:31,420 - WARNING - Network policy with name ingress-on-service not found in agent 2025-10-02 01:25:33,421 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=0b39e485-bba1-46ad-ab2c-c9466bf2096e 2025-10-02 01:25:33,440 - WARNING - Network policy with name ingress-on-service not found in agent 2025-10-02 01:25:35,441 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=0b39e485-bba1-46ad-ab2c-c9466bf2096e 2025-10-02 01:25:35,463 - INFO - Network policy with name ingress-on-service found in agent 2025-10-02 01:25:35,463 - INFO - Network Policy ingress-on-service verification passed 2025-10-02 01:25:40,532 - DEBUG - [Pod ctest-pod-54635483] Cmd: wget http://10.101.112.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:25:40,533 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd wget http://10.101.112.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:25:40,533 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:25:45,597 - DEBUG - [Pod ctest-pod-54635483] Cmd: wget http://10.101.112.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:25:45,597 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd wget http://10.101.112.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:25:45,597 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:25:50,686 - DEBUG - [Pod ctest-pod-54635483] Cmd: wget http://10.101.112.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:25:50,686 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd wget http://10.101.112.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:25:50,686 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:25:55,774 - DEBUG - [Pod ctest-pod-54635483] Cmd: wget http://10.101.112.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:25:55,774 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd wget http://10.101.112.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:25:55,774 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:26:00,879 - DEBUG - [Pod ctest-pod-54635483] Cmd: wget http://10.101.112.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:26:00,879 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd wget http://10.101.112.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:26:00,879 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:26:05,957 - DEBUG - [Pod ctest-pod-54635483] Cmd: wget http://10.101.112.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:26:05,957 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd wget http://10.101.112.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:26:05,957 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:26:11,031 - DEBUG - [Pod ctest-pod-54635483] Cmd: wget http://10.101.112.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:26:11,031 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd wget http://10.101.112.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:26:11,031 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:26:16,118 - DEBUG - [Pod ctest-pod-54635483] Cmd: wget http://10.101.112.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:26:16,119 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd wget http://10.101.112.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:26:16,119 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:26:21,192 - DEBUG - [Pod ctest-pod-54635483] Cmd: wget http://10.101.112.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:26:21,192 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd wget http://10.101.112.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:26:21,192 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:26:26,275 - DEBUG - [Pod ctest-pod-54635483] Cmd: wget http://10.101.112.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:26:26,275 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd wget http://10.101.112.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:26:26,275 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:26:26,275 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-28647913': 0, 'ctest-pod-48364581': 0} 2025-10-02 01:26:26,381 - DEBUG - [Pod ctest-pod-19018627] Cmd: wget http://10.101.112.173:80/ -O - -T 5 -t 1 , Output: ctest-pod-28647913 Connecting to 10.101.112.173:80 (10.101.112.173:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-02 01:26:26,381 - DEBUG - [Pod Pod ctest-pod-19018627] Cmd wget http://10.101.112.173:80/ -O - -T 5 -t 1 passed 2025-10-02 01:26:26,381 - DEBUG - [Pod Pod ctest-pod-19018627] Cmd output: ctest-pod-28647913 Connecting to 10.101.112.173:80 (10.101.112.173:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-02 01:26:26,457 - DEBUG - [Pod ctest-pod-19018627] Cmd: wget http://10.101.112.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.112.173:80 (10.101.112.173:80) ctest-pod-28647913 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-02 01:26:26,458 - DEBUG - [Pod Pod ctest-pod-19018627] Cmd wget http://10.101.112.173:80/ -O - -T 5 -t 1 passed 2025-10-02 01:26:26,458 - DEBUG - [Pod Pod ctest-pod-19018627] Cmd output: Connecting to 10.101.112.173:80 (10.101.112.173:80) ctest-pod-28647913 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-02 01:26:26,536 - DEBUG - [Pod ctest-pod-19018627] Cmd: wget http://10.101.112.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.112.173:80 (10.101.112.173:80) writing to stdout ctest-pod-28647913 - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-02 01:26:26,536 - DEBUG - [Pod Pod ctest-pod-19018627] Cmd wget http://10.101.112.173:80/ -O - -T 5 -t 1 passed 2025-10-02 01:26:26,537 - DEBUG - [Pod Pod ctest-pod-19018627] Cmd output: Connecting to 10.101.112.173:80 (10.101.112.173:80) writing to stdout ctest-pod-28647913 - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-02 01:26:26,603 - DEBUG - [Pod ctest-pod-19018627] Cmd: wget http://10.101.112.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.112.173:80 (10.101.112.173:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-28647913 2025-10-02 01:26:26,603 - DEBUG - [Pod Pod ctest-pod-19018627] Cmd wget http://10.101.112.173:80/ -O - -T 5 -t 1 passed 2025-10-02 01:26:26,603 - DEBUG - [Pod Pod ctest-pod-19018627] Cmd output: Connecting to 10.101.112.173:80 (10.101.112.173:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-28647913 2025-10-02 01:26:26,677 - DEBUG - [Pod ctest-pod-19018627] Cmd: wget http://10.101.112.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.112.173:80 (10.101.112.173:80) writing to stdout ctest-pod-28647913 - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-02 01:26:26,677 - DEBUG - [Pod Pod ctest-pod-19018627] Cmd wget http://10.101.112.173:80/ -O - -T 5 -t 1 passed 2025-10-02 01:26:26,677 - DEBUG - [Pod Pod ctest-pod-19018627] Cmd output: Connecting to 10.101.112.173:80 (10.101.112.173:80) writing to stdout ctest-pod-28647913 - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-02 01:26:26,762 - DEBUG - [Pod ctest-pod-19018627] Cmd: wget http://10.101.112.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.112.173:80 (10.101.112.173:80) writing to stdout ctest-pod-48364581 - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-02 01:26:26,762 - DEBUG - [Pod Pod ctest-pod-19018627] Cmd wget http://10.101.112.173:80/ -O - -T 5 -t 1 passed 2025-10-02 01:26:26,762 - DEBUG - [Pod Pod ctest-pod-19018627] Cmd output: Connecting to 10.101.112.173:80 (10.101.112.173:80) writing to stdout ctest-pod-48364581 - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-02 01:26:26,762 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-28647913': 5, 'ctest-pod-48364581': 1} 2025-10-02 01:26:31,835 - DEBUG - [Pod ctest-pod-54191403] Cmd: wget http://10.101.112.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:26:31,835 - DEBUG - [Pod Pod ctest-pod-54191403] Cmd wget http://10.101.112.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:26:31,835 - DEBUG - [Pod Pod ctest-pod-54191403] Cmd output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:26:36,918 - DEBUG - [Pod ctest-pod-54191403] Cmd: wget http://10.101.112.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:26:36,918 - DEBUG - [Pod Pod ctest-pod-54191403] Cmd wget http://10.101.112.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:26:36,919 - DEBUG - [Pod Pod ctest-pod-54191403] Cmd output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:26:41,997 - DEBUG - [Pod ctest-pod-54191403] Cmd: wget http://10.101.112.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:26:41,997 - DEBUG - [Pod Pod ctest-pod-54191403] Cmd wget http://10.101.112.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:26:41,997 - DEBUG - [Pod Pod ctest-pod-54191403] Cmd output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:26:47,070 - DEBUG - [Pod ctest-pod-54191403] Cmd: wget http://10.101.112.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:26:47,071 - DEBUG - [Pod Pod ctest-pod-54191403] Cmd wget http://10.101.112.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:26:47,071 - DEBUG - [Pod Pod ctest-pod-54191403] Cmd output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:26:52,145 - DEBUG - [Pod ctest-pod-54191403] Cmd: wget http://10.101.112.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:26:52,145 - DEBUG - [Pod Pod ctest-pod-54191403] Cmd wget http://10.101.112.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:26:52,145 - DEBUG - [Pod Pod ctest-pod-54191403] Cmd output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:26:57,221 - DEBUG - [Pod ctest-pod-54191403] Cmd: wget http://10.101.112.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:26:57,221 - DEBUG - [Pod Pod ctest-pod-54191403] Cmd wget http://10.101.112.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:26:57,221 - DEBUG - [Pod Pod ctest-pod-54191403] Cmd output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:27:02,301 - DEBUG - [Pod ctest-pod-54191403] Cmd: wget http://10.101.112.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:27:02,302 - DEBUG - [Pod Pod ctest-pod-54191403] Cmd wget http://10.101.112.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:27:02,302 - DEBUG - [Pod Pod ctest-pod-54191403] Cmd output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:27:07,386 - DEBUG - [Pod ctest-pod-54191403] Cmd: wget http://10.101.112.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:27:07,386 - DEBUG - [Pod Pod ctest-pod-54191403] Cmd wget http://10.101.112.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:27:07,386 - DEBUG - [Pod Pod ctest-pod-54191403] Cmd output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:27:12,456 - DEBUG - [Pod ctest-pod-54191403] Cmd: wget http://10.101.112.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:27:12,456 - DEBUG - [Pod Pod ctest-pod-54191403] Cmd wget http://10.101.112.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:27:12,456 - DEBUG - [Pod Pod ctest-pod-54191403] Cmd output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:27:17,570 - DEBUG - [Pod ctest-pod-54191403] Cmd: wget http://10.101.112.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:27:17,570 - DEBUG - [Pod Pod ctest-pod-54191403] Cmd wget http://10.101.112.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:27:17,570 - DEBUG - [Pod Pod ctest-pod-54191403] Cmd output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:27:17,570 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-28647913': 0, 'ctest-pod-48364581': 0} 2025-10-02 01:27:19,650 - DEBUG - [Pod ctest-pod-19018627] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.352 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.063 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.068 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.063/0.161/0.352 ms 2025-10-02 01:27:19,650 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-19018627 with expectation True passed 2025-10-02 01:27:21,735 - DEBUG - [Pod ctest-pod-54635483] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=1.482 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.075 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.062 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.062/0.539/1.482 ms 2025-10-02 01:27:21,735 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-54635483 with expectation True passed 2025-10-02 01:27:23,818 - DEBUG - [Pod ctest-pod-54191403] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.396 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.080 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.083 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.080/0.186/0.396 ms 2025-10-02 01:27:23,818 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-54191403 with expectation True passed 2025-10-02 01:27:23,890 - DEBUG - [Pod ctest-pod-19018627] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-02 01:27:23,890 - DEBUG - [Pod Pod ctest-pod-19018627] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-10-02 01:27:23,890 - DEBUG - [Pod Pod ctest-pod-19018627] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-02 01:27:23,890 - INFO - wget check of of http://10.47.255.250 from ctest-pod-19018627 passed 2025-10-02 01:27:23,964 - DEBUG - [Pod ctest-pod-19018627] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-02 01:27:23,964 - DEBUG - [Pod Pod ctest-pod-19018627] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 passed 2025-10-02 01:27:23,964 - DEBUG - [Pod Pod ctest-pod-19018627] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-02 01:27:23,964 - INFO - wget check of of http://10.47.255.249 from ctest-pod-19018627 passed 2025-10-02 01:27:29,033 - DEBUG - [Pod ctest-pod-54635483] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2025-10-02 01:27:29,033 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2025-10-02 01:27:29,033 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2025-10-02 01:27:29,033 - INFO - wget check of of http://10.47.255.249 from ctest-pod-54635483 passed 2025-10-02 01:27:34,116 - DEBUG - [Pod ctest-pod-98300861] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-10-02 01:27:34,117 - DEBUG - [Pod Pod ctest-pod-98300861] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-10-02 01:27:34,117 - DEBUG - [Pod Pod ctest-pod-98300861] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-10-02 01:27:34,117 - INFO - wget check of of http://10.47.255.250 from ctest-pod-98300861 passed 2025-10-02 01:27:34,131 - INFO - Updating Network Policy ingress-on-service 2025-10-02 01:27:39,214 - DEBUG - [Pod ctest-pod-54635483] Cmd: wget http://10.101.112.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:27:39,214 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd wget http://10.101.112.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:27:39,214 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:27:44,311 - DEBUG - [Pod ctest-pod-54635483] Cmd: wget http://10.101.112.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:27:44,311 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd wget http://10.101.112.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:27:44,311 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:27:49,397 - DEBUG - [Pod ctest-pod-54635483] Cmd: wget http://10.101.112.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:27:49,397 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd wget http://10.101.112.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:27:49,397 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:27:54,467 - DEBUG - [Pod ctest-pod-54635483] Cmd: wget http://10.101.112.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:27:54,467 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd wget http://10.101.112.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:27:54,467 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:27:59,542 - DEBUG - [Pod ctest-pod-54635483] Cmd: wget http://10.101.112.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:27:59,542 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd wget http://10.101.112.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:27:59,542 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:28:04,620 - DEBUG - [Pod ctest-pod-54635483] Cmd: wget http://10.101.112.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:28:04,620 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd wget http://10.101.112.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:28:04,620 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:28:09,698 - DEBUG - [Pod ctest-pod-54635483] Cmd: wget http://10.101.112.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:28:09,698 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd wget http://10.101.112.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:28:09,698 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:28:14,773 - DEBUG - [Pod ctest-pod-54635483] Cmd: wget http://10.101.112.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:28:14,773 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd wget http://10.101.112.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:28:14,773 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:28:19,840 - DEBUG - [Pod ctest-pod-54635483] Cmd: wget http://10.101.112.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:28:19,840 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd wget http://10.101.112.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:28:19,840 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:28:24,925 - DEBUG - [Pod ctest-pod-54635483] Cmd: wget http://10.101.112.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:28:24,925 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd wget http://10.101.112.173:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:28:24,925 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd output: Connecting to 10.101.112.173:80 (10.101.112.173:80) wget: download timed out 2025-10-02 01:28:24,925 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-28647913': 0, 'ctest-pod-48364581': 0} 2025-10-02 01:28:25,019 - DEBUG - [Pod ctest-pod-19018627] Cmd: wget http://10.101.112.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.112.173:80 (10.101.112.173:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-28647913 2025-10-02 01:28:25,019 - DEBUG - [Pod Pod ctest-pod-19018627] Cmd wget http://10.101.112.173:80/ -O - -T 5 -t 1 passed 2025-10-02 01:28:25,020 - DEBUG - [Pod Pod ctest-pod-19018627] Cmd output: Connecting to 10.101.112.173:80 (10.101.112.173:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-28647913 2025-10-02 01:28:25,092 - DEBUG - [Pod ctest-pod-19018627] Cmd: wget http://10.101.112.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.112.173:80 (10.101.112.173:80) ctest-pod-28647913 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-02 01:28:25,092 - DEBUG - [Pod Pod ctest-pod-19018627] Cmd wget http://10.101.112.173:80/ -O - -T 5 -t 1 passed 2025-10-02 01:28:25,092 - DEBUG - [Pod Pod ctest-pod-19018627] Cmd output: Connecting to 10.101.112.173:80 (10.101.112.173:80) ctest-pod-28647913 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-02 01:28:25,167 - DEBUG - [Pod ctest-pod-19018627] Cmd: wget http://10.101.112.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.112.173:80 (10.101.112.173:80) ctest-pod-28647913 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-02 01:28:25,167 - DEBUG - [Pod Pod ctest-pod-19018627] Cmd wget http://10.101.112.173:80/ -O - -T 5 -t 1 passed 2025-10-02 01:28:25,167 - DEBUG - [Pod Pod ctest-pod-19018627] Cmd output: Connecting to 10.101.112.173:80 (10.101.112.173:80) ctest-pod-28647913 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-02 01:28:25,245 - DEBUG - [Pod ctest-pod-19018627] Cmd: wget http://10.101.112.173:80/ -O - -T 5 -t 1 , Output: ctest-pod-48364581 Connecting to 10.101.112.173:80 (10.101.112.173:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-02 01:28:25,245 - DEBUG - [Pod Pod ctest-pod-19018627] Cmd wget http://10.101.112.173:80/ -O - -T 5 -t 1 passed 2025-10-02 01:28:25,245 - DEBUG - [Pod Pod ctest-pod-19018627] Cmd output: ctest-pod-48364581 Connecting to 10.101.112.173:80 (10.101.112.173:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-02 01:28:25,245 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-28647913': 3, 'ctest-pod-48364581': 1} 2025-10-02 01:28:25,316 - DEBUG - [Pod ctest-pod-54191403] Cmd: wget http://10.101.112.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.112.173:80 (10.101.112.173:80) ctest-pod-48364581 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-02 01:28:25,317 - DEBUG - [Pod Pod ctest-pod-54191403] Cmd wget http://10.101.112.173:80/ -O - -T 5 -t 1 passed 2025-10-02 01:28:25,317 - DEBUG - [Pod Pod ctest-pod-54191403] Cmd output: Connecting to 10.101.112.173:80 (10.101.112.173:80) ctest-pod-48364581 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-02 01:28:25,383 - DEBUG - [Pod ctest-pod-54191403] Cmd: wget http://10.101.112.173:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.112.173:80 (10.101.112.173:80) ctest-pod-28647913 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-02 01:28:25,384 - DEBUG - [Pod Pod ctest-pod-54191403] Cmd wget http://10.101.112.173:80/ -O - -T 5 -t 1 passed 2025-10-02 01:28:25,384 - DEBUG - [Pod Pod ctest-pod-54191403] Cmd output: Connecting to 10.101.112.173:80 (10.101.112.173:80) ctest-pod-28647913 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-02 01:28:25,384 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-28647913': 1, 'ctest-pod-48364581': 1} 2025-10-02 01:28:27,459 - DEBUG - [Pod ctest-pod-19018627] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.636 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.353 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.068 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.068/0.352/0.636 ms 2025-10-02 01:28:27,460 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-19018627 with expectation True passed 2025-10-02 01:28:29,549 - DEBUG - [Pod ctest-pod-54635483] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.959 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.077 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.369/0.959 ms 2025-10-02 01:28:29,549 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-54635483 with expectation True passed 2025-10-02 01:28:31,625 - DEBUG - [Pod ctest-pod-54191403] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.915 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.061 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.097 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.061/0.357/0.915 ms 2025-10-02 01:28:31,626 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-54191403 with expectation True passed 2025-10-02 01:28:31,692 - DEBUG - [Pod ctest-pod-19018627] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-02 01:28:31,693 - DEBUG - [Pod Pod ctest-pod-19018627] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-10-02 01:28:31,693 - DEBUG - [Pod Pod ctest-pod-19018627] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-02 01:28:31,693 - INFO - wget check of of http://10.47.255.250 from ctest-pod-19018627 passed 2025-10-02 01:28:31,759 - DEBUG - [Pod ctest-pod-19018627] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-02 01:28:31,759 - DEBUG - [Pod Pod ctest-pod-19018627] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 passed 2025-10-02 01:28:31,760 - DEBUG - [Pod Pod ctest-pod-19018627] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-02 01:28:31,760 - INFO - wget check of of http://10.47.255.249 from ctest-pod-19018627 passed 2025-10-02 01:28:36,865 - DEBUG - [Pod ctest-pod-54635483] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2025-10-02 01:28:36,865 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2025-10-02 01:28:36,865 - DEBUG - [Pod Pod ctest-pod-54635483] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2025-10-02 01:28:36,865 - INFO - wget check of of http://10.47.255.249 from ctest-pod-54635483 passed 2025-10-02 01:28:36,939 - DEBUG - [Pod ctest-pod-98300861] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-02 01:28:36,939 - DEBUG - [Pod Pod ctest-pod-98300861] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-10-02 01:28:36,939 - DEBUG - [Pod Pod ctest-pod-98300861] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-02 01:28:36,939 - INFO - wget check of of http://10.47.255.250 from ctest-pod-98300861 passed 2025-10-02 01:28:36,939 - INFO - Deleting Network Policy : ingress-on-service 2025-10-02 01:28:36,940 - INFO - Deleting service : ctest-nginx-svc-91080530 2025-10-02 01:28:37,521 - DEBUG - No XMPP flaps were noticed during the test