2025-06-30 16:58:30,367 - INFO - Using existing project ['default-domain', 'k8s-default'](e4e8fce6-8de8-4410-8e00-0db15a80bd69) 2025-06-30 16:58:30,383 - DEBUG - Namespace ctest-new-default-23033405 not present 2025-06-30 16:58:30,392 - INFO - Created namespace ctest-new-default-23033405 2025-06-30 16:58:33,397 - DEBUG - Namespace ctest-non-default-87691310 not present 2025-06-30 16:58:33,406 - INFO - Created namespace ctest-non-default-87691310 2025-06-30 16:58:36,420 - DEBUG - Pod ctest-pod-58121805 not present 2025-06-30 16:58:36,421 - INFO - Creating Pod ctest-pod-58121805 2025-06-30 16:58:36,458 - DEBUG - Pod : ctest-pod-58121805 UUID is c31b25d6-f423-4f31-82c4-3221b0d0d296 2025-06-30 16:58:36,460 - DEBUG - Pod ctest-pod-25955220 not present 2025-06-30 16:58:36,460 - INFO - Creating Pod ctest-pod-25955220 2025-06-30 16:58:36,498 - DEBUG - Pod : ctest-pod-25955220 UUID is 8718ec8f-7989-4cad-ad8b-2454470653f5 2025-06-30 16:58:36,501 - DEBUG - Pod ctest-pod-74075235 not present 2025-06-30 16:58:36,501 - INFO - Creating Pod ctest-pod-74075235 2025-06-30 16:58:36,521 - DEBUG - Pod : ctest-pod-74075235 UUID is 376bc57e-1ff0-48f2-9de9-fb09ef0b0449 2025-06-30 16:58:36,523 - DEBUG - Pod ctest-pod-93991316 not present 2025-06-30 16:58:36,523 - INFO - Creating Pod ctest-pod-93991316 2025-06-30 16:58:36,570 - DEBUG - Pod : ctest-pod-93991316 UUID is 2d32be6d-7885-46ea-a48c-6e5d3cae6a7b 2025-06-30 16:58:36,575 - DEBUG - Pod ctest-pod-94821726 not present 2025-06-30 16:58:36,575 - INFO - Creating Pod ctest-pod-94821726 2025-06-30 16:58:36,595 - DEBUG - Pod : ctest-pod-94821726 UUID is 5732db2e-ecc5-4a3d-9822-e5c7d7f19b1a 2025-06-30 16:58:36,597 - DEBUG - Pod ctest-pod-64011715 not present 2025-06-30 16:58:36,597 - INFO - Creating Pod ctest-pod-64011715 2025-06-30 16:58:36,617 - DEBUG - Pod : ctest-pod-64011715 UUID is 7d196180-385f-4c6b-9b19-80866af61190 2025-06-30 16:58:36,619 - DEBUG - Pod ctest-pod-21104361 not present 2025-06-30 16:58:36,619 - INFO - Creating Pod ctest-pod-21104361 2025-06-30 16:58:36,635 - DEBUG - Pod : ctest-pod-21104361 UUID is ecef2f23-23b3-46a6-a5a1-df19af2806d3 2025-06-30 16:58:36,637 - DEBUG - Pod ctest-pod-79904174 not present 2025-06-30 16:58:36,637 - INFO - Creating Pod ctest-pod-79904174 2025-06-30 16:58:36,660 - DEBUG - Pod : ctest-pod-79904174 UUID is dad674f2-0f6f-43c1-bf1e-252c557cb685 2025-06-30 16:58:36,814 - INFO - Project default-domain:k8s-ctest-new-default-23033405 for Namespace ctest-new-default-23033405 is seen in contrail-api 2025-06-30 16:58:36,814 - DEBUG - Project uuid in Contrail is 66bd0e43-8fa9-48df-a4dc-4efbbfa95e8e 2025-06-30 16:58:36,983 - DEBUG - Requesting: http://10.0.0.162:8108/Snh_NamespaceDatabaseList?namespace_uuid=2bda982e-b33a-4c1f-b014-aed910bde146 2025-06-30 16:58:36,987 - INFO - Namespace ctest-new-default-23033405 with uuid 2bda982e-b33a-4c1f-b014-aed910bde146 found in kube manager 2025-06-30 16:58:36,987 - INFO - Namespace ctest-new-default-23033405 verification passed 2025-06-30 16:58:37,183 - INFO - Project default-domain:k8s-ctest-non-default-87691310 for Namespace ctest-non-default-87691310 is seen in contrail-api 2025-06-30 16:58:37,184 - DEBUG - Project uuid in Contrail is 353001b2-4a9b-4675-9708-106baea16021 2025-06-30 16:58:37,184 - DEBUG - Requesting: http://10.0.0.162:8108/Snh_NamespaceDatabaseList?namespace_uuid=f1abf157-b02b-4ac4-b67a-83249a6ea52d 2025-06-30 16:58:37,188 - INFO - Namespace ctest-non-default-87691310 with uuid f1abf157-b02b-4ac4-b67a-83249a6ea52d found in kube manager 2025-06-30 16:58:37,188 - INFO - Namespace ctest-non-default-87691310 verification passed 2025-06-30 16:58:37,192 - DEBUG - Pod ctest-pod-58121805 not in running state.Currently in Pending 2025-06-30 16:58:42,198 - DEBUG - Pod ctest-pod-58121805 not in running state.Currently in Pending 2025-06-30 16:58:47,206 - INFO - Pod ctest-pod-58121805 is in running state.Got IP 10.47.255.251 2025-06-30 16:58:47,218 - DEBUG - Pod ctest-pod-58121805 has vmi 778fc0ea-55d3-11f0-b3da-fa163eaaf6fd 2025-06-30 16:58:47,219 - INFO - Verified pod ctest-pod-58121805 in contrail-api 2025-06-30 16:58:47,242 - DEBUG - VMI 778fc0ea-55d3-11f0-b3da-fa163eaaf6fd is active in agent 10.0.0.163 2025-06-30 16:58:47,242 - INFO - Verified Pod ctest-pod-58121805 in agent 10.0.0.163 2025-06-30 16:58:47,242 - DEBUG - Requesting: http://10.0.0.162:8108/Snh_VirtualMachineDatabaseList?x=c31b25d6-f423-4f31-82c4-3221b0d0d296 2025-06-30 16:58:47,246 - INFO - Pod ctest-pod-58121805 with uuid c31b25d6-f423-4f31-82c4-3221b0d0d296 found in kube manager 2025-06-30 16:58:47,246 - INFO - Pod ctest-pod-58121805 verification passed 2025-06-30 16:58:47,251 - DEBUG - Pod ctest-pod-25955220 not in running state.Currently in Pending 2025-06-30 16:58:52,257 - INFO - Pod ctest-pod-25955220 is in running state.Got IP 10.47.255.250 2025-06-30 16:58:52,312 - DEBUG - Pod ctest-pod-25955220 has vmi 780d7698-55d3-11f0-b3da-fa163eaaf6fd 2025-06-30 16:58:52,312 - INFO - Verified pod ctest-pod-25955220 in contrail-api 2025-06-30 16:58:52,335 - DEBUG - VMI 780d7698-55d3-11f0-b3da-fa163eaaf6fd is active in agent 10.0.0.163 2025-06-30 16:58:52,335 - INFO - Verified Pod ctest-pod-25955220 in agent 10.0.0.163 2025-06-30 16:58:52,335 - DEBUG - Requesting: http://10.0.0.162:8108/Snh_VirtualMachineDatabaseList?x=8718ec8f-7989-4cad-ad8b-2454470653f5 2025-06-30 16:58:52,340 - INFO - Pod ctest-pod-25955220 with uuid 8718ec8f-7989-4cad-ad8b-2454470653f5 found in kube manager 2025-06-30 16:58:52,340 - INFO - Pod ctest-pod-25955220 verification passed 2025-06-30 16:58:52,344 - INFO - Pod ctest-pod-74075235 is in running state.Got IP 10.47.255.249 2025-06-30 16:58:52,356 - DEBUG - Pod ctest-pod-74075235 has vmi 78ca3bde-55d3-11f0-b3da-fa163eaaf6fd 2025-06-30 16:58:52,356 - INFO - Verified pod ctest-pod-74075235 in contrail-api 2025-06-30 16:58:52,379 - DEBUG - VMI 78ca3bde-55d3-11f0-b3da-fa163eaaf6fd is active in agent 10.0.0.163 2025-06-30 16:58:52,379 - INFO - Verified Pod ctest-pod-74075235 in agent 10.0.0.163 2025-06-30 16:58:52,379 - DEBUG - Requesting: http://10.0.0.162:8108/Snh_VirtualMachineDatabaseList?x=376bc57e-1ff0-48f2-9de9-fb09ef0b0449 2025-06-30 16:58:52,384 - INFO - Pod ctest-pod-74075235 with uuid 376bc57e-1ff0-48f2-9de9-fb09ef0b0449 found in kube manager 2025-06-30 16:58:52,384 - INFO - Pod ctest-pod-74075235 verification passed 2025-06-30 16:58:52,391 - INFO - Pod ctest-pod-93991316 is in running state.Got IP 10.47.255.248 2025-06-30 16:58:52,447 - DEBUG - Pod ctest-pod-93991316 has vmi 79448736-55d3-11f0-b3da-fa163eaaf6fd 2025-06-30 16:58:52,447 - INFO - Verified pod ctest-pod-93991316 in contrail-api 2025-06-30 16:58:52,473 - DEBUG - VMI 79448736-55d3-11f0-b3da-fa163eaaf6fd is active in agent 10.0.0.163 2025-06-30 16:58:52,473 - INFO - Verified Pod ctest-pod-93991316 in agent 10.0.0.163 2025-06-30 16:58:52,474 - DEBUG - Requesting: http://10.0.0.162:8108/Snh_VirtualMachineDatabaseList?x=2d32be6d-7885-46ea-a48c-6e5d3cae6a7b 2025-06-30 16:58:52,478 - INFO - Pod ctest-pod-93991316 with uuid 2d32be6d-7885-46ea-a48c-6e5d3cae6a7b found in kube manager 2025-06-30 16:58:52,478 - INFO - Pod ctest-pod-93991316 verification passed 2025-06-30 16:58:52,482 - INFO - Pod ctest-pod-94821726 is in running state.Got IP 10.47.255.247 2025-06-30 16:58:52,494 - DEBUG - Pod ctest-pod-94821726 has vmi 79d36870-55d3-11f0-b3da-fa163eaaf6fd 2025-06-30 16:58:52,494 - INFO - Verified pod ctest-pod-94821726 in contrail-api 2025-06-30 16:58:52,520 - DEBUG - VMI 79d36870-55d3-11f0-b3da-fa163eaaf6fd is active in agent 10.0.0.163 2025-06-30 16:58:52,520 - INFO - Verified Pod ctest-pod-94821726 in agent 10.0.0.163 2025-06-30 16:58:52,520 - DEBUG - Requesting: http://10.0.0.162:8108/Snh_VirtualMachineDatabaseList?x=5732db2e-ecc5-4a3d-9822-e5c7d7f19b1a 2025-06-30 16:58:52,524 - INFO - Pod ctest-pod-94821726 with uuid 5732db2e-ecc5-4a3d-9822-e5c7d7f19b1a found in kube manager 2025-06-30 16:58:52,524 - INFO - Pod ctest-pod-94821726 verification passed 2025-06-30 16:58:52,529 - DEBUG - Pod ctest-pod-21104361 not in running state.Currently in Pending 2025-06-30 16:58:57,536 - INFO - Pod ctest-pod-21104361 is in running state.Got IP 10.47.255.245 2025-06-30 16:58:57,549 - DEBUG - Pod ctest-pod-21104361 has vmi 7acf4f00-55d3-11f0-b3da-fa163eaaf6fd 2025-06-30 16:58:57,549 - INFO - Verified pod ctest-pod-21104361 in contrail-api 2025-06-30 16:58:57,580 - DEBUG - VMI 7acf4f00-55d3-11f0-b3da-fa163eaaf6fd is active in agent 10.0.0.163 2025-06-30 16:58:57,581 - INFO - Verified Pod ctest-pod-21104361 in agent 10.0.0.163 2025-06-30 16:58:57,581 - DEBUG - Requesting: http://10.0.0.162:8108/Snh_VirtualMachineDatabaseList?x=ecef2f23-23b3-46a6-a5a1-df19af2806d3 2025-06-30 16:58:57,585 - INFO - Pod ctest-pod-21104361 with uuid ecef2f23-23b3-46a6-a5a1-df19af2806d3 found in kube manager 2025-06-30 16:58:57,585 - INFO - Pod ctest-pod-21104361 verification passed 2025-06-30 16:58:57,591 - INFO - Pod ctest-pod-64011715 is in running state.Got IP 10.47.255.246 2025-06-30 16:58:57,644 - DEBUG - Pod ctest-pod-64011715 has vmi 7a56c198-55d3-11f0-b3da-fa163eaaf6fd 2025-06-30 16:58:57,644 - INFO - Verified pod ctest-pod-64011715 in contrail-api 2025-06-30 16:58:57,661 - DEBUG - VMI 7a56c198-55d3-11f0-b3da-fa163eaaf6fd is active in agent 10.0.0.163 2025-06-30 16:58:57,661 - INFO - Verified Pod ctest-pod-64011715 in agent 10.0.0.163 2025-06-30 16:58:57,662 - DEBUG - Requesting: http://10.0.0.162:8108/Snh_VirtualMachineDatabaseList?x=7d196180-385f-4c6b-9b19-80866af61190 2025-06-30 16:58:57,667 - INFO - Pod ctest-pod-64011715 with uuid 7d196180-385f-4c6b-9b19-80866af61190 found in kube manager 2025-06-30 16:58:57,667 - INFO - Pod ctest-pod-64011715 verification passed 2025-06-30 16:58:57,673 - INFO - Pod ctest-pod-79904174 is in running state.Got IP 10.47.255.244 2025-06-30 16:58:57,686 - DEBUG - Pod ctest-pod-79904174 has vmi 7b3edaf0-55d3-11f0-b3da-fa163eaaf6fd 2025-06-30 16:58:57,686 - INFO - Verified pod ctest-pod-79904174 in contrail-api 2025-06-30 16:58:57,713 - DEBUG - VMI 7b3edaf0-55d3-11f0-b3da-fa163eaaf6fd is active in agent 10.0.0.163 2025-06-30 16:58:57,713 - INFO - Verified Pod ctest-pod-79904174 in agent 10.0.0.163 2025-06-30 16:58:57,713 - DEBUG - Requesting: http://10.0.0.162:8108/Snh_VirtualMachineDatabaseList?x=dad674f2-0f6f-43c1-bf1e-252c557cb685 2025-06-30 16:58:57,731 - INFO - Pod ctest-pod-79904174 with uuid dad674f2-0f6f-43c1-bf1e-252c557cb685 found in kube manager 2025-06-30 16:58:57,731 - INFO - Pod ctest-pod-79904174 verification passed 2025-06-30 16:58:57,731 - INFO - ================================================================================ 2025-06-30 16:58:57,731 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-06-30 16:58:57,731 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-06-30 16:58:58,075 - DEBUG - Nothing to compare xmpp stats {'10.0.0.163': {'10.0.0.162': '0'}} with 2025-06-30 16:58:58,075 - INFO - Initial checks done. Running the testcase now 2025-06-30 16:58:58,075 - INFO - 2025-06-30 16:58:58,162 - DEBUG - [Pod ctest-pod-58121805] Cmd: echo ctest-pod-58121805 > /usr/share/nginx/html/index.html, Output: 2025-06-30 16:58:58,252 - DEBUG - [Pod ctest-pod-25955220] Cmd: echo ctest-pod-25955220 > /usr/share/nginx/html/index.html, Output: 2025-06-30 16:58:58,332 - DEBUG - [Pod ctest-pod-74075235] Cmd: echo ctest-pod-74075235 > /usr/share/nginx/html/index.html, Output: 2025-06-30 16:58:58,460 - DEBUG - [Pod ctest-pod-93991316] Cmd: echo ctest-pod-93991316 > /usr/share/nginx/html/index.html, Output: 2025-06-30 16:58:58,463 - DEBUG - Service ctest-nginx-svc-30646492 not present 2025-06-30 16:58:58,463 - INFO - Creating service ctest-nginx-svc-30646492 2025-06-30 16:58:58,489 - INFO - Created Service ctest-nginx-svc-30646492 2025-06-30 16:58:58,496 - WARNING - Service UUID 97635136-e93f-44e2-91f0-26b80da098ee not yet found in contrail-api 2025-06-30 16:58:59,506 - INFO - Validated that Service ctest-nginx-svc-30646492 is seen in contrail-api 2025-06-30 16:58:59,506 - DEBUG - Requesting: http://10.0.0.162:8108/Snh_LoadbalancerDatabaseList?x=97635136-e93f-44e2-91f0-26b80da098ee 2025-06-30 16:58:59,511 - INFO - Service ctest-nginx-svc-30646492 with uuid 97635136-e93f-44e2-91f0-26b80da098ee found in kube manager 2025-06-30 16:58:59,511 - INFO - Service ctest-nginx-svc-30646492 verification passed 2025-06-30 16:59:00,641 - DEBUG - [Pod ctest-pod-94821726] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.79.120:80 (10.108.79.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-58121805 2025-06-30 16:59:00,641 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 passed 2025-06-30 16:59:00,641 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd output: Connecting to 10.108.79.120:80 (10.108.79.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-58121805 2025-06-30 16:59:00,729 - DEBUG - [Pod ctest-pod-94821726] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.79.120:80 (10.108.79.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-25955220 2025-06-30 16:59:00,729 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 passed 2025-06-30 16:59:00,729 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd output: Connecting to 10.108.79.120:80 (10.108.79.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-25955220 2025-06-30 16:59:00,729 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-58121805': 1, 'ctest-pod-25955220': 1} 2025-06-30 16:59:00,795 - DEBUG - [Pod ctest-pod-21104361] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: ctest-pod-58121805 Connecting to 10.108.79.120:80 (10.108.79.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 16:59:00,796 - DEBUG - [Pod Pod ctest-pod-21104361] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 passed 2025-06-30 16:59:00,796 - DEBUG - [Pod Pod ctest-pod-21104361] Cmd output: ctest-pod-58121805 Connecting to 10.108.79.120:80 (10.108.79.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 16:59:00,864 - DEBUG - [Pod ctest-pod-21104361] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: ctest-pod-25955220 Connecting to 10.108.79.120:80 (10.108.79.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 16:59:00,865 - DEBUG - [Pod Pod ctest-pod-21104361] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 passed 2025-06-30 16:59:00,865 - DEBUG - [Pod Pod ctest-pod-21104361] Cmd output: ctest-pod-25955220 Connecting to 10.108.79.120:80 (10.108.79.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 16:59:00,865 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-58121805': 1, 'ctest-pod-25955220': 1} 2025-06-30 16:59:00,868 - DEBUG - Network policy ingress-on-service not present 2025-06-30 16:59:00,868 - INFO - Creating Network Policy ingress-on-service 2025-06-30 16:59:00,947 - INFO - Network policy found in k8s 2025-06-30 16:59:00,947 - DEBUG - Requesting: http://10.0.0.162:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=985aaa7f-2d48-4ae5-8aba-14f393c60d31 2025-06-30 16:59:00,952 - INFO - Network Policy ingress-on-service with uuid 985aaa7f-2d48-4ae5-8aba-14f393c60d31 found in kube manager 2025-06-30 16:59:01,011 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-06-30 16:59:01,011 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-06-30 16:59:01,011 - DEBUG - Requesting: http://10.0.0.162:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=985aaa7f-2d48-4ae5-8aba-14f393c60d31 2025-06-30 16:59:01,047 - WARNING - Network policy with name ingress-on-service not found in agent 2025-06-30 16:59:03,048 - DEBUG - Requesting: http://10.0.0.162:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=985aaa7f-2d48-4ae5-8aba-14f393c60d31 2025-06-30 16:59:03,079 - INFO - Network policy with name ingress-on-service found in agent 2025-06-30 16:59:03,079 - INFO - Network Policy ingress-on-service verification passed 2025-06-30 16:59:08,152 - DEBUG - [Pod ctest-pod-94821726] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 16:59:08,152 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 16:59:08,152 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 16:59:13,248 - DEBUG - [Pod ctest-pod-94821726] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 16:59:13,248 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 16:59:13,248 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 16:59:18,334 - DEBUG - [Pod ctest-pod-94821726] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 16:59:18,334 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 16:59:18,334 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 16:59:23,451 - DEBUG - [Pod ctest-pod-94821726] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 16:59:23,451 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 16:59:23,451 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 16:59:28,567 - DEBUG - [Pod ctest-pod-94821726] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 16:59:28,567 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 16:59:28,567 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 16:59:33,674 - DEBUG - [Pod ctest-pod-94821726] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 16:59:33,674 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 16:59:33,674 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 16:59:38,773 - DEBUG - [Pod ctest-pod-94821726] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 16:59:38,774 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 16:59:38,774 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 16:59:43,876 - DEBUG - [Pod ctest-pod-94821726] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 16:59:43,876 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 16:59:43,876 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 16:59:48,984 - DEBUG - [Pod ctest-pod-94821726] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 16:59:48,984 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 16:59:48,984 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 16:59:54,056 - DEBUG - [Pod ctest-pod-94821726] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 16:59:54,056 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 16:59:54,056 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 16:59:54,056 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-58121805': 0, 'ctest-pod-25955220': 0} 2025-06-30 16:59:54,159 - DEBUG - [Pod ctest-pod-64011715] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: ctest-pod-25955220 Connecting to 10.108.79.120:80 (10.108.79.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 16:59:54,159 - DEBUG - [Pod Pod ctest-pod-64011715] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 passed 2025-06-30 16:59:54,159 - DEBUG - [Pod Pod ctest-pod-64011715] Cmd output: ctest-pod-25955220 Connecting to 10.108.79.120:80 (10.108.79.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 16:59:54,239 - DEBUG - [Pod ctest-pod-64011715] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: ctest-pod-25955220 Connecting to 10.108.79.120:80 (10.108.79.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 16:59:54,240 - DEBUG - [Pod Pod ctest-pod-64011715] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 passed 2025-06-30 16:59:54,240 - DEBUG - [Pod Pod ctest-pod-64011715] Cmd output: ctest-pod-25955220 Connecting to 10.108.79.120:80 (10.108.79.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 16:59:54,299 - DEBUG - [Pod ctest-pod-64011715] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: ctest-pod-25955220 Connecting to 10.108.79.120:80 (10.108.79.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 16:59:54,299 - DEBUG - [Pod Pod ctest-pod-64011715] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 passed 2025-06-30 16:59:54,299 - DEBUG - [Pod Pod ctest-pod-64011715] Cmd output: ctest-pod-25955220 Connecting to 10.108.79.120:80 (10.108.79.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 16:59:54,361 - DEBUG - [Pod ctest-pod-64011715] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: ctest-pod-25955220 Connecting to 10.108.79.120:80 (10.108.79.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 16:59:54,362 - DEBUG - [Pod Pod ctest-pod-64011715] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 passed 2025-06-30 16:59:54,362 - DEBUG - [Pod Pod ctest-pod-64011715] Cmd output: ctest-pod-25955220 Connecting to 10.108.79.120:80 (10.108.79.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 16:59:54,441 - DEBUG - [Pod ctest-pod-64011715] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: ctest-pod-25955220 Connecting to 10.108.79.120:80 (10.108.79.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 16:59:54,441 - DEBUG - [Pod Pod ctest-pod-64011715] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 passed 2025-06-30 16:59:54,441 - DEBUG - [Pod Pod ctest-pod-64011715] Cmd output: ctest-pod-25955220 Connecting to 10.108.79.120:80 (10.108.79.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 16:59:54,521 - DEBUG - [Pod ctest-pod-64011715] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: ctest-pod-58121805 Connecting to 10.108.79.120:80 (10.108.79.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 16:59:54,521 - DEBUG - [Pod Pod ctest-pod-64011715] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 passed 2025-06-30 16:59:54,521 - DEBUG - [Pod Pod ctest-pod-64011715] Cmd output: ctest-pod-58121805 Connecting to 10.108.79.120:80 (10.108.79.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 16:59:54,521 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-58121805': 1, 'ctest-pod-25955220': 5} 2025-06-30 16:59:57,159 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2025-06-30 17:00:07,502 - DEBUG - [Pod ctest-pod-21104361] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:00:07,502 - DEBUG - [Pod Pod ctest-pod-21104361] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:00:07,502 - DEBUG - [Pod Pod ctest-pod-21104361] Cmd output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:00:12,567 - DEBUG - [Pod ctest-pod-21104361] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:00:12,567 - DEBUG - [Pod Pod ctest-pod-21104361] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:00:12,567 - DEBUG - [Pod Pod ctest-pod-21104361] Cmd output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:00:17,638 - DEBUG - [Pod ctest-pod-21104361] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:00:17,638 - DEBUG - [Pod Pod ctest-pod-21104361] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:00:17,638 - DEBUG - [Pod Pod ctest-pod-21104361] Cmd output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:00:22,707 - DEBUG - [Pod ctest-pod-21104361] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:00:22,707 - DEBUG - [Pod Pod ctest-pod-21104361] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:00:22,707 - DEBUG - [Pod Pod ctest-pod-21104361] Cmd output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:00:27,794 - DEBUG - [Pod ctest-pod-21104361] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:00:27,794 - DEBUG - [Pod Pod ctest-pod-21104361] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:00:27,794 - DEBUG - [Pod Pod ctest-pod-21104361] Cmd output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:00:32,869 - DEBUG - [Pod ctest-pod-21104361] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:00:32,870 - DEBUG - [Pod Pod ctest-pod-21104361] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:00:32,870 - DEBUG - [Pod Pod ctest-pod-21104361] Cmd output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:00:37,982 - DEBUG - [Pod ctest-pod-21104361] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:00:37,982 - DEBUG - [Pod Pod ctest-pod-21104361] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:00:37,982 - DEBUG - [Pod Pod ctest-pod-21104361] Cmd output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:00:43,073 - DEBUG - [Pod ctest-pod-21104361] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:00:43,073 - DEBUG - [Pod Pod ctest-pod-21104361] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:00:43,073 - DEBUG - [Pod Pod ctest-pod-21104361] Cmd output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:00:48,177 - DEBUG - [Pod ctest-pod-21104361] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:00:48,177 - DEBUG - [Pod Pod ctest-pod-21104361] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:00:48,177 - DEBUG - [Pod Pod ctest-pod-21104361] Cmd output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:00:53,262 - DEBUG - [Pod ctest-pod-21104361] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:00:53,262 - DEBUG - [Pod Pod ctest-pod-21104361] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:00:53,262 - DEBUG - [Pod Pod ctest-pod-21104361] Cmd output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:00:53,262 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-58121805': 0, 'ctest-pod-25955220': 0} 2025-06-30 17:00:55,358 - DEBUG - [Pod ctest-pod-64011715] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=3.033 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.095 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.091 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.091/1.073/3.033 ms 2025-06-30 17:00:55,358 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-64011715 with expectation True passed 2025-06-30 17:00:57,435 - DEBUG - [Pod ctest-pod-94821726] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.910 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.205 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.147 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.147/0.420/0.910 ms 2025-06-30 17:00:57,435 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-94821726 with expectation True passed 2025-06-30 17:00:59,513 - DEBUG - [Pod ctest-pod-21104361] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.814 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.086 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.256 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.086/0.385/0.814 ms 2025-06-30 17:00:59,513 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-21104361 with expectation True passed 2025-06-30 17:00:59,624 - DEBUG - [Pod ctest-pod-64011715] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-30 17:00:59,624 - DEBUG - [Pod Pod ctest-pod-64011715] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-06-30 17:00:59,624 - DEBUG - [Pod Pod ctest-pod-64011715] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-30 17:00:59,624 - INFO - wget check of of http://10.47.255.251 from ctest-pod-64011715 passed 2025-06-30 17:00:59,717 - DEBUG - [Pod ctest-pod-64011715] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-30 17:00:59,718 - DEBUG - [Pod Pod ctest-pod-64011715] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-06-30 17:00:59,718 - DEBUG - [Pod Pod ctest-pod-64011715] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-30 17:00:59,718 - INFO - wget check of of http://10.47.255.250 from ctest-pod-64011715 passed 2025-06-30 17:01:04,785 - DEBUG - [Pod ctest-pod-94821726] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-30 17:01:04,785 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-30 17:01:04,785 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-30 17:01:04,785 - INFO - wget check of of http://10.47.255.250 from ctest-pod-94821726 passed 2025-06-30 17:01:09,900 - DEBUG - [Pod ctest-pod-79904174] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-06-30 17:01:09,900 - DEBUG - [Pod Pod ctest-pod-79904174] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-06-30 17:01:09,900 - DEBUG - [Pod Pod ctest-pod-79904174] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-06-30 17:01:09,900 - INFO - wget check of of http://10.47.255.251 from ctest-pod-79904174 passed 2025-06-30 17:01:09,916 - INFO - Updating Network Policy ingress-on-service 2025-06-30 17:01:15,037 - DEBUG - [Pod ctest-pod-94821726] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:01:15,037 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:01:15,037 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:01:20,132 - DEBUG - [Pod ctest-pod-94821726] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:01:20,132 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:01:20,132 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:01:25,206 - DEBUG - [Pod ctest-pod-94821726] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:01:25,206 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:01:25,206 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:01:30,294 - DEBUG - [Pod ctest-pod-94821726] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:01:30,294 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:01:30,294 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:01:35,361 - DEBUG - [Pod ctest-pod-94821726] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:01:35,361 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:01:35,361 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:01:40,451 - DEBUG - [Pod ctest-pod-94821726] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:01:40,451 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:01:40,451 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:01:45,528 - DEBUG - [Pod ctest-pod-94821726] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:01:45,528 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:01:45,528 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:01:50,637 - DEBUG - [Pod ctest-pod-94821726] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:01:50,638 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:01:50,638 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:01:55,743 - DEBUG - [Pod ctest-pod-94821726] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:01:55,743 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:01:55,743 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:02:00,837 - DEBUG - [Pod ctest-pod-94821726] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:02:00,837 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:02:00,837 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd output: Connecting to 10.108.79.120:80 (10.108.79.120:80) wget: download timed out 2025-06-30 17:02:00,837 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-58121805': 0, 'ctest-pod-25955220': 0} 2025-06-30 17:02:00,923 - DEBUG - [Pod ctest-pod-64011715] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: ctest-pod-58121805 Connecting to 10.108.79.120:80 (10.108.79.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 17:02:00,923 - DEBUG - [Pod Pod ctest-pod-64011715] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 passed 2025-06-30 17:02:00,923 - DEBUG - [Pod Pod ctest-pod-64011715] Cmd output: ctest-pod-58121805 Connecting to 10.108.79.120:80 (10.108.79.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 17:02:00,983 - DEBUG - [Pod ctest-pod-64011715] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: ctest-pod-25955220 Connecting to 10.108.79.120:80 (10.108.79.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 17:02:00,983 - DEBUG - [Pod Pod ctest-pod-64011715] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 passed 2025-06-30 17:02:00,984 - DEBUG - [Pod Pod ctest-pod-64011715] Cmd output: ctest-pod-25955220 Connecting to 10.108.79.120:80 (10.108.79.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 17:02:00,984 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-58121805': 1, 'ctest-pod-25955220': 1} 2025-06-30 17:02:01,054 - DEBUG - [Pod ctest-pod-21104361] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: ctest-pod-25955220 Connecting to 10.108.79.120:80 (10.108.79.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 17:02:01,054 - DEBUG - [Pod Pod ctest-pod-21104361] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 passed 2025-06-30 17:02:01,054 - DEBUG - [Pod Pod ctest-pod-21104361] Cmd output: ctest-pod-25955220 Connecting to 10.108.79.120:80 (10.108.79.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 17:02:01,125 - DEBUG - [Pod ctest-pod-21104361] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: ctest-pod-25955220 Connecting to 10.108.79.120:80 (10.108.79.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 17:02:01,125 - DEBUG - [Pod Pod ctest-pod-21104361] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 passed 2025-06-30 17:02:01,125 - DEBUG - [Pod Pod ctest-pod-21104361] Cmd output: ctest-pod-25955220 Connecting to 10.108.79.120:80 (10.108.79.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 17:02:01,187 - DEBUG - [Pod ctest-pod-21104361] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: ctest-pod-25955220 Connecting to 10.108.79.120:80 (10.108.79.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 17:02:01,187 - DEBUG - [Pod Pod ctest-pod-21104361] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 passed 2025-06-30 17:02:01,187 - DEBUG - [Pod Pod ctest-pod-21104361] Cmd output: ctest-pod-25955220 Connecting to 10.108.79.120:80 (10.108.79.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 17:02:01,249 - DEBUG - [Pod ctest-pod-21104361] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: ctest-pod-25955220 Connecting to 10.108.79.120:80 (10.108.79.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 17:02:01,249 - DEBUG - [Pod Pod ctest-pod-21104361] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 passed 2025-06-30 17:02:01,249 - DEBUG - [Pod Pod ctest-pod-21104361] Cmd output: ctest-pod-25955220 Connecting to 10.108.79.120:80 (10.108.79.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 17:02:01,317 - DEBUG - [Pod ctest-pod-21104361] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.79.120:80 (10.108.79.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-25955220 2025-06-30 17:02:01,317 - DEBUG - [Pod Pod ctest-pod-21104361] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 passed 2025-06-30 17:02:01,317 - DEBUG - [Pod Pod ctest-pod-21104361] Cmd output: Connecting to 10.108.79.120:80 (10.108.79.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-25955220 2025-06-30 17:02:01,386 - DEBUG - [Pod ctest-pod-21104361] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: ctest-pod-25955220 Connecting to 10.108.79.120:80 (10.108.79.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 17:02:01,386 - DEBUG - [Pod Pod ctest-pod-21104361] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 passed 2025-06-30 17:02:01,386 - DEBUG - [Pod Pod ctest-pod-21104361] Cmd output: ctest-pod-25955220 Connecting to 10.108.79.120:80 (10.108.79.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 17:02:01,454 - DEBUG - [Pod ctest-pod-21104361] Cmd: wget http://10.108.79.120:80/ -O - -T 5 -t 1 , Output: ctest-pod-58121805 Connecting to 10.108.79.120:80 (10.108.79.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 17:02:01,454 - DEBUG - [Pod Pod ctest-pod-21104361] Cmd wget http://10.108.79.120:80/ -O - -T 5 -t 1 passed 2025-06-30 17:02:01,454 - DEBUG - [Pod Pod ctest-pod-21104361] Cmd output: ctest-pod-58121805 Connecting to 10.108.79.120:80 (10.108.79.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 17:02:01,454 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-58121805': 1, 'ctest-pod-25955220': 6} 2025-06-30 17:02:03,521 - DEBUG - [Pod ctest-pod-64011715] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.869 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.137 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.146 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.137/0.384/0.869 ms 2025-06-30 17:02:03,521 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-64011715 with expectation True passed 2025-06-30 17:02:05,603 - DEBUG - [Pod ctest-pod-94821726] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.719 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.115 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.096 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.096/0.310/0.719 ms 2025-06-30 17:02:05,603 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-94821726 with expectation True passed 2025-06-30 17:02:07,664 - DEBUG - [Pod ctest-pod-21104361] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.554 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.137 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.086 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.086/0.259/0.554 ms 2025-06-30 17:02:07,664 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-21104361 with expectation True passed 2025-06-30 17:02:07,766 - DEBUG - [Pod ctest-pod-64011715] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-30 17:02:07,766 - DEBUG - [Pod Pod ctest-pod-64011715] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-06-30 17:02:07,766 - DEBUG - [Pod Pod ctest-pod-64011715] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-30 17:02:07,766 - INFO - wget check of of http://10.47.255.251 from ctest-pod-64011715 passed 2025-06-30 17:02:07,873 - DEBUG - [Pod ctest-pod-64011715] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-30 17:02:07,873 - DEBUG - [Pod Pod ctest-pod-64011715] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-06-30 17:02:07,873 - DEBUG - [Pod Pod ctest-pod-64011715] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-30 17:02:07,873 - INFO - wget check of of http://10.47.255.250 from ctest-pod-64011715 passed 2025-06-30 17:02:12,958 - DEBUG - [Pod ctest-pod-94821726] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-30 17:02:12,958 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-30 17:02:12,958 - DEBUG - [Pod Pod ctest-pod-94821726] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-30 17:02:12,958 - INFO - wget check of of http://10.47.255.250 from ctest-pod-94821726 passed 2025-06-30 17:02:13,054 - DEBUG - [Pod ctest-pod-79904174] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-30 17:02:13,055 - DEBUG - [Pod Pod ctest-pod-79904174] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-06-30 17:02:13,055 - DEBUG - [Pod Pod ctest-pod-79904174] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-30 17:02:13,055 - INFO - wget check of of http://10.47.255.251 from ctest-pod-79904174 passed 2025-06-30 17:02:13,055 - INFO - Deleting Network Policy : ingress-on-service 2025-06-30 17:02:13,055 - INFO - Deleting service : ctest-nginx-svc-30646492 2025-06-30 17:02:13,392 - DEBUG - No XMPP flaps were noticed during the test 2025-06-30 17:02:13,392 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:16] 2025-06-30 17:02:13,392 - INFO - -------------------------------------------------------------------------------- 2025-06-30 17:02:13,397 - INFO - Deleting pod ctest-new-default-23033405:ctest-pod-58121805 2025-06-30 17:02:13,399 - INFO - Deleting pod ctest-new-default-23033405:ctest-pod-25955220 2025-06-30 17:02:13,402 - INFO - Deleting pod ctest-non-default-87691310:ctest-pod-74075235 2025-06-30 17:02:13,402 - INFO - Deleting pod ctest-non-default-87691310:ctest-pod-93991316 2025-06-30 17:02:13,403 - INFO - Deleting pod ctest-new-default-23033405:ctest-pod-94821726 2025-06-30 17:02:13,403 - INFO - Deleting pod ctest-new-default-23033405:ctest-pod-64011715 2025-06-30 17:02:13,404 - INFO - Deleting pod ctest-non-default-87691310:ctest-pod-21104361 2025-06-30 17:02:13,404 - INFO - Deleting pod ctest-non-default-87691310:ctest-pod-79904174 2025-06-30 17:02:13,525 - WARNING - Pod uuid c31b25d6-f423-4f31-82c4-3221b0d0d296 is still seen in agent 10.0.0.163 VM list 2025-06-30 17:02:13,558 - WARNING - Pod uuid dad674f2-0f6f-43c1-bf1e-252c557cb685 is still seen in agent 10.0.0.163 VM list 2025-06-30 17:02:13,559 - WARNING - Pod uuid 7d196180-385f-4c6b-9b19-80866af61190 is still seen in agent 10.0.0.163 VM list 2025-06-30 17:02:13,560 - WARNING - Pod uuid 8718ec8f-7989-4cad-ad8b-2454470653f5 is still seen in agent 10.0.0.163 VM list 2025-06-30 17:02:13,560 - WARNING - Pod uuid 2d32be6d-7885-46ea-a48c-6e5d3cae6a7b is still seen in agent 10.0.0.163 VM list 2025-06-30 17:02:13,563 - WARNING - Pod uuid ecef2f23-23b3-46a6-a5a1-df19af2806d3 is still seen in agent 10.0.0.163 VM list 2025-06-30 17:02:13,565 - WARNING - Pod uuid 5732db2e-ecc5-4a3d-9822-e5c7d7f19b1a is still seen in agent 10.0.0.163 VM list 2025-06-30 17:02:13,566 - WARNING - Pod uuid 376bc57e-1ff0-48f2-9de9-fb09ef0b0449 is still seen in agent 10.0.0.163 VM list 2025-06-30 17:02:18,552 - WARNING - Pod uuid c31b25d6-f423-4f31-82c4-3221b0d0d296 is still seen in agent 10.0.0.163 VM list 2025-06-30 17:02:18,644 - DEBUG - Pod 2d32be6d-7885-46ea-a48c-6e5d3cae6a7b is not in agent 10.0.0.163 VM list 2025-06-30 17:02:18,648 - DEBUG - Pod 8718ec8f-7989-4cad-ad8b-2454470653f5 is not in agent 10.0.0.163 VM list 2025-06-30 17:02:18,649 - WARNING - Pod uuid dad674f2-0f6f-43c1-bf1e-252c557cb685 is still seen in agent 10.0.0.163 VM list 2025-06-30 17:02:18,649 - DEBUG - Pod 376bc57e-1ff0-48f2-9de9-fb09ef0b0449 is not in agent 10.0.0.163 VM list 2025-06-30 17:02:18,651 - WARNING - Pod uuid ecef2f23-23b3-46a6-a5a1-df19af2806d3 is still seen in agent 10.0.0.163 VM list 2025-06-30 17:02:18,651 - WARNING - Pod uuid 5732db2e-ecc5-4a3d-9822-e5c7d7f19b1a is still seen in agent 10.0.0.163 VM list 2025-06-30 17:02:18,651 - WARNING - Pod uuid 7d196180-385f-4c6b-9b19-80866af61190 is still seen in agent 10.0.0.163 VM list 2025-06-30 17:02:18,681 - DEBUG - VMI 79448736-55d3-11f0-b3da-fa163eaaf6fd is removed from agent 10.0.0.163 2025-06-30 17:02:18,681 - INFO - Verified that pod ctest-pod-93991316 is removed in agent 2025-06-30 17:02:18,682 - DEBUG - VMI 780d7698-55d3-11f0-b3da-fa163eaaf6fd is removed from agent 10.0.0.163 2025-06-30 17:02:18,682 - INFO - Verified that pod ctest-pod-25955220 is removed in agent 2025-06-30 17:02:18,682 - DEBUG - VMI 78ca3bde-55d3-11f0-b3da-fa163eaaf6fd is removed from agent 10.0.0.163 2025-06-30 17:02:18,682 - INFO - Verified that pod ctest-pod-74075235 is removed in agent 2025-06-30 17:02:23,565 - WARNING - Pod uuid c31b25d6-f423-4f31-82c4-3221b0d0d296 is still seen in agent 10.0.0.163 VM list 2025-06-30 17:02:23,694 - WARNING - Pod uuid 5732db2e-ecc5-4a3d-9822-e5c7d7f19b1a is still seen in agent 10.0.0.163 VM list 2025-06-30 17:02:23,695 - WARNING - Pod uuid 7d196180-385f-4c6b-9b19-80866af61190 is still seen in agent 10.0.0.163 VM list 2025-06-30 17:02:23,696 - WARNING - Pod uuid ecef2f23-23b3-46a6-a5a1-df19af2806d3 is still seen in agent 10.0.0.163 VM list 2025-06-30 17:02:23,696 - WARNING - Pod uuid dad674f2-0f6f-43c1-bf1e-252c557cb685 is still seen in agent 10.0.0.163 VM list 2025-06-30 17:02:28,580 - WARNING - Pod uuid c31b25d6-f423-4f31-82c4-3221b0d0d296 is still seen in agent 10.0.0.163 VM list 2025-06-30 17:02:28,745 - WARNING - Pod uuid ecef2f23-23b3-46a6-a5a1-df19af2806d3 is still seen in agent 10.0.0.163 VM list 2025-06-30 17:02:28,746 - WARNING - Pod uuid 7d196180-385f-4c6b-9b19-80866af61190 is still seen in agent 10.0.0.163 VM list 2025-06-30 17:02:28,746 - WARNING - Pod uuid dad674f2-0f6f-43c1-bf1e-252c557cb685 is still seen in agent 10.0.0.163 VM list 2025-06-30 17:02:28,746 - WARNING - Pod uuid 5732db2e-ecc5-4a3d-9822-e5c7d7f19b1a is still seen in agent 10.0.0.163 VM list 2025-06-30 17:02:33,600 - WARNING - Pod uuid c31b25d6-f423-4f31-82c4-3221b0d0d296 is still seen in agent 10.0.0.163 VM list 2025-06-30 17:02:33,790 - WARNING - Pod uuid 5732db2e-ecc5-4a3d-9822-e5c7d7f19b1a is still seen in agent 10.0.0.163 VM list 2025-06-30 17:02:33,790 - WARNING - Pod uuid ecef2f23-23b3-46a6-a5a1-df19af2806d3 is still seen in agent 10.0.0.163 VM list 2025-06-30 17:02:33,792 - WARNING - Pod uuid dad674f2-0f6f-43c1-bf1e-252c557cb685 is still seen in agent 10.0.0.163 VM list 2025-06-30 17:02:33,792 - WARNING - Pod uuid 7d196180-385f-4c6b-9b19-80866af61190 is still seen in agent 10.0.0.163 VM list 2025-06-30 17:02:38,620 - WARNING - Pod uuid c31b25d6-f423-4f31-82c4-3221b0d0d296 is still seen in agent 10.0.0.163 VM list 2025-06-30 17:02:38,822 - WARNING - Pod uuid 5732db2e-ecc5-4a3d-9822-e5c7d7f19b1a is still seen in agent 10.0.0.163 VM list 2025-06-30 17:02:38,823 - WARNING - Pod uuid ecef2f23-23b3-46a6-a5a1-df19af2806d3 is still seen in agent 10.0.0.163 VM list 2025-06-30 17:02:38,825 - WARNING - Pod uuid dad674f2-0f6f-43c1-bf1e-252c557cb685 is still seen in agent 10.0.0.163 VM list 2025-06-30 17:02:38,826 - WARNING - Pod uuid 7d196180-385f-4c6b-9b19-80866af61190 is still seen in agent 10.0.0.163 VM list 2025-06-30 17:02:43,632 - WARNING - Pod uuid c31b25d6-f423-4f31-82c4-3221b0d0d296 is still seen in agent 10.0.0.163 VM list 2025-06-30 17:02:43,871 - WARNING - Pod uuid dad674f2-0f6f-43c1-bf1e-252c557cb685 is still seen in agent 10.0.0.163 VM list 2025-06-30 17:02:43,872 - WARNING - Pod uuid ecef2f23-23b3-46a6-a5a1-df19af2806d3 is still seen in agent 10.0.0.163 VM list 2025-06-30 17:02:43,873 - WARNING - Pod uuid 7d196180-385f-4c6b-9b19-80866af61190 is still seen in agent 10.0.0.163 VM list 2025-06-30 17:02:43,873 - WARNING - Pod uuid 5732db2e-ecc5-4a3d-9822-e5c7d7f19b1a is still seen in agent 10.0.0.163 VM list 2025-06-30 17:02:48,649 - DEBUG - Pod c31b25d6-f423-4f31-82c4-3221b0d0d296 is not in agent 10.0.0.163 VM list 2025-06-30 17:02:48,664 - DEBUG - VMI 778fc0ea-55d3-11f0-b3da-fa163eaaf6fd is removed from agent 10.0.0.163 2025-06-30 17:02:48,664 - INFO - Verified that pod ctest-pod-58121805 is removed in agent 2025-06-30 17:02:48,914 - DEBUG - Pod ecef2f23-23b3-46a6-a5a1-df19af2806d3 is not in agent 10.0.0.163 VM list 2025-06-30 17:02:48,916 - DEBUG - Pod dad674f2-0f6f-43c1-bf1e-252c557cb685 is not in agent 10.0.0.163 VM list 2025-06-30 17:02:48,919 - DEBUG - Pod 7d196180-385f-4c6b-9b19-80866af61190 is not in agent 10.0.0.163 VM list 2025-06-30 17:02:48,920 - DEBUG - Pod 5732db2e-ecc5-4a3d-9822-e5c7d7f19b1a is not in agent 10.0.0.163 VM list 2025-06-30 17:02:48,956 - DEBUG - VMI 7acf4f00-55d3-11f0-b3da-fa163eaaf6fd is removed from agent 10.0.0.163 2025-06-30 17:02:48,956 - INFO - Verified that pod ctest-pod-21104361 is removed in agent 2025-06-30 17:02:48,956 - DEBUG - VMI 7b3edaf0-55d3-11f0-b3da-fa163eaaf6fd is removed from agent 10.0.0.163 2025-06-30 17:02:48,956 - INFO - Verified that pod ctest-pod-79904174 is removed in agent 2025-06-30 17:02:48,958 - DEBUG - VMI 7a56c198-55d3-11f0-b3da-fa163eaaf6fd is removed from agent 10.0.0.163 2025-06-30 17:02:48,958 - INFO - Verified that pod ctest-pod-64011715 is removed in agent 2025-06-30 17:02:48,959 - DEBUG - VMI 79d36870-55d3-11f0-b3da-fa163eaaf6fd is removed from agent 10.0.0.163 2025-06-30 17:02:48,959 - INFO - Verified that pod ctest-pod-94821726 is removed in agent 2025-06-30 17:02:48,960 - INFO - Deleting namespace ctest-non-default-87691310 2025-06-30 17:02:48,979 - DEBUG - Namespace ctest-non-default-87691310 still in k8s 2025-06-30 17:02:50,984 - DEBUG - Namespace ctest-non-default-87691310 still in k8s 2025-06-30 17:02:52,990 - DEBUG - Namespace ctest-non-default-87691310 still in k8s 2025-06-30 17:02:55,000 - DEBUG - Namespace ctest-non-default-87691310 is not in k8s 2025-06-30 17:02:55,000 - DEBUG - No need to check project deletion in contrail-api 2025-06-30 17:02:55,000 - INFO - Deleting namespace ctest-new-default-23033405 2025-06-30 17:02:55,012 - DEBUG - Namespace ctest-new-default-23033405 still in k8s 2025-06-30 17:02:57,017 - DEBUG - Namespace ctest-new-default-23033405 still in k8s 2025-06-30 17:02:59,023 - DEBUG - Namespace ctest-new-default-23033405 still in k8s 2025-06-30 17:03:01,027 - DEBUG - Namespace ctest-new-default-23033405 is not in k8s 2025-06-30 17:03:01,027 - DEBUG - No need to check project deletion in contrail-api