2025-07-14 01:53:57,256 - INFO - Using existing project ['default-domain', 'k8s-default'](381b28aa-8f35-4794-9a10-5be45ae6f373) 2025-07-14 01:53:57,277 - DEBUG - Namespace ctest-new-default-82558740 not present 2025-07-14 01:53:57,293 - INFO - Created namespace ctest-new-default-82558740 2025-07-14 01:54:00,299 - DEBUG - Namespace ctest-non-default-39243909 not present 2025-07-14 01:54:00,309 - INFO - Created namespace ctest-non-default-39243909 2025-07-14 01:54:03,332 - DEBUG - Pod ctest-pod-82808904 not present 2025-07-14 01:54:03,332 - INFO - Creating Pod ctest-pod-82808904 2025-07-14 01:54:03,352 - DEBUG - Pod : ctest-pod-82808904 UUID is 5df62a48-2640-4a9c-be8e-0602f28c83a1 2025-07-14 01:54:03,354 - DEBUG - Pod ctest-pod-21346518 not present 2025-07-14 01:54:03,354 - INFO - Creating Pod ctest-pod-21346518 2025-07-14 01:54:03,396 - DEBUG - Pod : ctest-pod-21346518 UUID is 132673de-0954-44b0-a7e5-b88c7d43f481 2025-07-14 01:54:03,399 - DEBUG - Pod ctest-pod-82158189 not present 2025-07-14 01:54:03,399 - INFO - Creating Pod ctest-pod-82158189 2025-07-14 01:54:03,440 - DEBUG - Pod : ctest-pod-82158189 UUID is 83e264ab-031a-42c8-938a-bbc1160193b3 2025-07-14 01:54:03,443 - DEBUG - Pod ctest-pod-79436160 not present 2025-07-14 01:54:03,443 - INFO - Creating Pod ctest-pod-79436160 2025-07-14 01:54:03,461 - DEBUG - Pod : ctest-pod-79436160 UUID is 494f5784-7842-45f6-9461-f60a860db7be 2025-07-14 01:54:03,467 - DEBUG - Pod ctest-pod-20245916 not present 2025-07-14 01:54:03,467 - INFO - Creating Pod ctest-pod-20245916 2025-07-14 01:54:03,486 - DEBUG - Pod : ctest-pod-20245916 UUID is d29aa64b-285e-4a47-8381-00aac9c99ff9 2025-07-14 01:54:03,488 - DEBUG - Pod ctest-pod-48828767 not present 2025-07-14 01:54:03,489 - INFO - Creating Pod ctest-pod-48828767 2025-07-14 01:54:03,514 - DEBUG - Pod : ctest-pod-48828767 UUID is 51082ca3-bdd0-47de-b3f4-e6aec548e753 2025-07-14 01:54:03,516 - DEBUG - Pod ctest-pod-36010672 not present 2025-07-14 01:54:03,516 - INFO - Creating Pod ctest-pod-36010672 2025-07-14 01:54:03,538 - DEBUG - Pod : ctest-pod-36010672 UUID is c927c416-2501-4680-9282-e9fd38c8e7fe 2025-07-14 01:54:03,540 - DEBUG - Pod ctest-pod-74764227 not present 2025-07-14 01:54:03,540 - INFO - Creating Pod ctest-pod-74764227 2025-07-14 01:54:03,561 - DEBUG - Pod : ctest-pod-74764227 UUID is 0f294486-9c7b-4e22-ad97-bc345c279918 2025-07-14 01:54:03,772 - INFO - Project default-domain:k8s-ctest-new-default-82558740 for Namespace ctest-new-default-82558740 is seen in contrail-api 2025-07-14 01:54:03,772 - DEBUG - Project uuid in Contrail is 452a79c8-e6af-42eb-bde3-fef60b8cd428 2025-07-14 01:54:03,960 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NamespaceDatabaseList?namespace_uuid=c8895b40-df8d-4754-8f74-9f0691d8f71f 2025-07-14 01:54:03,967 - INFO - Namespace ctest-new-default-82558740 with uuid c8895b40-df8d-4754-8f74-9f0691d8f71f found in kube manager 2025-07-14 01:54:03,967 - INFO - Namespace ctest-new-default-82558740 verification passed 2025-07-14 01:54:04,231 - INFO - Project default-domain:k8s-ctest-non-default-39243909 for Namespace ctest-non-default-39243909 is seen in contrail-api 2025-07-14 01:54:04,232 - DEBUG - Project uuid in Contrail is e3d24004-bd68-4d16-9141-938b5f12292b 2025-07-14 01:54:04,232 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NamespaceDatabaseList?namespace_uuid=7d63b6b7-0020-4568-b432-0aadc2a13e14 2025-07-14 01:54:04,237 - INFO - Namespace ctest-non-default-39243909 with uuid 7d63b6b7-0020-4568-b432-0aadc2a13e14 found in kube manager 2025-07-14 01:54:04,238 - INFO - Namespace ctest-non-default-39243909 verification passed 2025-07-14 01:54:04,243 - DEBUG - Pod ctest-pod-82808904 not in running state.Currently in Pending 2025-07-14 01:54:09,255 - DEBUG - Pod ctest-pod-82808904 not in running state.Currently in Pending 2025-07-14 01:54:14,269 - INFO - Pod ctest-pod-82808904 is in running state.Got IP 10.47.255.251 2025-07-14 01:54:14,283 - DEBUG - Pod ctest-pod-82808904 has vmi 6c2749a8-6055-11f0-b303-fa163e4f1b46 2025-07-14 01:54:14,283 - INFO - Verified pod ctest-pod-82808904 in contrail-api 2025-07-14 01:54:14,295 - DEBUG - VMI 6c2749a8-6055-11f0-b303-fa163e4f1b46 is active in agent 10.0.0.19 2025-07-14 01:54:14,295 - INFO - Verified Pod ctest-pod-82808904 in agent 10.0.0.19 2025-07-14 01:54:14,296 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=5df62a48-2640-4a9c-be8e-0602f28c83a1 2025-07-14 01:54:14,300 - INFO - Pod ctest-pod-82808904 with uuid 5df62a48-2640-4a9c-be8e-0602f28c83a1 found in kube manager 2025-07-14 01:54:14,300 - INFO - Pod ctest-pod-82808904 verification passed 2025-07-14 01:54:14,305 - INFO - Pod ctest-pod-21346518 is in running state.Got IP 10.47.255.250 2025-07-14 01:54:14,318 - DEBUG - Pod ctest-pod-21346518 has vmi 6ccb2668-6055-11f0-b303-fa163e4f1b46 2025-07-14 01:54:14,318 - INFO - Verified pod ctest-pod-21346518 in contrail-api 2025-07-14 01:54:14,330 - DEBUG - VMI 6ccb2668-6055-11f0-b303-fa163e4f1b46 is active in agent 10.0.0.19 2025-07-14 01:54:14,330 - INFO - Verified Pod ctest-pod-21346518 in agent 10.0.0.19 2025-07-14 01:54:14,330 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=132673de-0954-44b0-a7e5-b88c7d43f481 2025-07-14 01:54:14,334 - INFO - Pod ctest-pod-21346518 with uuid 132673de-0954-44b0-a7e5-b88c7d43f481 found in kube manager 2025-07-14 01:54:14,334 - INFO - Pod ctest-pod-21346518 verification passed 2025-07-14 01:54:14,339 - INFO - Pod ctest-pod-82158189 is in running state.Got IP 10.47.255.249 2025-07-14 01:54:14,395 - DEBUG - Pod ctest-pod-82158189 has vmi 6d66585e-6055-11f0-b303-fa163e4f1b46 2025-07-14 01:54:14,395 - INFO - Verified pod ctest-pod-82158189 in contrail-api 2025-07-14 01:54:14,407 - DEBUG - VMI 6d66585e-6055-11f0-b303-fa163e4f1b46 is active in agent 10.0.0.19 2025-07-14 01:54:14,407 - INFO - Verified Pod ctest-pod-82158189 in agent 10.0.0.19 2025-07-14 01:54:14,407 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=83e264ab-031a-42c8-938a-bbc1160193b3 2025-07-14 01:54:14,411 - INFO - Pod ctest-pod-82158189 with uuid 83e264ab-031a-42c8-938a-bbc1160193b3 found in kube manager 2025-07-14 01:54:14,412 - INFO - Pod ctest-pod-82158189 verification passed 2025-07-14 01:54:14,418 - INFO - Pod ctest-pod-79436160 is in running state.Got IP 10.47.255.248 2025-07-14 01:54:14,431 - DEBUG - Pod ctest-pod-79436160 has vmi 6de6a1a8-6055-11f0-b303-fa163e4f1b46 2025-07-14 01:54:14,431 - INFO - Verified pod ctest-pod-79436160 in contrail-api 2025-07-14 01:54:14,444 - DEBUG - VMI 6de6a1a8-6055-11f0-b303-fa163e4f1b46 is active in agent 10.0.0.19 2025-07-14 01:54:14,444 - INFO - Verified Pod ctest-pod-79436160 in agent 10.0.0.19 2025-07-14 01:54:14,444 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=494f5784-7842-45f6-9461-f60a860db7be 2025-07-14 01:54:14,449 - INFO - Pod ctest-pod-79436160 with uuid 494f5784-7842-45f6-9461-f60a860db7be found in kube manager 2025-07-14 01:54:14,449 - INFO - Pod ctest-pod-79436160 verification passed 2025-07-14 01:54:14,454 - DEBUG - Pod ctest-pod-20245916 not in running state.Currently in Pending 2025-07-14 01:54:19,460 - DEBUG - Pod ctest-pod-20245916 not in running state.Currently in Pending 2025-07-14 01:54:24,467 - INFO - Pod ctest-pod-20245916 is in running state.Got IP 10.47.255.247 2025-07-14 01:54:24,523 - DEBUG - Pod ctest-pod-20245916 has vmi 6e7b2814-6055-11f0-b303-fa163e4f1b46 2025-07-14 01:54:24,524 - INFO - Verified pod ctest-pod-20245916 in contrail-api 2025-07-14 01:54:24,537 - DEBUG - VMI 6e7b2814-6055-11f0-b303-fa163e4f1b46 is active in agent 10.0.0.19 2025-07-14 01:54:24,537 - INFO - Verified Pod ctest-pod-20245916 in agent 10.0.0.19 2025-07-14 01:54:24,537 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=d29aa64b-285e-4a47-8381-00aac9c99ff9 2025-07-14 01:54:24,542 - INFO - Pod ctest-pod-20245916 with uuid d29aa64b-285e-4a47-8381-00aac9c99ff9 found in kube manager 2025-07-14 01:54:24,542 - INFO - Pod ctest-pod-20245916 verification passed 2025-07-14 01:54:24,548 - INFO - Pod ctest-pod-36010672 is in running state.Got IP 10.47.255.245 2025-07-14 01:54:24,564 - DEBUG - Pod ctest-pod-36010672 has vmi 6f7b61de-6055-11f0-b303-fa163e4f1b46 2025-07-14 01:54:24,564 - INFO - Verified pod ctest-pod-36010672 in contrail-api 2025-07-14 01:54:24,578 - DEBUG - VMI 6f7b61de-6055-11f0-b303-fa163e4f1b46 is active in agent 10.0.0.19 2025-07-14 01:54:24,578 - INFO - Verified Pod ctest-pod-36010672 in agent 10.0.0.19 2025-07-14 01:54:24,579 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=c927c416-2501-4680-9282-e9fd38c8e7fe 2025-07-14 01:54:24,584 - INFO - Pod ctest-pod-36010672 with uuid c927c416-2501-4680-9282-e9fd38c8e7fe found in kube manager 2025-07-14 01:54:24,584 - INFO - Pod ctest-pod-36010672 verification passed 2025-07-14 01:54:24,667 - INFO - Pod ctest-pod-48828767 is in running state.Got IP 10.47.255.246 2025-07-14 01:54:24,723 - DEBUG - Pod ctest-pod-48828767 has vmi 6efbce38-6055-11f0-b303-fa163e4f1b46 2025-07-14 01:54:24,723 - INFO - Verified pod ctest-pod-48828767 in contrail-api 2025-07-14 01:54:24,741 - DEBUG - VMI 6efbce38-6055-11f0-b303-fa163e4f1b46 is active in agent 10.0.0.19 2025-07-14 01:54:24,741 - INFO - Verified Pod ctest-pod-48828767 in agent 10.0.0.19 2025-07-14 01:54:24,742 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=51082ca3-bdd0-47de-b3f4-e6aec548e753 2025-07-14 01:54:24,746 - INFO - Pod ctest-pod-48828767 with uuid 51082ca3-bdd0-47de-b3f4-e6aec548e753 found in kube manager 2025-07-14 01:54:24,746 - INFO - Pod ctest-pod-48828767 verification passed 2025-07-14 01:54:24,753 - INFO - Pod ctest-pod-74764227 is in running state.Got IP 10.47.255.244 2025-07-14 01:54:24,769 - DEBUG - Pod ctest-pod-74764227 has vmi 6ff37322-6055-11f0-b303-fa163e4f1b46 2025-07-14 01:54:24,770 - INFO - Verified pod ctest-pod-74764227 in contrail-api 2025-07-14 01:54:24,787 - DEBUG - VMI 6ff37322-6055-11f0-b303-fa163e4f1b46 is active in agent 10.0.0.19 2025-07-14 01:54:24,787 - INFO - Verified Pod ctest-pod-74764227 in agent 10.0.0.19 2025-07-14 01:54:24,787 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=0f294486-9c7b-4e22-ad97-bc345c279918 2025-07-14 01:54:24,793 - INFO - Pod ctest-pod-74764227 with uuid 0f294486-9c7b-4e22-ad97-bc345c279918 found in kube manager 2025-07-14 01:54:24,793 - INFO - Pod ctest-pod-74764227 verification passed 2025-07-14 01:54:24,793 - INFO - ================================================================================ 2025-07-14 01:54:24,793 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-07-14 01:54:24,794 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-07-14 01:54:25,029 - DEBUG - Nothing to compare xmpp stats {'10.0.0.19': {'10.0.0.33': '0'}} with 2025-07-14 01:54:25,029 - INFO - Initial checks done. Running the testcase now 2025-07-14 01:54:25,029 - INFO - 2025-07-14 01:54:25,088 - DEBUG - [Pod ctest-pod-82808904] Cmd: echo ctest-pod-82808904 > /usr/share/nginx/html/index.html, Output: 2025-07-14 01:54:25,158 - DEBUG - [Pod ctest-pod-21346518] Cmd: echo ctest-pod-21346518 > /usr/share/nginx/html/index.html, Output: 2025-07-14 01:54:25,224 - DEBUG - [Pod ctest-pod-82158189] Cmd: echo ctest-pod-82158189 > /usr/share/nginx/html/index.html, Output: 2025-07-14 01:54:25,289 - DEBUG - [Pod ctest-pod-79436160] Cmd: echo ctest-pod-79436160 > /usr/share/nginx/html/index.html, Output: 2025-07-14 01:54:25,291 - DEBUG - Service ctest-nginx-svc-03397921 not present 2025-07-14 01:54:25,292 - INFO - Creating service ctest-nginx-svc-03397921 2025-07-14 01:54:25,303 - INFO - Created Service ctest-nginx-svc-03397921 2025-07-14 01:54:25,323 - WARNING - Service UUID c7ae783c-996e-4533-96ac-88dcc3fe1d19 not yet found in contrail-api 2025-07-14 01:54:26,335 - INFO - Validated that Service ctest-nginx-svc-03397921 is seen in contrail-api 2025-07-14 01:54:26,335 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_LoadbalancerDatabaseList?x=c7ae783c-996e-4533-96ac-88dcc3fe1d19 2025-07-14 01:54:26,348 - INFO - Service ctest-nginx-svc-03397921 with uuid c7ae783c-996e-4533-96ac-88dcc3fe1d19 found in kube manager 2025-07-14 01:54:26,348 - INFO - Service ctest-nginx-svc-03397921 verification passed 2025-07-14 01:54:27,426 - DEBUG - [Pod ctest-pod-20245916] Cmd: wget http://10.99.118.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.118.9:80 (10.99.118.9:80) ctest-pod-21346518 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-14 01:54:27,426 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd wget http://10.99.118.9:80/ -O - -T 5 -t 1 passed 2025-07-14 01:54:27,426 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd output: Connecting to 10.99.118.9:80 (10.99.118.9:80) ctest-pod-21346518 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-14 01:54:27,479 - DEBUG - [Pod ctest-pod-20245916] Cmd: wget http://10.99.118.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.118.9:80 (10.99.118.9:80) ctest-pod-82808904 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-14 01:54:27,479 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd wget http://10.99.118.9:80/ -O - -T 5 -t 1 passed 2025-07-14 01:54:27,479 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd output: Connecting to 10.99.118.9:80 (10.99.118.9:80) ctest-pod-82808904 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-14 01:54:27,479 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-82808904': 1, 'ctest-pod-21346518': 1} 2025-07-14 01:54:27,536 - DEBUG - [Pod ctest-pod-36010672] Cmd: wget http://10.99.118.9:80/ -O - -T 5 -t 1 , Output: ctest-pod-21346518 Connecting to 10.99.118.9:80 (10.99.118.9:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-14 01:54:27,536 - DEBUG - [Pod Pod ctest-pod-36010672] Cmd wget http://10.99.118.9:80/ -O - -T 5 -t 1 passed 2025-07-14 01:54:27,536 - DEBUG - [Pod Pod ctest-pod-36010672] Cmd output: ctest-pod-21346518 Connecting to 10.99.118.9:80 (10.99.118.9:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-14 01:54:27,589 - DEBUG - [Pod ctest-pod-36010672] Cmd: wget http://10.99.118.9:80/ -O - -T 5 -t 1 , Output: ctest-pod-21346518 Connecting to 10.99.118.9:80 (10.99.118.9:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-14 01:54:27,589 - DEBUG - [Pod Pod ctest-pod-36010672] Cmd wget http://10.99.118.9:80/ -O - -T 5 -t 1 passed 2025-07-14 01:54:27,589 - DEBUG - [Pod Pod ctest-pod-36010672] Cmd output: ctest-pod-21346518 Connecting to 10.99.118.9:80 (10.99.118.9:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-14 01:54:27,642 - DEBUG - [Pod ctest-pod-36010672] Cmd: wget http://10.99.118.9:80/ -O - -T 5 -t 1 , Output: ctest-pod-82808904 Connecting to 10.99.118.9:80 (10.99.118.9:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-14 01:54:27,642 - DEBUG - [Pod Pod ctest-pod-36010672] Cmd wget http://10.99.118.9:80/ -O - -T 5 -t 1 passed 2025-07-14 01:54:27,642 - DEBUG - [Pod Pod ctest-pod-36010672] Cmd output: ctest-pod-82808904 Connecting to 10.99.118.9:80 (10.99.118.9:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-14 01:54:27,642 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-82808904': 1, 'ctest-pod-21346518': 2} 2025-07-14 01:54:27,646 - DEBUG - Network policy ingress-on-service not present 2025-07-14 01:54:27,646 - INFO - Creating Network Policy ingress-on-service 2025-07-14 01:54:27,660 - INFO - Network policy found in k8s 2025-07-14 01:54:27,660 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=56eb4d7d-0149-4afb-9868-d652d42080a3 2025-07-14 01:54:27,666 - INFO - Network Policy ingress-on-service with uuid 56eb4d7d-0149-4afb-9868-d652d42080a3 found in kube manager 2025-07-14 01:54:27,720 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-07-14 01:54:27,721 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-07-14 01:54:27,721 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=56eb4d7d-0149-4afb-9868-d652d42080a3 2025-07-14 01:54:27,768 - WARNING - Network policy with name ingress-on-service not found in agent 2025-07-14 01:54:29,769 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=56eb4d7d-0149-4afb-9868-d652d42080a3 2025-07-14 01:54:29,812 - INFO - Network policy with name ingress-on-service found in agent 2025-07-14 01:54:29,812 - INFO - Network Policy ingress-on-service verification passed 2025-07-14 01:54:34,865 - DEBUG - [Pod ctest-pod-20245916] Cmd: wget http://10.99.118.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:54:34,865 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd wget http://10.99.118.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:54:34,865 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:54:39,924 - DEBUG - [Pod ctest-pod-20245916] Cmd: wget http://10.99.118.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:54:39,924 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd wget http://10.99.118.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:54:39,924 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:54:44,981 - DEBUG - [Pod ctest-pod-20245916] Cmd: wget http://10.99.118.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:54:44,981 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd wget http://10.99.118.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:54:44,981 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:54:50,033 - DEBUG - [Pod ctest-pod-20245916] Cmd: wget http://10.99.118.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:54:50,033 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd wget http://10.99.118.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:54:50,033 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:54:55,090 - DEBUG - [Pod ctest-pod-20245916] Cmd: wget http://10.99.118.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:54:55,090 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd wget http://10.99.118.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:54:55,090 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:55:00,142 - DEBUG - [Pod ctest-pod-20245916] Cmd: wget http://10.99.118.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:55:00,142 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd wget http://10.99.118.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:55:00,142 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:55:05,194 - DEBUG - [Pod ctest-pod-20245916] Cmd: wget http://10.99.118.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:55:05,194 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd wget http://10.99.118.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:55:05,194 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:55:10,250 - DEBUG - [Pod ctest-pod-20245916] Cmd: wget http://10.99.118.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:55:10,250 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd wget http://10.99.118.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:55:10,250 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:55:15,310 - DEBUG - [Pod ctest-pod-20245916] Cmd: wget http://10.99.118.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:55:15,310 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd wget http://10.99.118.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:55:15,310 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:55:20,361 - DEBUG - [Pod ctest-pod-20245916] Cmd: wget http://10.99.118.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:55:20,361 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd wget http://10.99.118.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:55:20,361 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:55:20,361 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-82808904': 0, 'ctest-pod-21346518': 0} 2025-07-14 01:55:20,419 - DEBUG - [Pod ctest-pod-48828767] Cmd: wget http://10.99.118.9:80/ -O - -T 5 -t 1 , Output: ctest-pod-21346518 Connecting to 10.99.118.9:80 (10.99.118.9:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-14 01:55:20,419 - DEBUG - [Pod Pod ctest-pod-48828767] Cmd wget http://10.99.118.9:80/ -O - -T 5 -t 1 passed 2025-07-14 01:55:20,419 - DEBUG - [Pod Pod ctest-pod-48828767] Cmd output: ctest-pod-21346518 Connecting to 10.99.118.9:80 (10.99.118.9:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-14 01:55:20,470 - DEBUG - [Pod ctest-pod-48828767] Cmd: wget http://10.99.118.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.118.9:80 (10.99.118.9:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-82808904 2025-07-14 01:55:20,470 - DEBUG - [Pod Pod ctest-pod-48828767] Cmd wget http://10.99.118.9:80/ -O - -T 5 -t 1 passed 2025-07-14 01:55:20,470 - DEBUG - [Pod Pod ctest-pod-48828767] Cmd output: Connecting to 10.99.118.9:80 (10.99.118.9:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-82808904 2025-07-14 01:55:20,471 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-82808904': 1, 'ctest-pod-21346518': 1} 2025-07-14 01:55:25,522 - DEBUG - [Pod ctest-pod-36010672] Cmd: wget http://10.99.118.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:55:25,522 - DEBUG - [Pod Pod ctest-pod-36010672] Cmd wget http://10.99.118.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:55:25,522 - DEBUG - [Pod Pod ctest-pod-36010672] Cmd output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:55:30,586 - DEBUG - [Pod ctest-pod-36010672] Cmd: wget http://10.99.118.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:55:30,586 - DEBUG - [Pod Pod ctest-pod-36010672] Cmd wget http://10.99.118.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:55:30,587 - DEBUG - [Pod Pod ctest-pod-36010672] Cmd output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:55:35,654 - DEBUG - [Pod ctest-pod-36010672] Cmd: wget http://10.99.118.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:55:35,654 - DEBUG - [Pod Pod ctest-pod-36010672] Cmd wget http://10.99.118.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:55:35,654 - DEBUG - [Pod Pod ctest-pod-36010672] Cmd output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:55:37,244 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2025-07-14 01:55:47,332 - DEBUG - [Pod ctest-pod-36010672] Cmd: wget http://10.99.118.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:55:47,332 - DEBUG - [Pod Pod ctest-pod-36010672] Cmd wget http://10.99.118.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:55:47,332 - DEBUG - [Pod Pod ctest-pod-36010672] Cmd output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:55:52,394 - DEBUG - [Pod ctest-pod-36010672] Cmd: wget http://10.99.118.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:55:52,394 - DEBUG - [Pod Pod ctest-pod-36010672] Cmd wget http://10.99.118.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:55:52,394 - DEBUG - [Pod Pod ctest-pod-36010672] Cmd output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:55:57,458 - DEBUG - [Pod ctest-pod-36010672] Cmd: wget http://10.99.118.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:55:57,459 - DEBUG - [Pod Pod ctest-pod-36010672] Cmd wget http://10.99.118.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:55:57,459 - DEBUG - [Pod Pod ctest-pod-36010672] Cmd output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:56:02,509 - DEBUG - [Pod ctest-pod-36010672] Cmd: wget http://10.99.118.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:56:02,509 - DEBUG - [Pod Pod ctest-pod-36010672] Cmd wget http://10.99.118.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:56:02,509 - DEBUG - [Pod Pod ctest-pod-36010672] Cmd output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:56:07,564 - DEBUG - [Pod ctest-pod-36010672] Cmd: wget http://10.99.118.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:56:07,564 - DEBUG - [Pod Pod ctest-pod-36010672] Cmd wget http://10.99.118.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:56:07,565 - DEBUG - [Pod Pod ctest-pod-36010672] Cmd output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:56:12,624 - DEBUG - [Pod ctest-pod-36010672] Cmd: wget http://10.99.118.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:56:12,624 - DEBUG - [Pod Pod ctest-pod-36010672] Cmd wget http://10.99.118.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:56:12,624 - DEBUG - [Pod Pod ctest-pod-36010672] Cmd output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:56:17,678 - DEBUG - [Pod ctest-pod-36010672] Cmd: wget http://10.99.118.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:56:17,678 - DEBUG - [Pod Pod ctest-pod-36010672] Cmd wget http://10.99.118.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:56:17,678 - DEBUG - [Pod Pod ctest-pod-36010672] Cmd output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:56:17,678 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-82808904': 0, 'ctest-pod-21346518': 0} 2025-07-14 01:56:19,743 - DEBUG - [Pod ctest-pod-48828767] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.761 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.099 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.105 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.099/0.321/0.761 ms 2025-07-14 01:56:19,743 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-48828767 with expectation True passed 2025-07-14 01:56:21,802 - DEBUG - [Pod ctest-pod-20245916] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.589 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.087 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.104 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.087/0.593/1.589 ms 2025-07-14 01:56:21,802 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-20245916 with expectation True passed 2025-07-14 01:56:23,862 - DEBUG - [Pod ctest-pod-36010672] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.494 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.097 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.093 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.093/0.228/0.494 ms 2025-07-14 01:56:23,862 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-36010672 with expectation True passed 2025-07-14 01:56:23,925 - DEBUG - [Pod ctest-pod-48828767] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-14 01:56:23,925 - DEBUG - [Pod Pod ctest-pod-48828767] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-07-14 01:56:23,925 - DEBUG - [Pod Pod ctest-pod-48828767] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-14 01:56:23,925 - INFO - wget check of of http://10.47.255.251 from ctest-pod-48828767 passed 2025-07-14 01:56:23,980 - DEBUG - [Pod ctest-pod-48828767] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-14 01:56:23,980 - DEBUG - [Pod Pod ctest-pod-48828767] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-07-14 01:56:23,980 - DEBUG - [Pod Pod ctest-pod-48828767] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-14 01:56:23,981 - INFO - wget check of of http://10.47.255.250 from ctest-pod-48828767 passed 2025-07-14 01:56:29,033 - DEBUG - [Pod ctest-pod-20245916] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-07-14 01:56:29,034 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-07-14 01:56:29,034 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-07-14 01:56:29,034 - INFO - wget check of of http://10.47.255.250 from ctest-pod-20245916 passed 2025-07-14 01:56:34,095 - DEBUG - [Pod ctest-pod-74764227] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-07-14 01:56:34,095 - DEBUG - [Pod Pod ctest-pod-74764227] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-07-14 01:56:34,095 - DEBUG - [Pod Pod ctest-pod-74764227] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-07-14 01:56:34,095 - INFO - wget check of of http://10.47.255.251 from ctest-pod-74764227 passed 2025-07-14 01:56:34,110 - INFO - Updating Network Policy ingress-on-service 2025-07-14 01:56:39,190 - DEBUG - [Pod ctest-pod-20245916] Cmd: wget http://10.99.118.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:56:39,190 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd wget http://10.99.118.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:56:39,190 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:56:44,245 - DEBUG - [Pod ctest-pod-20245916] Cmd: wget http://10.99.118.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:56:44,245 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd wget http://10.99.118.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:56:44,245 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:56:49,309 - DEBUG - [Pod ctest-pod-20245916] Cmd: wget http://10.99.118.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:56:49,309 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd wget http://10.99.118.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:56:49,310 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:56:54,365 - DEBUG - [Pod ctest-pod-20245916] Cmd: wget http://10.99.118.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:56:54,366 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd wget http://10.99.118.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:56:54,366 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:56:59,413 - DEBUG - [Pod ctest-pod-20245916] Cmd: wget http://10.99.118.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:56:59,413 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd wget http://10.99.118.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:56:59,413 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:57:04,461 - DEBUG - [Pod ctest-pod-20245916] Cmd: wget http://10.99.118.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:57:04,461 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd wget http://10.99.118.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:57:04,461 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:57:09,517 - DEBUG - [Pod ctest-pod-20245916] Cmd: wget http://10.99.118.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:57:09,517 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd wget http://10.99.118.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:57:09,517 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:57:14,569 - DEBUG - [Pod ctest-pod-20245916] Cmd: wget http://10.99.118.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:57:14,569 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd wget http://10.99.118.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:57:14,569 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:57:19,624 - DEBUG - [Pod ctest-pod-20245916] Cmd: wget http://10.99.118.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:57:19,624 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd wget http://10.99.118.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:57:19,624 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:57:24,678 - DEBUG - [Pod ctest-pod-20245916] Cmd: wget http://10.99.118.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:57:24,678 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd wget http://10.99.118.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:57:24,678 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd output: Connecting to 10.99.118.9:80 (10.99.118.9:80) wget: download timed out 2025-07-14 01:57:24,678 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-82808904': 0, 'ctest-pod-21346518': 0} 2025-07-14 01:57:24,735 - DEBUG - [Pod ctest-pod-48828767] Cmd: wget http://10.99.118.9:80/ -O - -T 5 -t 1 , Output: ctest-pod-21346518 Connecting to 10.99.118.9:80 (10.99.118.9:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-14 01:57:24,735 - DEBUG - [Pod Pod ctest-pod-48828767] Cmd wget http://10.99.118.9:80/ -O - -T 5 -t 1 passed 2025-07-14 01:57:24,735 - DEBUG - [Pod Pod ctest-pod-48828767] Cmd output: ctest-pod-21346518 Connecting to 10.99.118.9:80 (10.99.118.9:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-14 01:57:24,787 - DEBUG - [Pod ctest-pod-48828767] Cmd: wget http://10.99.118.9:80/ -O - -T 5 -t 1 , Output: ctest-pod-82808904 Connecting to 10.99.118.9:80 (10.99.118.9:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-14 01:57:24,787 - DEBUG - [Pod Pod ctest-pod-48828767] Cmd wget http://10.99.118.9:80/ -O - -T 5 -t 1 passed 2025-07-14 01:57:24,787 - DEBUG - [Pod Pod ctest-pod-48828767] Cmd output: ctest-pod-82808904 Connecting to 10.99.118.9:80 (10.99.118.9:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-14 01:57:24,787 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-82808904': 1, 'ctest-pod-21346518': 1} 2025-07-14 01:57:24,839 - DEBUG - [Pod ctest-pod-36010672] Cmd: wget http://10.99.118.9:80/ -O - -T 5 -t 1 , Output: ctest-pod-21346518 Connecting to 10.99.118.9:80 (10.99.118.9:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-14 01:57:24,839 - DEBUG - [Pod Pod ctest-pod-36010672] Cmd wget http://10.99.118.9:80/ -O - -T 5 -t 1 passed 2025-07-14 01:57:24,839 - DEBUG - [Pod Pod ctest-pod-36010672] Cmd output: ctest-pod-21346518 Connecting to 10.99.118.9:80 (10.99.118.9:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-14 01:57:24,899 - DEBUG - [Pod ctest-pod-36010672] Cmd: wget http://10.99.118.9:80/ -O - -T 5 -t 1 , Output: ctest-pod-21346518 Connecting to 10.99.118.9:80 (10.99.118.9:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-14 01:57:24,899 - DEBUG - [Pod Pod ctest-pod-36010672] Cmd wget http://10.99.118.9:80/ -O - -T 5 -t 1 passed 2025-07-14 01:57:24,899 - DEBUG - [Pod Pod ctest-pod-36010672] Cmd output: ctest-pod-21346518 Connecting to 10.99.118.9:80 (10.99.118.9:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-14 01:57:24,960 - DEBUG - [Pod ctest-pod-36010672] Cmd: wget http://10.99.118.9:80/ -O - -T 5 -t 1 , Output: ctest-pod-82808904 Connecting to 10.99.118.9:80 (10.99.118.9:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-14 01:57:24,960 - DEBUG - [Pod Pod ctest-pod-36010672] Cmd wget http://10.99.118.9:80/ -O - -T 5 -t 1 passed 2025-07-14 01:57:24,961 - DEBUG - [Pod Pod ctest-pod-36010672] Cmd output: ctest-pod-82808904 Connecting to 10.99.118.9:80 (10.99.118.9:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-14 01:57:24,961 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-82808904': 1, 'ctest-pod-21346518': 2} 2025-07-14 01:57:27,017 - DEBUG - [Pod ctest-pod-48828767] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.124 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.081 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.099 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.081/0.434/1.124 ms 2025-07-14 01:57:27,018 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-48828767 with expectation True passed 2025-07-14 01:57:29,079 - DEBUG - [Pod ctest-pod-20245916] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.140 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.177 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.092 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.092/0.469/1.140 ms 2025-07-14 01:57:29,079 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-20245916 with expectation True passed 2025-07-14 01:57:31,130 - DEBUG - [Pod ctest-pod-36010672] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.803 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.102 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.125 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.102/0.343/0.803 ms 2025-07-14 01:57:31,130 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-36010672 with expectation True passed 2025-07-14 01:57:31,185 - DEBUG - [Pod ctest-pod-48828767] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-14 01:57:31,185 - DEBUG - [Pod Pod ctest-pod-48828767] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-07-14 01:57:31,185 - DEBUG - [Pod Pod ctest-pod-48828767] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-14 01:57:31,185 - INFO - wget check of of http://10.47.255.251 from ctest-pod-48828767 passed 2025-07-14 01:57:31,253 - DEBUG - [Pod ctest-pod-48828767] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-14 01:57:31,253 - DEBUG - [Pod Pod ctest-pod-48828767] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-07-14 01:57:31,253 - DEBUG - [Pod Pod ctest-pod-48828767] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-14 01:57:31,253 - INFO - wget check of of http://10.47.255.250 from ctest-pod-48828767 passed 2025-07-14 01:57:36,308 - DEBUG - [Pod ctest-pod-20245916] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-07-14 01:57:36,308 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-07-14 01:57:36,308 - DEBUG - [Pod Pod ctest-pod-20245916] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-07-14 01:57:36,308 - INFO - wget check of of http://10.47.255.250 from ctest-pod-20245916 passed 2025-07-14 01:57:36,362 - DEBUG - [Pod ctest-pod-74764227] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-14 01:57:36,362 - DEBUG - [Pod Pod ctest-pod-74764227] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-07-14 01:57:36,362 - DEBUG - [Pod Pod ctest-pod-74764227] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-14 01:57:36,362 - INFO - wget check of of http://10.47.255.251 from ctest-pod-74764227 passed 2025-07-14 01:57:36,362 - INFO - Deleting Network Policy : ingress-on-service 2025-07-14 01:57:36,363 - INFO - Deleting service : ctest-nginx-svc-03397921 2025-07-14 01:57:36,594 - DEBUG - No XMPP flaps were noticed during the test 2025-07-14 01:57:36,594 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:12] 2025-07-14 01:57:36,594 - INFO - -------------------------------------------------------------------------------- 2025-07-14 01:57:36,600 - INFO - Deleting pod ctest-new-default-82558740:ctest-pod-82808904 2025-07-14 01:57:36,600 - INFO - Deleting pod ctest-new-default-82558740:ctest-pod-21346518 2025-07-14 01:57:36,601 - INFO - Deleting pod ctest-non-default-39243909:ctest-pod-82158189 2025-07-14 01:57:36,601 - INFO - Deleting pod ctest-non-default-39243909:ctest-pod-79436160 2025-07-14 01:57:36,601 - INFO - Deleting pod ctest-new-default-82558740:ctest-pod-20245916 2025-07-14 01:57:36,602 - INFO - Deleting pod ctest-new-default-82558740:ctest-pod-48828767 2025-07-14 01:57:36,602 - INFO - Deleting pod ctest-non-default-39243909:ctest-pod-36010672 2025-07-14 01:57:36,602 - INFO - Deleting pod ctest-non-default-39243909:ctest-pod-74764227 2025-07-14 01:57:36,675 - WARNING - Pod uuid 5df62a48-2640-4a9c-be8e-0602f28c83a1 is still seen in agent 10.0.0.19 VM list 2025-07-14 01:57:36,680 - WARNING - Pod uuid 132673de-0954-44b0-a7e5-b88c7d43f481 is still seen in agent 10.0.0.19 VM list 2025-07-14 01:57:36,707 - WARNING - Pod uuid 83e264ab-031a-42c8-938a-bbc1160193b3 is still seen in agent 10.0.0.19 VM list 2025-07-14 01:57:36,707 - WARNING - Pod uuid 494f5784-7842-45f6-9461-f60a860db7be is still seen in agent 10.0.0.19 VM list 2025-07-14 01:57:36,710 - WARNING - Pod uuid 0f294486-9c7b-4e22-ad97-bc345c279918 is still seen in agent 10.0.0.19 VM list 2025-07-14 01:57:36,710 - WARNING - Pod uuid 51082ca3-bdd0-47de-b3f4-e6aec548e753 is still seen in agent 10.0.0.19 VM list 2025-07-14 01:57:36,710 - WARNING - Pod uuid d29aa64b-285e-4a47-8381-00aac9c99ff9 is still seen in agent 10.0.0.19 VM list 2025-07-14 01:57:36,712 - WARNING - Pod uuid c927c416-2501-4680-9282-e9fd38c8e7fe is still seen in agent 10.0.0.19 VM list 2025-07-14 01:57:41,687 - DEBUG - Pod 5df62a48-2640-4a9c-be8e-0602f28c83a1 is not in agent 10.0.0.19 VM list 2025-07-14 01:57:41,690 - DEBUG - Pod 132673de-0954-44b0-a7e5-b88c7d43f481 is not in agent 10.0.0.19 VM list 2025-07-14 01:57:41,699 - DEBUG - VMI 6ccb2668-6055-11f0-b303-fa163e4f1b46 is removed from agent 10.0.0.19 2025-07-14 01:57:41,699 - INFO - Verified that pod ctest-pod-21346518 is removed in agent 2025-07-14 01:57:41,701 - DEBUG - VMI 6c2749a8-6055-11f0-b303-fa163e4f1b46 is removed from agent 10.0.0.19 2025-07-14 01:57:41,701 - INFO - Verified that pod ctest-pod-82808904 is removed in agent 2025-07-14 01:57:41,744 - WARNING - Pod uuid d29aa64b-285e-4a47-8381-00aac9c99ff9 is still seen in agent 10.0.0.19 VM list 2025-07-14 01:57:41,745 - WARNING - Pod uuid c927c416-2501-4680-9282-e9fd38c8e7fe is still seen in agent 10.0.0.19 VM list 2025-07-14 01:57:41,745 - DEBUG - Pod 494f5784-7842-45f6-9461-f60a860db7be is not in agent 10.0.0.19 VM list 2025-07-14 01:57:41,748 - DEBUG - Pod 83e264ab-031a-42c8-938a-bbc1160193b3 is not in agent 10.0.0.19 VM list 2025-07-14 01:57:41,753 - WARNING - Pod uuid 51082ca3-bdd0-47de-b3f4-e6aec548e753 is still seen in agent 10.0.0.19 VM list 2025-07-14 01:57:41,754 - WARNING - Pod uuid 0f294486-9c7b-4e22-ad97-bc345c279918 is still seen in agent 10.0.0.19 VM list 2025-07-14 01:57:41,763 - DEBUG - VMI 6de6a1a8-6055-11f0-b303-fa163e4f1b46 is removed from agent 10.0.0.19 2025-07-14 01:57:41,763 - INFO - Verified that pod ctest-pod-79436160 is removed in agent 2025-07-14 01:57:41,764 - DEBUG - VMI 6d66585e-6055-11f0-b303-fa163e4f1b46 is removed from agent 10.0.0.19 2025-07-14 01:57:41,764 - INFO - Verified that pod ctest-pod-82158189 is removed in agent 2025-07-14 01:57:46,779 - WARNING - Pod uuid 0f294486-9c7b-4e22-ad97-bc345c279918 is still seen in agent 10.0.0.19 VM list 2025-07-14 01:57:46,780 - WARNING - Pod uuid 51082ca3-bdd0-47de-b3f4-e6aec548e753 is still seen in agent 10.0.0.19 VM list 2025-07-14 01:57:46,781 - WARNING - Pod uuid c927c416-2501-4680-9282-e9fd38c8e7fe is still seen in agent 10.0.0.19 VM list 2025-07-14 01:57:46,782 - WARNING - Pod uuid d29aa64b-285e-4a47-8381-00aac9c99ff9 is still seen in agent 10.0.0.19 VM list 2025-07-14 01:57:51,800 - WARNING - Pod uuid 0f294486-9c7b-4e22-ad97-bc345c279918 is still seen in agent 10.0.0.19 VM list 2025-07-14 01:57:51,803 - WARNING - Pod uuid c927c416-2501-4680-9282-e9fd38c8e7fe is still seen in agent 10.0.0.19 VM list 2025-07-14 01:57:51,803 - WARNING - Pod uuid 51082ca3-bdd0-47de-b3f4-e6aec548e753 is still seen in agent 10.0.0.19 VM list 2025-07-14 01:57:51,803 - WARNING - Pod uuid d29aa64b-285e-4a47-8381-00aac9c99ff9 is still seen in agent 10.0.0.19 VM list 2025-07-14 01:57:56,822 - WARNING - Pod uuid 0f294486-9c7b-4e22-ad97-bc345c279918 is still seen in agent 10.0.0.19 VM list 2025-07-14 01:57:56,822 - WARNING - Pod uuid c927c416-2501-4680-9282-e9fd38c8e7fe is still seen in agent 10.0.0.19 VM list 2025-07-14 01:57:56,823 - WARNING - Pod uuid 51082ca3-bdd0-47de-b3f4-e6aec548e753 is still seen in agent 10.0.0.19 VM list 2025-07-14 01:57:56,824 - WARNING - Pod uuid d29aa64b-285e-4a47-8381-00aac9c99ff9 is still seen in agent 10.0.0.19 VM list 2025-07-14 01:58:01,844 - WARNING - Pod uuid 0f294486-9c7b-4e22-ad97-bc345c279918 is still seen in agent 10.0.0.19 VM list 2025-07-14 01:58:01,846 - WARNING - Pod uuid 51082ca3-bdd0-47de-b3f4-e6aec548e753 is still seen in agent 10.0.0.19 VM list 2025-07-14 01:58:01,846 - WARNING - Pod uuid d29aa64b-285e-4a47-8381-00aac9c99ff9 is still seen in agent 10.0.0.19 VM list 2025-07-14 01:58:01,847 - WARNING - Pod uuid c927c416-2501-4680-9282-e9fd38c8e7fe is still seen in agent 10.0.0.19 VM list 2025-07-14 01:58:06,871 - WARNING - Pod uuid 51082ca3-bdd0-47de-b3f4-e6aec548e753 is still seen in agent 10.0.0.19 VM list 2025-07-14 01:58:06,873 - WARNING - Pod uuid c927c416-2501-4680-9282-e9fd38c8e7fe is still seen in agent 10.0.0.19 VM list 2025-07-14 01:58:06,873 - WARNING - Pod uuid d29aa64b-285e-4a47-8381-00aac9c99ff9 is still seen in agent 10.0.0.19 VM list 2025-07-14 01:58:06,874 - WARNING - Pod uuid 0f294486-9c7b-4e22-ad97-bc345c279918 is still seen in agent 10.0.0.19 VM list 2025-07-14 01:58:11,901 - DEBUG - Pod c927c416-2501-4680-9282-e9fd38c8e7fe is not in agent 10.0.0.19 VM list 2025-07-14 01:58:11,903 - DEBUG - Pod 0f294486-9c7b-4e22-ad97-bc345c279918 is not in agent 10.0.0.19 VM list 2025-07-14 01:58:11,905 - DEBUG - Pod d29aa64b-285e-4a47-8381-00aac9c99ff9 is not in agent 10.0.0.19 VM list 2025-07-14 01:58:11,906 - DEBUG - Pod 51082ca3-bdd0-47de-b3f4-e6aec548e753 is not in agent 10.0.0.19 VM list 2025-07-14 01:58:11,934 - DEBUG - VMI 6f7b61de-6055-11f0-b303-fa163e4f1b46 is removed from agent 10.0.0.19 2025-07-14 01:58:11,934 - INFO - Verified that pod ctest-pod-36010672 is removed in agent 2025-07-14 01:58:11,936 - DEBUG - VMI 6efbce38-6055-11f0-b303-fa163e4f1b46 is removed from agent 10.0.0.19 2025-07-14 01:58:11,936 - INFO - Verified that pod ctest-pod-48828767 is removed in agent 2025-07-14 01:58:11,936 - DEBUG - VMI 6e7b2814-6055-11f0-b303-fa163e4f1b46 is removed from agent 10.0.0.19 2025-07-14 01:58:11,936 - INFO - Verified that pod ctest-pod-20245916 is removed in agent 2025-07-14 01:58:11,937 - DEBUG - VMI 6ff37322-6055-11f0-b303-fa163e4f1b46 is removed from agent 10.0.0.19 2025-07-14 01:58:11,937 - INFO - Verified that pod ctest-pod-74764227 is removed in agent 2025-07-14 01:58:11,937 - INFO - Deleting namespace ctest-non-default-39243909 2025-07-14 01:58:11,956 - DEBUG - Namespace ctest-non-default-39243909 still in k8s 2025-07-14 01:58:13,961 - DEBUG - Namespace ctest-non-default-39243909 still in k8s 2025-07-14 01:58:15,966 - DEBUG - Namespace ctest-non-default-39243909 still in k8s 2025-07-14 01:58:17,971 - DEBUG - Namespace ctest-non-default-39243909 is not in k8s 2025-07-14 01:58:17,971 - DEBUG - No need to check project deletion in contrail-api 2025-07-14 01:58:17,971 - INFO - Deleting namespace ctest-new-default-82558740 2025-07-14 01:58:17,983 - DEBUG - Namespace ctest-new-default-82558740 still in k8s 2025-07-14 01:58:19,988 - DEBUG - Namespace ctest-new-default-82558740 still in k8s 2025-07-14 01:58:21,994 - DEBUG - Namespace ctest-new-default-82558740 still in k8s 2025-07-14 01:58:23,998 - DEBUG - Namespace ctest-new-default-82558740 is not in k8s 2025-07-14 01:58:23,998 - DEBUG - No need to check project deletion in contrail-api