2025-06-24 19:15:52,128 - INFO - Using existing project ['default-domain', 'k8s-default'](4ad3a231-820e-4de5-9c96-cb827a0b96a8) 2025-06-24 19:15:52,162 - DEBUG - Namespace ctest-new-default-21418177 not present 2025-06-24 19:15:52,178 - INFO - Created namespace ctest-new-default-21418177 2025-06-24 19:15:55,182 - DEBUG - Namespace ctest-non-default-68337761 not present 2025-06-24 19:15:55,203 - INFO - Created namespace ctest-non-default-68337761 2025-06-24 19:15:58,226 - DEBUG - Pod ctest-pod-34647509 not present 2025-06-24 19:15:58,227 - INFO - Creating Pod ctest-pod-34647509 2025-06-24 19:15:58,257 - DEBUG - Pod : ctest-pod-34647509 UUID is f4bb326e-bb09-4e60-940b-c86fc4c7f3f2 2025-06-24 19:15:58,273 - DEBUG - Pod ctest-pod-01041288 not present 2025-06-24 19:15:58,276 - INFO - Creating Pod ctest-pod-01041288 2025-06-24 19:15:58,304 - DEBUG - Pod : ctest-pod-01041288 UUID is f01068d4-ff31-4202-b11c-d2c4ced0af1c 2025-06-24 19:15:58,307 - DEBUG - Pod ctest-pod-33534904 not present 2025-06-24 19:15:58,307 - INFO - Creating Pod ctest-pod-33534904 2025-06-24 19:15:58,356 - DEBUG - Pod : ctest-pod-33534904 UUID is 53de7ca4-f964-4a9a-8f0e-ba69184a0e18 2025-06-24 19:15:58,359 - DEBUG - Pod ctest-pod-86318508 not present 2025-06-24 19:15:58,359 - INFO - Creating Pod ctest-pod-86318508 2025-06-24 19:15:58,388 - DEBUG - Pod : ctest-pod-86318508 UUID is 4a0f8c55-9610-4ce9-a4b0-72d99a6fd88d 2025-06-24 19:15:58,390 - DEBUG - Pod ctest-pod-29319241 not present 2025-06-24 19:15:58,391 - INFO - Creating Pod ctest-pod-29319241 2025-06-24 19:15:58,416 - DEBUG - Pod : ctest-pod-29319241 UUID is 069aec3d-4152-4e75-97b8-b447ea2d466a 2025-06-24 19:15:58,418 - DEBUG - Pod ctest-pod-96513810 not present 2025-06-24 19:15:58,418 - INFO - Creating Pod ctest-pod-96513810 2025-06-24 19:15:58,440 - DEBUG - Pod : ctest-pod-96513810 UUID is 4ecdb64f-b865-47f4-aaef-faa557e11964 2025-06-24 19:15:58,442 - DEBUG - Pod ctest-pod-90413947 not present 2025-06-24 19:15:58,442 - INFO - Creating Pod ctest-pod-90413947 2025-06-24 19:15:58,459 - DEBUG - Pod : ctest-pod-90413947 UUID is 96a8d2c2-bfe0-49cc-8eb0-86620014081d 2025-06-24 19:15:58,461 - DEBUG - Pod ctest-pod-67811089 not present 2025-06-24 19:15:58,461 - INFO - Creating Pod ctest-pod-67811089 2025-06-24 19:15:58,484 - DEBUG - Pod : ctest-pod-67811089 UUID is c18d3062-7017-42ea-ab7d-cda47be9f583 2025-06-24 19:15:58,662 - INFO - Project default-domain:k8s-ctest-new-default-21418177 for Namespace ctest-new-default-21418177 is seen in contrail-api 2025-06-24 19:15:58,662 - DEBUG - Project uuid in Contrail is 38d41cd6-7b44-46a8-a136-61cb514f9f8e 2025-06-24 19:15:58,832 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NamespaceDatabaseList?namespace_uuid=d8bb68c1-191a-4587-b27c-2ef4a64d137c 2025-06-24 19:15:58,837 - INFO - Namespace ctest-new-default-21418177 with uuid d8bb68c1-191a-4587-b27c-2ef4a64d137c found in kube manager 2025-06-24 19:15:58,837 - INFO - Namespace ctest-new-default-21418177 verification passed 2025-06-24 19:15:59,055 - INFO - Project default-domain:k8s-ctest-non-default-68337761 for Namespace ctest-non-default-68337761 is seen in contrail-api 2025-06-24 19:15:59,055 - DEBUG - Project uuid in Contrail is 49e13d9b-9e9b-45b8-b1ec-756dcb079894 2025-06-24 19:15:59,055 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NamespaceDatabaseList?namespace_uuid=cdf37200-1806-45bf-bbf9-904e0a8d9a19 2025-06-24 19:15:59,060 - INFO - Namespace ctest-non-default-68337761 with uuid cdf37200-1806-45bf-bbf9-904e0a8d9a19 found in kube manager 2025-06-24 19:15:59,060 - INFO - Namespace ctest-non-default-68337761 verification passed 2025-06-24 19:15:59,064 - DEBUG - Pod ctest-pod-34647509 not in running state.Currently in Pending 2025-06-24 19:16:04,082 - DEBUG - Pod ctest-pod-34647509 not in running state.Currently in Pending 2025-06-24 19:16:09,089 - INFO - Pod ctest-pod-34647509 is in running state.Got IP 10.47.255.251 2025-06-24 19:16:09,102 - DEBUG - Pod ctest-pod-34647509 has vmi a9bb1dc4-512f-11f0-b802-fa163ec76471 2025-06-24 19:16:09,102 - INFO - Verified pod ctest-pod-34647509 in contrail-api 2025-06-24 19:16:09,120 - DEBUG - VMI a9bb1dc4-512f-11f0-b802-fa163ec76471 is active in agent 10.0.0.130 2025-06-24 19:16:09,120 - INFO - Verified Pod ctest-pod-34647509 in agent 10.0.0.130 2025-06-24 19:16:09,121 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=f4bb326e-bb09-4e60-940b-c86fc4c7f3f2 2025-06-24 19:16:09,125 - INFO - Pod ctest-pod-34647509 with uuid f4bb326e-bb09-4e60-940b-c86fc4c7f3f2 found in kube manager 2025-06-24 19:16:09,125 - INFO - Pod ctest-pod-34647509 verification passed 2025-06-24 19:16:09,130 - INFO - Pod ctest-pod-01041288 is in running state.Got IP 10.47.255.250 2025-06-24 19:16:09,144 - DEBUG - Pod ctest-pod-01041288 has vmi aa46579a-512f-11f0-b802-fa163ec76471 2025-06-24 19:16:09,144 - INFO - Verified pod ctest-pod-01041288 in contrail-api 2025-06-24 19:16:09,154 - DEBUG - VMI aa46579a-512f-11f0-b802-fa163ec76471 is active in agent 10.0.0.130 2025-06-24 19:16:09,155 - INFO - Verified Pod ctest-pod-01041288 in agent 10.0.0.130 2025-06-24 19:16:09,155 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=f01068d4-ff31-4202-b11c-d2c4ced0af1c 2025-06-24 19:16:09,159 - INFO - Pod ctest-pod-01041288 with uuid f01068d4-ff31-4202-b11c-d2c4ced0af1c found in kube manager 2025-06-24 19:16:09,159 - INFO - Pod ctest-pod-01041288 verification passed 2025-06-24 19:16:09,169 - DEBUG - Pod ctest-pod-33534904 not in running state.Currently in Pending 2025-06-24 19:16:14,178 - INFO - Pod ctest-pod-33534904 is in running state.Got IP 10.47.255.249 2025-06-24 19:16:14,235 - DEBUG - Pod ctest-pod-33534904 has vmi aaebf1d2-512f-11f0-b802-fa163ec76471 2025-06-24 19:16:14,235 - INFO - Verified pod ctest-pod-33534904 in contrail-api 2025-06-24 19:16:14,249 - DEBUG - VMI aaebf1d2-512f-11f0-b802-fa163ec76471 is active in agent 10.0.0.130 2025-06-24 19:16:14,249 - INFO - Verified Pod ctest-pod-33534904 in agent 10.0.0.130 2025-06-24 19:16:14,250 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=53de7ca4-f964-4a9a-8f0e-ba69184a0e18 2025-06-24 19:16:14,254 - INFO - Pod ctest-pod-33534904 with uuid 53de7ca4-f964-4a9a-8f0e-ba69184a0e18 found in kube manager 2025-06-24 19:16:14,254 - INFO - Pod ctest-pod-33534904 verification passed 2025-06-24 19:16:14,259 - INFO - Pod ctest-pod-86318508 is in running state.Got IP 10.47.255.248 2025-06-24 19:16:14,273 - DEBUG - Pod ctest-pod-86318508 has vmi ab7d2c74-512f-11f0-b802-fa163ec76471 2025-06-24 19:16:14,273 - INFO - Verified pod ctest-pod-86318508 in contrail-api 2025-06-24 19:16:14,286 - DEBUG - VMI ab7d2c74-512f-11f0-b802-fa163ec76471 is active in agent 10.0.0.130 2025-06-24 19:16:14,287 - INFO - Verified Pod ctest-pod-86318508 in agent 10.0.0.130 2025-06-24 19:16:14,287 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=4a0f8c55-9610-4ce9-a4b0-72d99a6fd88d 2025-06-24 19:16:14,291 - INFO - Pod ctest-pod-86318508 with uuid 4a0f8c55-9610-4ce9-a4b0-72d99a6fd88d found in kube manager 2025-06-24 19:16:14,291 - INFO - Pod ctest-pod-86318508 verification passed 2025-06-24 19:16:14,297 - DEBUG - Pod ctest-pod-29319241 not in running state.Currently in Pending 2025-06-24 19:16:19,303 - INFO - Pod ctest-pod-29319241 is in running state.Got IP 10.47.255.247 2025-06-24 19:16:19,359 - DEBUG - Pod ctest-pod-29319241 has vmi ac1558d2-512f-11f0-b802-fa163ec76471 2025-06-24 19:16:19,359 - INFO - Verified pod ctest-pod-29319241 in contrail-api 2025-06-24 19:16:19,372 - DEBUG - VMI ac1558d2-512f-11f0-b802-fa163ec76471 is active in agent 10.0.0.130 2025-06-24 19:16:19,372 - INFO - Verified Pod ctest-pod-29319241 in agent 10.0.0.130 2025-06-24 19:16:19,372 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=069aec3d-4152-4e75-97b8-b447ea2d466a 2025-06-24 19:16:19,377 - INFO - Pod ctest-pod-29319241 with uuid 069aec3d-4152-4e75-97b8-b447ea2d466a found in kube manager 2025-06-24 19:16:19,377 - INFO - Pod ctest-pod-29319241 verification passed 2025-06-24 19:16:19,452 - INFO - Pod ctest-pod-90413947 is in running state.Got IP 10.47.255.245 2025-06-24 19:16:19,467 - DEBUG - Pod ctest-pod-90413947 has vmi ad1109a2-512f-11f0-b802-fa163ec76471 2025-06-24 19:16:19,467 - INFO - Verified pod ctest-pod-90413947 in contrail-api 2025-06-24 19:16:19,484 - DEBUG - VMI ad1109a2-512f-11f0-b802-fa163ec76471 is active in agent 10.0.0.130 2025-06-24 19:16:19,484 - INFO - Verified Pod ctest-pod-90413947 in agent 10.0.0.130 2025-06-24 19:16:19,484 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=96a8d2c2-bfe0-49cc-8eb0-86620014081d 2025-06-24 19:16:19,491 - INFO - Pod ctest-pod-90413947 with uuid 96a8d2c2-bfe0-49cc-8eb0-86620014081d found in kube manager 2025-06-24 19:16:19,492 - INFO - Pod ctest-pod-90413947 verification passed 2025-06-24 19:16:19,499 - INFO - Pod ctest-pod-96513810 is in running state.Got IP 10.47.255.246 2025-06-24 19:16:19,555 - DEBUG - Pod ctest-pod-96513810 has vmi ac913326-512f-11f0-b802-fa163ec76471 2025-06-24 19:16:19,555 - INFO - Verified pod ctest-pod-96513810 in contrail-api 2025-06-24 19:16:19,567 - DEBUG - VMI ac913326-512f-11f0-b802-fa163ec76471 is active in agent 10.0.0.130 2025-06-24 19:16:19,567 - INFO - Verified Pod ctest-pod-96513810 in agent 10.0.0.130 2025-06-24 19:16:19,567 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=4ecdb64f-b865-47f4-aaef-faa557e11964 2025-06-24 19:16:19,572 - INFO - Pod ctest-pod-96513810 with uuid 4ecdb64f-b865-47f4-aaef-faa557e11964 found in kube manager 2025-06-24 19:16:19,572 - INFO - Pod ctest-pod-96513810 verification passed 2025-06-24 19:16:19,578 - INFO - Pod ctest-pod-67811089 is in running state.Got IP 10.47.255.244 2025-06-24 19:16:19,593 - DEBUG - Pod ctest-pod-67811089 has vmi ad8f2684-512f-11f0-b802-fa163ec76471 2025-06-24 19:16:19,593 - INFO - Verified pod ctest-pod-67811089 in contrail-api 2025-06-24 19:16:19,605 - DEBUG - VMI ad8f2684-512f-11f0-b802-fa163ec76471 is active in agent 10.0.0.130 2025-06-24 19:16:19,605 - INFO - Verified Pod ctest-pod-67811089 in agent 10.0.0.130 2025-06-24 19:16:19,605 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=c18d3062-7017-42ea-ab7d-cda47be9f583 2025-06-24 19:16:19,610 - INFO - Pod ctest-pod-67811089 with uuid c18d3062-7017-42ea-ab7d-cda47be9f583 found in kube manager 2025-06-24 19:16:19,611 - INFO - Pod ctest-pod-67811089 verification passed 2025-06-24 19:16:19,611 - INFO - ================================================================================ 2025-06-24 19:16:19,611 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-06-24 19:16:19,612 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-06-24 19:16:19,843 - DEBUG - Nothing to compare xmpp stats {'10.0.0.130': {'10.0.0.50': '0'}} with 2025-06-24 19:16:19,843 - INFO - Initial checks done. Running the testcase now 2025-06-24 19:16:19,843 - INFO - 2025-06-24 19:16:19,901 - DEBUG - [Pod ctest-pod-34647509] Cmd: echo ctest-pod-34647509 > /usr/share/nginx/html/index.html, Output: 2025-06-24 19:16:19,963 - DEBUG - [Pod ctest-pod-01041288] Cmd: echo ctest-pod-01041288 > /usr/share/nginx/html/index.html, Output: 2025-06-24 19:16:20,028 - DEBUG - [Pod ctest-pod-33534904] Cmd: echo ctest-pod-33534904 > /usr/share/nginx/html/index.html, Output: 2025-06-24 19:16:20,078 - DEBUG - [Pod ctest-pod-86318508] Cmd: echo ctest-pod-86318508 > /usr/share/nginx/html/index.html, Output: 2025-06-24 19:16:20,082 - DEBUG - Service ctest-nginx-svc-47569884 not present 2025-06-24 19:16:20,082 - INFO - Creating service ctest-nginx-svc-47569884 2025-06-24 19:16:20,321 - INFO - Created Service ctest-nginx-svc-47569884 2025-06-24 19:16:20,334 - WARNING - Service UUID 0f7f4034-065d-42de-8383-8f2e38f63d58 not yet found in contrail-api 2025-06-24 19:16:21,341 - INFO - Validated that Service ctest-nginx-svc-47569884 is seen in contrail-api 2025-06-24 19:16:21,342 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_LoadbalancerDatabaseList?x=0f7f4034-065d-42de-8383-8f2e38f63d58 2025-06-24 19:16:21,347 - INFO - Service ctest-nginx-svc-47569884 with uuid 0f7f4034-065d-42de-8383-8f2e38f63d58 found in kube manager 2025-06-24 19:16:21,347 - INFO - Service ctest-nginx-svc-47569884 verification passed 2025-06-24 19:16:22,432 - DEBUG - [Pod ctest-pod-29319241] Cmd: wget http://10.106.27.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.27.229:80 (10.106.27.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-01041288 2025-06-24 19:16:22,432 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd wget http://10.106.27.229:80/ -O - -T 5 -t 1 passed 2025-06-24 19:16:22,432 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd output: Connecting to 10.106.27.229:80 (10.106.27.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-01041288 2025-06-24 19:16:22,486 - DEBUG - [Pod ctest-pod-29319241] Cmd: wget http://10.106.27.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.27.229:80 (10.106.27.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-01041288 2025-06-24 19:16:22,486 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd wget http://10.106.27.229:80/ -O - -T 5 -t 1 passed 2025-06-24 19:16:22,486 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd output: Connecting to 10.106.27.229:80 (10.106.27.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-01041288 2025-06-24 19:16:22,548 - DEBUG - [Pod ctest-pod-29319241] Cmd: wget http://10.106.27.229:80/ -O - -T 5 -t 1 , Output: ctest-pod-34647509 Connecting to 10.106.27.229:80 (10.106.27.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 19:16:22,549 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd wget http://10.106.27.229:80/ -O - -T 5 -t 1 passed 2025-06-24 19:16:22,549 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd output: ctest-pod-34647509 Connecting to 10.106.27.229:80 (10.106.27.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 19:16:22,549 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-34647509': 1, 'ctest-pod-01041288': 2} 2025-06-24 19:16:22,601 - DEBUG - [Pod ctest-pod-90413947] Cmd: wget http://10.106.27.229:80/ -O - -T 5 -t 1 , Output: ctest-pod-01041288 Connecting to 10.106.27.229:80 (10.106.27.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 19:16:22,601 - DEBUG - [Pod Pod ctest-pod-90413947] Cmd wget http://10.106.27.229:80/ -O - -T 5 -t 1 passed 2025-06-24 19:16:22,601 - DEBUG - [Pod Pod ctest-pod-90413947] Cmd output: ctest-pod-01041288 Connecting to 10.106.27.229:80 (10.106.27.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 19:16:22,656 - DEBUG - [Pod ctest-pod-90413947] Cmd: wget http://10.106.27.229:80/ -O - -T 5 -t 1 , Output: ctest-pod-34647509 Connecting to 10.106.27.229:80 (10.106.27.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 19:16:22,656 - DEBUG - [Pod Pod ctest-pod-90413947] Cmd wget http://10.106.27.229:80/ -O - -T 5 -t 1 passed 2025-06-24 19:16:22,656 - DEBUG - [Pod Pod ctest-pod-90413947] Cmd output: ctest-pod-34647509 Connecting to 10.106.27.229:80 (10.106.27.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 19:16:22,656 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-34647509': 1, 'ctest-pod-01041288': 1} 2025-06-24 19:16:22,660 - DEBUG - Network policy ingress-on-service not present 2025-06-24 19:16:22,660 - INFO - Creating Network Policy ingress-on-service 2025-06-24 19:16:22,684 - INFO - Network policy found in k8s 2025-06-24 19:16:22,684 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=bc8fefec-c804-4fd5-a52a-9c8968f8e696 2025-06-24 19:16:22,689 - INFO - Network Policy ingress-on-service with uuid bc8fefec-c804-4fd5-a52a-9c8968f8e696 found in kube manager 2025-06-24 19:16:22,724 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-06-24 19:16:22,725 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-06-24 19:16:22,725 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=bc8fefec-c804-4fd5-a52a-9c8968f8e696 2025-06-24 19:16:22,761 - WARNING - Network policy with name ingress-on-service not found in agent 2025-06-24 19:16:24,762 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=bc8fefec-c804-4fd5-a52a-9c8968f8e696 2025-06-24 19:16:24,794 - INFO - Network policy with name ingress-on-service found in agent 2025-06-24 19:16:24,794 - INFO - Network Policy ingress-on-service verification passed 2025-06-24 19:16:29,852 - DEBUG - [Pod ctest-pod-29319241] Cmd: wget http://10.106.27.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:16:29,853 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd wget http://10.106.27.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:16:29,853 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:16:34,910 - DEBUG - [Pod ctest-pod-29319241] Cmd: wget http://10.106.27.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:16:34,910 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd wget http://10.106.27.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:16:34,910 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:16:39,964 - DEBUG - [Pod ctest-pod-29319241] Cmd: wget http://10.106.27.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:16:39,964 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd wget http://10.106.27.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:16:39,964 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:16:45,013 - DEBUG - [Pod ctest-pod-29319241] Cmd: wget http://10.106.27.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:16:45,013 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd wget http://10.106.27.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:16:45,013 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:16:50,064 - DEBUG - [Pod ctest-pod-29319241] Cmd: wget http://10.106.27.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:16:50,064 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd wget http://10.106.27.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:16:50,065 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:16:55,116 - DEBUG - [Pod ctest-pod-29319241] Cmd: wget http://10.106.27.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:16:55,117 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd wget http://10.106.27.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:16:55,117 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:17:00,160 - DEBUG - [Pod ctest-pod-29319241] Cmd: wget http://10.106.27.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:17:00,160 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd wget http://10.106.27.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:17:00,160 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:17:05,208 - DEBUG - [Pod ctest-pod-29319241] Cmd: wget http://10.106.27.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:17:05,208 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd wget http://10.106.27.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:17:05,208 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:17:10,271 - DEBUG - [Pod ctest-pod-29319241] Cmd: wget http://10.106.27.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:17:10,271 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd wget http://10.106.27.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:17:10,271 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:17:15,324 - DEBUG - [Pod ctest-pod-29319241] Cmd: wget http://10.106.27.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:17:15,325 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd wget http://10.106.27.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:17:15,325 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:17:15,325 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-34647509': 0, 'ctest-pod-01041288': 0} 2025-06-24 19:17:15,381 - DEBUG - [Pod ctest-pod-96513810] Cmd: wget http://10.106.27.229:80/ -O - -T 5 -t 1 , Output: ctest-pod-01041288 Connecting to 10.106.27.229:80 (10.106.27.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 19:17:15,382 - DEBUG - [Pod Pod ctest-pod-96513810] Cmd wget http://10.106.27.229:80/ -O - -T 5 -t 1 passed 2025-06-24 19:17:15,382 - DEBUG - [Pod Pod ctest-pod-96513810] Cmd output: ctest-pod-01041288 Connecting to 10.106.27.229:80 (10.106.27.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 19:17:15,441 - DEBUG - [Pod ctest-pod-96513810] Cmd: wget http://10.106.27.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.27.229:80 (10.106.27.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-01041288 2025-06-24 19:17:15,441 - DEBUG - [Pod Pod ctest-pod-96513810] Cmd wget http://10.106.27.229:80/ -O - -T 5 -t 1 passed 2025-06-24 19:17:15,441 - DEBUG - [Pod Pod ctest-pod-96513810] Cmd output: Connecting to 10.106.27.229:80 (10.106.27.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-01041288 2025-06-24 19:17:15,498 - DEBUG - [Pod ctest-pod-96513810] Cmd: wget http://10.106.27.229:80/ -O - -T 5 -t 1 , Output: ctest-pod-01041288 Connecting to 10.106.27.229:80 (10.106.27.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 19:17:15,498 - DEBUG - [Pod Pod ctest-pod-96513810] Cmd wget http://10.106.27.229:80/ -O - -T 5 -t 1 passed 2025-06-24 19:17:15,498 - DEBUG - [Pod Pod ctest-pod-96513810] Cmd output: ctest-pod-01041288 Connecting to 10.106.27.229:80 (10.106.27.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 19:17:15,557 - DEBUG - [Pod ctest-pod-96513810] Cmd: wget http://10.106.27.229:80/ -O - -T 5 -t 1 , Output: ctest-pod-01041288 Connecting to 10.106.27.229:80 (10.106.27.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 19:17:15,557 - DEBUG - [Pod Pod ctest-pod-96513810] Cmd wget http://10.106.27.229:80/ -O - -T 5 -t 1 passed 2025-06-24 19:17:15,557 - DEBUG - [Pod Pod ctest-pod-96513810] Cmd output: ctest-pod-01041288 Connecting to 10.106.27.229:80 (10.106.27.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 19:17:15,610 - DEBUG - [Pod ctest-pod-96513810] Cmd: wget http://10.106.27.229:80/ -O - -T 5 -t 1 , Output: ctest-pod-01041288 Connecting to 10.106.27.229:80 (10.106.27.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 19:17:15,610 - DEBUG - [Pod Pod ctest-pod-96513810] Cmd wget http://10.106.27.229:80/ -O - -T 5 -t 1 passed 2025-06-24 19:17:15,610 - DEBUG - [Pod Pod ctest-pod-96513810] Cmd output: ctest-pod-01041288 Connecting to 10.106.27.229:80 (10.106.27.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 19:17:15,667 - DEBUG - [Pod ctest-pod-96513810] Cmd: wget http://10.106.27.229:80/ -O - -T 5 -t 1 , Output: ctest-pod-34647509 Connecting to 10.106.27.229:80 (10.106.27.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 19:17:15,667 - DEBUG - [Pod Pod ctest-pod-96513810] Cmd wget http://10.106.27.229:80/ -O - -T 5 -t 1 passed 2025-06-24 19:17:15,667 - DEBUG - [Pod Pod ctest-pod-96513810] Cmd output: ctest-pod-34647509 Connecting to 10.106.27.229:80 (10.106.27.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 19:17:15,667 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-34647509': 1, 'ctest-pod-01041288': 5} 2025-06-24 19:17:20,721 - DEBUG - [Pod ctest-pod-90413947] Cmd: wget http://10.106.27.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:17:20,721 - DEBUG - [Pod Pod ctest-pod-90413947] Cmd wget http://10.106.27.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:17:20,721 - DEBUG - [Pod Pod ctest-pod-90413947] Cmd output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:17:25,773 - DEBUG - [Pod ctest-pod-90413947] Cmd: wget http://10.106.27.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:17:25,773 - DEBUG - [Pod Pod ctest-pod-90413947] Cmd wget http://10.106.27.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:17:25,773 - DEBUG - [Pod Pod ctest-pod-90413947] Cmd output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:17:30,849 - DEBUG - [Pod ctest-pod-90413947] Cmd: wget http://10.106.27.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:17:30,849 - DEBUG - [Pod Pod ctest-pod-90413947] Cmd wget http://10.106.27.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:17:30,849 - DEBUG - [Pod Pod ctest-pod-90413947] Cmd output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:17:30,930 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2025-06-24 19:17:40,995 - DEBUG - [Pod ctest-pod-90413947] Cmd: wget http://10.106.27.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:17:40,995 - DEBUG - [Pod Pod ctest-pod-90413947] Cmd wget http://10.106.27.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:17:40,995 - DEBUG - [Pod Pod ctest-pod-90413947] Cmd output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:17:46,052 - DEBUG - [Pod ctest-pod-90413947] Cmd: wget http://10.106.27.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:17:46,052 - DEBUG - [Pod Pod ctest-pod-90413947] Cmd wget http://10.106.27.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:17:46,052 - DEBUG - [Pod Pod ctest-pod-90413947] Cmd output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:17:51,150 - DEBUG - [Pod ctest-pod-90413947] Cmd: wget http://10.106.27.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:17:51,150 - DEBUG - [Pod Pod ctest-pod-90413947] Cmd wget http://10.106.27.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:17:51,150 - DEBUG - [Pod Pod ctest-pod-90413947] Cmd output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:17:56,203 - DEBUG - [Pod ctest-pod-90413947] Cmd: wget http://10.106.27.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:17:56,203 - DEBUG - [Pod Pod ctest-pod-90413947] Cmd wget http://10.106.27.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:17:56,203 - DEBUG - [Pod Pod ctest-pod-90413947] Cmd output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:18:01,252 - DEBUG - [Pod ctest-pod-90413947] Cmd: wget http://10.106.27.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:18:01,252 - DEBUG - [Pod Pod ctest-pod-90413947] Cmd wget http://10.106.27.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:18:01,252 - DEBUG - [Pod Pod ctest-pod-90413947] Cmd output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:18:06,307 - DEBUG - [Pod ctest-pod-90413947] Cmd: wget http://10.106.27.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:18:06,307 - DEBUG - [Pod Pod ctest-pod-90413947] Cmd wget http://10.106.27.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:18:06,307 - DEBUG - [Pod Pod ctest-pod-90413947] Cmd output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:18:11,368 - DEBUG - [Pod ctest-pod-90413947] Cmd: wget http://10.106.27.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:18:11,368 - DEBUG - [Pod Pod ctest-pod-90413947] Cmd wget http://10.106.27.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:18:11,368 - DEBUG - [Pod Pod ctest-pod-90413947] Cmd output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:18:11,369 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-34647509': 0, 'ctest-pod-01041288': 0} 2025-06-24 19:18:13,416 - DEBUG - [Pod ctest-pod-96513810] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.208 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.083 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.076 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.076/0.455/1.208 ms 2025-06-24 19:18:13,416 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-96513810 with expectation True passed 2025-06-24 19:18:15,469 - DEBUG - [Pod ctest-pod-29319241] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.300 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.072 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.077 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.072/0.483/1.300 ms 2025-06-24 19:18:15,469 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-29319241 with expectation True passed 2025-06-24 19:18:17,524 - DEBUG - [Pod ctest-pod-90413947] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.552 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.049 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.074 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.049/0.225/0.552 ms 2025-06-24 19:18:17,524 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-90413947 with expectation True passed 2025-06-24 19:18:17,582 - DEBUG - [Pod ctest-pod-96513810] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-24 19:18:17,616 - DEBUG - [Pod Pod ctest-pod-96513810] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-06-24 19:18:17,616 - DEBUG - [Pod Pod ctest-pod-96513810] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-24 19:18:17,616 - INFO - wget check of of http://10.47.255.251 from ctest-pod-96513810 passed 2025-06-24 19:18:17,671 - DEBUG - [Pod ctest-pod-96513810] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-24 19:18:17,671 - DEBUG - [Pod Pod ctest-pod-96513810] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-06-24 19:18:17,671 - DEBUG - [Pod Pod ctest-pod-96513810] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-24 19:18:17,671 - INFO - wget check of of http://10.47.255.250 from ctest-pod-96513810 passed 2025-06-24 19:18:22,734 - DEBUG - [Pod ctest-pod-29319241] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-24 19:18:22,734 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-24 19:18:22,734 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-24 19:18:22,734 - INFO - wget check of of http://10.47.255.250 from ctest-pod-29319241 passed 2025-06-24 19:18:27,794 - DEBUG - [Pod ctest-pod-67811089] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-06-24 19:18:27,794 - DEBUG - [Pod Pod ctest-pod-67811089] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-06-24 19:18:27,794 - DEBUG - [Pod Pod ctest-pod-67811089] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-06-24 19:18:27,794 - INFO - wget check of of http://10.47.255.251 from ctest-pod-67811089 passed 2025-06-24 19:18:27,803 - INFO - Updating Network Policy ingress-on-service 2025-06-24 19:18:32,869 - DEBUG - [Pod ctest-pod-29319241] Cmd: wget http://10.106.27.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:18:32,869 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd wget http://10.106.27.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:18:32,869 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:18:37,920 - DEBUG - [Pod ctest-pod-29319241] Cmd: wget http://10.106.27.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:18:37,921 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd wget http://10.106.27.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:18:37,921 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:18:42,975 - DEBUG - [Pod ctest-pod-29319241] Cmd: wget http://10.106.27.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:18:42,975 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd wget http://10.106.27.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:18:42,975 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:18:48,025 - DEBUG - [Pod ctest-pod-29319241] Cmd: wget http://10.106.27.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:18:48,025 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd wget http://10.106.27.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:18:48,025 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:18:53,076 - DEBUG - [Pod ctest-pod-29319241] Cmd: wget http://10.106.27.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:18:53,076 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd wget http://10.106.27.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:18:53,076 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:18:58,126 - DEBUG - [Pod ctest-pod-29319241] Cmd: wget http://10.106.27.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:18:58,127 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd wget http://10.106.27.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:18:58,127 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:19:03,184 - DEBUG - [Pod ctest-pod-29319241] Cmd: wget http://10.106.27.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:19:03,185 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd wget http://10.106.27.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:19:03,185 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:19:08,236 - DEBUG - [Pod ctest-pod-29319241] Cmd: wget http://10.106.27.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:19:08,237 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd wget http://10.106.27.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:19:08,237 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:19:13,306 - DEBUG - [Pod ctest-pod-29319241] Cmd: wget http://10.106.27.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:19:13,306 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd wget http://10.106.27.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:19:13,306 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:19:18,376 - DEBUG - [Pod ctest-pod-29319241] Cmd: wget http://10.106.27.229:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:19:18,376 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd wget http://10.106.27.229:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:19:18,376 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd output: Connecting to 10.106.27.229:80 (10.106.27.229:80) wget: download timed out 2025-06-24 19:19:18,376 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-34647509': 0, 'ctest-pod-01041288': 0} 2025-06-24 19:19:18,434 - DEBUG - [Pod ctest-pod-96513810] Cmd: wget http://10.106.27.229:80/ -O - -T 5 -t 1 , Output: ctest-pod-34647509 Connecting to 10.106.27.229:80 (10.106.27.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 19:19:18,434 - DEBUG - [Pod Pod ctest-pod-96513810] Cmd wget http://10.106.27.229:80/ -O - -T 5 -t 1 passed 2025-06-24 19:19:18,435 - DEBUG - [Pod Pod ctest-pod-96513810] Cmd output: ctest-pod-34647509 Connecting to 10.106.27.229:80 (10.106.27.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 19:19:18,492 - DEBUG - [Pod ctest-pod-96513810] Cmd: wget http://10.106.27.229:80/ -O - -T 5 -t 1 , Output: ctest-pod-34647509 Connecting to 10.106.27.229:80 (10.106.27.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 19:19:18,492 - DEBUG - [Pod Pod ctest-pod-96513810] Cmd wget http://10.106.27.229:80/ -O - -T 5 -t 1 passed 2025-06-24 19:19:18,492 - DEBUG - [Pod Pod ctest-pod-96513810] Cmd output: ctest-pod-34647509 Connecting to 10.106.27.229:80 (10.106.27.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 19:19:18,548 - DEBUG - [Pod ctest-pod-96513810] Cmd: wget http://10.106.27.229:80/ -O - -T 5 -t 1 , Output: ctest-pod-01041288 Connecting to 10.106.27.229:80 (10.106.27.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 19:19:18,548 - DEBUG - [Pod Pod ctest-pod-96513810] Cmd wget http://10.106.27.229:80/ -O - -T 5 -t 1 passed 2025-06-24 19:19:18,548 - DEBUG - [Pod Pod ctest-pod-96513810] Cmd output: ctest-pod-01041288 Connecting to 10.106.27.229:80 (10.106.27.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 19:19:18,548 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-34647509': 2, 'ctest-pod-01041288': 1} 2025-06-24 19:19:18,604 - DEBUG - [Pod ctest-pod-90413947] Cmd: wget http://10.106.27.229:80/ -O - -T 5 -t 1 , Output: ctest-pod-01041288 Connecting to 10.106.27.229:80 (10.106.27.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 19:19:18,604 - DEBUG - [Pod Pod ctest-pod-90413947] Cmd wget http://10.106.27.229:80/ -O - -T 5 -t 1 passed 2025-06-24 19:19:18,604 - DEBUG - [Pod Pod ctest-pod-90413947] Cmd output: ctest-pod-01041288 Connecting to 10.106.27.229:80 (10.106.27.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 19:19:18,659 - DEBUG - [Pod ctest-pod-90413947] Cmd: wget http://10.106.27.229:80/ -O - -T 5 -t 1 , Output: ctest-pod-34647509 Connecting to 10.106.27.229:80 (10.106.27.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 19:19:18,659 - DEBUG - [Pod Pod ctest-pod-90413947] Cmd wget http://10.106.27.229:80/ -O - -T 5 -t 1 passed 2025-06-24 19:19:18,660 - DEBUG - [Pod Pod ctest-pod-90413947] Cmd output: ctest-pod-34647509 Connecting to 10.106.27.229:80 (10.106.27.229:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 19:19:18,660 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-34647509': 1, 'ctest-pod-01041288': 1} 2025-06-24 19:19:20,718 - DEBUG - [Pod ctest-pod-96513810] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.615 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.067 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.089 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.067/0.257/0.615 ms 2025-06-24 19:19:20,718 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-96513810 with expectation True passed 2025-06-24 19:19:22,769 - DEBUG - [Pod ctest-pod-29319241] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.165 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.096 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.084 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.084/0.448/1.165 ms 2025-06-24 19:19:22,769 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-29319241 with expectation True passed 2025-06-24 19:19:24,821 - DEBUG - [Pod ctest-pod-90413947] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.410 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.073 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.089 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.073/0.524/1.410 ms 2025-06-24 19:19:24,822 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-90413947 with expectation True passed 2025-06-24 19:19:24,879 - DEBUG - [Pod ctest-pod-96513810] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-24 19:19:24,879 - DEBUG - [Pod Pod ctest-pod-96513810] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-06-24 19:19:24,879 - DEBUG - [Pod Pod ctest-pod-96513810] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-24 19:19:24,879 - INFO - wget check of of http://10.47.255.251 from ctest-pod-96513810 passed 2025-06-24 19:19:24,930 - DEBUG - [Pod ctest-pod-96513810] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-24 19:19:24,930 - DEBUG - [Pod Pod ctest-pod-96513810] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-06-24 19:19:24,930 - DEBUG - [Pod Pod ctest-pod-96513810] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-24 19:19:24,930 - INFO - wget check of of http://10.47.255.250 from ctest-pod-96513810 passed 2025-06-24 19:19:29,985 - DEBUG - [Pod ctest-pod-29319241] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-24 19:19:29,985 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-24 19:19:29,985 - DEBUG - [Pod Pod ctest-pod-29319241] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-24 19:19:29,985 - INFO - wget check of of http://10.47.255.250 from ctest-pod-29319241 passed 2025-06-24 19:19:30,036 - DEBUG - [Pod ctest-pod-67811089] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-24 19:19:30,036 - DEBUG - [Pod Pod ctest-pod-67811089] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-06-24 19:19:30,036 - DEBUG - [Pod Pod ctest-pod-67811089] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-24 19:19:30,036 - INFO - wget check of of http://10.47.255.251 from ctest-pod-67811089 passed 2025-06-24 19:19:30,036 - INFO - Deleting Network Policy : ingress-on-service 2025-06-24 19:19:30,037 - INFO - Deleting service : ctest-nginx-svc-47569884 2025-06-24 19:19:30,277 - DEBUG - No XMPP flaps were noticed during the test 2025-06-24 19:19:30,277 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:11] 2025-06-24 19:19:30,277 - INFO - -------------------------------------------------------------------------------- 2025-06-24 19:19:30,287 - INFO - Deleting pod ctest-new-default-21418177:ctest-pod-34647509 2025-06-24 19:19:30,287 - INFO - Deleting pod ctest-new-default-21418177:ctest-pod-01041288 2025-06-24 19:19:30,288 - INFO - Deleting pod ctest-non-default-68337761:ctest-pod-33534904 2025-06-24 19:19:30,289 - INFO - Deleting pod ctest-non-default-68337761:ctest-pod-86318508 2025-06-24 19:19:30,289 - INFO - Deleting pod ctest-new-default-21418177:ctest-pod-29319241 2025-06-24 19:19:30,290 - INFO - Deleting pod ctest-new-default-21418177:ctest-pod-96513810 2025-06-24 19:19:30,290 - INFO - Deleting pod ctest-non-default-68337761:ctest-pod-90413947 2025-06-24 19:19:30,291 - INFO - Deleting pod ctest-non-default-68337761:ctest-pod-67811089 2025-06-24 19:19:30,407 - WARNING - Pod uuid f4bb326e-bb09-4e60-940b-c86fc4c7f3f2 is still seen in agent 10.0.0.130 VM list 2025-06-24 19:19:30,409 - WARNING - Pod uuid 96a8d2c2-bfe0-49cc-8eb0-86620014081d is still seen in agent 10.0.0.130 VM list 2025-06-24 19:19:30,438 - WARNING - Pod uuid 53de7ca4-f964-4a9a-8f0e-ba69184a0e18 is still seen in agent 10.0.0.130 VM list 2025-06-24 19:19:30,440 - WARNING - Pod uuid c18d3062-7017-42ea-ab7d-cda47be9f583 is still seen in agent 10.0.0.130 VM list 2025-06-24 19:19:30,441 - WARNING - Pod uuid 4ecdb64f-b865-47f4-aaef-faa557e11964 is still seen in agent 10.0.0.130 VM list 2025-06-24 19:19:30,441 - WARNING - Pod uuid f01068d4-ff31-4202-b11c-d2c4ced0af1c is still seen in agent 10.0.0.130 VM list 2025-06-24 19:19:30,444 - WARNING - Pod uuid 069aec3d-4152-4e75-97b8-b447ea2d466a is still seen in agent 10.0.0.130 VM list 2025-06-24 19:19:30,444 - WARNING - Pod uuid 4a0f8c55-9610-4ce9-a4b0-72d99a6fd88d is still seen in agent 10.0.0.130 VM list 2025-06-24 19:19:35,422 - WARNING - Pod uuid 96a8d2c2-bfe0-49cc-8eb0-86620014081d is still seen in agent 10.0.0.130 VM list 2025-06-24 19:19:35,424 - DEBUG - Pod f4bb326e-bb09-4e60-940b-c86fc4c7f3f2 is not in agent 10.0.0.130 VM list 2025-06-24 19:19:35,432 - DEBUG - VMI a9bb1dc4-512f-11f0-b802-fa163ec76471 is removed from agent 10.0.0.130 2025-06-24 19:19:35,432 - INFO - Verified that pod ctest-pod-34647509 is removed in agent 2025-06-24 19:19:35,474 - WARNING - Pod uuid 4ecdb64f-b865-47f4-aaef-faa557e11964 is still seen in agent 10.0.0.130 VM list 2025-06-24 19:19:35,475 - DEBUG - Pod 53de7ca4-f964-4a9a-8f0e-ba69184a0e18 is not in agent 10.0.0.130 VM list 2025-06-24 19:19:35,476 - WARNING - Pod uuid f01068d4-ff31-4202-b11c-d2c4ced0af1c is still seen in agent 10.0.0.130 VM list 2025-06-24 19:19:35,477 - WARNING - Pod uuid c18d3062-7017-42ea-ab7d-cda47be9f583 is still seen in agent 10.0.0.130 VM list 2025-06-24 19:19:35,479 - WARNING - Pod uuid 069aec3d-4152-4e75-97b8-b447ea2d466a is still seen in agent 10.0.0.130 VM list 2025-06-24 19:19:35,480 - DEBUG - Pod 4a0f8c55-9610-4ce9-a4b0-72d99a6fd88d is not in agent 10.0.0.130 VM list 2025-06-24 19:19:35,490 - DEBUG - VMI aaebf1d2-512f-11f0-b802-fa163ec76471 is removed from agent 10.0.0.130 2025-06-24 19:19:35,490 - INFO - Verified that pod ctest-pod-33534904 is removed in agent 2025-06-24 19:19:35,490 - DEBUG - VMI ab7d2c74-512f-11f0-b802-fa163ec76471 is removed from agent 10.0.0.130 2025-06-24 19:19:35,490 - INFO - Verified that pod ctest-pod-86318508 is removed in agent 2025-06-24 19:19:40,430 - WARNING - Pod uuid 96a8d2c2-bfe0-49cc-8eb0-86620014081d is still seen in agent 10.0.0.130 VM list 2025-06-24 19:19:40,493 - WARNING - Pod uuid 4ecdb64f-b865-47f4-aaef-faa557e11964 is still seen in agent 10.0.0.130 VM list 2025-06-24 19:19:40,495 - WARNING - Pod uuid 069aec3d-4152-4e75-97b8-b447ea2d466a is still seen in agent 10.0.0.130 VM list 2025-06-24 19:19:40,496 - WARNING - Pod uuid c18d3062-7017-42ea-ab7d-cda47be9f583 is still seen in agent 10.0.0.130 VM list 2025-06-24 19:19:40,496 - WARNING - Pod uuid f01068d4-ff31-4202-b11c-d2c4ced0af1c is still seen in agent 10.0.0.130 VM list 2025-06-24 19:19:45,438 - WARNING - Pod uuid 96a8d2c2-bfe0-49cc-8eb0-86620014081d is still seen in agent 10.0.0.130 VM list 2025-06-24 19:19:45,516 - WARNING - Pod uuid c18d3062-7017-42ea-ab7d-cda47be9f583 is still seen in agent 10.0.0.130 VM list 2025-06-24 19:19:45,517 - WARNING - Pod uuid 069aec3d-4152-4e75-97b8-b447ea2d466a is still seen in agent 10.0.0.130 VM list 2025-06-24 19:19:45,518 - WARNING - Pod uuid f01068d4-ff31-4202-b11c-d2c4ced0af1c is still seen in agent 10.0.0.130 VM list 2025-06-24 19:19:45,519 - WARNING - Pod uuid 4ecdb64f-b865-47f4-aaef-faa557e11964 is still seen in agent 10.0.0.130 VM list 2025-06-24 19:19:50,446 - WARNING - Pod uuid 96a8d2c2-bfe0-49cc-8eb0-86620014081d is still seen in agent 10.0.0.130 VM list 2025-06-24 19:19:50,536 - WARNING - Pod uuid c18d3062-7017-42ea-ab7d-cda47be9f583 is still seen in agent 10.0.0.130 VM list 2025-06-24 19:19:50,538 - WARNING - Pod uuid 069aec3d-4152-4e75-97b8-b447ea2d466a is still seen in agent 10.0.0.130 VM list 2025-06-24 19:19:50,539 - WARNING - Pod uuid 4ecdb64f-b865-47f4-aaef-faa557e11964 is still seen in agent 10.0.0.130 VM list 2025-06-24 19:19:50,539 - WARNING - Pod uuid f01068d4-ff31-4202-b11c-d2c4ced0af1c is still seen in agent 10.0.0.130 VM list 2025-06-24 19:19:55,455 - WARNING - Pod uuid 96a8d2c2-bfe0-49cc-8eb0-86620014081d is still seen in agent 10.0.0.130 VM list 2025-06-24 19:19:55,565 - WARNING - Pod uuid c18d3062-7017-42ea-ab7d-cda47be9f583 is still seen in agent 10.0.0.130 VM list 2025-06-24 19:19:55,568 - WARNING - Pod uuid 069aec3d-4152-4e75-97b8-b447ea2d466a is still seen in agent 10.0.0.130 VM list 2025-06-24 19:19:55,568 - WARNING - Pod uuid 4ecdb64f-b865-47f4-aaef-faa557e11964 is still seen in agent 10.0.0.130 VM list 2025-06-24 19:19:55,568 - WARNING - Pod uuid f01068d4-ff31-4202-b11c-d2c4ced0af1c is still seen in agent 10.0.0.130 VM list 2025-06-24 19:20:00,468 - WARNING - Pod uuid 96a8d2c2-bfe0-49cc-8eb0-86620014081d is still seen in agent 10.0.0.130 VM list 2025-06-24 19:20:00,585 - WARNING - Pod uuid 4ecdb64f-b865-47f4-aaef-faa557e11964 is still seen in agent 10.0.0.130 VM list 2025-06-24 19:20:00,586 - WARNING - Pod uuid c18d3062-7017-42ea-ab7d-cda47be9f583 is still seen in agent 10.0.0.130 VM list 2025-06-24 19:20:00,587 - WARNING - Pod uuid f01068d4-ff31-4202-b11c-d2c4ced0af1c is still seen in agent 10.0.0.130 VM list 2025-06-24 19:20:00,587 - WARNING - Pod uuid 069aec3d-4152-4e75-97b8-b447ea2d466a is still seen in agent 10.0.0.130 VM list 2025-06-24 19:20:05,477 - DEBUG - Pod 96a8d2c2-bfe0-49cc-8eb0-86620014081d is not in agent 10.0.0.130 VM list 2025-06-24 19:20:05,484 - DEBUG - VMI ad1109a2-512f-11f0-b802-fa163ec76471 is removed from agent 10.0.0.130 2025-06-24 19:20:05,484 - INFO - Verified that pod ctest-pod-90413947 is removed in agent 2025-06-24 19:20:05,605 - DEBUG - Pod 4ecdb64f-b865-47f4-aaef-faa557e11964 is not in agent 10.0.0.130 VM list 2025-06-24 19:20:05,608 - DEBUG - Pod 069aec3d-4152-4e75-97b8-b447ea2d466a is not in agent 10.0.0.130 VM list 2025-06-24 19:20:05,610 - DEBUG - Pod f01068d4-ff31-4202-b11c-d2c4ced0af1c is not in agent 10.0.0.130 VM list 2025-06-24 19:20:05,611 - DEBUG - Pod c18d3062-7017-42ea-ab7d-cda47be9f583 is not in agent 10.0.0.130 VM list 2025-06-24 19:20:05,626 - DEBUG - VMI ac913326-512f-11f0-b802-fa163ec76471 is removed from agent 10.0.0.130 2025-06-24 19:20:05,626 - INFO - Verified that pod ctest-pod-96513810 is removed in agent 2025-06-24 19:20:05,628 - DEBUG - VMI ac1558d2-512f-11f0-b802-fa163ec76471 is removed from agent 10.0.0.130 2025-06-24 19:20:05,628 - INFO - Verified that pod ctest-pod-29319241 is removed in agent 2025-06-24 19:20:05,628 - DEBUG - VMI aa46579a-512f-11f0-b802-fa163ec76471 is removed from agent 10.0.0.130 2025-06-24 19:20:05,628 - INFO - Verified that pod ctest-pod-01041288 is removed in agent 2025-06-24 19:20:05,629 - DEBUG - VMI ad8f2684-512f-11f0-b802-fa163ec76471 is removed from agent 10.0.0.130 2025-06-24 19:20:05,629 - INFO - Verified that pod ctest-pod-67811089 is removed in agent 2025-06-24 19:20:05,629 - INFO - Deleting namespace ctest-non-default-68337761 2025-06-24 19:20:05,646 - DEBUG - Namespace ctest-non-default-68337761 still in k8s 2025-06-24 19:20:07,652 - DEBUG - Namespace ctest-non-default-68337761 still in k8s 2025-06-24 19:20:09,657 - DEBUG - Namespace ctest-non-default-68337761 still in k8s 2025-06-24 19:20:11,661 - DEBUG - Namespace ctest-non-default-68337761 is not in k8s 2025-06-24 19:20:11,662 - DEBUG - No need to check project deletion in contrail-api 2025-06-24 19:20:11,662 - INFO - Deleting namespace ctest-new-default-21418177 2025-06-24 19:20:11,670 - DEBUG - Namespace ctest-new-default-21418177 still in k8s 2025-06-24 19:20:13,675 - DEBUG - Namespace ctest-new-default-21418177 still in k8s 2025-06-24 19:20:15,688 - DEBUG - Namespace ctest-new-default-21418177 still in k8s 2025-06-24 19:20:17,691 - DEBUG - Namespace ctest-new-default-21418177 is not in k8s 2025-06-24 19:20:17,692 - DEBUG - No need to check project deletion in contrail-api