2025-05-28 12:02:31,658 - INFO - Using existing project ['default-domain', 'k8s-default'](5c80b6fb-a147-4403-902b-93326c2a2f7e) 2025-05-28 12:02:31,678 - DEBUG - Namespace ctest-new-default-01804811 not present 2025-05-28 12:02:31,686 - INFO - Created namespace ctest-new-default-01804811 2025-05-28 12:02:34,691 - DEBUG - Namespace ctest-non-default-93054286 not present 2025-05-28 12:02:34,705 - INFO - Created namespace ctest-non-default-93054286 2025-05-28 12:02:37,723 - DEBUG - Pod ctest-pod-92702687 not present 2025-05-28 12:02:37,723 - INFO - Creating Pod ctest-pod-92702687 2025-05-28 12:02:37,749 - DEBUG - Pod : ctest-pod-92702687 UUID is 3e907757-d4c9-4db2-bb16-449c82cd85b2 2025-05-28 12:02:37,753 - DEBUG - Pod ctest-pod-97310618 not present 2025-05-28 12:02:37,753 - INFO - Creating Pod ctest-pod-97310618 2025-05-28 12:02:37,788 - DEBUG - Pod : ctest-pod-97310618 UUID is 67e831f3-5523-4784-b993-a9659a6b98b6 2025-05-28 12:02:37,790 - DEBUG - Pod ctest-pod-21470543 not present 2025-05-28 12:02:37,790 - INFO - Creating Pod ctest-pod-21470543 2025-05-28 12:02:37,823 - DEBUG - Pod : ctest-pod-21470543 UUID is e09a3777-1398-46cb-a047-d755ad00f6c4 2025-05-28 12:02:37,826 - DEBUG - Pod ctest-pod-67173690 not present 2025-05-28 12:02:37,826 - INFO - Creating Pod ctest-pod-67173690 2025-05-28 12:02:37,851 - DEBUG - Pod : ctest-pod-67173690 UUID is 81c41387-58a4-4b3d-a05f-a91f30314370 2025-05-28 12:02:37,853 - DEBUG - Pod ctest-pod-14469393 not present 2025-05-28 12:02:37,853 - INFO - Creating Pod ctest-pod-14469393 2025-05-28 12:02:37,872 - DEBUG - Pod : ctest-pod-14469393 UUID is 44fdb55e-6a58-42ee-85c9-292bd6349bd6 2025-05-28 12:02:37,875 - DEBUG - Pod ctest-pod-12519907 not present 2025-05-28 12:02:37,875 - INFO - Creating Pod ctest-pod-12519907 2025-05-28 12:02:37,891 - DEBUG - Pod : ctest-pod-12519907 UUID is 31703d27-09cd-408b-bd03-62039183aa0e 2025-05-28 12:02:37,892 - DEBUG - Pod ctest-pod-17467473 not present 2025-05-28 12:02:37,893 - INFO - Creating Pod ctest-pod-17467473 2025-05-28 12:02:37,913 - DEBUG - Pod : ctest-pod-17467473 UUID is 49cf25cf-94a5-4d80-ba12-93d17a38a5dd 2025-05-28 12:02:37,915 - DEBUG - Pod ctest-pod-19478731 not present 2025-05-28 12:02:37,915 - INFO - Creating Pod ctest-pod-19478731 2025-05-28 12:02:37,949 - DEBUG - Pod : ctest-pod-19478731 UUID is 18d4ab55-9cd8-44c5-9058-389ea2c0b930 2025-05-28 12:02:38,230 - INFO - Project default-domain:k8s-ctest-new-default-01804811 for Namespace ctest-new-default-01804811 is seen in contrail-api 2025-05-28 12:02:38,230 - DEBUG - Project uuid in Contrail is 69285dda-81d1-4032-ba55-22e6392575e0 2025-05-28 12:02:38,448 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NamespaceDatabaseList?namespace_uuid=b76194c5-8efb-4127-87a3-a51b118fda03 2025-05-28 12:02:38,453 - INFO - Namespace ctest-new-default-01804811 with uuid b76194c5-8efb-4127-87a3-a51b118fda03 found in kube manager 2025-05-28 12:02:38,453 - INFO - Namespace ctest-new-default-01804811 verification passed 2025-05-28 12:02:38,657 - INFO - Project default-domain:k8s-ctest-non-default-93054286 for Namespace ctest-non-default-93054286 is seen in contrail-api 2025-05-28 12:02:38,657 - DEBUG - Project uuid in Contrail is e0ab98fc-1a3f-424b-b56d-15a68c90e6d4 2025-05-28 12:02:38,657 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NamespaceDatabaseList?namespace_uuid=1a7a67c7-36ca-4b9b-b4b1-dbd62d7c0506 2025-05-28 12:02:38,663 - INFO - Namespace ctest-non-default-93054286 with uuid 1a7a67c7-36ca-4b9b-b4b1-dbd62d7c0506 found in kube manager 2025-05-28 12:02:38,663 - INFO - Namespace ctest-non-default-93054286 verification passed 2025-05-28 12:02:38,670 - DEBUG - Pod ctest-pod-92702687 not in running state.Currently in Pending 2025-05-28 12:02:43,676 - DEBUG - Pod ctest-pod-92702687 not in running state.Currently in Pending 2025-05-28 12:02:48,682 - INFO - Pod ctest-pod-92702687 is in running state.Got IP 10.47.255.251 2025-05-28 12:02:48,695 - DEBUG - Pod ctest-pod-92702687 has vmi a73459a0-3bbb-11f0-9d3f-fa163e3d4579 2025-05-28 12:02:48,695 - INFO - Verified pod ctest-pod-92702687 in contrail-api 2025-05-28 12:02:48,708 - DEBUG - VMI a73459a0-3bbb-11f0-9d3f-fa163e3d4579 is active in agent 10.0.0.22 2025-05-28 12:02:48,708 - INFO - Verified Pod ctest-pod-92702687 in agent 10.0.0.22 2025-05-28 12:02:48,709 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=3e907757-d4c9-4db2-bb16-449c82cd85b2 2025-05-28 12:02:48,713 - INFO - Pod ctest-pod-92702687 with uuid 3e907757-d4c9-4db2-bb16-449c82cd85b2 found in kube manager 2025-05-28 12:02:48,713 - INFO - Pod ctest-pod-92702687 verification passed 2025-05-28 12:02:48,718 - DEBUG - Pod ctest-pod-97310618 not in running state.Currently in Pending 2025-05-28 12:02:53,732 - INFO - Pod ctest-pod-97310618 is in running state.Got IP 10.47.255.250 2025-05-28 12:02:53,749 - DEBUG - Pod ctest-pod-97310618 has vmi a7bcf878-3bbb-11f0-9d3f-fa163e3d4579 2025-05-28 12:02:53,749 - INFO - Verified pod ctest-pod-97310618 in contrail-api 2025-05-28 12:02:53,763 - DEBUG - VMI a7bcf878-3bbb-11f0-9d3f-fa163e3d4579 is active in agent 10.0.0.22 2025-05-28 12:02:53,763 - INFO - Verified Pod ctest-pod-97310618 in agent 10.0.0.22 2025-05-28 12:02:53,763 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=67e831f3-5523-4784-b993-a9659a6b98b6 2025-05-28 12:02:53,768 - INFO - Pod ctest-pod-97310618 with uuid 67e831f3-5523-4784-b993-a9659a6b98b6 found in kube manager 2025-05-28 12:02:53,768 - INFO - Pod ctest-pod-97310618 verification passed 2025-05-28 12:02:53,774 - INFO - Pod ctest-pod-21470543 is in running state.Got IP 10.47.255.249 2025-05-28 12:02:53,834 - DEBUG - Pod ctest-pod-21470543 has vmi a86569f4-3bbb-11f0-9d3f-fa163e3d4579 2025-05-28 12:02:53,834 - INFO - Verified pod ctest-pod-21470543 in contrail-api 2025-05-28 12:02:53,848 - DEBUG - VMI a86569f4-3bbb-11f0-9d3f-fa163e3d4579 is active in agent 10.0.0.22 2025-05-28 12:02:53,849 - INFO - Verified Pod ctest-pod-21470543 in agent 10.0.0.22 2025-05-28 12:02:53,849 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=e09a3777-1398-46cb-a047-d755ad00f6c4 2025-05-28 12:02:53,854 - INFO - Pod ctest-pod-21470543 with uuid e09a3777-1398-46cb-a047-d755ad00f6c4 found in kube manager 2025-05-28 12:02:53,854 - INFO - Pod ctest-pod-21470543 verification passed 2025-05-28 12:02:53,861 - INFO - Pod ctest-pod-67173690 is in running state.Got IP 10.47.255.248 2025-05-28 12:02:53,921 - DEBUG - Pod ctest-pod-67173690 has vmi a8f56ab8-3bbb-11f0-9d3f-fa163e3d4579 2025-05-28 12:02:53,921 - INFO - Verified pod ctest-pod-67173690 in contrail-api 2025-05-28 12:02:53,938 - DEBUG - VMI a8f56ab8-3bbb-11f0-9d3f-fa163e3d4579 is active in agent 10.0.0.22 2025-05-28 12:02:53,938 - INFO - Verified Pod ctest-pod-67173690 in agent 10.0.0.22 2025-05-28 12:02:53,939 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=81c41387-58a4-4b3d-a05f-a91f30314370 2025-05-28 12:02:53,944 - INFO - Pod ctest-pod-67173690 with uuid 81c41387-58a4-4b3d-a05f-a91f30314370 found in kube manager 2025-05-28 12:02:53,944 - INFO - Pod ctest-pod-67173690 verification passed 2025-05-28 12:02:53,949 - INFO - Pod ctest-pod-14469393 is in running state.Got IP 10.47.255.247 2025-05-28 12:02:53,967 - DEBUG - Pod ctest-pod-14469393 has vmi a99fbe96-3bbb-11f0-9d3f-fa163e3d4579 2025-05-28 12:02:53,967 - INFO - Verified pod ctest-pod-14469393 in contrail-api 2025-05-28 12:02:53,981 - DEBUG - VMI a99fbe96-3bbb-11f0-9d3f-fa163e3d4579 is active in agent 10.0.0.22 2025-05-28 12:02:53,981 - INFO - Verified Pod ctest-pod-14469393 in agent 10.0.0.22 2025-05-28 12:02:53,981 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=44fdb55e-6a58-42ee-85c9-292bd6349bd6 2025-05-28 12:02:53,986 - INFO - Pod ctest-pod-14469393 with uuid 44fdb55e-6a58-42ee-85c9-292bd6349bd6 found in kube manager 2025-05-28 12:02:53,986 - INFO - Pod ctest-pod-14469393 verification passed 2025-05-28 12:02:53,992 - INFO - Pod ctest-pod-17467473 is in running state.Got IP 10.47.255.245 2025-05-28 12:02:54,052 - DEBUG - Pod ctest-pod-17467473 has vmi aa8b2f98-3bbb-11f0-9d3f-fa163e3d4579 2025-05-28 12:02:54,052 - INFO - Verified pod ctest-pod-17467473 in contrail-api 2025-05-28 12:02:54,065 - DEBUG - VMI aa8b2f98-3bbb-11f0-9d3f-fa163e3d4579 is active in agent 10.0.0.22 2025-05-28 12:02:54,065 - INFO - Verified Pod ctest-pod-17467473 in agent 10.0.0.22 2025-05-28 12:02:54,066 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=49cf25cf-94a5-4d80-ba12-93d17a38a5dd 2025-05-28 12:02:54,070 - INFO - Pod ctest-pod-17467473 with uuid 49cf25cf-94a5-4d80-ba12-93d17a38a5dd found in kube manager 2025-05-28 12:02:54,070 - INFO - Pod ctest-pod-17467473 verification passed 2025-05-28 12:02:54,143 - INFO - Pod ctest-pod-12519907 is in running state.Got IP 10.47.255.246 2025-05-28 12:02:54,157 - DEBUG - Pod ctest-pod-12519907 has vmi aa12c2e2-3bbb-11f0-9d3f-fa163e3d4579 2025-05-28 12:02:54,157 - INFO - Verified pod ctest-pod-12519907 in contrail-api 2025-05-28 12:02:54,169 - DEBUG - VMI aa12c2e2-3bbb-11f0-9d3f-fa163e3d4579 is active in agent 10.0.0.22 2025-05-28 12:02:54,170 - INFO - Verified Pod ctest-pod-12519907 in agent 10.0.0.22 2025-05-28 12:02:54,170 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=31703d27-09cd-408b-bd03-62039183aa0e 2025-05-28 12:02:54,174 - INFO - Pod ctest-pod-12519907 with uuid 31703d27-09cd-408b-bd03-62039183aa0e found in kube manager 2025-05-28 12:02:54,174 - INFO - Pod ctest-pod-12519907 verification passed 2025-05-28 12:02:54,180 - DEBUG - Pod ctest-pod-19478731 not in running state.Currently in Pending 2025-05-28 12:02:59,187 - INFO - Pod ctest-pod-19478731 is in running state.Got IP 10.47.255.244 2025-05-28 12:02:59,241 - DEBUG - Pod ctest-pod-19478731 has vmi ab03956e-3bbb-11f0-9d3f-fa163e3d4579 2025-05-28 12:02:59,241 - INFO - Verified pod ctest-pod-19478731 in contrail-api 2025-05-28 12:02:59,255 - DEBUG - VMI ab03956e-3bbb-11f0-9d3f-fa163e3d4579 is active in agent 10.0.0.22 2025-05-28 12:02:59,256 - INFO - Verified Pod ctest-pod-19478731 in agent 10.0.0.22 2025-05-28 12:02:59,256 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=18d4ab55-9cd8-44c5-9058-389ea2c0b930 2025-05-28 12:02:59,260 - INFO - Pod ctest-pod-19478731 with uuid 18d4ab55-9cd8-44c5-9058-389ea2c0b930 found in kube manager 2025-05-28 12:02:59,260 - INFO - Pod ctest-pod-19478731 verification passed 2025-05-28 12:02:59,260 - INFO - ================================================================================ 2025-05-28 12:02:59,260 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-05-28 12:02:59,261 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-05-28 12:02:59,451 - DEBUG - Nothing to compare xmpp stats {'10.0.0.22': {'10.0.0.33': '0'}} with 2025-05-28 12:02:59,451 - INFO - Initial checks done. Running the testcase now 2025-05-28 12:02:59,451 - INFO - 2025-05-28 12:02:59,507 - DEBUG - [Pod ctest-pod-92702687] Cmd: echo ctest-pod-92702687 > /usr/share/nginx/html/index.html, Output: 2025-05-28 12:02:59,569 - DEBUG - [Pod ctest-pod-97310618] Cmd: echo ctest-pod-97310618 > /usr/share/nginx/html/index.html, Output: 2025-05-28 12:02:59,637 - DEBUG - [Pod ctest-pod-21470543] Cmd: echo ctest-pod-21470543 > /usr/share/nginx/html/index.html, Output: 2025-05-28 12:02:59,695 - DEBUG - [Pod ctest-pod-67173690] Cmd: echo ctest-pod-67173690 > /usr/share/nginx/html/index.html, Output: 2025-05-28 12:02:59,698 - DEBUG - Service ctest-nginx-svc-53431380 not present 2025-05-28 12:02:59,699 - INFO - Creating service ctest-nginx-svc-53431380 2025-05-28 12:02:59,722 - INFO - Created Service ctest-nginx-svc-53431380 2025-05-28 12:02:59,728 - WARNING - Service UUID 49a562d1-b840-4317-90a7-90bbd6a9c38f not yet found in contrail-api 2025-05-28 12:03:00,735 - INFO - Validated that Service ctest-nginx-svc-53431380 is seen in contrail-api 2025-05-28 12:03:00,735 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_LoadbalancerDatabaseList?x=49a562d1-b840-4317-90a7-90bbd6a9c38f 2025-05-28 12:03:00,739 - INFO - Service ctest-nginx-svc-53431380 with uuid 49a562d1-b840-4317-90a7-90bbd6a9c38f found in kube manager 2025-05-28 12:03:00,740 - INFO - Service ctest-nginx-svc-53431380 verification passed 2025-05-28 12:03:01,823 - DEBUG - [Pod ctest-pod-14469393] Cmd: wget http://10.96.21.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.21.33:80 (10.96.21.33:80) writing to stdout - 100% |********************************| ctest-pod-92702687 19 0:00:00 ETA written to stdout 2025-05-28 12:03:01,823 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd wget http://10.96.21.33:80/ -O - -T 5 -t 1 passed 2025-05-28 12:03:01,823 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd output: Connecting to 10.96.21.33:80 (10.96.21.33:80) writing to stdout - 100% |********************************| ctest-pod-92702687 19 0:00:00 ETA written to stdout 2025-05-28 12:03:01,873 - DEBUG - [Pod ctest-pod-14469393] Cmd: wget http://10.96.21.33:80/ -O - -T 5 -t 1 , Output: ctest-pod-97310618 Connecting to 10.96.21.33:80 (10.96.21.33:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-28 12:03:01,873 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd wget http://10.96.21.33:80/ -O - -T 5 -t 1 passed 2025-05-28 12:03:01,873 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd output: ctest-pod-97310618 Connecting to 10.96.21.33:80 (10.96.21.33:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-28 12:03:01,873 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-92702687': 1, 'ctest-pod-97310618': 1} 2025-05-28 12:03:01,931 - DEBUG - [Pod ctest-pod-17467473] Cmd: wget http://10.96.21.33:80/ -O - -T 5 -t 1 , Output: ctest-pod-97310618 Connecting to 10.96.21.33:80 (10.96.21.33:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-28 12:03:01,931 - DEBUG - [Pod Pod ctest-pod-17467473] Cmd wget http://10.96.21.33:80/ -O - -T 5 -t 1 passed 2025-05-28 12:03:01,931 - DEBUG - [Pod Pod ctest-pod-17467473] Cmd output: ctest-pod-97310618 Connecting to 10.96.21.33:80 (10.96.21.33:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-28 12:03:01,984 - DEBUG - [Pod ctest-pod-17467473] Cmd: wget http://10.96.21.33:80/ -O - -T 5 -t 1 , Output: ctest-pod-92702687 Connecting to 10.96.21.33:80 (10.96.21.33:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-28 12:03:01,984 - DEBUG - [Pod Pod ctest-pod-17467473] Cmd wget http://10.96.21.33:80/ -O - -T 5 -t 1 passed 2025-05-28 12:03:01,984 - DEBUG - [Pod Pod ctest-pod-17467473] Cmd output: ctest-pod-92702687 Connecting to 10.96.21.33:80 (10.96.21.33:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-28 12:03:01,984 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-92702687': 1, 'ctest-pod-97310618': 1} 2025-05-28 12:03:01,987 - DEBUG - Network policy ingress-on-service not present 2025-05-28 12:03:01,988 - INFO - Creating Network Policy ingress-on-service 2025-05-28 12:03:02,001 - INFO - Network policy found in k8s 2025-05-28 12:03:02,001 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=4bc65fef-4564-4f2c-98f3-9d9a2c7ad1e6 2025-05-28 12:03:02,008 - INFO - Network Policy ingress-on-service with uuid 4bc65fef-4564-4f2c-98f3-9d9a2c7ad1e6 found in kube manager 2025-05-28 12:03:02,052 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-05-28 12:03:02,052 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-05-28 12:03:02,052 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=4bc65fef-4564-4f2c-98f3-9d9a2c7ad1e6 2025-05-28 12:03:02,083 - WARNING - Network policy with name ingress-on-service not found in agent 2025-05-28 12:03:04,083 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=4bc65fef-4564-4f2c-98f3-9d9a2c7ad1e6 2025-05-28 12:03:04,116 - INFO - Network policy with name ingress-on-service found in agent 2025-05-28 12:03:04,116 - INFO - Network Policy ingress-on-service verification passed 2025-05-28 12:03:09,188 - DEBUG - [Pod ctest-pod-14469393] Cmd: wget http://10.96.21.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:03:09,188 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd wget http://10.96.21.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:03:09,188 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:03:14,249 - DEBUG - [Pod ctest-pod-14469393] Cmd: wget http://10.96.21.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:03:14,249 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd wget http://10.96.21.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:03:14,249 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:03:19,298 - DEBUG - [Pod ctest-pod-14469393] Cmd: wget http://10.96.21.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:03:19,298 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd wget http://10.96.21.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:03:19,298 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:03:24,352 - DEBUG - [Pod ctest-pod-14469393] Cmd: wget http://10.96.21.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:03:24,352 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd wget http://10.96.21.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:03:24,352 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:03:29,403 - DEBUG - [Pod ctest-pod-14469393] Cmd: wget http://10.96.21.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:03:29,403 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd wget http://10.96.21.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:03:29,403 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:03:34,454 - DEBUG - [Pod ctest-pod-14469393] Cmd: wget http://10.96.21.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:03:34,454 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd wget http://10.96.21.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:03:34,454 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:03:39,506 - DEBUG - [Pod ctest-pod-14469393] Cmd: wget http://10.96.21.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:03:39,506 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd wget http://10.96.21.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:03:39,506 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:03:44,566 - DEBUG - [Pod ctest-pod-14469393] Cmd: wget http://10.96.21.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:03:44,566 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd wget http://10.96.21.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:03:44,566 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:03:49,618 - DEBUG - [Pod ctest-pod-14469393] Cmd: wget http://10.96.21.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:03:49,619 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd wget http://10.96.21.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:03:49,619 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:03:54,674 - DEBUG - [Pod ctest-pod-14469393] Cmd: wget http://10.96.21.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:03:54,674 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd wget http://10.96.21.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:03:54,674 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:03:54,674 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-92702687': 0, 'ctest-pod-97310618': 0} 2025-05-28 12:03:54,742 - DEBUG - [Pod ctest-pod-12519907] Cmd: wget http://10.96.21.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.21.33:80 (10.96.21.33:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-97310618 2025-05-28 12:03:54,742 - DEBUG - [Pod Pod ctest-pod-12519907] Cmd wget http://10.96.21.33:80/ -O - -T 5 -t 1 passed 2025-05-28 12:03:54,742 - DEBUG - [Pod Pod ctest-pod-12519907] Cmd output: Connecting to 10.96.21.33:80 (10.96.21.33:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-97310618 2025-05-28 12:03:54,820 - DEBUG - [Pod ctest-pod-12519907] Cmd: wget http://10.96.21.33:80/ -O - -T 5 -t 1 , Output: ctest-pod-97310618 Connecting to 10.96.21.33:80 (10.96.21.33:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-28 12:03:54,821 - DEBUG - [Pod Pod ctest-pod-12519907] Cmd wget http://10.96.21.33:80/ -O - -T 5 -t 1 passed 2025-05-28 12:03:54,821 - DEBUG - [Pod Pod ctest-pod-12519907] Cmd output: ctest-pod-97310618 Connecting to 10.96.21.33:80 (10.96.21.33:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-28 12:03:54,877 - DEBUG - [Pod ctest-pod-12519907] Cmd: wget http://10.96.21.33:80/ -O - -T 5 -t 1 , Output: ctest-pod-92702687 Connecting to 10.96.21.33:80 (10.96.21.33:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-28 12:03:54,877 - DEBUG - [Pod Pod ctest-pod-12519907] Cmd wget http://10.96.21.33:80/ -O - -T 5 -t 1 passed 2025-05-28 12:03:54,877 - DEBUG - [Pod Pod ctest-pod-12519907] Cmd output: ctest-pod-92702687 Connecting to 10.96.21.33:80 (10.96.21.33:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-28 12:03:54,877 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-92702687': 1, 'ctest-pod-97310618': 2} 2025-05-28 12:03:59,930 - DEBUG - [Pod ctest-pod-17467473] Cmd: wget http://10.96.21.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:03:59,931 - DEBUG - [Pod Pod ctest-pod-17467473] Cmd wget http://10.96.21.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:03:59,931 - DEBUG - [Pod Pod ctest-pod-17467473] Cmd output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:04:04,983 - DEBUG - [Pod ctest-pod-17467473] Cmd: wget http://10.96.21.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:04:04,983 - DEBUG - [Pod Pod ctest-pod-17467473] Cmd wget http://10.96.21.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:04:04,983 - DEBUG - [Pod Pod ctest-pod-17467473] Cmd output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:04:10,030 - DEBUG - [Pod ctest-pod-17467473] Cmd: wget http://10.96.21.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:04:10,030 - DEBUG - [Pod Pod ctest-pod-17467473] Cmd wget http://10.96.21.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:04:10,030 - DEBUG - [Pod Pod ctest-pod-17467473] Cmd output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:04:15,078 - DEBUG - [Pod ctest-pod-17467473] Cmd: wget http://10.96.21.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:04:15,078 - DEBUG - [Pod Pod ctest-pod-17467473] Cmd wget http://10.96.21.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:04:15,078 - DEBUG - [Pod Pod ctest-pod-17467473] Cmd output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:04:20,130 - DEBUG - [Pod ctest-pod-17467473] Cmd: wget http://10.96.21.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:04:20,130 - DEBUG - [Pod Pod ctest-pod-17467473] Cmd wget http://10.96.21.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:04:20,130 - DEBUG - [Pod Pod ctest-pod-17467473] Cmd output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:04:25,182 - DEBUG - [Pod ctest-pod-17467473] Cmd: wget http://10.96.21.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:04:25,182 - DEBUG - [Pod Pod ctest-pod-17467473] Cmd wget http://10.96.21.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:04:25,182 - DEBUG - [Pod Pod ctest-pod-17467473] Cmd output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:04:30,234 - DEBUG - [Pod ctest-pod-17467473] Cmd: wget http://10.96.21.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:04:30,235 - DEBUG - [Pod Pod ctest-pod-17467473] Cmd wget http://10.96.21.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:04:30,235 - DEBUG - [Pod Pod ctest-pod-17467473] Cmd output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:04:35,287 - DEBUG - [Pod ctest-pod-17467473] Cmd: wget http://10.96.21.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:04:35,287 - DEBUG - [Pod Pod ctest-pod-17467473] Cmd wget http://10.96.21.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:04:35,287 - DEBUG - [Pod Pod ctest-pod-17467473] Cmd output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:04:40,342 - DEBUG - [Pod ctest-pod-17467473] Cmd: wget http://10.96.21.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:04:40,342 - DEBUG - [Pod Pod ctest-pod-17467473] Cmd wget http://10.96.21.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:04:40,343 - DEBUG - [Pod Pod ctest-pod-17467473] Cmd output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:04:45,394 - DEBUG - [Pod ctest-pod-17467473] Cmd: wget http://10.96.21.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:04:45,395 - DEBUG - [Pod Pod ctest-pod-17467473] Cmd wget http://10.96.21.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:04:45,395 - DEBUG - [Pod Pod ctest-pod-17467473] Cmd output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:04:45,395 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-92702687': 0, 'ctest-pod-97310618': 0} 2025-05-28 12:04:47,442 - DEBUG - [Pod ctest-pod-12519907] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.884 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.061 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.089 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.061/0.344/0.884 ms 2025-05-28 12:04:47,442 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-12519907 with expectation True passed 2025-05-28 12:04:49,494 - DEBUG - [Pod ctest-pod-14469393] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.185 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.073 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.072 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.072/0.443/1.185 ms 2025-05-28 12:04:49,494 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-14469393 with expectation True passed 2025-05-28 12:04:51,542 - DEBUG - [Pod ctest-pod-17467473] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.551 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.086 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.089 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.086/0.242/0.551 ms 2025-05-28 12:04:51,542 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-17467473 with expectation True passed 2025-05-28 12:04:51,597 - DEBUG - [Pod ctest-pod-12519907] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-28 12:04:51,597 - DEBUG - [Pod Pod ctest-pod-12519907] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-05-28 12:04:51,597 - DEBUG - [Pod Pod ctest-pod-12519907] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-28 12:04:51,597 - INFO - wget check of of http://10.47.255.251 from ctest-pod-12519907 passed 2025-05-28 12:04:51,657 - DEBUG - [Pod ctest-pod-12519907] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-28 12:04:51,657 - DEBUG - [Pod Pod ctest-pod-12519907] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-05-28 12:04:51,657 - DEBUG - [Pod Pod ctest-pod-12519907] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-28 12:04:51,657 - INFO - wget check of of http://10.47.255.250 from ctest-pod-12519907 passed 2025-05-28 12:04:56,706 - DEBUG - [Pod ctest-pod-14469393] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-05-28 12:04:56,706 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-05-28 12:04:56,706 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-05-28 12:04:56,706 - INFO - wget check of of http://10.47.255.250 from ctest-pod-14469393 passed 2025-05-28 12:05:01,772 - DEBUG - [Pod ctest-pod-19478731] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-05-28 12:05:01,772 - DEBUG - [Pod Pod ctest-pod-19478731] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-05-28 12:05:01,772 - DEBUG - [Pod Pod ctest-pod-19478731] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-05-28 12:05:01,772 - INFO - wget check of of http://10.47.255.251 from ctest-pod-19478731 passed 2025-05-28 12:05:01,781 - INFO - Updating Network Policy ingress-on-service 2025-05-28 12:05:06,847 - DEBUG - [Pod ctest-pod-14469393] Cmd: wget http://10.96.21.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:05:06,847 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd wget http://10.96.21.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:05:06,847 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:05:11,902 - DEBUG - [Pod ctest-pod-14469393] Cmd: wget http://10.96.21.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:05:11,902 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd wget http://10.96.21.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:05:11,903 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:05:16,963 - DEBUG - [Pod ctest-pod-14469393] Cmd: wget http://10.96.21.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:05:16,963 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd wget http://10.96.21.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:05:16,963 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:05:22,010 - DEBUG - [Pod ctest-pod-14469393] Cmd: wget http://10.96.21.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:05:22,010 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd wget http://10.96.21.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:05:22,010 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:05:27,058 - DEBUG - [Pod ctest-pod-14469393] Cmd: wget http://10.96.21.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:05:27,058 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd wget http://10.96.21.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:05:27,058 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:05:32,112 - DEBUG - [Pod ctest-pod-14469393] Cmd: wget http://10.96.21.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:05:32,113 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd wget http://10.96.21.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:05:32,113 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:05:37,170 - DEBUG - [Pod ctest-pod-14469393] Cmd: wget http://10.96.21.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:05:37,170 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd wget http://10.96.21.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:05:37,170 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:05:42,226 - DEBUG - [Pod ctest-pod-14469393] Cmd: wget http://10.96.21.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:05:42,226 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd wget http://10.96.21.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:05:42,226 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:05:47,278 - DEBUG - [Pod ctest-pod-14469393] Cmd: wget http://10.96.21.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:05:47,278 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd wget http://10.96.21.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:05:47,278 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:05:52,330 - DEBUG - [Pod ctest-pod-14469393] Cmd: wget http://10.96.21.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:05:52,330 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd wget http://10.96.21.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:05:52,330 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd output: Connecting to 10.96.21.33:80 (10.96.21.33:80) wget: download timed out 2025-05-28 12:05:52,330 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-92702687': 0, 'ctest-pod-97310618': 0} 2025-05-28 12:05:52,380 - DEBUG - [Pod ctest-pod-12519907] Cmd: wget http://10.96.21.33:80/ -O - -T 5 -t 1 , Output: ctest-pod-97310618 Connecting to 10.96.21.33:80 (10.96.21.33:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-28 12:05:52,380 - DEBUG - [Pod Pod ctest-pod-12519907] Cmd wget http://10.96.21.33:80/ -O - -T 5 -t 1 passed 2025-05-28 12:05:52,381 - DEBUG - [Pod Pod ctest-pod-12519907] Cmd output: ctest-pod-97310618 Connecting to 10.96.21.33:80 (10.96.21.33:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-28 12:05:52,437 - DEBUG - [Pod ctest-pod-12519907] Cmd: wget http://10.96.21.33:80/ -O - -T 5 -t 1 , Output: ctest-pod-97310618 Connecting to 10.96.21.33:80 (10.96.21.33:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-28 12:05:52,437 - DEBUG - [Pod Pod ctest-pod-12519907] Cmd wget http://10.96.21.33:80/ -O - -T 5 -t 1 passed 2025-05-28 12:05:52,437 - DEBUG - [Pod Pod ctest-pod-12519907] Cmd output: ctest-pod-97310618 Connecting to 10.96.21.33:80 (10.96.21.33:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-28 12:05:52,473 - DEBUG - [Pod ctest-pod-12519907] Cmd: wget http://10.96.21.33:80/ -O - -T 5 -t 1 , Output: ctest-pod-92702687 Connecting to 10.96.21.33:80 (10.96.21.33:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-28 12:05:52,473 - DEBUG - [Pod Pod ctest-pod-12519907] Cmd wget http://10.96.21.33:80/ -O - -T 5 -t 1 passed 2025-05-28 12:05:52,473 - DEBUG - [Pod Pod ctest-pod-12519907] Cmd output: ctest-pod-92702687 Connecting to 10.96.21.33:80 (10.96.21.33:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-28 12:05:52,473 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-92702687': 1, 'ctest-pod-97310618': 2} 2025-05-28 12:05:52,528 - DEBUG - [Pod ctest-pod-17467473] Cmd: wget http://10.96.21.33:80/ -O - -T 5 -t 1 , Output: ctest-pod-92702687 Connecting to 10.96.21.33:80 (10.96.21.33:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-28 12:05:52,528 - DEBUG - [Pod Pod ctest-pod-17467473] Cmd wget http://10.96.21.33:80/ -O - -T 5 -t 1 passed 2025-05-28 12:05:52,528 - DEBUG - [Pod Pod ctest-pod-17467473] Cmd output: ctest-pod-92702687 Connecting to 10.96.21.33:80 (10.96.21.33:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-28 12:05:52,579 - DEBUG - [Pod ctest-pod-17467473] Cmd: wget http://10.96.21.33:80/ -O - -T 5 -t 1 , Output: ctest-pod-97310618 Connecting to 10.96.21.33:80 (10.96.21.33:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-28 12:05:52,579 - DEBUG - [Pod Pod ctest-pod-17467473] Cmd wget http://10.96.21.33:80/ -O - -T 5 -t 1 passed 2025-05-28 12:05:52,579 - DEBUG - [Pod Pod ctest-pod-17467473] Cmd output: ctest-pod-97310618 Connecting to 10.96.21.33:80 (10.96.21.33:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-28 12:05:52,580 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-92702687': 1, 'ctest-pod-97310618': 1} 2025-05-28 12:05:54,644 - DEBUG - [Pod ctest-pod-12519907] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.920 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.077 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.092 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.077/0.363/0.920 ms 2025-05-28 12:05:54,644 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-12519907 with expectation True passed 2025-05-28 12:05:56,690 - DEBUG - [Pod ctest-pod-14469393] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.985 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.090 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.098 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.090/0.391/0.985 ms 2025-05-28 12:05:56,690 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-14469393 with expectation True passed 2025-05-28 12:05:58,738 - DEBUG - [Pod ctest-pod-17467473] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.280 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.073 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.073 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.073/0.475/1.280 ms 2025-05-28 12:05:58,738 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-17467473 with expectation True passed 2025-05-28 12:05:58,804 - DEBUG - [Pod ctest-pod-12519907] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-28 12:05:58,804 - DEBUG - [Pod Pod ctest-pod-12519907] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-05-28 12:05:58,804 - DEBUG - [Pod Pod ctest-pod-12519907] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-28 12:05:58,804 - INFO - wget check of of http://10.47.255.251 from ctest-pod-12519907 passed 2025-05-28 12:05:58,861 - DEBUG - [Pod ctest-pod-12519907] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-28 12:05:58,861 - DEBUG - [Pod Pod ctest-pod-12519907] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-05-28 12:05:58,861 - DEBUG - [Pod Pod ctest-pod-12519907] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-28 12:05:58,861 - INFO - wget check of of http://10.47.255.250 from ctest-pod-12519907 passed 2025-05-28 12:06:03,922 - DEBUG - [Pod ctest-pod-14469393] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-05-28 12:06:03,922 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-05-28 12:06:03,922 - DEBUG - [Pod Pod ctest-pod-14469393] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-05-28 12:06:03,922 - INFO - wget check of of http://10.47.255.250 from ctest-pod-14469393 passed 2025-05-28 12:06:03,976 - DEBUG - [Pod ctest-pod-19478731] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-28 12:06:03,976 - DEBUG - [Pod Pod ctest-pod-19478731] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-05-28 12:06:03,976 - DEBUG - [Pod Pod ctest-pod-19478731] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-28 12:06:03,976 - INFO - wget check of of http://10.47.255.251 from ctest-pod-19478731 passed 2025-05-28 12:06:03,976 - INFO - Deleting Network Policy : ingress-on-service 2025-05-28 12:06:03,977 - INFO - Deleting service : ctest-nginx-svc-53431380 2025-05-28 12:06:04,162 - DEBUG - No XMPP flaps were noticed during the test 2025-05-28 12:06:04,162 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:05] 2025-05-28 12:06:04,162 - INFO - -------------------------------------------------------------------------------- 2025-05-28 12:06:04,167 - INFO - Deleting pod ctest-new-default-01804811:ctest-pod-92702687 2025-05-28 12:06:04,168 - INFO - Deleting pod ctest-new-default-01804811:ctest-pod-97310618 2025-05-28 12:06:04,168 - INFO - Deleting pod ctest-non-default-93054286:ctest-pod-21470543 2025-05-28 12:06:04,169 - INFO - Deleting pod ctest-non-default-93054286:ctest-pod-67173690 2025-05-28 12:06:04,169 - INFO - Deleting pod ctest-new-default-01804811:ctest-pod-14469393 2025-05-28 12:06:04,169 - INFO - Deleting pod ctest-new-default-01804811:ctest-pod-12519907 2025-05-28 12:06:04,170 - INFO - Deleting pod ctest-non-default-93054286:ctest-pod-17467473 2025-05-28 12:06:04,170 - INFO - Deleting pod ctest-non-default-93054286:ctest-pod-19478731 2025-05-28 12:06:04,305 - WARNING - Pod uuid 3e907757-d4c9-4db2-bb16-449c82cd85b2 is still seen in agent 10.0.0.22 VM list 2025-05-28 12:06:04,306 - WARNING - Pod uuid 49cf25cf-94a5-4d80-ba12-93d17a38a5dd is still seen in agent 10.0.0.22 VM list 2025-05-28 12:06:04,307 - WARNING - Pod uuid 67e831f3-5523-4784-b993-a9659a6b98b6 is still seen in agent 10.0.0.22 VM list 2025-05-28 12:06:04,308 - WARNING - Pod uuid e09a3777-1398-46cb-a047-d755ad00f6c4 is still seen in agent 10.0.0.22 VM list 2025-05-28 12:06:04,309 - WARNING - Pod uuid 31703d27-09cd-408b-bd03-62039183aa0e is still seen in agent 10.0.0.22 VM list 2025-05-28 12:06:04,309 - WARNING - Pod uuid 81c41387-58a4-4b3d-a05f-a91f30314370 is still seen in agent 10.0.0.22 VM list 2025-05-28 12:06:04,309 - WARNING - Pod uuid 18d4ab55-9cd8-44c5-9058-389ea2c0b930 is still seen in agent 10.0.0.22 VM list 2025-05-28 12:06:04,309 - WARNING - Pod uuid 44fdb55e-6a58-42ee-85c9-292bd6349bd6 is still seen in agent 10.0.0.22 VM list 2025-05-28 12:06:09,341 - WARNING - Pod uuid 31703d27-09cd-408b-bd03-62039183aa0e is still seen in agent 10.0.0.22 VM list 2025-05-28 12:06:09,341 - DEBUG - Pod e09a3777-1398-46cb-a047-d755ad00f6c4 is not in agent 10.0.0.22 VM list 2025-05-28 12:06:09,343 - DEBUG - Pod 67e831f3-5523-4784-b993-a9659a6b98b6 is not in agent 10.0.0.22 VM list 2025-05-28 12:06:09,347 - WARNING - Pod uuid 44fdb55e-6a58-42ee-85c9-292bd6349bd6 is still seen in agent 10.0.0.22 VM list 2025-05-28 12:06:09,347 - WARNING - Pod uuid 18d4ab55-9cd8-44c5-9058-389ea2c0b930 is still seen in agent 10.0.0.22 VM list 2025-05-28 12:06:09,347 - DEBUG - Pod 81c41387-58a4-4b3d-a05f-a91f30314370 is not in agent 10.0.0.22 VM list 2025-05-28 12:06:09,349 - WARNING - Pod uuid 49cf25cf-94a5-4d80-ba12-93d17a38a5dd is still seen in agent 10.0.0.22 VM list 2025-05-28 12:06:09,349 - DEBUG - Pod 3e907757-d4c9-4db2-bb16-449c82cd85b2 is not in agent 10.0.0.22 VM list 2025-05-28 12:06:09,364 - DEBUG - VMI a7bcf878-3bbb-11f0-9d3f-fa163e3d4579 is removed from agent 10.0.0.22 2025-05-28 12:06:09,364 - INFO - Verified that pod ctest-pod-97310618 is removed in agent 2025-05-28 12:06:09,364 - DEBUG - VMI a86569f4-3bbb-11f0-9d3f-fa163e3d4579 is removed from agent 10.0.0.22 2025-05-28 12:06:09,364 - INFO - Verified that pod ctest-pod-21470543 is removed in agent 2025-05-28 12:06:09,366 - DEBUG - VMI a73459a0-3bbb-11f0-9d3f-fa163e3d4579 is removed from agent 10.0.0.22 2025-05-28 12:06:09,366 - INFO - Verified that pod ctest-pod-92702687 is removed in agent 2025-05-28 12:06:09,366 - DEBUG - VMI a8f56ab8-3bbb-11f0-9d3f-fa163e3d4579 is removed from agent 10.0.0.22 2025-05-28 12:06:09,366 - INFO - Verified that pod ctest-pod-67173690 is removed in agent 2025-05-28 12:06:14,353 - WARNING - Pod uuid 31703d27-09cd-408b-bd03-62039183aa0e is still seen in agent 10.0.0.22 VM list 2025-05-28 12:06:14,361 - WARNING - Pod uuid 44fdb55e-6a58-42ee-85c9-292bd6349bd6 is still seen in agent 10.0.0.22 VM list 2025-05-28 12:06:14,363 - WARNING - Pod uuid 18d4ab55-9cd8-44c5-9058-389ea2c0b930 is still seen in agent 10.0.0.22 VM list 2025-05-28 12:06:14,363 - WARNING - Pod uuid 49cf25cf-94a5-4d80-ba12-93d17a38a5dd is still seen in agent 10.0.0.22 VM list 2025-05-28 12:06:19,362 - WARNING - Pod uuid 31703d27-09cd-408b-bd03-62039183aa0e is still seen in agent 10.0.0.22 VM list 2025-05-28 12:06:19,376 - WARNING - Pod uuid 44fdb55e-6a58-42ee-85c9-292bd6349bd6 is still seen in agent 10.0.0.22 VM list 2025-05-28 12:06:19,378 - WARNING - Pod uuid 18d4ab55-9cd8-44c5-9058-389ea2c0b930 is still seen in agent 10.0.0.22 VM list 2025-05-28 12:06:19,379 - WARNING - Pod uuid 49cf25cf-94a5-4d80-ba12-93d17a38a5dd is still seen in agent 10.0.0.22 VM list 2025-05-28 12:06:24,372 - WARNING - Pod uuid 31703d27-09cd-408b-bd03-62039183aa0e is still seen in agent 10.0.0.22 VM list 2025-05-28 12:06:24,393 - WARNING - Pod uuid 44fdb55e-6a58-42ee-85c9-292bd6349bd6 is still seen in agent 10.0.0.22 VM list 2025-05-28 12:06:24,394 - WARNING - Pod uuid 49cf25cf-94a5-4d80-ba12-93d17a38a5dd is still seen in agent 10.0.0.22 VM list 2025-05-28 12:06:24,394 - WARNING - Pod uuid 18d4ab55-9cd8-44c5-9058-389ea2c0b930 is still seen in agent 10.0.0.22 VM list 2025-05-28 12:06:29,381 - WARNING - Pod uuid 31703d27-09cd-408b-bd03-62039183aa0e is still seen in agent 10.0.0.22 VM list 2025-05-28 12:06:29,407 - WARNING - Pod uuid 44fdb55e-6a58-42ee-85c9-292bd6349bd6 is still seen in agent 10.0.0.22 VM list 2025-05-28 12:06:29,408 - WARNING - Pod uuid 18d4ab55-9cd8-44c5-9058-389ea2c0b930 is still seen in agent 10.0.0.22 VM list 2025-05-28 12:06:29,408 - WARNING - Pod uuid 49cf25cf-94a5-4d80-ba12-93d17a38a5dd is still seen in agent 10.0.0.22 VM list 2025-05-28 12:06:34,406 - WARNING - Pod uuid 31703d27-09cd-408b-bd03-62039183aa0e is still seen in agent 10.0.0.22 VM list 2025-05-28 12:06:34,422 - WARNING - Pod uuid 44fdb55e-6a58-42ee-85c9-292bd6349bd6 is still seen in agent 10.0.0.22 VM list 2025-05-28 12:06:34,423 - WARNING - Pod uuid 49cf25cf-94a5-4d80-ba12-93d17a38a5dd is still seen in agent 10.0.0.22 VM list 2025-05-28 12:06:34,424 - WARNING - Pod uuid 18d4ab55-9cd8-44c5-9058-389ea2c0b930 is still seen in agent 10.0.0.22 VM list 2025-05-28 12:06:39,413 - DEBUG - Pod 31703d27-09cd-408b-bd03-62039183aa0e is not in agent 10.0.0.22 VM list 2025-05-28 12:06:39,419 - DEBUG - VMI aa12c2e2-3bbb-11f0-9d3f-fa163e3d4579 is removed from agent 10.0.0.22 2025-05-28 12:06:39,419 - INFO - Verified that pod ctest-pod-12519907 is removed in agent 2025-05-28 12:06:39,436 - DEBUG - Pod 44fdb55e-6a58-42ee-85c9-292bd6349bd6 is not in agent 10.0.0.22 VM list 2025-05-28 12:06:39,439 - DEBUG - Pod 49cf25cf-94a5-4d80-ba12-93d17a38a5dd is not in agent 10.0.0.22 VM list 2025-05-28 12:06:39,441 - DEBUG - Pod 18d4ab55-9cd8-44c5-9058-389ea2c0b930 is not in agent 10.0.0.22 VM list 2025-05-28 12:06:39,451 - DEBUG - VMI a99fbe96-3bbb-11f0-9d3f-fa163e3d4579 is removed from agent 10.0.0.22 2025-05-28 12:06:39,451 - INFO - Verified that pod ctest-pod-14469393 is removed in agent 2025-05-28 12:06:39,453 - DEBUG - VMI ab03956e-3bbb-11f0-9d3f-fa163e3d4579 is removed from agent 10.0.0.22 2025-05-28 12:06:39,453 - INFO - Verified that pod ctest-pod-19478731 is removed in agent 2025-05-28 12:06:39,453 - DEBUG - VMI aa8b2f98-3bbb-11f0-9d3f-fa163e3d4579 is removed from agent 10.0.0.22 2025-05-28 12:06:39,453 - INFO - Verified that pod ctest-pod-17467473 is removed in agent 2025-05-28 12:06:39,453 - INFO - Deleting namespace ctest-non-default-93054286 2025-05-28 12:06:39,462 - DEBUG - Namespace ctest-non-default-93054286 still in k8s 2025-05-28 12:06:41,467 - DEBUG - Namespace ctest-non-default-93054286 still in k8s 2025-05-28 12:06:43,471 - DEBUG - Namespace ctest-non-default-93054286 still in k8s 2025-05-28 12:06:45,475 - DEBUG - Namespace ctest-non-default-93054286 is not in k8s 2025-05-28 12:06:45,475 - DEBUG - No need to check project deletion in contrail-api 2025-05-28 12:06:45,475 - INFO - Deleting namespace ctest-new-default-01804811 2025-05-28 12:06:45,485 - DEBUG - Namespace ctest-new-default-01804811 still in k8s 2025-05-28 12:06:47,489 - DEBUG - Namespace ctest-new-default-01804811 still in k8s 2025-05-28 12:06:49,494 - DEBUG - Namespace ctest-new-default-01804811 still in k8s 2025-05-28 12:06:51,498 - DEBUG - Namespace ctest-new-default-01804811 is not in k8s 2025-05-28 12:06:51,498 - DEBUG - No need to check project deletion in contrail-api