2025-05-30 13:51:18,571 - INFO - Using existing project ['default-domain', 'k8s-default'](3ea72ffd-9e81-4532-81fd-383d0af59f77) 2025-05-30 13:51:18,593 - DEBUG - Namespace ctest-new-default-05536182 not present 2025-05-30 13:51:18,614 - INFO - Created namespace ctest-new-default-05536182 2025-05-30 13:51:21,619 - DEBUG - Namespace ctest-non-default-64706789 not present 2025-05-30 13:51:21,627 - INFO - Created namespace ctest-non-default-64706789 2025-05-30 13:51:24,643 - DEBUG - Pod ctest-pod-05597587 not present 2025-05-30 13:51:24,643 - INFO - Creating Pod ctest-pod-05597587 2025-05-30 13:51:24,680 - DEBUG - Pod : ctest-pod-05597587 UUID is 0f037c10-9f9f-4116-a2ff-411bbaa2b148 2025-05-30 13:51:24,682 - DEBUG - Pod ctest-pod-81698967 not present 2025-05-30 13:51:24,683 - INFO - Creating Pod ctest-pod-81698967 2025-05-30 13:51:24,721 - DEBUG - Pod : ctest-pod-81698967 UUID is e3ddfc63-454c-493a-9a18-d709ab464321 2025-05-30 13:51:24,723 - DEBUG - Pod ctest-pod-72187954 not present 2025-05-30 13:51:24,723 - INFO - Creating Pod ctest-pod-72187954 2025-05-30 13:51:24,747 - DEBUG - Pod : ctest-pod-72187954 UUID is 26fe40c2-a89f-4186-96e7-ce97fbdb557d 2025-05-30 13:51:24,752 - DEBUG - Pod ctest-pod-73956025 not present 2025-05-30 13:51:24,752 - INFO - Creating Pod ctest-pod-73956025 2025-05-30 13:51:24,768 - DEBUG - Pod : ctest-pod-73956025 UUID is b37c4aff-3efa-48a1-a35f-269f69e7cff5 2025-05-30 13:51:24,773 - DEBUG - Pod ctest-pod-85096095 not present 2025-05-30 13:51:24,773 - INFO - Creating Pod ctest-pod-85096095 2025-05-30 13:51:24,788 - DEBUG - Pod : ctest-pod-85096095 UUID is e656dc4f-106c-45d2-a215-f33d1ad067cd 2025-05-30 13:51:24,790 - DEBUG - Pod ctest-pod-35647212 not present 2025-05-30 13:51:24,790 - INFO - Creating Pod ctest-pod-35647212 2025-05-30 13:51:24,806 - DEBUG - Pod : ctest-pod-35647212 UUID is b2ea7d02-2095-4c74-963f-296187a12328 2025-05-30 13:51:24,808 - DEBUG - Pod ctest-pod-56526389 not present 2025-05-30 13:51:24,808 - INFO - Creating Pod ctest-pod-56526389 2025-05-30 13:51:24,827 - DEBUG - Pod : ctest-pod-56526389 UUID is 5e11258a-f3ff-4bf0-b25b-4d02b44e96bd 2025-05-30 13:51:24,830 - DEBUG - Pod ctest-pod-90466976 not present 2025-05-30 13:51:24,830 - INFO - Creating Pod ctest-pod-90466976 2025-05-30 13:51:24,846 - DEBUG - Pod : ctest-pod-90466976 UUID is ebd32376-768e-4fcc-ae75-fc01ef76f64b 2025-05-30 13:51:25,019 - INFO - Project default-domain:k8s-ctest-new-default-05536182 for Namespace ctest-new-default-05536182 is seen in contrail-api 2025-05-30 13:51:25,019 - DEBUG - Project uuid in Contrail is f47ec3cb-e667-45d2-a14d-d10476869b35 2025-05-30 13:51:25,147 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NamespaceDatabaseList?namespace_uuid=1f48c001-7e0c-4bdf-a129-6a8e01f8b3d8 2025-05-30 13:51:25,152 - INFO - Namespace ctest-new-default-05536182 with uuid 1f48c001-7e0c-4bdf-a129-6a8e01f8b3d8 found in kube manager 2025-05-30 13:51:25,152 - INFO - Namespace ctest-new-default-05536182 verification passed 2025-05-30 13:51:25,424 - INFO - Project default-domain:k8s-ctest-non-default-64706789 for Namespace ctest-non-default-64706789 is seen in contrail-api 2025-05-30 13:51:25,424 - DEBUG - Project uuid in Contrail is cc337069-f856-4bdb-b0f0-d4d69e1db265 2025-05-30 13:51:25,424 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NamespaceDatabaseList?namespace_uuid=2af05366-fad1-425b-a8ad-35e6511205de 2025-05-30 13:51:25,429 - INFO - Namespace ctest-non-default-64706789 with uuid 2af05366-fad1-425b-a8ad-35e6511205de found in kube manager 2025-05-30 13:51:25,429 - INFO - Namespace ctest-non-default-64706789 verification passed 2025-05-30 13:51:25,436 - DEBUG - Pod ctest-pod-05597587 not in running state.Currently in Pending 2025-05-30 13:51:30,443 - DEBUG - Pod ctest-pod-05597587 not in running state.Currently in Pending 2025-05-30 13:51:35,452 - INFO - Pod ctest-pod-05597587 is in running state.Got IP 10.47.255.251 2025-05-30 13:51:35,469 - DEBUG - Pod ctest-pod-05597587 has vmi 2e2b5128-3d5d-11f0-b9a7-fa163e2b2ee1 2025-05-30 13:51:35,469 - INFO - Verified pod ctest-pod-05597587 in contrail-api 2025-05-30 13:51:35,483 - DEBUG - VMI 2e2b5128-3d5d-11f0-b9a7-fa163e2b2ee1 is active in agent 10.0.0.49 2025-05-30 13:51:35,484 - INFO - Verified Pod ctest-pod-05597587 in agent 10.0.0.49 2025-05-30 13:51:35,484 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=0f037c10-9f9f-4116-a2ff-411bbaa2b148 2025-05-30 13:51:35,489 - INFO - Pod ctest-pod-05597587 with uuid 0f037c10-9f9f-4116-a2ff-411bbaa2b148 found in kube manager 2025-05-30 13:51:35,489 - INFO - Pod ctest-pod-05597587 verification passed 2025-05-30 13:51:35,495 - INFO - Pod ctest-pod-81698967 is in running state.Got IP 10.47.255.250 2025-05-30 13:51:35,556 - DEBUG - Pod ctest-pod-81698967 has vmi 2eaa8678-3d5d-11f0-b9a7-fa163e2b2ee1 2025-05-30 13:51:35,556 - INFO - Verified pod ctest-pod-81698967 in contrail-api 2025-05-30 13:51:35,568 - DEBUG - VMI 2eaa8678-3d5d-11f0-b9a7-fa163e2b2ee1 is active in agent 10.0.0.49 2025-05-30 13:51:35,568 - INFO - Verified Pod ctest-pod-81698967 in agent 10.0.0.49 2025-05-30 13:51:35,568 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=e3ddfc63-454c-493a-9a18-d709ab464321 2025-05-30 13:51:35,573 - INFO - Pod ctest-pod-81698967 with uuid e3ddfc63-454c-493a-9a18-d709ab464321 found in kube manager 2025-05-30 13:51:35,573 - INFO - Pod ctest-pod-81698967 verification passed 2025-05-30 13:51:35,578 - DEBUG - Pod ctest-pod-72187954 not in running state.Currently in Pending 2025-05-30 13:51:40,585 - INFO - Pod ctest-pod-72187954 is in running state.Got IP 10.47.255.249 2025-05-30 13:51:40,599 - DEBUG - Pod ctest-pod-72187954 has vmi 2f640d8c-3d5d-11f0-b9a7-fa163e2b2ee1 2025-05-30 13:51:40,599 - INFO - Verified pod ctest-pod-72187954 in contrail-api 2025-05-30 13:51:40,613 - DEBUG - VMI 2f640d8c-3d5d-11f0-b9a7-fa163e2b2ee1 is active in agent 10.0.0.49 2025-05-30 13:51:40,613 - INFO - Verified Pod ctest-pod-72187954 in agent 10.0.0.49 2025-05-30 13:51:40,613 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=26fe40c2-a89f-4186-96e7-ce97fbdb557d 2025-05-30 13:51:40,618 - INFO - Pod ctest-pod-72187954 with uuid 26fe40c2-a89f-4186-96e7-ce97fbdb557d found in kube manager 2025-05-30 13:51:40,618 - INFO - Pod ctest-pod-72187954 verification passed 2025-05-30 13:51:40,625 - INFO - Pod ctest-pod-73956025 is in running state.Got IP 10.47.255.248 2025-05-30 13:51:40,680 - DEBUG - Pod ctest-pod-73956025 has vmi 2fdea1dc-3d5d-11f0-b9a7-fa163e2b2ee1 2025-05-30 13:51:40,680 - INFO - Verified pod ctest-pod-73956025 in contrail-api 2025-05-30 13:51:40,695 - DEBUG - VMI 2fdea1dc-3d5d-11f0-b9a7-fa163e2b2ee1 is active in agent 10.0.0.49 2025-05-30 13:51:40,696 - INFO - Verified Pod ctest-pod-73956025 in agent 10.0.0.49 2025-05-30 13:51:40,696 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=b37c4aff-3efa-48a1-a35f-269f69e7cff5 2025-05-30 13:51:40,700 - INFO - Pod ctest-pod-73956025 with uuid b37c4aff-3efa-48a1-a35f-269f69e7cff5 found in kube manager 2025-05-30 13:51:40,701 - INFO - Pod ctest-pod-73956025 verification passed 2025-05-30 13:51:40,706 - DEBUG - Pod ctest-pod-85096095 not in running state.Currently in Pending 2025-05-30 13:51:45,713 - INFO - Pod ctest-pod-85096095 is in running state.Got IP 10.47.255.247 2025-05-30 13:51:45,727 - DEBUG - Pod ctest-pod-85096095 has vmi 306d8f64-3d5d-11f0-b9a7-fa163e2b2ee1 2025-05-30 13:51:45,728 - INFO - Verified pod ctest-pod-85096095 in contrail-api 2025-05-30 13:51:45,741 - DEBUG - VMI 306d8f64-3d5d-11f0-b9a7-fa163e2b2ee1 is active in agent 10.0.0.49 2025-05-30 13:51:45,741 - INFO - Verified Pod ctest-pod-85096095 in agent 10.0.0.49 2025-05-30 13:51:45,741 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=e656dc4f-106c-45d2-a215-f33d1ad067cd 2025-05-30 13:51:45,746 - INFO - Pod ctest-pod-85096095 with uuid e656dc4f-106c-45d2-a215-f33d1ad067cd found in kube manager 2025-05-30 13:51:45,746 - INFO - Pod ctest-pod-85096095 verification passed 2025-05-30 13:51:45,751 - INFO - Pod ctest-pod-56526389 is in running state.Got IP 10.47.255.245 2025-05-30 13:51:45,804 - DEBUG - Pod ctest-pod-56526389 has vmi 3160d958-3d5d-11f0-b9a7-fa163e2b2ee1 2025-05-30 13:51:45,804 - INFO - Verified pod ctest-pod-56526389 in contrail-api 2025-05-30 13:51:45,818 - DEBUG - VMI 3160d958-3d5d-11f0-b9a7-fa163e2b2ee1 is active in agent 10.0.0.49 2025-05-30 13:51:45,818 - INFO - Verified Pod ctest-pod-56526389 in agent 10.0.0.49 2025-05-30 13:51:45,819 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=5e11258a-f3ff-4bf0-b25b-4d02b44e96bd 2025-05-30 13:51:45,823 - INFO - Pod ctest-pod-56526389 with uuid 5e11258a-f3ff-4bf0-b25b-4d02b44e96bd found in kube manager 2025-05-30 13:51:45,823 - INFO - Pod ctest-pod-56526389 verification passed 2025-05-30 13:51:45,894 - INFO - Pod ctest-pod-35647212 is in running state.Got IP 10.47.255.246 2025-05-30 13:51:45,908 - DEBUG - Pod ctest-pod-35647212 has vmi 30e541da-3d5d-11f0-b9a7-fa163e2b2ee1 2025-05-30 13:51:45,908 - INFO - Verified pod ctest-pod-35647212 in contrail-api 2025-05-30 13:51:45,922 - DEBUG - VMI 30e541da-3d5d-11f0-b9a7-fa163e2b2ee1 is active in agent 10.0.0.49 2025-05-30 13:51:45,923 - INFO - Verified Pod ctest-pod-35647212 in agent 10.0.0.49 2025-05-30 13:51:45,923 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=b2ea7d02-2095-4c74-963f-296187a12328 2025-05-30 13:51:45,929 - INFO - Pod ctest-pod-35647212 with uuid b2ea7d02-2095-4c74-963f-296187a12328 found in kube manager 2025-05-30 13:51:45,929 - INFO - Pod ctest-pod-35647212 verification passed 2025-05-30 13:51:45,934 - INFO - Pod ctest-pod-90466976 is in running state.Got IP 10.47.255.244 2025-05-30 13:51:45,992 - DEBUG - Pod ctest-pod-90466976 has vmi 31dadc94-3d5d-11f0-b9a7-fa163e2b2ee1 2025-05-30 13:51:45,992 - INFO - Verified pod ctest-pod-90466976 in contrail-api 2025-05-30 13:51:46,005 - DEBUG - VMI 31dadc94-3d5d-11f0-b9a7-fa163e2b2ee1 is active in agent 10.0.0.49 2025-05-30 13:51:46,005 - INFO - Verified Pod ctest-pod-90466976 in agent 10.0.0.49 2025-05-30 13:51:46,005 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=ebd32376-768e-4fcc-ae75-fc01ef76f64b 2025-05-30 13:51:46,010 - INFO - Pod ctest-pod-90466976 with uuid ebd32376-768e-4fcc-ae75-fc01ef76f64b found in kube manager 2025-05-30 13:51:46,010 - INFO - Pod ctest-pod-90466976 verification passed 2025-05-30 13:51:46,010 - INFO - ================================================================================ 2025-05-30 13:51:46,010 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-05-30 13:51:46,010 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-05-30 13:51:46,242 - DEBUG - Nothing to compare xmpp stats {'10.0.0.49': {'10.0.0.48': '0'}} with 2025-05-30 13:51:46,242 - INFO - Initial checks done. Running the testcase now 2025-05-30 13:51:46,242 - INFO - 2025-05-30 13:51:46,303 - DEBUG - [Pod ctest-pod-05597587] Cmd: echo ctest-pod-05597587 > /usr/share/nginx/html/index.html, Output: 2025-05-30 13:51:46,358 - DEBUG - [Pod ctest-pod-81698967] Cmd: echo ctest-pod-81698967 > /usr/share/nginx/html/index.html, Output: 2025-05-30 13:51:46,412 - DEBUG - [Pod ctest-pod-72187954] Cmd: echo ctest-pod-72187954 > /usr/share/nginx/html/index.html, Output: 2025-05-30 13:51:46,466 - DEBUG - [Pod ctest-pod-73956025] Cmd: echo ctest-pod-73956025 > /usr/share/nginx/html/index.html, Output: 2025-05-30 13:51:46,468 - DEBUG - Service ctest-nginx-svc-02664517 not present 2025-05-30 13:51:46,468 - INFO - Creating service ctest-nginx-svc-02664517 2025-05-30 13:51:46,479 - INFO - Created Service ctest-nginx-svc-02664517 2025-05-30 13:51:46,493 - WARNING - Service UUID dd390454-0b0c-4416-a2a4-ade07e55f3d6 not yet found in contrail-api 2025-05-30 13:51:47,503 - INFO - Validated that Service ctest-nginx-svc-02664517 is seen in contrail-api 2025-05-30 13:51:47,503 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_LoadbalancerDatabaseList?x=dd390454-0b0c-4416-a2a4-ade07e55f3d6 2025-05-30 13:51:47,508 - INFO - Service ctest-nginx-svc-02664517 with uuid dd390454-0b0c-4416-a2a4-ade07e55f3d6 found in kube manager 2025-05-30 13:51:47,508 - INFO - Service ctest-nginx-svc-02664517 verification passed 2025-05-30 13:51:48,571 - DEBUG - [Pod ctest-pod-85096095] Cmd: wget http://10.110.200.35:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.200.35:80 (10.110.200.35:80) ctest-pod-05597587 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-30 13:51:48,571 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd wget http://10.110.200.35:80/ -O - -T 5 -t 1 passed 2025-05-30 13:51:48,571 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd output: Connecting to 10.110.200.35:80 (10.110.200.35:80) ctest-pod-05597587 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-30 13:51:48,624 - DEBUG - [Pod ctest-pod-85096095] Cmd: wget http://10.110.200.35:80/ -O - -T 5 -t 1 , Output: ctest-pod-81698967 Connecting to 10.110.200.35:80 (10.110.200.35:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-30 13:51:48,624 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd wget http://10.110.200.35:80/ -O - -T 5 -t 1 passed 2025-05-30 13:51:48,624 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd output: ctest-pod-81698967 Connecting to 10.110.200.35:80 (10.110.200.35:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-30 13:51:48,624 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-05597587': 1, 'ctest-pod-81698967': 1} 2025-05-30 13:51:48,674 - DEBUG - [Pod ctest-pod-56526389] Cmd: wget http://10.110.200.35:80/ -O - -T 5 -t 1 , Output: ctest-pod-81698967 Connecting to 10.110.200.35:80 (10.110.200.35:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-30 13:51:48,675 - DEBUG - [Pod Pod ctest-pod-56526389] Cmd wget http://10.110.200.35:80/ -O - -T 5 -t 1 passed 2025-05-30 13:51:48,675 - DEBUG - [Pod Pod ctest-pod-56526389] Cmd output: ctest-pod-81698967 Connecting to 10.110.200.35:80 (10.110.200.35:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-30 13:51:48,739 - DEBUG - [Pod ctest-pod-56526389] Cmd: wget http://10.110.200.35:80/ -O - -T 5 -t 1 , Output: ctest-pod-81698967 Connecting to 10.110.200.35:80 (10.110.200.35:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-30 13:51:48,739 - DEBUG - [Pod Pod ctest-pod-56526389] Cmd wget http://10.110.200.35:80/ -O - -T 5 -t 1 passed 2025-05-30 13:51:48,739 - DEBUG - [Pod Pod ctest-pod-56526389] Cmd output: ctest-pod-81698967 Connecting to 10.110.200.35:80 (10.110.200.35:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-30 13:51:48,793 - DEBUG - [Pod ctest-pod-56526389] Cmd: wget http://10.110.200.35:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.200.35:80 (10.110.200.35:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-05597587 2025-05-30 13:51:48,793 - DEBUG - [Pod Pod ctest-pod-56526389] Cmd wget http://10.110.200.35:80/ -O - -T 5 -t 1 passed 2025-05-30 13:51:48,793 - DEBUG - [Pod Pod ctest-pod-56526389] Cmd output: Connecting to 10.110.200.35:80 (10.110.200.35:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-05597587 2025-05-30 13:51:48,793 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-05597587': 1, 'ctest-pod-81698967': 2} 2025-05-30 13:51:48,796 - DEBUG - Network policy ingress-on-service not present 2025-05-30 13:51:48,796 - INFO - Creating Network Policy ingress-on-service 2025-05-30 13:51:48,807 - INFO - Network policy found in k8s 2025-05-30 13:51:48,807 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=e0043619-8b8b-481a-9228-6e84857c7390 2025-05-30 13:51:48,814 - INFO - Network Policy ingress-on-service with uuid e0043619-8b8b-481a-9228-6e84857c7390 found in kube manager 2025-05-30 13:51:48,851 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-05-30 13:51:48,851 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-05-30 13:51:48,852 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=e0043619-8b8b-481a-9228-6e84857c7390 2025-05-30 13:51:48,881 - WARNING - Network policy with name ingress-on-service not found in agent 2025-05-30 13:51:50,882 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=e0043619-8b8b-481a-9228-6e84857c7390 2025-05-30 13:51:50,913 - INFO - Network policy with name ingress-on-service found in agent 2025-05-30 13:51:50,913 - INFO - Network Policy ingress-on-service verification passed 2025-05-30 13:51:55,966 - DEBUG - [Pod ctest-pod-85096095] Cmd: wget http://10.110.200.35:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:51:55,967 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd wget http://10.110.200.35:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:51:55,967 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:52:01,026 - DEBUG - [Pod ctest-pod-85096095] Cmd: wget http://10.110.200.35:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:52:01,026 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd wget http://10.110.200.35:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:52:01,026 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:52:06,083 - DEBUG - [Pod ctest-pod-85096095] Cmd: wget http://10.110.200.35:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:52:06,083 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd wget http://10.110.200.35:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:52:06,083 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:52:11,139 - DEBUG - [Pod ctest-pod-85096095] Cmd: wget http://10.110.200.35:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:52:11,139 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd wget http://10.110.200.35:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:52:11,139 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:52:16,204 - DEBUG - [Pod ctest-pod-85096095] Cmd: wget http://10.110.200.35:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:52:16,204 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd wget http://10.110.200.35:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:52:16,204 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:52:21,268 - DEBUG - [Pod ctest-pod-85096095] Cmd: wget http://10.110.200.35:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:52:21,268 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd wget http://10.110.200.35:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:52:21,268 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:52:26,322 - DEBUG - [Pod ctest-pod-85096095] Cmd: wget http://10.110.200.35:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:52:26,322 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd wget http://10.110.200.35:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:52:26,322 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:52:31,362 - DEBUG - [Pod ctest-pod-85096095] Cmd: wget http://10.110.200.35:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:52:31,363 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd wget http://10.110.200.35:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:52:31,363 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:52:36,415 - DEBUG - [Pod ctest-pod-85096095] Cmd: wget http://10.110.200.35:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:52:36,415 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd wget http://10.110.200.35:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:52:36,415 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:52:41,478 - DEBUG - [Pod ctest-pod-85096095] Cmd: wget http://10.110.200.35:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:52:41,479 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd wget http://10.110.200.35:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:52:41,479 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:52:41,479 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-05597587': 0, 'ctest-pod-81698967': 0} 2025-05-30 13:52:41,546 - DEBUG - [Pod ctest-pod-35647212] Cmd: wget http://10.110.200.35:80/ -O - -T 5 -t 1 , Output: ctest-pod-05597587 Connecting to 10.110.200.35:80 (10.110.200.35:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-30 13:52:41,546 - DEBUG - [Pod Pod ctest-pod-35647212] Cmd wget http://10.110.200.35:80/ -O - -T 5 -t 1 passed 2025-05-30 13:52:41,546 - DEBUG - [Pod Pod ctest-pod-35647212] Cmd output: ctest-pod-05597587 Connecting to 10.110.200.35:80 (10.110.200.35:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-30 13:52:41,604 - DEBUG - [Pod ctest-pod-35647212] Cmd: wget http://10.110.200.35:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.200.35:80 (10.110.200.35:80) ctest-pod-05597587 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-30 13:52:41,604 - DEBUG - [Pod Pod ctest-pod-35647212] Cmd wget http://10.110.200.35:80/ -O - -T 5 -t 1 passed 2025-05-30 13:52:41,605 - DEBUG - [Pod Pod ctest-pod-35647212] Cmd output: Connecting to 10.110.200.35:80 (10.110.200.35:80) ctest-pod-05597587 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-30 13:52:41,663 - DEBUG - [Pod ctest-pod-35647212] Cmd: wget http://10.110.200.35:80/ -O - -T 5 -t 1 , Output: ctest-pod-81698967 Connecting to 10.110.200.35:80 (10.110.200.35:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-30 13:52:41,663 - DEBUG - [Pod Pod ctest-pod-35647212] Cmd wget http://10.110.200.35:80/ -O - -T 5 -t 1 passed 2025-05-30 13:52:41,663 - DEBUG - [Pod Pod ctest-pod-35647212] Cmd output: ctest-pod-81698967 Connecting to 10.110.200.35:80 (10.110.200.35:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-30 13:52:41,663 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-05597587': 2, 'ctest-pod-81698967': 1} 2025-05-30 13:52:46,722 - DEBUG - [Pod ctest-pod-56526389] Cmd: wget http://10.110.200.35:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:52:46,722 - DEBUG - [Pod Pod ctest-pod-56526389] Cmd wget http://10.110.200.35:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:52:46,722 - DEBUG - [Pod Pod ctest-pod-56526389] Cmd output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:52:51,774 - DEBUG - [Pod ctest-pod-56526389] Cmd: wget http://10.110.200.35:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:52:51,775 - DEBUG - [Pod Pod ctest-pod-56526389] Cmd wget http://10.110.200.35:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:52:51,775 - DEBUG - [Pod Pod ctest-pod-56526389] Cmd output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:52:56,826 - DEBUG - [Pod ctest-pod-56526389] Cmd: wget http://10.110.200.35:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:52:56,827 - DEBUG - [Pod Pod ctest-pod-56526389] Cmd wget http://10.110.200.35:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:52:56,827 - DEBUG - [Pod Pod ctest-pod-56526389] Cmd output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:53:01,872 - DEBUG - [Pod ctest-pod-56526389] Cmd: wget http://10.110.200.35:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:53:01,873 - DEBUG - [Pod Pod ctest-pod-56526389] Cmd wget http://10.110.200.35:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:53:01,873 - DEBUG - [Pod Pod ctest-pod-56526389] Cmd output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:53:06,922 - DEBUG - [Pod ctest-pod-56526389] Cmd: wget http://10.110.200.35:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:53:06,922 - DEBUG - [Pod Pod ctest-pod-56526389] Cmd wget http://10.110.200.35:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:53:06,922 - DEBUG - [Pod Pod ctest-pod-56526389] Cmd output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:53:11,978 - DEBUG - [Pod ctest-pod-56526389] Cmd: wget http://10.110.200.35:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:53:11,979 - DEBUG - [Pod Pod ctest-pod-56526389] Cmd wget http://10.110.200.35:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:53:11,979 - DEBUG - [Pod Pod ctest-pod-56526389] Cmd output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:53:17,034 - DEBUG - [Pod ctest-pod-56526389] Cmd: wget http://10.110.200.35:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:53:17,034 - DEBUG - [Pod Pod ctest-pod-56526389] Cmd wget http://10.110.200.35:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:53:17,034 - DEBUG - [Pod Pod ctest-pod-56526389] Cmd output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:53:22,090 - DEBUG - [Pod ctest-pod-56526389] Cmd: wget http://10.110.200.35:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:53:22,090 - DEBUG - [Pod Pod ctest-pod-56526389] Cmd wget http://10.110.200.35:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:53:22,090 - DEBUG - [Pod Pod ctest-pod-56526389] Cmd output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:53:27,144 - DEBUG - [Pod ctest-pod-56526389] Cmd: wget http://10.110.200.35:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:53:27,144 - DEBUG - [Pod Pod ctest-pod-56526389] Cmd wget http://10.110.200.35:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:53:27,144 - DEBUG - [Pod Pod ctest-pod-56526389] Cmd output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:53:32,195 - DEBUG - [Pod ctest-pod-56526389] Cmd: wget http://10.110.200.35:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:53:32,195 - DEBUG - [Pod Pod ctest-pod-56526389] Cmd wget http://10.110.200.35:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:53:32,195 - DEBUG - [Pod Pod ctest-pod-56526389] Cmd output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:53:32,195 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-05597587': 0, 'ctest-pod-81698967': 0} 2025-05-30 13:53:34,247 - DEBUG - [Pod ctest-pod-35647212] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.511 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.058 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.082 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.058/0.550/1.511 ms 2025-05-30 13:53:34,247 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-35647212 with expectation True passed 2025-05-30 13:53:36,300 - DEBUG - [Pod ctest-pod-85096095] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.517 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.073 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.074 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.073/0.221/0.517 ms 2025-05-30 13:53:36,300 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-85096095 with expectation True passed 2025-05-30 13:53:38,364 - DEBUG - [Pod ctest-pod-56526389] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.822 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.089 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.072 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.072/0.327/0.822 ms 2025-05-30 13:53:38,364 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-56526389 with expectation True passed 2025-05-30 13:53:38,419 - DEBUG - [Pod ctest-pod-35647212] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-30 13:53:38,420 - DEBUG - [Pod Pod ctest-pod-35647212] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-05-30 13:53:38,420 - DEBUG - [Pod Pod ctest-pod-35647212] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-30 13:53:38,420 - INFO - wget check of of http://10.47.255.251 from ctest-pod-35647212 passed 2025-05-30 13:53:38,468 - DEBUG - [Pod ctest-pod-35647212] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-30 13:53:38,468 - DEBUG - [Pod Pod ctest-pod-35647212] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-05-30 13:53:38,468 - DEBUG - [Pod Pod ctest-pod-35647212] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-30 13:53:38,468 - INFO - wget check of of http://10.47.255.250 from ctest-pod-35647212 passed 2025-05-30 13:53:43,524 - DEBUG - [Pod ctest-pod-85096095] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-05-30 13:53:43,524 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-05-30 13:53:43,524 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-05-30 13:53:43,524 - INFO - wget check of of http://10.47.255.250 from ctest-pod-85096095 passed 2025-05-30 13:53:48,581 - DEBUG - [Pod ctest-pod-90466976] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-05-30 13:53:48,581 - DEBUG - [Pod Pod ctest-pod-90466976] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-05-30 13:53:48,581 - DEBUG - [Pod Pod ctest-pod-90466976] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-05-30 13:53:48,582 - INFO - wget check of of http://10.47.255.251 from ctest-pod-90466976 passed 2025-05-30 13:53:48,590 - INFO - Updating Network Policy ingress-on-service 2025-05-30 13:53:53,662 - DEBUG - [Pod ctest-pod-85096095] Cmd: wget http://10.110.200.35:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:53:53,662 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd wget http://10.110.200.35:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:53:53,662 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:53:58,715 - DEBUG - [Pod ctest-pod-85096095] Cmd: wget http://10.110.200.35:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:53:58,715 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd wget http://10.110.200.35:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:53:58,715 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:54:03,783 - DEBUG - [Pod ctest-pod-85096095] Cmd: wget http://10.110.200.35:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:54:03,783 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd wget http://10.110.200.35:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:54:03,783 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:54:04,552 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2025-05-30 13:54:14,619 - DEBUG - [Pod ctest-pod-85096095] Cmd: wget http://10.110.200.35:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:54:14,619 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd wget http://10.110.200.35:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:54:14,619 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:54:19,675 - DEBUG - [Pod ctest-pod-85096095] Cmd: wget http://10.110.200.35:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:54:19,675 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd wget http://10.110.200.35:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:54:19,675 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:54:24,744 - DEBUG - [Pod ctest-pod-85096095] Cmd: wget http://10.110.200.35:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:54:24,878 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd wget http://10.110.200.35:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:54:24,878 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:54:29,930 - DEBUG - [Pod ctest-pod-85096095] Cmd: wget http://10.110.200.35:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:54:29,930 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd wget http://10.110.200.35:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:54:29,930 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:54:34,983 - DEBUG - [Pod ctest-pod-85096095] Cmd: wget http://10.110.200.35:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:54:34,983 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd wget http://10.110.200.35:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:54:34,983 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:54:40,034 - DEBUG - [Pod ctest-pod-85096095] Cmd: wget http://10.110.200.35:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:54:40,035 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd wget http://10.110.200.35:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:54:40,035 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:54:45,090 - DEBUG - [Pod ctest-pod-85096095] Cmd: wget http://10.110.200.35:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:54:45,091 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd wget http://10.110.200.35:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:54:45,091 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd output: Connecting to 10.110.200.35:80 (10.110.200.35:80) wget: download timed out 2025-05-30 13:54:45,091 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-05597587': 0, 'ctest-pod-81698967': 0} 2025-05-30 13:54:45,143 - DEBUG - [Pod ctest-pod-35647212] Cmd: wget http://10.110.200.35:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.200.35:80 (10.110.200.35:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-81698967 2025-05-30 13:54:45,144 - DEBUG - [Pod Pod ctest-pod-35647212] Cmd wget http://10.110.200.35:80/ -O - -T 5 -t 1 passed 2025-05-30 13:54:45,144 - DEBUG - [Pod Pod ctest-pod-35647212] Cmd output: Connecting to 10.110.200.35:80 (10.110.200.35:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-81698967 2025-05-30 13:54:45,196 - DEBUG - [Pod ctest-pod-35647212] Cmd: wget http://10.110.200.35:80/ -O - -T 5 -t 1 , Output: ctest-pod-81698967 Connecting to 10.110.200.35:80 (10.110.200.35:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-30 13:54:45,196 - DEBUG - [Pod Pod ctest-pod-35647212] Cmd wget http://10.110.200.35:80/ -O - -T 5 -t 1 passed 2025-05-30 13:54:45,196 - DEBUG - [Pod Pod ctest-pod-35647212] Cmd output: ctest-pod-81698967 Connecting to 10.110.200.35:80 (10.110.200.35:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-30 13:54:45,248 - DEBUG - [Pod ctest-pod-35647212] Cmd: wget http://10.110.200.35:80/ -O - -T 5 -t 1 , Output: ctest-pod-81698967 Connecting to 10.110.200.35:80 (10.110.200.35:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-30 13:54:45,248 - DEBUG - [Pod Pod ctest-pod-35647212] Cmd wget http://10.110.200.35:80/ -O - -T 5 -t 1 passed 2025-05-30 13:54:45,248 - DEBUG - [Pod Pod ctest-pod-35647212] Cmd output: ctest-pod-81698967 Connecting to 10.110.200.35:80 (10.110.200.35:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-30 13:54:45,302 - DEBUG - [Pod ctest-pod-35647212] Cmd: wget http://10.110.200.35:80/ -O - -T 5 -t 1 , Output: ctest-pod-81698967 Connecting to 10.110.200.35:80 (10.110.200.35:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-30 13:54:45,302 - DEBUG - [Pod Pod ctest-pod-35647212] Cmd wget http://10.110.200.35:80/ -O - -T 5 -t 1 passed 2025-05-30 13:54:45,302 - DEBUG - [Pod Pod ctest-pod-35647212] Cmd output: ctest-pod-81698967 Connecting to 10.110.200.35:80 (10.110.200.35:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-30 13:54:45,349 - DEBUG - [Pod ctest-pod-35647212] Cmd: wget http://10.110.200.35:80/ -O - -T 5 -t 1 , Output: ctest-pod-81698967 Connecting to 10.110.200.35:80 (10.110.200.35:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-30 13:54:45,350 - DEBUG - [Pod Pod ctest-pod-35647212] Cmd wget http://10.110.200.35:80/ -O - -T 5 -t 1 passed 2025-05-30 13:54:45,350 - DEBUG - [Pod Pod ctest-pod-35647212] Cmd output: ctest-pod-81698967 Connecting to 10.110.200.35:80 (10.110.200.35:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-30 13:54:45,400 - DEBUG - [Pod ctest-pod-35647212] Cmd: wget http://10.110.200.35:80/ -O - -T 5 -t 1 , Output: ctest-pod-05597587 Connecting to 10.110.200.35:80 (10.110.200.35:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-30 13:54:45,400 - DEBUG - [Pod Pod ctest-pod-35647212] Cmd wget http://10.110.200.35:80/ -O - -T 5 -t 1 passed 2025-05-30 13:54:45,400 - DEBUG - [Pod Pod ctest-pod-35647212] Cmd output: ctest-pod-05597587 Connecting to 10.110.200.35:80 (10.110.200.35:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-30 13:54:45,400 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-05597587': 1, 'ctest-pod-81698967': 5} 2025-05-30 13:54:45,467 - DEBUG - [Pod ctest-pod-56526389] Cmd: wget http://10.110.200.35:80/ -O - -T 5 -t 1 , Output: ctest-pod-81698967 Connecting to 10.110.200.35:80 (10.110.200.35:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-30 13:54:45,468 - DEBUG - [Pod Pod ctest-pod-56526389] Cmd wget http://10.110.200.35:80/ -O - -T 5 -t 1 passed 2025-05-30 13:54:45,468 - DEBUG - [Pod Pod ctest-pod-56526389] Cmd output: ctest-pod-81698967 Connecting to 10.110.200.35:80 (10.110.200.35:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-30 13:54:45,525 - DEBUG - [Pod ctest-pod-56526389] Cmd: wget http://10.110.200.35:80/ -O - -T 5 -t 1 , Output: ctest-pod-81698967 Connecting to 10.110.200.35:80 (10.110.200.35:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-30 13:54:45,526 - DEBUG - [Pod Pod ctest-pod-56526389] Cmd wget http://10.110.200.35:80/ -O - -T 5 -t 1 passed 2025-05-30 13:54:45,526 - DEBUG - [Pod Pod ctest-pod-56526389] Cmd output: ctest-pod-81698967 Connecting to 10.110.200.35:80 (10.110.200.35:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-30 13:54:45,584 - DEBUG - [Pod ctest-pod-56526389] Cmd: wget http://10.110.200.35:80/ -O - -T 5 -t 1 , Output: ctest-pod-05597587 Connecting to 10.110.200.35:80 (10.110.200.35:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-30 13:54:45,584 - DEBUG - [Pod Pod ctest-pod-56526389] Cmd wget http://10.110.200.35:80/ -O - -T 5 -t 1 passed 2025-05-30 13:54:45,584 - DEBUG - [Pod Pod ctest-pod-56526389] Cmd output: ctest-pod-05597587 Connecting to 10.110.200.35:80 (10.110.200.35:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-30 13:54:45,584 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-05597587': 1, 'ctest-pod-81698967': 2} 2025-05-30 13:54:47,622 - DEBUG - [Pod ctest-pod-35647212] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.375 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.072 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.101 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.072/0.182/0.375 ms 2025-05-30 13:54:47,623 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-35647212 with expectation True passed 2025-05-30 13:54:49,674 - DEBUG - [Pod ctest-pod-85096095] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.682 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.115 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.070/0.289/0.682 ms 2025-05-30 13:54:49,674 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-85096095 with expectation True passed 2025-05-30 13:54:51,725 - DEBUG - [Pod ctest-pod-56526389] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.528 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.079 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.076 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.076/0.561/1.528 ms 2025-05-30 13:54:51,725 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-56526389 with expectation True passed 2025-05-30 13:54:51,785 - DEBUG - [Pod ctest-pod-35647212] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-30 13:54:51,785 - DEBUG - [Pod Pod ctest-pod-35647212] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-05-30 13:54:51,785 - DEBUG - [Pod Pod ctest-pod-35647212] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-30 13:54:51,785 - INFO - wget check of of http://10.47.255.251 from ctest-pod-35647212 passed 2025-05-30 13:54:51,873 - DEBUG - [Pod ctest-pod-35647212] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-30 13:54:51,873 - DEBUG - [Pod Pod ctest-pod-35647212] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-05-30 13:54:51,873 - DEBUG - [Pod Pod ctest-pod-35647212] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-30 13:54:51,873 - INFO - wget check of of http://10.47.255.250 from ctest-pod-35647212 passed 2025-05-30 13:54:56,923 - DEBUG - [Pod ctest-pod-85096095] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-05-30 13:54:56,923 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-05-30 13:54:56,923 - DEBUG - [Pod Pod ctest-pod-85096095] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-05-30 13:54:56,923 - INFO - wget check of of http://10.47.255.250 from ctest-pod-85096095 passed 2025-05-30 13:54:56,972 - DEBUG - [Pod ctest-pod-90466976] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-30 13:54:56,972 - DEBUG - [Pod Pod ctest-pod-90466976] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-05-30 13:54:56,972 - DEBUG - [Pod Pod ctest-pod-90466976] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-30 13:54:56,972 - INFO - wget check of of http://10.47.255.251 from ctest-pod-90466976 passed 2025-05-30 13:54:56,973 - INFO - Deleting Network Policy : ingress-on-service 2025-05-30 13:54:56,973 - INFO - Deleting service : ctest-nginx-svc-02664517 2025-05-30 13:54:57,221 - DEBUG - No XMPP flaps were noticed during the test 2025-05-30 13:54:57,221 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:11] 2025-05-30 13:54:57,221 - INFO - -------------------------------------------------------------------------------- 2025-05-30 13:54:57,230 - INFO - Deleting pod ctest-new-default-05536182:ctest-pod-05597587 2025-05-30 13:54:57,231 - INFO - Deleting pod ctest-new-default-05536182:ctest-pod-81698967 2025-05-30 13:54:57,231 - INFO - Deleting pod ctest-non-default-64706789:ctest-pod-72187954 2025-05-30 13:54:57,231 - INFO - Deleting pod ctest-non-default-64706789:ctest-pod-73956025 2025-05-30 13:54:57,232 - INFO - Deleting pod ctest-new-default-05536182:ctest-pod-85096095 2025-05-30 13:54:57,232 - INFO - Deleting pod ctest-new-default-05536182:ctest-pod-35647212 2025-05-30 13:54:57,232 - INFO - Deleting pod ctest-non-default-64706789:ctest-pod-56526389 2025-05-30 13:54:57,233 - INFO - Deleting pod ctest-non-default-64706789:ctest-pod-90466976 2025-05-30 13:54:57,362 - WARNING - Pod uuid 0f037c10-9f9f-4116-a2ff-411bbaa2b148 is still seen in agent 10.0.0.49 VM list 2025-05-30 13:54:57,418 - WARNING - Pod uuid b37c4aff-3efa-48a1-a35f-269f69e7cff5 is still seen in agent 10.0.0.49 VM list 2025-05-30 13:54:57,420 - WARNING - Pod uuid b2ea7d02-2095-4c74-963f-296187a12328 is still seen in agent 10.0.0.49 VM list 2025-05-30 13:54:57,423 - WARNING - Pod uuid ebd32376-768e-4fcc-ae75-fc01ef76f64b is still seen in agent 10.0.0.49 VM list 2025-05-30 13:54:57,425 - WARNING - Pod uuid 5e11258a-f3ff-4bf0-b25b-4d02b44e96bd is still seen in agent 10.0.0.49 VM list 2025-05-30 13:54:57,426 - WARNING - Pod uuid e656dc4f-106c-45d2-a215-f33d1ad067cd is still seen in agent 10.0.0.49 VM list 2025-05-30 13:54:57,426 - WARNING - Pod uuid 26fe40c2-a89f-4186-96e7-ce97fbdb557d is still seen in agent 10.0.0.49 VM list 2025-05-30 13:54:57,427 - WARNING - Pod uuid e3ddfc63-454c-493a-9a18-d709ab464321 is still seen in agent 10.0.0.49 VM list 2025-05-30 13:55:02,372 - DEBUG - Pod 0f037c10-9f9f-4116-a2ff-411bbaa2b148 is not in agent 10.0.0.49 VM list 2025-05-30 13:55:02,380 - DEBUG - VMI 2e2b5128-3d5d-11f0-b9a7-fa163e2b2ee1 is removed from agent 10.0.0.49 2025-05-30 13:55:02,380 - INFO - Verified that pod ctest-pod-05597587 is removed in agent 2025-05-30 13:55:02,436 - WARNING - Pod uuid b2ea7d02-2095-4c74-963f-296187a12328 is still seen in agent 10.0.0.49 VM list 2025-05-30 13:55:02,437 - DEBUG - Pod b37c4aff-3efa-48a1-a35f-269f69e7cff5 is not in agent 10.0.0.49 VM list 2025-05-30 13:55:02,456 - DEBUG - VMI 2fdea1dc-3d5d-11f0-b9a7-fa163e2b2ee1 is removed from agent 10.0.0.49 2025-05-30 13:55:02,456 - INFO - Verified that pod ctest-pod-73956025 is removed in agent 2025-05-30 13:55:02,457 - DEBUG - Pod 26fe40c2-a89f-4186-96e7-ce97fbdb557d is not in agent 10.0.0.49 VM list 2025-05-30 13:55:02,459 - DEBUG - Pod e3ddfc63-454c-493a-9a18-d709ab464321 is not in agent 10.0.0.49 VM list 2025-05-30 13:55:02,460 - WARNING - Pod uuid ebd32376-768e-4fcc-ae75-fc01ef76f64b is still seen in agent 10.0.0.49 VM list 2025-05-30 13:55:02,461 - WARNING - Pod uuid 5e11258a-f3ff-4bf0-b25b-4d02b44e96bd is still seen in agent 10.0.0.49 VM list 2025-05-30 13:55:02,463 - WARNING - Pod uuid e656dc4f-106c-45d2-a215-f33d1ad067cd is still seen in agent 10.0.0.49 VM list 2025-05-30 13:55:02,471 - DEBUG - VMI 2eaa8678-3d5d-11f0-b9a7-fa163e2b2ee1 is removed from agent 10.0.0.49 2025-05-30 13:55:02,471 - INFO - Verified that pod ctest-pod-81698967 is removed in agent 2025-05-30 13:55:02,472 - DEBUG - VMI 2f640d8c-3d5d-11f0-b9a7-fa163e2b2ee1 is removed from agent 10.0.0.49 2025-05-30 13:55:02,472 - INFO - Verified that pod ctest-pod-72187954 is removed in agent 2025-05-30 13:55:07,445 - WARNING - Pod uuid b2ea7d02-2095-4c74-963f-296187a12328 is still seen in agent 10.0.0.49 VM list 2025-05-30 13:55:07,476 - WARNING - Pod uuid ebd32376-768e-4fcc-ae75-fc01ef76f64b is still seen in agent 10.0.0.49 VM list 2025-05-30 13:55:07,477 - WARNING - Pod uuid e656dc4f-106c-45d2-a215-f33d1ad067cd is still seen in agent 10.0.0.49 VM list 2025-05-30 13:55:07,477 - WARNING - Pod uuid 5e11258a-f3ff-4bf0-b25b-4d02b44e96bd is still seen in agent 10.0.0.49 VM list 2025-05-30 13:55:12,453 - WARNING - Pod uuid b2ea7d02-2095-4c74-963f-296187a12328 is still seen in agent 10.0.0.49 VM list 2025-05-30 13:55:12,491 - WARNING - Pod uuid ebd32376-768e-4fcc-ae75-fc01ef76f64b is still seen in agent 10.0.0.49 VM list 2025-05-30 13:55:12,493 - WARNING - Pod uuid e656dc4f-106c-45d2-a215-f33d1ad067cd is still seen in agent 10.0.0.49 VM list 2025-05-30 13:55:12,493 - WARNING - Pod uuid 5e11258a-f3ff-4bf0-b25b-4d02b44e96bd is still seen in agent 10.0.0.49 VM list 2025-05-30 13:55:17,462 - WARNING - Pod uuid b2ea7d02-2095-4c74-963f-296187a12328 is still seen in agent 10.0.0.49 VM list 2025-05-30 13:55:17,508 - WARNING - Pod uuid ebd32376-768e-4fcc-ae75-fc01ef76f64b is still seen in agent 10.0.0.49 VM list 2025-05-30 13:55:17,510 - WARNING - Pod uuid 5e11258a-f3ff-4bf0-b25b-4d02b44e96bd is still seen in agent 10.0.0.49 VM list 2025-05-30 13:55:17,510 - WARNING - Pod uuid e656dc4f-106c-45d2-a215-f33d1ad067cd is still seen in agent 10.0.0.49 VM list 2025-05-30 13:55:22,471 - WARNING - Pod uuid b2ea7d02-2095-4c74-963f-296187a12328 is still seen in agent 10.0.0.49 VM list 2025-05-30 13:55:22,523 - WARNING - Pod uuid ebd32376-768e-4fcc-ae75-fc01ef76f64b is still seen in agent 10.0.0.49 VM list 2025-05-30 13:55:22,525 - WARNING - Pod uuid 5e11258a-f3ff-4bf0-b25b-4d02b44e96bd is still seen in agent 10.0.0.49 VM list 2025-05-30 13:55:22,525 - WARNING - Pod uuid e656dc4f-106c-45d2-a215-f33d1ad067cd is still seen in agent 10.0.0.49 VM list 2025-05-30 13:55:27,486 - WARNING - Pod uuid b2ea7d02-2095-4c74-963f-296187a12328 is still seen in agent 10.0.0.49 VM list 2025-05-30 13:55:27,540 - WARNING - Pod uuid ebd32376-768e-4fcc-ae75-fc01ef76f64b is still seen in agent 10.0.0.49 VM list 2025-05-30 13:55:27,542 - WARNING - Pod uuid 5e11258a-f3ff-4bf0-b25b-4d02b44e96bd is still seen in agent 10.0.0.49 VM list 2025-05-30 13:55:27,543 - WARNING - Pod uuid e656dc4f-106c-45d2-a215-f33d1ad067cd is still seen in agent 10.0.0.49 VM list 2025-05-30 13:55:32,494 - DEBUG - Pod b2ea7d02-2095-4c74-963f-296187a12328 is not in agent 10.0.0.49 VM list 2025-05-30 13:55:32,501 - DEBUG - VMI 30e541da-3d5d-11f0-b9a7-fa163e2b2ee1 is removed from agent 10.0.0.49 2025-05-30 13:55:32,501 - INFO - Verified that pod ctest-pod-35647212 is removed in agent 2025-05-30 13:55:32,556 - DEBUG - Pod ebd32376-768e-4fcc-ae75-fc01ef76f64b is not in agent 10.0.0.49 VM list 2025-05-30 13:55:32,559 - DEBUG - Pod 5e11258a-f3ff-4bf0-b25b-4d02b44e96bd is not in agent 10.0.0.49 VM list 2025-05-30 13:55:32,561 - DEBUG - Pod e656dc4f-106c-45d2-a215-f33d1ad067cd is not in agent 10.0.0.49 VM list 2025-05-30 13:55:32,573 - DEBUG - VMI 3160d958-3d5d-11f0-b9a7-fa163e2b2ee1 is removed from agent 10.0.0.49 2025-05-30 13:55:32,573 - INFO - Verified that pod ctest-pod-56526389 is removed in agent 2025-05-30 13:55:32,574 - DEBUG - VMI 31dadc94-3d5d-11f0-b9a7-fa163e2b2ee1 is removed from agent 10.0.0.49 2025-05-30 13:55:32,574 - INFO - Verified that pod ctest-pod-90466976 is removed in agent 2025-05-30 13:55:32,575 - DEBUG - VMI 306d8f64-3d5d-11f0-b9a7-fa163e2b2ee1 is removed from agent 10.0.0.49 2025-05-30 13:55:32,575 - INFO - Verified that pod ctest-pod-85096095 is removed in agent 2025-05-30 13:55:32,575 - INFO - Deleting namespace ctest-non-default-64706789 2025-05-30 13:55:32,592 - DEBUG - Namespace ctest-non-default-64706789 still in k8s 2025-05-30 13:55:34,597 - DEBUG - Namespace ctest-non-default-64706789 still in k8s 2025-05-30 13:55:36,602 - DEBUG - Namespace ctest-non-default-64706789 still in k8s 2025-05-30 13:55:38,606 - DEBUG - Namespace ctest-non-default-64706789 is not in k8s 2025-05-30 13:55:38,606 - DEBUG - No need to check project deletion in contrail-api 2025-05-30 13:55:38,606 - INFO - Deleting namespace ctest-new-default-05536182 2025-05-30 13:55:38,614 - DEBUG - Namespace ctest-new-default-05536182 still in k8s 2025-05-30 13:55:40,619 - DEBUG - Namespace ctest-new-default-05536182 still in k8s 2025-05-30 13:55:42,624 - DEBUG - Namespace ctest-new-default-05536182 still in k8s 2025-05-30 13:55:44,627 - DEBUG - Namespace ctest-new-default-05536182 is not in k8s 2025-05-30 13:55:44,627 - DEBUG - No need to check project deletion in contrail-api