2025-08-11 21:19:52,748 - INFO - Using existing project ['default-domain', 'k8s-default'](ae0db9e9-53d4-4374-8812-b6d8ba7c9f56) 2025-08-11 21:19:52,766 - DEBUG - Namespace ctest-new-default-95304074 not present 2025-08-11 21:19:52,774 - INFO - Created namespace ctest-new-default-95304074 2025-08-11 21:19:55,778 - DEBUG - Namespace ctest-non-default-16170595 not present 2025-08-11 21:19:55,789 - INFO - Created namespace ctest-non-default-16170595 2025-08-11 21:19:58,810 - DEBUG - Pod ctest-pod-70435530 not present 2025-08-11 21:19:58,810 - INFO - Creating Pod ctest-pod-70435530 2025-08-11 21:19:58,829 - DEBUG - Pod : ctest-pod-70435530 UUID is b602bf41-1965-4355-aac9-bc9d8363ba6b 2025-08-11 21:19:58,833 - DEBUG - Pod ctest-pod-24794004 not present 2025-08-11 21:19:58,835 - INFO - Creating Pod ctest-pod-24794004 2025-08-11 21:19:58,874 - DEBUG - Pod : ctest-pod-24794004 UUID is 35829ece-ce1b-429c-9a63-315125756ca9 2025-08-11 21:19:58,877 - DEBUG - Pod ctest-pod-25986475 not present 2025-08-11 21:19:58,877 - INFO - Creating Pod ctest-pod-25986475 2025-08-11 21:19:58,911 - DEBUG - Pod : ctest-pod-25986475 UUID is 63b77f37-3ffb-492a-b445-b2e410a00b6d 2025-08-11 21:19:58,917 - DEBUG - Pod ctest-pod-86434435 not present 2025-08-11 21:19:58,918 - INFO - Creating Pod ctest-pod-86434435 2025-08-11 21:19:58,941 - DEBUG - Pod : ctest-pod-86434435 UUID is e5e23e4d-bb2a-4810-878a-444731ef3885 2025-08-11 21:19:58,943 - DEBUG - Pod ctest-pod-10542787 not present 2025-08-11 21:19:58,944 - INFO - Creating Pod ctest-pod-10542787 2025-08-11 21:19:58,959 - DEBUG - Pod : ctest-pod-10542787 UUID is f98ac2d8-9d80-4000-84c3-3ae039876c64 2025-08-11 21:19:58,961 - DEBUG - Pod ctest-pod-67264798 not present 2025-08-11 21:19:58,961 - INFO - Creating Pod ctest-pod-67264798 2025-08-11 21:19:58,975 - DEBUG - Node for Pod ctest-pod-67264798 not yet populated 2025-08-11 21:20:01,982 - DEBUG - Pod : ctest-pod-67264798 UUID is 5eb8b130-d6a0-4ec8-b341-1b7567edd743 2025-08-11 21:20:01,984 - DEBUG - Pod ctest-pod-58415516 not present 2025-08-11 21:20:01,984 - INFO - Creating Pod ctest-pod-58415516 2025-08-11 21:20:02,006 - DEBUG - Pod : ctest-pod-58415516 UUID is c4ee0c24-3090-4082-81dd-c21cddcce524 2025-08-11 21:20:02,008 - DEBUG - Pod ctest-pod-48556015 not present 2025-08-11 21:20:02,008 - INFO - Creating Pod ctest-pod-48556015 2025-08-11 21:20:02,032 - DEBUG - Pod : ctest-pod-48556015 UUID is 4a8d31ae-12ba-45b6-af58-6b5c6bd8e8b5 2025-08-11 21:20:02,290 - INFO - Project default-domain:k8s-ctest-new-default-95304074 for Namespace ctest-new-default-95304074 is seen in contrail-api 2025-08-11 21:20:02,291 - DEBUG - Project uuid in Contrail is c516f8e6-888f-48d4-8dfc-f5527d41480f 2025-08-11 21:20:02,451 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NamespaceDatabaseList?namespace_uuid=5ec2ec7b-9c9f-4b5b-81b1-c31cb3920ed9 2025-08-11 21:20:02,457 - INFO - Namespace ctest-new-default-95304074 with uuid 5ec2ec7b-9c9f-4b5b-81b1-c31cb3920ed9 found in kube manager 2025-08-11 21:20:02,457 - INFO - Namespace ctest-new-default-95304074 verification passed 2025-08-11 21:20:02,713 - INFO - Project default-domain:k8s-ctest-non-default-16170595 for Namespace ctest-non-default-16170595 is seen in contrail-api 2025-08-11 21:20:02,714 - DEBUG - Project uuid in Contrail is 456ad380-875d-421e-9394-bce62b53c242 2025-08-11 21:20:02,714 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NamespaceDatabaseList?namespace_uuid=82ae59fc-24f9-4f3d-b12e-ca34477dfd35 2025-08-11 21:20:02,719 - INFO - Namespace ctest-non-default-16170595 with uuid 82ae59fc-24f9-4f3d-b12e-ca34477dfd35 found in kube manager 2025-08-11 21:20:02,719 - INFO - Namespace ctest-non-default-16170595 verification passed 2025-08-11 21:20:02,724 - DEBUG - Pod ctest-pod-70435530 not in running state.Currently in Pending 2025-08-11 21:20:07,732 - DEBUG - Pod ctest-pod-70435530 not in running state.Currently in Pending 2025-08-11 21:20:12,742 - INFO - Pod ctest-pod-70435530 is in running state.Got IP 10.47.255.251 2025-08-11 21:20:12,756 - DEBUG - Pod ctest-pod-70435530 has vmi f044e1f0-76f8-11f0-a5d6-fa163e539a15 2025-08-11 21:20:12,756 - INFO - Verified pod ctest-pod-70435530 in contrail-api 2025-08-11 21:20:12,778 - DEBUG - VMI f044e1f0-76f8-11f0-a5d6-fa163e539a15 is active in agent 10.0.0.240 2025-08-11 21:20:12,778 - INFO - Verified Pod ctest-pod-70435530 in agent 10.0.0.240 2025-08-11 21:20:12,778 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=b602bf41-1965-4355-aac9-bc9d8363ba6b 2025-08-11 21:20:12,782 - INFO - Pod ctest-pod-70435530 with uuid b602bf41-1965-4355-aac9-bc9d8363ba6b found in kube manager 2025-08-11 21:20:12,782 - INFO - Pod ctest-pod-70435530 verification passed 2025-08-11 21:20:12,787 - DEBUG - Pod ctest-pod-24794004 not in running state.Currently in Pending 2025-08-11 21:20:17,795 - INFO - Pod ctest-pod-24794004 is in running state.Got IP 10.47.255.250 2025-08-11 21:20:17,852 - DEBUG - Pod ctest-pod-24794004 has vmi f0b9477a-76f8-11f0-a5d6-fa163e539a15 2025-08-11 21:20:17,852 - INFO - Verified pod ctest-pod-24794004 in contrail-api 2025-08-11 21:20:17,868 - DEBUG - VMI f0b9477a-76f8-11f0-a5d6-fa163e539a15 is active in agent 10.0.0.240 2025-08-11 21:20:17,868 - INFO - Verified Pod ctest-pod-24794004 in agent 10.0.0.240 2025-08-11 21:20:17,868 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=35829ece-ce1b-429c-9a63-315125756ca9 2025-08-11 21:20:17,873 - INFO - Pod ctest-pod-24794004 with uuid 35829ece-ce1b-429c-9a63-315125756ca9 found in kube manager 2025-08-11 21:20:17,873 - INFO - Pod ctest-pod-24794004 verification passed 2025-08-11 21:20:17,879 - INFO - Pod ctest-pod-25986475 is in running state.Got IP 10.47.255.249 2025-08-11 21:20:17,892 - DEBUG - Pod ctest-pod-25986475 has vmi f1540a8a-76f8-11f0-a5d6-fa163e539a15 2025-08-11 21:20:17,892 - INFO - Verified pod ctest-pod-25986475 in contrail-api 2025-08-11 21:20:17,904 - DEBUG - VMI f1540a8a-76f8-11f0-a5d6-fa163e539a15 is active in agent 10.0.0.240 2025-08-11 21:20:17,904 - INFO - Verified Pod ctest-pod-25986475 in agent 10.0.0.240 2025-08-11 21:20:17,904 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=63b77f37-3ffb-492a-b445-b2e410a00b6d 2025-08-11 21:20:17,908 - INFO - Pod ctest-pod-25986475 with uuid 63b77f37-3ffb-492a-b445-b2e410a00b6d found in kube manager 2025-08-11 21:20:17,908 - INFO - Pod ctest-pod-25986475 verification passed 2025-08-11 21:20:17,913 - INFO - Pod ctest-pod-86434435 is in running state.Got IP 10.47.255.248 2025-08-11 21:20:17,968 - DEBUG - Pod ctest-pod-86434435 has vmi f1df1b7a-76f8-11f0-a5d6-fa163e539a15 2025-08-11 21:20:17,968 - INFO - Verified pod ctest-pod-86434435 in contrail-api 2025-08-11 21:20:17,979 - DEBUG - VMI f1df1b7a-76f8-11f0-a5d6-fa163e539a15 is active in agent 10.0.0.240 2025-08-11 21:20:17,979 - INFO - Verified Pod ctest-pod-86434435 in agent 10.0.0.240 2025-08-11 21:20:17,979 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=e5e23e4d-bb2a-4810-878a-444731ef3885 2025-08-11 21:20:17,984 - INFO - Pod ctest-pod-86434435 with uuid e5e23e4d-bb2a-4810-878a-444731ef3885 found in kube manager 2025-08-11 21:20:17,984 - INFO - Pod ctest-pod-86434435 verification passed 2025-08-11 21:20:17,989 - INFO - Pod ctest-pod-10542787 is in running state.Got IP 10.47.255.247 2025-08-11 21:20:18,052 - DEBUG - Pod ctest-pod-10542787 has vmi f2648972-76f8-11f0-a5d6-fa163e539a15 2025-08-11 21:20:18,052 - INFO - Verified pod ctest-pod-10542787 in contrail-api 2025-08-11 21:20:18,063 - DEBUG - VMI f2648972-76f8-11f0-a5d6-fa163e539a15 is active in agent 10.0.0.240 2025-08-11 21:20:18,064 - INFO - Verified Pod ctest-pod-10542787 in agent 10.0.0.240 2025-08-11 21:20:18,064 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=f98ac2d8-9d80-4000-84c3-3ae039876c64 2025-08-11 21:20:18,068 - INFO - Pod ctest-pod-10542787 with uuid f98ac2d8-9d80-4000-84c3-3ae039876c64 found in kube manager 2025-08-11 21:20:18,068 - INFO - Pod ctest-pod-10542787 verification passed 2025-08-11 21:20:18,075 - INFO - Pod ctest-pod-58415516 is in running state.Got IP 10.47.255.245 2025-08-11 21:20:18,088 - DEBUG - Pod ctest-pod-58415516 has vmi f361dffa-76f8-11f0-a5d6-fa163e539a15 2025-08-11 21:20:18,088 - INFO - Verified pod ctest-pod-58415516 in contrail-api 2025-08-11 21:20:18,101 - DEBUG - VMI f361dffa-76f8-11f0-a5d6-fa163e539a15 is active in agent 10.0.0.240 2025-08-11 21:20:18,101 - INFO - Verified Pod ctest-pod-58415516 in agent 10.0.0.240 2025-08-11 21:20:18,101 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=c4ee0c24-3090-4082-81dd-c21cddcce524 2025-08-11 21:20:18,106 - INFO - Pod ctest-pod-58415516 with uuid c4ee0c24-3090-4082-81dd-c21cddcce524 found in kube manager 2025-08-11 21:20:18,106 - INFO - Pod ctest-pod-58415516 verification passed 2025-08-11 21:20:18,111 - INFO - Pod ctest-pod-67264798 is in running state.Got IP 10.47.255.246 2025-08-11 21:20:18,163 - DEBUG - Pod ctest-pod-67264798 has vmi f2d05c4c-76f8-11f0-a5d6-fa163e539a15 2025-08-11 21:20:18,163 - INFO - Verified pod ctest-pod-67264798 in contrail-api 2025-08-11 21:20:18,177 - DEBUG - VMI f2d05c4c-76f8-11f0-a5d6-fa163e539a15 is active in agent 10.0.0.240 2025-08-11 21:20:18,177 - INFO - Verified Pod ctest-pod-67264798 in agent 10.0.0.240 2025-08-11 21:20:18,177 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=5eb8b130-d6a0-4ec8-b341-1b7567edd743 2025-08-11 21:20:18,182 - INFO - Pod ctest-pod-67264798 with uuid 5eb8b130-d6a0-4ec8-b341-1b7567edd743 found in kube manager 2025-08-11 21:20:18,182 - INFO - Pod ctest-pod-67264798 verification passed 2025-08-11 21:20:18,187 - INFO - Pod ctest-pod-48556015 is in running state.Got IP 10.47.255.244 2025-08-11 21:20:18,240 - DEBUG - Pod ctest-pod-48556015 has vmi f3e618b0-76f8-11f0-a5d6-fa163e539a15 2025-08-11 21:20:18,240 - INFO - Verified pod ctest-pod-48556015 in contrail-api 2025-08-11 21:20:18,251 - DEBUG - VMI f3e618b0-76f8-11f0-a5d6-fa163e539a15 is active in agent 10.0.0.240 2025-08-11 21:20:18,252 - INFO - Verified Pod ctest-pod-48556015 in agent 10.0.0.240 2025-08-11 21:20:18,252 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=4a8d31ae-12ba-45b6-af58-6b5c6bd8e8b5 2025-08-11 21:20:18,256 - INFO - Pod ctest-pod-48556015 with uuid 4a8d31ae-12ba-45b6-af58-6b5c6bd8e8b5 found in kube manager 2025-08-11 21:20:18,256 - INFO - Pod ctest-pod-48556015 verification passed 2025-08-11 21:20:18,256 - INFO - ================================================================================ 2025-08-11 21:20:18,256 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-08-11 21:20:18,257 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-08-11 21:20:18,441 - DEBUG - Nothing to compare xmpp stats {'10.0.0.240': {'10.0.0.33': '0'}} with 2025-08-11 21:20:18,441 - INFO - Initial checks done. Running the testcase now 2025-08-11 21:20:18,441 - INFO - 2025-08-11 21:20:18,564 - DEBUG - [Pod ctest-pod-70435530] Cmd: echo ctest-pod-70435530 > /usr/share/nginx/html/index.html, Output: 2025-08-11 21:20:18,716 - DEBUG - [Pod ctest-pod-24794004] Cmd: echo ctest-pod-24794004 > /usr/share/nginx/html/index.html, Output: 2025-08-11 21:20:18,843 - DEBUG - [Pod ctest-pod-25986475] Cmd: echo ctest-pod-25986475 > /usr/share/nginx/html/index.html, Output: 2025-08-11 21:20:18,894 - DEBUG - [Pod ctest-pod-86434435] Cmd: echo ctest-pod-86434435 > /usr/share/nginx/html/index.html, Output: 2025-08-11 21:20:18,897 - DEBUG - Service ctest-nginx-svc-62248450 not present 2025-08-11 21:20:18,897 - INFO - Creating service ctest-nginx-svc-62248450 2025-08-11 21:20:18,923 - INFO - Created Service ctest-nginx-svc-62248450 2025-08-11 21:20:18,931 - WARNING - Service UUID 8cfdf9f1-429f-4f60-aa9d-1d530257e4a1 not yet found in contrail-api 2025-08-11 21:20:19,938 - INFO - Validated that Service ctest-nginx-svc-62248450 is seen in contrail-api 2025-08-11 21:20:19,938 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_LoadbalancerDatabaseList?x=8cfdf9f1-429f-4f60-aa9d-1d530257e4a1 2025-08-11 21:20:19,943 - INFO - Service ctest-nginx-svc-62248450 with uuid 8cfdf9f1-429f-4f60-aa9d-1d530257e4a1 found in kube manager 2025-08-11 21:20:19,944 - INFO - Service ctest-nginx-svc-62248450 verification passed 2025-08-11 21:20:20,999 - DEBUG - [Pod ctest-pod-10542787] Cmd: wget http://10.96.107.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.107.100:80 (10.96.107.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-24794004 2025-08-11 21:20:20,999 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd wget http://10.96.107.100:80/ -O - -T 5 -t 1 passed 2025-08-11 21:20:20,999 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd output: Connecting to 10.96.107.100:80 (10.96.107.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-24794004 2025-08-11 21:20:21,051 - DEBUG - [Pod ctest-pod-10542787] Cmd: wget http://10.96.107.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.107.100:80 (10.96.107.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-70435530 2025-08-11 21:20:21,051 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd wget http://10.96.107.100:80/ -O - -T 5 -t 1 passed 2025-08-11 21:20:21,051 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd output: Connecting to 10.96.107.100:80 (10.96.107.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-70435530 2025-08-11 21:20:21,051 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-70435530': 1, 'ctest-pod-24794004': 1} 2025-08-11 21:20:21,102 - DEBUG - [Pod ctest-pod-58415516] Cmd: wget http://10.96.107.100:80/ -O - -T 5 -t 1 , Output: ctest-pod-24794004 Connecting to 10.96.107.100:80 (10.96.107.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-11 21:20:21,102 - DEBUG - [Pod Pod ctest-pod-58415516] Cmd wget http://10.96.107.100:80/ -O - -T 5 -t 1 passed 2025-08-11 21:20:21,103 - DEBUG - [Pod Pod ctest-pod-58415516] Cmd output: ctest-pod-24794004 Connecting to 10.96.107.100:80 (10.96.107.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-11 21:20:21,153 - DEBUG - [Pod ctest-pod-58415516] Cmd: wget http://10.96.107.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.107.100:80 (10.96.107.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-24794004 2025-08-11 21:20:21,153 - DEBUG - [Pod Pod ctest-pod-58415516] Cmd wget http://10.96.107.100:80/ -O - -T 5 -t 1 passed 2025-08-11 21:20:21,153 - DEBUG - [Pod Pod ctest-pod-58415516] Cmd output: Connecting to 10.96.107.100:80 (10.96.107.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-24794004 2025-08-11 21:20:21,192 - DEBUG - [Pod ctest-pod-58415516] Cmd: wget http://10.96.107.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.107.100:80 (10.96.107.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-24794004 2025-08-11 21:20:21,192 - DEBUG - [Pod Pod ctest-pod-58415516] Cmd wget http://10.96.107.100:80/ -O - -T 5 -t 1 passed 2025-08-11 21:20:21,192 - DEBUG - [Pod Pod ctest-pod-58415516] Cmd output: Connecting to 10.96.107.100:80 (10.96.107.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-24794004 2025-08-11 21:20:21,303 - DEBUG - [Pod ctest-pod-58415516] Cmd: wget http://10.96.107.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.107.100:80 (10.96.107.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-24794004 2025-08-11 21:20:21,303 - DEBUG - [Pod Pod ctest-pod-58415516] Cmd wget http://10.96.107.100:80/ -O - -T 5 -t 1 passed 2025-08-11 21:20:21,303 - DEBUG - [Pod Pod ctest-pod-58415516] Cmd output: Connecting to 10.96.107.100:80 (10.96.107.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-24794004 2025-08-11 21:20:21,353 - DEBUG - [Pod ctest-pod-58415516] Cmd: wget http://10.96.107.100:80/ -O - -T 5 -t 1 , Output: ctest-pod-70435530 Connecting to 10.96.107.100:80 (10.96.107.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-11 21:20:21,353 - DEBUG - [Pod Pod ctest-pod-58415516] Cmd wget http://10.96.107.100:80/ -O - -T 5 -t 1 passed 2025-08-11 21:20:21,353 - DEBUG - [Pod Pod ctest-pod-58415516] Cmd output: ctest-pod-70435530 Connecting to 10.96.107.100:80 (10.96.107.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-11 21:20:21,353 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-70435530': 1, 'ctest-pod-24794004': 4} 2025-08-11 21:20:21,356 - DEBUG - Network policy ingress-on-service not present 2025-08-11 21:20:21,357 - INFO - Creating Network Policy ingress-on-service 2025-08-11 21:20:21,366 - INFO - Network policy found in k8s 2025-08-11 21:20:21,366 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=4d7459bf-3ac6-49c0-8375-846c630c64b0 2025-08-11 21:20:21,381 - INFO - Network Policy ingress-on-service with uuid 4d7459bf-3ac6-49c0-8375-846c630c64b0 found in kube manager 2025-08-11 21:20:21,424 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-08-11 21:20:21,424 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-08-11 21:20:21,424 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=4d7459bf-3ac6-49c0-8375-846c630c64b0 2025-08-11 21:20:21,464 - WARNING - Network policy with name ingress-on-service not found in agent 2025-08-11 21:20:23,465 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=4d7459bf-3ac6-49c0-8375-846c630c64b0 2025-08-11 21:20:23,496 - INFO - Network policy with name ingress-on-service found in agent 2025-08-11 21:20:23,496 - INFO - Network Policy ingress-on-service verification passed 2025-08-11 21:20:28,547 - DEBUG - [Pod ctest-pod-10542787] Cmd: wget http://10.96.107.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:20:28,547 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd wget http://10.96.107.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:20:28,547 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:20:33,599 - DEBUG - [Pod ctest-pod-10542787] Cmd: wget http://10.96.107.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:20:33,599 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd wget http://10.96.107.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:20:33,599 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:20:38,652 - DEBUG - [Pod ctest-pod-10542787] Cmd: wget http://10.96.107.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:20:38,653 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd wget http://10.96.107.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:20:38,653 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:20:43,703 - DEBUG - [Pod ctest-pod-10542787] Cmd: wget http://10.96.107.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:20:43,703 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd wget http://10.96.107.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:20:43,704 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:20:48,751 - DEBUG - [Pod ctest-pod-10542787] Cmd: wget http://10.96.107.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:20:48,751 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd wget http://10.96.107.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:20:48,751 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:20:53,800 - DEBUG - [Pod ctest-pod-10542787] Cmd: wget http://10.96.107.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:20:53,800 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd wget http://10.96.107.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:20:53,800 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:20:58,855 - DEBUG - [Pod ctest-pod-10542787] Cmd: wget http://10.96.107.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:20:58,855 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd wget http://10.96.107.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:20:58,855 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:21:03,908 - DEBUG - [Pod ctest-pod-10542787] Cmd: wget http://10.96.107.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:21:03,908 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd wget http://10.96.107.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:21:03,908 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:21:08,955 - DEBUG - [Pod ctest-pod-10542787] Cmd: wget http://10.96.107.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:21:08,955 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd wget http://10.96.107.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:21:08,955 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:21:14,007 - DEBUG - [Pod ctest-pod-10542787] Cmd: wget http://10.96.107.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:21:14,007 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd wget http://10.96.107.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:21:14,007 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:21:14,007 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-70435530': 0, 'ctest-pod-24794004': 0} 2025-08-11 21:21:14,069 - DEBUG - [Pod ctest-pod-67264798] Cmd: wget http://10.96.107.100:80/ -O - -T 5 -t 1 , Output: ctest-pod-24794004 Connecting to 10.96.107.100:80 (10.96.107.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-11 21:21:14,069 - DEBUG - [Pod Pod ctest-pod-67264798] Cmd wget http://10.96.107.100:80/ -O - -T 5 -t 1 passed 2025-08-11 21:21:14,069 - DEBUG - [Pod Pod ctest-pod-67264798] Cmd output: ctest-pod-24794004 Connecting to 10.96.107.100:80 (10.96.107.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-11 21:21:14,122 - DEBUG - [Pod ctest-pod-67264798] Cmd: wget http://10.96.107.100:80/ -O - -T 5 -t 1 , Output: ctest-pod-24794004 Connecting to 10.96.107.100:80 (10.96.107.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-11 21:21:14,122 - DEBUG - [Pod Pod ctest-pod-67264798] Cmd wget http://10.96.107.100:80/ -O - -T 5 -t 1 passed 2025-08-11 21:21:14,122 - DEBUG - [Pod Pod ctest-pod-67264798] Cmd output: ctest-pod-24794004 Connecting to 10.96.107.100:80 (10.96.107.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-11 21:21:14,174 - DEBUG - [Pod ctest-pod-67264798] Cmd: wget http://10.96.107.100:80/ -O - -T 5 -t 1 , Output: ctest-pod-70435530 Connecting to 10.96.107.100:80 (10.96.107.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-11 21:21:14,174 - DEBUG - [Pod Pod ctest-pod-67264798] Cmd wget http://10.96.107.100:80/ -O - -T 5 -t 1 passed 2025-08-11 21:21:14,174 - DEBUG - [Pod Pod ctest-pod-67264798] Cmd output: ctest-pod-70435530 Connecting to 10.96.107.100:80 (10.96.107.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-11 21:21:14,174 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-70435530': 1, 'ctest-pod-24794004': 2} 2025-08-11 21:21:19,231 - DEBUG - [Pod ctest-pod-58415516] Cmd: wget http://10.96.107.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:21:19,231 - DEBUG - [Pod Pod ctest-pod-58415516] Cmd wget http://10.96.107.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:21:19,231 - DEBUG - [Pod Pod ctest-pod-58415516] Cmd output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:21:24,279 - DEBUG - [Pod ctest-pod-58415516] Cmd: wget http://10.96.107.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:21:24,279 - DEBUG - [Pod Pod ctest-pod-58415516] Cmd wget http://10.96.107.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:21:24,279 - DEBUG - [Pod Pod ctest-pod-58415516] Cmd output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:21:29,334 - DEBUG - [Pod ctest-pod-58415516] Cmd: wget http://10.96.107.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:21:29,335 - DEBUG - [Pod Pod ctest-pod-58415516] Cmd wget http://10.96.107.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:21:29,335 - DEBUG - [Pod Pod ctest-pod-58415516] Cmd output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:21:34,383 - DEBUG - [Pod ctest-pod-58415516] Cmd: wget http://10.96.107.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:21:34,383 - DEBUG - [Pod Pod ctest-pod-58415516] Cmd wget http://10.96.107.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:21:34,383 - DEBUG - [Pod Pod ctest-pod-58415516] Cmd output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:21:39,435 - DEBUG - [Pod ctest-pod-58415516] Cmd: wget http://10.96.107.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:21:39,435 - DEBUG - [Pod Pod ctest-pod-58415516] Cmd wget http://10.96.107.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:21:39,435 - DEBUG - [Pod Pod ctest-pod-58415516] Cmd output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:21:44,505 - DEBUG - [Pod ctest-pod-58415516] Cmd: wget http://10.96.107.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:21:44,505 - DEBUG - [Pod Pod ctest-pod-58415516] Cmd wget http://10.96.107.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:21:44,505 - DEBUG - [Pod Pod ctest-pod-58415516] Cmd output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:21:49,571 - DEBUG - [Pod ctest-pod-58415516] Cmd: wget http://10.96.107.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:21:49,571 - DEBUG - [Pod Pod ctest-pod-58415516] Cmd wget http://10.96.107.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:21:49,571 - DEBUG - [Pod Pod ctest-pod-58415516] Cmd output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:21:54,627 - DEBUG - [Pod ctest-pod-58415516] Cmd: wget http://10.96.107.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:21:54,628 - DEBUG - [Pod Pod ctest-pod-58415516] Cmd wget http://10.96.107.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:21:54,628 - DEBUG - [Pod Pod ctest-pod-58415516] Cmd output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:21:59,677 - DEBUG - [Pod ctest-pod-58415516] Cmd: wget http://10.96.107.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:21:59,677 - DEBUG - [Pod Pod ctest-pod-58415516] Cmd wget http://10.96.107.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:21:59,677 - DEBUG - [Pod Pod ctest-pod-58415516] Cmd output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:22:04,727 - DEBUG - [Pod ctest-pod-58415516] Cmd: wget http://10.96.107.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:22:04,728 - DEBUG - [Pod Pod ctest-pod-58415516] Cmd wget http://10.96.107.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:22:04,728 - DEBUG - [Pod Pod ctest-pod-58415516] Cmd output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:22:04,728 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-70435530': 0, 'ctest-pod-24794004': 0} 2025-08-11 21:22:06,788 - DEBUG - [Pod ctest-pod-67264798] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.318 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.069 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.077 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.069/0.488/1.318 ms 2025-08-11 21:22:06,788 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-67264798 with expectation True passed 2025-08-11 21:22:08,840 - DEBUG - [Pod ctest-pod-10542787] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.931 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.081 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.088 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.081/0.366/0.931 ms 2025-08-11 21:22:08,840 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-10542787 with expectation True passed 2025-08-11 21:22:10,911 - DEBUG - [Pod ctest-pod-58415516] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.494 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.066 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.086 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.066/0.215/0.494 ms 2025-08-11 21:22:10,911 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-58415516 with expectation True passed 2025-08-11 21:22:10,962 - DEBUG - [Pod ctest-pod-67264798] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-08-11 21:22:10,962 - DEBUG - [Pod Pod ctest-pod-67264798] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-08-11 21:22:10,962 - DEBUG - [Pod Pod ctest-pod-67264798] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-08-11 21:22:10,962 - INFO - wget check of of http://10.47.255.251 from ctest-pod-67264798 passed 2025-08-11 21:22:11,018 - DEBUG - [Pod ctest-pod-67264798] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-08-11 21:22:11,018 - DEBUG - [Pod Pod ctest-pod-67264798] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-08-11 21:22:11,018 - DEBUG - [Pod Pod ctest-pod-67264798] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-08-11 21:22:11,018 - INFO - wget check of of http://10.47.255.250 from ctest-pod-67264798 passed 2025-08-11 21:22:16,067 - DEBUG - [Pod ctest-pod-10542787] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-08-11 21:22:16,067 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-08-11 21:22:16,067 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-08-11 21:22:16,067 - INFO - wget check of of http://10.47.255.250 from ctest-pod-10542787 passed 2025-08-11 21:22:21,123 - DEBUG - [Pod ctest-pod-48556015] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-08-11 21:22:21,123 - DEBUG - [Pod Pod ctest-pod-48556015] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-08-11 21:22:21,124 - DEBUG - [Pod Pod ctest-pod-48556015] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-08-11 21:22:21,124 - INFO - wget check of of http://10.47.255.251 from ctest-pod-48556015 passed 2025-08-11 21:22:21,132 - INFO - Updating Network Policy ingress-on-service 2025-08-11 21:22:26,195 - DEBUG - [Pod ctest-pod-10542787] Cmd: wget http://10.96.107.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:22:26,195 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd wget http://10.96.107.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:22:26,195 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:22:31,251 - DEBUG - [Pod ctest-pod-10542787] Cmd: wget http://10.96.107.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:22:31,251 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd wget http://10.96.107.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:22:31,251 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:22:36,303 - DEBUG - [Pod ctest-pod-10542787] Cmd: wget http://10.96.107.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:22:36,303 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd wget http://10.96.107.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:22:36,303 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:22:39,892 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2025-08-11 21:22:50,299 - DEBUG - [Pod ctest-pod-10542787] Cmd: wget http://10.96.107.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:22:50,299 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd wget http://10.96.107.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:22:50,299 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:22:55,352 - DEBUG - [Pod ctest-pod-10542787] Cmd: wget http://10.96.107.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:22:55,352 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd wget http://10.96.107.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:22:55,352 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:23:00,408 - DEBUG - [Pod ctest-pod-10542787] Cmd: wget http://10.96.107.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:23:00,408 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd wget http://10.96.107.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:23:00,408 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:23:05,464 - DEBUG - [Pod ctest-pod-10542787] Cmd: wget http://10.96.107.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:23:05,464 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd wget http://10.96.107.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:23:05,465 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:23:10,514 - DEBUG - [Pod ctest-pod-10542787] Cmd: wget http://10.96.107.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:23:10,514 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd wget http://10.96.107.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:23:10,515 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:23:15,563 - DEBUG - [Pod ctest-pod-10542787] Cmd: wget http://10.96.107.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:23:15,563 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd wget http://10.96.107.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:23:15,563 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:23:20,611 - DEBUG - [Pod ctest-pod-10542787] Cmd: wget http://10.96.107.100:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:23:20,611 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd wget http://10.96.107.100:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:23:20,611 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd output: Connecting to 10.96.107.100:80 (10.96.107.100:80) wget: download timed out 2025-08-11 21:23:20,611 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-70435530': 0, 'ctest-pod-24794004': 0} 2025-08-11 21:23:20,664 - DEBUG - [Pod ctest-pod-67264798] Cmd: wget http://10.96.107.100:80/ -O - -T 5 -t 1 , Output: ctest-pod-24794004 Connecting to 10.96.107.100:80 (10.96.107.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-11 21:23:20,665 - DEBUG - [Pod Pod ctest-pod-67264798] Cmd wget http://10.96.107.100:80/ -O - -T 5 -t 1 passed 2025-08-11 21:23:20,665 - DEBUG - [Pod Pod ctest-pod-67264798] Cmd output: ctest-pod-24794004 Connecting to 10.96.107.100:80 (10.96.107.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-11 21:23:20,717 - DEBUG - [Pod ctest-pod-67264798] Cmd: wget http://10.96.107.100:80/ -O - -T 5 -t 1 , Output: ctest-pod-70435530 Connecting to 10.96.107.100:80 (10.96.107.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-11 21:23:20,717 - DEBUG - [Pod Pod ctest-pod-67264798] Cmd wget http://10.96.107.100:80/ -O - -T 5 -t 1 passed 2025-08-11 21:23:20,717 - DEBUG - [Pod Pod ctest-pod-67264798] Cmd output: ctest-pod-70435530 Connecting to 10.96.107.100:80 (10.96.107.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-11 21:23:20,717 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-70435530': 1, 'ctest-pod-24794004': 1} 2025-08-11 21:23:20,768 - DEBUG - [Pod ctest-pod-58415516] Cmd: wget http://10.96.107.100:80/ -O - -T 5 -t 1 , Output: ctest-pod-70435530 Connecting to 10.96.107.100:80 (10.96.107.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-11 21:23:20,768 - DEBUG - [Pod Pod ctest-pod-58415516] Cmd wget http://10.96.107.100:80/ -O - -T 5 -t 1 passed 2025-08-11 21:23:20,768 - DEBUG - [Pod Pod ctest-pod-58415516] Cmd output: ctest-pod-70435530 Connecting to 10.96.107.100:80 (10.96.107.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-11 21:23:20,828 - DEBUG - [Pod ctest-pod-58415516] Cmd: wget http://10.96.107.100:80/ -O - -T 5 -t 1 , Output: ctest-pod-24794004 Connecting to 10.96.107.100:80 (10.96.107.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-11 21:23:20,828 - DEBUG - [Pod Pod ctest-pod-58415516] Cmd wget http://10.96.107.100:80/ -O - -T 5 -t 1 passed 2025-08-11 21:23:20,828 - DEBUG - [Pod Pod ctest-pod-58415516] Cmd output: ctest-pod-24794004 Connecting to 10.96.107.100:80 (10.96.107.100:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-11 21:23:20,828 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-70435530': 1, 'ctest-pod-24794004': 1} 2025-08-11 21:23:22,875 - DEBUG - [Pod ctest-pod-67264798] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.889 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.088 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.081 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.081/0.352/0.889 ms 2025-08-11 21:23:22,875 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-67264798 with expectation True passed 2025-08-11 21:23:24,927 - DEBUG - [Pod ctest-pod-10542787] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.442 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.078 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.094 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.078/0.204/0.442 ms 2025-08-11 21:23:24,927 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-10542787 with expectation True passed 2025-08-11 21:23:26,971 - DEBUG - [Pod ctest-pod-58415516] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.833 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.087 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.081 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.081/0.333/0.833 ms 2025-08-11 21:23:26,971 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-58415516 with expectation True passed 2025-08-11 21:23:27,024 - DEBUG - [Pod ctest-pod-67264798] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-08-11 21:23:27,025 - DEBUG - [Pod Pod ctest-pod-67264798] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-08-11 21:23:27,025 - DEBUG - [Pod Pod ctest-pod-67264798] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-08-11 21:23:27,025 - INFO - wget check of of http://10.47.255.251 from ctest-pod-67264798 passed 2025-08-11 21:23:27,081 - DEBUG - [Pod ctest-pod-67264798] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-08-11 21:23:27,081 - DEBUG - [Pod Pod ctest-pod-67264798] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-08-11 21:23:27,081 - DEBUG - [Pod Pod ctest-pod-67264798] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-08-11 21:23:27,081 - INFO - wget check of of http://10.47.255.250 from ctest-pod-67264798 passed 2025-08-11 21:23:32,131 - DEBUG - [Pod ctest-pod-10542787] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-08-11 21:23:32,131 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-08-11 21:23:32,131 - DEBUG - [Pod Pod ctest-pod-10542787] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-08-11 21:23:32,131 - INFO - wget check of of http://10.47.255.250 from ctest-pod-10542787 passed 2025-08-11 21:23:32,181 - DEBUG - [Pod ctest-pod-48556015] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-08-11 21:23:32,181 - DEBUG - [Pod Pod ctest-pod-48556015] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-08-11 21:23:32,181 - DEBUG - [Pod Pod ctest-pod-48556015] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-08-11 21:23:32,181 - INFO - wget check of of http://10.47.255.251 from ctest-pod-48556015 passed 2025-08-11 21:23:32,181 - INFO - Deleting Network Policy : ingress-on-service 2025-08-11 21:23:32,182 - INFO - Deleting service : ctest-nginx-svc-62248450 2025-08-11 21:23:32,409 - DEBUG - No XMPP flaps were noticed during the test
2025-08-11 21:23:32,409 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:14]
2025-08-11 21:23:32,409 - INFO - -------------------------------------------------------------------------------- 2025-08-11 21:23:32,416 - INFO - Deleting pod ctest-new-default-95304074:ctest-pod-70435530 2025-08-11 21:23:32,417 - INFO - Deleting pod ctest-new-default-95304074:ctest-pod-24794004 2025-08-11 21:23:32,417 - INFO - Deleting pod ctest-non-default-16170595:ctest-pod-25986475 2025-08-11 21:23:32,418 - INFO - Deleting pod ctest-non-default-16170595:ctest-pod-86434435 2025-08-11 21:23:32,418 - INFO - Deleting pod ctest-new-default-95304074:ctest-pod-10542787 2025-08-11 21:23:32,418 - INFO - Deleting pod ctest-new-default-95304074:ctest-pod-67264798 2025-08-11 21:23:32,419 - INFO - Deleting pod ctest-non-default-16170595:ctest-pod-58415516 2025-08-11 21:23:32,419 - INFO - Deleting pod ctest-non-default-16170595:ctest-pod-48556015 2025-08-11 21:23:32,511 - WARNING - Pod uuid b602bf41-1965-4355-aac9-bc9d8363ba6b is still seen in agent 10.0.0.240 VM list 2025-08-11 21:23:32,512 - WARNING - Pod uuid c4ee0c24-3090-4082-81dd-c21cddcce524 is still seen in agent 10.0.0.240 VM list 2025-08-11 21:23:32,537 - WARNING - Pod uuid 35829ece-ce1b-429c-9a63-315125756ca9 is still seen in agent 10.0.0.240 VM list 2025-08-11 21:23:32,539 - WARNING - Pod uuid 63b77f37-3ffb-492a-b445-b2e410a00b6d is still seen in agent 10.0.0.240 VM list 2025-08-11 21:23:32,541 - WARNING - Pod uuid e5e23e4d-bb2a-4810-878a-444731ef3885 is still seen in agent 10.0.0.240 VM list 2025-08-11 21:23:32,542 - WARNING - Pod uuid 5eb8b130-d6a0-4ec8-b341-1b7567edd743 is still seen in agent 10.0.0.240 VM list 2025-08-11 21:23:32,543 - WARNING - Pod uuid f98ac2d8-9d80-4000-84c3-3ae039876c64 is still seen in agent 10.0.0.240 VM list 2025-08-11 21:23:32,550 - WARNING - Pod uuid 4a8d31ae-12ba-45b6-af58-6b5c6bd8e8b5 is still seen in agent 10.0.0.240 VM list 2025-08-11 21:23:37,527 - DEBUG - Pod b602bf41-1965-4355-aac9-bc9d8363ba6b is not in agent 10.0.0.240 VM list 2025-08-11 21:23:37,533 - WARNING - Pod uuid c4ee0c24-3090-4082-81dd-c21cddcce524 is still seen in agent 10.0.0.240 VM list 2025-08-11 21:23:37,538 - DEBUG - VMI f044e1f0-76f8-11f0-a5d6-fa163e539a15 is removed from agent 10.0.0.240 2025-08-11 21:23:37,538 - INFO - Verified that pod ctest-pod-70435530 is removed in agent 2025-08-11 21:23:37,550 - DEBUG - Pod 35829ece-ce1b-429c-9a63-315125756ca9 is not in agent 10.0.0.240 VM list 2025-08-11 21:23:37,563 - DEBUG - Pod 63b77f37-3ffb-492a-b445-b2e410a00b6d is not in agent 10.0.0.240 VM list 2025-08-11 21:23:37,568 - DEBUG - Pod e5e23e4d-bb2a-4810-878a-444731ef3885 is not in agent 10.0.0.240 VM list 2025-08-11 21:23:37,574 - WARNING - Pod uuid 5eb8b130-d6a0-4ec8-b341-1b7567edd743 is still seen in agent 10.0.0.240 VM list 2025-08-11 21:23:37,581 - WARNING - Pod uuid 4a8d31ae-12ba-45b6-af58-6b5c6bd8e8b5 is still seen in agent 10.0.0.240 VM list 2025-08-11 21:23:37,582 - WARNING - Pod uuid f98ac2d8-9d80-4000-84c3-3ae039876c64 is still seen in agent 10.0.0.240 VM list 2025-08-11 21:23:37,583 - DEBUG - VMI f1540a8a-76f8-11f0-a5d6-fa163e539a15 is removed from agent 10.0.0.240 2025-08-11 21:23:37,583 - INFO - Verified that pod ctest-pod-25986475 is removed in agent 2025-08-11 21:23:37,584 - DEBUG - VMI f0b9477a-76f8-11f0-a5d6-fa163e539a15 is removed from agent 10.0.0.240 2025-08-11 21:23:37,584 - INFO - Verified that pod ctest-pod-24794004 is removed in agent 2025-08-11 21:23:37,586 - DEBUG - VMI f1df1b7a-76f8-11f0-a5d6-fa163e539a15 is removed from agent 10.0.0.240 2025-08-11 21:23:37,586 - INFO - Verified that pod ctest-pod-86434435 is removed in agent 2025-08-11 21:23:42,546 - WARNING - Pod uuid c4ee0c24-3090-4082-81dd-c21cddcce524 is still seen in agent 10.0.0.240 VM list 2025-08-11 21:23:42,619 - WARNING - Pod uuid f98ac2d8-9d80-4000-84c3-3ae039876c64 is still seen in agent 10.0.0.240 VM list 2025-08-11 21:23:42,621 - WARNING - Pod uuid 4a8d31ae-12ba-45b6-af58-6b5c6bd8e8b5 is still seen in agent 10.0.0.240 VM list 2025-08-11 21:23:42,622 - WARNING - Pod uuid 5eb8b130-d6a0-4ec8-b341-1b7567edd743 is still seen in agent 10.0.0.240 VM list 2025-08-11 21:23:47,553 - WARNING - Pod uuid c4ee0c24-3090-4082-81dd-c21cddcce524 is still seen in agent 10.0.0.240 VM list 2025-08-11 21:23:47,638 - WARNING - Pod uuid f98ac2d8-9d80-4000-84c3-3ae039876c64 is still seen in agent 10.0.0.240 VM list 2025-08-11 21:23:47,639 - WARNING - Pod uuid 4a8d31ae-12ba-45b6-af58-6b5c6bd8e8b5 is still seen in agent 10.0.0.240 VM list 2025-08-11 21:23:47,639 - WARNING - Pod uuid 5eb8b130-d6a0-4ec8-b341-1b7567edd743 is still seen in agent 10.0.0.240 VM list 2025-08-11 21:23:52,560 - WARNING - Pod uuid c4ee0c24-3090-4082-81dd-c21cddcce524 is still seen in agent 10.0.0.240 VM list 2025-08-11 21:23:52,652 - WARNING - Pod uuid f98ac2d8-9d80-4000-84c3-3ae039876c64 is still seen in agent 10.0.0.240 VM list 2025-08-11 21:23:52,653 - WARNING - Pod uuid 5eb8b130-d6a0-4ec8-b341-1b7567edd743 is still seen in agent 10.0.0.240 VM list 2025-08-11 21:23:52,654 - WARNING - Pod uuid 4a8d31ae-12ba-45b6-af58-6b5c6bd8e8b5 is still seen in agent 10.0.0.240 VM list 2025-08-11 21:23:57,568 - WARNING - Pod uuid c4ee0c24-3090-4082-81dd-c21cddcce524 is still seen in agent 10.0.0.240 VM list 2025-08-11 21:23:57,666 - WARNING - Pod uuid f98ac2d8-9d80-4000-84c3-3ae039876c64 is still seen in agent 10.0.0.240 VM list 2025-08-11 21:23:57,667 - WARNING - Pod uuid 5eb8b130-d6a0-4ec8-b341-1b7567edd743 is still seen in agent 10.0.0.240 VM list 2025-08-11 21:23:57,667 - WARNING - Pod uuid 4a8d31ae-12ba-45b6-af58-6b5c6bd8e8b5 is still seen in agent 10.0.0.240 VM list 2025-08-11 21:24:02,575 - WARNING - Pod uuid c4ee0c24-3090-4082-81dd-c21cddcce524 is still seen in agent 10.0.0.240 VM list 2025-08-11 21:24:02,681 - WARNING - Pod uuid f98ac2d8-9d80-4000-84c3-3ae039876c64 is still seen in agent 10.0.0.240 VM list 2025-08-11 21:24:02,682 - WARNING - Pod uuid 4a8d31ae-12ba-45b6-af58-6b5c6bd8e8b5 is still seen in agent 10.0.0.240 VM list 2025-08-11 21:24:02,683 - WARNING - Pod uuid 5eb8b130-d6a0-4ec8-b341-1b7567edd743 is still seen in agent 10.0.0.240 VM list 2025-08-11 21:24:07,583 - DEBUG - Pod c4ee0c24-3090-4082-81dd-c21cddcce524 is not in agent 10.0.0.240 VM list 2025-08-11 21:24:07,589 - DEBUG - VMI f361dffa-76f8-11f0-a5d6-fa163e539a15 is removed from agent 10.0.0.240 2025-08-11 21:24:07,589 - INFO - Verified that pod ctest-pod-58415516 is removed in agent 2025-08-11 21:24:07,695 - DEBUG - Pod f98ac2d8-9d80-4000-84c3-3ae039876c64 is not in agent 10.0.0.240 VM list 2025-08-11 21:24:07,698 - DEBUG - Pod 4a8d31ae-12ba-45b6-af58-6b5c6bd8e8b5 is not in agent 10.0.0.240 VM list 2025-08-11 21:24:07,699 - DEBUG - Pod 5eb8b130-d6a0-4ec8-b341-1b7567edd743 is not in agent 10.0.0.240 VM list 2025-08-11 21:24:07,710 - DEBUG - VMI f2648972-76f8-11f0-a5d6-fa163e539a15 is removed from agent 10.0.0.240 2025-08-11 21:24:07,710 - INFO - Verified that pod ctest-pod-10542787 is removed in agent 2025-08-11 21:24:07,712 - DEBUG - VMI f3e618b0-76f8-11f0-a5d6-fa163e539a15 is removed from agent 10.0.0.240 2025-08-11 21:24:07,712 - INFO - Verified that pod ctest-pod-48556015 is removed in agent 2025-08-11 21:24:07,713 - DEBUG - VMI f2d05c4c-76f8-11f0-a5d6-fa163e539a15 is removed from agent 10.0.0.240 2025-08-11 21:24:07,713 - INFO - Verified that pod ctest-pod-67264798 is removed in agent 2025-08-11 21:24:07,713 - INFO - Deleting namespace ctest-non-default-16170595 2025-08-11 21:24:07,733 - DEBUG - Namespace ctest-non-default-16170595 still in k8s 2025-08-11 21:24:09,737 - DEBUG - Namespace ctest-non-default-16170595 still in k8s 2025-08-11 21:24:11,741 - DEBUG - Namespace ctest-non-default-16170595 still in k8s 2025-08-11 21:24:13,745 - DEBUG - Namespace ctest-non-default-16170595 is not in k8s 2025-08-11 21:24:13,746 - DEBUG - No need to check project deletion in contrail-api 2025-08-11 21:24:13,746 - INFO - Deleting namespace ctest-new-default-95304074 2025-08-11 21:24:13,754 - DEBUG - Namespace ctest-new-default-95304074 still in k8s 2025-08-11 21:24:15,759 - DEBUG - Namespace ctest-new-default-95304074 still in k8s 2025-08-11 21:24:17,764 - DEBUG - Namespace ctest-new-default-95304074 still in k8s 2025-08-11 21:24:19,768 - DEBUG - Namespace ctest-new-default-95304074 is not in k8s 2025-08-11 21:24:19,768 - DEBUG - No need to check project deletion in contrail-api