2025-03-30 06:04:02,618 - INFO - Using existing project ['default-domain', 'k8s-default'](7651b2f9-7759-48a4-9b20-cb8c0f415c4d) 2025-03-30 06:04:02,642 - DEBUG - Namespace ctest-new-default-31346320 not present 2025-03-30 06:04:02,664 - INFO - Created namespace ctest-new-default-31346320 2025-03-30 06:04:05,669 - DEBUG - Namespace ctest-non-default-34727667 not present 2025-03-30 06:04:05,678 - INFO - Created namespace ctest-non-default-34727667 2025-03-30 06:04:08,699 - DEBUG - Pod ctest-pod-46851246 not present 2025-03-30 06:04:08,700 - INFO - Creating Pod ctest-pod-46851246 2025-03-30 06:04:08,720 - DEBUG - Pod : ctest-pod-46851246 UUID is 3dc858f8-fca0-455d-a84d-f1c19193a11a 2025-03-30 06:04:08,723 - DEBUG - Pod ctest-pod-59024873 not present 2025-03-30 06:04:08,723 - INFO - Creating Pod ctest-pod-59024873 2025-03-30 06:04:08,755 - DEBUG - Pod : ctest-pod-59024873 UUID is 889517d4-3f55-4f24-94d8-0c6a13c13820 2025-03-30 06:04:08,757 - DEBUG - Pod ctest-pod-58869681 not present 2025-03-30 06:04:08,758 - INFO - Creating Pod ctest-pod-58869681 2025-03-30 06:04:08,788 - DEBUG - Pod : ctest-pod-58869681 UUID is 9698b0b9-cc6b-4971-812f-a60ccd9af8f4 2025-03-30 06:04:08,791 - DEBUG - Pod ctest-pod-26978227 not present 2025-03-30 06:04:08,792 - INFO - Creating Pod ctest-pod-26978227 2025-03-30 06:04:08,843 - DEBUG - Pod : ctest-pod-26978227 UUID is 22d342f5-aad7-47af-9457-8b4415793706 2025-03-30 06:04:08,850 - DEBUG - Pod ctest-pod-01691980 not present 2025-03-30 06:04:08,851 - INFO - Creating Pod ctest-pod-01691980 2025-03-30 06:04:08,876 - DEBUG - Pod : ctest-pod-01691980 UUID is 01882859-2c17-43f2-8700-f2f395f82c31 2025-03-30 06:04:08,878 - DEBUG - Pod ctest-pod-50148764 not present 2025-03-30 06:04:08,878 - INFO - Creating Pod ctest-pod-50148764 2025-03-30 06:04:08,898 - DEBUG - Pod : ctest-pod-50148764 UUID is 5858181a-96c5-43b8-8dff-3738c92c23ea 2025-03-30 06:04:08,901 - DEBUG - Pod ctest-pod-70400773 not present 2025-03-30 06:04:08,902 - INFO - Creating Pod ctest-pod-70400773 2025-03-30 06:04:08,932 - DEBUG - Pod : ctest-pod-70400773 UUID is 809dfa53-57d4-400b-8ded-647d44978090 2025-03-30 06:04:08,935 - DEBUG - Pod ctest-pod-74233288 not present 2025-03-30 06:04:08,935 - INFO - Creating Pod ctest-pod-74233288 2025-03-30 06:04:08,964 - DEBUG - Pod : ctest-pod-74233288 UUID is 565cc0ea-ddc0-41ac-9ed0-546803cdf367 2025-03-30 06:04:09,157 - INFO - Project default-domain:k8s-ctest-new-default-31346320 for Namespace ctest-new-default-31346320 is seen in contrail-api 2025-03-30 06:04:09,158 - DEBUG - Project uuid in Contrail is 30bebe2b-d0a1-450c-b076-b5544b670e13 2025-03-30 06:04:09,321 - DEBUG - Requesting: http://10.0.0.30:8108/Snh_NamespaceDatabaseList?namespace_uuid=5f1d6182-6667-4980-9519-d2fb451f568f 2025-03-30 06:04:09,328 - INFO - Namespace ctest-new-default-31346320 with uuid 5f1d6182-6667-4980-9519-d2fb451f568f found in kube manager 2025-03-30 06:04:09,329 - INFO - Namespace ctest-new-default-31346320 verification passed 2025-03-30 06:04:09,529 - INFO - Project default-domain:k8s-ctest-non-default-34727667 for Namespace ctest-non-default-34727667 is seen in contrail-api 2025-03-30 06:04:09,529 - DEBUG - Project uuid in Contrail is 3f13f7bb-20bd-435b-9958-966ddd7f8bc0 2025-03-30 06:04:09,529 - DEBUG - Requesting: http://10.0.0.30:8108/Snh_NamespaceDatabaseList?namespace_uuid=c0331960-4a5c-4904-a6b8-0516136962df 2025-03-30 06:04:09,538 - INFO - Namespace ctest-non-default-34727667 with uuid c0331960-4a5c-4904-a6b8-0516136962df found in kube manager 2025-03-30 06:04:09,538 - INFO - Namespace ctest-non-default-34727667 verification passed 2025-03-30 06:04:09,546 - DEBUG - Pod ctest-pod-46851246 not in running state.Currently in Pending 2025-03-30 06:04:14,560 - DEBUG - Pod ctest-pod-46851246 not in running state.Currently in Pending 2025-03-30 06:04:19,568 - INFO - Pod ctest-pod-46851246 is in running state.Got IP 10.47.255.251 2025-03-30 06:04:19,626 - DEBUG - Pod ctest-pod-46851246 has vmi cc510458-0d2c-11f0-9efa-fa163e361bf8 2025-03-30 06:04:19,626 - INFO - Verified pod ctest-pod-46851246 in contrail-api 2025-03-30 06:04:19,641 - DEBUG - VMI cc510458-0d2c-11f0-9efa-fa163e361bf8 is active in agent 10.0.0.17 2025-03-30 06:04:19,641 - INFO - Verified Pod ctest-pod-46851246 in agent 10.0.0.17 2025-03-30 06:04:19,641 - DEBUG - Requesting: http://10.0.0.30:8108/Snh_VirtualMachineDatabaseList?x=3dc858f8-fca0-455d-a84d-f1c19193a11a 2025-03-30 06:04:19,647 - INFO - Pod ctest-pod-46851246 with uuid 3dc858f8-fca0-455d-a84d-f1c19193a11a found in kube manager 2025-03-30 06:04:19,647 - INFO - Pod ctest-pod-46851246 verification passed 2025-03-30 06:04:19,652 - INFO - Pod ctest-pod-59024873 is in running state.Got IP 10.47.255.250 2025-03-30 06:04:19,668 - DEBUG - Pod ctest-pod-59024873 has vmi ccbf0214-0d2c-11f0-9efa-fa163e361bf8 2025-03-30 06:04:19,668 - INFO - Verified pod ctest-pod-59024873 in contrail-api 2025-03-30 06:04:19,680 - DEBUG - VMI ccbf0214-0d2c-11f0-9efa-fa163e361bf8 is active in agent 10.0.0.17 2025-03-30 06:04:19,680 - INFO - Verified Pod ctest-pod-59024873 in agent 10.0.0.17 2025-03-30 06:04:19,681 - DEBUG - Requesting: http://10.0.0.30:8108/Snh_VirtualMachineDatabaseList?x=889517d4-3f55-4f24-94d8-0c6a13c13820 2025-03-30 06:04:19,685 - INFO - Pod ctest-pod-59024873 with uuid 889517d4-3f55-4f24-94d8-0c6a13c13820 found in kube manager 2025-03-30 06:04:19,685 - INFO - Pod ctest-pod-59024873 verification passed 2025-03-30 06:04:19,698 - INFO - Pod ctest-pod-58869681 is in running state.Got IP 10.47.255.249 2025-03-30 06:04:19,756 - DEBUG - Pod ctest-pod-58869681 has vmi cd75dfac-0d2c-11f0-9efa-fa163e361bf8 2025-03-30 06:04:19,757 - INFO - Verified pod ctest-pod-58869681 in contrail-api 2025-03-30 06:04:19,769 - DEBUG - VMI cd75dfac-0d2c-11f0-9efa-fa163e361bf8 is active in agent 10.0.0.17 2025-03-30 06:04:19,770 - INFO - Verified Pod ctest-pod-58869681 in agent 10.0.0.17 2025-03-30 06:04:19,770 - DEBUG - Requesting: http://10.0.0.30:8108/Snh_VirtualMachineDatabaseList?x=9698b0b9-cc6b-4971-812f-a60ccd9af8f4 2025-03-30 06:04:19,783 - INFO - Pod ctest-pod-58869681 with uuid 9698b0b9-cc6b-4971-812f-a60ccd9af8f4 found in kube manager 2025-03-30 06:04:19,783 - INFO - Pod ctest-pod-58869681 verification passed 2025-03-30 06:04:19,790 - DEBUG - Pod ctest-pod-26978227 not in running state.Currently in Pending 2025-03-30 06:04:24,798 - INFO - Pod ctest-pod-26978227 is in running state.Got IP 10.47.255.248 2025-03-30 06:04:24,814 - DEBUG - Pod ctest-pod-26978227 has vmi cdfff304-0d2c-11f0-9efa-fa163e361bf8 2025-03-30 06:04:24,814 - INFO - Verified pod ctest-pod-26978227 in contrail-api 2025-03-30 06:04:24,830 - DEBUG - VMI cdfff304-0d2c-11f0-9efa-fa163e361bf8 is active in agent 10.0.0.17 2025-03-30 06:04:24,830 - INFO - Verified Pod ctest-pod-26978227 in agent 10.0.0.17 2025-03-30 06:04:24,830 - DEBUG - Requesting: http://10.0.0.30:8108/Snh_VirtualMachineDatabaseList?x=22d342f5-aad7-47af-9457-8b4415793706 2025-03-30 06:04:24,835 - INFO - Pod ctest-pod-26978227 with uuid 22d342f5-aad7-47af-9457-8b4415793706 found in kube manager 2025-03-30 06:04:24,835 - INFO - Pod ctest-pod-26978227 verification passed 2025-03-30 06:04:24,840 - INFO - Pod ctest-pod-01691980 is in running state.Got IP 10.47.255.247 2025-03-30 06:04:24,899 - DEBUG - Pod ctest-pod-01691980 has vmi ce8cc81a-0d2c-11f0-9efa-fa163e361bf8 2025-03-30 06:04:24,899 - INFO - Verified pod ctest-pod-01691980 in contrail-api 2025-03-30 06:04:24,914 - DEBUG - VMI ce8cc81a-0d2c-11f0-9efa-fa163e361bf8 is active in agent 10.0.0.17 2025-03-30 06:04:24,914 - INFO - Verified Pod ctest-pod-01691980 in agent 10.0.0.17 2025-03-30 06:04:24,915 - DEBUG - Requesting: http://10.0.0.30:8108/Snh_VirtualMachineDatabaseList?x=01882859-2c17-43f2-8700-f2f395f82c31 2025-03-30 06:04:24,919 - INFO - Pod ctest-pod-01691980 with uuid 01882859-2c17-43f2-8700-f2f395f82c31 found in kube manager 2025-03-30 06:04:24,919 - INFO - Pod ctest-pod-01691980 verification passed 2025-03-30 06:04:24,925 - INFO - Pod ctest-pod-70400773 is in running state.Got IP 10.47.255.245 2025-03-30 06:04:24,982 - DEBUG - Pod ctest-pod-70400773 has vmi cf7cd292-0d2c-11f0-9efa-fa163e361bf8 2025-03-30 06:04:24,982 - INFO - Verified pod ctest-pod-70400773 in contrail-api 2025-03-30 06:04:24,997 - DEBUG - VMI cf7cd292-0d2c-11f0-9efa-fa163e361bf8 is active in agent 10.0.0.17 2025-03-30 06:04:24,997 - INFO - Verified Pod ctest-pod-70400773 in agent 10.0.0.17 2025-03-30 06:04:24,997 - DEBUG - Requesting: http://10.0.0.30:8108/Snh_VirtualMachineDatabaseList?x=809dfa53-57d4-400b-8ded-647d44978090 2025-03-30 06:04:25,005 - INFO - Pod ctest-pod-70400773 with uuid 809dfa53-57d4-400b-8ded-647d44978090 found in kube manager 2025-03-30 06:04:25,005 - INFO - Pod ctest-pod-70400773 verification passed 2025-03-30 06:04:25,010 - INFO - Pod ctest-pod-50148764 is in running state.Got IP 10.47.255.246 2025-03-30 06:04:25,023 - DEBUG - Pod ctest-pod-50148764 has vmi cf056824-0d2c-11f0-9efa-fa163e361bf8 2025-03-30 06:04:25,023 - INFO - Verified pod ctest-pod-50148764 in contrail-api 2025-03-30 06:04:25,037 - DEBUG - VMI cf056824-0d2c-11f0-9efa-fa163e361bf8 is active in agent 10.0.0.17 2025-03-30 06:04:25,037 - INFO - Verified Pod ctest-pod-50148764 in agent 10.0.0.17 2025-03-30 06:04:25,037 - DEBUG - Requesting: http://10.0.0.30:8108/Snh_VirtualMachineDatabaseList?x=5858181a-96c5-43b8-8dff-3738c92c23ea 2025-03-30 06:04:25,041 - INFO - Pod ctest-pod-50148764 with uuid 5858181a-96c5-43b8-8dff-3738c92c23ea found in kube manager 2025-03-30 06:04:25,041 - INFO - Pod ctest-pod-50148764 verification passed 2025-03-30 06:04:25,046 - INFO - Pod ctest-pod-74233288 is in running state.Got IP 10.47.255.244 2025-03-30 06:04:25,103 - DEBUG - Pod ctest-pod-74233288 has vmi cff85c50-0d2c-11f0-9efa-fa163e361bf8 2025-03-30 06:04:25,103 - INFO - Verified pod ctest-pod-74233288 in contrail-api 2025-03-30 06:04:25,119 - DEBUG - VMI cff85c50-0d2c-11f0-9efa-fa163e361bf8 is active in agent 10.0.0.17 2025-03-30 06:04:25,120 - INFO - Verified Pod ctest-pod-74233288 in agent 10.0.0.17 2025-03-30 06:04:25,120 - DEBUG - Requesting: http://10.0.0.30:8108/Snh_VirtualMachineDatabaseList?x=565cc0ea-ddc0-41ac-9ed0-546803cdf367 2025-03-30 06:04:25,124 - INFO - Pod ctest-pod-74233288 with uuid 565cc0ea-ddc0-41ac-9ed0-546803cdf367 found in kube manager 2025-03-30 06:04:25,124 - INFO - Pod ctest-pod-74233288 verification passed 2025-03-30 06:04:25,124 - INFO - ================================================================================ 2025-03-30 06:04:25,125 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-03-30 06:04:25,125 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-03-30 06:04:25,365 - DEBUG - Nothing to compare xmpp stats {'10.0.0.17': {'10.0.0.30': '0'}} with 2025-03-30 06:04:25,365 - INFO - Initial checks done. Running the testcase now 2025-03-30 06:04:25,365 - INFO - 2025-03-30 06:04:25,431 - DEBUG - [Pod ctest-pod-46851246] Cmd: echo ctest-pod-46851246 > /usr/share/nginx/html/index.html, Output: 2025-03-30 06:04:25,497 - DEBUG - [Pod ctest-pod-59024873] Cmd: echo ctest-pod-59024873 > /usr/share/nginx/html/index.html, Output: 2025-03-30 06:04:25,558 - DEBUG - [Pod ctest-pod-58869681] Cmd: echo ctest-pod-58869681 > /usr/share/nginx/html/index.html, Output: 2025-03-30 06:04:25,630 - DEBUG - [Pod ctest-pod-26978227] Cmd: echo ctest-pod-26978227 > /usr/share/nginx/html/index.html, Output: 2025-03-30 06:04:25,633 - DEBUG - Service ctest-nginx-svc-64569996 not present 2025-03-30 06:04:25,634 - INFO - Creating service ctest-nginx-svc-64569996 2025-03-30 06:04:25,654 - INFO - Created Service ctest-nginx-svc-64569996 2025-03-30 06:04:25,659 - WARNING - Service UUID e2ed9e4b-eef6-4b92-977a-53450c31134d not yet found in contrail-api 2025-03-30 06:04:26,666 - INFO - Validated that Service ctest-nginx-svc-64569996 is seen in contrail-api 2025-03-30 06:04:26,667 - DEBUG - Requesting: http://10.0.0.30:8108/Snh_LoadbalancerDatabaseList?x=e2ed9e4b-eef6-4b92-977a-53450c31134d 2025-03-30 06:04:26,673 - INFO - Service ctest-nginx-svc-64569996 with uuid e2ed9e4b-eef6-4b92-977a-53450c31134d found in kube manager 2025-03-30 06:04:26,673 - INFO - Service ctest-nginx-svc-64569996 verification passed 2025-03-30 06:04:27,787 - DEBUG - [Pod ctest-pod-01691980] Cmd: wget http://10.109.87.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.87.140:80 (10.109.87.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-59024873 2025-03-30 06:04:27,788 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd wget http://10.109.87.140:80/ -O - -T 5 -t 1 passed 2025-03-30 06:04:27,788 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd output: Connecting to 10.109.87.140:80 (10.109.87.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-59024873 2025-03-30 06:04:27,857 - DEBUG - [Pod ctest-pod-01691980] Cmd: wget http://10.109.87.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.87.140:80 (10.109.87.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-46851246 2025-03-30 06:04:27,858 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd wget http://10.109.87.140:80/ -O - -T 5 -t 1 passed 2025-03-30 06:04:27,858 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd output: Connecting to 10.109.87.140:80 (10.109.87.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-46851246 2025-03-30 06:04:27,858 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-46851246': 1, 'ctest-pod-59024873': 1} 2025-03-30 06:04:27,940 - DEBUG - [Pod ctest-pod-70400773] Cmd: wget http://10.109.87.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.87.140:80 (10.109.87.140:80) ctest-pod-46851246 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-30 06:04:27,940 - DEBUG - [Pod Pod ctest-pod-70400773] Cmd wget http://10.109.87.140:80/ -O - -T 5 -t 1 passed 2025-03-30 06:04:27,940 - DEBUG - [Pod Pod ctest-pod-70400773] Cmd output: Connecting to 10.109.87.140:80 (10.109.87.140:80) ctest-pod-46851246 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-30 06:04:28,006 - DEBUG - [Pod ctest-pod-70400773] Cmd: wget http://10.109.87.140:80/ -O - -T 5 -t 1 , Output: ctest-pod-59024873 Connecting to 10.109.87.140:80 (10.109.87.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-30 06:04:28,006 - DEBUG - [Pod Pod ctest-pod-70400773] Cmd wget http://10.109.87.140:80/ -O - -T 5 -t 1 passed 2025-03-30 06:04:28,006 - DEBUG - [Pod Pod ctest-pod-70400773] Cmd output: ctest-pod-59024873 Connecting to 10.109.87.140:80 (10.109.87.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-30 06:04:28,006 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-46851246': 1, 'ctest-pod-59024873': 1} 2025-03-30 06:04:28,009 - DEBUG - Network policy ingress-on-service not present 2025-03-30 06:04:28,085 - INFO - Creating Network Policy ingress-on-service 2025-03-30 06:04:28,107 - INFO - Network policy found in k8s 2025-03-30 06:04:28,107 - DEBUG - Requesting: http://10.0.0.30:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=61a6dcb1-d50a-4b4d-a482-d467abda84d3 2025-03-30 06:04:28,113 - INFO - Network Policy ingress-on-service with uuid 61a6dcb1-d50a-4b4d-a482-d467abda84d3 found in kube manager 2025-03-30 06:04:28,146 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-03-30 06:04:28,147 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-03-30 06:04:28,148 - DEBUG - Requesting: http://10.0.0.30:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=61a6dcb1-d50a-4b4d-a482-d467abda84d3 2025-03-30 06:04:28,178 - WARNING - Network policy with name ingress-on-service not found in agent 2025-03-30 06:04:30,179 - DEBUG - Requesting: http://10.0.0.30:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=61a6dcb1-d50a-4b4d-a482-d467abda84d3 2025-03-30 06:04:30,215 - INFO - Network policy with name ingress-on-service found in agent 2025-03-30 06:04:30,216 - INFO - Network Policy ingress-on-service verification passed 2025-03-30 06:04:35,281 - DEBUG - [Pod ctest-pod-01691980] Cmd: wget http://10.109.87.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:04:35,281 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd wget http://10.109.87.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:04:35,281 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:04:40,341 - DEBUG - [Pod ctest-pod-01691980] Cmd: wget http://10.109.87.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:04:40,341 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd wget http://10.109.87.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:04:40,341 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:04:45,417 - DEBUG - [Pod ctest-pod-01691980] Cmd: wget http://10.109.87.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:04:45,417 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd wget http://10.109.87.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:04:45,417 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:04:50,484 - DEBUG - [Pod ctest-pod-01691980] Cmd: wget http://10.109.87.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:04:50,485 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd wget http://10.109.87.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:04:50,485 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:04:55,552 - DEBUG - [Pod ctest-pod-01691980] Cmd: wget http://10.109.87.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:04:55,553 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd wget http://10.109.87.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:04:55,553 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:05:00,626 - DEBUG - [Pod ctest-pod-01691980] Cmd: wget http://10.109.87.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:05:00,626 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd wget http://10.109.87.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:05:00,626 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:05:05,683 - DEBUG - [Pod ctest-pod-01691980] Cmd: wget http://10.109.87.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:05:05,683 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd wget http://10.109.87.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:05:05,683 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:05:10,739 - DEBUG - [Pod ctest-pod-01691980] Cmd: wget http://10.109.87.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:05:10,739 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd wget http://10.109.87.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:05:10,739 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:05:15,789 - DEBUG - [Pod ctest-pod-01691980] Cmd: wget http://10.109.87.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:05:15,789 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd wget http://10.109.87.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:05:15,789 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:05:20,846 - DEBUG - [Pod ctest-pod-01691980] Cmd: wget http://10.109.87.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:05:20,846 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd wget http://10.109.87.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:05:20,846 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:05:20,846 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-46851246': 0, 'ctest-pod-59024873': 0} 2025-03-30 06:05:20,920 - DEBUG - [Pod ctest-pod-50148764] Cmd: wget http://10.109.87.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.87.140:80 (10.109.87.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-59024873 2025-03-30 06:05:20,920 - DEBUG - [Pod Pod ctest-pod-50148764] Cmd wget http://10.109.87.140:80/ -O - -T 5 -t 1 passed 2025-03-30 06:05:20,920 - DEBUG - [Pod Pod ctest-pod-50148764] Cmd output: Connecting to 10.109.87.140:80 (10.109.87.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-59024873 2025-03-30 06:05:20,988 - DEBUG - [Pod ctest-pod-50148764] Cmd: wget http://10.109.87.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.87.140:80 (10.109.87.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-59024873 2025-03-30 06:05:20,989 - DEBUG - [Pod Pod ctest-pod-50148764] Cmd wget http://10.109.87.140:80/ -O - -T 5 -t 1 passed 2025-03-30 06:05:20,989 - DEBUG - [Pod Pod ctest-pod-50148764] Cmd output: Connecting to 10.109.87.140:80 (10.109.87.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-59024873 2025-03-30 06:05:21,054 - DEBUG - [Pod ctest-pod-50148764] Cmd: wget http://10.109.87.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.87.140:80 (10.109.87.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-59024873 2025-03-30 06:05:21,055 - DEBUG - [Pod Pod ctest-pod-50148764] Cmd wget http://10.109.87.140:80/ -O - -T 5 -t 1 passed 2025-03-30 06:05:21,055 - DEBUG - [Pod Pod ctest-pod-50148764] Cmd output: Connecting to 10.109.87.140:80 (10.109.87.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-59024873 2025-03-30 06:05:21,119 - DEBUG - [Pod ctest-pod-50148764] Cmd: wget http://10.109.87.140:80/ -O - -T 5 -t 1 , Output: ctest-pod-59024873 Connecting to 10.109.87.140:80 (10.109.87.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-30 06:05:21,119 - DEBUG - [Pod Pod ctest-pod-50148764] Cmd wget http://10.109.87.140:80/ -O - -T 5 -t 1 passed 2025-03-30 06:05:21,119 - DEBUG - [Pod Pod ctest-pod-50148764] Cmd output: ctest-pod-59024873 Connecting to 10.109.87.140:80 (10.109.87.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-30 06:05:21,192 - DEBUG - [Pod ctest-pod-50148764] Cmd: wget http://10.109.87.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.87.140:80 (10.109.87.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-46851246 2025-03-30 06:05:21,192 - DEBUG - [Pod Pod ctest-pod-50148764] Cmd wget http://10.109.87.140:80/ -O - -T 5 -t 1 passed 2025-03-30 06:05:21,192 - DEBUG - [Pod Pod ctest-pod-50148764] Cmd output: Connecting to 10.109.87.140:80 (10.109.87.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-46851246 2025-03-30 06:05:21,192 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-46851246': 1, 'ctest-pod-59024873': 4} 2025-03-30 06:05:26,261 - DEBUG - [Pod ctest-pod-70400773] Cmd: wget http://10.109.87.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:05:26,261 - DEBUG - [Pod Pod ctest-pod-70400773] Cmd wget http://10.109.87.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:05:26,261 - DEBUG - [Pod Pod ctest-pod-70400773] Cmd output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:05:31,330 - DEBUG - [Pod ctest-pod-70400773] Cmd: wget http://10.109.87.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:05:31,330 - DEBUG - [Pod Pod ctest-pod-70400773] Cmd wget http://10.109.87.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:05:31,330 - DEBUG - [Pod Pod ctest-pod-70400773] Cmd output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:05:36,401 - DEBUG - [Pod ctest-pod-70400773] Cmd: wget http://10.109.87.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:05:36,406 - DEBUG - [Pod Pod ctest-pod-70400773] Cmd wget http://10.109.87.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:05:36,407 - DEBUG - [Pod Pod ctest-pod-70400773] Cmd output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:05:41,474 - DEBUG - [Pod ctest-pod-70400773] Cmd: wget http://10.109.87.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:05:41,475 - DEBUG - [Pod Pod ctest-pod-70400773] Cmd wget http://10.109.87.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:05:41,475 - DEBUG - [Pod Pod ctest-pod-70400773] Cmd output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:05:46,533 - DEBUG - [Pod ctest-pod-70400773] Cmd: wget http://10.109.87.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:05:46,533 - DEBUG - [Pod Pod ctest-pod-70400773] Cmd wget http://10.109.87.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:05:46,533 - DEBUG - [Pod Pod ctest-pod-70400773] Cmd output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:05:51,607 - DEBUG - [Pod ctest-pod-70400773] Cmd: wget http://10.109.87.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:05:51,607 - DEBUG - [Pod Pod ctest-pod-70400773] Cmd wget http://10.109.87.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:05:51,607 - DEBUG - [Pod Pod ctest-pod-70400773] Cmd output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:05:56,675 - DEBUG - [Pod ctest-pod-70400773] Cmd: wget http://10.109.87.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:05:56,675 - DEBUG - [Pod Pod ctest-pod-70400773] Cmd wget http://10.109.87.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:05:56,675 - DEBUG - [Pod Pod ctest-pod-70400773] Cmd output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:06:01,746 - DEBUG - [Pod ctest-pod-70400773] Cmd: wget http://10.109.87.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:06:01,746 - DEBUG - [Pod Pod ctest-pod-70400773] Cmd wget http://10.109.87.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:06:01,746 - DEBUG - [Pod Pod ctest-pod-70400773] Cmd output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:06:06,810 - DEBUG - [Pod ctest-pod-70400773] Cmd: wget http://10.109.87.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:06:06,810 - DEBUG - [Pod Pod ctest-pod-70400773] Cmd wget http://10.109.87.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:06:06,810 - DEBUG - [Pod Pod ctest-pod-70400773] Cmd output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:06:11,879 - DEBUG - [Pod ctest-pod-70400773] Cmd: wget http://10.109.87.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:06:11,879 - DEBUG - [Pod Pod ctest-pod-70400773] Cmd wget http://10.109.87.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:06:11,879 - DEBUG - [Pod Pod ctest-pod-70400773] Cmd output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:06:11,879 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-46851246': 0, 'ctest-pod-59024873': 0} 2025-03-30 06:06:13,965 - DEBUG - [Pod ctest-pod-50148764] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.352 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.081 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.115 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.081/0.516/1.352 ms 2025-03-30 06:06:13,965 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-50148764 with expectation True passed 2025-03-30 06:06:16,026 - DEBUG - [Pod ctest-pod-01691980] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.415 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.085 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.099 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.085/0.533/1.415 ms 2025-03-30 06:06:16,026 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-01691980 with expectation True passed 2025-03-30 06:06:18,107 - DEBUG - [Pod ctest-pod-70400773] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.790 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.083 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.105 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.083/0.659/1.790 ms 2025-03-30 06:06:18,107 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-70400773 with expectation True passed 2025-03-30 06:06:18,186 - DEBUG - [Pod ctest-pod-50148764] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-30 06:06:18,186 - DEBUG - [Pod Pod ctest-pod-50148764] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-03-30 06:06:18,186 - DEBUG - [Pod Pod ctest-pod-50148764] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-30 06:06:18,186 - INFO - wget check of of http://10.47.255.251 from ctest-pod-50148764 passed 2025-03-30 06:06:18,255 - DEBUG - [Pod ctest-pod-50148764] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-30 06:06:18,255 - DEBUG - [Pod Pod ctest-pod-50148764] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-03-30 06:06:18,255 - DEBUG - [Pod Pod ctest-pod-50148764] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-30 06:06:18,255 - INFO - wget check of of http://10.47.255.250 from ctest-pod-50148764 passed 2025-03-30 06:06:23,329 - DEBUG - [Pod ctest-pod-01691980] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-30 06:06:23,329 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-30 06:06:23,329 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-30 06:06:23,329 - INFO - wget check of of http://10.47.255.250 from ctest-pod-01691980 passed 2025-03-30 06:06:28,386 - DEBUG - [Pod ctest-pod-74233288] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-03-30 06:06:28,386 - DEBUG - [Pod Pod ctest-pod-74233288] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-03-30 06:06:28,386 - DEBUG - [Pod Pod ctest-pod-74233288] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-03-30 06:06:28,386 - INFO - wget check of of http://10.47.255.251 from ctest-pod-74233288 passed 2025-03-30 06:06:28,395 - INFO - Updating Network Policy ingress-on-service 2025-03-30 06:06:33,461 - DEBUG - [Pod ctest-pod-01691980] Cmd: wget http://10.109.87.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:06:33,461 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd wget http://10.109.87.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:06:33,462 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:06:38,537 - DEBUG - [Pod ctest-pod-01691980] Cmd: wget http://10.109.87.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:06:38,537 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd wget http://10.109.87.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:06:38,537 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:06:43,590 - DEBUG - [Pod ctest-pod-01691980] Cmd: wget http://10.109.87.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:06:43,590 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd wget http://10.109.87.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:06:43,590 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:06:48,675 - DEBUG - [Pod ctest-pod-01691980] Cmd: wget http://10.109.87.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:06:48,676 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd wget http://10.109.87.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:06:48,676 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:06:53,741 - DEBUG - [Pod ctest-pod-01691980] Cmd: wget http://10.109.87.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:06:53,741 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd wget http://10.109.87.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:06:53,741 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:06:58,802 - DEBUG - [Pod ctest-pod-01691980] Cmd: wget http://10.109.87.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:06:58,803 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd wget http://10.109.87.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:06:58,803 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:07:03,878 - DEBUG - [Pod ctest-pod-01691980] Cmd: wget http://10.109.87.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:07:03,878 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd wget http://10.109.87.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:07:03,878 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:07:08,940 - DEBUG - [Pod ctest-pod-01691980] Cmd: wget http://10.109.87.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:07:08,940 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd wget http://10.109.87.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:07:08,940 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:07:14,014 - DEBUG - [Pod ctest-pod-01691980] Cmd: wget http://10.109.87.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:07:14,014 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd wget http://10.109.87.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:07:14,014 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:07:19,073 - DEBUG - [Pod ctest-pod-01691980] Cmd: wget http://10.109.87.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:07:19,073 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd wget http://10.109.87.140:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:07:19,073 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd output: Connecting to 10.109.87.140:80 (10.109.87.140:80) wget: download timed out 2025-03-30 06:07:19,073 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-46851246': 0, 'ctest-pod-59024873': 0} 2025-03-30 06:07:19,139 - DEBUG - [Pod ctest-pod-50148764] Cmd: wget http://10.109.87.140:80/ -O - -T 5 -t 1 , Output: ctest-pod-59024873 Connecting to 10.109.87.140:80 (10.109.87.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-30 06:07:19,139 - DEBUG - [Pod Pod ctest-pod-50148764] Cmd wget http://10.109.87.140:80/ -O - -T 5 -t 1 passed 2025-03-30 06:07:19,139 - DEBUG - [Pod Pod ctest-pod-50148764] Cmd output: ctest-pod-59024873 Connecting to 10.109.87.140:80 (10.109.87.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-30 06:07:19,203 - DEBUG - [Pod ctest-pod-50148764] Cmd: wget http://10.109.87.140:80/ -O - -T 5 -t 1 , Output: ctest-pod-46851246 Connecting to 10.109.87.140:80 (10.109.87.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-30 06:07:19,203 - DEBUG - [Pod Pod ctest-pod-50148764] Cmd wget http://10.109.87.140:80/ -O - -T 5 -t 1 passed 2025-03-30 06:07:19,203 - DEBUG - [Pod Pod ctest-pod-50148764] Cmd output: ctest-pod-46851246 Connecting to 10.109.87.140:80 (10.109.87.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-30 06:07:19,203 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-46851246': 1, 'ctest-pod-59024873': 1} 2025-03-30 06:07:19,250 - DEBUG - [Pod ctest-pod-70400773] Cmd: wget http://10.109.87.140:80/ -O - -T 5 -t 1 , Output: ctest-pod-46851246 Connecting to 10.109.87.140:80 (10.109.87.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-30 06:07:19,250 - DEBUG - [Pod Pod ctest-pod-70400773] Cmd wget http://10.109.87.140:80/ -O - -T 5 -t 1 passed 2025-03-30 06:07:19,250 - DEBUG - [Pod Pod ctest-pod-70400773] Cmd output: ctest-pod-46851246 Connecting to 10.109.87.140:80 (10.109.87.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-30 06:07:19,308 - DEBUG - [Pod ctest-pod-70400773] Cmd: wget http://10.109.87.140:80/ -O - -T 5 -t 1 , Output: ctest-pod-46851246 Connecting to 10.109.87.140:80 (10.109.87.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-30 06:07:19,308 - DEBUG - [Pod Pod ctest-pod-70400773] Cmd wget http://10.109.87.140:80/ -O - -T 5 -t 1 passed 2025-03-30 06:07:19,308 - DEBUG - [Pod Pod ctest-pod-70400773] Cmd output: ctest-pod-46851246 Connecting to 10.109.87.140:80 (10.109.87.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-30 06:07:19,371 - DEBUG - [Pod ctest-pod-70400773] Cmd: wget http://10.109.87.140:80/ -O - -T 5 -t 1 , Output: ctest-pod-46851246 Connecting to 10.109.87.140:80 (10.109.87.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-30 06:07:19,371 - DEBUG - [Pod Pod ctest-pod-70400773] Cmd wget http://10.109.87.140:80/ -O - -T 5 -t 1 passed 2025-03-30 06:07:19,371 - DEBUG - [Pod Pod ctest-pod-70400773] Cmd output: ctest-pod-46851246 Connecting to 10.109.87.140:80 (10.109.87.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-30 06:07:19,425 - DEBUG - [Pod ctest-pod-70400773] Cmd: wget http://10.109.87.140:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.87.140:80 (10.109.87.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-59024873 2025-03-30 06:07:19,426 - DEBUG - [Pod Pod ctest-pod-70400773] Cmd wget http://10.109.87.140:80/ -O - -T 5 -t 1 passed 2025-03-30 06:07:19,426 - DEBUG - [Pod Pod ctest-pod-70400773] Cmd output: Connecting to 10.109.87.140:80 (10.109.87.140:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-59024873 2025-03-30 06:07:19,426 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-46851246': 3, 'ctest-pod-59024873': 1} 2025-03-30 06:07:21,503 - DEBUG - [Pod ctest-pod-50148764] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.527 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.087 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.085 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.085/0.233/0.527 ms 2025-03-30 06:07:21,504 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-50148764 with expectation True passed 2025-03-30 06:07:23,566 - DEBUG - [Pod ctest-pod-01691980] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.626 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.094 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.089 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.089/0.269/0.626 ms 2025-03-30 06:07:23,566 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-01691980 with expectation True passed 2025-03-30 06:07:25,638 - DEBUG - [Pod ctest-pod-70400773] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.985 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.084 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.089 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.084/0.386/0.985 ms 2025-03-30 06:07:25,638 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-70400773 with expectation True passed 2025-03-30 06:07:25,715 - DEBUG - [Pod ctest-pod-50148764] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-30 06:07:25,715 - DEBUG - [Pod Pod ctest-pod-50148764] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-03-30 06:07:25,715 - DEBUG - [Pod Pod ctest-pod-50148764] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-30 06:07:25,715 - INFO - wget check of of http://10.47.255.251 from ctest-pod-50148764 passed 2025-03-30 06:07:25,771 - DEBUG - [Pod ctest-pod-50148764] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-30 06:07:25,771 - DEBUG - [Pod Pod ctest-pod-50148764] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-03-30 06:07:25,771 - DEBUG - [Pod Pod ctest-pod-50148764] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-30 06:07:25,771 - INFO - wget check of of http://10.47.255.250 from ctest-pod-50148764 passed 2025-03-30 06:07:30,828 - DEBUG - [Pod ctest-pod-01691980] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-30 06:07:30,828 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-30 06:07:30,829 - DEBUG - [Pod Pod ctest-pod-01691980] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-30 06:07:30,829 - INFO - wget check of of http://10.47.255.250 from ctest-pod-01691980 passed 2025-03-30 06:07:30,887 - DEBUG - [Pod ctest-pod-74233288] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-30 06:07:30,887 - DEBUG - [Pod Pod ctest-pod-74233288] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-03-30 06:07:30,887 - DEBUG - [Pod Pod ctest-pod-74233288] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-30 06:07:30,887 - INFO - wget check of of http://10.47.255.251 from ctest-pod-74233288 passed 2025-03-30 06:07:30,888 - INFO - Deleting Network Policy : ingress-on-service 2025-03-30 06:07:30,888 - INFO - Deleting service : ctest-nginx-svc-64569996 2025-03-30 06:07:31,157 - DEBUG - No XMPP flaps were noticed during the test 2025-03-30 06:07:31,157 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:06] 2025-03-30 06:07:31,157 - INFO - -------------------------------------------------------------------------------- 2025-03-30 06:07:31,162 - INFO - Deleting pod ctest-new-default-31346320:ctest-pod-46851246 2025-03-30 06:07:31,163 - INFO - Deleting pod ctest-new-default-31346320:ctest-pod-59024873 2025-03-30 06:07:31,163 - INFO - Deleting pod ctest-non-default-34727667:ctest-pod-58869681 2025-03-30 06:07:31,163 - INFO - Deleting pod ctest-non-default-34727667:ctest-pod-26978227 2025-03-30 06:07:31,164 - INFO - Deleting pod ctest-new-default-31346320:ctest-pod-01691980 2025-03-30 06:07:31,164 - INFO - Deleting pod ctest-new-default-31346320:ctest-pod-50148764 2025-03-30 06:07:31,164 - INFO - Deleting pod ctest-non-default-34727667:ctest-pod-70400773 2025-03-30 06:07:31,165 - INFO - Deleting pod ctest-non-default-34727667:ctest-pod-74233288 2025-03-30 06:07:31,257 - WARNING - Pod uuid 3dc858f8-fca0-455d-a84d-f1c19193a11a is still seen in agent 10.0.0.17 VM list 2025-03-30 06:07:31,324 - WARNING - Pod uuid 889517d4-3f55-4f24-94d8-0c6a13c13820 is still seen in agent 10.0.0.17 VM list 2025-03-30 06:07:31,325 - WARNING - Pod uuid 565cc0ea-ddc0-41ac-9ed0-546803cdf367 is still seen in agent 10.0.0.17 VM list 2025-03-30 06:07:31,326 - WARNING - Pod uuid 01882859-2c17-43f2-8700-f2f395f82c31 is still seen in agent 10.0.0.17 VM list 2025-03-30 06:07:31,326 - WARNING - Pod uuid 809dfa53-57d4-400b-8ded-647d44978090 is still seen in agent 10.0.0.17 VM list 2025-03-30 06:07:31,327 - WARNING - Pod uuid 22d342f5-aad7-47af-9457-8b4415793706 is still seen in agent 10.0.0.17 VM list 2025-03-30 06:07:31,327 - WARNING - Pod uuid 5858181a-96c5-43b8-8dff-3738c92c23ea is still seen in agent 10.0.0.17 VM list 2025-03-30 06:07:31,327 - WARNING - Pod uuid 9698b0b9-cc6b-4971-812f-a60ccd9af8f4 is still seen in agent 10.0.0.17 VM list 2025-03-30 06:07:36,267 - DEBUG - Pod 3dc858f8-fca0-455d-a84d-f1c19193a11a is not in agent 10.0.0.17 VM list 2025-03-30 06:07:36,275 - DEBUG - VMI cc510458-0d2c-11f0-9efa-fa163e361bf8 is removed from agent 10.0.0.17 2025-03-30 06:07:36,275 - INFO - Verified that pod ctest-pod-46851246 is removed in agent 2025-03-30 06:07:36,355 - WARNING - Pod uuid 01882859-2c17-43f2-8700-f2f395f82c31 is still seen in agent 10.0.0.17 VM list 2025-03-30 06:07:36,357 - DEBUG - Pod 22d342f5-aad7-47af-9457-8b4415793706 is not in agent 10.0.0.17 VM list 2025-03-30 06:07:36,358 - WARNING - Pod uuid 809dfa53-57d4-400b-8ded-647d44978090 is still seen in agent 10.0.0.17 VM list 2025-03-30 06:07:36,359 - WARNING - Pod uuid 5858181a-96c5-43b8-8dff-3738c92c23ea is still seen in agent 10.0.0.17 VM list 2025-03-30 06:07:36,359 - DEBUG - Pod 9698b0b9-cc6b-4971-812f-a60ccd9af8f4 is not in agent 10.0.0.17 VM list 2025-03-30 06:07:36,360 - WARNING - Pod uuid 565cc0ea-ddc0-41ac-9ed0-546803cdf367 is still seen in agent 10.0.0.17 VM list 2025-03-30 06:07:36,361 - DEBUG - Pod 889517d4-3f55-4f24-94d8-0c6a13c13820 is not in agent 10.0.0.17 VM list 2025-03-30 06:07:36,372 - DEBUG - VMI cdfff304-0d2c-11f0-9efa-fa163e361bf8 is removed from agent 10.0.0.17 2025-03-30 06:07:36,372 - INFO - Verified that pod ctest-pod-26978227 is removed in agent 2025-03-30 06:07:36,374 - DEBUG - VMI ccbf0214-0d2c-11f0-9efa-fa163e361bf8 is removed from agent 10.0.0.17 2025-03-30 06:07:36,374 - INFO - Verified that pod ctest-pod-59024873 is removed in agent 2025-03-30 06:07:36,374 - DEBUG - VMI cd75dfac-0d2c-11f0-9efa-fa163e361bf8 is removed from agent 10.0.0.17 2025-03-30 06:07:36,374 - INFO - Verified that pod ctest-pod-58869681 is removed in agent 2025-03-30 06:07:41,365 - WARNING - Pod uuid 01882859-2c17-43f2-8700-f2f395f82c31 is still seen in agent 10.0.0.17 VM list 2025-03-30 06:07:41,374 - WARNING - Pod uuid 809dfa53-57d4-400b-8ded-647d44978090 is still seen in agent 10.0.0.17 VM list 2025-03-30 06:07:41,376 - WARNING - Pod uuid 565cc0ea-ddc0-41ac-9ed0-546803cdf367 is still seen in agent 10.0.0.17 VM list 2025-03-30 06:07:41,377 - WARNING - Pod uuid 5858181a-96c5-43b8-8dff-3738c92c23ea is still seen in agent 10.0.0.17 VM list 2025-03-30 06:07:46,373 - WARNING - Pod uuid 01882859-2c17-43f2-8700-f2f395f82c31 is still seen in agent 10.0.0.17 VM list 2025-03-30 06:07:46,391 - WARNING - Pod uuid 809dfa53-57d4-400b-8ded-647d44978090 is still seen in agent 10.0.0.17 VM list 2025-03-30 06:07:46,393 - WARNING - Pod uuid 5858181a-96c5-43b8-8dff-3738c92c23ea is still seen in agent 10.0.0.17 VM list 2025-03-30 06:07:46,393 - WARNING - Pod uuid 565cc0ea-ddc0-41ac-9ed0-546803cdf367 is still seen in agent 10.0.0.17 VM list 2025-03-30 06:07:51,382 - WARNING - Pod uuid 01882859-2c17-43f2-8700-f2f395f82c31 is still seen in agent 10.0.0.17 VM list 2025-03-30 06:07:51,407 - WARNING - Pod uuid 809dfa53-57d4-400b-8ded-647d44978090 is still seen in agent 10.0.0.17 VM list 2025-03-30 06:07:51,409 - WARNING - Pod uuid 5858181a-96c5-43b8-8dff-3738c92c23ea is still seen in agent 10.0.0.17 VM list 2025-03-30 06:07:51,409 - WARNING - Pod uuid 565cc0ea-ddc0-41ac-9ed0-546803cdf367 is still seen in agent 10.0.0.17 VM list 2025-03-30 06:07:56,390 - WARNING - Pod uuid 01882859-2c17-43f2-8700-f2f395f82c31 is still seen in agent 10.0.0.17 VM list 2025-03-30 06:07:56,424 - WARNING - Pod uuid 809dfa53-57d4-400b-8ded-647d44978090 is still seen in agent 10.0.0.17 VM list 2025-03-30 06:07:56,425 - WARNING - Pod uuid 565cc0ea-ddc0-41ac-9ed0-546803cdf367 is still seen in agent 10.0.0.17 VM list 2025-03-30 06:07:56,426 - WARNING - Pod uuid 5858181a-96c5-43b8-8dff-3738c92c23ea is still seen in agent 10.0.0.17 VM list 2025-03-30 06:08:01,401 - WARNING - Pod uuid 01882859-2c17-43f2-8700-f2f395f82c31 is still seen in agent 10.0.0.17 VM list 2025-03-30 06:08:01,448 - WARNING - Pod uuid 809dfa53-57d4-400b-8ded-647d44978090 is still seen in agent 10.0.0.17 VM list 2025-03-30 06:08:01,449 - WARNING - Pod uuid 565cc0ea-ddc0-41ac-9ed0-546803cdf367 is still seen in agent 10.0.0.17 VM list 2025-03-30 06:08:01,449 - WARNING - Pod uuid 5858181a-96c5-43b8-8dff-3738c92c23ea is still seen in agent 10.0.0.17 VM list 2025-03-30 06:08:06,409 - DEBUG - Pod 01882859-2c17-43f2-8700-f2f395f82c31 is not in agent 10.0.0.17 VM list 2025-03-30 06:08:06,416 - DEBUG - VMI ce8cc81a-0d2c-11f0-9efa-fa163e361bf8 is removed from agent 10.0.0.17 2025-03-30 06:08:06,416 - INFO - Verified that pod ctest-pod-01691980 is removed in agent 2025-03-30 06:08:06,463 - DEBUG - Pod 809dfa53-57d4-400b-8ded-647d44978090 is not in agent 10.0.0.17 VM list 2025-03-30 06:08:06,466 - DEBUG - Pod 565cc0ea-ddc0-41ac-9ed0-546803cdf367 is not in agent 10.0.0.17 VM list 2025-03-30 06:08:06,468 - DEBUG - Pod 5858181a-96c5-43b8-8dff-3738c92c23ea is not in agent 10.0.0.17 VM list 2025-03-30 06:08:06,482 - DEBUG - VMI cf056824-0d2c-11f0-9efa-fa163e361bf8 is removed from agent 10.0.0.17 2025-03-30 06:08:06,482 - INFO - Verified that pod ctest-pod-50148764 is removed in agent 2025-03-30 06:08:06,482 - DEBUG - VMI cff85c50-0d2c-11f0-9efa-fa163e361bf8 is removed from agent 10.0.0.17 2025-03-30 06:08:06,483 - INFO - Verified that pod ctest-pod-74233288 is removed in agent 2025-03-30 06:08:06,483 - DEBUG - VMI cf7cd292-0d2c-11f0-9efa-fa163e361bf8 is removed from agent 10.0.0.17 2025-03-30 06:08:06,483 - INFO - Verified that pod ctest-pod-70400773 is removed in agent 2025-03-30 06:08:06,483 - INFO - Deleting namespace ctest-non-default-34727667 2025-03-30 06:08:06,497 - DEBUG - Namespace ctest-non-default-34727667 still in k8s 2025-03-30 06:08:08,502 - DEBUG - Namespace ctest-non-default-34727667 still in k8s 2025-03-30 06:08:10,512 - DEBUG - Namespace ctest-non-default-34727667 still in k8s 2025-03-30 06:08:12,516 - DEBUG - Namespace ctest-non-default-34727667 is not in k8s 2025-03-30 06:08:12,517 - DEBUG - No need to check project deletion in contrail-api 2025-03-30 06:08:12,517 - INFO - Deleting namespace ctest-new-default-31346320 2025-03-30 06:08:12,525 - DEBUG - Namespace ctest-new-default-31346320 still in k8s 2025-03-30 06:08:14,537 - DEBUG - Namespace ctest-new-default-31346320 still in k8s 2025-03-30 06:08:16,542 - DEBUG - Namespace ctest-new-default-31346320 still in k8s 2025-03-30 06:08:18,546 - DEBUG - Namespace ctest-new-default-31346320 is not in k8s 2025-03-30 06:08:18,546 - DEBUG - No need to check project deletion in contrail-api