2025-04-26 10:32:04,125 - INFO - Using existing project ['default-domain', 'k8s-default'](cde8c0f8-4220-484b-865b-bb5722783246)
2025-04-26 10:32:04,152 - DEBUG - Namespace ctest-new-default-26626428 not present
2025-04-26 10:32:04,163 - INFO - Created namespace ctest-new-default-26626428
2025-04-26 10:32:07,170 - DEBUG - Namespace ctest-non-default-75157367 not present
2025-04-26 10:32:07,176 - INFO - Created namespace ctest-non-default-75157367
2025-04-26 10:32:10,192 - DEBUG - Pod ctest-pod-79790693 not present
2025-04-26 10:32:10,193 - INFO - Creating Pod ctest-pod-79790693
2025-04-26 10:32:10,209 - DEBUG - Pod : ctest-pod-79790693 UUID is ff8ab95c-41df-453e-ba9f-04e5d7f283d7
2025-04-26 10:32:10,213 - DEBUG - Pod ctest-pod-03680780 not present
2025-04-26 10:32:10,213 - INFO - Creating Pod ctest-pod-03680780
2025-04-26 10:32:10,229 - DEBUG - Pod : ctest-pod-03680780 UUID is 9ae36f2c-e7fc-4f19-b69e-491169f9405e
2025-04-26 10:32:10,233 - DEBUG - Pod ctest-pod-24205269 not present
2025-04-26 10:32:10,233 - INFO - Creating Pod ctest-pod-24205269
2025-04-26 10:32:10,254 - DEBUG - Pod : ctest-pod-24205269 UUID is cef49011-77bf-4b03-a970-70739e6c2f35
2025-04-26 10:32:10,256 - DEBUG - Pod ctest-pod-44942131 not present
2025-04-26 10:32:10,256 - INFO - Creating Pod ctest-pod-44942131
2025-04-26 10:32:10,272 - DEBUG - Pod : ctest-pod-44942131 UUID is 4496bb80-cb21-4bf8-9e62-87738f105300
2025-04-26 10:32:10,275 - DEBUG - Pod ctest-pod-26790021 not present
2025-04-26 10:32:10,275 - INFO - Creating Pod ctest-pod-26790021
2025-04-26 10:32:10,293 - DEBUG - Pod : ctest-pod-26790021 UUID is ee35d8ec-687e-48e7-b92f-449c843c11ad
2025-04-26 10:32:10,301 - DEBUG - Pod ctest-pod-86421194 not present
2025-04-26 10:32:10,301 - INFO - Creating Pod ctest-pod-86421194
2025-04-26 10:32:10,319 - DEBUG - Pod : ctest-pod-86421194 UUID is 6ad19cec-76a7-4166-b32f-5ac46df2983d
2025-04-26 10:32:10,323 - DEBUG - Pod ctest-pod-26763466 not present
2025-04-26 10:32:10,323 - INFO - Creating Pod ctest-pod-26763466
2025-04-26 10:32:10,343 - DEBUG - Pod : ctest-pod-26763466 UUID is 4033b2c8-6684-4dda-b1bb-8ea6f0b6f587
2025-04-26 10:32:10,346 - DEBUG - Pod ctest-pod-89538151 not present
2025-04-26 10:32:10,346 - INFO - Creating Pod ctest-pod-89538151
2025-04-26 10:32:10,372 - DEBUG - Pod : ctest-pod-89538151 UUID is 304d71ca-3b6c-4b78-a555-0e45d666d4b1
2025-04-26 10:32:10,645 - INFO - Project default-domain:k8s-ctest-new-default-26626428 for Namespace ctest-new-default-26626428 is seen in contrail-api
2025-04-26 10:32:10,645 - DEBUG - Project uuid in Contrail is 486847c8-4d02-4824-8899-bc6e23445b2e
2025-04-26 10:32:10,861 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=26000fa7-2c4b-4abb-b9ee-8924713b09f8
2025-04-26 10:32:10,874 - INFO - Namespace ctest-new-default-26626428 with uuid 26000fa7-2c4b-4abb-b9ee-8924713b09f8 found in kube manager
2025-04-26 10:32:10,875 - INFO - Namespace ctest-new-default-26626428 verification passed
2025-04-26 10:32:11,346 - INFO - Project default-domain:k8s-ctest-non-default-75157367 for Namespace ctest-non-default-75157367 is seen in contrail-api
2025-04-26 10:32:11,346 - DEBUG - Project uuid in Contrail is 9466e5c7-56c9-4323-b3ec-565a9f5a1dc7
2025-04-26 10:32:11,346 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=90c221d5-78bb-4b9d-9945-9c773b2a5c3e
2025-04-26 10:32:11,353 - INFO - Namespace ctest-non-default-75157367 with uuid 90c221d5-78bb-4b9d-9945-9c773b2a5c3e found in kube manager
2025-04-26 10:32:11,353 - INFO - Namespace ctest-non-default-75157367 verification passed
2025-04-26 10:32:11,359 - DEBUG - Pod ctest-pod-79790693 not in running state.Currently in Pending
2025-04-26 10:32:16,366 - DEBUG - Pod ctest-pod-79790693 not in running state.Currently in Pending
2025-04-26 10:32:21,375 - INFO - Pod ctest-pod-79790693 is in running state.Got IP 10.47.255.250
2025-04-26 10:32:21,439 - DEBUG - Pod ctest-pod-79790693 has vmi b7856a24-2289-11f0-8713-024207d73545
2025-04-26 10:32:21,439 - INFO - Verified pod ctest-pod-79790693 in contrail-api
2025-04-26 10:32:21,451 - DEBUG - VMI b7856a24-2289-11f0-8713-024207d73545 is active in agent 10.0.0.22
2025-04-26 10:32:21,451 - INFO - Verified Pod ctest-pod-79790693 in agent 10.0.0.22
2025-04-26 10:32:21,452 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=ff8ab95c-41df-453e-ba9f-04e5d7f283d7
2025-04-26 10:32:21,456 - INFO - Pod ctest-pod-79790693 with uuid ff8ab95c-41df-453e-ba9f-04e5d7f283d7 found in kube manager
2025-04-26 10:32:21,456 - INFO - Pod ctest-pod-79790693 verification passed
2025-04-26 10:32:21,462 - DEBUG - Pod ctest-pod-03680780 not in running state.Currently in Pending
2025-04-26 10:32:26,468 - INFO - Pod ctest-pod-03680780 is in running state.Got IP 10.47.255.249
2025-04-26 10:32:26,528 - DEBUG - Pod ctest-pod-03680780 has vmi b8365af0-2289-11f0-8713-024207d73545
2025-04-26 10:32:26,528 - INFO - Verified pod ctest-pod-03680780 in contrail-api
2025-04-26 10:32:26,554 - DEBUG - VMI b8365af0-2289-11f0-8713-024207d73545 is active in agent 10.0.0.22
2025-04-26 10:32:26,554 - INFO - Verified Pod ctest-pod-03680780 in agent 10.0.0.22
2025-04-26 10:32:26,554 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=9ae36f2c-e7fc-4f19-b69e-491169f9405e
2025-04-26 10:32:26,561 - INFO - Pod ctest-pod-03680780 with uuid 9ae36f2c-e7fc-4f19-b69e-491169f9405e found in kube manager
2025-04-26 10:32:26,562 - INFO - Pod ctest-pod-03680780 verification passed
2025-04-26 10:32:26,569 - DEBUG - Pod ctest-pod-24205269 not in running state.Currently in Pending
2025-04-26 10:32:31,576 - INFO - Pod ctest-pod-24205269 is in running state.Got IP 10.47.255.248
2025-04-26 10:32:31,632 - DEBUG - Pod ctest-pod-24205269 has vmi b92f4714-2289-11f0-8713-024207d73545
2025-04-26 10:32:31,632 - INFO - Verified pod ctest-pod-24205269 in contrail-api
2025-04-26 10:32:31,642 - DEBUG - VMI b92f4714-2289-11f0-8713-024207d73545 is active in agent 10.0.0.22
2025-04-26 10:32:31,642 - INFO - Verified Pod ctest-pod-24205269 in agent 10.0.0.22
2025-04-26 10:32:31,642 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=cef49011-77bf-4b03-a970-70739e6c2f35
2025-04-26 10:32:31,647 - INFO - Pod ctest-pod-24205269 with uuid cef49011-77bf-4b03-a970-70739e6c2f35 found in kube manager
2025-04-26 10:32:31,647 - INFO - Pod ctest-pod-24205269 verification passed
2025-04-26 10:32:31,652 - INFO - Pod ctest-pod-44942131 is in running state.Got IP 10.47.255.247
2025-04-26 10:32:31,745 - DEBUG - Pod ctest-pod-44942131 has vmi b9df9362-2289-11f0-8713-024207d73545
2025-04-26 10:32:31,745 - INFO - Verified pod ctest-pod-44942131 in contrail-api
2025-04-26 10:32:31,755 - DEBUG - VMI b9df9362-2289-11f0-8713-024207d73545 is active in agent 10.0.0.22
2025-04-26 10:32:31,756 - INFO - Verified Pod ctest-pod-44942131 in agent 10.0.0.22
2025-04-26 10:32:31,756 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=4496bb80-cb21-4bf8-9e62-87738f105300
2025-04-26 10:32:31,760 - INFO - Pod ctest-pod-44942131 with uuid 4496bb80-cb21-4bf8-9e62-87738f105300 found in kube manager
2025-04-26 10:32:31,760 - INFO - Pod ctest-pod-44942131 verification passed
2025-04-26 10:32:31,765 - INFO - Pod ctest-pod-26790021 is in running state.Got IP 10.47.255.246
2025-04-26 10:32:31,858 - DEBUG - Pod ctest-pod-26790021 has vmi bab07e50-2289-11f0-8713-024207d73545
2025-04-26 10:32:31,858 - INFO - Verified pod ctest-pod-26790021 in contrail-api
2025-04-26 10:32:31,870 - DEBUG - VMI bab07e50-2289-11f0-8713-024207d73545 is active in agent 10.0.0.22
2025-04-26 10:32:31,870 - INFO - Verified Pod ctest-pod-26790021 in agent 10.0.0.22
2025-04-26 10:32:31,870 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=ee35d8ec-687e-48e7-b92f-449c843c11ad
2025-04-26 10:32:31,874 - INFO - Pod ctest-pod-26790021 with uuid ee35d8ec-687e-48e7-b92f-449c843c11ad found in kube manager
2025-04-26 10:32:31,874 - INFO - Pod ctest-pod-26790021 verification passed
2025-04-26 10:32:31,879 - INFO - Pod ctest-pod-26763466 is in running state.Got IP 10.47.255.244
2025-04-26 10:32:31,972 - DEBUG - Pod ctest-pod-26763466 has vmi bc377e40-2289-11f0-8713-024207d73545
2025-04-26 10:32:31,972 - INFO - Verified pod ctest-pod-26763466 in contrail-api
2025-04-26 10:32:31,982 - DEBUG - VMI bc377e40-2289-11f0-8713-024207d73545 is active in agent 10.0.0.22
2025-04-26 10:32:31,982 - INFO - Verified Pod ctest-pod-26763466 in agent 10.0.0.22
2025-04-26 10:32:31,982 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=4033b2c8-6684-4dda-b1bb-8ea6f0b6f587
2025-04-26 10:32:31,986 - INFO - Pod ctest-pod-26763466 with uuid 4033b2c8-6684-4dda-b1bb-8ea6f0b6f587 found in kube manager
2025-04-26 10:32:31,986 - INFO - Pod ctest-pod-26763466 verification passed
2025-04-26 10:32:31,992 - INFO - Pod ctest-pod-86421194 is in running state.Got IP 10.47.255.245
2025-04-26 10:32:32,085 - DEBUG - Pod ctest-pod-86421194 has vmi bb725a52-2289-11f0-8713-024207d73545
2025-04-26 10:32:32,085 - INFO - Verified pod ctest-pod-86421194 in contrail-api
2025-04-26 10:32:32,105 - DEBUG - VMI bb725a52-2289-11f0-8713-024207d73545 is active in agent 10.0.0.22
2025-04-26 10:32:32,105 - INFO - Verified Pod ctest-pod-86421194 in agent 10.0.0.22
2025-04-26 10:32:32,106 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=6ad19cec-76a7-4166-b32f-5ac46df2983d
2025-04-26 10:32:32,110 - INFO - Pod ctest-pod-86421194 with uuid 6ad19cec-76a7-4166-b32f-5ac46df2983d found in kube manager
2025-04-26 10:32:32,110 - INFO - Pod ctest-pod-86421194 verification passed
2025-04-26 10:32:32,115 - INFO - Pod ctest-pod-89538151 is in running state.Got IP 10.47.255.243
2025-04-26 10:32:32,212 - DEBUG - Pod ctest-pod-89538151 has vmi bd06c02e-2289-11f0-8713-024207d73545
2025-04-26 10:32:32,212 - INFO - Verified pod ctest-pod-89538151 in contrail-api
2025-04-26 10:32:32,224 - DEBUG - VMI bd06c02e-2289-11f0-8713-024207d73545 is active in agent 10.0.0.22
2025-04-26 10:32:32,224 - INFO - Verified Pod ctest-pod-89538151 in agent 10.0.0.22
2025-04-26 10:32:32,224 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=304d71ca-3b6c-4b78-a555-0e45d666d4b1
2025-04-26 10:32:32,229 - INFO - Pod ctest-pod-89538151 with uuid 304d71ca-3b6c-4b78-a555-0e45d666d4b1 found in kube manager
2025-04-26 10:32:32,229 - INFO - Pod ctest-pod-89538151 verification passed
2025-04-26 10:32:32,229 - INFO - ================================================================================
2025-04-26 10:32:32,229 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-04-26 10:32:32,229 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-04-26 10:32:32,474 - DEBUG - Nothing to compare xmpp stats {'10.0.0.22': {'10.0.0.22': '2'}} with
2025-04-26 10:32:32,474 - INFO - Initial checks done. Running the testcase now
2025-04-26 10:32:32,474 - INFO -
2025-04-26 10:32:32,552 - DEBUG - [Pod ctest-pod-79790693] Cmd: echo ctest-pod-79790693 > /usr/share/nginx/html/index.html, Output:
2025-04-26 10:32:32,626 - DEBUG - [Pod ctest-pod-03680780] Cmd: echo ctest-pod-03680780 > /usr/share/nginx/html/index.html, Output:
2025-04-26 10:32:32,694 - DEBUG - [Pod ctest-pod-24205269] Cmd: echo ctest-pod-24205269 > /usr/share/nginx/html/index.html, Output:
2025-04-26 10:32:32,788 - DEBUG - [Pod ctest-pod-44942131] Cmd: echo ctest-pod-44942131 > /usr/share/nginx/html/index.html, Output:
2025-04-26 10:32:32,792 - DEBUG - Service ctest-nginx-svc-79168387 not present
2025-04-26 10:32:32,792 - INFO - Creating service ctest-nginx-svc-79168387
2025-04-26 10:32:32,806 - INFO - Created Service ctest-nginx-svc-79168387
2025-04-26 10:32:32,814 - WARNING - Service UUID c6311334-115b-43aa-929f-0b7b47309025 not yet found in contrail-api
2025-04-26 10:32:33,823 - INFO - Validated that Service ctest-nginx-svc-79168387 is seen in contrail-api
2025-04-26 10:32:33,823 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_LoadbalancerDatabaseList?x=c6311334-115b-43aa-929f-0b7b47309025
2025-04-26 10:32:33,829 - INFO - Service ctest-nginx-svc-79168387 with uuid c6311334-115b-43aa-929f-0b7b47309025 found in kube manager
2025-04-26 10:32:33,829 - INFO - Service ctest-nginx-svc-79168387 verification passed
2025-04-26 10:32:34,948 - DEBUG - [Pod ctest-pod-26790021] Cmd: wget http://10.110.71.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
writing to stdout
ctest-pod-03680780
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-26 10:32:34,948 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd wget http://10.110.71.83:80/ -O - -T 5 -t 1 passed
2025-04-26 10:32:34,948 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
writing to stdout
ctest-pod-03680780
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-26 10:32:35,036 - DEBUG - [Pod ctest-pod-26790021] Cmd: wget http://10.110.71.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-03680780
2025-04-26 10:32:35,036 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd wget http://10.110.71.83:80/ -O - -T 5 -t 1 passed
2025-04-26 10:32:35,036 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-03680780
2025-04-26 10:32:35,098 - DEBUG - [Pod ctest-pod-26790021] Cmd: wget http://10.110.71.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-79790693
2025-04-26 10:32:35,098 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd wget http://10.110.71.83:80/ -O - -T 5 -t 1 passed
2025-04-26 10:32:35,098 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-79790693
2025-04-26 10:32:35,098 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-79790693': 1, 'ctest-pod-03680780': 2}
2025-04-26 10:32:35,165 - DEBUG - [Pod ctest-pod-26763466] Cmd: wget http://10.110.71.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-03680780
2025-04-26 10:32:35,165 - DEBUG - [Pod Pod ctest-pod-26763466] Cmd wget http://10.110.71.83:80/ -O - -T 5 -t 1 passed
2025-04-26 10:32:35,165 - DEBUG - [Pod Pod ctest-pod-26763466] Cmd output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-03680780
2025-04-26 10:32:35,242 - DEBUG - [Pod ctest-pod-26763466] Cmd: wget http://10.110.71.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
writing to stdout
ctest-pod-79790693
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-26 10:32:35,242 - DEBUG - [Pod Pod ctest-pod-26763466] Cmd wget http://10.110.71.83:80/ -O - -T 5 -t 1 passed
2025-04-26 10:32:35,242 - DEBUG - [Pod Pod ctest-pod-26763466] Cmd output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
writing to stdout
ctest-pod-79790693
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-26 10:32:35,242 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-79790693': 1, 'ctest-pod-03680780': 1}
2025-04-26 10:32:35,246 - DEBUG - Network policy ingress-on-service not present
2025-04-26 10:32:35,247 - INFO - Creating Network Policy ingress-on-service
2025-04-26 10:32:35,257 - INFO - Network policy found in k8s
2025-04-26 10:32:35,257 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=b7a92fd4-8cf0-4417-ae23-c2a89baf3b96
2025-04-26 10:32:35,263 - INFO - Network Policy ingress-on-service with uuid b7a92fd4-8cf0-4417-ae23-c2a89baf3b96 found in kube manager
2025-04-26 10:32:35,290 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-04-26 10:32:35,290 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-04-26 10:32:35,290 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=b7a92fd4-8cf0-4417-ae23-c2a89baf3b96
2025-04-26 10:32:35,314 - WARNING - Network policy with name ingress-on-service not found in agent
2025-04-26 10:32:37,314 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=b7a92fd4-8cf0-4417-ae23-c2a89baf3b96
2025-04-26 10:32:37,339 - WARNING - Network policy with name ingress-on-service not found in agent
2025-04-26 10:32:39,340 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=b7a92fd4-8cf0-4417-ae23-c2a89baf3b96
2025-04-26 10:32:39,368 - INFO - Network policy with name ingress-on-service found in agent
2025-04-26 10:32:39,369 - INFO - Network Policy ingress-on-service verification passed
2025-04-26 10:32:44,438 - DEBUG - [Pod ctest-pod-26790021] Cmd: wget http://10.110.71.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:32:44,438 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd wget http://10.110.71.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:32:44,438 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:32:49,504 - DEBUG - [Pod ctest-pod-26790021] Cmd: wget http://10.110.71.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:32:49,504 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd wget http://10.110.71.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:32:49,504 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:32:54,619 - DEBUG - [Pod ctest-pod-26790021] Cmd: wget http://10.110.71.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:32:54,619 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd wget http://10.110.71.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:32:54,619 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:32:59,689 - DEBUG - [Pod ctest-pod-26790021] Cmd: wget http://10.110.71.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:32:59,689 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd wget http://10.110.71.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:32:59,689 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:33:04,773 - DEBUG - [Pod ctest-pod-26790021] Cmd: wget http://10.110.71.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:33:04,774 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd wget http://10.110.71.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:33:04,774 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:33:09,842 - DEBUG - [Pod ctest-pod-26790021] Cmd: wget http://10.110.71.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:33:09,842 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd wget http://10.110.71.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:33:09,842 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:33:14,913 - DEBUG - [Pod ctest-pod-26790021] Cmd: wget http://10.110.71.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:33:14,913 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd wget http://10.110.71.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:33:14,913 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:33:19,973 - DEBUG - [Pod ctest-pod-26790021] Cmd: wget http://10.110.71.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:33:19,973 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd wget http://10.110.71.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:33:19,973 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:33:25,044 - DEBUG - [Pod ctest-pod-26790021] Cmd: wget http://10.110.71.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:33:25,044 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd wget http://10.110.71.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:33:25,044 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:33:30,107 - DEBUG - [Pod ctest-pod-26790021] Cmd: wget http://10.110.71.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:33:30,107 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd wget http://10.110.71.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:33:30,107 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:33:30,107 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-79790693': 0, 'ctest-pod-03680780': 0}
2025-04-26 10:33:30,179 - DEBUG - [Pod ctest-pod-86421194] Cmd: wget http://10.110.71.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-03680780
2025-04-26 10:33:30,179 - DEBUG - [Pod Pod ctest-pod-86421194] Cmd wget http://10.110.71.83:80/ -O - -T 5 -t 1 passed
2025-04-26 10:33:30,179 - DEBUG - [Pod Pod ctest-pod-86421194] Cmd output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-03680780
2025-04-26 10:33:30,247 - DEBUG - [Pod ctest-pod-86421194] Cmd: wget http://10.110.71.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
ctest-pod-79790693
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-26 10:33:30,247 - DEBUG - [Pod Pod ctest-pod-86421194] Cmd wget http://10.110.71.83:80/ -O - -T 5 -t 1 passed
2025-04-26 10:33:30,247 - DEBUG - [Pod Pod ctest-pod-86421194] Cmd output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
ctest-pod-79790693
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-26 10:33:30,247 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-79790693': 1, 'ctest-pod-03680780': 1}
2025-04-26 10:33:35,312 - DEBUG - [Pod ctest-pod-26763466] Cmd: wget http://10.110.71.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:33:35,312 - DEBUG - [Pod Pod ctest-pod-26763466] Cmd wget http://10.110.71.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:33:35,312 - DEBUG - [Pod Pod ctest-pod-26763466] Cmd output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:33:40,383 - DEBUG - [Pod ctest-pod-26763466] Cmd: wget http://10.110.71.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:33:40,383 - DEBUG - [Pod Pod ctest-pod-26763466] Cmd wget http://10.110.71.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:33:40,383 - DEBUG - [Pod Pod ctest-pod-26763466] Cmd output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:33:45,451 - DEBUG - [Pod ctest-pod-26763466] Cmd: wget http://10.110.71.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:33:45,452 - DEBUG - [Pod Pod ctest-pod-26763466] Cmd wget http://10.110.71.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:33:45,452 - DEBUG - [Pod Pod ctest-pod-26763466] Cmd output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:33:50,515 - DEBUG - [Pod ctest-pod-26763466] Cmd: wget http://10.110.71.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:33:50,515 - DEBUG - [Pod Pod ctest-pod-26763466] Cmd wget http://10.110.71.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:33:50,515 - DEBUG - [Pod Pod ctest-pod-26763466] Cmd output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:33:55,593 - DEBUG - [Pod ctest-pod-26763466] Cmd: wget http://10.110.71.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:33:55,593 - DEBUG - [Pod Pod ctest-pod-26763466] Cmd wget http://10.110.71.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:33:55,593 - DEBUG - [Pod Pod ctest-pod-26763466] Cmd output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:34:00,659 - DEBUG - [Pod ctest-pod-26763466] Cmd: wget http://10.110.71.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:34:00,659 - DEBUG - [Pod Pod ctest-pod-26763466] Cmd wget http://10.110.71.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:34:00,659 - DEBUG - [Pod Pod ctest-pod-26763466] Cmd output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:34:05,731 - DEBUG - [Pod ctest-pod-26763466] Cmd: wget http://10.110.71.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:34:05,731 - DEBUG - [Pod Pod ctest-pod-26763466] Cmd wget http://10.110.71.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:34:05,731 - DEBUG - [Pod Pod ctest-pod-26763466] Cmd output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:34:10,803 - DEBUG - [Pod ctest-pod-26763466] Cmd: wget http://10.110.71.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:34:10,803 - DEBUG - [Pod Pod ctest-pod-26763466] Cmd wget http://10.110.71.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:34:10,803 - DEBUG - [Pod Pod ctest-pod-26763466] Cmd output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:34:15,875 - DEBUG - [Pod ctest-pod-26763466] Cmd: wget http://10.110.71.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:34:15,876 - DEBUG - [Pod Pod ctest-pod-26763466] Cmd wget http://10.110.71.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:34:15,876 - DEBUG - [Pod Pod ctest-pod-26763466] Cmd output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:34:20,954 - DEBUG - [Pod ctest-pod-26763466] Cmd: wget http://10.110.71.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:34:20,954 - DEBUG - [Pod Pod ctest-pod-26763466] Cmd wget http://10.110.71.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:34:20,954 - DEBUG - [Pod Pod ctest-pod-26763466] Cmd output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:34:20,954 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-79790693': 0, 'ctest-pod-03680780': 0}
2025-04-26 10:34:23,014 - DEBUG - [Pod ctest-pod-86421194] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.406 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.060 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.072 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.060/0.179/0.406 ms
2025-04-26 10:34:23,014 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-86421194 with expectation True passed
2025-04-26 10:34:25,077 - DEBUG - [Pod ctest-pod-26790021] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes
64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.360 ms
64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.047 ms
64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.094 ms
--- 10.47.255.245 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.047/0.167/0.360 ms
2025-04-26 10:34:25,077 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-26790021 with expectation True passed
2025-04-26 10:34:27,146 - DEBUG - [Pod ctest-pod-26763466] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes
64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.792 ms
64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.051 ms
64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.064 ms
--- 10.47.255.245 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.051/0.302/0.792 ms
2025-04-26 10:34:27,146 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-26763466 with expectation True passed
2025-04-26 10:34:27,216 - DEBUG - [Pod ctest-pod-86421194] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-26 10:34:27,216 - DEBUG - [Pod Pod ctest-pod-86421194] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-04-26 10:34:27,216 - DEBUG - [Pod Pod ctest-pod-86421194] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-26 10:34:27,216 - INFO - wget check of of http://10.47.255.250 from ctest-pod-86421194 passed
2025-04-26 10:34:27,358 - DEBUG - [Pod ctest-pod-86421194] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-26 10:34:27,358 - DEBUG - [Pod Pod ctest-pod-86421194] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 passed
2025-04-26 10:34:27,358 - DEBUG - [Pod Pod ctest-pod-86421194] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-26 10:34:27,358 - INFO - wget check of of http://10.47.255.249 from ctest-pod-86421194 passed
2025-04-26 10:34:32,426 - DEBUG - [Pod ctest-pod-26790021] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2025-04-26 10:34:32,427 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2025-04-26 10:34:32,427 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2025-04-26 10:34:32,427 - INFO - wget check of of http://10.47.255.249 from ctest-pod-26790021 passed
2025-04-26 10:34:37,498 - DEBUG - [Pod ctest-pod-89538151] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-26 10:34:37,498 - DEBUG - [Pod Pod ctest-pod-89538151] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-26 10:34:37,498 - DEBUG - [Pod Pod ctest-pod-89538151] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-26 10:34:37,498 - INFO - wget check of of http://10.47.255.250 from ctest-pod-89538151 passed
2025-04-26 10:34:37,508 - INFO - Updating Network Policy ingress-on-service
2025-04-26 10:34:42,591 - DEBUG - [Pod ctest-pod-26790021] Cmd: wget http://10.110.71.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:34:42,591 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd wget http://10.110.71.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:34:42,591 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:34:47,660 - DEBUG - [Pod ctest-pod-26790021] Cmd: wget http://10.110.71.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:34:47,661 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd wget http://10.110.71.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:34:47,661 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:34:52,729 - DEBUG - [Pod ctest-pod-26790021] Cmd: wget http://10.110.71.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:34:52,729 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd wget http://10.110.71.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:34:52,729 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:34:57,796 - DEBUG - [Pod ctest-pod-26790021] Cmd: wget http://10.110.71.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:34:57,796 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd wget http://10.110.71.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:34:57,796 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:35:02,864 - DEBUG - [Pod ctest-pod-26790021] Cmd: wget http://10.110.71.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:35:02,864 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd wget http://10.110.71.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:35:02,864 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:35:07,927 - DEBUG - [Pod ctest-pod-26790021] Cmd: wget http://10.110.71.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:35:07,927 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd wget http://10.110.71.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:35:07,927 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:35:12,999 - DEBUG - [Pod ctest-pod-26790021] Cmd: wget http://10.110.71.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:35:12,999 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd wget http://10.110.71.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:35:12,999 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:35:18,084 - DEBUG - [Pod ctest-pod-26790021] Cmd: wget http://10.110.71.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:35:18,084 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd wget http://10.110.71.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:35:18,084 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:35:23,151 - DEBUG - [Pod ctest-pod-26790021] Cmd: wget http://10.110.71.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:35:23,152 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd wget http://10.110.71.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:35:23,152 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:35:28,227 - DEBUG - [Pod ctest-pod-26790021] Cmd: wget http://10.110.71.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:35:28,227 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd wget http://10.110.71.83:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:35:28,227 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
wget: download timed out
2025-04-26 10:35:28,227 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-79790693': 0, 'ctest-pod-03680780': 0}
2025-04-26 10:35:28,290 - DEBUG - [Pod ctest-pod-86421194] Cmd: wget http://10.110.71.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
ctest-pod-03680780
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-26 10:35:28,290 - DEBUG - [Pod Pod ctest-pod-86421194] Cmd wget http://10.110.71.83:80/ -O - -T 5 -t 1 passed
2025-04-26 10:35:28,290 - DEBUG - [Pod Pod ctest-pod-86421194] Cmd output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
ctest-pod-03680780
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-26 10:35:28,359 - DEBUG - [Pod ctest-pod-86421194] Cmd: wget http://10.110.71.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-03680780
2025-04-26 10:35:28,359 - DEBUG - [Pod Pod ctest-pod-86421194] Cmd wget http://10.110.71.83:80/ -O - -T 5 -t 1 passed
2025-04-26 10:35:28,359 - DEBUG - [Pod Pod ctest-pod-86421194] Cmd output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-03680780
2025-04-26 10:35:28,432 - DEBUG - [Pod ctest-pod-86421194] Cmd: wget http://10.110.71.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-79790693
2025-04-26 10:35:28,432 - DEBUG - [Pod Pod ctest-pod-86421194] Cmd wget http://10.110.71.83:80/ -O - -T 5 -t 1 passed
2025-04-26 10:35:28,432 - DEBUG - [Pod Pod ctest-pod-86421194] Cmd output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-79790693
2025-04-26 10:35:28,432 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-79790693': 1, 'ctest-pod-03680780': 2}
2025-04-26 10:35:28,511 - DEBUG - [Pod ctest-pod-26763466] Cmd: wget http://10.110.71.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
writing to stdout
ctest-pod-79790693
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-26 10:35:28,511 - DEBUG - [Pod Pod ctest-pod-26763466] Cmd wget http://10.110.71.83:80/ -O - -T 5 -t 1 passed
2025-04-26 10:35:28,511 - DEBUG - [Pod Pod ctest-pod-26763466] Cmd output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
writing to stdout
ctest-pod-79790693
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-26 10:35:28,574 - DEBUG - [Pod ctest-pod-26763466] Cmd: wget http://10.110.71.83:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
ctest-pod-03680780
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-26 10:35:28,574 - DEBUG - [Pod Pod ctest-pod-26763466] Cmd wget http://10.110.71.83:80/ -O - -T 5 -t 1 passed
2025-04-26 10:35:28,574 - DEBUG - [Pod Pod ctest-pod-26763466] Cmd output: Connecting to 10.110.71.83:80 (10.110.71.83:80)
ctest-pod-03680780
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-26 10:35:28,574 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-79790693': 1, 'ctest-pod-03680780': 1}
2025-04-26 10:35:30,640 - DEBUG - [Pod ctest-pod-86421194] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.405 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.068 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.054 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.054/0.175/0.405 ms
2025-04-26 10:35:30,640 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-86421194 with expectation True passed
2025-04-26 10:35:32,712 - DEBUG - [Pod ctest-pod-26790021] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes
64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.864 ms
64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.057 ms
64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.075 ms
--- 10.47.255.245 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.057/0.332/0.864 ms
2025-04-26 10:35:32,712 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-26790021 with expectation True passed
2025-04-26 10:35:34,790 - DEBUG - [Pod ctest-pod-26763466] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes
64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.395 ms
64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.056 ms
64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.065 ms
--- 10.47.255.245 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.056/0.172/0.395 ms
2025-04-26 10:35:34,790 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-26763466 with expectation True passed
2025-04-26 10:35:34,850 - DEBUG - [Pod ctest-pod-86421194] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-26 10:35:34,850 - DEBUG - [Pod Pod ctest-pod-86421194] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-04-26 10:35:34,850 - DEBUG - [Pod Pod ctest-pod-86421194] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-26 10:35:34,850 - INFO - wget check of of http://10.47.255.250 from ctest-pod-86421194 passed
2025-04-26 10:35:34,911 - DEBUG - [Pod ctest-pod-86421194] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-26 10:35:34,911 - DEBUG - [Pod Pod ctest-pod-86421194] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 passed
2025-04-26 10:35:34,911 - DEBUG - [Pod Pod ctest-pod-86421194] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-26 10:35:34,911 - INFO - wget check of of http://10.47.255.249 from ctest-pod-86421194 passed
2025-04-26 10:35:39,972 - DEBUG - [Pod ctest-pod-26790021] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2025-04-26 10:35:39,972 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2025-04-26 10:35:39,972 - DEBUG - [Pod Pod ctest-pod-26790021] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2025-04-26 10:35:39,972 - INFO - wget check of of http://10.47.255.249 from ctest-pod-26790021 passed
2025-04-26 10:35:40,036 - DEBUG - [Pod ctest-pod-89538151] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-26 10:35:40,036 - DEBUG - [Pod Pod ctest-pod-89538151] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-04-26 10:35:40,036 - DEBUG - [Pod Pod ctest-pod-89538151] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-26 10:35:40,036 - INFO - wget check of of http://10.47.255.250 from ctest-pod-89538151 passed
2025-04-26 10:35:40,036 - INFO - Deleting Network Policy : ingress-on-service
2025-04-26 10:35:40,036 - INFO - Deleting service : ctest-nginx-svc-79168387
2025-04-26 10:35:40,519 - DEBUG - No XMPP flaps were noticed during the test
2025-04-26 10:35:40,519 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:08]
2025-04-26 10:35:40,519 - INFO - --------------------------------------------------------------------------------
2025-04-26 10:35:40,524 - INFO - Deleting pod ctest-new-default-26626428:ctest-pod-79790693
2025-04-26 10:35:40,524 - INFO - Deleting pod ctest-new-default-26626428:ctest-pod-03680780
2025-04-26 10:35:40,525 - INFO - Deleting pod ctest-non-default-75157367:ctest-pod-24205269
2025-04-26 10:35:40,525 - INFO - Deleting pod ctest-non-default-75157367:ctest-pod-44942131
2025-04-26 10:35:40,525 - INFO - Deleting pod ctest-new-default-26626428:ctest-pod-26790021
2025-04-26 10:35:40,526 - INFO - Deleting pod ctest-new-default-26626428:ctest-pod-86421194
2025-04-26 10:35:40,526 - INFO - Deleting pod ctest-non-default-75157367:ctest-pod-26763466
2025-04-26 10:35:40,526 - INFO - Deleting pod ctest-non-default-75157367:ctest-pod-89538151
2025-04-26 10:35:40,637 - WARNING - Pod uuid 304d71ca-3b6c-4b78-a555-0e45d666d4b1 is still seen in agent 10.0.0.22 VM list
2025-04-26 10:35:40,637 - WARNING - Pod uuid cef49011-77bf-4b03-a970-70739e6c2f35 is still seen in agent 10.0.0.22 VM list
2025-04-26 10:35:40,638 - WARNING - Pod uuid ee35d8ec-687e-48e7-b92f-449c843c11ad is still seen in agent 10.0.0.22 VM list
2025-04-26 10:35:40,638 - WARNING - Pod uuid 9ae36f2c-e7fc-4f19-b69e-491169f9405e is still seen in agent 10.0.0.22 VM list
2025-04-26 10:35:40,638 - WARNING - Pod uuid 4496bb80-cb21-4bf8-9e62-87738f105300 is still seen in agent 10.0.0.22 VM list
2025-04-26 10:35:40,638 - WARNING - Pod uuid ff8ab95c-41df-453e-ba9f-04e5d7f283d7 is still seen in agent 10.0.0.22 VM list
2025-04-26 10:35:40,639 - WARNING - Pod uuid 6ad19cec-76a7-4166-b32f-5ac46df2983d is still seen in agent 10.0.0.22 VM list
2025-04-26 10:35:40,639 - WARNING - Pod uuid 4033b2c8-6684-4dda-b1bb-8ea6f0b6f587 is still seen in agent 10.0.0.22 VM list
2025-04-26 10:35:45,668 - DEBUG - Pod ff8ab95c-41df-453e-ba9f-04e5d7f283d7 is not in agent 10.0.0.22 VM list
2025-04-26 10:35:45,669 - WARNING - Pod uuid 6ad19cec-76a7-4166-b32f-5ac46df2983d is still seen in agent 10.0.0.22 VM list
2025-04-26 10:35:45,670 - DEBUG - Pod cef49011-77bf-4b03-a970-70739e6c2f35 is not in agent 10.0.0.22 VM list
2025-04-26 10:35:45,671 - DEBUG - Pod 9ae36f2c-e7fc-4f19-b69e-491169f9405e is not in agent 10.0.0.22 VM list
2025-04-26 10:35:45,672 - WARNING - Pod uuid 304d71ca-3b6c-4b78-a555-0e45d666d4b1 is still seen in agent 10.0.0.22 VM list
2025-04-26 10:35:45,673 - WARNING - Pod uuid ee35d8ec-687e-48e7-b92f-449c843c11ad is still seen in agent 10.0.0.22 VM list
2025-04-26 10:35:45,673 - WARNING - Pod uuid 4033b2c8-6684-4dda-b1bb-8ea6f0b6f587 is still seen in agent 10.0.0.22 VM list
2025-04-26 10:35:45,675 - DEBUG - Pod 4496bb80-cb21-4bf8-9e62-87738f105300 is not in agent 10.0.0.22 VM list
2025-04-26 10:35:45,687 - DEBUG - VMI b9df9362-2289-11f0-8713-024207d73545 is removed from agent 10.0.0.22
2025-04-26 10:35:45,687 - INFO - Verified that pod ctest-pod-44942131 is removed in agent
2025-04-26 10:35:45,688 - DEBUG - VMI b8365af0-2289-11f0-8713-024207d73545 is removed from agent 10.0.0.22
2025-04-26 10:35:45,688 - INFO - Verified that pod ctest-pod-03680780 is removed in agent
2025-04-26 10:35:45,688 - DEBUG - VMI b92f4714-2289-11f0-8713-024207d73545 is removed from agent 10.0.0.22
2025-04-26 10:35:45,688 - INFO - Verified that pod ctest-pod-24205269 is removed in agent
2025-04-26 10:35:45,688 - DEBUG - VMI b7856a24-2289-11f0-8713-024207d73545 is removed from agent 10.0.0.22
2025-04-26 10:35:45,688 - INFO - Verified that pod ctest-pod-79790693 is removed in agent
2025-04-26 10:35:50,678 - WARNING - Pod uuid 6ad19cec-76a7-4166-b32f-5ac46df2983d is still seen in agent 10.0.0.22 VM list
2025-04-26 10:35:50,685 - WARNING - Pod uuid 4033b2c8-6684-4dda-b1bb-8ea6f0b6f587 is still seen in agent 10.0.0.22 VM list
2025-04-26 10:35:50,686 - WARNING - Pod uuid 304d71ca-3b6c-4b78-a555-0e45d666d4b1 is still seen in agent 10.0.0.22 VM list
2025-04-26 10:35:50,686 - WARNING - Pod uuid ee35d8ec-687e-48e7-b92f-449c843c11ad is still seen in agent 10.0.0.22 VM list
2025-04-26 10:35:55,684 - WARNING - Pod uuid 6ad19cec-76a7-4166-b32f-5ac46df2983d is still seen in agent 10.0.0.22 VM list
2025-04-26 10:35:55,697 - WARNING - Pod uuid 304d71ca-3b6c-4b78-a555-0e45d666d4b1 is still seen in agent 10.0.0.22 VM list
2025-04-26 10:35:55,698 - WARNING - Pod uuid 4033b2c8-6684-4dda-b1bb-8ea6f0b6f587 is still seen in agent 10.0.0.22 VM list
2025-04-26 10:35:55,698 - WARNING - Pod uuid ee35d8ec-687e-48e7-b92f-449c843c11ad is still seen in agent 10.0.0.22 VM list
2025-04-26 10:36:00,692 - WARNING - Pod uuid 6ad19cec-76a7-4166-b32f-5ac46df2983d is still seen in agent 10.0.0.22 VM list
2025-04-26 10:36:00,709 - WARNING - Pod uuid 304d71ca-3b6c-4b78-a555-0e45d666d4b1 is still seen in agent 10.0.0.22 VM list
2025-04-26 10:36:00,712 - WARNING - Pod uuid ee35d8ec-687e-48e7-b92f-449c843c11ad is still seen in agent 10.0.0.22 VM list
2025-04-26 10:36:00,713 - WARNING - Pod uuid 4033b2c8-6684-4dda-b1bb-8ea6f0b6f587 is still seen in agent 10.0.0.22 VM list
2025-04-26 10:36:05,698 - WARNING - Pod uuid 6ad19cec-76a7-4166-b32f-5ac46df2983d is still seen in agent 10.0.0.22 VM list
2025-04-26 10:36:05,717 - WARNING - Pod uuid 304d71ca-3b6c-4b78-a555-0e45d666d4b1 is still seen in agent 10.0.0.22 VM list
2025-04-26 10:36:05,723 - WARNING - Pod uuid ee35d8ec-687e-48e7-b92f-449c843c11ad is still seen in agent 10.0.0.22 VM list
2025-04-26 10:36:05,724 - WARNING - Pod uuid 4033b2c8-6684-4dda-b1bb-8ea6f0b6f587 is still seen in agent 10.0.0.22 VM list
2025-04-26 10:36:10,707 - WARNING - Pod uuid 6ad19cec-76a7-4166-b32f-5ac46df2983d is still seen in agent 10.0.0.22 VM list
2025-04-26 10:36:10,737 - WARNING - Pod uuid ee35d8ec-687e-48e7-b92f-449c843c11ad is still seen in agent 10.0.0.22 VM list
2025-04-26 10:36:10,739 - WARNING - Pod uuid 4033b2c8-6684-4dda-b1bb-8ea6f0b6f587 is still seen in agent 10.0.0.22 VM list
2025-04-26 10:36:10,740 - WARNING - Pod uuid 304d71ca-3b6c-4b78-a555-0e45d666d4b1 is still seen in agent 10.0.0.22 VM list
2025-04-26 10:36:15,714 - DEBUG - Pod 6ad19cec-76a7-4166-b32f-5ac46df2983d is not in agent 10.0.0.22 VM list
2025-04-26 10:36:15,719 - DEBUG - VMI bb725a52-2289-11f0-8713-024207d73545 is removed from agent 10.0.0.22
2025-04-26 10:36:15,719 - INFO - Verified that pod ctest-pod-86421194 is removed in agent
2025-04-26 10:36:15,746 - DEBUG - Pod ee35d8ec-687e-48e7-b92f-449c843c11ad is not in agent 10.0.0.22 VM list
2025-04-26 10:36:15,754 - DEBUG - Pod 4033b2c8-6684-4dda-b1bb-8ea6f0b6f587 is not in agent 10.0.0.22 VM list
2025-04-26 10:36:15,756 - DEBUG - Pod 304d71ca-3b6c-4b78-a555-0e45d666d4b1 is not in agent 10.0.0.22 VM list
2025-04-26 10:36:15,759 - DEBUG - VMI bab07e50-2289-11f0-8713-024207d73545 is removed from agent 10.0.0.22
2025-04-26 10:36:15,759 - INFO - Verified that pod ctest-pod-26790021 is removed in agent
2025-04-26 10:36:15,765 - DEBUG - VMI bc377e40-2289-11f0-8713-024207d73545 is removed from agent 10.0.0.22
2025-04-26 10:36:15,765 - INFO - Verified that pod ctest-pod-26763466 is removed in agent
2025-04-26 10:36:15,766 - DEBUG - VMI bd06c02e-2289-11f0-8713-024207d73545 is removed from agent 10.0.0.22
2025-04-26 10:36:15,766 - INFO - Verified that pod ctest-pod-89538151 is removed in agent
2025-04-26 10:36:15,766 - INFO - Deleting namespace ctest-non-default-75157367
2025-04-26 10:36:15,776 - DEBUG - Namespace ctest-non-default-75157367 still in k8s
2025-04-26 10:36:17,780 - DEBUG - Namespace ctest-non-default-75157367 still in k8s
2025-04-26 10:36:19,787 - DEBUG - Namespace ctest-non-default-75157367 still in k8s
2025-04-26 10:36:21,791 - DEBUG - Namespace ctest-non-default-75157367 is not in k8s
2025-04-26 10:36:21,791 - DEBUG - No need to check project deletion in contrail-api
2025-04-26 10:36:21,791 - INFO - Deleting namespace ctest-new-default-26626428
2025-04-26 10:36:21,805 - DEBUG - Namespace ctest-new-default-26626428 still in k8s
2025-04-26 10:36:23,810 - DEBUG - Namespace ctest-new-default-26626428 still in k8s
2025-04-26 10:36:25,815 - DEBUG - Namespace ctest-new-default-26626428 still in k8s
2025-04-26 10:36:27,819 - DEBUG - Namespace ctest-new-default-26626428 is not in k8s
2025-04-26 10:36:27,819 - DEBUG - No need to check project deletion in contrail-api