2025-03-20 02:13:38,857 - INFO - Using existing project ['default-domain', 'k8s-default'](de1e17d1-b99e-46b9-a928-04c7729fd3f5)
2025-03-20 02:13:38,881 - DEBUG - Namespace ctest-new-default-00543228 not present
2025-03-20 02:13:38,893 - INFO - Created namespace ctest-new-default-00543228
2025-03-20 02:13:41,898 - DEBUG - Namespace ctest-non-default-82983500 not present
2025-03-20 02:13:41,910 - INFO - Created namespace ctest-non-default-82983500
2025-03-20 02:13:44,933 - DEBUG - Pod ctest-pod-11112280 not present
2025-03-20 02:13:44,933 - INFO - Creating Pod ctest-pod-11112280
2025-03-20 02:13:44,986 - DEBUG - Pod : ctest-pod-11112280 UUID is b1254a28-7afa-4a0e-b018-acd9a4887605
2025-03-20 02:13:45,000 - DEBUG - Pod ctest-pod-69054424 not present
2025-03-20 02:13:45,000 - INFO - Creating Pod ctest-pod-69054424
2025-03-20 02:13:45,043 - DEBUG - Pod : ctest-pod-69054424 UUID is e3ea73b3-8e9e-4ec3-ae2e-cfc1e596e1c2
2025-03-20 02:13:45,049 - DEBUG - Pod ctest-pod-83219257 not present
2025-03-20 02:13:45,068 - INFO - Creating Pod ctest-pod-83219257
2025-03-20 02:13:45,131 - DEBUG - Pod : ctest-pod-83219257 UUID is ff51f947-7fcf-44b0-b0a6-3dffd0d73bcf
2025-03-20 02:13:45,134 - DEBUG - Pod ctest-pod-45217746 not present
2025-03-20 02:13:45,134 - INFO - Creating Pod ctest-pod-45217746
2025-03-20 02:13:45,165 - DEBUG - Pod : ctest-pod-45217746 UUID is d185057c-285b-4207-b9a2-76f1d85fc4ef
2025-03-20 02:13:45,173 - DEBUG - Pod ctest-pod-21174880 not present
2025-03-20 02:13:45,173 - INFO - Creating Pod ctest-pod-21174880
2025-03-20 02:13:45,209 - DEBUG - Pod : ctest-pod-21174880 UUID is d7246dbf-3456-4eb4-bc26-476d7976bc75
2025-03-20 02:13:45,212 - DEBUG - Pod ctest-pod-70823770 not present
2025-03-20 02:13:45,213 - INFO - Creating Pod ctest-pod-70823770
2025-03-20 02:13:45,250 - DEBUG - Pod : ctest-pod-70823770 UUID is 57348ae1-2e51-45bb-83de-488c34622ce1
2025-03-20 02:13:45,253 - DEBUG - Pod ctest-pod-39793270 not present
2025-03-20 02:13:45,253 - INFO - Creating Pod ctest-pod-39793270
2025-03-20 02:13:45,288 - DEBUG - Pod : ctest-pod-39793270 UUID is 910f355a-2384-4b97-a40e-7f4598ab033e
2025-03-20 02:13:45,296 - DEBUG - Pod ctest-pod-78022570 not present
2025-03-20 02:13:45,297 - INFO - Creating Pod ctest-pod-78022570
2025-03-20 02:13:45,328 - DEBUG - Pod : ctest-pod-78022570 UUID is d3791ec7-4af1-4d62-9618-44db3cdb6814
2025-03-20 02:13:45,580 - INFO - Project default-domain:k8s-ctest-new-default-00543228 for Namespace ctest-new-default-00543228 is seen in contrail-api
2025-03-20 02:13:45,580 - DEBUG - Project uuid in Contrail is c3403d07-fad7-490f-9ba3-617e9c2b5624
2025-03-20 02:13:45,767 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NamespaceDatabaseList?namespace_uuid=916f9b79-2045-4cbc-ad3f-af40a3669aad
2025-03-20 02:13:45,771 - INFO - Namespace ctest-new-default-00543228 with uuid 916f9b79-2045-4cbc-ad3f-af40a3669aad found in kube manager
2025-03-20 02:13:45,772 - INFO - Namespace ctest-new-default-00543228 verification passed
2025-03-20 02:13:46,019 - INFO - Project default-domain:k8s-ctest-non-default-82983500 for Namespace ctest-non-default-82983500 is seen in contrail-api
2025-03-20 02:13:46,019 - DEBUG - Project uuid in Contrail is f1265601-471b-4601-adce-802753d93089
2025-03-20 02:13:46,019 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NamespaceDatabaseList?namespace_uuid=209708ca-3bbe-45ce-ad1b-eff4210fff6f
2025-03-20 02:13:46,027 - INFO - Namespace ctest-non-default-82983500 with uuid 209708ca-3bbe-45ce-ad1b-eff4210fff6f found in kube manager
2025-03-20 02:13:46,027 - INFO - Namespace ctest-non-default-82983500 verification passed
2025-03-20 02:13:46,037 - DEBUG - Pod ctest-pod-11112280 not in running state.Currently in Pending
2025-03-20 02:13:51,055 - DEBUG - Pod ctest-pod-11112280 not in running state.Currently in Pending
2025-03-20 02:13:56,062 - DEBUG - Pod ctest-pod-11112280 not in running state.Currently in Pending
2025-03-20 02:14:01,071 - INFO - Pod ctest-pod-11112280 is in running state.Got IP 10.47.255.251
2025-03-20 02:14:01,089 - DEBUG - Pod ctest-pod-11112280 has vmi f4b5cd38-0530-11f0-8ed9-fa163e22f11c
2025-03-20 02:14:01,089 - INFO - Verified pod ctest-pod-11112280 in contrail-api
2025-03-20 02:14:01,112 - DEBUG - VMI f4b5cd38-0530-11f0-8ed9-fa163e22f11c is active in agent 10.0.0.22
2025-03-20 02:14:01,112 - INFO - Verified Pod ctest-pod-11112280 in agent 10.0.0.22
2025-03-20 02:14:01,112 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=b1254a28-7afa-4a0e-b018-acd9a4887605
2025-03-20 02:14:01,119 - INFO - Pod ctest-pod-11112280 with uuid b1254a28-7afa-4a0e-b018-acd9a4887605 found in kube manager
2025-03-20 02:14:01,119 - INFO - Pod ctest-pod-11112280 verification passed
2025-03-20 02:14:01,126 - INFO - Pod ctest-pod-69054424 is in running state.Got IP 10.47.255.250
2025-03-20 02:14:01,143 - DEBUG - Pod ctest-pod-69054424 has vmi f54261ee-0530-11f0-8ed9-fa163e22f11c
2025-03-20 02:14:01,143 - INFO - Verified pod ctest-pod-69054424 in contrail-api
2025-03-20 02:14:01,159 - DEBUG - VMI f54261ee-0530-11f0-8ed9-fa163e22f11c is active in agent 10.0.0.22
2025-03-20 02:14:01,160 - INFO - Verified Pod ctest-pod-69054424 in agent 10.0.0.22
2025-03-20 02:14:01,160 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=e3ea73b3-8e9e-4ec3-ae2e-cfc1e596e1c2
2025-03-20 02:14:01,165 - INFO - Pod ctest-pod-69054424 with uuid e3ea73b3-8e9e-4ec3-ae2e-cfc1e596e1c2 found in kube manager
2025-03-20 02:14:01,165 - INFO - Pod ctest-pod-69054424 verification passed
2025-03-20 02:14:01,171 - INFO - Pod ctest-pod-83219257 is in running state.Got IP 10.47.255.249
2025-03-20 02:14:01,229 - DEBUG - Pod ctest-pod-83219257 has vmi f5fbc4b8-0530-11f0-8ed9-fa163e22f11c
2025-03-20 02:14:01,229 - INFO - Verified pod ctest-pod-83219257 in contrail-api
2025-03-20 02:14:01,249 - DEBUG - VMI f5fbc4b8-0530-11f0-8ed9-fa163e22f11c is active in agent 10.0.0.22
2025-03-20 02:14:01,250 - INFO - Verified Pod ctest-pod-83219257 in agent 10.0.0.22
2025-03-20 02:14:01,250 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=ff51f947-7fcf-44b0-b0a6-3dffd0d73bcf
2025-03-20 02:14:01,255 - INFO - Pod ctest-pod-83219257 with uuid ff51f947-7fcf-44b0-b0a6-3dffd0d73bcf found in kube manager
2025-03-20 02:14:01,255 - INFO - Pod ctest-pod-83219257 verification passed
2025-03-20 02:14:01,262 - INFO - Pod ctest-pod-45217746 is in running state.Got IP 10.47.255.248
2025-03-20 02:14:01,319 - DEBUG - Pod ctest-pod-45217746 has vmi f67f2722-0530-11f0-8ed9-fa163e22f11c
2025-03-20 02:14:01,319 - INFO - Verified pod ctest-pod-45217746 in contrail-api
2025-03-20 02:14:01,339 - DEBUG - VMI f67f2722-0530-11f0-8ed9-fa163e22f11c is active in agent 10.0.0.22
2025-03-20 02:14:01,339 - INFO - Verified Pod ctest-pod-45217746 in agent 10.0.0.22
2025-03-20 02:14:01,340 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=d185057c-285b-4207-b9a2-76f1d85fc4ef
2025-03-20 02:14:01,345 - INFO - Pod ctest-pod-45217746 with uuid d185057c-285b-4207-b9a2-76f1d85fc4ef found in kube manager
2025-03-20 02:14:01,345 - INFO - Pod ctest-pod-45217746 verification passed
2025-03-20 02:14:01,353 - DEBUG - Pod ctest-pod-21174880 not in running state.Currently in Pending
2025-03-20 02:14:06,370 - INFO - Pod ctest-pod-21174880 is in running state.Got IP 10.47.255.247
2025-03-20 02:14:06,390 - DEBUG - Pod ctest-pod-21174880 has vmi f720bab0-0530-11f0-8ed9-fa163e22f11c
2025-03-20 02:14:06,390 - INFO - Verified pod ctest-pod-21174880 in contrail-api
2025-03-20 02:14:06,406 - DEBUG - VMI f720bab0-0530-11f0-8ed9-fa163e22f11c is active in agent 10.0.0.22
2025-03-20 02:14:06,406 - INFO - Verified Pod ctest-pod-21174880 in agent 10.0.0.22
2025-03-20 02:14:06,406 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=d7246dbf-3456-4eb4-bc26-476d7976bc75
2025-03-20 02:14:06,412 - INFO - Pod ctest-pod-21174880 with uuid d7246dbf-3456-4eb4-bc26-476d7976bc75 found in kube manager
2025-03-20 02:14:06,412 - INFO - Pod ctest-pod-21174880 verification passed
2025-03-20 02:14:06,418 - INFO - Pod ctest-pod-39793270 is in running state.Got IP 10.47.255.245
2025-03-20 02:14:06,475 - DEBUG - Pod ctest-pod-39793270 has vmi f836b1f2-0530-11f0-8ed9-fa163e22f11c
2025-03-20 02:14:06,475 - INFO - Verified pod ctest-pod-39793270 in contrail-api
2025-03-20 02:14:06,494 - DEBUG - VMI f836b1f2-0530-11f0-8ed9-fa163e22f11c is active in agent 10.0.0.22
2025-03-20 02:14:06,494 - INFO - Verified Pod ctest-pod-39793270 in agent 10.0.0.22
2025-03-20 02:14:06,494 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=910f355a-2384-4b97-a40e-7f4598ab033e
2025-03-20 02:14:06,503 - INFO - Pod ctest-pod-39793270 with uuid 910f355a-2384-4b97-a40e-7f4598ab033e found in kube manager
2025-03-20 02:14:06,503 - INFO - Pod ctest-pod-39793270 verification passed
2025-03-20 02:14:06,589 - INFO - Pod ctest-pod-70823770 is in running state.Got IP 10.47.255.246
2025-03-20 02:14:06,607 - DEBUG - Pod ctest-pod-70823770 has vmi f7b4a8a6-0530-11f0-8ed9-fa163e22f11c
2025-03-20 02:14:06,607 - INFO - Verified pod ctest-pod-70823770 in contrail-api
2025-03-20 02:14:06,624 - DEBUG - VMI f7b4a8a6-0530-11f0-8ed9-fa163e22f11c is active in agent 10.0.0.22
2025-03-20 02:14:06,625 - INFO - Verified Pod ctest-pod-70823770 in agent 10.0.0.22
2025-03-20 02:14:06,625 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=57348ae1-2e51-45bb-83de-488c34622ce1
2025-03-20 02:14:06,630 - INFO - Pod ctest-pod-70823770 with uuid 57348ae1-2e51-45bb-83de-488c34622ce1 found in kube manager
2025-03-20 02:14:06,630 - INFO - Pod ctest-pod-70823770 verification passed
2025-03-20 02:14:06,636 - INFO - Pod ctest-pod-78022570 is in running state.Got IP 10.47.255.244
2025-03-20 02:14:06,695 - DEBUG - Pod ctest-pod-78022570 has vmi f8bada9a-0530-11f0-8ed9-fa163e22f11c
2025-03-20 02:14:06,695 - INFO - Verified pod ctest-pod-78022570 in contrail-api
2025-03-20 02:14:06,710 - DEBUG - VMI f8bada9a-0530-11f0-8ed9-fa163e22f11c is active in agent 10.0.0.22
2025-03-20 02:14:06,711 - INFO - Verified Pod ctest-pod-78022570 in agent 10.0.0.22
2025-03-20 02:14:06,711 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=d3791ec7-4af1-4d62-9618-44db3cdb6814
2025-03-20 02:14:06,716 - INFO - Pod ctest-pod-78022570 with uuid d3791ec7-4af1-4d62-9618-44db3cdb6814 found in kube manager
2025-03-20 02:14:06,716 - INFO - Pod ctest-pod-78022570 verification passed
2025-03-20 02:14:06,716 - INFO - ================================================================================
2025-03-20 02:14:06,716 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-03-20 02:14:06,716 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-03-20 02:14:06,961 - DEBUG - Nothing to compare xmpp stats {'10.0.0.22': {'10.0.0.50': '0'}} with
2025-03-20 02:14:06,961 - INFO - Initial checks done. Running the testcase now
2025-03-20 02:14:06,962 - INFO -
2025-03-20 02:14:07,019 - DEBUG - [Pod ctest-pod-11112280] Cmd: echo ctest-pod-11112280 > /usr/share/nginx/html/index.html, Output:
2025-03-20 02:14:07,100 - DEBUG - [Pod ctest-pod-69054424] Cmd: echo ctest-pod-69054424 > /usr/share/nginx/html/index.html, Output:
2025-03-20 02:14:07,170 - DEBUG - [Pod ctest-pod-83219257] Cmd: echo ctest-pod-83219257 > /usr/share/nginx/html/index.html, Output:
2025-03-20 02:14:07,238 - DEBUG - [Pod ctest-pod-45217746] Cmd: echo ctest-pod-45217746 > /usr/share/nginx/html/index.html, Output:
2025-03-20 02:14:07,241 - DEBUG - Service ctest-nginx-svc-64021673 not present
2025-03-20 02:14:07,242 - INFO - Creating service ctest-nginx-svc-64021673
2025-03-20 02:14:07,254 - INFO - Created Service ctest-nginx-svc-64021673
2025-03-20 02:14:07,261 - WARNING - Service UUID 761a5369-eebc-4724-a300-2218b3a83e60 not yet found in contrail-api
2025-03-20 02:14:08,283 - INFO - Validated that Service ctest-nginx-svc-64021673 is seen in contrail-api
2025-03-20 02:14:08,284 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_LoadbalancerDatabaseList?x=761a5369-eebc-4724-a300-2218b3a83e60
2025-03-20 02:14:08,292 - INFO - Service ctest-nginx-svc-64021673 with uuid 761a5369-eebc-4724-a300-2218b3a83e60 found in kube manager
2025-03-20 02:14:08,292 - INFO - Service ctest-nginx-svc-64021673 verification passed
2025-03-20 02:14:09,380 - DEBUG - [Pod ctest-pod-21174880] Cmd: wget http://10.102.138.86:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-11112280
2025-03-20 02:14:09,380 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd wget http://10.102.138.86:80/ -O - -T 5 -t 1 passed
2025-03-20 02:14:09,381 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-11112280
2025-03-20 02:14:09,449 - DEBUG - [Pod ctest-pod-21174880] Cmd: wget http://10.102.138.86:80/ -O - -T 5 -t 1 , Output: ctest-pod-11112280
Connecting to 10.102.138.86:80 (10.102.138.86:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-20 02:14:09,449 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd wget http://10.102.138.86:80/ -O - -T 5 -t 1 passed
2025-03-20 02:14:09,449 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd output: ctest-pod-11112280
Connecting to 10.102.138.86:80 (10.102.138.86:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-20 02:14:09,511 - DEBUG - [Pod ctest-pod-21174880] Cmd: wget http://10.102.138.86:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-69054424
2025-03-20 02:14:09,511 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd wget http://10.102.138.86:80/ -O - -T 5 -t 1 passed
2025-03-20 02:14:09,511 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-69054424
2025-03-20 02:14:09,511 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-11112280': 2, 'ctest-pod-69054424': 1}
2025-03-20 02:14:09,572 - DEBUG - [Pod ctest-pod-39793270] Cmd: wget http://10.102.138.86:80/ -O - -T 5 -t 1 , Output: ctest-pod-69054424
Connecting to 10.102.138.86:80 (10.102.138.86:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-20 02:14:09,572 - DEBUG - [Pod Pod ctest-pod-39793270] Cmd wget http://10.102.138.86:80/ -O - -T 5 -t 1 passed
2025-03-20 02:14:09,572 - DEBUG - [Pod Pod ctest-pod-39793270] Cmd output: ctest-pod-69054424
Connecting to 10.102.138.86:80 (10.102.138.86:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-20 02:14:09,629 - DEBUG - [Pod ctest-pod-39793270] Cmd: wget http://10.102.138.86:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-11112280
2025-03-20 02:14:09,629 - DEBUG - [Pod Pod ctest-pod-39793270] Cmd wget http://10.102.138.86:80/ -O - -T 5 -t 1 passed
2025-03-20 02:14:09,630 - DEBUG - [Pod Pod ctest-pod-39793270] Cmd output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-11112280
2025-03-20 02:14:09,630 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-11112280': 1, 'ctest-pod-69054424': 1}
2025-03-20 02:14:09,633 - DEBUG - Network policy ingress-on-service not present
2025-03-20 02:14:09,634 - INFO - Creating Network Policy ingress-on-service
2025-03-20 02:14:09,648 - INFO - Network policy found in k8s
2025-03-20 02:14:09,650 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=acb6e89c-160e-4af5-a00a-b267a2bc7071
2025-03-20 02:14:09,659 - INFO - Network Policy ingress-on-service with uuid acb6e89c-160e-4af5-a00a-b267a2bc7071 found in kube manager
2025-03-20 02:14:09,705 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-03-20 02:14:09,706 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-03-20 02:14:09,706 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=acb6e89c-160e-4af5-a00a-b267a2bc7071
2025-03-20 02:14:09,740 - WARNING - Network policy with name ingress-on-service not found in agent
2025-03-20 02:14:11,741 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=acb6e89c-160e-4af5-a00a-b267a2bc7071
2025-03-20 02:14:11,777 - INFO - Network policy with name ingress-on-service found in agent
2025-03-20 02:14:11,777 - INFO - Network Policy ingress-on-service verification passed
2025-03-20 02:14:16,838 - DEBUG - [Pod ctest-pod-21174880] Cmd: wget http://10.102.138.86:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:14:16,838 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd wget http://10.102.138.86:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:14:16,838 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:14:21,890 - DEBUG - [Pod ctest-pod-21174880] Cmd: wget http://10.102.138.86:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:14:21,891 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd wget http://10.102.138.86:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:14:21,891 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:14:26,968 - DEBUG - [Pod ctest-pod-21174880] Cmd: wget http://10.102.138.86:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:14:26,968 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd wget http://10.102.138.86:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:14:26,968 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:14:32,024 - DEBUG - [Pod ctest-pod-21174880] Cmd: wget http://10.102.138.86:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:14:32,025 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd wget http://10.102.138.86:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:14:32,025 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:14:37,105 - DEBUG - [Pod ctest-pod-21174880] Cmd: wget http://10.102.138.86:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:14:37,105 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd wget http://10.102.138.86:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:14:37,105 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:14:42,177 - DEBUG - [Pod ctest-pod-21174880] Cmd: wget http://10.102.138.86:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:14:42,178 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd wget http://10.102.138.86:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:14:42,178 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:14:47,237 - DEBUG - [Pod ctest-pod-21174880] Cmd: wget http://10.102.138.86:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:14:47,237 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd wget http://10.102.138.86:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:14:47,237 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:14:52,297 - DEBUG - [Pod ctest-pod-21174880] Cmd: wget http://10.102.138.86:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:14:52,298 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd wget http://10.102.138.86:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:14:52,298 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:14:57,368 - DEBUG - [Pod ctest-pod-21174880] Cmd: wget http://10.102.138.86:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:14:57,368 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd wget http://10.102.138.86:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:14:57,368 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:15:02,448 - DEBUG - [Pod ctest-pod-21174880] Cmd: wget http://10.102.138.86:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:15:02,449 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd wget http://10.102.138.86:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:15:02,449 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:15:02,449 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-11112280': 0, 'ctest-pod-69054424': 0}
2025-03-20 02:15:02,517 - DEBUG - [Pod ctest-pod-70823770] Cmd: wget http://10.102.138.86:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-69054424
2025-03-20 02:15:02,518 - DEBUG - [Pod Pod ctest-pod-70823770] Cmd wget http://10.102.138.86:80/ -O - -T 5 -t 1 passed
2025-03-20 02:15:02,518 - DEBUG - [Pod Pod ctest-pod-70823770] Cmd output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-69054424
2025-03-20 02:15:02,594 - DEBUG - [Pod ctest-pod-70823770] Cmd: wget http://10.102.138.86:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-11112280
2025-03-20 02:15:02,594 - DEBUG - [Pod Pod ctest-pod-70823770] Cmd wget http://10.102.138.86:80/ -O - -T 5 -t 1 passed
2025-03-20 02:15:02,594 - DEBUG - [Pod Pod ctest-pod-70823770] Cmd output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-11112280
2025-03-20 02:15:02,594 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-11112280': 1, 'ctest-pod-69054424': 1}
2025-03-20 02:15:07,660 - DEBUG - [Pod ctest-pod-39793270] Cmd: wget http://10.102.138.86:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:15:07,660 - DEBUG - [Pod Pod ctest-pod-39793270] Cmd wget http://10.102.138.86:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:15:07,660 - DEBUG - [Pod Pod ctest-pod-39793270] Cmd output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:15:12,727 - DEBUG - [Pod ctest-pod-39793270] Cmd: wget http://10.102.138.86:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:15:12,728 - DEBUG - [Pod Pod ctest-pod-39793270] Cmd wget http://10.102.138.86:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:15:12,728 - DEBUG - [Pod Pod ctest-pod-39793270] Cmd output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:15:17,797 - DEBUG - [Pod ctest-pod-39793270] Cmd: wget http://10.102.138.86:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:15:17,797 - DEBUG - [Pod Pod ctest-pod-39793270] Cmd wget http://10.102.138.86:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:15:17,797 - DEBUG - [Pod Pod ctest-pod-39793270] Cmd output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:15:22,849 - DEBUG - [Pod ctest-pod-39793270] Cmd: wget http://10.102.138.86:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:15:22,849 - DEBUG - [Pod Pod ctest-pod-39793270] Cmd wget http://10.102.138.86:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:15:22,849 - DEBUG - [Pod Pod ctest-pod-39793270] Cmd output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:15:27,908 - DEBUG - [Pod ctest-pod-39793270] Cmd: wget http://10.102.138.86:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:15:27,908 - DEBUG - [Pod Pod ctest-pod-39793270] Cmd wget http://10.102.138.86:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:15:27,908 - DEBUG - [Pod Pod ctest-pod-39793270] Cmd output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:15:32,970 - DEBUG - [Pod ctest-pod-39793270] Cmd: wget http://10.102.138.86:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:15:32,970 - DEBUG - [Pod Pod ctest-pod-39793270] Cmd wget http://10.102.138.86:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:15:32,970 - DEBUG - [Pod Pod ctest-pod-39793270] Cmd output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:15:38,037 - DEBUG - [Pod ctest-pod-39793270] Cmd: wget http://10.102.138.86:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:15:38,037 - DEBUG - [Pod Pod ctest-pod-39793270] Cmd wget http://10.102.138.86:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:15:38,037 - DEBUG - [Pod Pod ctest-pod-39793270] Cmd output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:15:43,084 - DEBUG - [Pod ctest-pod-39793270] Cmd: wget http://10.102.138.86:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:15:43,085 - DEBUG - [Pod Pod ctest-pod-39793270] Cmd wget http://10.102.138.86:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:15:43,085 - DEBUG - [Pod Pod ctest-pod-39793270] Cmd output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:15:48,136 - DEBUG - [Pod ctest-pod-39793270] Cmd: wget http://10.102.138.86:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:15:48,137 - DEBUG - [Pod Pod ctest-pod-39793270] Cmd wget http://10.102.138.86:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:15:48,137 - DEBUG - [Pod Pod ctest-pod-39793270] Cmd output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:15:53,184 - DEBUG - [Pod ctest-pod-39793270] Cmd: wget http://10.102.138.86:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:15:53,184 - DEBUG - [Pod Pod ctest-pod-39793270] Cmd wget http://10.102.138.86:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:15:53,184 - DEBUG - [Pod Pod ctest-pod-39793270] Cmd output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:15:53,184 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-11112280': 0, 'ctest-pod-69054424': 0}
2025-03-20 02:15:55,247 - DEBUG - [Pod ctest-pod-70823770] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.814 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.074 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.081 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.074/0.323/0.814 ms
2025-03-20 02:15:55,248 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-70823770 with expectation True passed
2025-03-20 02:15:57,313 - DEBUG - [Pod ctest-pod-21174880] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.364 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.075 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.138 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.075/0.192/0.364 ms
2025-03-20 02:15:57,313 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-21174880 with expectation True passed
2025-03-20 02:15:59,391 - DEBUG - [Pod ctest-pod-39793270] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.980 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.075 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.071/0.375/0.980 ms
2025-03-20 02:15:59,391 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-39793270 with expectation True passed
2025-03-20 02:15:59,461 - DEBUG - [Pod ctest-pod-70823770] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-20 02:15:59,461 - DEBUG - [Pod Pod ctest-pod-70823770] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-03-20 02:15:59,461 - DEBUG - [Pod Pod ctest-pod-70823770] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-20 02:15:59,461 - INFO - wget check of of http://10.47.255.251 from ctest-pod-70823770 passed
2025-03-20 02:15:59,539 - DEBUG - [Pod ctest-pod-70823770] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-20 02:15:59,539 - DEBUG - [Pod Pod ctest-pod-70823770] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-03-20 02:15:59,539 - DEBUG - [Pod Pod ctest-pod-70823770] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-20 02:15:59,539 - INFO - wget check of of http://10.47.255.250 from ctest-pod-70823770 passed
2025-03-20 02:16:04,608 - DEBUG - [Pod ctest-pod-21174880] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-20 02:16:04,608 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-20 02:16:04,608 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-20 02:16:04,608 - INFO - wget check of of http://10.47.255.250 from ctest-pod-21174880 passed
2025-03-20 02:16:09,680 - DEBUG - [Pod ctest-pod-78022570] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-03-20 02:16:09,680 - DEBUG - [Pod Pod ctest-pod-78022570] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-03-20 02:16:09,681 - DEBUG - [Pod Pod ctest-pod-78022570] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-03-20 02:16:09,681 - INFO - wget check of of http://10.47.255.251 from ctest-pod-78022570 passed
2025-03-20 02:16:09,689 - INFO - Updating Network Policy ingress-on-service
2025-03-20 02:16:14,789 - DEBUG - [Pod ctest-pod-21174880] Cmd: wget http://10.102.138.86:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:16:14,789 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd wget http://10.102.138.86:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:16:14,789 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:16:19,865 - DEBUG - [Pod ctest-pod-21174880] Cmd: wget http://10.102.138.86:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:16:19,865 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd wget http://10.102.138.86:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:16:19,865 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:16:24,942 - DEBUG - [Pod ctest-pod-21174880] Cmd: wget http://10.102.138.86:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:16:24,942 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd wget http://10.102.138.86:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:16:24,942 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:16:30,018 - DEBUG - [Pod ctest-pod-21174880] Cmd: wget http://10.102.138.86:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:16:30,019 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd wget http://10.102.138.86:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:16:30,019 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:16:35,073 - DEBUG - [Pod ctest-pod-21174880] Cmd: wget http://10.102.138.86:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:16:35,073 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd wget http://10.102.138.86:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:16:35,073 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:16:40,141 - DEBUG - [Pod ctest-pod-21174880] Cmd: wget http://10.102.138.86:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:16:40,141 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd wget http://10.102.138.86:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:16:40,141 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:16:45,208 - DEBUG - [Pod ctest-pod-21174880] Cmd: wget http://10.102.138.86:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:16:45,208 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd wget http://10.102.138.86:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:16:45,208 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:16:50,265 - DEBUG - [Pod ctest-pod-21174880] Cmd: wget http://10.102.138.86:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:16:50,266 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd wget http://10.102.138.86:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:16:50,266 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:16:55,330 - DEBUG - [Pod ctest-pod-21174880] Cmd: wget http://10.102.138.86:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:16:55,330 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd wget http://10.102.138.86:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:16:55,331 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:17:00,400 - DEBUG - [Pod ctest-pod-21174880] Cmd: wget http://10.102.138.86:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:17:00,400 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd wget http://10.102.138.86:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:17:00,400 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
wget: download timed out
2025-03-20 02:17:00,400 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-11112280': 0, 'ctest-pod-69054424': 0}
2025-03-20 02:17:00,465 - DEBUG - [Pod ctest-pod-70823770] Cmd: wget http://10.102.138.86:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
writing to stdout
ctest-pod-11112280
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-20 02:17:00,465 - DEBUG - [Pod Pod ctest-pod-70823770] Cmd wget http://10.102.138.86:80/ -O - -T 5 -t 1 passed
2025-03-20 02:17:00,466 - DEBUG - [Pod Pod ctest-pod-70823770] Cmd output: Connecting to 10.102.138.86:80 (10.102.138.86:80)
writing to stdout
ctest-pod-11112280
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-20 02:17:00,536 - DEBUG - [Pod ctest-pod-70823770] Cmd: wget http://10.102.138.86:80/ -O - -T 5 -t 1 , Output: ctest-pod-69054424
Connecting to 10.102.138.86:80 (10.102.138.86:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-20 02:17:00,536 - DEBUG - [Pod Pod ctest-pod-70823770] Cmd wget http://10.102.138.86:80/ -O - -T 5 -t 1 passed
2025-03-20 02:17:00,536 - DEBUG - [Pod Pod ctest-pod-70823770] Cmd output: ctest-pod-69054424
Connecting to 10.102.138.86:80 (10.102.138.86:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-20 02:17:00,536 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-11112280': 1, 'ctest-pod-69054424': 1}
2025-03-20 02:17:00,594 - DEBUG - [Pod ctest-pod-39793270] Cmd: wget http://10.102.138.86:80/ -O - -T 5 -t 1 , Output: ctest-pod-69054424
Connecting to 10.102.138.86:80 (10.102.138.86:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-20 02:17:00,594 - DEBUG - [Pod Pod ctest-pod-39793270] Cmd wget http://10.102.138.86:80/ -O - -T 5 -t 1 passed
2025-03-20 02:17:00,595 - DEBUG - [Pod Pod ctest-pod-39793270] Cmd output: ctest-pod-69054424
Connecting to 10.102.138.86:80 (10.102.138.86:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-20 02:17:00,663 - DEBUG - [Pod ctest-pod-39793270] Cmd: wget http://10.102.138.86:80/ -O - -T 5 -t 1 , Output: ctest-pod-11112280
Connecting to 10.102.138.86:80 (10.102.138.86:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-20 02:17:00,663 - DEBUG - [Pod Pod ctest-pod-39793270] Cmd wget http://10.102.138.86:80/ -O - -T 5 -t 1 passed
2025-03-20 02:17:00,663 - DEBUG - [Pod Pod ctest-pod-39793270] Cmd output: ctest-pod-11112280
Connecting to 10.102.138.86:80 (10.102.138.86:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-20 02:17:00,663 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-11112280': 1, 'ctest-pod-69054424': 1}
2025-03-20 02:17:02,734 - DEBUG - [Pod ctest-pod-70823770] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.434 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.073 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.073 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.073/0.193/0.434 ms
2025-03-20 02:17:02,734 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-70823770 with expectation True passed
2025-03-20 02:17:04,802 - DEBUG - [Pod ctest-pod-21174880] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.094 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.075 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.090 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.075/0.419/1.094 ms
2025-03-20 02:17:04,803 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-21174880 with expectation True passed
2025-03-20 02:17:06,891 - DEBUG - [Pod ctest-pod-39793270] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.066 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.072 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.078 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.072/0.405/1.066 ms
2025-03-20 02:17:06,891 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-39793270 with expectation True passed
2025-03-20 02:17:06,977 - DEBUG - [Pod ctest-pod-70823770] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-20 02:17:06,977 - DEBUG - [Pod Pod ctest-pod-70823770] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-03-20 02:17:06,977 - DEBUG - [Pod Pod ctest-pod-70823770] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-20 02:17:06,977 - INFO - wget check of of http://10.47.255.251 from ctest-pod-70823770 passed
2025-03-20 02:17:07,029 - DEBUG - [Pod ctest-pod-70823770] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-20 02:17:07,029 - DEBUG - [Pod Pod ctest-pod-70823770] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-03-20 02:17:07,029 - DEBUG - [Pod Pod ctest-pod-70823770] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-20 02:17:07,029 - INFO - wget check of of http://10.47.255.250 from ctest-pod-70823770 passed
2025-03-20 02:17:12,111 - DEBUG - [Pod ctest-pod-21174880] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-20 02:17:12,111 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-20 02:17:12,111 - DEBUG - [Pod Pod ctest-pod-21174880] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-20 02:17:12,111 - INFO - wget check of of http://10.47.255.250 from ctest-pod-21174880 passed
2025-03-20 02:17:12,175 - DEBUG - [Pod ctest-pod-78022570] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-20 02:17:12,175 - DEBUG - [Pod Pod ctest-pod-78022570] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-03-20 02:17:12,175 - DEBUG - [Pod Pod ctest-pod-78022570] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-20 02:17:12,175 - INFO - wget check of of http://10.47.255.251 from ctest-pod-78022570 passed
2025-03-20 02:17:12,175 - INFO - Deleting Network Policy : ingress-on-service
2025-03-20 02:17:12,175 - INFO - Deleting service : ctest-nginx-svc-64021673
2025-03-20 02:17:12,435 - DEBUG - No XMPP flaps were noticed during the test
2025-03-20 02:17:12,435 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:06]
2025-03-20 02:17:12,435 - INFO - --------------------------------------------------------------------------------
2025-03-20 02:17:12,441 - INFO - Deleting pod ctest-new-default-00543228:ctest-pod-11112280
2025-03-20 02:17:12,441 - INFO - Deleting pod ctest-new-default-00543228:ctest-pod-69054424
2025-03-20 02:17:12,442 - INFO - Deleting pod ctest-non-default-82983500:ctest-pod-83219257
2025-03-20 02:17:12,442 - INFO - Deleting pod ctest-non-default-82983500:ctest-pod-45217746
2025-03-20 02:17:12,442 - INFO - Deleting pod ctest-new-default-00543228:ctest-pod-21174880
2025-03-20 02:17:12,443 - INFO - Deleting pod ctest-new-default-00543228:ctest-pod-70823770
2025-03-20 02:17:12,443 - INFO - Deleting pod ctest-non-default-82983500:ctest-pod-39793270
2025-03-20 02:17:12,444 - INFO - Deleting pod ctest-non-default-82983500:ctest-pod-78022570
2025-03-20 02:17:12,590 - WARNING - Pod uuid d185057c-285b-4207-b9a2-76f1d85fc4ef is still seen in agent 10.0.0.22 VM list
2025-03-20 02:17:12,590 - WARNING - Pod uuid d7246dbf-3456-4eb4-bc26-476d7976bc75 is still seen in agent 10.0.0.22 VM list
2025-03-20 02:17:12,592 - WARNING - Pod uuid ff51f947-7fcf-44b0-b0a6-3dffd0d73bcf is still seen in agent 10.0.0.22 VM list
2025-03-20 02:17:12,593 - WARNING - Pod uuid e3ea73b3-8e9e-4ec3-ae2e-cfc1e596e1c2 is still seen in agent 10.0.0.22 VM list
2025-03-20 02:17:12,593 - WARNING - Pod uuid b1254a28-7afa-4a0e-b018-acd9a4887605 is still seen in agent 10.0.0.22 VM list
2025-03-20 02:17:12,593 - WARNING - Pod uuid 57348ae1-2e51-45bb-83de-488c34622ce1 is still seen in agent 10.0.0.22 VM list
2025-03-20 02:17:12,594 - WARNING - Pod uuid 910f355a-2384-4b97-a40e-7f4598ab033e is still seen in agent 10.0.0.22 VM list
2025-03-20 02:17:12,595 - WARNING - Pod uuid d3791ec7-4af1-4d62-9618-44db3cdb6814 is still seen in agent 10.0.0.22 VM list
2025-03-20 02:17:17,635 - DEBUG - Pod e3ea73b3-8e9e-4ec3-ae2e-cfc1e596e1c2 is not in agent 10.0.0.22 VM list
2025-03-20 02:17:17,642 - WARNING - Pod uuid d3791ec7-4af1-4d62-9618-44db3cdb6814 is still seen in agent 10.0.0.22 VM list
2025-03-20 02:17:17,642 - WARNING - Pod uuid 910f355a-2384-4b97-a40e-7f4598ab033e is still seen in agent 10.0.0.22 VM list
2025-03-20 02:17:17,643 - DEBUG - Pod d185057c-285b-4207-b9a2-76f1d85fc4ef is not in agent 10.0.0.22 VM list
2025-03-20 02:17:17,645 - DEBUG - Pod ff51f947-7fcf-44b0-b0a6-3dffd0d73bcf is not in agent 10.0.0.22 VM list
2025-03-20 02:17:17,647 - DEBUG - Pod b1254a28-7afa-4a0e-b018-acd9a4887605 is not in agent 10.0.0.22 VM list
2025-03-20 02:17:17,648 - WARNING - Pod uuid d7246dbf-3456-4eb4-bc26-476d7976bc75 is still seen in agent 10.0.0.22 VM list
2025-03-20 02:17:17,649 - WARNING - Pod uuid 57348ae1-2e51-45bb-83de-488c34622ce1 is still seen in agent 10.0.0.22 VM list
2025-03-20 02:17:17,669 - DEBUG - VMI f67f2722-0530-11f0-8ed9-fa163e22f11c is removed from agent 10.0.0.22
2025-03-20 02:17:17,669 - INFO - Verified that pod ctest-pod-45217746 is removed in agent
2025-03-20 02:17:17,669 - DEBUG - VMI f54261ee-0530-11f0-8ed9-fa163e22f11c is removed from agent 10.0.0.22
2025-03-20 02:17:17,669 - INFO - Verified that pod ctest-pod-69054424 is removed in agent
2025-03-20 02:17:17,671 - DEBUG - VMI f5fbc4b8-0530-11f0-8ed9-fa163e22f11c is removed from agent 10.0.0.22
2025-03-20 02:17:17,671 - INFO - Verified that pod ctest-pod-83219257 is removed in agent
2025-03-20 02:17:17,672 - DEBUG - VMI f4b5cd38-0530-11f0-8ed9-fa163e22f11c is removed from agent 10.0.0.22
2025-03-20 02:17:17,672 - INFO - Verified that pod ctest-pod-11112280 is removed in agent
2025-03-20 02:17:22,657 - WARNING - Pod uuid 910f355a-2384-4b97-a40e-7f4598ab033e is still seen in agent 10.0.0.22 VM list
2025-03-20 02:17:22,663 - WARNING - Pod uuid d3791ec7-4af1-4d62-9618-44db3cdb6814 is still seen in agent 10.0.0.22 VM list
2025-03-20 02:17:22,665 - WARNING - Pod uuid 57348ae1-2e51-45bb-83de-488c34622ce1 is still seen in agent 10.0.0.22 VM list
2025-03-20 02:17:22,665 - WARNING - Pod uuid d7246dbf-3456-4eb4-bc26-476d7976bc75 is still seen in agent 10.0.0.22 VM list
2025-03-20 02:17:27,677 - WARNING - Pod uuid 910f355a-2384-4b97-a40e-7f4598ab033e is still seen in agent 10.0.0.22 VM list
2025-03-20 02:17:27,687 - WARNING - Pod uuid d3791ec7-4af1-4d62-9618-44db3cdb6814 is still seen in agent 10.0.0.22 VM list
2025-03-20 02:17:27,689 - WARNING - Pod uuid 57348ae1-2e51-45bb-83de-488c34622ce1 is still seen in agent 10.0.0.22 VM list
2025-03-20 02:17:27,690 - WARNING - Pod uuid d7246dbf-3456-4eb4-bc26-476d7976bc75 is still seen in agent 10.0.0.22 VM list
2025-03-20 02:17:32,686 - WARNING - Pod uuid 910f355a-2384-4b97-a40e-7f4598ab033e is still seen in agent 10.0.0.22 VM list
2025-03-20 02:17:32,703 - WARNING - Pod uuid d3791ec7-4af1-4d62-9618-44db3cdb6814 is still seen in agent 10.0.0.22 VM list
2025-03-20 02:17:32,705 - WARNING - Pod uuid d7246dbf-3456-4eb4-bc26-476d7976bc75 is still seen in agent 10.0.0.22 VM list
2025-03-20 02:17:32,705 - WARNING - Pod uuid 57348ae1-2e51-45bb-83de-488c34622ce1 is still seen in agent 10.0.0.22 VM list
2025-03-20 02:17:37,694 - WARNING - Pod uuid 910f355a-2384-4b97-a40e-7f4598ab033e is still seen in agent 10.0.0.22 VM list
2025-03-20 02:17:37,719 - WARNING - Pod uuid d3791ec7-4af1-4d62-9618-44db3cdb6814 is still seen in agent 10.0.0.22 VM list
2025-03-20 02:17:37,720 - WARNING - Pod uuid 57348ae1-2e51-45bb-83de-488c34622ce1 is still seen in agent 10.0.0.22 VM list
2025-03-20 02:17:37,721 - WARNING - Pod uuid d7246dbf-3456-4eb4-bc26-476d7976bc75 is still seen in agent 10.0.0.22 VM list
2025-03-20 02:17:42,728 - WARNING - Pod uuid 910f355a-2384-4b97-a40e-7f4598ab033e is still seen in agent 10.0.0.22 VM list
2025-03-20 02:17:42,737 - WARNING - Pod uuid d3791ec7-4af1-4d62-9618-44db3cdb6814 is still seen in agent 10.0.0.22 VM list
2025-03-20 02:17:42,739 - WARNING - Pod uuid d7246dbf-3456-4eb4-bc26-476d7976bc75 is still seen in agent 10.0.0.22 VM list
2025-03-20 02:17:42,739 - WARNING - Pod uuid 57348ae1-2e51-45bb-83de-488c34622ce1 is still seen in agent 10.0.0.22 VM list
2025-03-20 02:17:47,736 - DEBUG - Pod 910f355a-2384-4b97-a40e-7f4598ab033e is not in agent 10.0.0.22 VM list
2025-03-20 02:17:47,760 - DEBUG - Pod 57348ae1-2e51-45bb-83de-488c34622ce1 is not in agent 10.0.0.22 VM list
2025-03-20 02:17:47,761 - DEBUG - Pod d3791ec7-4af1-4d62-9618-44db3cdb6814 is not in agent 10.0.0.22 VM list
2025-03-20 02:17:47,763 - DEBUG - VMI f836b1f2-0530-11f0-8ed9-fa163e22f11c is removed from agent 10.0.0.22
2025-03-20 02:17:47,763 - INFO - Verified that pod ctest-pod-39793270 is removed in agent
2025-03-20 02:17:47,765 - DEBUG - Pod d7246dbf-3456-4eb4-bc26-476d7976bc75 is not in agent 10.0.0.22 VM list
2025-03-20 02:17:47,794 - DEBUG - VMI f720bab0-0530-11f0-8ed9-fa163e22f11c is removed from agent 10.0.0.22
2025-03-20 02:17:47,795 - INFO - Verified that pod ctest-pod-21174880 is removed in agent
2025-03-20 02:17:47,795 - DEBUG - VMI f7b4a8a6-0530-11f0-8ed9-fa163e22f11c is removed from agent 10.0.0.22
2025-03-20 02:17:47,795 - INFO - Verified that pod ctest-pod-70823770 is removed in agent
2025-03-20 02:17:47,796 - DEBUG - VMI f8bada9a-0530-11f0-8ed9-fa163e22f11c is removed from agent 10.0.0.22
2025-03-20 02:17:47,796 - INFO - Verified that pod ctest-pod-78022570 is removed in agent
2025-03-20 02:17:47,796 - INFO - Deleting namespace ctest-non-default-82983500
2025-03-20 02:17:47,815 - DEBUG - Namespace ctest-non-default-82983500 still in k8s
2025-03-20 02:17:49,821 - DEBUG - Namespace ctest-non-default-82983500 still in k8s
2025-03-20 02:17:51,826 - DEBUG - Namespace ctest-non-default-82983500 still in k8s
2025-03-20 02:17:53,832 - DEBUG - Namespace ctest-non-default-82983500 is not in k8s
2025-03-20 02:17:53,832 - DEBUG - No need to check project deletion in contrail-api
2025-03-20 02:17:53,832 - INFO - Deleting namespace ctest-new-default-00543228
2025-03-20 02:17:53,847 - DEBUG - Namespace ctest-new-default-00543228 still in k8s
2025-03-20 02:17:55,853 - DEBUG - Namespace ctest-new-default-00543228 still in k8s
2025-03-20 02:17:57,858 - DEBUG - Namespace ctest-new-default-00543228 still in k8s
2025-03-20 02:17:59,863 - DEBUG - Namespace ctest-new-default-00543228 is not in k8s
2025-03-20 02:17:59,863 - DEBUG - No need to check project deletion in contrail-api