2025-04-28 15:55:40,569 - INFO - Using existing project ['default-domain', 'k8s-default'](b5e52bd2-e310-48a4-be89-9603d0a3f535)
2025-04-28 15:55:40,587 - DEBUG - Namespace ctest-new-default-39353957 not present
2025-04-28 15:55:40,594 - INFO - Created namespace ctest-new-default-39353957
2025-04-28 15:55:43,600 - DEBUG - Namespace ctest-non-default-27048587 not present
2025-04-28 15:55:43,610 - INFO - Created namespace ctest-non-default-27048587
2025-04-28 15:55:46,628 - DEBUG - Pod ctest-pod-64586208 not present
2025-04-28 15:55:46,629 - INFO - Creating Pod ctest-pod-64586208
2025-04-28 15:55:46,666 - DEBUG - Pod : ctest-pod-64586208 UUID is f189e9ef-3b1f-4652-b46b-34164e858d61
2025-04-28 15:55:46,668 - DEBUG - Pod ctest-pod-98242035 not present
2025-04-28 15:55:46,668 - INFO - Creating Pod ctest-pod-98242035
2025-04-28 15:55:46,721 - DEBUG - Pod : ctest-pod-98242035 UUID is c0536ffb-4d55-44f3-b0cf-fae51fa63194
2025-04-28 15:55:46,725 - DEBUG - Pod ctest-pod-98438550 not present
2025-04-28 15:55:46,725 - INFO - Creating Pod ctest-pod-98438550
2025-04-28 15:55:46,775 - DEBUG - Pod : ctest-pod-98438550 UUID is 1147ef3f-6ac4-47f6-81ff-32ee0667f22d
2025-04-28 15:55:46,780 - DEBUG - Pod ctest-pod-09262645 not present
2025-04-28 15:55:46,781 - INFO - Creating Pod ctest-pod-09262645
2025-04-28 15:55:46,803 - DEBUG - Pod : ctest-pod-09262645 UUID is 07632109-72e2-4906-be72-9d6429cc1c94
2025-04-28 15:55:46,807 - DEBUG - Pod ctest-pod-49532279 not present
2025-04-28 15:55:46,807 - INFO - Creating Pod ctest-pod-49532279
2025-04-28 15:55:46,826 - DEBUG - Pod : ctest-pod-49532279 UUID is 0eb25a58-8e3a-4f7c-b71d-d3151b797c1a
2025-04-28 15:55:46,828 - DEBUG - Pod ctest-pod-29124638 not present
2025-04-28 15:55:46,828 - INFO - Creating Pod ctest-pod-29124638
2025-04-28 15:55:46,845 - DEBUG - Pod : ctest-pod-29124638 UUID is 98c3cf91-d76f-4f0b-9114-49e6757ef064
2025-04-28 15:55:46,847 - DEBUG - Pod ctest-pod-42066933 not present
2025-04-28 15:55:46,848 - INFO - Creating Pod ctest-pod-42066933
2025-04-28 15:55:46,867 - DEBUG - Pod : ctest-pod-42066933 UUID is 3e753739-0f65-4358-bc90-6b1ea180e75d
2025-04-28 15:55:46,871 - DEBUG - Pod ctest-pod-55467851 not present
2025-04-28 15:55:46,871 - INFO - Creating Pod ctest-pod-55467851
2025-04-28 15:55:46,906 - DEBUG - Pod : ctest-pod-55467851 UUID is db6f1e4b-0f53-4fc7-b09b-c22e2230f25e
2025-04-28 15:55:47,078 - INFO - Project default-domain:k8s-ctest-new-default-39353957 for Namespace ctest-new-default-39353957 is seen in contrail-api
2025-04-28 15:55:47,078 - DEBUG - Project uuid in Contrail is fc1fe9e8-e59d-43cd-83a2-d759dae1e2e2
2025-04-28 15:55:47,291 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_NamespaceDatabaseList?namespace_uuid=8899ca85-c894-4c36-9aaf-256b232cd1f4
2025-04-28 15:55:47,299 - INFO - Namespace ctest-new-default-39353957 with uuid 8899ca85-c894-4c36-9aaf-256b232cd1f4 found in kube manager
2025-04-28 15:55:47,299 - INFO - Namespace ctest-new-default-39353957 verification passed
2025-04-28 15:55:47,468 - INFO - Project default-domain:k8s-ctest-non-default-27048587 for Namespace ctest-non-default-27048587 is seen in contrail-api
2025-04-28 15:55:47,469 - DEBUG - Project uuid in Contrail is 9138e9ba-9d92-47a0-9d58-6037fbdcd8a1
2025-04-28 15:55:47,469 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_NamespaceDatabaseList?namespace_uuid=76372e64-2864-439b-b246-3b7d28009c44
2025-04-28 15:55:47,481 - INFO - Namespace ctest-non-default-27048587 with uuid 76372e64-2864-439b-b246-3b7d28009c44 found in kube manager
2025-04-28 15:55:47,481 - INFO - Namespace ctest-non-default-27048587 verification passed
2025-04-28 15:55:47,489 - DEBUG - Pod ctest-pod-64586208 not in running state.Currently in Pending
2025-04-28 15:55:52,501 - DEBUG - Pod ctest-pod-64586208 not in running state.Currently in Pending
2025-04-28 15:55:57,508 - INFO - Pod ctest-pod-64586208 is in running state.Got IP 10.47.255.251
2025-04-28 15:55:57,561 - DEBUG - Pod ctest-pod-64586208 has vmi 40a32dd0-2449-11f0-884c-fa163e744e77
2025-04-28 15:55:57,562 - INFO - Verified pod ctest-pod-64586208 in contrail-api
2025-04-28 15:55:57,574 - DEBUG - VMI 40a32dd0-2449-11f0-884c-fa163e744e77 is active in agent 10.0.0.23
2025-04-28 15:55:57,574 - INFO - Verified Pod ctest-pod-64586208 in agent 10.0.0.23
2025-04-28 15:55:57,574 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=f189e9ef-3b1f-4652-b46b-34164e858d61
2025-04-28 15:55:57,578 - INFO - Pod ctest-pod-64586208 with uuid f189e9ef-3b1f-4652-b46b-34164e858d61 found in kube manager
2025-04-28 15:55:57,579 - INFO - Pod ctest-pod-64586208 verification passed
2025-04-28 15:55:57,584 - DEBUG - Pod ctest-pod-98242035 not in running state.Currently in Pending
2025-04-28 15:56:02,592 - INFO - Pod ctest-pod-98242035 is in running state.Got IP 10.47.255.250
2025-04-28 15:56:02,605 - DEBUG - Pod ctest-pod-98242035 has vmi 4135ed64-2449-11f0-884c-fa163e744e77
2025-04-28 15:56:02,605 - INFO - Verified pod ctest-pod-98242035 in contrail-api
2025-04-28 15:56:02,619 - DEBUG - VMI 4135ed64-2449-11f0-884c-fa163e744e77 is active in agent 10.0.0.23
2025-04-28 15:56:02,619 - INFO - Verified Pod ctest-pod-98242035 in agent 10.0.0.23
2025-04-28 15:56:02,619 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=c0536ffb-4d55-44f3-b0cf-fae51fa63194
2025-04-28 15:56:02,624 - INFO - Pod ctest-pod-98242035 with uuid c0536ffb-4d55-44f3-b0cf-fae51fa63194 found in kube manager
2025-04-28 15:56:02,624 - INFO - Pod ctest-pod-98242035 verification passed
2025-04-28 15:56:02,629 - INFO - Pod ctest-pod-98438550 is in running state.Got IP 10.47.255.249
2025-04-28 15:56:02,689 - DEBUG - Pod ctest-pod-98438550 has vmi 41ec4442-2449-11f0-884c-fa163e744e77
2025-04-28 15:56:02,690 - INFO - Verified pod ctest-pod-98438550 in contrail-api
2025-04-28 15:56:02,703 - DEBUG - VMI 41ec4442-2449-11f0-884c-fa163e744e77 is active in agent 10.0.0.23
2025-04-28 15:56:02,703 - INFO - Verified Pod ctest-pod-98438550 in agent 10.0.0.23
2025-04-28 15:56:02,704 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=1147ef3f-6ac4-47f6-81ff-32ee0667f22d
2025-04-28 15:56:02,708 - INFO - Pod ctest-pod-98438550 with uuid 1147ef3f-6ac4-47f6-81ff-32ee0667f22d found in kube manager
2025-04-28 15:56:02,708 - INFO - Pod ctest-pod-98438550 verification passed
2025-04-28 15:56:02,714 - INFO - Pod ctest-pod-09262645 is in running state.Got IP 10.47.255.248
2025-04-28 15:56:02,730 - DEBUG - Pod ctest-pod-09262645 has vmi 4282a75c-2449-11f0-884c-fa163e744e77
2025-04-28 15:56:02,730 - INFO - Verified pod ctest-pod-09262645 in contrail-api
2025-04-28 15:56:02,742 - DEBUG - VMI 4282a75c-2449-11f0-884c-fa163e744e77 is active in agent 10.0.0.23
2025-04-28 15:56:02,742 - INFO - Verified Pod ctest-pod-09262645 in agent 10.0.0.23
2025-04-28 15:56:02,743 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=07632109-72e2-4906-be72-9d6429cc1c94
2025-04-28 15:56:02,747 - INFO - Pod ctest-pod-09262645 with uuid 07632109-72e2-4906-be72-9d6429cc1c94 found in kube manager
2025-04-28 15:56:02,747 - INFO - Pod ctest-pod-09262645 verification passed
2025-04-28 15:56:02,752 - DEBUG - Pod ctest-pod-49532279 not in running state.Currently in Pending
2025-04-28 15:56:07,759 - INFO - Pod ctest-pod-49532279 is in running state.Got IP 10.47.255.247
2025-04-28 15:56:07,813 - DEBUG - Pod ctest-pod-49532279 has vmi 432d6e9e-2449-11f0-884c-fa163e744e77
2025-04-28 15:56:07,813 - INFO - Verified pod ctest-pod-49532279 in contrail-api
2025-04-28 15:56:07,827 - DEBUG - VMI 432d6e9e-2449-11f0-884c-fa163e744e77 is active in agent 10.0.0.23
2025-04-28 15:56:07,827 - INFO - Verified Pod ctest-pod-49532279 in agent 10.0.0.23
2025-04-28 15:56:07,827 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=0eb25a58-8e3a-4f7c-b71d-d3151b797c1a
2025-04-28 15:56:07,831 - INFO - Pod ctest-pod-49532279 with uuid 0eb25a58-8e3a-4f7c-b71d-d3151b797c1a found in kube manager
2025-04-28 15:56:07,831 - INFO - Pod ctest-pod-49532279 verification passed
2025-04-28 15:56:07,837 - INFO - Pod ctest-pod-42066933 is in running state.Got IP 10.47.255.245
2025-04-28 15:56:07,849 - DEBUG - Pod ctest-pod-42066933 has vmi 444ae860-2449-11f0-884c-fa163e744e77
2025-04-28 15:56:07,850 - INFO - Verified pod ctest-pod-42066933 in contrail-api
2025-04-28 15:56:07,863 - DEBUG - VMI 444ae860-2449-11f0-884c-fa163e744e77 is active in agent 10.0.0.23
2025-04-28 15:56:07,863 - INFO - Verified Pod ctest-pod-42066933 in agent 10.0.0.23
2025-04-28 15:56:07,863 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=3e753739-0f65-4358-bc90-6b1ea180e75d
2025-04-28 15:56:07,867 - INFO - Pod ctest-pod-42066933 with uuid 3e753739-0f65-4358-bc90-6b1ea180e75d found in kube manager
2025-04-28 15:56:07,867 - INFO - Pod ctest-pod-42066933 verification passed
2025-04-28 15:56:07,938 - INFO - Pod ctest-pod-29124638 is in running state.Got IP 10.47.255.246
2025-04-28 15:56:07,997 - DEBUG - Pod ctest-pod-29124638 has vmi 43bbe89a-2449-11f0-884c-fa163e744e77
2025-04-28 15:56:07,998 - INFO - Verified pod ctest-pod-29124638 in contrail-api
2025-04-28 15:56:08,018 - DEBUG - VMI 43bbe89a-2449-11f0-884c-fa163e744e77 is active in agent 10.0.0.23
2025-04-28 15:56:08,018 - INFO - Verified Pod ctest-pod-29124638 in agent 10.0.0.23
2025-04-28 15:56:08,019 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=98c3cf91-d76f-4f0b-9114-49e6757ef064
2025-04-28 15:56:08,024 - INFO - Pod ctest-pod-29124638 with uuid 98c3cf91-d76f-4f0b-9114-49e6757ef064 found in kube manager
2025-04-28 15:56:08,024 - INFO - Pod ctest-pod-29124638 verification passed
2025-04-28 15:56:08,029 - INFO - Pod ctest-pod-55467851 is in running state.Got IP 10.47.255.244
2025-04-28 15:56:08,046 - DEBUG - Pod ctest-pod-55467851 has vmi 44ce4c32-2449-11f0-884c-fa163e744e77
2025-04-28 15:56:08,046 - INFO - Verified pod ctest-pod-55467851 in contrail-api
2025-04-28 15:56:08,062 - DEBUG - VMI 44ce4c32-2449-11f0-884c-fa163e744e77 is active in agent 10.0.0.23
2025-04-28 15:56:08,063 - INFO - Verified Pod ctest-pod-55467851 in agent 10.0.0.23
2025-04-28 15:56:08,063 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=db6f1e4b-0f53-4fc7-b09b-c22e2230f25e
2025-04-28 15:56:08,069 - INFO - Pod ctest-pod-55467851 with uuid db6f1e4b-0f53-4fc7-b09b-c22e2230f25e found in kube manager
2025-04-28 15:56:08,069 - INFO - Pod ctest-pod-55467851 verification passed
2025-04-28 15:56:08,069 - INFO - ================================================================================
2025-04-28 15:56:08,070 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-04-28 15:56:08,070 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-04-28 15:56:08,322 - DEBUG - Nothing to compare xmpp stats {'10.0.0.23': {'10.0.0.249': '0'}} with
2025-04-28 15:56:08,322 - INFO - Initial checks done. Running the testcase now
2025-04-28 15:56:08,322 - INFO -
2025-04-28 15:56:08,397 - DEBUG - [Pod ctest-pod-64586208] Cmd: echo ctest-pod-64586208 > /usr/share/nginx/html/index.html, Output:
2025-04-28 15:56:08,457 - DEBUG - [Pod ctest-pod-98242035] Cmd: echo ctest-pod-98242035 > /usr/share/nginx/html/index.html, Output:
2025-04-28 15:56:08,517 - DEBUG - [Pod ctest-pod-98438550] Cmd: echo ctest-pod-98438550 > /usr/share/nginx/html/index.html, Output:
2025-04-28 15:56:08,596 - DEBUG - [Pod ctest-pod-09262645] Cmd: echo ctest-pod-09262645 > /usr/share/nginx/html/index.html, Output:
2025-04-28 15:56:08,599 - DEBUG - Service ctest-nginx-svc-42028185 not present
2025-04-28 15:56:08,599 - INFO - Creating service ctest-nginx-svc-42028185
2025-04-28 15:56:08,620 - INFO - Created Service ctest-nginx-svc-42028185
2025-04-28 15:56:08,635 - WARNING - Service UUID c9725528-dd2c-4d0f-b97d-8ffc793b6d85 not yet found in contrail-api
2025-04-28 15:56:09,647 - INFO - Validated that Service ctest-nginx-svc-42028185 is seen in contrail-api
2025-04-28 15:56:09,647 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_LoadbalancerDatabaseList?x=c9725528-dd2c-4d0f-b97d-8ffc793b6d85
2025-04-28 15:56:09,657 - INFO - Service ctest-nginx-svc-42028185 with uuid c9725528-dd2c-4d0f-b97d-8ffc793b6d85 found in kube manager
2025-04-28 15:56:09,657 - INFO - Service ctest-nginx-svc-42028185 verification passed
2025-04-28 15:56:10,723 - DEBUG - [Pod ctest-pod-49532279] Cmd: wget http://10.106.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-64586208
2025-04-28 15:56:10,723 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd wget http://10.106.212.188:80/ -O - -T 5 -t 1 passed
2025-04-28 15:56:10,723 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-64586208
2025-04-28 15:56:10,779 - DEBUG - [Pod ctest-pod-49532279] Cmd: wget http://10.106.212.188:80/ -O - -T 5 -t 1 , Output: ctest-pod-98242035
Connecting to 10.106.212.188:80 (10.106.212.188:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-28 15:56:10,779 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd wget http://10.106.212.188:80/ -O - -T 5 -t 1 passed
2025-04-28 15:56:10,779 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd output: ctest-pod-98242035
Connecting to 10.106.212.188:80 (10.106.212.188:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-28 15:56:10,779 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-64586208': 1, 'ctest-pod-98242035': 1}
2025-04-28 15:56:10,837 - DEBUG - [Pod ctest-pod-42066933] Cmd: wget http://10.106.212.188:80/ -O - -T 5 -t 1 , Output: ctest-pod-98242035
Connecting to 10.106.212.188:80 (10.106.212.188:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-28 15:56:10,837 - DEBUG - [Pod Pod ctest-pod-42066933] Cmd wget http://10.106.212.188:80/ -O - -T 5 -t 1 passed
2025-04-28 15:56:10,837 - DEBUG - [Pod Pod ctest-pod-42066933] Cmd output: ctest-pod-98242035
Connecting to 10.106.212.188:80 (10.106.212.188:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-28 15:56:10,893 - DEBUG - [Pod ctest-pod-42066933] Cmd: wget http://10.106.212.188:80/ -O - -T 5 -t 1 , Output: ctest-pod-64586208
Connecting to 10.106.212.188:80 (10.106.212.188:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-28 15:56:10,893 - DEBUG - [Pod Pod ctest-pod-42066933] Cmd wget http://10.106.212.188:80/ -O - -T 5 -t 1 passed
2025-04-28 15:56:10,893 - DEBUG - [Pod Pod ctest-pod-42066933] Cmd output: ctest-pod-64586208
Connecting to 10.106.212.188:80 (10.106.212.188:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-28 15:56:10,893 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-64586208': 1, 'ctest-pod-98242035': 1}
2025-04-28 15:56:10,896 - DEBUG - Network policy ingress-on-service not present
2025-04-28 15:56:10,896 - INFO - Creating Network Policy ingress-on-service
2025-04-28 15:56:10,907 - INFO - Network policy found in k8s
2025-04-28 15:56:10,907 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=af0b9d7d-d493-48ac-81d5-c4e85a34d7ec
2025-04-28 15:56:10,912 - INFO - Network Policy ingress-on-service with uuid af0b9d7d-d493-48ac-81d5-c4e85a34d7ec found in kube manager
2025-04-28 15:56:10,945 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-04-28 15:56:10,946 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-04-28 15:56:10,946 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=af0b9d7d-d493-48ac-81d5-c4e85a34d7ec
2025-04-28 15:56:10,975 - WARNING - Network policy with name ingress-on-service not found in agent
2025-04-28 15:56:12,976 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=af0b9d7d-d493-48ac-81d5-c4e85a34d7ec
2025-04-28 15:56:13,006 - INFO - Network policy with name ingress-on-service found in agent
2025-04-28 15:56:13,007 - INFO - Network Policy ingress-on-service verification passed
2025-04-28 15:56:18,059 - DEBUG - [Pod ctest-pod-49532279] Cmd: wget http://10.106.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:56:18,060 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd wget http://10.106.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:56:18,060 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:56:23,107 - DEBUG - [Pod ctest-pod-49532279] Cmd: wget http://10.106.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:56:23,107 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd wget http://10.106.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:56:23,107 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:56:28,156 - DEBUG - [Pod ctest-pod-49532279] Cmd: wget http://10.106.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:56:28,156 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd wget http://10.106.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:56:28,156 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:56:33,207 - DEBUG - [Pod ctest-pod-49532279] Cmd: wget http://10.106.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:56:33,207 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd wget http://10.106.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:56:33,207 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:56:38,265 - DEBUG - [Pod ctest-pod-49532279] Cmd: wget http://10.106.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:56:38,265 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd wget http://10.106.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:56:38,265 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:56:43,315 - DEBUG - [Pod ctest-pod-49532279] Cmd: wget http://10.106.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:56:43,315 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd wget http://10.106.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:56:43,315 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:56:48,373 - DEBUG - [Pod ctest-pod-49532279] Cmd: wget http://10.106.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:56:48,373 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd wget http://10.106.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:56:48,373 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:56:53,429 - DEBUG - [Pod ctest-pod-49532279] Cmd: wget http://10.106.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:56:53,429 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd wget http://10.106.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:56:53,429 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:56:58,485 - DEBUG - [Pod ctest-pod-49532279] Cmd: wget http://10.106.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:56:58,485 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd wget http://10.106.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:56:58,485 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:57:03,536 - DEBUG - [Pod ctest-pod-49532279] Cmd: wget http://10.106.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:57:03,536 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd wget http://10.106.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:57:03,536 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:57:03,536 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-64586208': 0, 'ctest-pod-98242035': 0}
2025-04-28 15:57:03,592 - DEBUG - [Pod ctest-pod-29124638] Cmd: wget http://10.106.212.188:80/ -O - -T 5 -t 1 , Output: ctest-pod-64586208
Connecting to 10.106.212.188:80 (10.106.212.188:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-28 15:57:03,592 - DEBUG - [Pod Pod ctest-pod-29124638] Cmd wget http://10.106.212.188:80/ -O - -T 5 -t 1 passed
2025-04-28 15:57:03,592 - DEBUG - [Pod Pod ctest-pod-29124638] Cmd output: ctest-pod-64586208
Connecting to 10.106.212.188:80 (10.106.212.188:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-28 15:57:03,654 - DEBUG - [Pod ctest-pod-29124638] Cmd: wget http://10.106.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-64586208
2025-04-28 15:57:03,654 - DEBUG - [Pod Pod ctest-pod-29124638] Cmd wget http://10.106.212.188:80/ -O - -T 5 -t 1 passed
2025-04-28 15:57:03,654 - DEBUG - [Pod Pod ctest-pod-29124638] Cmd output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-64586208
2025-04-28 15:57:03,713 - DEBUG - [Pod ctest-pod-29124638] Cmd: wget http://10.106.212.188:80/ -O - -T 5 -t 1 , Output: ctest-pod-98242035
Connecting to 10.106.212.188:80 (10.106.212.188:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-28 15:57:03,714 - DEBUG - [Pod Pod ctest-pod-29124638] Cmd wget http://10.106.212.188:80/ -O - -T 5 -t 1 passed
2025-04-28 15:57:03,714 - DEBUG - [Pod Pod ctest-pod-29124638] Cmd output: ctest-pod-98242035
Connecting to 10.106.212.188:80 (10.106.212.188:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-28 15:57:03,714 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-64586208': 2, 'ctest-pod-98242035': 1}
2025-04-28 15:57:08,767 - DEBUG - [Pod ctest-pod-42066933] Cmd: wget http://10.106.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:57:08,767 - DEBUG - [Pod Pod ctest-pod-42066933] Cmd wget http://10.106.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:57:08,767 - DEBUG - [Pod Pod ctest-pod-42066933] Cmd output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:57:13,822 - DEBUG - [Pod ctest-pod-42066933] Cmd: wget http://10.106.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:57:13,822 - DEBUG - [Pod Pod ctest-pod-42066933] Cmd wget http://10.106.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:57:13,822 - DEBUG - [Pod Pod ctest-pod-42066933] Cmd output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:57:18,876 - DEBUG - [Pod ctest-pod-42066933] Cmd: wget http://10.106.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:57:18,876 - DEBUG - [Pod Pod ctest-pod-42066933] Cmd wget http://10.106.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:57:18,876 - DEBUG - [Pod Pod ctest-pod-42066933] Cmd output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:57:23,936 - DEBUG - [Pod ctest-pod-42066933] Cmd: wget http://10.106.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:57:23,936 - DEBUG - [Pod Pod ctest-pod-42066933] Cmd wget http://10.106.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:57:23,936 - DEBUG - [Pod Pod ctest-pod-42066933] Cmd output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:57:29,000 - DEBUG - [Pod ctest-pod-42066933] Cmd: wget http://10.106.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:57:29,000 - DEBUG - [Pod Pod ctest-pod-42066933] Cmd wget http://10.106.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:57:29,000 - DEBUG - [Pod Pod ctest-pod-42066933] Cmd output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:57:34,057 - DEBUG - [Pod ctest-pod-42066933] Cmd: wget http://10.106.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:57:34,057 - DEBUG - [Pod Pod ctest-pod-42066933] Cmd wget http://10.106.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:57:34,057 - DEBUG - [Pod Pod ctest-pod-42066933] Cmd output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:57:39,115 - DEBUG - [Pod ctest-pod-42066933] Cmd: wget http://10.106.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:57:39,115 - DEBUG - [Pod Pod ctest-pod-42066933] Cmd wget http://10.106.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:57:39,115 - DEBUG - [Pod Pod ctest-pod-42066933] Cmd output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:57:44,171 - DEBUG - [Pod ctest-pod-42066933] Cmd: wget http://10.106.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:57:44,171 - DEBUG - [Pod Pod ctest-pod-42066933] Cmd wget http://10.106.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:57:44,171 - DEBUG - [Pod Pod ctest-pod-42066933] Cmd output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:57:49,231 - DEBUG - [Pod ctest-pod-42066933] Cmd: wget http://10.106.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:57:49,231 - DEBUG - [Pod Pod ctest-pod-42066933] Cmd wget http://10.106.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:57:49,231 - DEBUG - [Pod Pod ctest-pod-42066933] Cmd output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:57:54,283 - DEBUG - [Pod ctest-pod-42066933] Cmd: wget http://10.106.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:57:54,283 - DEBUG - [Pod Pod ctest-pod-42066933] Cmd wget http://10.106.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:57:54,283 - DEBUG - [Pod Pod ctest-pod-42066933] Cmd output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:57:54,283 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-64586208': 0, 'ctest-pod-98242035': 0}
2025-04-28 15:57:56,341 - DEBUG - [Pod ctest-pod-29124638] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.697 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.078 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.085 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.078/0.286/0.697 ms
2025-04-28 15:57:56,341 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-29124638 with expectation True passed
2025-04-28 15:57:58,423 - DEBUG - [Pod ctest-pod-49532279] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.694 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.073 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.102 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.073/0.289/0.694 ms
2025-04-28 15:57:58,423 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-49532279 with expectation True passed
2025-04-28 15:58:00,475 - DEBUG - [Pod ctest-pod-42066933] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.068 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.074 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.085 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.074/0.409/1.068 ms
2025-04-28 15:58:00,476 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-42066933 with expectation True passed
2025-04-28 15:58:00,530 - DEBUG - [Pod ctest-pod-29124638] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-28 15:58:00,530 - DEBUG - [Pod Pod ctest-pod-29124638] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-04-28 15:58:00,530 - DEBUG - [Pod Pod ctest-pod-29124638] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-28 15:58:00,530 - INFO - wget check of of http://10.47.255.251 from ctest-pod-29124638 passed
2025-04-28 15:58:00,583 - DEBUG - [Pod ctest-pod-29124638] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-28 15:58:00,583 - DEBUG - [Pod Pod ctest-pod-29124638] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-04-28 15:58:00,583 - DEBUG - [Pod Pod ctest-pod-29124638] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-28 15:58:00,583 - INFO - wget check of of http://10.47.255.250 from ctest-pod-29124638 passed
2025-04-28 15:58:05,636 - DEBUG - [Pod ctest-pod-49532279] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-28 15:58:05,636 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-28 15:58:05,636 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-28 15:58:05,636 - INFO - wget check of of http://10.47.255.250 from ctest-pod-49532279 passed
2025-04-28 15:58:10,695 - DEBUG - [Pod ctest-pod-55467851] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-04-28 15:58:10,695 - DEBUG - [Pod Pod ctest-pod-55467851] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-04-28 15:58:10,695 - DEBUG - [Pod Pod ctest-pod-55467851] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-04-28 15:58:10,695 - INFO - wget check of of http://10.47.255.251 from ctest-pod-55467851 passed
2025-04-28 15:58:10,703 - INFO - Updating Network Policy ingress-on-service
2025-04-28 15:58:15,759 - DEBUG - [Pod ctest-pod-49532279] Cmd: wget http://10.106.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:58:15,759 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd wget http://10.106.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:58:15,759 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:58:20,811 - DEBUG - [Pod ctest-pod-49532279] Cmd: wget http://10.106.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:58:20,812 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd wget http://10.106.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:58:20,812 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:58:25,865 - DEBUG - [Pod ctest-pod-49532279] Cmd: wget http://10.106.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:58:25,865 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd wget http://10.106.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:58:25,865 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:58:30,920 - DEBUG - [Pod ctest-pod-49532279] Cmd: wget http://10.106.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:58:30,920 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd wget http://10.106.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:58:30,920 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:58:35,979 - DEBUG - [Pod ctest-pod-49532279] Cmd: wget http://10.106.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:58:35,979 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd wget http://10.106.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:58:35,979 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:58:41,039 - DEBUG - [Pod ctest-pod-49532279] Cmd: wget http://10.106.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:58:41,039 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd wget http://10.106.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:58:41,039 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:58:46,091 - DEBUG - [Pod ctest-pod-49532279] Cmd: wget http://10.106.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:58:46,091 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd wget http://10.106.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:58:46,092 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:58:51,143 - DEBUG - [Pod ctest-pod-49532279] Cmd: wget http://10.106.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:58:51,143 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd wget http://10.106.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:58:51,143 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:58:56,191 - DEBUG - [Pod ctest-pod-49532279] Cmd: wget http://10.106.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:58:56,191 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd wget http://10.106.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:58:56,191 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:59:01,243 - DEBUG - [Pod ctest-pod-49532279] Cmd: wget http://10.106.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:59:01,243 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd wget http://10.106.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:59:01,243 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
wget: download timed out
2025-04-28 15:59:01,243 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-64586208': 0, 'ctest-pod-98242035': 0}
2025-04-28 15:59:01,288 - DEBUG - [Pod ctest-pod-29124638] Cmd: wget http://10.106.212.188:80/ -O - -T 5 -t 1 , Output: ctest-pod-98242035
Connecting to 10.106.212.188:80 (10.106.212.188:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-28 15:59:01,288 - DEBUG - [Pod Pod ctest-pod-29124638] Cmd wget http://10.106.212.188:80/ -O - -T 5 -t 1 passed
2025-04-28 15:59:01,289 - DEBUG - [Pod Pod ctest-pod-29124638] Cmd output: ctest-pod-98242035
Connecting to 10.106.212.188:80 (10.106.212.188:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-28 15:59:01,344 - DEBUG - [Pod ctest-pod-29124638] Cmd: wget http://10.106.212.188:80/ -O - -T 5 -t 1 , Output: ctest-pod-64586208
Connecting to 10.106.212.188:80 (10.106.212.188:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-28 15:59:01,344 - DEBUG - [Pod Pod ctest-pod-29124638] Cmd wget http://10.106.212.188:80/ -O - -T 5 -t 1 passed
2025-04-28 15:59:01,344 - DEBUG - [Pod Pod ctest-pod-29124638] Cmd output: ctest-pod-64586208
Connecting to 10.106.212.188:80 (10.106.212.188:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-28 15:59:01,344 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-64586208': 1, 'ctest-pod-98242035': 1}
2025-04-28 15:59:01,400 - DEBUG - [Pod ctest-pod-42066933] Cmd: wget http://10.106.212.188:80/ -O - -T 5 -t 1 , Output: ctest-pod-98242035
Connecting to 10.106.212.188:80 (10.106.212.188:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-28 15:59:01,400 - DEBUG - [Pod Pod ctest-pod-42066933] Cmd wget http://10.106.212.188:80/ -O - -T 5 -t 1 passed
2025-04-28 15:59:01,400 - DEBUG - [Pod Pod ctest-pod-42066933] Cmd output: ctest-pod-98242035
Connecting to 10.106.212.188:80 (10.106.212.188:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-28 15:59:01,457 - DEBUG - [Pod ctest-pod-42066933] Cmd: wget http://10.106.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-64586208
2025-04-28 15:59:01,457 - DEBUG - [Pod Pod ctest-pod-42066933] Cmd wget http://10.106.212.188:80/ -O - -T 5 -t 1 passed
2025-04-28 15:59:01,457 - DEBUG - [Pod Pod ctest-pod-42066933] Cmd output: Connecting to 10.106.212.188:80 (10.106.212.188:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-64586208
2025-04-28 15:59:01,457 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-64586208': 1, 'ctest-pod-98242035': 1}
2025-04-28 15:59:03,507 - DEBUG - [Pod ctest-pod-29124638] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.830 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.069 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.073 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.069/0.324/0.830 ms
2025-04-28 15:59:03,507 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-29124638 with expectation True passed
2025-04-28 15:59:05,560 - DEBUG - [Pod ctest-pod-49532279] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.687 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.075 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.078 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.075/0.280/0.687 ms
2025-04-28 15:59:05,560 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-49532279 with expectation True passed
2025-04-28 15:59:07,611 - DEBUG - [Pod ctest-pod-42066933] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.402 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.087 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.076 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.076/0.188/0.402 ms
2025-04-28 15:59:07,611 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-42066933 with expectation True passed
2025-04-28 15:59:07,661 - DEBUG - [Pod ctest-pod-29124638] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-28 15:59:07,661 - DEBUG - [Pod Pod ctest-pod-29124638] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-04-28 15:59:07,661 - DEBUG - [Pod Pod ctest-pod-29124638] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-28 15:59:07,661 - INFO - wget check of of http://10.47.255.251 from ctest-pod-29124638 passed
2025-04-28 15:59:07,713 - DEBUG - [Pod ctest-pod-29124638] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-28 15:59:07,714 - DEBUG - [Pod Pod ctest-pod-29124638] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-04-28 15:59:07,714 - DEBUG - [Pod Pod ctest-pod-29124638] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-28 15:59:07,714 - INFO - wget check of of http://10.47.255.250 from ctest-pod-29124638 passed
2025-04-28 15:59:12,770 - DEBUG - [Pod ctest-pod-49532279] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-28 15:59:12,771 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-28 15:59:12,771 - DEBUG - [Pod Pod ctest-pod-49532279] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-28 15:59:12,771 - INFO - wget check of of http://10.47.255.250 from ctest-pod-49532279 passed
2025-04-28 15:59:12,824 - DEBUG - [Pod ctest-pod-55467851] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-28 15:59:12,825 - DEBUG - [Pod Pod ctest-pod-55467851] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-04-28 15:59:12,825 - DEBUG - [Pod Pod ctest-pod-55467851] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-28 15:59:12,825 - INFO - wget check of of http://10.47.255.251 from ctest-pod-55467851 passed
2025-04-28 15:59:12,825 - INFO - Deleting Network Policy : ingress-on-service
2025-04-28 15:59:12,825 - INFO - Deleting service : ctest-nginx-svc-42028185
2025-04-28 15:59:13,077 - DEBUG - No XMPP flaps were noticed during the test
2025-04-28 15:59:13,077 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:05]
2025-04-28 15:59:13,078 - INFO - --------------------------------------------------------------------------------
2025-04-28 15:59:13,083 - INFO - Deleting pod ctest-new-default-39353957:ctest-pod-64586208
2025-04-28 15:59:13,084 - INFO - Deleting pod ctest-new-default-39353957:ctest-pod-98242035
2025-04-28 15:59:13,084 - INFO - Deleting pod ctest-non-default-27048587:ctest-pod-98438550
2025-04-28 15:59:13,084 - INFO - Deleting pod ctest-non-default-27048587:ctest-pod-09262645
2025-04-28 15:59:13,085 - INFO - Deleting pod ctest-new-default-39353957:ctest-pod-49532279
2025-04-28 15:59:13,085 - INFO - Deleting pod ctest-new-default-39353957:ctest-pod-29124638
2025-04-28 15:59:13,085 - INFO - Deleting pod ctest-non-default-27048587:ctest-pod-42066933
2025-04-28 15:59:13,086 - INFO - Deleting pod ctest-non-default-27048587:ctest-pod-55467851
2025-04-28 15:59:13,253 - WARNING - Pod uuid f189e9ef-3b1f-4652-b46b-34164e858d61 is still seen in agent 10.0.0.23 VM list
2025-04-28 15:59:13,262 - WARNING - Pod uuid 1147ef3f-6ac4-47f6-81ff-32ee0667f22d is still seen in agent 10.0.0.23 VM list
2025-04-28 15:59:13,263 - WARNING - Pod uuid 0eb25a58-8e3a-4f7c-b71d-d3151b797c1a is still seen in agent 10.0.0.23 VM list
2025-04-28 15:59:13,264 - WARNING - Pod uuid 07632109-72e2-4906-be72-9d6429cc1c94 is still seen in agent 10.0.0.23 VM list
2025-04-28 15:59:13,265 - WARNING - Pod uuid c0536ffb-4d55-44f3-b0cf-fae51fa63194 is still seen in agent 10.0.0.23 VM list
2025-04-28 15:59:13,267 - WARNING - Pod uuid 3e753739-0f65-4358-bc90-6b1ea180e75d is still seen in agent 10.0.0.23 VM list
2025-04-28 15:59:13,267 - WARNING - Pod uuid 98c3cf91-d76f-4f0b-9114-49e6757ef064 is still seen in agent 10.0.0.23 VM list
2025-04-28 15:59:13,268 - WARNING - Pod uuid db6f1e4b-0f53-4fc7-b09b-c22e2230f25e is still seen in agent 10.0.0.23 VM list
2025-04-28 15:59:18,296 - WARNING - Pod uuid c0536ffb-4d55-44f3-b0cf-fae51fa63194 is still seen in agent 10.0.0.23 VM list
2025-04-28 15:59:18,296 - DEBUG - Pod 07632109-72e2-4906-be72-9d6429cc1c94 is not in agent 10.0.0.23 VM list
2025-04-28 15:59:18,300 - WARNING - Pod uuid 3e753739-0f65-4358-bc90-6b1ea180e75d is still seen in agent 10.0.0.23 VM list
2025-04-28 15:59:18,301 - WARNING - Pod uuid 98c3cf91-d76f-4f0b-9114-49e6757ef064 is still seen in agent 10.0.0.23 VM list
2025-04-28 15:59:18,301 - WARNING - Pod uuid db6f1e4b-0f53-4fc7-b09b-c22e2230f25e is still seen in agent 10.0.0.23 VM list
2025-04-28 15:59:18,302 - WARNING - Pod uuid 0eb25a58-8e3a-4f7c-b71d-d3151b797c1a is still seen in agent 10.0.0.23 VM list
2025-04-28 15:59:18,302 - DEBUG - Pod f189e9ef-3b1f-4652-b46b-34164e858d61 is not in agent 10.0.0.23 VM list
2025-04-28 15:59:18,303 - DEBUG - Pod 1147ef3f-6ac4-47f6-81ff-32ee0667f22d is not in agent 10.0.0.23 VM list
2025-04-28 15:59:18,315 - DEBUG - VMI 4282a75c-2449-11f0-884c-fa163e744e77 is removed from agent 10.0.0.23
2025-04-28 15:59:18,315 - INFO - Verified that pod ctest-pod-09262645 is removed in agent
2025-04-28 15:59:18,316 - DEBUG - VMI 40a32dd0-2449-11f0-884c-fa163e744e77 is removed from agent 10.0.0.23
2025-04-28 15:59:18,316 - INFO - Verified that pod ctest-pod-64586208 is removed in agent
2025-04-28 15:59:18,317 - DEBUG - VMI 41ec4442-2449-11f0-884c-fa163e744e77 is removed from agent 10.0.0.23
2025-04-28 15:59:18,317 - INFO - Verified that pod ctest-pod-98438550 is removed in agent
2025-04-28 15:59:23,308 - WARNING - Pod uuid c0536ffb-4d55-44f3-b0cf-fae51fa63194 is still seen in agent 10.0.0.23 VM list
2025-04-28 15:59:23,320 - WARNING - Pod uuid 0eb25a58-8e3a-4f7c-b71d-d3151b797c1a is still seen in agent 10.0.0.23 VM list
2025-04-28 15:59:23,320 - WARNING - Pod uuid 3e753739-0f65-4358-bc90-6b1ea180e75d is still seen in agent 10.0.0.23 VM list
2025-04-28 15:59:23,321 - WARNING - Pod uuid 98c3cf91-d76f-4f0b-9114-49e6757ef064 is still seen in agent 10.0.0.23 VM list
2025-04-28 15:59:23,322 - WARNING - Pod uuid db6f1e4b-0f53-4fc7-b09b-c22e2230f25e is still seen in agent 10.0.0.23 VM list
2025-04-28 15:59:28,317 - WARNING - Pod uuid c0536ffb-4d55-44f3-b0cf-fae51fa63194 is still seen in agent 10.0.0.23 VM list
2025-04-28 15:59:28,352 - WARNING - Pod uuid 98c3cf91-d76f-4f0b-9114-49e6757ef064 is still seen in agent 10.0.0.23 VM list
2025-04-28 15:59:28,353 - WARNING - Pod uuid db6f1e4b-0f53-4fc7-b09b-c22e2230f25e is still seen in agent 10.0.0.23 VM list
2025-04-28 15:59:28,353 - WARNING - Pod uuid 3e753739-0f65-4358-bc90-6b1ea180e75d is still seen in agent 10.0.0.23 VM list
2025-04-28 15:59:28,353 - WARNING - Pod uuid 0eb25a58-8e3a-4f7c-b71d-d3151b797c1a is still seen in agent 10.0.0.23 VM list
2025-04-28 15:59:33,325 - WARNING - Pod uuid c0536ffb-4d55-44f3-b0cf-fae51fa63194 is still seen in agent 10.0.0.23 VM list
2025-04-28 15:59:33,379 - WARNING - Pod uuid 98c3cf91-d76f-4f0b-9114-49e6757ef064 is still seen in agent 10.0.0.23 VM list
2025-04-28 15:59:33,381 - WARNING - Pod uuid 3e753739-0f65-4358-bc90-6b1ea180e75d is still seen in agent 10.0.0.23 VM list
2025-04-28 15:59:33,381 - WARNING - Pod uuid db6f1e4b-0f53-4fc7-b09b-c22e2230f25e is still seen in agent 10.0.0.23 VM list
2025-04-28 15:59:33,382 - WARNING - Pod uuid 0eb25a58-8e3a-4f7c-b71d-d3151b797c1a is still seen in agent 10.0.0.23 VM list
2025-04-28 15:59:38,334 - WARNING - Pod uuid c0536ffb-4d55-44f3-b0cf-fae51fa63194 is still seen in agent 10.0.0.23 VM list
2025-04-28 15:59:38,401 - WARNING - Pod uuid 0eb25a58-8e3a-4f7c-b71d-d3151b797c1a is still seen in agent 10.0.0.23 VM list
2025-04-28 15:59:38,402 - WARNING - Pod uuid 98c3cf91-d76f-4f0b-9114-49e6757ef064 is still seen in agent 10.0.0.23 VM list
2025-04-28 15:59:38,403 - WARNING - Pod uuid db6f1e4b-0f53-4fc7-b09b-c22e2230f25e is still seen in agent 10.0.0.23 VM list
2025-04-28 15:59:38,404 - WARNING - Pod uuid 3e753739-0f65-4358-bc90-6b1ea180e75d is still seen in agent 10.0.0.23 VM list
2025-04-28 15:59:43,344 - WARNING - Pod uuid c0536ffb-4d55-44f3-b0cf-fae51fa63194 is still seen in agent 10.0.0.23 VM list
2025-04-28 15:59:43,441 - WARNING - Pod uuid 98c3cf91-d76f-4f0b-9114-49e6757ef064 is still seen in agent 10.0.0.23 VM list
2025-04-28 15:59:43,443 - WARNING - Pod uuid db6f1e4b-0f53-4fc7-b09b-c22e2230f25e is still seen in agent 10.0.0.23 VM list
2025-04-28 15:59:43,444 - WARNING - Pod uuid 3e753739-0f65-4358-bc90-6b1ea180e75d is still seen in agent 10.0.0.23 VM list
2025-04-28 15:59:43,444 - WARNING - Pod uuid 0eb25a58-8e3a-4f7c-b71d-d3151b797c1a is still seen in agent 10.0.0.23 VM list
2025-04-28 15:59:48,352 - DEBUG - Pod c0536ffb-4d55-44f3-b0cf-fae51fa63194 is not in agent 10.0.0.23 VM list
2025-04-28 15:59:48,359 - DEBUG - VMI 4135ed64-2449-11f0-884c-fa163e744e77 is removed from agent 10.0.0.23
2025-04-28 15:59:48,359 - INFO - Verified that pod ctest-pod-98242035 is removed in agent
2025-04-28 15:59:48,461 - DEBUG - Pod 98c3cf91-d76f-4f0b-9114-49e6757ef064 is not in agent 10.0.0.23 VM list
2025-04-28 15:59:48,465 - DEBUG - Pod 3e753739-0f65-4358-bc90-6b1ea180e75d is not in agent 10.0.0.23 VM list
2025-04-28 15:59:48,466 - DEBUG - Pod db6f1e4b-0f53-4fc7-b09b-c22e2230f25e is not in agent 10.0.0.23 VM list
2025-04-28 15:59:48,467 - DEBUG - Pod 0eb25a58-8e3a-4f7c-b71d-d3151b797c1a is not in agent 10.0.0.23 VM list
2025-04-28 15:59:48,484 - DEBUG - VMI 432d6e9e-2449-11f0-884c-fa163e744e77 is removed from agent 10.0.0.23
2025-04-28 15:59:48,484 - INFO - Verified that pod ctest-pod-49532279 is removed in agent
2025-04-28 15:59:48,485 - DEBUG - VMI 43bbe89a-2449-11f0-884c-fa163e744e77 is removed from agent 10.0.0.23
2025-04-28 15:59:48,485 - INFO - Verified that pod ctest-pod-29124638 is removed in agent
2025-04-28 15:59:48,486 - DEBUG - VMI 44ce4c32-2449-11f0-884c-fa163e744e77 is removed from agent 10.0.0.23
2025-04-28 15:59:48,486 - INFO - Verified that pod ctest-pod-55467851 is removed in agent
2025-04-28 15:59:48,487 - DEBUG - VMI 444ae860-2449-11f0-884c-fa163e744e77 is removed from agent 10.0.0.23
2025-04-28 15:59:48,487 - INFO - Verified that pod ctest-pod-42066933 is removed in agent
2025-04-28 15:59:48,487 - INFO - Deleting namespace ctest-non-default-27048587
2025-04-28 15:59:48,506 - DEBUG - Namespace ctest-non-default-27048587 still in k8s
2025-04-28 15:59:50,512 - DEBUG - Namespace ctest-non-default-27048587 still in k8s
2025-04-28 15:59:52,516 - DEBUG - Namespace ctest-non-default-27048587 still in k8s
2025-04-28 15:59:54,520 - DEBUG - Namespace ctest-non-default-27048587 is not in k8s
2025-04-28 15:59:54,520 - DEBUG - No need to check project deletion in contrail-api
2025-04-28 15:59:54,520 - INFO - Deleting namespace ctest-new-default-39353957
2025-04-28 15:59:54,528 - DEBUG - Namespace ctest-new-default-39353957 still in k8s
2025-04-28 15:59:56,533 - DEBUG - Namespace ctest-new-default-39353957 still in k8s
2025-04-28 15:59:58,537 - DEBUG - Namespace ctest-new-default-39353957 still in k8s
2025-04-28 16:00:00,541 - DEBUG - Namespace ctest-new-default-39353957 is not in k8s
2025-04-28 16:00:00,541 - DEBUG - No need to check project deletion in contrail-api