2025-05-06 11:34:40,450 - INFO - Using existing project ['default-domain', 'k8s-default'](8a5c8227-1d21-45d9-b3d4-0b1573b589c0)
2025-05-06 11:34:40,474 - DEBUG - Namespace ctest-new-default-84067068 not present
2025-05-06 11:34:40,486 - INFO - Created namespace ctest-new-default-84067068
2025-05-06 11:34:43,495 - DEBUG - Namespace ctest-non-default-58863215 not present
2025-05-06 11:34:43,544 - INFO - Created namespace ctest-non-default-58863215
2025-05-06 11:34:46,588 - DEBUG - Pod ctest-pod-68511956 not present
2025-05-06 11:34:46,588 - INFO - Creating Pod ctest-pod-68511956
2025-05-06 11:34:46,652 - DEBUG - Pod : ctest-pod-68511956 UUID is 995171fd-029b-434c-8525-1a6364314a2e
2025-05-06 11:34:46,657 - DEBUG - Pod ctest-pod-09556533 not present
2025-05-06 11:34:46,658 - INFO - Creating Pod ctest-pod-09556533
2025-05-06 11:34:46,689 - DEBUG - Pod : ctest-pod-09556533 UUID is d5f9bb84-24bc-4a7c-ad76-03123b58f80a
2025-05-06 11:34:46,692 - DEBUG - Pod ctest-pod-28262885 not present
2025-05-06 11:34:46,693 - INFO - Creating Pod ctest-pod-28262885
2025-05-06 11:34:46,733 - DEBUG - Pod : ctest-pod-28262885 UUID is 45dffcf4-99e6-4840-991d-bad26bf4a990
2025-05-06 11:34:46,735 - DEBUG - Pod ctest-pod-69988945 not present
2025-05-06 11:34:46,735 - INFO - Creating Pod ctest-pod-69988945
2025-05-06 11:34:46,756 - DEBUG - Pod : ctest-pod-69988945 UUID is a4496a04-2870-483c-ab69-9ac215dfc726
2025-05-06 11:34:46,759 - DEBUG - Pod ctest-pod-53056594 not present
2025-05-06 11:34:46,759 - INFO - Creating Pod ctest-pod-53056594
2025-05-06 11:34:46,774 - DEBUG - Pod : ctest-pod-53056594 UUID is 9d226dd6-9549-4b72-bca8-ec5b68e0a911
2025-05-06 11:34:46,776 - DEBUG - Pod ctest-pod-01112069 not present
2025-05-06 11:34:46,776 - INFO - Creating Pod ctest-pod-01112069
2025-05-06 11:34:46,802 - DEBUG - Pod : ctest-pod-01112069 UUID is f723a833-f6bb-4c0d-9590-c2b88083a758
2025-05-06 11:34:46,804 - DEBUG - Pod ctest-pod-14614639 not present
2025-05-06 11:34:46,804 - INFO - Creating Pod ctest-pod-14614639
2025-05-06 11:34:46,830 - DEBUG - Pod : ctest-pod-14614639 UUID is 31b0c2f8-8fa1-4ac9-b40b-38ae32ad0d47
2025-05-06 11:34:46,834 - DEBUG - Pod ctest-pod-93793390 not present
2025-05-06 11:34:46,834 - INFO - Creating Pod ctest-pod-93793390
2025-05-06 11:34:46,855 - DEBUG - Pod : ctest-pod-93793390 UUID is 318888be-e4d6-46e0-bd81-cdf35383ffc7
2025-05-06 11:34:47,074 - INFO - Project default-domain:k8s-ctest-new-default-84067068 for Namespace ctest-new-default-84067068 is seen in contrail-api
2025-05-06 11:34:47,074 - DEBUG - Project uuid in Contrail is 9b4db97e-5459-4f19-880b-e7dac08087df
2025-05-06 11:34:47,279 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_NamespaceDatabaseList?namespace_uuid=1bf30798-446e-4ffb-a760-b030af2852da
2025-05-06 11:34:47,284 - INFO - Namespace ctest-new-default-84067068 with uuid 1bf30798-446e-4ffb-a760-b030af2852da found in kube manager
2025-05-06 11:34:47,284 - INFO - Namespace ctest-new-default-84067068 verification passed
2025-05-06 11:34:47,566 - INFO - Project default-domain:k8s-ctest-non-default-58863215 for Namespace ctest-non-default-58863215 is seen in contrail-api
2025-05-06 11:34:47,566 - DEBUG - Project uuid in Contrail is 6eb1f7d2-5bc3-4173-9a6f-e0a119fe728e
2025-05-06 11:34:47,566 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_NamespaceDatabaseList?namespace_uuid=7dabb980-2d83-4c04-b059-8f0900058639
2025-05-06 11:34:47,574 - INFO - Namespace ctest-non-default-58863215 with uuid 7dabb980-2d83-4c04-b059-8f0900058639 found in kube manager
2025-05-06 11:34:47,575 - INFO - Namespace ctest-non-default-58863215 verification passed
2025-05-06 11:34:47,587 - DEBUG - Pod ctest-pod-68511956 not in running state.Currently in Pending
2025-05-06 11:34:52,621 - DEBUG - Pod ctest-pod-68511956 not in running state.Currently in Pending
2025-05-06 11:34:57,632 - INFO - Pod ctest-pod-68511956 is in running state.Got IP 10.47.255.251
2025-05-06 11:34:57,656 - DEBUG - Pod ctest-pod-68511956 has vmi 1deb8f64-2a6e-11f0-8df7-fa163ee5e42a
2025-05-06 11:34:57,656 - INFO - Verified pod ctest-pod-68511956 in contrail-api
2025-05-06 11:34:57,670 - DEBUG - VMI 1deb8f64-2a6e-11f0-8df7-fa163ee5e42a is active in agent 10.0.0.65
2025-05-06 11:34:57,670 - INFO - Verified Pod ctest-pod-68511956 in agent 10.0.0.65
2025-05-06 11:34:57,670 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=995171fd-029b-434c-8525-1a6364314a2e
2025-05-06 11:34:57,676 - INFO - Pod ctest-pod-68511956 with uuid 995171fd-029b-434c-8525-1a6364314a2e found in kube manager
2025-05-06 11:34:57,677 - INFO - Pod ctest-pod-68511956 verification passed
2025-05-06 11:34:57,685 - INFO - Pod ctest-pod-09556533 is in running state.Got IP 10.47.255.250
2025-05-06 11:34:57,742 - DEBUG - Pod ctest-pod-09556533 has vmi 1e7a7d0a-2a6e-11f0-8df7-fa163ee5e42a
2025-05-06 11:34:57,742 - INFO - Verified pod ctest-pod-09556533 in contrail-api
2025-05-06 11:34:57,760 - DEBUG - VMI 1e7a7d0a-2a6e-11f0-8df7-fa163ee5e42a is active in agent 10.0.0.65
2025-05-06 11:34:57,762 - INFO - Verified Pod ctest-pod-09556533 in agent 10.0.0.65
2025-05-06 11:34:57,763 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=d5f9bb84-24bc-4a7c-ad76-03123b58f80a
2025-05-06 11:34:57,769 - INFO - Pod ctest-pod-09556533 with uuid d5f9bb84-24bc-4a7c-ad76-03123b58f80a found in kube manager
2025-05-06 11:34:57,769 - INFO - Pod ctest-pod-09556533 verification passed
2025-05-06 11:34:57,776 - INFO - Pod ctest-pod-28262885 is in running state.Got IP 10.47.255.249
2025-05-06 11:34:57,794 - DEBUG - Pod ctest-pod-28262885 has vmi 1f35a01c-2a6e-11f0-8df7-fa163ee5e42a
2025-05-06 11:34:57,794 - INFO - Verified pod ctest-pod-28262885 in contrail-api
2025-05-06 11:34:57,810 - DEBUG - VMI 1f35a01c-2a6e-11f0-8df7-fa163ee5e42a is active in agent 10.0.0.65
2025-05-06 11:34:57,811 - INFO - Verified Pod ctest-pod-28262885 in agent 10.0.0.65
2025-05-06 11:34:57,811 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=45dffcf4-99e6-4840-991d-bad26bf4a990
2025-05-06 11:34:57,818 - INFO - Pod ctest-pod-28262885 with uuid 45dffcf4-99e6-4840-991d-bad26bf4a990 found in kube manager
2025-05-06 11:34:57,818 - INFO - Pod ctest-pod-28262885 verification passed
2025-05-06 11:34:57,828 - DEBUG - Pod ctest-pod-69988945 not in running state.Currently in Pending
2025-05-06 11:35:02,845 - INFO - Pod ctest-pod-69988945 is in running state.Got IP 10.47.255.248
2025-05-06 11:35:02,910 - DEBUG - Pod ctest-pod-69988945 has vmi 1fc51abc-2a6e-11f0-8df7-fa163ee5e42a
2025-05-06 11:35:02,910 - INFO - Verified pod ctest-pod-69988945 in contrail-api
2025-05-06 11:35:02,928 - DEBUG - VMI 1fc51abc-2a6e-11f0-8df7-fa163ee5e42a is active in agent 10.0.0.65
2025-05-06 11:35:02,929 - INFO - Verified Pod ctest-pod-69988945 in agent 10.0.0.65
2025-05-06 11:35:02,929 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=a4496a04-2870-483c-ab69-9ac215dfc726
2025-05-06 11:35:02,936 - INFO - Pod ctest-pod-69988945 with uuid a4496a04-2870-483c-ab69-9ac215dfc726 found in kube manager
2025-05-06 11:35:02,936 - INFO - Pod ctest-pod-69988945 verification passed
2025-05-06 11:35:02,945 - DEBUG - Pod ctest-pod-53056594 not in running state.Currently in Pending
2025-05-06 11:35:07,963 - INFO - Pod ctest-pod-53056594 is in running state.Got IP 10.47.255.247
2025-05-06 11:35:08,010 - DEBUG - Pod ctest-pod-53056594 has vmi 2063b56e-2a6e-11f0-8df7-fa163ee5e42a
2025-05-06 11:35:08,010 - INFO - Verified pod ctest-pod-53056594 in contrail-api
2025-05-06 11:35:08,034 - DEBUG - VMI 2063b56e-2a6e-11f0-8df7-fa163ee5e42a is active in agent 10.0.0.65
2025-05-06 11:35:08,035 - INFO - Verified Pod ctest-pod-53056594 in agent 10.0.0.65
2025-05-06 11:35:08,035 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=9d226dd6-9549-4b72-bca8-ec5b68e0a911
2025-05-06 11:35:08,045 - INFO - Pod ctest-pod-53056594 with uuid 9d226dd6-9549-4b72-bca8-ec5b68e0a911 found in kube manager
2025-05-06 11:35:08,045 - INFO - Pod ctest-pod-53056594 verification passed
2025-05-06 11:35:08,055 - INFO - Pod ctest-pod-14614639 is in running state.Got IP 10.47.255.245
2025-05-06 11:35:08,080 - DEBUG - Pod ctest-pod-14614639 has vmi 215c4c10-2a6e-11f0-8df7-fa163ee5e42a
2025-05-06 11:35:08,080 - INFO - Verified pod ctest-pod-14614639 in contrail-api
2025-05-06 11:35:08,099 - DEBUG - VMI 215c4c10-2a6e-11f0-8df7-fa163ee5e42a is active in agent 10.0.0.65
2025-05-06 11:35:08,100 - INFO - Verified Pod ctest-pod-14614639 in agent 10.0.0.65
2025-05-06 11:35:08,100 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=31b0c2f8-8fa1-4ac9-b40b-38ae32ad0d47
2025-05-06 11:35:08,110 - INFO - Pod ctest-pod-14614639 with uuid 31b0c2f8-8fa1-4ac9-b40b-38ae32ad0d47 found in kube manager
2025-05-06 11:35:08,110 - INFO - Pod ctest-pod-14614639 verification passed
2025-05-06 11:35:08,198 - INFO - Pod ctest-pod-01112069 is in running state.Got IP 10.47.255.246
2025-05-06 11:35:08,279 - DEBUG - Pod ctest-pod-01112069 has vmi 20dfd59a-2a6e-11f0-8df7-fa163ee5e42a
2025-05-06 11:35:08,279 - INFO - Verified pod ctest-pod-01112069 in contrail-api
2025-05-06 11:35:08,307 - DEBUG - VMI 20dfd59a-2a6e-11f0-8df7-fa163ee5e42a is active in agent 10.0.0.65
2025-05-06 11:35:08,308 - INFO - Verified Pod ctest-pod-01112069 in agent 10.0.0.65
2025-05-06 11:35:08,308 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=f723a833-f6bb-4c0d-9590-c2b88083a758
2025-05-06 11:35:08,321 - INFO - Pod ctest-pod-01112069 with uuid f723a833-f6bb-4c0d-9590-c2b88083a758 found in kube manager
2025-05-06 11:35:08,322 - INFO - Pod ctest-pod-01112069 verification passed
2025-05-06 11:35:08,340 - INFO - Pod ctest-pod-93793390 is in running state.Got IP 10.47.255.244
2025-05-06 11:35:08,388 - DEBUG - Pod ctest-pod-93793390 has vmi 21e81402-2a6e-11f0-8df7-fa163ee5e42a
2025-05-06 11:35:08,388 - INFO - Verified pod ctest-pod-93793390 in contrail-api
2025-05-06 11:35:08,412 - DEBUG - VMI 21e81402-2a6e-11f0-8df7-fa163ee5e42a is active in agent 10.0.0.65
2025-05-06 11:35:08,412 - INFO - Verified Pod ctest-pod-93793390 in agent 10.0.0.65
2025-05-06 11:35:08,413 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=318888be-e4d6-46e0-bd81-cdf35383ffc7
2025-05-06 11:35:08,423 - INFO - Pod ctest-pod-93793390 with uuid 318888be-e4d6-46e0-bd81-cdf35383ffc7 found in kube manager
2025-05-06 11:35:08,423 - INFO - Pod ctest-pod-93793390 verification passed
2025-05-06 11:35:08,423 - INFO - ================================================================================
2025-05-06 11:35:08,423 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-05-06 11:35:08,424 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-05-06 11:35:08,814 - DEBUG - Nothing to compare xmpp stats {'10.0.0.65': {'10.0.0.57': '0'}} with
2025-05-06 11:35:08,815 - INFO - Initial checks done. Running the testcase now
2025-05-06 11:35:08,815 - INFO -
2025-05-06 11:35:08,897 - DEBUG - [Pod ctest-pod-68511956] Cmd: echo ctest-pod-68511956 > /usr/share/nginx/html/index.html, Output:
2025-05-06 11:35:08,972 - DEBUG - [Pod ctest-pod-09556533] Cmd: echo ctest-pod-09556533 > /usr/share/nginx/html/index.html, Output:
2025-05-06 11:35:09,045 - DEBUG - [Pod ctest-pod-28262885] Cmd: echo ctest-pod-28262885 > /usr/share/nginx/html/index.html, Output:
2025-05-06 11:35:09,117 - DEBUG - [Pod ctest-pod-69988945] Cmd: echo ctest-pod-69988945 > /usr/share/nginx/html/index.html, Output:
2025-05-06 11:35:09,122 - DEBUG - Service ctest-nginx-svc-96669158 not present
2025-05-06 11:35:09,123 - INFO - Creating service ctest-nginx-svc-96669158
2025-05-06 11:35:09,148 - INFO - Created Service ctest-nginx-svc-96669158
2025-05-06 11:35:09,163 - WARNING - Service UUID 02137dc1-f25a-44a7-a933-5aa440e7e43a not yet found in contrail-api
2025-05-06 11:35:10,169 - INFO - Validated that Service ctest-nginx-svc-96669158 is seen in contrail-api
2025-05-06 11:35:10,170 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_LoadbalancerDatabaseList?x=02137dc1-f25a-44a7-a933-5aa440e7e43a
2025-05-06 11:35:10,174 - INFO - Service ctest-nginx-svc-96669158 with uuid 02137dc1-f25a-44a7-a933-5aa440e7e43a found in kube manager
2025-05-06 11:35:10,174 - INFO - Service ctest-nginx-svc-96669158 verification passed
2025-05-06 11:35:11,257 - DEBUG - [Pod ctest-pod-53056594] Cmd: wget http://10.101.215.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
ctest-pod-09556533
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-06 11:35:11,257 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd wget http://10.101.215.4:80/ -O - -T 5 -t 1 passed
2025-05-06 11:35:11,257 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
ctest-pod-09556533
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-06 11:35:11,357 - DEBUG - [Pod ctest-pod-53056594] Cmd: wget http://10.101.215.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-09556533
2025-05-06 11:35:11,357 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd wget http://10.101.215.4:80/ -O - -T 5 -t 1 passed
2025-05-06 11:35:11,357 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-09556533
2025-05-06 11:35:11,442 - DEBUG - [Pod ctest-pod-53056594] Cmd: wget http://10.101.215.4:80/ -O - -T 5 -t 1 , Output: ctest-pod-68511956
Connecting to 10.101.215.4:80 (10.101.215.4:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-06 11:35:11,442 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd wget http://10.101.215.4:80/ -O - -T 5 -t 1 passed
2025-05-06 11:35:11,442 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd output: ctest-pod-68511956
Connecting to 10.101.215.4:80 (10.101.215.4:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-06 11:35:11,442 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-68511956': 1, 'ctest-pod-09556533': 2}
2025-05-06 11:35:11,534 - DEBUG - [Pod ctest-pod-14614639] Cmd: wget http://10.101.215.4:80/ -O - -T 5 -t 1 , Output: ctest-pod-09556533
Connecting to 10.101.215.4:80 (10.101.215.4:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-06 11:35:11,535 - DEBUG - [Pod Pod ctest-pod-14614639] Cmd wget http://10.101.215.4:80/ -O - -T 5 -t 1 passed
2025-05-06 11:35:11,535 - DEBUG - [Pod Pod ctest-pod-14614639] Cmd output: ctest-pod-09556533
Connecting to 10.101.215.4:80 (10.101.215.4:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-06 11:35:11,605 - DEBUG - [Pod ctest-pod-14614639] Cmd: wget http://10.101.215.4:80/ -O - -T 5 -t 1 , Output: ctest-pod-09556533
Connecting to 10.101.215.4:80 (10.101.215.4:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-06 11:35:11,605 - DEBUG - [Pod Pod ctest-pod-14614639] Cmd wget http://10.101.215.4:80/ -O - -T 5 -t 1 passed
2025-05-06 11:35:11,605 - DEBUG - [Pod Pod ctest-pod-14614639] Cmd output: ctest-pod-09556533
Connecting to 10.101.215.4:80 (10.101.215.4:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-06 11:35:11,660 - DEBUG - [Pod ctest-pod-14614639] Cmd: wget http://10.101.215.4:80/ -O - -T 5 -t 1 , Output: ctest-pod-09556533
Connecting to 10.101.215.4:80 (10.101.215.4:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-06 11:35:11,660 - DEBUG - [Pod Pod ctest-pod-14614639] Cmd wget http://10.101.215.4:80/ -O - -T 5 -t 1 passed
2025-05-06 11:35:11,660 - DEBUG - [Pod Pod ctest-pod-14614639] Cmd output: ctest-pod-09556533
Connecting to 10.101.215.4:80 (10.101.215.4:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-06 11:35:11,696 - DEBUG - [Pod ctest-pod-14614639] Cmd: wget http://10.101.215.4:80/ -O - -T 5 -t 1 , Output: ctest-pod-09556533
Connecting to 10.101.215.4:80 (10.101.215.4:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-06 11:35:11,696 - DEBUG - [Pod Pod ctest-pod-14614639] Cmd wget http://10.101.215.4:80/ -O - -T 5 -t 1 passed
2025-05-06 11:35:11,696 - DEBUG - [Pod Pod ctest-pod-14614639] Cmd output: ctest-pod-09556533
Connecting to 10.101.215.4:80 (10.101.215.4:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-06 11:35:11,752 - DEBUG - [Pod ctest-pod-14614639] Cmd: wget http://10.101.215.4:80/ -O - -T 5 -t 1 , Output: ctest-pod-68511956
Connecting to 10.101.215.4:80 (10.101.215.4:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-06 11:35:11,752 - DEBUG - [Pod Pod ctest-pod-14614639] Cmd wget http://10.101.215.4:80/ -O - -T 5 -t 1 passed
2025-05-06 11:35:11,752 - DEBUG - [Pod Pod ctest-pod-14614639] Cmd output: ctest-pod-68511956
Connecting to 10.101.215.4:80 (10.101.215.4:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-06 11:35:11,752 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-68511956': 1, 'ctest-pod-09556533': 4}
2025-05-06 11:35:11,760 - DEBUG - Network policy ingress-on-service not present
2025-05-06 11:35:11,761 - INFO - Creating Network Policy ingress-on-service
2025-05-06 11:35:11,788 - INFO - Network policy found in k8s
2025-05-06 11:35:11,788 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=b30fc8d9-2377-4bf0-b652-5db5dc818ded
2025-05-06 11:35:11,799 - INFO - Network Policy ingress-on-service with uuid b30fc8d9-2377-4bf0-b652-5db5dc818ded found in kube manager
2025-05-06 11:35:11,855 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-05-06 11:35:11,855 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-05-06 11:35:11,855 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=b30fc8d9-2377-4bf0-b652-5db5dc818ded
2025-05-06 11:35:11,894 - WARNING - Network policy with name ingress-on-service not found in agent
2025-05-06 11:35:13,895 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=b30fc8d9-2377-4bf0-b652-5db5dc818ded
2025-05-06 11:35:13,972 - INFO - Network policy with name ingress-on-service found in agent
2025-05-06 11:35:13,973 - INFO - Network Policy ingress-on-service verification passed
2025-05-06 11:35:19,043 - DEBUG - [Pod ctest-pod-53056594] Cmd: wget http://10.101.215.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:35:19,044 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd wget http://10.101.215.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:35:19,044 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:35:24,110 - DEBUG - [Pod ctest-pod-53056594] Cmd: wget http://10.101.215.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:35:24,110 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd wget http://10.101.215.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:35:24,111 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:35:29,180 - DEBUG - [Pod ctest-pod-53056594] Cmd: wget http://10.101.215.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:35:29,180 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd wget http://10.101.215.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:35:29,180 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:35:34,258 - DEBUG - [Pod ctest-pod-53056594] Cmd: wget http://10.101.215.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:35:34,259 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd wget http://10.101.215.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:35:34,259 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:35:36,552 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2025-05-06 11:35:46,638 - DEBUG - [Pod ctest-pod-53056594] Cmd: wget http://10.101.215.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:35:46,638 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd wget http://10.101.215.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:35:46,638 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:35:51,695 - DEBUG - [Pod ctest-pod-53056594] Cmd: wget http://10.101.215.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:35:51,695 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd wget http://10.101.215.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:35:51,695 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:35:56,751 - DEBUG - [Pod ctest-pod-53056594] Cmd: wget http://10.101.215.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:35:56,751 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd wget http://10.101.215.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:35:56,752 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:36:01,823 - DEBUG - [Pod ctest-pod-53056594] Cmd: wget http://10.101.215.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:36:01,823 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd wget http://10.101.215.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:36:01,823 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:36:06,882 - DEBUG - [Pod ctest-pod-53056594] Cmd: wget http://10.101.215.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:36:06,882 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd wget http://10.101.215.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:36:06,883 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:36:11,965 - DEBUG - [Pod ctest-pod-53056594] Cmd: wget http://10.101.215.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:36:11,965 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd wget http://10.101.215.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:36:11,965 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:36:11,965 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-68511956': 0, 'ctest-pod-09556533': 0}
2025-05-06 11:36:12,026 - DEBUG - [Pod ctest-pod-01112069] Cmd: wget http://10.101.215.4:80/ -O - -T 5 -t 1 , Output: ctest-pod-68511956
Connecting to 10.101.215.4:80 (10.101.215.4:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-06 11:36:12,027 - DEBUG - [Pod Pod ctest-pod-01112069] Cmd wget http://10.101.215.4:80/ -O - -T 5 -t 1 passed
2025-05-06 11:36:12,027 - DEBUG - [Pod Pod ctest-pod-01112069] Cmd output: ctest-pod-68511956
Connecting to 10.101.215.4:80 (10.101.215.4:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-06 11:36:12,085 - DEBUG - [Pod ctest-pod-01112069] Cmd: wget http://10.101.215.4:80/ -O - -T 5 -t 1 , Output: ctest-pod-09556533
Connecting to 10.101.215.4:80 (10.101.215.4:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-06 11:36:12,085 - DEBUG - [Pod Pod ctest-pod-01112069] Cmd wget http://10.101.215.4:80/ -O - -T 5 -t 1 passed
2025-05-06 11:36:12,085 - DEBUG - [Pod Pod ctest-pod-01112069] Cmd output: ctest-pod-09556533
Connecting to 10.101.215.4:80 (10.101.215.4:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-06 11:36:12,085 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-68511956': 1, 'ctest-pod-09556533': 1}
2025-05-06 11:36:17,148 - DEBUG - [Pod ctest-pod-14614639] Cmd: wget http://10.101.215.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:36:17,149 - DEBUG - [Pod Pod ctest-pod-14614639] Cmd wget http://10.101.215.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:36:17,149 - DEBUG - [Pod Pod ctest-pod-14614639] Cmd output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:36:22,223 - DEBUG - [Pod ctest-pod-14614639] Cmd: wget http://10.101.215.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:36:22,223 - DEBUG - [Pod Pod ctest-pod-14614639] Cmd wget http://10.101.215.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:36:22,223 - DEBUG - [Pod Pod ctest-pod-14614639] Cmd output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:36:27,295 - DEBUG - [Pod ctest-pod-14614639] Cmd: wget http://10.101.215.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:36:27,295 - DEBUG - [Pod Pod ctest-pod-14614639] Cmd wget http://10.101.215.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:36:27,295 - DEBUG - [Pod Pod ctest-pod-14614639] Cmd output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:36:32,363 - DEBUG - [Pod ctest-pod-14614639] Cmd: wget http://10.101.215.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:36:32,365 - DEBUG - [Pod Pod ctest-pod-14614639] Cmd wget http://10.101.215.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:36:32,366 - DEBUG - [Pod Pod ctest-pod-14614639] Cmd output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:36:37,444 - DEBUG - [Pod ctest-pod-14614639] Cmd: wget http://10.101.215.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:36:37,444 - DEBUG - [Pod Pod ctest-pod-14614639] Cmd wget http://10.101.215.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:36:37,444 - DEBUG - [Pod Pod ctest-pod-14614639] Cmd output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:36:42,528 - DEBUG - [Pod ctest-pod-14614639] Cmd: wget http://10.101.215.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:36:42,528 - DEBUG - [Pod Pod ctest-pod-14614639] Cmd wget http://10.101.215.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:36:42,529 - DEBUG - [Pod Pod ctest-pod-14614639] Cmd output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:36:47,595 - DEBUG - [Pod ctest-pod-14614639] Cmd: wget http://10.101.215.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:36:47,596 - DEBUG - [Pod Pod ctest-pod-14614639] Cmd wget http://10.101.215.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:36:47,596 - DEBUG - [Pod Pod ctest-pod-14614639] Cmd output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:36:52,671 - DEBUG - [Pod ctest-pod-14614639] Cmd: wget http://10.101.215.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:36:52,672 - DEBUG - [Pod Pod ctest-pod-14614639] Cmd wget http://10.101.215.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:36:52,672 - DEBUG - [Pod Pod ctest-pod-14614639] Cmd output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:36:57,739 - DEBUG - [Pod ctest-pod-14614639] Cmd: wget http://10.101.215.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:36:57,739 - DEBUG - [Pod Pod ctest-pod-14614639] Cmd wget http://10.101.215.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:36:57,740 - DEBUG - [Pod Pod ctest-pod-14614639] Cmd output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:37:02,806 - DEBUG - [Pod ctest-pod-14614639] Cmd: wget http://10.101.215.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:37:02,806 - DEBUG - [Pod Pod ctest-pod-14614639] Cmd wget http://10.101.215.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:37:02,806 - DEBUG - [Pod Pod ctest-pod-14614639] Cmd output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:37:02,806 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-68511956': 0, 'ctest-pod-09556533': 0}
2025-05-06 11:37:04,863 - DEBUG - [Pod ctest-pod-01112069] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.597 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.068 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.080 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.068/0.248/0.597 ms
2025-05-06 11:37:04,864 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-01112069 with expectation True passed
2025-05-06 11:37:06,927 - DEBUG - [Pod ctest-pod-53056594] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.576 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.081 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.080 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.080/0.245/0.576 ms
2025-05-06 11:37:06,928 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-53056594 with expectation True passed
2025-05-06 11:37:09,011 - DEBUG - [Pod ctest-pod-14614639] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.890 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.074 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.084 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.074/0.349/0.890 ms
2025-05-06 11:37:09,012 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-14614639 with expectation True passed
2025-05-06 11:37:09,093 - DEBUG - [Pod ctest-pod-01112069] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-05-06 11:37:09,094 - DEBUG - [Pod Pod ctest-pod-01112069] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-05-06 11:37:09,094 - DEBUG - [Pod Pod ctest-pod-01112069] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-05-06 11:37:09,094 - INFO - wget check of of http://10.47.255.251 from ctest-pod-01112069 passed
2025-05-06 11:37:09,165 - DEBUG - [Pod ctest-pod-01112069] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-05-06 11:37:09,165 - DEBUG - [Pod Pod ctest-pod-01112069] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-05-06 11:37:09,165 - DEBUG - [Pod Pod ctest-pod-01112069] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-05-06 11:37:09,165 - INFO - wget check of of http://10.47.255.250 from ctest-pod-01112069 passed
2025-05-06 11:37:14,234 - DEBUG - [Pod ctest-pod-53056594] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-05-06 11:37:14,234 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-05-06 11:37:14,234 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-05-06 11:37:14,234 - INFO - wget check of of http://10.47.255.250 from ctest-pod-53056594 passed
2025-05-06 11:37:19,288 - DEBUG - [Pod ctest-pod-93793390] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-05-06 11:37:19,288 - DEBUG - [Pod Pod ctest-pod-93793390] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-05-06 11:37:19,289 - DEBUG - [Pod Pod ctest-pod-93793390] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-05-06 11:37:19,289 - INFO - wget check of of http://10.47.255.251 from ctest-pod-93793390 passed
2025-05-06 11:37:19,316 - INFO - Updating Network Policy ingress-on-service
2025-05-06 11:37:24,420 - DEBUG - [Pod ctest-pod-53056594] Cmd: wget http://10.101.215.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:37:24,421 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd wget http://10.101.215.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:37:24,421 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:37:29,496 - DEBUG - [Pod ctest-pod-53056594] Cmd: wget http://10.101.215.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:37:29,496 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd wget http://10.101.215.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:37:29,497 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:37:34,572 - DEBUG - [Pod ctest-pod-53056594] Cmd: wget http://10.101.215.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:37:34,572 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd wget http://10.101.215.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:37:34,572 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:37:39,639 - DEBUG - [Pod ctest-pod-53056594] Cmd: wget http://10.101.215.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:37:39,640 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd wget http://10.101.215.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:37:39,640 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:37:44,712 - DEBUG - [Pod ctest-pod-53056594] Cmd: wget http://10.101.215.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:37:44,712 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd wget http://10.101.215.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:37:44,713 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:37:49,794 - DEBUG - [Pod ctest-pod-53056594] Cmd: wget http://10.101.215.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:37:49,795 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd wget http://10.101.215.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:37:49,795 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:37:54,850 - DEBUG - [Pod ctest-pod-53056594] Cmd: wget http://10.101.215.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:37:54,850 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd wget http://10.101.215.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:37:54,850 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:37:59,923 - DEBUG - [Pod ctest-pod-53056594] Cmd: wget http://10.101.215.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:37:59,923 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd wget http://10.101.215.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:37:59,923 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:38:04,984 - DEBUG - [Pod ctest-pod-53056594] Cmd: wget http://10.101.215.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:38:04,984 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd wget http://10.101.215.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:38:04,984 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:38:10,056 - DEBUG - [Pod ctest-pod-53056594] Cmd: wget http://10.101.215.4:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:38:10,056 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd wget http://10.101.215.4:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:38:10,056 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd output: Connecting to 10.101.215.4:80 (10.101.215.4:80)
wget: download timed out
2025-05-06 11:38:10,057 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-68511956': 0, 'ctest-pod-09556533': 0}
2025-05-06 11:38:10,153 - DEBUG - [Pod ctest-pod-01112069] Cmd: wget http://10.101.215.4:80/ -O - -T 5 -t 1 , Output: ctest-pod-09556533
Connecting to 10.101.215.4:80 (10.101.215.4:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-06 11:38:10,153 - DEBUG - [Pod Pod ctest-pod-01112069] Cmd wget http://10.101.215.4:80/ -O - -T 5 -t 1 passed
2025-05-06 11:38:10,154 - DEBUG - [Pod Pod ctest-pod-01112069] Cmd output: ctest-pod-09556533
Connecting to 10.101.215.4:80 (10.101.215.4:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-06 11:38:10,227 - DEBUG - [Pod ctest-pod-01112069] Cmd: wget http://10.101.215.4:80/ -O - -T 5 -t 1 , Output: ctest-pod-68511956
Connecting to 10.101.215.4:80 (10.101.215.4:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-06 11:38:10,228 - DEBUG - [Pod Pod ctest-pod-01112069] Cmd wget http://10.101.215.4:80/ -O - -T 5 -t 1 passed
2025-05-06 11:38:10,228 - DEBUG - [Pod Pod ctest-pod-01112069] Cmd output: ctest-pod-68511956
Connecting to 10.101.215.4:80 (10.101.215.4:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-06 11:38:10,228 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-68511956': 1, 'ctest-pod-09556533': 1}
2025-05-06 11:38:10,296 - DEBUG - [Pod ctest-pod-14614639] Cmd: wget http://10.101.215.4:80/ -O - -T 5 -t 1 , Output: ctest-pod-09556533
Connecting to 10.101.215.4:80 (10.101.215.4:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-06 11:38:10,296 - DEBUG - [Pod Pod ctest-pod-14614639] Cmd wget http://10.101.215.4:80/ -O - -T 5 -t 1 passed
2025-05-06 11:38:10,296 - DEBUG - [Pod Pod ctest-pod-14614639] Cmd output: ctest-pod-09556533
Connecting to 10.101.215.4:80 (10.101.215.4:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-06 11:38:10,362 - DEBUG - [Pod ctest-pod-14614639] Cmd: wget http://10.101.215.4:80/ -O - -T 5 -t 1 , Output: ctest-pod-09556533
Connecting to 10.101.215.4:80 (10.101.215.4:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-06 11:38:10,362 - DEBUG - [Pod Pod ctest-pod-14614639] Cmd wget http://10.101.215.4:80/ -O - -T 5 -t 1 passed
2025-05-06 11:38:10,362 - DEBUG - [Pod Pod ctest-pod-14614639] Cmd output: ctest-pod-09556533
Connecting to 10.101.215.4:80 (10.101.215.4:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-06 11:38:10,432 - DEBUG - [Pod ctest-pod-14614639] Cmd: wget http://10.101.215.4:80/ -O - -T 5 -t 1 , Output: ctest-pod-09556533
Connecting to 10.101.215.4:80 (10.101.215.4:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-06 11:38:10,433 - DEBUG - [Pod Pod ctest-pod-14614639] Cmd wget http://10.101.215.4:80/ -O - -T 5 -t 1 passed
2025-05-06 11:38:10,433 - DEBUG - [Pod Pod ctest-pod-14614639] Cmd output: ctest-pod-09556533
Connecting to 10.101.215.4:80 (10.101.215.4:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-06 11:38:10,510 - DEBUG - [Pod ctest-pod-14614639] Cmd: wget http://10.101.215.4:80/ -O - -T 5 -t 1 , Output: ctest-pod-09556533
Connecting to 10.101.215.4:80 (10.101.215.4:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-06 11:38:10,511 - DEBUG - [Pod Pod ctest-pod-14614639] Cmd wget http://10.101.215.4:80/ -O - -T 5 -t 1 passed
2025-05-06 11:38:10,511 - DEBUG - [Pod Pod ctest-pod-14614639] Cmd output: ctest-pod-09556533
Connecting to 10.101.215.4:80 (10.101.215.4:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-06 11:38:10,583 - DEBUG - [Pod ctest-pod-14614639] Cmd: wget http://10.101.215.4:80/ -O - -T 5 -t 1 , Output: ctest-pod-68511956
Connecting to 10.101.215.4:80 (10.101.215.4:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-06 11:38:10,584 - DEBUG - [Pod Pod ctest-pod-14614639] Cmd wget http://10.101.215.4:80/ -O - -T 5 -t 1 passed
2025-05-06 11:38:10,584 - DEBUG - [Pod Pod ctest-pod-14614639] Cmd output: ctest-pod-68511956
Connecting to 10.101.215.4:80 (10.101.215.4:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-06 11:38:10,584 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-68511956': 1, 'ctest-pod-09556533': 4}
2025-05-06 11:38:12,662 - DEBUG - [Pod ctest-pod-01112069] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.941 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.071 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.090 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.071/0.367/0.941 ms
2025-05-06 11:38:12,663 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-01112069 with expectation True passed
2025-05-06 11:38:14,719 - DEBUG - [Pod ctest-pod-53056594] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.064 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.075 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.070 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.070/0.403/1.064 ms
2025-05-06 11:38:14,720 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-53056594 with expectation True passed
2025-05-06 11:38:16,793 - DEBUG - [Pod ctest-pod-14614639] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.541 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.085 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.071/0.232/0.541 ms
2025-05-06 11:38:16,793 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-14614639 with expectation True passed
2025-05-06 11:38:16,859 - DEBUG - [Pod ctest-pod-01112069] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-05-06 11:38:16,859 - DEBUG - [Pod Pod ctest-pod-01112069] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-05-06 11:38:16,859 - DEBUG - [Pod Pod ctest-pod-01112069] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-05-06 11:38:16,859 - INFO - wget check of of http://10.47.255.251 from ctest-pod-01112069 passed
2025-05-06 11:38:16,934 - DEBUG - [Pod ctest-pod-01112069] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-05-06 11:38:16,935 - DEBUG - [Pod Pod ctest-pod-01112069] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-05-06 11:38:16,935 - DEBUG - [Pod Pod ctest-pod-01112069] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-05-06 11:38:16,935 - INFO - wget check of of http://10.47.255.250 from ctest-pod-01112069 passed
2025-05-06 11:38:22,017 - DEBUG - [Pod ctest-pod-53056594] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-05-06 11:38:22,017 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-05-06 11:38:22,017 - DEBUG - [Pod Pod ctest-pod-53056594] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-05-06 11:38:22,017 - INFO - wget check of of http://10.47.255.250 from ctest-pod-53056594 passed
2025-05-06 11:38:22,090 - DEBUG - [Pod ctest-pod-93793390] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-05-06 11:38:22,090 - DEBUG - [Pod Pod ctest-pod-93793390] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-05-06 11:38:22,090 - DEBUG - [Pod Pod ctest-pod-93793390] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-05-06 11:38:22,090 - INFO - wget check of of http://10.47.255.251 from ctest-pod-93793390 passed
2025-05-06 11:38:22,091 - INFO - Deleting Network Policy : ingress-on-service
2025-05-06 11:38:22,093 - INFO - Deleting service : ctest-nginx-svc-96669158
2025-05-06 11:38:22,457 - DEBUG - No XMPP flaps were noticed during the test
2025-05-06 11:38:22,457 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:14]
2025-05-06 11:38:22,458 - INFO - --------------------------------------------------------------------------------
2025-05-06 11:38:22,475 - INFO - Deleting pod ctest-new-default-84067068:ctest-pod-68511956
2025-05-06 11:38:22,476 - INFO - Deleting pod ctest-new-default-84067068:ctest-pod-09556533
2025-05-06 11:38:22,477 - INFO - Deleting pod ctest-non-default-58863215:ctest-pod-28262885
2025-05-06 11:38:22,478 - INFO - Deleting pod ctest-non-default-58863215:ctest-pod-69988945
2025-05-06 11:38:22,480 - INFO - Deleting pod ctest-new-default-84067068:ctest-pod-53056594
2025-05-06 11:38:22,481 - INFO - Deleting pod ctest-new-default-84067068:ctest-pod-01112069
2025-05-06 11:38:22,482 - INFO - Deleting pod ctest-non-default-58863215:ctest-pod-14614639
2025-05-06 11:38:22,483 - INFO - Deleting pod ctest-non-default-58863215:ctest-pod-93793390
2025-05-06 11:38:22,531 - WARNING - Pod uuid 995171fd-029b-434c-8525-1a6364314a2e is still seen in agent 10.0.0.65 VM list
2025-05-06 11:38:22,693 - WARNING - Pod uuid 9d226dd6-9549-4b72-bca8-ec5b68e0a911 is still seen in agent 10.0.0.65 VM list
2025-05-06 11:38:22,695 - WARNING - Pod uuid f723a833-f6bb-4c0d-9590-c2b88083a758 is still seen in agent 10.0.0.65 VM list
2025-05-06 11:38:22,696 - WARNING - Pod uuid 45dffcf4-99e6-4840-991d-bad26bf4a990 is still seen in agent 10.0.0.65 VM list
2025-05-06 11:38:22,696 - WARNING - Pod uuid 318888be-e4d6-46e0-bd81-cdf35383ffc7 is still seen in agent 10.0.0.65 VM list
2025-05-06 11:38:22,697 - WARNING - Pod uuid 31b0c2f8-8fa1-4ac9-b40b-38ae32ad0d47 is still seen in agent 10.0.0.65 VM list
2025-05-06 11:38:22,697 - WARNING - Pod uuid d5f9bb84-24bc-4a7c-ad76-03123b58f80a is still seen in agent 10.0.0.65 VM list
2025-05-06 11:38:22,697 - WARNING - Pod uuid a4496a04-2870-483c-ab69-9ac215dfc726 is still seen in agent 10.0.0.65 VM list
2025-05-06 11:38:27,546 - DEBUG - Pod 995171fd-029b-434c-8525-1a6364314a2e is not in agent 10.0.0.65 VM list
2025-05-06 11:38:27,557 - DEBUG - VMI 1deb8f64-2a6e-11f0-8df7-fa163ee5e42a is removed from agent 10.0.0.65
2025-05-06 11:38:27,557 - INFO - Verified that pod ctest-pod-68511956 is removed in agent
2025-05-06 11:38:27,721 - WARNING - Pod uuid 9d226dd6-9549-4b72-bca8-ec5b68e0a911 is still seen in agent 10.0.0.65 VM list
2025-05-06 11:38:27,753 - WARNING - Pod uuid 31b0c2f8-8fa1-4ac9-b40b-38ae32ad0d47 is still seen in agent 10.0.0.65 VM list
2025-05-06 11:38:27,764 - WARNING - Pod uuid d5f9bb84-24bc-4a7c-ad76-03123b58f80a is still seen in agent 10.0.0.65 VM list
2025-05-06 11:38:27,766 - DEBUG - Pod 45dffcf4-99e6-4840-991d-bad26bf4a990 is not in agent 10.0.0.65 VM list
2025-05-06 11:38:27,778 - WARNING - Pod uuid 318888be-e4d6-46e0-bd81-cdf35383ffc7 is still seen in agent 10.0.0.65 VM list
2025-05-06 11:38:27,779 - DEBUG - Pod a4496a04-2870-483c-ab69-9ac215dfc726 is not in agent 10.0.0.65 VM list
2025-05-06 11:38:27,782 - WARNING - Pod uuid f723a833-f6bb-4c0d-9590-c2b88083a758 is still seen in agent 10.0.0.65 VM list
2025-05-06 11:38:27,794 - DEBUG - VMI 1f35a01c-2a6e-11f0-8df7-fa163ee5e42a is removed from agent 10.0.0.65
2025-05-06 11:38:27,794 - INFO - Verified that pod ctest-pod-28262885 is removed in agent
2025-05-06 11:38:27,796 - DEBUG - VMI 1fc51abc-2a6e-11f0-8df7-fa163ee5e42a is removed from agent 10.0.0.65
2025-05-06 11:38:27,796 - INFO - Verified that pod ctest-pod-69988945 is removed in agent
2025-05-06 11:38:32,735 - WARNING - Pod uuid 9d226dd6-9549-4b72-bca8-ec5b68e0a911 is still seen in agent 10.0.0.65 VM list
2025-05-06 11:38:32,797 - WARNING - Pod uuid 31b0c2f8-8fa1-4ac9-b40b-38ae32ad0d47 is still seen in agent 10.0.0.65 VM list
2025-05-06 11:38:32,802 - WARNING - Pod uuid d5f9bb84-24bc-4a7c-ad76-03123b58f80a is still seen in agent 10.0.0.65 VM list
2025-05-06 11:38:32,814 - WARNING - Pod uuid f723a833-f6bb-4c0d-9590-c2b88083a758 is still seen in agent 10.0.0.65 VM list
2025-05-06 11:38:32,815 - WARNING - Pod uuid 318888be-e4d6-46e0-bd81-cdf35383ffc7 is still seen in agent 10.0.0.65 VM list
2025-05-06 11:38:37,751 - WARNING - Pod uuid 9d226dd6-9549-4b72-bca8-ec5b68e0a911 is still seen in agent 10.0.0.65 VM list
2025-05-06 11:38:37,836 - WARNING - Pod uuid 31b0c2f8-8fa1-4ac9-b40b-38ae32ad0d47 is still seen in agent 10.0.0.65 VM list
2025-05-06 11:38:37,838 - WARNING - Pod uuid d5f9bb84-24bc-4a7c-ad76-03123b58f80a is still seen in agent 10.0.0.65 VM list
2025-05-06 11:38:37,849 - WARNING - Pod uuid f723a833-f6bb-4c0d-9590-c2b88083a758 is still seen in agent 10.0.0.65 VM list
2025-05-06 11:38:37,852 - WARNING - Pod uuid 318888be-e4d6-46e0-bd81-cdf35383ffc7 is still seen in agent 10.0.0.65 VM list
2025-05-06 11:38:42,765 - WARNING - Pod uuid 9d226dd6-9549-4b72-bca8-ec5b68e0a911 is still seen in agent 10.0.0.65 VM list
2025-05-06 11:38:42,879 - WARNING - Pod uuid d5f9bb84-24bc-4a7c-ad76-03123b58f80a is still seen in agent 10.0.0.65 VM list
2025-05-06 11:38:42,881 - WARNING - Pod uuid 31b0c2f8-8fa1-4ac9-b40b-38ae32ad0d47 is still seen in agent 10.0.0.65 VM list
2025-05-06 11:38:42,887 - WARNING - Pod uuid f723a833-f6bb-4c0d-9590-c2b88083a758 is still seen in agent 10.0.0.65 VM list
2025-05-06 11:38:42,888 - WARNING - Pod uuid 318888be-e4d6-46e0-bd81-cdf35383ffc7 is still seen in agent 10.0.0.65 VM list
2025-05-06 11:38:47,775 - WARNING - Pod uuid 9d226dd6-9549-4b72-bca8-ec5b68e0a911 is still seen in agent 10.0.0.65 VM list
2025-05-06 11:38:47,915 - WARNING - Pod uuid 31b0c2f8-8fa1-4ac9-b40b-38ae32ad0d47 is still seen in agent 10.0.0.65 VM list
2025-05-06 11:38:47,916 - WARNING - Pod uuid d5f9bb84-24bc-4a7c-ad76-03123b58f80a is still seen in agent 10.0.0.65 VM list
2025-05-06 11:38:47,919 - WARNING - Pod uuid 318888be-e4d6-46e0-bd81-cdf35383ffc7 is still seen in agent 10.0.0.65 VM list
2025-05-06 11:38:47,920 - WARNING - Pod uuid f723a833-f6bb-4c0d-9590-c2b88083a758 is still seen in agent 10.0.0.65 VM list
2025-05-06 11:38:52,806 - WARNING - Pod uuid 9d226dd6-9549-4b72-bca8-ec5b68e0a911 is still seen in agent 10.0.0.65 VM list
2025-05-06 11:38:53,015 - WARNING - Pod uuid 31b0c2f8-8fa1-4ac9-b40b-38ae32ad0d47 is still seen in agent 10.0.0.65 VM list
2025-05-06 11:38:53,015 - WARNING - Pod uuid d5f9bb84-24bc-4a7c-ad76-03123b58f80a is still seen in agent 10.0.0.65 VM list
2025-05-06 11:38:53,017 - WARNING - Pod uuid f723a833-f6bb-4c0d-9590-c2b88083a758 is still seen in agent 10.0.0.65 VM list
2025-05-06 11:38:53,018 - WARNING - Pod uuid 318888be-e4d6-46e0-bd81-cdf35383ffc7 is still seen in agent 10.0.0.65 VM list
2025-05-06 11:38:57,829 - DEBUG - Pod 9d226dd6-9549-4b72-bca8-ec5b68e0a911 is not in agent 10.0.0.65 VM list
2025-05-06 11:38:57,837 - DEBUG - VMI 2063b56e-2a6e-11f0-8df7-fa163ee5e42a is removed from agent 10.0.0.65
2025-05-06 11:38:57,837 - INFO - Verified that pod ctest-pod-53056594 is removed in agent
2025-05-06 11:38:58,050 - DEBUG - Pod 318888be-e4d6-46e0-bd81-cdf35383ffc7 is not in agent 10.0.0.65 VM list
2025-05-06 11:38:58,053 - DEBUG - Pod f723a833-f6bb-4c0d-9590-c2b88083a758 is not in agent 10.0.0.65 VM list
2025-05-06 11:38:58,055 - DEBUG - Pod d5f9bb84-24bc-4a7c-ad76-03123b58f80a is not in agent 10.0.0.65 VM list
2025-05-06 11:38:58,058 - DEBUG - Pod 31b0c2f8-8fa1-4ac9-b40b-38ae32ad0d47 is not in agent 10.0.0.65 VM list
2025-05-06 11:38:58,075 - DEBUG - VMI 21e81402-2a6e-11f0-8df7-fa163ee5e42a is removed from agent 10.0.0.65
2025-05-06 11:38:58,075 - INFO - Verified that pod ctest-pod-93793390 is removed in agent
2025-05-06 11:38:58,079 - DEBUG - VMI 215c4c10-2a6e-11f0-8df7-fa163ee5e42a is removed from agent 10.0.0.65
2025-05-06 11:38:58,079 - INFO - Verified that pod ctest-pod-14614639 is removed in agent
2025-05-06 11:38:58,080 - DEBUG - VMI 1e7a7d0a-2a6e-11f0-8df7-fa163ee5e42a is removed from agent 10.0.0.65
2025-05-06 11:38:58,080 - INFO - Verified that pod ctest-pod-09556533 is removed in agent
2025-05-06 11:38:58,081 - DEBUG - VMI 20dfd59a-2a6e-11f0-8df7-fa163ee5e42a is removed from agent 10.0.0.65
2025-05-06 11:38:58,081 - INFO - Verified that pod ctest-pod-01112069 is removed in agent
2025-05-06 11:38:58,082 - INFO - Deleting namespace ctest-non-default-58863215
2025-05-06 11:38:58,105 - DEBUG - Namespace ctest-non-default-58863215 still in k8s
2025-05-06 11:39:00,112 - DEBUG - Namespace ctest-non-default-58863215 still in k8s
2025-05-06 11:39:02,123 - DEBUG - Namespace ctest-non-default-58863215 still in k8s
2025-05-06 11:39:04,140 - DEBUG - Namespace ctest-non-default-58863215 is not in k8s
2025-05-06 11:39:04,140 - DEBUG - No need to check project deletion in contrail-api
2025-05-06 11:39:04,140 - INFO - Deleting namespace ctest-new-default-84067068
2025-05-06 11:39:04,155 - DEBUG - Namespace ctest-new-default-84067068 still in k8s
2025-05-06 11:39:06,174 - DEBUG - Namespace ctest-new-default-84067068 still in k8s
2025-05-06 11:39:08,185 - DEBUG - Namespace ctest-new-default-84067068 still in k8s
2025-05-06 11:39:10,190 - DEBUG - Namespace ctest-new-default-84067068 is not in k8s
2025-05-06 11:39:10,190 - DEBUG - No need to check project deletion in contrail-api