2025-10-23 21:24:03,229 - INFO - Using existing project ['default-domain', 'k8s-default'](4fa44030-8778-47eb-bf0a-7bdbcb520949)
2025-10-23 21:24:03,249 - DEBUG - Namespace ctest-new-default-23418353 not present
2025-10-23 21:24:03,263 - INFO - Created namespace ctest-new-default-23418353
2025-10-23 21:24:06,271 - DEBUG - Namespace ctest-non-default-63203810 not present
2025-10-23 21:24:06,283 - INFO - Created namespace ctest-non-default-63203810
2025-10-23 21:24:09,312 - DEBUG - Pod ctest-pod-68970036 not present
2025-10-23 21:24:09,313 - INFO - Creating Pod ctest-pod-68970036
2025-10-23 21:24:09,380 - DEBUG - Pod : ctest-pod-68970036 UUID is 52fb16b8-4fcc-4545-8994-2271c6489108
2025-10-23 21:24:09,388 - DEBUG - Pod ctest-pod-64806376 not present
2025-10-23 21:24:09,389 - INFO - Creating Pod ctest-pod-64806376
2025-10-23 21:24:09,433 - DEBUG - Pod : ctest-pod-64806376 UUID is 6498b4d2-8185-47a2-b5f2-b6f362d88037
2025-10-23 21:24:09,447 - DEBUG - Pod ctest-pod-29765608 not present
2025-10-23 21:24:09,448 - INFO - Creating Pod ctest-pod-29765608
2025-10-23 21:24:09,484 - DEBUG - Pod : ctest-pod-29765608 UUID is ccfb33cd-82bf-4cf2-aaf5-e634dd9def95
2025-10-23 21:24:09,487 - DEBUG - Pod ctest-pod-64938748 not present
2025-10-23 21:24:09,488 - INFO - Creating Pod ctest-pod-64938748
2025-10-23 21:24:09,509 - DEBUG - Pod : ctest-pod-64938748 UUID is ff85e4a4-7f8c-40f3-b57c-c5c045d0d596
2025-10-23 21:24:09,514 - DEBUG - Pod ctest-pod-12272970 not present
2025-10-23 21:24:09,515 - INFO - Creating Pod ctest-pod-12272970
2025-10-23 21:24:09,541 - DEBUG - Pod : ctest-pod-12272970 UUID is 59a737a3-f27c-4ecf-9929-00f804c82c53
2025-10-23 21:24:09,543 - DEBUG - Pod ctest-pod-82100416 not present
2025-10-23 21:24:09,543 - INFO - Creating Pod ctest-pod-82100416
2025-10-23 21:24:09,561 - DEBUG - Pod : ctest-pod-82100416 UUID is 479f382c-6768-4387-966c-d786a8760c11
2025-10-23 21:24:09,563 - DEBUG - Pod ctest-pod-74378273 not present
2025-10-23 21:24:09,563 - INFO - Creating Pod ctest-pod-74378273
2025-10-23 21:24:09,613 - DEBUG - Pod : ctest-pod-74378273 UUID is 2b483304-f405-40c5-866e-511e5ed0fc54
2025-10-23 21:24:09,618 - DEBUG - Pod ctest-pod-74157080 not present
2025-10-23 21:24:09,619 - INFO - Creating Pod ctest-pod-74157080
2025-10-23 21:24:09,644 - DEBUG - Pod : ctest-pod-74157080 UUID is 68a0bf52-807a-4356-89c3-f0c1cd0c2102
2025-10-23 21:24:09,881 - INFO - Project default-domain:k8s-ctest-new-default-23418353 for Namespace ctest-new-default-23418353 is seen in contrail-api
2025-10-23 21:24:09,881 - DEBUG - Project uuid in Contrail is 2c8522a4-3b34-4b28-a2c4-070f66fd25b2
2025-10-23 21:24:10,047 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NamespaceDatabaseList?namespace_uuid=4cdb042b-5f8c-458f-bf39-8bb31fda4133
2025-10-23 21:24:10,052 - INFO - Namespace ctest-new-default-23418353 with uuid 4cdb042b-5f8c-458f-bf39-8bb31fda4133 found in kube manager
2025-10-23 21:24:10,052 - INFO - Namespace ctest-new-default-23418353 verification passed
2025-10-23 21:24:10,244 - INFO - Project default-domain:k8s-ctest-non-default-63203810 for Namespace ctest-non-default-63203810 is seen in contrail-api
2025-10-23 21:24:10,244 - DEBUG - Project uuid in Contrail is 0dd9fd99-efb6-4753-8849-f353bc57c877
2025-10-23 21:24:10,244 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NamespaceDatabaseList?namespace_uuid=f56cc5e1-0cec-4811-9d4c-6060c80f620e
2025-10-23 21:24:10,250 - INFO - Namespace ctest-non-default-63203810 with uuid f56cc5e1-0cec-4811-9d4c-6060c80f620e found in kube manager
2025-10-23 21:24:10,250 - INFO - Namespace ctest-non-default-63203810 verification passed
2025-10-23 21:24:10,257 - DEBUG - Pod ctest-pod-68970036 not in running state.Currently in Pending
2025-10-23 21:24:15,272 - DEBUG - Pod ctest-pod-68970036 not in running state.Currently in Pending
2025-10-23 21:24:20,282 - DEBUG - Pod ctest-pod-68970036 not in running state.Currently in Pending
2025-10-23 21:24:25,290 - INFO - Pod ctest-pod-68970036 is in running state.Got IP 10.47.255.251
2025-10-23 21:24:25,345 - DEBUG - Pod ctest-pod-68970036 has vmi 9ddd36dc-b056-11f0-aebb-fa163ef74794
2025-10-23 21:24:25,345 - INFO - Verified pod ctest-pod-68970036 in contrail-api
2025-10-23 21:24:25,358 - DEBUG - VMI 9ddd36dc-b056-11f0-aebb-fa163ef74794 is active in agent 10.0.0.249
2025-10-23 21:24:25,358 - INFO - Verified Pod ctest-pod-68970036 in agent 10.0.0.249
2025-10-23 21:24:25,359 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=52fb16b8-4fcc-4545-8994-2271c6489108
2025-10-23 21:24:25,362 - INFO - Pod ctest-pod-68970036 with uuid 52fb16b8-4fcc-4545-8994-2271c6489108 found in kube manager
2025-10-23 21:24:25,363 - INFO - Pod ctest-pod-68970036 verification passed
2025-10-23 21:24:25,369 - INFO - Pod ctest-pod-64806376 is in running state.Got IP 10.47.255.250
2025-10-23 21:24:25,380 - DEBUG - Pod ctest-pod-64806376 has vmi 9e5ac84a-b056-11f0-aebb-fa163ef74794
2025-10-23 21:24:25,380 - INFO - Verified pod ctest-pod-64806376 in contrail-api
2025-10-23 21:24:25,391 - DEBUG - VMI 9e5ac84a-b056-11f0-aebb-fa163ef74794 is active in agent 10.0.0.249
2025-10-23 21:24:25,391 - INFO - Verified Pod ctest-pod-64806376 in agent 10.0.0.249
2025-10-23 21:24:25,392 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=6498b4d2-8185-47a2-b5f2-b6f362d88037
2025-10-23 21:24:25,395 - INFO - Pod ctest-pod-64806376 with uuid 6498b4d2-8185-47a2-b5f2-b6f362d88037 found in kube manager
2025-10-23 21:24:25,395 - INFO - Pod ctest-pod-64806376 verification passed
2025-10-23 21:24:25,402 - INFO - Pod ctest-pod-29765608 is in running state.Got IP 10.47.255.249
2025-10-23 21:24:25,455 - DEBUG - Pod ctest-pod-29765608 has vmi 9ef6a1de-b056-11f0-aebb-fa163ef74794
2025-10-23 21:24:25,456 - INFO - Verified pod ctest-pod-29765608 in contrail-api
2025-10-23 21:24:25,467 - DEBUG - VMI 9ef6a1de-b056-11f0-aebb-fa163ef74794 is active in agent 10.0.0.249
2025-10-23 21:24:25,468 - INFO - Verified Pod ctest-pod-29765608 in agent 10.0.0.249
2025-10-23 21:24:25,468 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=ccfb33cd-82bf-4cf2-aaf5-e634dd9def95
2025-10-23 21:24:25,471 - INFO - Pod ctest-pod-29765608 with uuid ccfb33cd-82bf-4cf2-aaf5-e634dd9def95 found in kube manager
2025-10-23 21:24:25,471 - INFO - Pod ctest-pod-29765608 verification passed
2025-10-23 21:24:25,478 - INFO - Pod ctest-pod-64938748 is in running state.Got IP 10.47.255.248
2025-10-23 21:24:25,533 - DEBUG - Pod ctest-pod-64938748 has vmi 9f71410a-b056-11f0-aebb-fa163ef74794
2025-10-23 21:24:25,533 - INFO - Verified pod ctest-pod-64938748 in contrail-api
2025-10-23 21:24:25,544 - DEBUG - VMI 9f71410a-b056-11f0-aebb-fa163ef74794 is active in agent 10.0.0.249
2025-10-23 21:24:25,544 - INFO - Verified Pod ctest-pod-64938748 in agent 10.0.0.249
2025-10-23 21:24:25,544 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=ff85e4a4-7f8c-40f3-b57c-c5c045d0d596
2025-10-23 21:24:25,548 - INFO - Pod ctest-pod-64938748 with uuid ff85e4a4-7f8c-40f3-b57c-c5c045d0d596 found in kube manager
2025-10-23 21:24:25,548 - INFO - Pod ctest-pod-64938748 verification passed
2025-10-23 21:24:25,554 - INFO - Pod ctest-pod-12272970 is in running state.Got IP 10.47.255.247
2025-10-23 21:24:25,565 - DEBUG - Pod ctest-pod-12272970 has vmi 9ffc9dd6-b056-11f0-aebb-fa163ef74794
2025-10-23 21:24:25,566 - INFO - Verified pod ctest-pod-12272970 in contrail-api
2025-10-23 21:24:25,577 - DEBUG - VMI 9ffc9dd6-b056-11f0-aebb-fa163ef74794 is active in agent 10.0.0.249
2025-10-23 21:24:25,577 - INFO - Verified Pod ctest-pod-12272970 in agent 10.0.0.249
2025-10-23 21:24:25,578 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=59a737a3-f27c-4ecf-9929-00f804c82c53
2025-10-23 21:24:25,588 - INFO - Pod ctest-pod-12272970 with uuid 59a737a3-f27c-4ecf-9929-00f804c82c53 found in kube manager
2025-10-23 21:24:25,588 - INFO - Pod ctest-pod-12272970 verification passed
2025-10-23 21:24:25,594 - INFO - Pod ctest-pod-74378273 is in running state.Got IP 10.47.255.245
2025-10-23 21:24:25,648 - DEBUG - Pod ctest-pod-74378273 has vmi a0dadaba-b056-11f0-aebb-fa163ef74794
2025-10-23 21:24:25,648 - INFO - Verified pod ctest-pod-74378273 in contrail-api
2025-10-23 21:24:25,659 - DEBUG - VMI a0dadaba-b056-11f0-aebb-fa163ef74794 is active in agent 10.0.0.249
2025-10-23 21:24:25,660 - INFO - Verified Pod ctest-pod-74378273 in agent 10.0.0.249
2025-10-23 21:24:25,660 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=2b483304-f405-40c5-866e-511e5ed0fc54
2025-10-23 21:24:25,664 - INFO - Pod ctest-pod-74378273 with uuid 2b483304-f405-40c5-866e-511e5ed0fc54 found in kube manager
2025-10-23 21:24:25,664 - INFO - Pod ctest-pod-74378273 verification passed
2025-10-23 21:24:25,673 - INFO - Pod ctest-pod-82100416 is in running state.Got IP 10.47.255.246
2025-10-23 21:24:25,733 - DEBUG - Pod ctest-pod-82100416 has vmi a06e3aea-b056-11f0-aebb-fa163ef74794
2025-10-23 21:24:25,733 - INFO - Verified pod ctest-pod-82100416 in contrail-api
2025-10-23 21:24:25,745 - DEBUG - VMI a06e3aea-b056-11f0-aebb-fa163ef74794 is active in agent 10.0.0.249
2025-10-23 21:24:25,745 - INFO - Verified Pod ctest-pod-82100416 in agent 10.0.0.249
2025-10-23 21:24:25,746 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=479f382c-6768-4387-966c-d786a8760c11
2025-10-23 21:24:25,750 - INFO - Pod ctest-pod-82100416 with uuid 479f382c-6768-4387-966c-d786a8760c11 found in kube manager
2025-10-23 21:24:25,750 - INFO - Pod ctest-pod-82100416 verification passed
2025-10-23 21:24:25,756 - DEBUG - Pod ctest-pod-74157080 not in running state.Currently in Pending
2025-10-23 21:24:30,772 - INFO - Pod ctest-pod-74157080 is in running state.Got IP 10.47.255.244
2025-10-23 21:24:30,789 - DEBUG - Pod ctest-pod-74157080 has vmi a153efa4-b056-11f0-aebb-fa163ef74794
2025-10-23 21:24:30,789 - INFO - Verified pod ctest-pod-74157080 in contrail-api
2025-10-23 21:24:30,804 - DEBUG - VMI a153efa4-b056-11f0-aebb-fa163ef74794 is active in agent 10.0.0.249
2025-10-23 21:24:30,804 - INFO - Verified Pod ctest-pod-74157080 in agent 10.0.0.249
2025-10-23 21:24:30,804 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=68a0bf52-807a-4356-89c3-f0c1cd0c2102
2025-10-23 21:24:30,810 - INFO - Pod ctest-pod-74157080 with uuid 68a0bf52-807a-4356-89c3-f0c1cd0c2102 found in kube manager
2025-10-23 21:24:30,810 - INFO - Pod ctest-pod-74157080 verification passed
2025-10-23 21:24:30,810 - INFO - ================================================================================
2025-10-23 21:24:30,811 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-10-23 21:24:30,811 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-10-23 21:24:31,067 - DEBUG - Nothing to compare xmpp stats {'10.0.0.249': {'10.0.0.33': '0'}} with
2025-10-23 21:24:31,067 - INFO - Initial checks done. Running the testcase now
2025-10-23 21:24:31,067 - INFO -
2025-10-23 21:24:31,120 - DEBUG - [Pod ctest-pod-68970036] Cmd: echo ctest-pod-68970036 > /usr/share/nginx/html/index.html, Output:
2025-10-23 21:24:31,175 - DEBUG - [Pod ctest-pod-64806376] Cmd: echo ctest-pod-64806376 > /usr/share/nginx/html/index.html, Output:
2025-10-23 21:24:31,235 - DEBUG - [Pod ctest-pod-29765608] Cmd: echo ctest-pod-29765608 > /usr/share/nginx/html/index.html, Output:
2025-10-23 21:24:31,294 - DEBUG - [Pod ctest-pod-64938748] Cmd: echo ctest-pod-64938748 > /usr/share/nginx/html/index.html, Output:
2025-10-23 21:24:31,299 - DEBUG - Service ctest-nginx-svc-17152392 not present
2025-10-23 21:24:31,299 - INFO - Creating service ctest-nginx-svc-17152392
2025-10-23 21:24:31,316 - INFO - Created Service ctest-nginx-svc-17152392
2025-10-23 21:24:31,333 - WARNING - Service UUID 49fb410c-a3b0-4d95-8c7b-00f88950d906 not yet found in contrail-api
2025-10-23 21:24:32,340 - INFO - Validated that Service ctest-nginx-svc-17152392 is seen in contrail-api
2025-10-23 21:24:32,340 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_LoadbalancerDatabaseList?x=49fb410c-a3b0-4d95-8c7b-00f88950d906
2025-10-23 21:24:32,345 - INFO - Service ctest-nginx-svc-17152392 with uuid 49fb410c-a3b0-4d95-8c7b-00f88950d906 found in kube manager
2025-10-23 21:24:32,345 - INFO - Service ctest-nginx-svc-17152392 verification passed
2025-10-23 21:24:33,408 - DEBUG - [Pod ctest-pod-12272970] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-68970036
2025-10-23 21:24:33,408 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 passed
2025-10-23 21:24:33,408 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-68970036
2025-10-23 21:24:33,465 - DEBUG - [Pod ctest-pod-12272970] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: ctest-pod-64806376
Connecting to 10.106.237.98:80 (10.106.237.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 21:24:33,465 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 passed
2025-10-23 21:24:33,465 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd output: ctest-pod-64806376
Connecting to 10.106.237.98:80 (10.106.237.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 21:24:33,465 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-68970036': 1, 'ctest-pod-64806376': 1}
2025-10-23 21:24:33,519 - DEBUG - [Pod ctest-pod-74378273] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: ctest-pod-64806376
Connecting to 10.106.237.98:80 (10.106.237.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 21:24:33,519 - DEBUG - [Pod Pod ctest-pod-74378273] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 passed
2025-10-23 21:24:33,519 - DEBUG - [Pod Pod ctest-pod-74378273] Cmd output: ctest-pod-64806376
Connecting to 10.106.237.98:80 (10.106.237.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 21:24:33,573 - DEBUG - [Pod ctest-pod-74378273] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-64806376
2025-10-23 21:24:33,574 - DEBUG - [Pod Pod ctest-pod-74378273] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 passed
2025-10-23 21:24:33,574 - DEBUG - [Pod Pod ctest-pod-74378273] Cmd output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-64806376
2025-10-23 21:24:33,649 - DEBUG - [Pod ctest-pod-74378273] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-64806376
2025-10-23 21:24:33,649 - DEBUG - [Pod Pod ctest-pod-74378273] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 passed
2025-10-23 21:24:33,649 - DEBUG - [Pod Pod ctest-pod-74378273] Cmd output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-64806376
2025-10-23 21:24:33,700 - DEBUG - [Pod ctest-pod-74378273] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: ctest-pod-68970036
Connecting to 10.106.237.98:80 (10.106.237.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 21:24:33,700 - DEBUG - [Pod Pod ctest-pod-74378273] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 passed
2025-10-23 21:24:33,700 - DEBUG - [Pod Pod ctest-pod-74378273] Cmd output: ctest-pod-68970036
Connecting to 10.106.237.98:80 (10.106.237.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 21:24:33,701 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-68970036': 1, 'ctest-pod-64806376': 3}
2025-10-23 21:24:33,704 - DEBUG - Network policy ingress-on-service not present
2025-10-23 21:24:33,705 - INFO - Creating Network Policy ingress-on-service
2025-10-23 21:24:33,728 - INFO - Network policy found in k8s
2025-10-23 21:24:33,728 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=6d523460-433f-449c-abd0-1e757d904299
2025-10-23 21:24:33,745 - INFO - Network Policy ingress-on-service with uuid 6d523460-433f-449c-abd0-1e757d904299 found in kube manager
2025-10-23 21:24:33,772 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-10-23 21:24:33,773 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-10-23 21:24:33,773 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=6d523460-433f-449c-abd0-1e757d904299
2025-10-23 21:24:33,798 - WARNING - Network policy with name ingress-on-service not found in agent
2025-10-23 21:24:35,799 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=6d523460-433f-449c-abd0-1e757d904299
2025-10-23 21:24:35,824 - INFO - Network policy with name ingress-on-service found in agent
2025-10-23 21:24:35,824 - INFO - Network Policy ingress-on-service verification passed
2025-10-23 21:24:40,875 - DEBUG - [Pod ctest-pod-12272970] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:24:40,875 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:24:40,875 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:24:45,923 - DEBUG - [Pod ctest-pod-12272970] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:24:45,923 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:24:45,923 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:24:50,975 - DEBUG - [Pod ctest-pod-12272970] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:24:50,976 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:24:50,976 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:24:56,032 - DEBUG - [Pod ctest-pod-12272970] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:24:56,032 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:24:56,032 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:25:01,080 - DEBUG - [Pod ctest-pod-12272970] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:25:01,081 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:25:01,081 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:25:06,134 - DEBUG - [Pod ctest-pod-12272970] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:25:06,134 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:25:06,134 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:25:11,183 - DEBUG - [Pod ctest-pod-12272970] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:25:11,183 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:25:11,184 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:25:16,240 - DEBUG - [Pod ctest-pod-12272970] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:25:16,240 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:25:16,240 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:25:21,301 - DEBUG - [Pod ctest-pod-12272970] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:25:21,301 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:25:21,301 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:25:25,786 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2025-10-23 21:25:35,844 - DEBUG - [Pod ctest-pod-12272970] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:25:35,844 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:25:35,844 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:25:35,844 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-68970036': 0, 'ctest-pod-64806376': 0}
2025-10-23 21:25:35,905 - DEBUG - [Pod ctest-pod-82100416] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: ctest-pod-68970036
Connecting to 10.106.237.98:80 (10.106.237.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 21:25:35,905 - DEBUG - [Pod Pod ctest-pod-82100416] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 passed
2025-10-23 21:25:35,905 - DEBUG - [Pod Pod ctest-pod-82100416] Cmd output: ctest-pod-68970036
Connecting to 10.106.237.98:80 (10.106.237.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 21:25:35,964 - DEBUG - [Pod ctest-pod-82100416] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: ctest-pod-68970036
Connecting to 10.106.237.98:80 (10.106.237.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 21:25:35,964 - DEBUG - [Pod Pod ctest-pod-82100416] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 passed
2025-10-23 21:25:35,964 - DEBUG - [Pod Pod ctest-pod-82100416] Cmd output: ctest-pod-68970036
Connecting to 10.106.237.98:80 (10.106.237.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 21:25:36,016 - DEBUG - [Pod ctest-pod-82100416] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: ctest-pod-68970036
Connecting to 10.106.237.98:80 (10.106.237.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 21:25:36,017 - DEBUG - [Pod Pod ctest-pod-82100416] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 passed
2025-10-23 21:25:36,017 - DEBUG - [Pod Pod ctest-pod-82100416] Cmd output: ctest-pod-68970036
Connecting to 10.106.237.98:80 (10.106.237.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 21:25:36,072 - DEBUG - [Pod ctest-pod-82100416] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: ctest-pod-68970036
Connecting to 10.106.237.98:80 (10.106.237.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 21:25:36,073 - DEBUG - [Pod Pod ctest-pod-82100416] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 passed
2025-10-23 21:25:36,073 - DEBUG - [Pod Pod ctest-pod-82100416] Cmd output: ctest-pod-68970036
Connecting to 10.106.237.98:80 (10.106.237.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 21:25:36,122 - DEBUG - [Pod ctest-pod-82100416] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: ctest-pod-68970036
Connecting to 10.106.237.98:80 (10.106.237.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 21:25:36,122 - DEBUG - [Pod Pod ctest-pod-82100416] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 passed
2025-10-23 21:25:36,122 - DEBUG - [Pod Pod ctest-pod-82100416] Cmd output: ctest-pod-68970036
Connecting to 10.106.237.98:80 (10.106.237.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 21:25:36,170 - DEBUG - [Pod ctest-pod-82100416] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: ctest-pod-64806376
Connecting to 10.106.237.98:80 (10.106.237.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 21:25:36,170 - DEBUG - [Pod Pod ctest-pod-82100416] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 passed
2025-10-23 21:25:36,170 - DEBUG - [Pod Pod ctest-pod-82100416] Cmd output: ctest-pod-64806376
Connecting to 10.106.237.98:80 (10.106.237.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 21:25:36,170 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-68970036': 5, 'ctest-pod-64806376': 1}
2025-10-23 21:25:41,220 - DEBUG - [Pod ctest-pod-74378273] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:25:41,220 - DEBUG - [Pod Pod ctest-pod-74378273] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:25:41,220 - DEBUG - [Pod Pod ctest-pod-74378273] Cmd output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:25:46,271 - DEBUG - [Pod ctest-pod-74378273] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:25:46,271 - DEBUG - [Pod Pod ctest-pod-74378273] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:25:46,271 - DEBUG - [Pod Pod ctest-pod-74378273] Cmd output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:25:51,325 - DEBUG - [Pod ctest-pod-74378273] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:25:51,325 - DEBUG - [Pod Pod ctest-pod-74378273] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:25:51,325 - DEBUG - [Pod Pod ctest-pod-74378273] Cmd output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:25:56,378 - DEBUG - [Pod ctest-pod-74378273] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:25:56,378 - DEBUG - [Pod Pod ctest-pod-74378273] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:25:56,378 - DEBUG - [Pod Pod ctest-pod-74378273] Cmd output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:26:01,424 - DEBUG - [Pod ctest-pod-74378273] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:26:01,424 - DEBUG - [Pod Pod ctest-pod-74378273] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:26:01,425 - DEBUG - [Pod Pod ctest-pod-74378273] Cmd output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:26:06,476 - DEBUG - [Pod ctest-pod-74378273] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:26:06,476 - DEBUG - [Pod Pod ctest-pod-74378273] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:26:06,476 - DEBUG - [Pod Pod ctest-pod-74378273] Cmd output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:26:11,527 - DEBUG - [Pod ctest-pod-74378273] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:26:11,528 - DEBUG - [Pod Pod ctest-pod-74378273] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:26:11,528 - DEBUG - [Pod Pod ctest-pod-74378273] Cmd output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:26:16,580 - DEBUG - [Pod ctest-pod-74378273] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:26:16,580 - DEBUG - [Pod Pod ctest-pod-74378273] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:26:16,580 - DEBUG - [Pod Pod ctest-pod-74378273] Cmd output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:26:21,637 - DEBUG - [Pod ctest-pod-74378273] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:26:21,637 - DEBUG - [Pod Pod ctest-pod-74378273] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:26:21,637 - DEBUG - [Pod Pod ctest-pod-74378273] Cmd output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:26:26,692 - DEBUG - [Pod ctest-pod-74378273] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:26:26,692 - DEBUG - [Pod Pod ctest-pod-74378273] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:26:26,692 - DEBUG - [Pod Pod ctest-pod-74378273] Cmd output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:26:26,692 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-68970036': 0, 'ctest-pod-64806376': 0}
2025-10-23 21:26:28,741 - DEBUG - [Pod ctest-pod-82100416] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.147 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.069 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.072 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.069/0.429/1.147 ms
2025-10-23 21:26:28,741 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-82100416 with expectation True passed
2025-10-23 21:26:30,792 - DEBUG - [Pod ctest-pod-12272970] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.562 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.076 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.071/0.236/0.562 ms
2025-10-23 21:26:30,792 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-12272970 with expectation True passed
2025-10-23 21:26:32,844 - DEBUG - [Pod ctest-pod-74378273] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.539 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.065 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.077 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.065/0.227/0.539 ms
2025-10-23 21:26:32,844 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-74378273 with expectation True passed
2025-10-23 21:26:32,901 - DEBUG - [Pod ctest-pod-82100416] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-23 21:26:32,901 - DEBUG - [Pod Pod ctest-pod-82100416] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-10-23 21:26:32,901 - DEBUG - [Pod Pod ctest-pod-82100416] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-23 21:26:32,901 - INFO - wget check of of http://10.47.255.251 from ctest-pod-82100416 passed
2025-10-23 21:26:32,957 - DEBUG - [Pod ctest-pod-82100416] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-23 21:26:32,957 - DEBUG - [Pod Pod ctest-pod-82100416] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-10-23 21:26:32,957 - DEBUG - [Pod Pod ctest-pod-82100416] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-23 21:26:32,957 - INFO - wget check of of http://10.47.255.250 from ctest-pod-82100416 passed
2025-10-23 21:26:38,008 - DEBUG - [Pod ctest-pod-12272970] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-10-23 21:26:38,008 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-10-23 21:26:38,008 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-10-23 21:26:38,008 - INFO - wget check of of http://10.47.255.250 from ctest-pod-12272970 passed
2025-10-23 21:26:43,075 - DEBUG - [Pod ctest-pod-74157080] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-10-23 21:26:43,075 - DEBUG - [Pod Pod ctest-pod-74157080] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-10-23 21:26:43,075 - DEBUG - [Pod Pod ctest-pod-74157080] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-10-23 21:26:43,075 - INFO - wget check of of http://10.47.255.251 from ctest-pod-74157080 passed
2025-10-23 21:26:43,084 - INFO - Updating Network Policy ingress-on-service
2025-10-23 21:26:48,140 - DEBUG - [Pod ctest-pod-12272970] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:26:48,140 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:26:48,140 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:26:53,192 - DEBUG - [Pod ctest-pod-12272970] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:26:53,192 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:26:53,192 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:26:58,239 - DEBUG - [Pod ctest-pod-12272970] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:26:58,240 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:26:58,240 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:27:03,292 - DEBUG - [Pod ctest-pod-12272970] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:27:03,292 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:27:03,292 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:27:08,343 - DEBUG - [Pod ctest-pod-12272970] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:27:08,344 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:27:08,344 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:27:13,392 - DEBUG - [Pod ctest-pod-12272970] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:27:13,392 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:27:13,392 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:27:18,444 - DEBUG - [Pod ctest-pod-12272970] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:27:18,444 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:27:18,444 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:27:23,492 - DEBUG - [Pod ctest-pod-12272970] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:27:23,492 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:27:23,492 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:27:28,551 - DEBUG - [Pod ctest-pod-12272970] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:27:28,552 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:27:28,552 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:27:33,604 - DEBUG - [Pod ctest-pod-12272970] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:27:33,605 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:27:33,605 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
wget: download timed out
2025-10-23 21:27:33,605 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-68970036': 0, 'ctest-pod-64806376': 0}
2025-10-23 21:27:33,665 - DEBUG - [Pod ctest-pod-82100416] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: ctest-pod-68970036
Connecting to 10.106.237.98:80 (10.106.237.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 21:27:33,665 - DEBUG - [Pod Pod ctest-pod-82100416] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 passed
2025-10-23 21:27:33,666 - DEBUG - [Pod Pod ctest-pod-82100416] Cmd output: ctest-pod-68970036
Connecting to 10.106.237.98:80 (10.106.237.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 21:27:33,718 - DEBUG - [Pod ctest-pod-82100416] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-64806376
2025-10-23 21:27:33,719 - DEBUG - [Pod Pod ctest-pod-82100416] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 passed
2025-10-23 21:27:33,719 - DEBUG - [Pod Pod ctest-pod-82100416] Cmd output: Connecting to 10.106.237.98:80 (10.106.237.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-64806376
2025-10-23 21:27:33,719 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-68970036': 1, 'ctest-pod-64806376': 1}
2025-10-23 21:27:33,766 - DEBUG - [Pod ctest-pod-74378273] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: ctest-pod-68970036
Connecting to 10.106.237.98:80 (10.106.237.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 21:27:33,766 - DEBUG - [Pod Pod ctest-pod-74378273] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 passed
2025-10-23 21:27:33,766 - DEBUG - [Pod Pod ctest-pod-74378273] Cmd output: ctest-pod-68970036
Connecting to 10.106.237.98:80 (10.106.237.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 21:27:33,802 - DEBUG - [Pod ctest-pod-74378273] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: ctest-pod-68970036
Connecting to 10.106.237.98:80 (10.106.237.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 21:27:33,802 - DEBUG - [Pod Pod ctest-pod-74378273] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 passed
2025-10-23 21:27:33,802 - DEBUG - [Pod Pod ctest-pod-74378273] Cmd output: ctest-pod-68970036
Connecting to 10.106.237.98:80 (10.106.237.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 21:27:33,858 - DEBUG - [Pod ctest-pod-74378273] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: ctest-pod-68970036
Connecting to 10.106.237.98:80 (10.106.237.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 21:27:33,858 - DEBUG - [Pod Pod ctest-pod-74378273] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 passed
2025-10-23 21:27:33,858 - DEBUG - [Pod Pod ctest-pod-74378273] Cmd output: ctest-pod-68970036
Connecting to 10.106.237.98:80 (10.106.237.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 21:27:33,914 - DEBUG - [Pod ctest-pod-74378273] Cmd: wget http://10.106.237.98:80/ -O - -T 5 -t 1 , Output: ctest-pod-64806376
Connecting to 10.106.237.98:80 (10.106.237.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 21:27:33,914 - DEBUG - [Pod Pod ctest-pod-74378273] Cmd wget http://10.106.237.98:80/ -O - -T 5 -t 1 passed
2025-10-23 21:27:33,914 - DEBUG - [Pod Pod ctest-pod-74378273] Cmd output: ctest-pod-64806376
Connecting to 10.106.237.98:80 (10.106.237.98:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 21:27:33,914 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-68970036': 3, 'ctest-pod-64806376': 1}
2025-10-23 21:27:35,976 - DEBUG - [Pod ctest-pod-82100416] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.881 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.075 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.089 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.075/0.348/0.881 ms
2025-10-23 21:27:35,976 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-82100416 with expectation True passed
2025-10-23 21:27:38,037 - DEBUG - [Pod ctest-pod-12272970] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.118 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.068 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.066 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.066/0.417/1.118 ms
2025-10-23 21:27:38,037 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-12272970 with expectation True passed
2025-10-23 21:27:40,084 - DEBUG - [Pod ctest-pod-74378273] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.313 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.069 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.080 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.069/0.154/0.313 ms
2025-10-23 21:27:40,084 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-74378273 with expectation True passed
2025-10-23 21:27:40,136 - DEBUG - [Pod ctest-pod-82100416] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-23 21:27:40,137 - DEBUG - [Pod Pod ctest-pod-82100416] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-10-23 21:27:40,137 - DEBUG - [Pod Pod ctest-pod-82100416] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-23 21:27:40,137 - INFO - wget check of of http://10.47.255.251 from ctest-pod-82100416 passed
2025-10-23 21:27:40,186 - DEBUG - [Pod ctest-pod-82100416] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-23 21:27:40,186 - DEBUG - [Pod Pod ctest-pod-82100416] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-10-23 21:27:40,186 - DEBUG - [Pod Pod ctest-pod-82100416] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-23 21:27:40,186 - INFO - wget check of of http://10.47.255.250 from ctest-pod-82100416 passed
2025-10-23 21:27:45,241 - DEBUG - [Pod ctest-pod-12272970] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-10-23 21:27:45,241 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-10-23 21:27:45,241 - DEBUG - [Pod Pod ctest-pod-12272970] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-10-23 21:27:45,241 - INFO - wget check of of http://10.47.255.250 from ctest-pod-12272970 passed
2025-10-23 21:27:45,295 - DEBUG - [Pod ctest-pod-74157080] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-23 21:27:45,295 - DEBUG - [Pod Pod ctest-pod-74157080] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-10-23 21:27:45,295 - DEBUG - [Pod Pod ctest-pod-74157080] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-23 21:27:45,295 - INFO - wget check of of http://10.47.255.251 from ctest-pod-74157080 passed
2025-10-23 21:27:45,295 - INFO - Deleting Network Policy : ingress-on-service
2025-10-23 21:27:45,296 - INFO - Deleting service : ctest-nginx-svc-17152392
2025-10-23 21:27:45,547 - DEBUG - No XMPP flaps were noticed during the test
2025-10-23 21:27:45,547 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:15]
2025-10-23 21:27:45,547 - INFO - --------------------------------------------------------------------------------
2025-10-23 21:27:45,552 - INFO - Deleting pod ctest-new-default-23418353:ctest-pod-68970036
2025-10-23 21:27:45,553 - INFO - Deleting pod ctest-new-default-23418353:ctest-pod-64806376
2025-10-23 21:27:45,553 - INFO - Deleting pod ctest-non-default-63203810:ctest-pod-29765608
2025-10-23 21:27:45,554 - INFO - Deleting pod ctest-non-default-63203810:ctest-pod-64938748
2025-10-23 21:27:45,554 - INFO - Deleting pod ctest-new-default-23418353:ctest-pod-12272970
2025-10-23 21:27:45,554 - INFO - Deleting pod ctest-new-default-23418353:ctest-pod-82100416
2025-10-23 21:27:45,555 - INFO - Deleting pod ctest-non-default-63203810:ctest-pod-74378273
2025-10-23 21:27:45,555 - INFO - Deleting pod ctest-non-default-63203810:ctest-pod-74157080
2025-10-23 21:27:45,622 - WARNING - Pod uuid 52fb16b8-4fcc-4545-8994-2271c6489108 is still seen in agent 10.0.0.249 VM list
2025-10-23 21:27:45,641 - WARNING - Pod uuid 59a737a3-f27c-4ecf-9929-00f804c82c53 is still seen in agent 10.0.0.249 VM list
2025-10-23 21:27:45,644 - WARNING - Pod uuid 68a0bf52-807a-4356-89c3-f0c1cd0c2102 is still seen in agent 10.0.0.249 VM list
2025-10-23 21:27:45,683 - WARNING - Pod uuid 6498b4d2-8185-47a2-b5f2-b6f362d88037 is still seen in agent 10.0.0.249 VM list
2025-10-23 21:27:45,684 - WARNING - Pod uuid 479f382c-6768-4387-966c-d786a8760c11 is still seen in agent 10.0.0.249 VM list
2025-10-23 21:27:45,684 - WARNING - Pod uuid ccfb33cd-82bf-4cf2-aaf5-e634dd9def95 is still seen in agent 10.0.0.249 VM list
2025-10-23 21:27:45,685 - WARNING - Pod uuid ff85e4a4-7f8c-40f3-b57c-c5c045d0d596 is still seen in agent 10.0.0.249 VM list
2025-10-23 21:27:45,685 - WARNING - Pod uuid 2b483304-f405-40c5-866e-511e5ed0fc54 is still seen in agent 10.0.0.249 VM list
2025-10-23 21:27:50,629 - DEBUG - Pod 52fb16b8-4fcc-4545-8994-2271c6489108 is not in agent 10.0.0.249 VM list
2025-10-23 21:27:50,635 - DEBUG - VMI 9ddd36dc-b056-11f0-aebb-fa163ef74794 is removed from agent 10.0.0.249
2025-10-23 21:27:50,635 - INFO - Verified that pod ctest-pod-68970036 is removed in agent
2025-10-23 21:27:50,649 - WARNING - Pod uuid 59a737a3-f27c-4ecf-9929-00f804c82c53 is still seen in agent 10.0.0.249 VM list
2025-10-23 21:27:50,650 - WARNING - Pod uuid 68a0bf52-807a-4356-89c3-f0c1cd0c2102 is still seen in agent 10.0.0.249 VM list
2025-10-23 21:27:50,703 - WARNING - Pod uuid 2b483304-f405-40c5-866e-511e5ed0fc54 is still seen in agent 10.0.0.249 VM list
2025-10-23 21:27:50,703 - DEBUG - Pod ccfb33cd-82bf-4cf2-aaf5-e634dd9def95 is not in agent 10.0.0.249 VM list
2025-10-23 21:27:50,705 - DEBUG - Pod 6498b4d2-8185-47a2-b5f2-b6f362d88037 is not in agent 10.0.0.249 VM list
2025-10-23 21:27:50,706 - WARNING - Pod uuid 479f382c-6768-4387-966c-d786a8760c11 is still seen in agent 10.0.0.249 VM list
2025-10-23 21:27:50,708 - DEBUG - Pod ff85e4a4-7f8c-40f3-b57c-c5c045d0d596 is not in agent 10.0.0.249 VM list
2025-10-23 21:27:50,715 - DEBUG - VMI 9e5ac84a-b056-11f0-aebb-fa163ef74794 is removed from agent 10.0.0.249
2025-10-23 21:27:50,715 - INFO - Verified that pod ctest-pod-64806376 is removed in agent
2025-10-23 21:27:50,715 - DEBUG - VMI 9ef6a1de-b056-11f0-aebb-fa163ef74794 is removed from agent 10.0.0.249
2025-10-23 21:27:50,715 - INFO - Verified that pod ctest-pod-29765608 is removed in agent
2025-10-23 21:27:50,716 - DEBUG - VMI 9f71410a-b056-11f0-aebb-fa163ef74794 is removed from agent 10.0.0.249
2025-10-23 21:27:50,716 - INFO - Verified that pod ctest-pod-64938748 is removed in agent
2025-10-23 21:27:55,659 - WARNING - Pod uuid 59a737a3-f27c-4ecf-9929-00f804c82c53 is still seen in agent 10.0.0.249 VM list
2025-10-23 21:27:55,660 - WARNING - Pod uuid 68a0bf52-807a-4356-89c3-f0c1cd0c2102 is still seen in agent 10.0.0.249 VM list
2025-10-23 21:27:55,718 - WARNING - Pod uuid 2b483304-f405-40c5-866e-511e5ed0fc54 is still seen in agent 10.0.0.249 VM list
2025-10-23 21:27:55,720 - WARNING - Pod uuid 479f382c-6768-4387-966c-d786a8760c11 is still seen in agent 10.0.0.249 VM list
2025-10-23 21:28:00,670 - WARNING - Pod uuid 68a0bf52-807a-4356-89c3-f0c1cd0c2102 is still seen in agent 10.0.0.249 VM list
2025-10-23 21:28:00,670 - WARNING - Pod uuid 59a737a3-f27c-4ecf-9929-00f804c82c53 is still seen in agent 10.0.0.249 VM list
2025-10-23 21:28:00,728 - WARNING - Pod uuid 2b483304-f405-40c5-866e-511e5ed0fc54 is still seen in agent 10.0.0.249 VM list
2025-10-23 21:28:00,729 - WARNING - Pod uuid 479f382c-6768-4387-966c-d786a8760c11 is still seen in agent 10.0.0.249 VM list
2025-10-23 21:28:05,683 - WARNING - Pod uuid 59a737a3-f27c-4ecf-9929-00f804c82c53 is still seen in agent 10.0.0.249 VM list
2025-10-23 21:28:05,684 - WARNING - Pod uuid 68a0bf52-807a-4356-89c3-f0c1cd0c2102 is still seen in agent 10.0.0.249 VM list
2025-10-23 21:28:05,741 - WARNING - Pod uuid 2b483304-f405-40c5-866e-511e5ed0fc54 is still seen in agent 10.0.0.249 VM list
2025-10-23 21:28:05,741 - WARNING - Pod uuid 479f382c-6768-4387-966c-d786a8760c11 is still seen in agent 10.0.0.249 VM list
2025-10-23 21:28:10,693 - WARNING - Pod uuid 59a737a3-f27c-4ecf-9929-00f804c82c53 is still seen in agent 10.0.0.249 VM list
2025-10-23 21:28:10,694 - WARNING - Pod uuid 68a0bf52-807a-4356-89c3-f0c1cd0c2102 is still seen in agent 10.0.0.249 VM list
2025-10-23 21:28:10,751 - WARNING - Pod uuid 2b483304-f405-40c5-866e-511e5ed0fc54 is still seen in agent 10.0.0.249 VM list
2025-10-23 21:28:10,751 - WARNING - Pod uuid 479f382c-6768-4387-966c-d786a8760c11 is still seen in agent 10.0.0.249 VM list
2025-10-23 21:28:15,705 - WARNING - Pod uuid 68a0bf52-807a-4356-89c3-f0c1cd0c2102 is still seen in agent 10.0.0.249 VM list
2025-10-23 21:28:15,709 - WARNING - Pod uuid 59a737a3-f27c-4ecf-9929-00f804c82c53 is still seen in agent 10.0.0.249 VM list
2025-10-23 21:28:15,760 - WARNING - Pod uuid 2b483304-f405-40c5-866e-511e5ed0fc54 is still seen in agent 10.0.0.249 VM list
2025-10-23 21:28:15,761 - WARNING - Pod uuid 479f382c-6768-4387-966c-d786a8760c11 is still seen in agent 10.0.0.249 VM list
2025-10-23 21:28:20,713 - DEBUG - Pod 68a0bf52-807a-4356-89c3-f0c1cd0c2102 is not in agent 10.0.0.249 VM list
2025-10-23 21:28:20,718 - DEBUG - Pod 59a737a3-f27c-4ecf-9929-00f804c82c53 is not in agent 10.0.0.249 VM list
2025-10-23 21:28:20,720 - DEBUG - VMI a153efa4-b056-11f0-aebb-fa163ef74794 is removed from agent 10.0.0.249
2025-10-23 21:28:20,720 - INFO - Verified that pod ctest-pod-74157080 is removed in agent
2025-10-23 21:28:20,724 - DEBUG - VMI 9ffc9dd6-b056-11f0-aebb-fa163ef74794 is removed from agent 10.0.0.249
2025-10-23 21:28:20,724 - INFO - Verified that pod ctest-pod-12272970 is removed in agent
2025-10-23 21:28:20,769 - DEBUG - Pod 479f382c-6768-4387-966c-d786a8760c11 is not in agent 10.0.0.249 VM list
2025-10-23 21:28:20,772 - DEBUG - Pod 2b483304-f405-40c5-866e-511e5ed0fc54 is not in agent 10.0.0.249 VM list
2025-10-23 21:28:20,779 - DEBUG - VMI a06e3aea-b056-11f0-aebb-fa163ef74794 is removed from agent 10.0.0.249
2025-10-23 21:28:20,779 - INFO - Verified that pod ctest-pod-82100416 is removed in agent
2025-10-23 21:28:20,779 - DEBUG - VMI a0dadaba-b056-11f0-aebb-fa163ef74794 is removed from agent 10.0.0.249
2025-10-23 21:28:20,780 - INFO - Verified that pod ctest-pod-74378273 is removed in agent
2025-10-23 21:28:20,780 - INFO - Deleting namespace ctest-non-default-63203810
2025-10-23 21:28:20,789 - DEBUG - Namespace ctest-non-default-63203810 still in k8s
2025-10-23 21:28:22,794 - DEBUG - Namespace ctest-non-default-63203810 still in k8s
2025-10-23 21:28:24,798 - DEBUG - Namespace ctest-non-default-63203810 still in k8s
2025-10-23 21:28:26,802 - DEBUG - Namespace ctest-non-default-63203810 is not in k8s
2025-10-23 21:28:26,803 - DEBUG - No need to check project deletion in contrail-api
2025-10-23 21:28:26,803 - INFO - Deleting namespace ctest-new-default-23418353
2025-10-23 21:28:26,815 - DEBUG - Namespace ctest-new-default-23418353 still in k8s
2025-10-23 21:28:28,819 - DEBUG - Namespace ctest-new-default-23418353 still in k8s
2025-10-23 21:28:30,832 - DEBUG - Namespace ctest-new-default-23418353 still in k8s
2025-10-23 21:28:32,836 - DEBUG - Namespace ctest-new-default-23418353 is not in k8s
2025-10-23 21:28:32,836 - DEBUG - No need to check project deletion in contrail-api