2025-09-08 01:47:02,027 - INFO - Using existing project ['default-domain', 'k8s-default'](11b37ae4-a41f-44f7-aa1f-11870796134b)
2025-09-08 01:47:02,053 - DEBUG - Namespace ctest-new-default-99390715 not present
2025-09-08 01:47:02,063 - INFO - Created namespace ctest-new-default-99390715
2025-09-08 01:47:05,068 - DEBUG - Namespace ctest-non-default-96629688 not present
2025-09-08 01:47:05,075 - INFO - Created namespace ctest-non-default-96629688
2025-09-08 01:47:08,092 - DEBUG - Pod ctest-pod-46078981 not present
2025-09-08 01:47:08,092 - INFO - Creating Pod ctest-pod-46078981
2025-09-08 01:47:08,125 - DEBUG - Pod : ctest-pod-46078981 UUID is 842fcd55-b8d8-44fc-b394-b6c7dc9640a5
2025-09-08 01:47:08,128 - DEBUG - Pod ctest-pod-63449654 not present
2025-09-08 01:47:08,128 - INFO - Creating Pod ctest-pod-63449654
2025-09-08 01:47:08,162 - DEBUG - Pod : ctest-pod-63449654 UUID is 7d53aea8-b0e4-47bc-bec5-283bf71ba52a
2025-09-08 01:47:08,164 - DEBUG - Pod ctest-pod-27624423 not present
2025-09-08 01:47:08,165 - INFO - Creating Pod ctest-pod-27624423
2025-09-08 01:47:08,185 - DEBUG - Pod : ctest-pod-27624423 UUID is 9820e6ab-1921-46fe-bf04-1edd3ecd6f1a
2025-09-08 01:47:08,190 - DEBUG - Pod ctest-pod-54012130 not present
2025-09-08 01:47:08,191 - INFO - Creating Pod ctest-pod-54012130
2025-09-08 01:47:08,219 - DEBUG - Pod : ctest-pod-54012130 UUID is 802550bf-dda8-4210-b85a-15c6f4321753
2025-09-08 01:47:08,225 - DEBUG - Pod ctest-pod-23932126 not present
2025-09-08 01:47:08,225 - INFO - Creating Pod ctest-pod-23932126
2025-09-08 01:47:08,251 - DEBUG - Pod : ctest-pod-23932126 UUID is f57d6c59-23b1-4798-bebe-60d9d80b0ddf
2025-09-08 01:47:08,253 - DEBUG - Pod ctest-pod-37138801 not present
2025-09-08 01:47:08,254 - INFO - Creating Pod ctest-pod-37138801
2025-09-08 01:47:08,271 - DEBUG - Pod : ctest-pod-37138801 UUID is 091414ec-d4c5-40ef-944b-2567f596b5ec
2025-09-08 01:47:08,275 - DEBUG - Pod ctest-pod-86711561 not present
2025-09-08 01:47:08,276 - INFO - Creating Pod ctest-pod-86711561
2025-09-08 01:47:08,297 - DEBUG - Pod : ctest-pod-86711561 UUID is 251f511f-41cc-45d9-8c48-86c38f302658
2025-09-08 01:47:08,300 - DEBUG - Pod ctest-pod-64157845 not present
2025-09-08 01:47:08,300 - INFO - Creating Pod ctest-pod-64157845
2025-09-08 01:47:08,322 - DEBUG - Pod : ctest-pod-64157845 UUID is 63758150-ccd3-4dcc-b66c-acd898799981
2025-09-08 01:47:08,669 - INFO - Project default-domain:k8s-ctest-new-default-99390715 for Namespace ctest-new-default-99390715 is seen in contrail-api
2025-09-08 01:47:08,669 - DEBUG - Project uuid in Contrail is 0be1bf93-5069-4500-a08d-8f7168a08983
2025-09-08 01:47:08,807 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NamespaceDatabaseList?namespace_uuid=ba52b291-9fe3-4043-9e64-5cade29a6fa6
2025-09-08 01:47:08,812 - INFO - Namespace ctest-new-default-99390715 with uuid ba52b291-9fe3-4043-9e64-5cade29a6fa6 found in kube manager
2025-09-08 01:47:08,812 - INFO - Namespace ctest-new-default-99390715 verification passed
2025-09-08 01:47:09,038 - INFO - Project default-domain:k8s-ctest-non-default-96629688 for Namespace ctest-non-default-96629688 is seen in contrail-api
2025-09-08 01:47:09,038 - DEBUG - Project uuid in Contrail is edeb1084-fd98-4464-b530-45793459d0cc
2025-09-08 01:47:09,038 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NamespaceDatabaseList?namespace_uuid=6e9f8a9a-0e18-44d9-80b1-7290e990b0ca
2025-09-08 01:47:09,042 - INFO - Namespace ctest-non-default-96629688 with uuid 6e9f8a9a-0e18-44d9-80b1-7290e990b0ca found in kube manager
2025-09-08 01:47:09,042 - INFO - Namespace ctest-non-default-96629688 verification passed
2025-09-08 01:47:09,050 - DEBUG - Pod ctest-pod-46078981 not in running state.Currently in Pending
2025-09-08 01:47:14,057 - DEBUG - Pod ctest-pod-46078981 not in running state.Currently in Pending
2025-09-08 01:47:19,064 - DEBUG - Pod ctest-pod-46078981 not in running state.Currently in Pending
2025-09-08 01:47:24,072 - INFO - Pod ctest-pod-46078981 is in running state.Got IP 10.47.255.250
2025-09-08 01:47:24,125 - DEBUG - Pod ctest-pod-46078981 has vmi bc78da08-8c55-11f0-b9a9-024220b8c2ec
2025-09-08 01:47:24,125 - INFO - Verified pod ctest-pod-46078981 in contrail-api
2025-09-08 01:47:24,136 - DEBUG - VMI bc78da08-8c55-11f0-b9a9-024220b8c2ec is active in agent 10.0.0.50
2025-09-08 01:47:24,136 - INFO - Verified Pod ctest-pod-46078981 in agent 10.0.0.50
2025-09-08 01:47:24,136 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=842fcd55-b8d8-44fc-b394-b6c7dc9640a5
2025-09-08 01:47:24,140 - INFO - Pod ctest-pod-46078981 with uuid 842fcd55-b8d8-44fc-b394-b6c7dc9640a5 found in kube manager
2025-09-08 01:47:24,141 - INFO - Pod ctest-pod-46078981 verification passed
2025-09-08 01:47:24,148 - INFO - Pod ctest-pod-63449654 is in running state.Got IP 10.47.255.249
2025-09-08 01:47:24,241 - DEBUG - Pod ctest-pod-63449654 has vmi bd232706-8c55-11f0-b9a9-024220b8c2ec
2025-09-08 01:47:24,241 - INFO - Verified pod ctest-pod-63449654 in contrail-api
2025-09-08 01:47:24,251 - DEBUG - VMI bd232706-8c55-11f0-b9a9-024220b8c2ec is active in agent 10.0.0.50
2025-09-08 01:47:24,251 - INFO - Verified Pod ctest-pod-63449654 in agent 10.0.0.50
2025-09-08 01:47:24,251 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=7d53aea8-b0e4-47bc-bec5-283bf71ba52a
2025-09-08 01:47:24,254 - INFO - Pod ctest-pod-63449654 with uuid 7d53aea8-b0e4-47bc-bec5-283bf71ba52a found in kube manager
2025-09-08 01:47:24,255 - INFO - Pod ctest-pod-63449654 verification passed
2025-09-08 01:47:24,262 - INFO - Pod ctest-pod-27624423 is in running state.Got IP 10.47.255.248
2025-09-08 01:47:24,357 - DEBUG - Pod ctest-pod-27624423 has vmi be1329d6-8c55-11f0-b9a9-024220b8c2ec
2025-09-08 01:47:24,357 - INFO - Verified pod ctest-pod-27624423 in contrail-api
2025-09-08 01:47:24,366 - DEBUG - VMI be1329d6-8c55-11f0-b9a9-024220b8c2ec is active in agent 10.0.0.50
2025-09-08 01:47:24,367 - INFO - Verified Pod ctest-pod-27624423 in agent 10.0.0.50
2025-09-08 01:47:24,367 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=9820e6ab-1921-46fe-bf04-1edd3ecd6f1a
2025-09-08 01:47:24,371 - INFO - Pod ctest-pod-27624423 with uuid 9820e6ab-1921-46fe-bf04-1edd3ecd6f1a found in kube manager
2025-09-08 01:47:24,371 - INFO - Pod ctest-pod-27624423 verification passed
2025-09-08 01:47:24,378 - DEBUG - Pod ctest-pod-54012130 not in running state.Currently in Pending
2025-09-08 01:47:29,385 - INFO - Pod ctest-pod-54012130 is in running state.Got IP 10.47.255.247
2025-09-08 01:47:29,436 - DEBUG - Pod ctest-pod-54012130 has vmi bec815a8-8c55-11f0-b9a9-024220b8c2ec
2025-09-08 01:47:29,436 - INFO - Verified pod ctest-pod-54012130 in contrail-api
2025-09-08 01:47:29,445 - DEBUG - VMI bec815a8-8c55-11f0-b9a9-024220b8c2ec is active in agent 10.0.0.50
2025-09-08 01:47:29,445 - INFO - Verified Pod ctest-pod-54012130 in agent 10.0.0.50
2025-09-08 01:47:29,445 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=802550bf-dda8-4210-b85a-15c6f4321753
2025-09-08 01:47:29,450 - INFO - Pod ctest-pod-54012130 with uuid 802550bf-dda8-4210-b85a-15c6f4321753 found in kube manager
2025-09-08 01:47:29,450 - INFO - Pod ctest-pod-54012130 verification passed
2025-09-08 01:47:29,456 - INFO - Pod ctest-pod-23932126 is in running state.Got IP 10.47.255.246
2025-09-08 01:47:29,547 - DEBUG - Pod ctest-pod-23932126 has vmi bf95f482-8c55-11f0-b9a9-024220b8c2ec
2025-09-08 01:47:29,547 - INFO - Verified pod ctest-pod-23932126 in contrail-api
2025-09-08 01:47:29,556 - DEBUG - VMI bf95f482-8c55-11f0-b9a9-024220b8c2ec is active in agent 10.0.0.50
2025-09-08 01:47:29,556 - INFO - Verified Pod ctest-pod-23932126 in agent 10.0.0.50
2025-09-08 01:47:29,556 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=f57d6c59-23b1-4798-bebe-60d9d80b0ddf
2025-09-08 01:47:29,560 - INFO - Pod ctest-pod-23932126 with uuid f57d6c59-23b1-4798-bebe-60d9d80b0ddf found in kube manager
2025-09-08 01:47:29,560 - INFO - Pod ctest-pod-23932126 verification passed
2025-09-08 01:47:29,566 - INFO - Pod ctest-pod-86711561 is in running state.Got IP 10.47.255.244
2025-09-08 01:47:29,657 - DEBUG - Pod ctest-pod-86711561 has vmi c1169ab4-8c55-11f0-b9a9-024220b8c2ec
2025-09-08 01:47:29,657 - INFO - Verified pod ctest-pod-86711561 in contrail-api
2025-09-08 01:47:29,666 - DEBUG - VMI c1169ab4-8c55-11f0-b9a9-024220b8c2ec is active in agent 10.0.0.50
2025-09-08 01:47:29,666 - INFO - Verified Pod ctest-pod-86711561 in agent 10.0.0.50
2025-09-08 01:47:29,666 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=251f511f-41cc-45d9-8c48-86c38f302658
2025-09-08 01:47:29,670 - INFO - Pod ctest-pod-86711561 with uuid 251f511f-41cc-45d9-8c48-86c38f302658 found in kube manager
2025-09-08 01:47:29,670 - INFO - Pod ctest-pod-86711561 verification passed
2025-09-08 01:47:29,676 - INFO - Pod ctest-pod-37138801 is in running state.Got IP 10.47.255.245
2025-09-08 01:47:29,769 - DEBUG - Pod ctest-pod-37138801 has vmi c0573020-8c55-11f0-b9a9-024220b8c2ec
2025-09-08 01:47:29,769 - INFO - Verified pod ctest-pod-37138801 in contrail-api
2025-09-08 01:47:29,778 - DEBUG - VMI c0573020-8c55-11f0-b9a9-024220b8c2ec is active in agent 10.0.0.50
2025-09-08 01:47:29,779 - INFO - Verified Pod ctest-pod-37138801 in agent 10.0.0.50
2025-09-08 01:47:29,779 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=091414ec-d4c5-40ef-944b-2567f596b5ec
2025-09-08 01:47:29,782 - INFO - Pod ctest-pod-37138801 with uuid 091414ec-d4c5-40ef-944b-2567f596b5ec found in kube manager
2025-09-08 01:47:29,782 - INFO - Pod ctest-pod-37138801 verification passed
2025-09-08 01:47:29,788 - DEBUG - Pod ctest-pod-64157845 not in running state.Currently in Pending
2025-09-08 01:47:34,797 - INFO - Pod ctest-pod-64157845 is in running state.Got IP 10.47.255.243
2025-09-08 01:47:34,850 - DEBUG - Pod ctest-pod-64157845 has vmi c1d957a2-8c55-11f0-b9a9-024220b8c2ec
2025-09-08 01:47:34,850 - INFO - Verified pod ctest-pod-64157845 in contrail-api
2025-09-08 01:47:34,862 - DEBUG - VMI c1d957a2-8c55-11f0-b9a9-024220b8c2ec is active in agent 10.0.0.50
2025-09-08 01:47:34,862 - INFO - Verified Pod ctest-pod-64157845 in agent 10.0.0.50
2025-09-08 01:47:34,862 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=63758150-ccd3-4dcc-b66c-acd898799981
2025-09-08 01:47:34,866 - INFO - Pod ctest-pod-64157845 with uuid 63758150-ccd3-4dcc-b66c-acd898799981 found in kube manager
2025-09-08 01:47:34,866 - INFO - Pod ctest-pod-64157845 verification passed
2025-09-08 01:47:34,867 - INFO - ================================================================================
2025-09-08 01:47:34,867 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-09-08 01:47:34,867 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-09-08 01:47:35,140 - DEBUG - Nothing to compare xmpp stats {'10.0.0.50': {'10.0.0.50': '2'}} with
2025-09-08 01:47:35,140 - INFO - Initial checks done. Running the testcase now
2025-09-08 01:47:35,140 - INFO -
2025-09-08 01:47:35,215 - DEBUG - [Pod ctest-pod-46078981] Cmd: echo ctest-pod-46078981 > /usr/share/nginx/html/index.html, Output:
2025-09-08 01:47:35,277 - DEBUG - [Pod ctest-pod-63449654] Cmd: echo ctest-pod-63449654 > /usr/share/nginx/html/index.html, Output:
2025-09-08 01:47:35,338 - DEBUG - [Pod ctest-pod-27624423] Cmd: echo ctest-pod-27624423 > /usr/share/nginx/html/index.html, Output:
2025-09-08 01:47:35,402 - DEBUG - [Pod ctest-pod-54012130] Cmd: echo ctest-pod-54012130 > /usr/share/nginx/html/index.html, Output:
2025-09-08 01:47:35,405 - DEBUG - Service ctest-nginx-svc-65223569 not present
2025-09-08 01:47:35,406 - INFO - Creating service ctest-nginx-svc-65223569
2025-09-08 01:47:35,420 - INFO - Created Service ctest-nginx-svc-65223569
2025-09-08 01:47:35,430 - WARNING - Service UUID 1fa175f5-7a4f-4e45-8dc8-81a0573c76b9 not yet found in contrail-api
2025-09-08 01:47:36,437 - INFO - Validated that Service ctest-nginx-svc-65223569 is seen in contrail-api
2025-09-08 01:47:36,437 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_LoadbalancerDatabaseList?x=1fa175f5-7a4f-4e45-8dc8-81a0573c76b9
2025-09-08 01:47:36,441 - INFO - Service ctest-nginx-svc-65223569 with uuid 1fa175f5-7a4f-4e45-8dc8-81a0573c76b9 found in kube manager
2025-09-08 01:47:36,441 - INFO - Service ctest-nginx-svc-65223569 verification passed
2025-09-08 01:47:37,556 - DEBUG - [Pod ctest-pod-23932126] Cmd: wget http://10.98.14.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
writing to stdout
ctest-pod-63449654
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-08 01:47:37,556 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd wget http://10.98.14.141:80/ -O - -T 5 -t 1 passed
2025-09-08 01:47:37,556 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
writing to stdout
ctest-pod-63449654
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-08 01:47:37,633 - DEBUG - [Pod ctest-pod-23932126] Cmd: wget http://10.98.14.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-63449654
2025-09-08 01:47:37,633 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd wget http://10.98.14.141:80/ -O - -T 5 -t 1 passed
2025-09-08 01:47:37,633 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-63449654
2025-09-08 01:47:37,704 - DEBUG - [Pod ctest-pod-23932126] Cmd: wget http://10.98.14.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
ctest-pod-46078981
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-08 01:47:37,704 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd wget http://10.98.14.141:80/ -O - -T 5 -t 1 passed
2025-09-08 01:47:37,704 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
ctest-pod-46078981
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-08 01:47:37,704 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-46078981': 1, 'ctest-pod-63449654': 2}
2025-09-08 01:47:37,775 - DEBUG - [Pod ctest-pod-86711561] Cmd: wget http://10.98.14.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-46078981
2025-09-08 01:47:37,775 - DEBUG - [Pod Pod ctest-pod-86711561] Cmd wget http://10.98.14.141:80/ -O - -T 5 -t 1 passed
2025-09-08 01:47:37,775 - DEBUG - [Pod Pod ctest-pod-86711561] Cmd output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-46078981
2025-09-08 01:47:37,849 - DEBUG - [Pod ctest-pod-86711561] Cmd: wget http://10.98.14.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
ctest-pod-63449654
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-08 01:47:37,849 - DEBUG - [Pod Pod ctest-pod-86711561] Cmd wget http://10.98.14.141:80/ -O - -T 5 -t 1 passed
2025-09-08 01:47:37,849 - DEBUG - [Pod Pod ctest-pod-86711561] Cmd output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
ctest-pod-63449654
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-08 01:47:37,849 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-46078981': 1, 'ctest-pod-63449654': 1}
2025-09-08 01:47:37,853 - DEBUG - Network policy ingress-on-service not present
2025-09-08 01:47:37,854 - INFO - Creating Network Policy ingress-on-service
2025-09-08 01:47:37,866 - INFO - Network policy found in k8s
2025-09-08 01:47:37,867 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=53a565a3-875a-4e23-a8a7-c31c3916b202
2025-09-08 01:47:37,872 - INFO - Network Policy ingress-on-service with uuid 53a565a3-875a-4e23-a8a7-c31c3916b202 found in kube manager
2025-09-08 01:47:37,897 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-09-08 01:47:37,898 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-09-08 01:47:37,898 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=53a565a3-875a-4e23-a8a7-c31c3916b202
2025-09-08 01:47:37,918 - WARNING - Network policy with name ingress-on-service not found in agent
2025-09-08 01:47:39,919 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=53a565a3-875a-4e23-a8a7-c31c3916b202
2025-09-08 01:47:39,940 - WARNING - Network policy with name ingress-on-service not found in agent
2025-09-08 01:47:41,941 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=53a565a3-875a-4e23-a8a7-c31c3916b202
2025-09-08 01:47:41,966 - INFO - Network policy with name ingress-on-service found in agent
2025-09-08 01:47:41,966 - INFO - Network Policy ingress-on-service verification passed
2025-09-08 01:47:47,041 - DEBUG - [Pod ctest-pod-23932126] Cmd: wget http://10.98.14.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:47:47,041 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd wget http://10.98.14.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:47:47,041 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:47:52,109 - DEBUG - [Pod ctest-pod-23932126] Cmd: wget http://10.98.14.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:47:52,109 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd wget http://10.98.14.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:47:52,110 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:47:57,187 - DEBUG - [Pod ctest-pod-23932126] Cmd: wget http://10.98.14.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:47:57,187 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd wget http://10.98.14.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:47:57,187 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:48:02,260 - DEBUG - [Pod ctest-pod-23932126] Cmd: wget http://10.98.14.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:48:02,260 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd wget http://10.98.14.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:48:02,260 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:48:07,332 - DEBUG - [Pod ctest-pod-23932126] Cmd: wget http://10.98.14.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:48:07,333 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd wget http://10.98.14.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:48:07,333 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:48:12,399 - DEBUG - [Pod ctest-pod-23932126] Cmd: wget http://10.98.14.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:48:12,399 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd wget http://10.98.14.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:48:12,400 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:48:17,463 - DEBUG - [Pod ctest-pod-23932126] Cmd: wget http://10.98.14.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:48:17,463 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd wget http://10.98.14.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:48:17,463 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:48:22,528 - DEBUG - [Pod ctest-pod-23932126] Cmd: wget http://10.98.14.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:48:22,529 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd wget http://10.98.14.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:48:22,529 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:48:27,596 - DEBUG - [Pod ctest-pod-23932126] Cmd: wget http://10.98.14.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:48:27,596 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd wget http://10.98.14.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:48:27,596 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:48:32,675 - DEBUG - [Pod ctest-pod-23932126] Cmd: wget http://10.98.14.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:48:32,675 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd wget http://10.98.14.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:48:32,675 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:48:32,675 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-46078981': 0, 'ctest-pod-63449654': 0}
2025-09-08 01:48:32,746 - DEBUG - [Pod ctest-pod-37138801] Cmd: wget http://10.98.14.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-63449654
2025-09-08 01:48:32,746 - DEBUG - [Pod Pod ctest-pod-37138801] Cmd wget http://10.98.14.141:80/ -O - -T 5 -t 1 passed
2025-09-08 01:48:32,746 - DEBUG - [Pod Pod ctest-pod-37138801] Cmd output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-63449654
2025-09-08 01:48:32,812 - DEBUG - [Pod ctest-pod-37138801] Cmd: wget http://10.98.14.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
ctest-pod-63449654
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-08 01:48:32,812 - DEBUG - [Pod Pod ctest-pod-37138801] Cmd wget http://10.98.14.141:80/ -O - -T 5 -t 1 passed
2025-09-08 01:48:32,813 - DEBUG - [Pod Pod ctest-pod-37138801] Cmd output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
ctest-pod-63449654
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-08 01:48:32,886 - DEBUG - [Pod ctest-pod-37138801] Cmd: wget http://10.98.14.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
ctest-pod-46078981
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-08 01:48:32,887 - DEBUG - [Pod Pod ctest-pod-37138801] Cmd wget http://10.98.14.141:80/ -O - -T 5 -t 1 passed
2025-09-08 01:48:32,887 - DEBUG - [Pod Pod ctest-pod-37138801] Cmd output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
ctest-pod-46078981
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-08 01:48:32,887 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-46078981': 1, 'ctest-pod-63449654': 2}
2025-09-08 01:48:37,956 - DEBUG - [Pod ctest-pod-86711561] Cmd: wget http://10.98.14.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:48:37,956 - DEBUG - [Pod Pod ctest-pod-86711561] Cmd wget http://10.98.14.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:48:37,956 - DEBUG - [Pod Pod ctest-pod-86711561] Cmd output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:48:43,026 - DEBUG - [Pod ctest-pod-86711561] Cmd: wget http://10.98.14.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:48:43,026 - DEBUG - [Pod Pod ctest-pod-86711561] Cmd wget http://10.98.14.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:48:43,026 - DEBUG - [Pod Pod ctest-pod-86711561] Cmd output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:48:48,102 - DEBUG - [Pod ctest-pod-86711561] Cmd: wget http://10.98.14.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:48:48,102 - DEBUG - [Pod Pod ctest-pod-86711561] Cmd wget http://10.98.14.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:48:48,102 - DEBUG - [Pod Pod ctest-pod-86711561] Cmd output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:48:53,227 - DEBUG - [Pod ctest-pod-86711561] Cmd: wget http://10.98.14.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:48:53,227 - DEBUG - [Pod Pod ctest-pod-86711561] Cmd wget http://10.98.14.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:48:53,227 - DEBUG - [Pod Pod ctest-pod-86711561] Cmd output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:48:58,297 - DEBUG - [Pod ctest-pod-86711561] Cmd: wget http://10.98.14.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:48:58,297 - DEBUG - [Pod Pod ctest-pod-86711561] Cmd wget http://10.98.14.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:48:58,297 - DEBUG - [Pod Pod ctest-pod-86711561] Cmd output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:49:03,364 - DEBUG - [Pod ctest-pod-86711561] Cmd: wget http://10.98.14.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:49:03,364 - DEBUG - [Pod Pod ctest-pod-86711561] Cmd wget http://10.98.14.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:49:03,364 - DEBUG - [Pod Pod ctest-pod-86711561] Cmd output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:49:08,436 - DEBUG - [Pod ctest-pod-86711561] Cmd: wget http://10.98.14.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:49:08,436 - DEBUG - [Pod Pod ctest-pod-86711561] Cmd wget http://10.98.14.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:49:08,436 - DEBUG - [Pod Pod ctest-pod-86711561] Cmd output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:49:13,500 - DEBUG - [Pod ctest-pod-86711561] Cmd: wget http://10.98.14.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:49:13,500 - DEBUG - [Pod Pod ctest-pod-86711561] Cmd wget http://10.98.14.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:49:13,500 - DEBUG - [Pod Pod ctest-pod-86711561] Cmd output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:49:18,561 - DEBUG - [Pod ctest-pod-86711561] Cmd: wget http://10.98.14.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:49:18,562 - DEBUG - [Pod Pod ctest-pod-86711561] Cmd wget http://10.98.14.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:49:18,562 - DEBUG - [Pod Pod ctest-pod-86711561] Cmd output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:49:23,628 - DEBUG - [Pod ctest-pod-86711561] Cmd: wget http://10.98.14.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:49:23,628 - DEBUG - [Pod Pod ctest-pod-86711561] Cmd wget http://10.98.14.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:49:23,628 - DEBUG - [Pod Pod ctest-pod-86711561] Cmd output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:49:23,628 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-46078981': 0, 'ctest-pod-63449654': 0}
2025-09-08 01:49:25,696 - DEBUG - [Pod ctest-pod-37138801] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.487 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.060 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.082 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.060/0.209/0.487 ms
2025-09-08 01:49:25,696 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-37138801 with expectation True passed
2025-09-08 01:49:27,773 - DEBUG - [Pod ctest-pod-23932126] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes
64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.502 ms
64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.061 ms
64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.077 ms
--- 10.47.255.245 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.061/0.213/0.502 ms
2025-09-08 01:49:27,773 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-23932126 with expectation True passed
2025-09-08 01:49:29,841 - DEBUG - [Pod ctest-pod-86711561] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes
64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.367 ms
64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.072 ms
64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.089 ms
--- 10.47.255.245 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.072/0.176/0.367 ms
2025-09-08 01:49:29,841 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-86711561 with expectation True passed
2025-09-08 01:49:29,903 - DEBUG - [Pod ctest-pod-37138801] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-08 01:49:29,903 - DEBUG - [Pod Pod ctest-pod-37138801] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-09-08 01:49:29,903 - DEBUG - [Pod Pod ctest-pod-37138801] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-08 01:49:29,903 - INFO - wget check of of http://10.47.255.250 from ctest-pod-37138801 passed
2025-09-08 01:49:29,972 - DEBUG - [Pod ctest-pod-37138801] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-08 01:49:29,972 - DEBUG - [Pod Pod ctest-pod-37138801] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 passed
2025-09-08 01:49:29,972 - DEBUG - [Pod Pod ctest-pod-37138801] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-08 01:49:29,972 - INFO - wget check of of http://10.47.255.249 from ctest-pod-37138801 passed
2025-09-08 01:49:35,034 - DEBUG - [Pod ctest-pod-23932126] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2025-09-08 01:49:35,034 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2025-09-08 01:49:35,034 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2025-09-08 01:49:35,034 - INFO - wget check of of http://10.47.255.249 from ctest-pod-23932126 passed
2025-09-08 01:49:40,108 - DEBUG - [Pod ctest-pod-64157845] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-09-08 01:49:40,108 - DEBUG - [Pod Pod ctest-pod-64157845] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-09-08 01:49:40,108 - DEBUG - [Pod Pod ctest-pod-64157845] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-09-08 01:49:40,108 - INFO - wget check of of http://10.47.255.250 from ctest-pod-64157845 passed
2025-09-08 01:49:40,119 - INFO - Updating Network Policy ingress-on-service
2025-09-08 01:49:45,199 - DEBUG - [Pod ctest-pod-23932126] Cmd: wget http://10.98.14.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:49:45,199 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd wget http://10.98.14.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:49:45,199 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:49:50,263 - DEBUG - [Pod ctest-pod-23932126] Cmd: wget http://10.98.14.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:49:50,263 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd wget http://10.98.14.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:49:50,263 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:49:55,324 - DEBUG - [Pod ctest-pod-23932126] Cmd: wget http://10.98.14.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:49:55,324 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd wget http://10.98.14.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:49:55,324 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:50:00,396 - DEBUG - [Pod ctest-pod-23932126] Cmd: wget http://10.98.14.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:50:00,396 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd wget http://10.98.14.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:50:00,396 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:50:05,463 - DEBUG - [Pod ctest-pod-23932126] Cmd: wget http://10.98.14.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:50:05,463 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd wget http://10.98.14.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:50:05,463 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:50:10,526 - DEBUG - [Pod ctest-pod-23932126] Cmd: wget http://10.98.14.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:50:10,526 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd wget http://10.98.14.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:50:10,526 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:50:15,589 - DEBUG - [Pod ctest-pod-23932126] Cmd: wget http://10.98.14.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:50:15,590 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd wget http://10.98.14.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:50:15,590 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:50:20,661 - DEBUG - [Pod ctest-pod-23932126] Cmd: wget http://10.98.14.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:50:20,661 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd wget http://10.98.14.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:50:20,661 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:50:25,739 - DEBUG - [Pod ctest-pod-23932126] Cmd: wget http://10.98.14.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:50:25,739 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd wget http://10.98.14.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:50:25,739 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:50:30,800 - DEBUG - [Pod ctest-pod-23932126] Cmd: wget http://10.98.14.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:50:30,800 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd wget http://10.98.14.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:50:30,800 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
wget: download timed out
2025-09-08 01:50:30,800 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-46078981': 0, 'ctest-pod-63449654': 0}
2025-09-08 01:50:30,876 - DEBUG - [Pod ctest-pod-37138801] Cmd: wget http://10.98.14.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-63449654
2025-09-08 01:50:30,876 - DEBUG - [Pod Pod ctest-pod-37138801] Cmd wget http://10.98.14.141:80/ -O - -T 5 -t 1 passed
2025-09-08 01:50:30,876 - DEBUG - [Pod Pod ctest-pod-37138801] Cmd output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-63449654
2025-09-08 01:50:30,940 - DEBUG - [Pod ctest-pod-37138801] Cmd: wget http://10.98.14.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
writing to stdout
- 100% ctest-pod-46078981
|********************************| 19 0:00:00 ETA
written to stdout
2025-09-08 01:50:30,941 - DEBUG - [Pod Pod ctest-pod-37138801] Cmd wget http://10.98.14.141:80/ -O - -T 5 -t 1 passed
2025-09-08 01:50:30,941 - DEBUG - [Pod Pod ctest-pod-37138801] Cmd output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
writing to stdout
- 100% ctest-pod-46078981
|********************************| 19 0:00:00 ETA
written to stdout
2025-09-08 01:50:30,941 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-46078981': 1, 'ctest-pod-63449654': 1}
2025-09-08 01:50:31,009 - DEBUG - [Pod ctest-pod-86711561] Cmd: wget http://10.98.14.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
writing to stdout
- 100% ctest-pod-46078981
|********************************| 19 0:00:00 ETA
written to stdout
2025-09-08 01:50:31,009 - DEBUG - [Pod Pod ctest-pod-86711561] Cmd wget http://10.98.14.141:80/ -O - -T 5 -t 1 passed
2025-09-08 01:50:31,009 - DEBUG - [Pod Pod ctest-pod-86711561] Cmd output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
writing to stdout
- 100% ctest-pod-46078981
|********************************| 19 0:00:00 ETA
written to stdout
2025-09-08 01:50:31,069 - DEBUG - [Pod ctest-pod-86711561] Cmd: wget http://10.98.14.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-46078981
2025-09-08 01:50:31,069 - DEBUG - [Pod Pod ctest-pod-86711561] Cmd wget http://10.98.14.141:80/ -O - -T 5 -t 1 passed
2025-09-08 01:50:31,069 - DEBUG - [Pod Pod ctest-pod-86711561] Cmd output: Connecting to 10.98.14.141:80 (10.98.14.141:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-46078981
2025-09-08 01:50:31,132 - DEBUG - [Pod ctest-pod-86711561] Cmd: wget http://10.98.14.141:80/ -O - -T 5 -t 1 , Output: ctest-pod-63449654
Connecting to 10.98.14.141:80 (10.98.14.141:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-08 01:50:31,132 - DEBUG - [Pod Pod ctest-pod-86711561] Cmd wget http://10.98.14.141:80/ -O - -T 5 -t 1 passed
2025-09-08 01:50:31,132 - DEBUG - [Pod Pod ctest-pod-86711561] Cmd output: ctest-pod-63449654
Connecting to 10.98.14.141:80 (10.98.14.141:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-08 01:50:31,132 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-46078981': 2, 'ctest-pod-63449654': 1}
2025-09-08 01:50:33,201 - DEBUG - [Pod ctest-pod-37138801] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.691 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.079 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.084 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.079/0.284/0.691 ms
2025-09-08 01:50:33,201 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-37138801 with expectation True passed
2025-09-08 01:50:35,284 - DEBUG - [Pod ctest-pod-23932126] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes
64 bytes from 10.47.255.245: seq=0 ttl=63 time=1.058 ms
64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.078 ms
64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.064 ms
--- 10.47.255.245 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.064/0.400/1.058 ms
2025-09-08 01:50:35,284 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-23932126 with expectation True passed
2025-09-08 01:50:37,350 - DEBUG - [Pod ctest-pod-86711561] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes
64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.709 ms
64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.086 ms
64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.074 ms
--- 10.47.255.245 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.074/0.289/0.709 ms
2025-09-08 01:50:37,350 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-86711561 with expectation True passed
2025-09-08 01:50:37,424 - DEBUG - [Pod ctest-pod-37138801] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-08 01:50:37,424 - DEBUG - [Pod Pod ctest-pod-37138801] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-09-08 01:50:37,424 - DEBUG - [Pod Pod ctest-pod-37138801] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-08 01:50:37,424 - INFO - wget check of of http://10.47.255.250 from ctest-pod-37138801 passed
2025-09-08 01:50:37,490 - DEBUG - [Pod ctest-pod-37138801] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-08 01:50:37,490 - DEBUG - [Pod Pod ctest-pod-37138801] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 passed
2025-09-08 01:50:37,490 - DEBUG - [Pod Pod ctest-pod-37138801] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-08 01:50:37,491 - INFO - wget check of of http://10.47.255.249 from ctest-pod-37138801 passed
2025-09-08 01:50:42,550 - DEBUG - [Pod ctest-pod-23932126] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2025-09-08 01:50:42,550 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2025-09-08 01:50:42,550 - DEBUG - [Pod Pod ctest-pod-23932126] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2025-09-08 01:50:42,550 - INFO - wget check of of http://10.47.255.249 from ctest-pod-23932126 passed
2025-09-08 01:50:42,618 - DEBUG - [Pod ctest-pod-64157845] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-08 01:50:42,618 - DEBUG - [Pod Pod ctest-pod-64157845] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-09-08 01:50:42,618 - DEBUG - [Pod Pod ctest-pod-64157845] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-08 01:50:42,618 - INFO - wget check of of http://10.47.255.250 from ctest-pod-64157845 passed
2025-09-08 01:50:42,618 - INFO - Deleting Network Policy : ingress-on-service
2025-09-08 01:50:42,620 - INFO - Deleting service : ctest-nginx-svc-65223569
2025-09-08 01:50:43,204 - DEBUG - No XMPP flaps were noticed during the test
2025-09-08 01:50:43,204 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:09]
2025-09-08 01:50:43,204 - INFO - --------------------------------------------------------------------------------
2025-09-08 01:50:43,209 - INFO - Deleting pod ctest-new-default-99390715:ctest-pod-46078981
2025-09-08 01:50:43,210 - INFO - Deleting pod ctest-new-default-99390715:ctest-pod-63449654
2025-09-08 01:50:43,210 - INFO - Deleting pod ctest-non-default-96629688:ctest-pod-27624423
2025-09-08 01:50:43,210 - INFO - Deleting pod ctest-non-default-96629688:ctest-pod-54012130
2025-09-08 01:50:43,211 - INFO - Deleting pod ctest-new-default-99390715:ctest-pod-23932126
2025-09-08 01:50:43,211 - INFO - Deleting pod ctest-new-default-99390715:ctest-pod-37138801
2025-09-08 01:50:43,211 - INFO - Deleting pod ctest-non-default-96629688:ctest-pod-86711561
2025-09-08 01:50:43,212 - INFO - Deleting pod ctest-non-default-96629688:ctest-pod-64157845
2025-09-08 01:50:43,337 - WARNING - Pod uuid 842fcd55-b8d8-44fc-b394-b6c7dc9640a5 is still seen in agent 10.0.0.50 VM list
2025-09-08 01:50:43,340 - WARNING - Pod uuid f57d6c59-23b1-4798-bebe-60d9d80b0ddf is still seen in agent 10.0.0.50 VM list
2025-09-08 01:50:43,341 - WARNING - Pod uuid 091414ec-d4c5-40ef-944b-2567f596b5ec is still seen in agent 10.0.0.50 VM list
2025-09-08 01:50:43,341 - WARNING - Pod uuid 63758150-ccd3-4dcc-b66c-acd898799981 is still seen in agent 10.0.0.50 VM list
2025-09-08 01:50:43,373 - WARNING - Pod uuid 251f511f-41cc-45d9-8c48-86c38f302658 is still seen in agent 10.0.0.50 VM list
2025-09-08 01:50:43,374 - WARNING - Pod uuid 9820e6ab-1921-46fe-bf04-1edd3ecd6f1a is still seen in agent 10.0.0.50 VM list
2025-09-08 01:50:43,374 - WARNING - Pod uuid 7d53aea8-b0e4-47bc-bec5-283bf71ba52a is still seen in agent 10.0.0.50 VM list
2025-09-08 01:50:43,374 - WARNING - Pod uuid 802550bf-dda8-4210-b85a-15c6f4321753 is still seen in agent 10.0.0.50 VM list
2025-09-08 01:50:48,352 - WARNING - Pod uuid 091414ec-d4c5-40ef-944b-2567f596b5ec is still seen in agent 10.0.0.50 VM list
2025-09-08 01:50:48,352 - WARNING - Pod uuid 63758150-ccd3-4dcc-b66c-acd898799981 is still seen in agent 10.0.0.50 VM list
2025-09-08 01:50:48,353 - WARNING - Pod uuid f57d6c59-23b1-4798-bebe-60d9d80b0ddf is still seen in agent 10.0.0.50 VM list
2025-09-08 01:50:48,353 - DEBUG - Pod 842fcd55-b8d8-44fc-b394-b6c7dc9640a5 is not in agent 10.0.0.50 VM list
2025-09-08 01:50:48,357 - DEBUG - VMI bc78da08-8c55-11f0-b9a9-024220b8c2ec is removed from agent 10.0.0.50
2025-09-08 01:50:48,357 - INFO - Verified that pod ctest-pod-46078981 is removed in agent
2025-09-08 01:50:48,386 - DEBUG - Pod 9820e6ab-1921-46fe-bf04-1edd3ecd6f1a is not in agent 10.0.0.50 VM list
2025-09-08 01:50:48,388 - DEBUG - Pod 802550bf-dda8-4210-b85a-15c6f4321753 is not in agent 10.0.0.50 VM list
2025-09-08 01:50:48,389 - WARNING - Pod uuid 251f511f-41cc-45d9-8c48-86c38f302658 is still seen in agent 10.0.0.50 VM list
2025-09-08 01:50:48,389 - WARNING - Pod uuid 7d53aea8-b0e4-47bc-bec5-283bf71ba52a is still seen in agent 10.0.0.50 VM list
2025-09-08 01:50:48,394 - DEBUG - VMI bec815a8-8c55-11f0-b9a9-024220b8c2ec is removed from agent 10.0.0.50
2025-09-08 01:50:48,394 - INFO - Verified that pod ctest-pod-54012130 is removed in agent
2025-09-08 01:50:48,395 - DEBUG - VMI be1329d6-8c55-11f0-b9a9-024220b8c2ec is removed from agent 10.0.0.50
2025-09-08 01:50:48,395 - INFO - Verified that pod ctest-pod-27624423 is removed in agent
2025-09-08 01:50:53,363 - WARNING - Pod uuid f57d6c59-23b1-4798-bebe-60d9d80b0ddf is still seen in agent 10.0.0.50 VM list
2025-09-08 01:50:53,364 - WARNING - Pod uuid 091414ec-d4c5-40ef-944b-2567f596b5ec is still seen in agent 10.0.0.50 VM list
2025-09-08 01:50:53,364 - WARNING - Pod uuid 63758150-ccd3-4dcc-b66c-acd898799981 is still seen in agent 10.0.0.50 VM list
2025-09-08 01:50:53,397 - WARNING - Pod uuid 7d53aea8-b0e4-47bc-bec5-283bf71ba52a is still seen in agent 10.0.0.50 VM list
2025-09-08 01:50:53,397 - WARNING - Pod uuid 251f511f-41cc-45d9-8c48-86c38f302658 is still seen in agent 10.0.0.50 VM list
2025-09-08 01:50:58,374 - WARNING - Pod uuid f57d6c59-23b1-4798-bebe-60d9d80b0ddf is still seen in agent 10.0.0.50 VM list
2025-09-08 01:50:58,375 - WARNING - Pod uuid 63758150-ccd3-4dcc-b66c-acd898799981 is still seen in agent 10.0.0.50 VM list
2025-09-08 01:50:58,376 - WARNING - Pod uuid 091414ec-d4c5-40ef-944b-2567f596b5ec is still seen in agent 10.0.0.50 VM list
2025-09-08 01:50:58,410 - WARNING - Pod uuid 7d53aea8-b0e4-47bc-bec5-283bf71ba52a is still seen in agent 10.0.0.50 VM list
2025-09-08 01:50:58,411 - WARNING - Pod uuid 251f511f-41cc-45d9-8c48-86c38f302658 is still seen in agent 10.0.0.50 VM list
2025-09-08 01:51:03,386 - WARNING - Pod uuid f57d6c59-23b1-4798-bebe-60d9d80b0ddf is still seen in agent 10.0.0.50 VM list
2025-09-08 01:51:03,387 - WARNING - Pod uuid 63758150-ccd3-4dcc-b66c-acd898799981 is still seen in agent 10.0.0.50 VM list
2025-09-08 01:51:03,388 - WARNING - Pod uuid 091414ec-d4c5-40ef-944b-2567f596b5ec is still seen in agent 10.0.0.50 VM list
2025-09-08 01:51:03,420 - WARNING - Pod uuid 7d53aea8-b0e4-47bc-bec5-283bf71ba52a is still seen in agent 10.0.0.50 VM list
2025-09-08 01:51:03,421 - WARNING - Pod uuid 251f511f-41cc-45d9-8c48-86c38f302658 is still seen in agent 10.0.0.50 VM list
2025-09-08 01:51:08,396 - WARNING - Pod uuid f57d6c59-23b1-4798-bebe-60d9d80b0ddf is still seen in agent 10.0.0.50 VM list
2025-09-08 01:51:08,397 - WARNING - Pod uuid 091414ec-d4c5-40ef-944b-2567f596b5ec is still seen in agent 10.0.0.50 VM list
2025-09-08 01:51:08,399 - WARNING - Pod uuid 63758150-ccd3-4dcc-b66c-acd898799981 is still seen in agent 10.0.0.50 VM list
2025-09-08 01:51:08,428 - WARNING - Pod uuid 251f511f-41cc-45d9-8c48-86c38f302658 is still seen in agent 10.0.0.50 VM list
2025-09-08 01:51:08,429 - WARNING - Pod uuid 7d53aea8-b0e4-47bc-bec5-283bf71ba52a is still seen in agent 10.0.0.50 VM list
2025-09-08 01:51:13,408 - WARNING - Pod uuid f57d6c59-23b1-4798-bebe-60d9d80b0ddf is still seen in agent 10.0.0.50 VM list
2025-09-08 01:51:13,409 - WARNING - Pod uuid 63758150-ccd3-4dcc-b66c-acd898799981 is still seen in agent 10.0.0.50 VM list
2025-09-08 01:51:13,410 - WARNING - Pod uuid 091414ec-d4c5-40ef-944b-2567f596b5ec is still seen in agent 10.0.0.50 VM list
2025-09-08 01:51:13,437 - WARNING - Pod uuid 251f511f-41cc-45d9-8c48-86c38f302658 is still seen in agent 10.0.0.50 VM list
2025-09-08 01:51:13,437 - WARNING - Pod uuid 7d53aea8-b0e4-47bc-bec5-283bf71ba52a is still seen in agent 10.0.0.50 VM list
2025-09-08 01:51:18,420 - DEBUG - Pod f57d6c59-23b1-4798-bebe-60d9d80b0ddf is not in agent 10.0.0.50 VM list
2025-09-08 01:51:18,422 - DEBUG - Pod 091414ec-d4c5-40ef-944b-2567f596b5ec is not in agent 10.0.0.50 VM list
2025-09-08 01:51:18,423 - DEBUG - Pod 63758150-ccd3-4dcc-b66c-acd898799981 is not in agent 10.0.0.50 VM list
2025-09-08 01:51:18,432 - DEBUG - VMI c1d957a2-8c55-11f0-b9a9-024220b8c2ec is removed from agent 10.0.0.50
2025-09-08 01:51:18,432 - INFO - Verified that pod ctest-pod-64157845 is removed in agent
2025-09-08 01:51:18,433 - DEBUG - VMI c0573020-8c55-11f0-b9a9-024220b8c2ec is removed from agent 10.0.0.50
2025-09-08 01:51:18,433 - INFO - Verified that pod ctest-pod-37138801 is removed in agent
2025-09-08 01:51:18,433 - DEBUG - VMI bf95f482-8c55-11f0-b9a9-024220b8c2ec is removed from agent 10.0.0.50
2025-09-08 01:51:18,433 - INFO - Verified that pod ctest-pod-23932126 is removed in agent
2025-09-08 01:51:18,445 - DEBUG - Pod 7d53aea8-b0e4-47bc-bec5-283bf71ba52a is not in agent 10.0.0.50 VM list
2025-09-08 01:51:18,447 - DEBUG - Pod 251f511f-41cc-45d9-8c48-86c38f302658 is not in agent 10.0.0.50 VM list
2025-09-08 01:51:18,453 - DEBUG - VMI bd232706-8c55-11f0-b9a9-024220b8c2ec is removed from agent 10.0.0.50
2025-09-08 01:51:18,453 - INFO - Verified that pod ctest-pod-63449654 is removed in agent
2025-09-08 01:51:18,453 - DEBUG - VMI c1169ab4-8c55-11f0-b9a9-024220b8c2ec is removed from agent 10.0.0.50
2025-09-08 01:51:18,453 - INFO - Verified that pod ctest-pod-86711561 is removed in agent
2025-09-08 01:51:18,453 - INFO - Deleting namespace ctest-non-default-96629688
2025-09-08 01:51:18,462 - DEBUG - Namespace ctest-non-default-96629688 still in k8s
2025-09-08 01:51:20,466 - DEBUG - Namespace ctest-non-default-96629688 still in k8s
2025-09-08 01:51:22,471 - DEBUG - Namespace ctest-non-default-96629688 still in k8s
2025-09-08 01:51:24,475 - DEBUG - Namespace ctest-non-default-96629688 is not in k8s
2025-09-08 01:51:24,475 - DEBUG - No need to check project deletion in contrail-api
2025-09-08 01:51:24,475 - INFO - Deleting namespace ctest-new-default-99390715
2025-09-08 01:51:24,484 - DEBUG - Namespace ctest-new-default-99390715 still in k8s
2025-09-08 01:51:26,489 - DEBUG - Namespace ctest-new-default-99390715 still in k8s
2025-09-08 01:51:28,494 - DEBUG - Namespace ctest-new-default-99390715 still in k8s
2025-09-08 01:51:30,498 - DEBUG - Namespace ctest-new-default-99390715 is not in k8s
2025-09-08 01:51:30,498 - DEBUG - No need to check project deletion in contrail-api