2025-04-28 10:59:05,396 - INFO - Using existing project ['default-domain', 'k8s-default'](262a9b48-68ee-4148-9f32-968498920879)
2025-04-28 10:59:05,416 - DEBUG - Namespace ctest-new-default-93160221 not present
2025-04-28 10:59:05,434 - INFO - Created namespace ctest-new-default-93160221
2025-04-28 10:59:08,440 - DEBUG - Namespace ctest-non-default-17974283 not present
2025-04-28 10:59:08,459 - INFO - Created namespace ctest-non-default-17974283
2025-04-28 10:59:11,479 - DEBUG - Pod ctest-pod-67181958 not present
2025-04-28 10:59:11,479 - INFO - Creating Pod ctest-pod-67181958
2025-04-28 10:59:11,500 - DEBUG - Pod : ctest-pod-67181958 UUID is 595f8cc8-ee19-4003-854c-e4a66df2869a
2025-04-28 10:59:11,504 - DEBUG - Pod ctest-pod-80290328 not present
2025-04-28 10:59:11,504 - INFO - Creating Pod ctest-pod-80290328
2025-04-28 10:59:11,538 - DEBUG - Pod : ctest-pod-80290328 UUID is c58ca047-3606-4830-adbe-2588cf9a064b
2025-04-28 10:59:11,543 - DEBUG - Pod ctest-pod-44069627 not present
2025-04-28 10:59:11,543 - INFO - Creating Pod ctest-pod-44069627
2025-04-28 10:59:11,579 - DEBUG - Pod : ctest-pod-44069627 UUID is 14ab53de-1a5b-4799-94b5-1531dec98315
2025-04-28 10:59:11,585 - DEBUG - Pod ctest-pod-93415473 not present
2025-04-28 10:59:11,585 - INFO - Creating Pod ctest-pod-93415473
2025-04-28 10:59:11,613 - DEBUG - Pod : ctest-pod-93415473 UUID is 173f1181-ead6-4051-a369-ddcd26d339ca
2025-04-28 10:59:11,615 - DEBUG - Pod ctest-pod-17614913 not present
2025-04-28 10:59:11,615 - INFO - Creating Pod ctest-pod-17614913
2025-04-28 10:59:11,634 - DEBUG - Pod : ctest-pod-17614913 UUID is 145b7998-4ada-4aeb-a6c3-2066756ada70
2025-04-28 10:59:11,636 - DEBUG - Pod ctest-pod-85946478 not present
2025-04-28 10:59:11,636 - INFO - Creating Pod ctest-pod-85946478
2025-04-28 10:59:11,655 - DEBUG - Pod : ctest-pod-85946478 UUID is 501f11b6-e6d8-4712-a8c7-ba4e2e0fdfcc
2025-04-28 10:59:11,657 - DEBUG - Pod ctest-pod-96122376 not present
2025-04-28 10:59:11,657 - INFO - Creating Pod ctest-pod-96122376
2025-04-28 10:59:11,675 - DEBUG - Pod : ctest-pod-96122376 UUID is 15a5ba40-ee53-4378-babc-2a479c977636
2025-04-28 10:59:11,677 - DEBUG - Pod ctest-pod-79508582 not present
2025-04-28 10:59:11,678 - INFO - Creating Pod ctest-pod-79508582
2025-04-28 10:59:11,697 - DEBUG - Pod : ctest-pod-79508582 UUID is 774621e8-4e18-4252-9d26-aba498214269
2025-04-28 10:59:11,878 - INFO - Project default-domain:k8s-ctest-new-default-93160221 for Namespace ctest-new-default-93160221 is seen in contrail-api
2025-04-28 10:59:11,878 - DEBUG - Project uuid in Contrail is bdfa970b-55fc-4016-8b8d-38c99e3983a7
2025-04-28 10:59:12,070 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_NamespaceDatabaseList?namespace_uuid=6acc2491-85e0-41f6-9e24-36b496ec0e1b
2025-04-28 10:59:12,074 - INFO - Namespace ctest-new-default-93160221 with uuid 6acc2491-85e0-41f6-9e24-36b496ec0e1b found in kube manager
2025-04-28 10:59:12,074 - INFO - Namespace ctest-new-default-93160221 verification passed
2025-04-28 10:59:12,276 - INFO - Project default-domain:k8s-ctest-non-default-17974283 for Namespace ctest-non-default-17974283 is seen in contrail-api
2025-04-28 10:59:12,276 - DEBUG - Project uuid in Contrail is 02f8f76b-9f88-4137-bfc7-37f02137923b
2025-04-28 10:59:12,276 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_NamespaceDatabaseList?namespace_uuid=d894a4b4-2dbe-4c12-a078-b78a57e878e2
2025-04-28 10:59:12,283 - INFO - Namespace ctest-non-default-17974283 with uuid d894a4b4-2dbe-4c12-a078-b78a57e878e2 found in kube manager
2025-04-28 10:59:12,283 - INFO - Namespace ctest-non-default-17974283 verification passed
2025-04-28 10:59:12,290 - DEBUG - Pod ctest-pod-67181958 not in running state.Currently in Pending
2025-04-28 10:59:17,313 - DEBUG - Pod ctest-pod-67181958 not in running state.Currently in Pending
2025-04-28 10:59:22,335 - DEBUG - Pod ctest-pod-67181958 not in running state.Currently in Pending
2025-04-28 10:59:27,342 - INFO - Pod ctest-pod-67181958 is in running state.Got IP 10.47.255.251
2025-04-28 10:59:27,397 - DEBUG - Pod ctest-pod-67181958 has vmi d1e56f8a-241f-11f0-a5cb-fa163e9670b8
2025-04-28 10:59:27,397 - INFO - Verified pod ctest-pod-67181958 in contrail-api
2025-04-28 10:59:27,412 - DEBUG - VMI d1e56f8a-241f-11f0-a5cb-fa163e9670b8 is active in agent 10.0.0.19
2025-04-28 10:59:27,413 - INFO - Verified Pod ctest-pod-67181958 in agent 10.0.0.19
2025-04-28 10:59:27,413 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=595f8cc8-ee19-4003-854c-e4a66df2869a
2025-04-28 10:59:27,418 - INFO - Pod ctest-pod-67181958 with uuid 595f8cc8-ee19-4003-854c-e4a66df2869a found in kube manager
2025-04-28 10:59:27,418 - INFO - Pod ctest-pod-67181958 verification passed
2025-04-28 10:59:27,423 - INFO - Pod ctest-pod-80290328 is in running state.Got IP 10.47.255.250
2025-04-28 10:59:27,451 - DEBUG - Pod ctest-pod-80290328 has vmi d27c2790-241f-11f0-a5cb-fa163e9670b8
2025-04-28 10:59:27,451 - INFO - Verified pod ctest-pod-80290328 in contrail-api
2025-04-28 10:59:27,463 - DEBUG - VMI d27c2790-241f-11f0-a5cb-fa163e9670b8 is active in agent 10.0.0.19
2025-04-28 10:59:27,464 - INFO - Verified Pod ctest-pod-80290328 in agent 10.0.0.19
2025-04-28 10:59:27,464 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=c58ca047-3606-4830-adbe-2588cf9a064b
2025-04-28 10:59:27,468 - INFO - Pod ctest-pod-80290328 with uuid c58ca047-3606-4830-adbe-2588cf9a064b found in kube manager
2025-04-28 10:59:27,468 - INFO - Pod ctest-pod-80290328 verification passed
2025-04-28 10:59:27,474 - INFO - Pod ctest-pod-44069627 is in running state.Got IP 10.47.255.249
2025-04-28 10:59:27,534 - DEBUG - Pod ctest-pod-44069627 has vmi d350bfe6-241f-11f0-a5cb-fa163e9670b8
2025-04-28 10:59:27,534 - INFO - Verified pod ctest-pod-44069627 in contrail-api
2025-04-28 10:59:27,547 - DEBUG - VMI d350bfe6-241f-11f0-a5cb-fa163e9670b8 is active in agent 10.0.0.19
2025-04-28 10:59:27,547 - INFO - Verified Pod ctest-pod-44069627 in agent 10.0.0.19
2025-04-28 10:59:27,548 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=14ab53de-1a5b-4799-94b5-1531dec98315
2025-04-28 10:59:27,552 - INFO - Pod ctest-pod-44069627 with uuid 14ab53de-1a5b-4799-94b5-1531dec98315 found in kube manager
2025-04-28 10:59:27,552 - INFO - Pod ctest-pod-44069627 verification passed
2025-04-28 10:59:27,559 - INFO - Pod ctest-pod-93415473 is in running state.Got IP 10.47.255.248
2025-04-28 10:59:27,621 - DEBUG - Pod ctest-pod-93415473 has vmi d3ec634c-241f-11f0-a5cb-fa163e9670b8
2025-04-28 10:59:27,621 - INFO - Verified pod ctest-pod-93415473 in contrail-api
2025-04-28 10:59:27,634 - DEBUG - VMI d3ec634c-241f-11f0-a5cb-fa163e9670b8 is active in agent 10.0.0.19
2025-04-28 10:59:27,635 - INFO - Verified Pod ctest-pod-93415473 in agent 10.0.0.19
2025-04-28 10:59:27,635 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=173f1181-ead6-4051-a369-ddcd26d339ca
2025-04-28 10:59:27,639 - INFO - Pod ctest-pod-93415473 with uuid 173f1181-ead6-4051-a369-ddcd26d339ca found in kube manager
2025-04-28 10:59:27,639 - INFO - Pod ctest-pod-93415473 verification passed
2025-04-28 10:59:27,644 - DEBUG - Pod ctest-pod-17614913 not in running state.Currently in Pending
2025-04-28 10:59:32,651 - INFO - Pod ctest-pod-17614913 is in running state.Got IP 10.47.255.247
2025-04-28 10:59:32,665 - DEBUG - Pod ctest-pod-17614913 has vmi d4b1ba16-241f-11f0-a5cb-fa163e9670b8
2025-04-28 10:59:32,665 - INFO - Verified pod ctest-pod-17614913 in contrail-api
2025-04-28 10:59:32,678 - DEBUG - VMI d4b1ba16-241f-11f0-a5cb-fa163e9670b8 is active in agent 10.0.0.19
2025-04-28 10:59:32,678 - INFO - Verified Pod ctest-pod-17614913 in agent 10.0.0.19
2025-04-28 10:59:32,678 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=145b7998-4ada-4aeb-a6c3-2066756ada70
2025-04-28 10:59:32,683 - INFO - Pod ctest-pod-17614913 with uuid 145b7998-4ada-4aeb-a6c3-2066756ada70 found in kube manager
2025-04-28 10:59:32,683 - INFO - Pod ctest-pod-17614913 verification passed
2025-04-28 10:59:32,688 - INFO - Pod ctest-pod-96122376 is in running state.Got IP 10.47.255.245
2025-04-28 10:59:32,749 - DEBUG - Pod ctest-pod-96122376 has vmi d5df4868-241f-11f0-a5cb-fa163e9670b8
2025-04-28 10:59:32,749 - INFO - Verified pod ctest-pod-96122376 in contrail-api
2025-04-28 10:59:32,762 - DEBUG - VMI d5df4868-241f-11f0-a5cb-fa163e9670b8 is active in agent 10.0.0.19
2025-04-28 10:59:32,762 - INFO - Verified Pod ctest-pod-96122376 in agent 10.0.0.19
2025-04-28 10:59:32,762 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=15a5ba40-ee53-4378-babc-2a479c977636
2025-04-28 10:59:32,768 - INFO - Pod ctest-pod-96122376 with uuid 15a5ba40-ee53-4378-babc-2a479c977636 found in kube manager
2025-04-28 10:59:32,768 - INFO - Pod ctest-pod-96122376 verification passed
2025-04-28 10:59:32,840 - INFO - Pod ctest-pod-85946478 is in running state.Got IP 10.47.255.246
2025-04-28 10:59:32,859 - DEBUG - Pod ctest-pod-85946478 has vmi d53ffb0a-241f-11f0-a5cb-fa163e9670b8
2025-04-28 10:59:32,860 - INFO - Verified pod ctest-pod-85946478 in contrail-api
2025-04-28 10:59:32,872 - DEBUG - VMI d53ffb0a-241f-11f0-a5cb-fa163e9670b8 is active in agent 10.0.0.19
2025-04-28 10:59:32,873 - INFO - Verified Pod ctest-pod-85946478 in agent 10.0.0.19
2025-04-28 10:59:32,873 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=501f11b6-e6d8-4712-a8c7-ba4e2e0fdfcc
2025-04-28 10:59:32,877 - INFO - Pod ctest-pod-85946478 with uuid 501f11b6-e6d8-4712-a8c7-ba4e2e0fdfcc found in kube manager
2025-04-28 10:59:32,877 - INFO - Pod ctest-pod-85946478 verification passed
2025-04-28 10:59:32,882 - INFO - Pod ctest-pod-79508582 is in running state.Got IP 10.47.255.244
2025-04-28 10:59:32,937 - DEBUG - Pod ctest-pod-79508582 has vmi d67b6388-241f-11f0-a5cb-fa163e9670b8
2025-04-28 10:59:32,937 - INFO - Verified pod ctest-pod-79508582 in contrail-api
2025-04-28 10:59:32,949 - DEBUG - VMI d67b6388-241f-11f0-a5cb-fa163e9670b8 is active in agent 10.0.0.19
2025-04-28 10:59:32,950 - INFO - Verified Pod ctest-pod-79508582 in agent 10.0.0.19
2025-04-28 10:59:32,950 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=774621e8-4e18-4252-9d26-aba498214269
2025-04-28 10:59:32,954 - INFO - Pod ctest-pod-79508582 with uuid 774621e8-4e18-4252-9d26-aba498214269 found in kube manager
2025-04-28 10:59:32,954 - INFO - Pod ctest-pod-79508582 verification passed
2025-04-28 10:59:32,954 - INFO - ================================================================================
2025-04-28 10:59:32,954 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-04-28 10:59:32,954 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-04-28 10:59:33,187 - DEBUG - Nothing to compare xmpp stats {'10.0.0.19': {'10.0.0.249': '0'}} with
2025-04-28 10:59:33,188 - INFO - Initial checks done. Running the testcase now
2025-04-28 10:59:33,188 - INFO -
2025-04-28 10:59:33,239 - DEBUG - [Pod ctest-pod-67181958] Cmd: echo ctest-pod-67181958 > /usr/share/nginx/html/index.html, Output:
2025-04-28 10:59:33,297 - DEBUG - [Pod ctest-pod-80290328] Cmd: echo ctest-pod-80290328 > /usr/share/nginx/html/index.html, Output:
2025-04-28 10:59:33,355 - DEBUG - [Pod ctest-pod-44069627] Cmd: echo ctest-pod-44069627 > /usr/share/nginx/html/index.html, Output:
2025-04-28 10:59:33,415 - DEBUG - [Pod ctest-pod-93415473] Cmd: echo ctest-pod-93415473 > /usr/share/nginx/html/index.html, Output:
2025-04-28 10:59:33,428 - DEBUG - Service ctest-nginx-svc-62317305 not present
2025-04-28 10:59:33,432 - INFO - Creating service ctest-nginx-svc-62317305
2025-04-28 10:59:33,448 - INFO - Created Service ctest-nginx-svc-62317305
2025-04-28 10:59:33,459 - WARNING - Service UUID 75fa26d6-ce9c-4859-9392-35db3931e3d6 not yet found in contrail-api
2025-04-28 10:59:34,466 - INFO - Validated that Service ctest-nginx-svc-62317305 is seen in contrail-api
2025-04-28 10:59:34,466 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_LoadbalancerDatabaseList?x=75fa26d6-ce9c-4859-9392-35db3931e3d6
2025-04-28 10:59:34,471 - INFO - Service ctest-nginx-svc-62317305 with uuid 75fa26d6-ce9c-4859-9392-35db3931e3d6 found in kube manager
2025-04-28 10:59:34,471 - INFO - Service ctest-nginx-svc-62317305 verification passed
2025-04-28 10:59:35,554 - DEBUG - [Pod ctest-pod-17614913] Cmd: wget http://10.110.233.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-67181958
2025-04-28 10:59:35,554 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd wget http://10.110.233.61:80/ -O - -T 5 -t 1 passed
2025-04-28 10:59:35,554 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-67181958
2025-04-28 10:59:35,614 - DEBUG - [Pod ctest-pod-17614913] Cmd: wget http://10.110.233.61:80/ -O - -T 5 -t 1 , Output: ctest-pod-80290328
Connecting to 10.110.233.61:80 (10.110.233.61:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-28 10:59:35,614 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd wget http://10.110.233.61:80/ -O - -T 5 -t 1 passed
2025-04-28 10:59:35,614 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd output: ctest-pod-80290328
Connecting to 10.110.233.61:80 (10.110.233.61:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-28 10:59:35,614 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-67181958': 1, 'ctest-pod-80290328': 1}
2025-04-28 10:59:35,675 - DEBUG - [Pod ctest-pod-96122376] Cmd: wget http://10.110.233.61:80/ -O - -T 5 -t 1 , Output: ctest-pod-67181958
Connecting to 10.110.233.61:80 (10.110.233.61:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-28 10:59:35,675 - DEBUG - [Pod Pod ctest-pod-96122376] Cmd wget http://10.110.233.61:80/ -O - -T 5 -t 1 passed
2025-04-28 10:59:35,675 - DEBUG - [Pod Pod ctest-pod-96122376] Cmd output: ctest-pod-67181958
Connecting to 10.110.233.61:80 (10.110.233.61:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-28 10:59:35,728 - DEBUG - [Pod ctest-pod-96122376] Cmd: wget http://10.110.233.61:80/ -O - -T 5 -t 1 , Output: ctest-pod-80290328
Connecting to 10.110.233.61:80 (10.110.233.61:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-28 10:59:35,729 - DEBUG - [Pod Pod ctest-pod-96122376] Cmd wget http://10.110.233.61:80/ -O - -T 5 -t 1 passed
2025-04-28 10:59:35,729 - DEBUG - [Pod Pod ctest-pod-96122376] Cmd output: ctest-pod-80290328
Connecting to 10.110.233.61:80 (10.110.233.61:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-28 10:59:35,729 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-67181958': 1, 'ctest-pod-80290328': 1}
2025-04-28 10:59:35,733 - DEBUG - Network policy ingress-on-service not present
2025-04-28 10:59:35,733 - INFO - Creating Network Policy ingress-on-service
2025-04-28 10:59:35,751 - INFO - Network policy found in k8s
2025-04-28 10:59:35,751 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=0f5571e5-f81b-47ac-900e-73e4744162c6
2025-04-28 10:59:35,757 - INFO - Network Policy ingress-on-service with uuid 0f5571e5-f81b-47ac-900e-73e4744162c6 found in kube manager
2025-04-28 10:59:35,790 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-04-28 10:59:35,790 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-04-28 10:59:35,790 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=0f5571e5-f81b-47ac-900e-73e4744162c6
2025-04-28 10:59:35,824 - WARNING - Network policy with name ingress-on-service not found in agent
2025-04-28 10:59:37,826 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=0f5571e5-f81b-47ac-900e-73e4744162c6
2025-04-28 10:59:37,866 - INFO - Network policy with name ingress-on-service found in agent
2025-04-28 10:59:37,866 - INFO - Network Policy ingress-on-service verification passed
2025-04-28 10:59:42,922 - DEBUG - [Pod ctest-pod-17614913] Cmd: wget http://10.110.233.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 10:59:42,922 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd wget http://10.110.233.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 10:59:42,922 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 10:59:47,969 - DEBUG - [Pod ctest-pod-17614913] Cmd: wget http://10.110.233.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 10:59:47,969 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd wget http://10.110.233.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 10:59:47,969 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 10:59:53,030 - DEBUG - [Pod ctest-pod-17614913] Cmd: wget http://10.110.233.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 10:59:53,030 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd wget http://10.110.233.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 10:59:53,030 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 10:59:58,087 - DEBUG - [Pod ctest-pod-17614913] Cmd: wget http://10.110.233.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 10:59:58,087 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd wget http://10.110.233.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 10:59:58,087 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:00:03,138 - DEBUG - [Pod ctest-pod-17614913] Cmd: wget http://10.110.233.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:00:03,138 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd wget http://10.110.233.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:00:03,138 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:00:08,190 - DEBUG - [Pod ctest-pod-17614913] Cmd: wget http://10.110.233.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:00:08,190 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd wget http://10.110.233.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:00:08,190 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:00:13,238 - DEBUG - [Pod ctest-pod-17614913] Cmd: wget http://10.110.233.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:00:13,238 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd wget http://10.110.233.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:00:13,238 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:00:18,295 - DEBUG - [Pod ctest-pod-17614913] Cmd: wget http://10.110.233.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:00:18,295 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd wget http://10.110.233.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:00:18,295 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:00:23,346 - DEBUG - [Pod ctest-pod-17614913] Cmd: wget http://10.110.233.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:00:23,346 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd wget http://10.110.233.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:00:23,346 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:00:28,413 - DEBUG - [Pod ctest-pod-17614913] Cmd: wget http://10.110.233.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:00:28,414 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd wget http://10.110.233.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:00:28,414 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:00:28,414 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-67181958': 0, 'ctest-pod-80290328': 0}
2025-04-28 11:00:28,480 - DEBUG - [Pod ctest-pod-85946478] Cmd: wget http://10.110.233.61:80/ -O - -T 5 -t 1 , Output: ctest-pod-80290328
Connecting to 10.110.233.61:80 (10.110.233.61:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-28 11:00:28,480 - DEBUG - [Pod Pod ctest-pod-85946478] Cmd wget http://10.110.233.61:80/ -O - -T 5 -t 1 passed
2025-04-28 11:00:28,480 - DEBUG - [Pod Pod ctest-pod-85946478] Cmd output: ctest-pod-80290328
Connecting to 10.110.233.61:80 (10.110.233.61:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-28 11:00:28,541 - DEBUG - [Pod ctest-pod-85946478] Cmd: wget http://10.110.233.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-80290328
2025-04-28 11:00:28,541 - DEBUG - [Pod Pod ctest-pod-85946478] Cmd wget http://10.110.233.61:80/ -O - -T 5 -t 1 passed
2025-04-28 11:00:28,541 - DEBUG - [Pod Pod ctest-pod-85946478] Cmd output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-80290328
2025-04-28 11:00:28,592 - DEBUG - [Pod ctest-pod-85946478] Cmd: wget http://10.110.233.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-67181958
2025-04-28 11:00:28,592 - DEBUG - [Pod Pod ctest-pod-85946478] Cmd wget http://10.110.233.61:80/ -O - -T 5 -t 1 passed
2025-04-28 11:00:28,592 - DEBUG - [Pod Pod ctest-pod-85946478] Cmd output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-67181958
2025-04-28 11:00:28,592 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-67181958': 1, 'ctest-pod-80290328': 2}
2025-04-28 11:00:33,646 - DEBUG - [Pod ctest-pod-96122376] Cmd: wget http://10.110.233.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:00:33,646 - DEBUG - [Pod Pod ctest-pod-96122376] Cmd wget http://10.110.233.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:00:33,646 - DEBUG - [Pod Pod ctest-pod-96122376] Cmd output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:00:38,698 - DEBUG - [Pod ctest-pod-96122376] Cmd: wget http://10.110.233.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:00:38,698 - DEBUG - [Pod Pod ctest-pod-96122376] Cmd wget http://10.110.233.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:00:38,698 - DEBUG - [Pod Pod ctest-pod-96122376] Cmd output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:00:43,750 - DEBUG - [Pod ctest-pod-96122376] Cmd: wget http://10.110.233.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:00:43,751 - DEBUG - [Pod Pod ctest-pod-96122376] Cmd wget http://10.110.233.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:00:43,751 - DEBUG - [Pod Pod ctest-pod-96122376] Cmd output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:00:48,805 - DEBUG - [Pod ctest-pod-96122376] Cmd: wget http://10.110.233.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:00:48,806 - DEBUG - [Pod Pod ctest-pod-96122376] Cmd wget http://10.110.233.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:00:48,806 - DEBUG - [Pod Pod ctest-pod-96122376] Cmd output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:00:53,875 - DEBUG - [Pod ctest-pod-96122376] Cmd: wget http://10.110.233.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:00:53,875 - DEBUG - [Pod Pod ctest-pod-96122376] Cmd wget http://10.110.233.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:00:53,875 - DEBUG - [Pod Pod ctest-pod-96122376] Cmd output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:00:58,934 - DEBUG - [Pod ctest-pod-96122376] Cmd: wget http://10.110.233.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:00:58,934 - DEBUG - [Pod Pod ctest-pod-96122376] Cmd wget http://10.110.233.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:00:58,934 - DEBUG - [Pod Pod ctest-pod-96122376] Cmd output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:01:03,978 - DEBUG - [Pod ctest-pod-96122376] Cmd: wget http://10.110.233.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:01:03,978 - DEBUG - [Pod Pod ctest-pod-96122376] Cmd wget http://10.110.233.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:01:03,978 - DEBUG - [Pod Pod ctest-pod-96122376] Cmd output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:01:09,031 - DEBUG - [Pod ctest-pod-96122376] Cmd: wget http://10.110.233.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:01:09,031 - DEBUG - [Pod Pod ctest-pod-96122376] Cmd wget http://10.110.233.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:01:09,031 - DEBUG - [Pod Pod ctest-pod-96122376] Cmd output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:01:14,091 - DEBUG - [Pod ctest-pod-96122376] Cmd: wget http://10.110.233.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:01:14,091 - DEBUG - [Pod Pod ctest-pod-96122376] Cmd wget http://10.110.233.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:01:14,091 - DEBUG - [Pod Pod ctest-pod-96122376] Cmd output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:01:19,159 - DEBUG - [Pod ctest-pod-96122376] Cmd: wget http://10.110.233.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:01:19,159 - DEBUG - [Pod Pod ctest-pod-96122376] Cmd wget http://10.110.233.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:01:19,159 - DEBUG - [Pod Pod ctest-pod-96122376] Cmd output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:01:19,159 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-67181958': 0, 'ctest-pod-80290328': 0}
2025-04-28 11:01:21,219 - DEBUG - [Pod ctest-pod-85946478] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.718 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.076 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.092 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.076/0.295/0.718 ms
2025-04-28 11:01:21,220 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-85946478 with expectation True passed
2025-04-28 11:01:23,276 - DEBUG - [Pod ctest-pod-17614913] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.299 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.092 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.073 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.073/0.488/1.299 ms
2025-04-28 11:01:23,276 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-17614913 with expectation True passed
2025-04-28 11:01:25,331 - DEBUG - [Pod ctest-pod-96122376] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.022 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.085 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.113 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.085/0.406/1.022 ms
2025-04-28 11:01:25,331 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-96122376 with expectation True passed
2025-04-28 11:01:25,384 - DEBUG - [Pod ctest-pod-85946478] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-28 11:01:25,385 - DEBUG - [Pod Pod ctest-pod-85946478] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-04-28 11:01:25,385 - DEBUG - [Pod Pod ctest-pod-85946478] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-28 11:01:25,385 - INFO - wget check of of http://10.47.255.251 from ctest-pod-85946478 passed
2025-04-28 11:01:25,441 - DEBUG - [Pod ctest-pod-85946478] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-28 11:01:25,441 - DEBUG - [Pod Pod ctest-pod-85946478] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-04-28 11:01:25,441 - DEBUG - [Pod Pod ctest-pod-85946478] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-28 11:01:25,441 - INFO - wget check of of http://10.47.255.250 from ctest-pod-85946478 passed
2025-04-28 11:01:30,477 - DEBUG - [Pod ctest-pod-17614913] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-28 11:01:30,477 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-28 11:01:30,477 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-28 11:01:30,477 - INFO - wget check of of http://10.47.255.250 from ctest-pod-17614913 passed
2025-04-28 11:01:35,531 - DEBUG - [Pod ctest-pod-79508582] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-04-28 11:01:35,531 - DEBUG - [Pod Pod ctest-pod-79508582] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-04-28 11:01:35,531 - DEBUG - [Pod Pod ctest-pod-79508582] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-04-28 11:01:35,531 - INFO - wget check of of http://10.47.255.251 from ctest-pod-79508582 passed
2025-04-28 11:01:35,541 - INFO - Updating Network Policy ingress-on-service
2025-04-28 11:01:40,603 - DEBUG - [Pod ctest-pod-17614913] Cmd: wget http://10.110.233.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:01:40,603 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd wget http://10.110.233.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:01:40,603 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:01:45,651 - DEBUG - [Pod ctest-pod-17614913] Cmd: wget http://10.110.233.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:01:45,651 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd wget http://10.110.233.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:01:45,651 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:01:50,716 - DEBUG - [Pod ctest-pod-17614913] Cmd: wget http://10.110.233.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:01:50,717 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd wget http://10.110.233.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:01:50,717 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:01:55,810 - DEBUG - [Pod ctest-pod-17614913] Cmd: wget http://10.110.233.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:01:55,811 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd wget http://10.110.233.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:01:55,811 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:02:00,863 - DEBUG - [Pod ctest-pod-17614913] Cmd: wget http://10.110.233.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:02:00,863 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd wget http://10.110.233.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:02:00,863 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:02:05,921 - DEBUG - [Pod ctest-pod-17614913] Cmd: wget http://10.110.233.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:02:05,921 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd wget http://10.110.233.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:02:05,921 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:02:10,986 - DEBUG - [Pod ctest-pod-17614913] Cmd: wget http://10.110.233.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:02:10,987 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd wget http://10.110.233.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:02:10,987 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:02:16,040 - DEBUG - [Pod ctest-pod-17614913] Cmd: wget http://10.110.233.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:02:16,040 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd wget http://10.110.233.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:02:16,040 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:02:16,903 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2025-04-28 11:02:26,975 - DEBUG - [Pod ctest-pod-17614913] Cmd: wget http://10.110.233.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:02:26,975 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd wget http://10.110.233.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:02:26,975 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:02:32,030 - DEBUG - [Pod ctest-pod-17614913] Cmd: wget http://10.110.233.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:02:32,030 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd wget http://10.110.233.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:02:32,030 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
wget: download timed out
2025-04-28 11:02:32,030 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-67181958': 0, 'ctest-pod-80290328': 0}
2025-04-28 11:02:32,092 - DEBUG - [Pod ctest-pod-85946478] Cmd: wget http://10.110.233.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-67181958
2025-04-28 11:02:32,093 - DEBUG - [Pod Pod ctest-pod-85946478] Cmd wget http://10.110.233.61:80/ -O - -T 5 -t 1 passed
2025-04-28 11:02:32,093 - DEBUG - [Pod Pod ctest-pod-85946478] Cmd output: Connecting to 10.110.233.61:80 (10.110.233.61:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-67181958
2025-04-28 11:02:32,149 - DEBUG - [Pod ctest-pod-85946478] Cmd: wget http://10.110.233.61:80/ -O - -T 5 -t 1 , Output: ctest-pod-80290328
Connecting to 10.110.233.61:80 (10.110.233.61:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-28 11:02:32,149 - DEBUG - [Pod Pod ctest-pod-85946478] Cmd wget http://10.110.233.61:80/ -O - -T 5 -t 1 passed
2025-04-28 11:02:32,149 - DEBUG - [Pod Pod ctest-pod-85946478] Cmd output: ctest-pod-80290328
Connecting to 10.110.233.61:80 (10.110.233.61:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-28 11:02:32,150 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-67181958': 1, 'ctest-pod-80290328': 1}
2025-04-28 11:02:32,205 - DEBUG - [Pod ctest-pod-96122376] Cmd: wget http://10.110.233.61:80/ -O - -T 5 -t 1 , Output: ctest-pod-67181958
Connecting to 10.110.233.61:80 (10.110.233.61:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-28 11:02:32,205 - DEBUG - [Pod Pod ctest-pod-96122376] Cmd wget http://10.110.233.61:80/ -O - -T 5 -t 1 passed
2025-04-28 11:02:32,205 - DEBUG - [Pod Pod ctest-pod-96122376] Cmd output: ctest-pod-67181958
Connecting to 10.110.233.61:80 (10.110.233.61:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-28 11:02:32,259 - DEBUG - [Pod ctest-pod-96122376] Cmd: wget http://10.110.233.61:80/ -O - -T 5 -t 1 , Output: ctest-pod-80290328
Connecting to 10.110.233.61:80 (10.110.233.61:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-28 11:02:32,259 - DEBUG - [Pod Pod ctest-pod-96122376] Cmd wget http://10.110.233.61:80/ -O - -T 5 -t 1 passed
2025-04-28 11:02:32,259 - DEBUG - [Pod Pod ctest-pod-96122376] Cmd output: ctest-pod-80290328
Connecting to 10.110.233.61:80 (10.110.233.61:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-28 11:02:32,259 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-67181958': 1, 'ctest-pod-80290328': 1}
2025-04-28 11:02:34,316 - DEBUG - [Pod ctest-pod-85946478] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.431 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.107 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.120 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.107/0.219/0.431 ms
2025-04-28 11:02:34,316 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-85946478 with expectation True passed
2025-04-28 11:02:36,370 - DEBUG - [Pod ctest-pod-17614913] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.516 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.103 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.113 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.103/0.244/0.516 ms
2025-04-28 11:02:36,371 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-17614913 with expectation True passed
2025-04-28 11:02:38,427 - DEBUG - [Pod ctest-pod-96122376] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.559 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.093 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.101 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.093/0.251/0.559 ms
2025-04-28 11:02:38,427 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-96122376 with expectation True passed
2025-04-28 11:02:38,484 - DEBUG - [Pod ctest-pod-85946478] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-28 11:02:38,485 - DEBUG - [Pod Pod ctest-pod-85946478] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-04-28 11:02:38,485 - DEBUG - [Pod Pod ctest-pod-85946478] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-28 11:02:38,485 - INFO - wget check of of http://10.47.255.251 from ctest-pod-85946478 passed
2025-04-28 11:02:38,534 - DEBUG - [Pod ctest-pod-85946478] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-28 11:02:38,534 - DEBUG - [Pod Pod ctest-pod-85946478] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-04-28 11:02:38,534 - DEBUG - [Pod Pod ctest-pod-85946478] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-28 11:02:38,534 - INFO - wget check of of http://10.47.255.250 from ctest-pod-85946478 passed
2025-04-28 11:02:43,587 - DEBUG - [Pod ctest-pod-17614913] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-28 11:02:43,587 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-28 11:02:43,587 - DEBUG - [Pod Pod ctest-pod-17614913] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-28 11:02:43,588 - INFO - wget check of of http://10.47.255.250 from ctest-pod-17614913 passed
2025-04-28 11:02:43,644 - DEBUG - [Pod ctest-pod-79508582] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-28 11:02:43,644 - DEBUG - [Pod Pod ctest-pod-79508582] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-04-28 11:02:43,644 - DEBUG - [Pod Pod ctest-pod-79508582] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-28 11:02:43,644 - INFO - wget check of of http://10.47.255.251 from ctest-pod-79508582 passed
2025-04-28 11:02:43,644 - INFO - Deleting Network Policy : ingress-on-service
2025-04-28 11:02:43,645 - INFO - Deleting service : ctest-nginx-svc-62317305
2025-04-28 11:02:43,886 - DEBUG - No XMPP flaps were noticed during the test
2025-04-28 11:02:43,886 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:11]
2025-04-28 11:02:43,887 - INFO - --------------------------------------------------------------------------------
2025-04-28 11:02:43,892 - INFO - Deleting pod ctest-new-default-93160221:ctest-pod-67181958
2025-04-28 11:02:43,892 - INFO - Deleting pod ctest-new-default-93160221:ctest-pod-80290328
2025-04-28 11:02:43,892 - INFO - Deleting pod ctest-non-default-17974283:ctest-pod-44069627
2025-04-28 11:02:43,893 - INFO - Deleting pod ctest-non-default-17974283:ctest-pod-93415473
2025-04-28 11:02:43,893 - INFO - Deleting pod ctest-new-default-93160221:ctest-pod-17614913
2025-04-28 11:02:43,893 - INFO - Deleting pod ctest-new-default-93160221:ctest-pod-85946478
2025-04-28 11:02:43,894 - INFO - Deleting pod ctest-non-default-17974283:ctest-pod-96122376
2025-04-28 11:02:43,894 - INFO - Deleting pod ctest-non-default-17974283:ctest-pod-79508582
2025-04-28 11:02:43,962 - WARNING - Pod uuid 595f8cc8-ee19-4003-854c-e4a66df2869a is still seen in agent 10.0.0.19 VM list
2025-04-28 11:02:43,982 - WARNING - Pod uuid 501f11b6-e6d8-4712-a8c7-ba4e2e0fdfcc is still seen in agent 10.0.0.19 VM list
2025-04-28 11:02:43,984 - WARNING - Pod uuid 14ab53de-1a5b-4799-94b5-1531dec98315 is still seen in agent 10.0.0.19 VM list
2025-04-28 11:02:44,021 - WARNING - Pod uuid c58ca047-3606-4830-adbe-2588cf9a064b is still seen in agent 10.0.0.19 VM list
2025-04-28 11:02:44,022 - WARNING - Pod uuid 774621e8-4e18-4252-9d26-aba498214269 is still seen in agent 10.0.0.19 VM list
2025-04-28 11:02:44,026 - WARNING - Pod uuid 145b7998-4ada-4aeb-a6c3-2066756ada70 is still seen in agent 10.0.0.19 VM list
2025-04-28 11:02:44,027 - WARNING - Pod uuid 173f1181-ead6-4051-a369-ddcd26d339ca is still seen in agent 10.0.0.19 VM list
2025-04-28 11:02:44,027 - WARNING - Pod uuid 15a5ba40-ee53-4378-babc-2a479c977636 is still seen in agent 10.0.0.19 VM list
2025-04-28 11:02:48,971 - DEBUG - Pod 595f8cc8-ee19-4003-854c-e4a66df2869a is not in agent 10.0.0.19 VM list
2025-04-28 11:02:48,977 - DEBUG - VMI d1e56f8a-241f-11f0-a5cb-fa163e9670b8 is removed from agent 10.0.0.19
2025-04-28 11:02:48,977 - INFO - Verified that pod ctest-pod-67181958 is removed in agent
2025-04-28 11:02:48,996 - WARNING - Pod uuid 501f11b6-e6d8-4712-a8c7-ba4e2e0fdfcc is still seen in agent 10.0.0.19 VM list
2025-04-28 11:02:48,996 - DEBUG - Pod 14ab53de-1a5b-4799-94b5-1531dec98315 is not in agent 10.0.0.19 VM list
2025-04-28 11:02:49,004 - DEBUG - VMI d350bfe6-241f-11f0-a5cb-fa163e9670b8 is removed from agent 10.0.0.19
2025-04-28 11:02:49,004 - INFO - Verified that pod ctest-pod-44069627 is removed in agent
2025-04-28 11:02:49,034 - DEBUG - Pod c58ca047-3606-4830-adbe-2588cf9a064b is not in agent 10.0.0.19 VM list
2025-04-28 11:02:49,058 - WARNING - Pod uuid 15a5ba40-ee53-4378-babc-2a479c977636 is still seen in agent 10.0.0.19 VM list
2025-04-28 11:02:49,058 - WARNING - Pod uuid 145b7998-4ada-4aeb-a6c3-2066756ada70 is still seen in agent 10.0.0.19 VM list
2025-04-28 11:02:49,059 - WARNING - Pod uuid 774621e8-4e18-4252-9d26-aba498214269 is still seen in agent 10.0.0.19 VM list
2025-04-28 11:02:49,060 - DEBUG - Pod 173f1181-ead6-4051-a369-ddcd26d339ca is not in agent 10.0.0.19 VM list
2025-04-28 11:02:49,062 - DEBUG - VMI d27c2790-241f-11f0-a5cb-fa163e9670b8 is removed from agent 10.0.0.19
2025-04-28 11:02:49,062 - INFO - Verified that pod ctest-pod-80290328 is removed in agent
2025-04-28 11:02:49,068 - DEBUG - VMI d3ec634c-241f-11f0-a5cb-fa163e9670b8 is removed from agent 10.0.0.19
2025-04-28 11:02:49,068 - INFO - Verified that pod ctest-pod-93415473 is removed in agent
2025-04-28 11:02:54,016 - WARNING - Pod uuid 501f11b6-e6d8-4712-a8c7-ba4e2e0fdfcc is still seen in agent 10.0.0.19 VM list
2025-04-28 11:02:54,076 - WARNING - Pod uuid 15a5ba40-ee53-4378-babc-2a479c977636 is still seen in agent 10.0.0.19 VM list
2025-04-28 11:02:54,078 - WARNING - Pod uuid 774621e8-4e18-4252-9d26-aba498214269 is still seen in agent 10.0.0.19 VM list
2025-04-28 11:02:54,078 - WARNING - Pod uuid 145b7998-4ada-4aeb-a6c3-2066756ada70 is still seen in agent 10.0.0.19 VM list
2025-04-28 11:02:59,030 - WARNING - Pod uuid 501f11b6-e6d8-4712-a8c7-ba4e2e0fdfcc is still seen in agent 10.0.0.19 VM list
2025-04-28 11:02:59,102 - WARNING - Pod uuid 15a5ba40-ee53-4378-babc-2a479c977636 is still seen in agent 10.0.0.19 VM list
2025-04-28 11:02:59,103 - WARNING - Pod uuid 145b7998-4ada-4aeb-a6c3-2066756ada70 is still seen in agent 10.0.0.19 VM list
2025-04-28 11:02:59,104 - WARNING - Pod uuid 774621e8-4e18-4252-9d26-aba498214269 is still seen in agent 10.0.0.19 VM list
2025-04-28 11:03:04,039 - WARNING - Pod uuid 501f11b6-e6d8-4712-a8c7-ba4e2e0fdfcc is still seen in agent 10.0.0.19 VM list
2025-04-28 11:03:04,124 - WARNING - Pod uuid 15a5ba40-ee53-4378-babc-2a479c977636 is still seen in agent 10.0.0.19 VM list
2025-04-28 11:03:04,127 - WARNING - Pod uuid 145b7998-4ada-4aeb-a6c3-2066756ada70 is still seen in agent 10.0.0.19 VM list
2025-04-28 11:03:04,128 - WARNING - Pod uuid 774621e8-4e18-4252-9d26-aba498214269 is still seen in agent 10.0.0.19 VM list
2025-04-28 11:03:09,048 - WARNING - Pod uuid 501f11b6-e6d8-4712-a8c7-ba4e2e0fdfcc is still seen in agent 10.0.0.19 VM list
2025-04-28 11:03:09,143 - WARNING - Pod uuid 15a5ba40-ee53-4378-babc-2a479c977636 is still seen in agent 10.0.0.19 VM list
2025-04-28 11:03:09,149 - WARNING - Pod uuid 145b7998-4ada-4aeb-a6c3-2066756ada70 is still seen in agent 10.0.0.19 VM list
2025-04-28 11:03:09,150 - WARNING - Pod uuid 774621e8-4e18-4252-9d26-aba498214269 is still seen in agent 10.0.0.19 VM list
2025-04-28 11:03:14,056 - WARNING - Pod uuid 501f11b6-e6d8-4712-a8c7-ba4e2e0fdfcc is still seen in agent 10.0.0.19 VM list
2025-04-28 11:03:14,154 - WARNING - Pod uuid 15a5ba40-ee53-4378-babc-2a479c977636 is still seen in agent 10.0.0.19 VM list
2025-04-28 11:03:14,183 - WARNING - Pod uuid 145b7998-4ada-4aeb-a6c3-2066756ada70 is still seen in agent 10.0.0.19 VM list
2025-04-28 11:03:14,185 - WARNING - Pod uuid 774621e8-4e18-4252-9d26-aba498214269 is still seen in agent 10.0.0.19 VM list
2025-04-28 11:03:19,064 - DEBUG - Pod 501f11b6-e6d8-4712-a8c7-ba4e2e0fdfcc is not in agent 10.0.0.19 VM list
2025-04-28 11:03:19,071 - DEBUG - VMI d53ffb0a-241f-11f0-a5cb-fa163e9670b8 is removed from agent 10.0.0.19
2025-04-28 11:03:19,071 - INFO - Verified that pod ctest-pod-85946478 is removed in agent
2025-04-28 11:03:19,164 - DEBUG - Pod 15a5ba40-ee53-4378-babc-2a479c977636 is not in agent 10.0.0.19 VM list
2025-04-28 11:03:19,171 - DEBUG - VMI d5df4868-241f-11f0-a5cb-fa163e9670b8 is removed from agent 10.0.0.19
2025-04-28 11:03:19,171 - INFO - Verified that pod ctest-pod-96122376 is removed in agent
2025-04-28 11:03:19,195 - DEBUG - Pod 145b7998-4ada-4aeb-a6c3-2066756ada70 is not in agent 10.0.0.19 VM list
2025-04-28 11:03:19,197 - DEBUG - Pod 774621e8-4e18-4252-9d26-aba498214269 is not in agent 10.0.0.19 VM list
2025-04-28 11:03:19,208 - DEBUG - VMI d67b6388-241f-11f0-a5cb-fa163e9670b8 is removed from agent 10.0.0.19
2025-04-28 11:03:19,208 - INFO - Verified that pod ctest-pod-79508582 is removed in agent
2025-04-28 11:03:19,209 - DEBUG - VMI d4b1ba16-241f-11f0-a5cb-fa163e9670b8 is removed from agent 10.0.0.19
2025-04-28 11:03:19,209 - INFO - Verified that pod ctest-pod-17614913 is removed in agent
2025-04-28 11:03:19,209 - INFO - Deleting namespace ctest-non-default-17974283
2025-04-28 11:03:19,224 - DEBUG - Namespace ctest-non-default-17974283 still in k8s
2025-04-28 11:03:21,230 - DEBUG - Namespace ctest-non-default-17974283 still in k8s
2025-04-28 11:03:23,234 - DEBUG - Namespace ctest-non-default-17974283 still in k8s
2025-04-28 11:03:25,238 - DEBUG - Namespace ctest-non-default-17974283 is not in k8s
2025-04-28 11:03:25,238 - DEBUG - No need to check project deletion in contrail-api
2025-04-28 11:03:25,238 - INFO - Deleting namespace ctest-new-default-93160221
2025-04-28 11:03:25,248 - DEBUG - Namespace ctest-new-default-93160221 still in k8s
2025-04-28 11:03:27,252 - DEBUG - Namespace ctest-new-default-93160221 still in k8s
2025-04-28 11:03:29,257 - DEBUG - Namespace ctest-new-default-93160221 still in k8s
2025-04-28 11:03:31,261 - DEBUG - Namespace ctest-new-default-93160221 is not in k8s
2025-04-28 11:03:31,261 - DEBUG - No need to check project deletion in contrail-api