2025-04-18 11:11:10,626 - INFO - Using existing project ['default-domain', 'k8s-default'](cf873d88-626b-4b85-9ec3-d2d3b8276a02)
2025-04-18 11:11:10,648 - DEBUG - Namespace ctest-new-default-46341287 not present
2025-04-18 11:11:10,659 - INFO - Created namespace ctest-new-default-46341287
2025-04-18 11:11:13,663 - DEBUG - Namespace ctest-non-default-28822133 not present
2025-04-18 11:11:13,674 - INFO - Created namespace ctest-non-default-28822133
2025-04-18 11:11:16,702 - DEBUG - Pod ctest-pod-37431827 not present
2025-04-18 11:11:16,703 - INFO - Creating Pod ctest-pod-37431827
2025-04-18 11:11:16,735 - DEBUG - Node for Pod ctest-pod-37431827 not yet populated
2025-04-18 11:11:19,758 - DEBUG - Pod : ctest-pod-37431827 UUID is 17b9b136-7f26-4dd6-8ee6-5770c0297c80
2025-04-18 11:11:19,761 - DEBUG - Pod ctest-pod-30162102 not present
2025-04-18 11:11:19,762 - INFO - Creating Pod ctest-pod-30162102
2025-04-18 11:11:19,797 - DEBUG - Pod : ctest-pod-30162102 UUID is e019af1b-76a6-45be-af40-da10c4ca1288
2025-04-18 11:11:19,805 - DEBUG - Pod ctest-pod-31619838 not present
2025-04-18 11:11:19,807 - INFO - Creating Pod ctest-pod-31619838
2025-04-18 11:11:19,833 - DEBUG - Pod : ctest-pod-31619838 UUID is 1406e2c0-d447-4994-b28e-2b381ae80d94
2025-04-18 11:11:19,839 - DEBUG - Pod ctest-pod-64022992 not present
2025-04-18 11:11:19,839 - INFO - Creating Pod ctest-pod-64022992
2025-04-18 11:11:19,878 - DEBUG - Pod : ctest-pod-64022992 UUID is cdf73132-c7aa-475f-962e-19ec15359349
2025-04-18 11:11:19,893 - DEBUG - Pod ctest-pod-08927505 not present
2025-04-18 11:11:19,894 - INFO - Creating Pod ctest-pod-08927505
2025-04-18 11:11:19,938 - DEBUG - Pod : ctest-pod-08927505 UUID is ba5b22c0-4d3e-4dd0-ad05-638b63eb30ea
2025-04-18 11:11:19,941 - DEBUG - Pod ctest-pod-37550160 not present
2025-04-18 11:11:19,941 - INFO - Creating Pod ctest-pod-37550160
2025-04-18 11:11:19,986 - DEBUG - Pod : ctest-pod-37550160 UUID is 277f7d7d-3487-49d6-b65c-22bae1363cb1
2025-04-18 11:11:19,991 - DEBUG - Pod ctest-pod-70081496 not present
2025-04-18 11:11:19,991 - INFO - Creating Pod ctest-pod-70081496
2025-04-18 11:11:20,029 - DEBUG - Pod : ctest-pod-70081496 UUID is ec64084f-2585-4d3e-856b-47a3cde9ce10
2025-04-18 11:11:20,044 - DEBUG - Pod ctest-pod-13713304 not present
2025-04-18 11:11:20,044 - INFO - Creating Pod ctest-pod-13713304
2025-04-18 11:11:20,077 - DEBUG - Pod : ctest-pod-13713304 UUID is adc15d1b-438d-48d5-a04d-190afb2701cf
2025-04-18 11:11:20,316 - INFO - Project default-domain:k8s-ctest-new-default-46341287 for Namespace ctest-new-default-46341287 is seen in contrail-api
2025-04-18 11:11:20,316 - DEBUG - Project uuid in Contrail is 864a85ab-b1fa-4a68-914c-9a0bbfe87717
2025-04-18 11:11:20,510 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NamespaceDatabaseList?namespace_uuid=d0a4694d-fe64-449b-b768-c1dd747d487a
2025-04-18 11:11:20,527 - INFO - Namespace ctest-new-default-46341287 with uuid d0a4694d-fe64-449b-b768-c1dd747d487a found in kube manager
2025-04-18 11:11:20,527 - INFO - Namespace ctest-new-default-46341287 verification passed
2025-04-18 11:11:20,757 - INFO - Project default-domain:k8s-ctest-non-default-28822133 for Namespace ctest-non-default-28822133 is seen in contrail-api
2025-04-18 11:11:20,758 - DEBUG - Project uuid in Contrail is fcb09c51-51d6-4da2-8680-de7da4e3cdc0
2025-04-18 11:11:20,758 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NamespaceDatabaseList?namespace_uuid=e8df3f73-a0a4-41d8-84e6-6cfb123804fe
2025-04-18 11:11:20,769 - INFO - Namespace ctest-non-default-28822133 with uuid e8df3f73-a0a4-41d8-84e6-6cfb123804fe found in kube manager
2025-04-18 11:11:20,769 - INFO - Namespace ctest-non-default-28822133 verification passed
2025-04-18 11:11:20,777 - DEBUG - Pod ctest-pod-37431827 not in running state.Currently in Pending
2025-04-18 11:11:25,785 - INFO - Pod ctest-pod-37431827 is in running state.Got IP 10.47.255.251
2025-04-18 11:11:25,842 - DEBUG - Pod ctest-pod-37431827 has vmi d9f579b8-1c45-11f0-8bb8-fa163e1de319
2025-04-18 11:11:25,842 - INFO - Verified pod ctest-pod-37431827 in contrail-api
2025-04-18 11:11:25,866 - DEBUG - VMI d9f579b8-1c45-11f0-8bb8-fa163e1de319 is active in agent 10.0.0.65
2025-04-18 11:11:25,866 - INFO - Verified Pod ctest-pod-37431827 in agent 10.0.0.65
2025-04-18 11:11:25,867 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=17b9b136-7f26-4dd6-8ee6-5770c0297c80
2025-04-18 11:11:25,873 - INFO - Pod ctest-pod-37431827 with uuid 17b9b136-7f26-4dd6-8ee6-5770c0297c80 found in kube manager
2025-04-18 11:11:25,873 - INFO - Pod ctest-pod-37431827 verification passed
2025-04-18 11:11:25,879 - DEBUG - Pod ctest-pod-30162102 not in running state.Currently in Pending
2025-04-18 11:11:30,887 - INFO - Pod ctest-pod-30162102 is in running state.Got IP 10.47.255.250
2025-04-18 11:11:30,906 - DEBUG - Pod ctest-pod-30162102 has vmi daf1fc74-1c45-11f0-8bb8-fa163e1de319
2025-04-18 11:11:30,906 - INFO - Verified pod ctest-pod-30162102 in contrail-api
2025-04-18 11:11:30,920 - DEBUG - VMI daf1fc74-1c45-11f0-8bb8-fa163e1de319 is active in agent 10.0.0.65
2025-04-18 11:11:30,920 - INFO - Verified Pod ctest-pod-30162102 in agent 10.0.0.65
2025-04-18 11:11:30,921 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=e019af1b-76a6-45be-af40-da10c4ca1288
2025-04-18 11:11:30,926 - INFO - Pod ctest-pod-30162102 with uuid e019af1b-76a6-45be-af40-da10c4ca1288 found in kube manager
2025-04-18 11:11:30,926 - INFO - Pod ctest-pod-30162102 verification passed
2025-04-18 11:11:30,932 - INFO - Pod ctest-pod-31619838 is in running state.Got IP 10.47.255.249
2025-04-18 11:11:30,994 - DEBUG - Pod ctest-pod-31619838 has vmi dbc927f8-1c45-11f0-8bb8-fa163e1de319
2025-04-18 11:11:30,994 - INFO - Verified pod ctest-pod-31619838 in contrail-api
2025-04-18 11:11:31,006 - DEBUG - VMI dbc927f8-1c45-11f0-8bb8-fa163e1de319 is active in agent 10.0.0.65
2025-04-18 11:11:31,007 - INFO - Verified Pod ctest-pod-31619838 in agent 10.0.0.65
2025-04-18 11:11:31,007 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=1406e2c0-d447-4994-b28e-2b381ae80d94
2025-04-18 11:11:31,012 - INFO - Pod ctest-pod-31619838 with uuid 1406e2c0-d447-4994-b28e-2b381ae80d94 found in kube manager
2025-04-18 11:11:31,012 - INFO - Pod ctest-pod-31619838 verification passed
2025-04-18 11:11:31,019 - DEBUG - Pod ctest-pod-64022992 not in running state.Currently in Pending
2025-04-18 11:11:36,027 - INFO - Pod ctest-pod-64022992 is in running state.Got IP 10.47.255.248
2025-04-18 11:11:36,045 - DEBUG - Pod ctest-pod-64022992 has vmi dc54cd08-1c45-11f0-8bb8-fa163e1de319
2025-04-18 11:11:36,045 - INFO - Verified pod ctest-pod-64022992 in contrail-api
2025-04-18 11:11:36,062 - DEBUG - VMI dc54cd08-1c45-11f0-8bb8-fa163e1de319 is active in agent 10.0.0.65
2025-04-18 11:11:36,062 - INFO - Verified Pod ctest-pod-64022992 in agent 10.0.0.65
2025-04-18 11:11:36,062 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=cdf73132-c7aa-475f-962e-19ec15359349
2025-04-18 11:11:36,068 - INFO - Pod ctest-pod-64022992 with uuid cdf73132-c7aa-475f-962e-19ec15359349 found in kube manager
2025-04-18 11:11:36,068 - INFO - Pod ctest-pod-64022992 verification passed
2025-04-18 11:11:36,074 - INFO - Pod ctest-pod-08927505 is in running state.Got IP 10.47.255.247
2025-04-18 11:11:36,130 - DEBUG - Pod ctest-pod-08927505 has vmi dcf4cdbc-1c45-11f0-8bb8-fa163e1de319
2025-04-18 11:11:36,130 - INFO - Verified pod ctest-pod-08927505 in contrail-api
2025-04-18 11:11:36,146 - DEBUG - VMI dcf4cdbc-1c45-11f0-8bb8-fa163e1de319 is active in agent 10.0.0.65
2025-04-18 11:11:36,146 - INFO - Verified Pod ctest-pod-08927505 in agent 10.0.0.65
2025-04-18 11:11:36,146 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=ba5b22c0-4d3e-4dd0-ad05-638b63eb30ea
2025-04-18 11:11:36,151 - INFO - Pod ctest-pod-08927505 with uuid ba5b22c0-4d3e-4dd0-ad05-638b63eb30ea found in kube manager
2025-04-18 11:11:36,152 - INFO - Pod ctest-pod-08927505 verification passed
2025-04-18 11:11:36,158 - INFO - Pod ctest-pod-70081496 is in running state.Got IP 10.47.255.245
2025-04-18 11:11:36,192 - DEBUG - Pod ctest-pod-70081496 has vmi de272324-1c45-11f0-8bb8-fa163e1de319
2025-04-18 11:11:36,193 - INFO - Verified pod ctest-pod-70081496 in contrail-api
2025-04-18 11:11:36,207 - DEBUG - VMI de272324-1c45-11f0-8bb8-fa163e1de319 is active in agent 10.0.0.65
2025-04-18 11:11:36,208 - INFO - Verified Pod ctest-pod-70081496 in agent 10.0.0.65
2025-04-18 11:11:36,208 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=ec64084f-2585-4d3e-856b-47a3cde9ce10
2025-04-18 11:11:36,213 - INFO - Pod ctest-pod-70081496 with uuid ec64084f-2585-4d3e-856b-47a3cde9ce10 found in kube manager
2025-04-18 11:11:36,213 - INFO - Pod ctest-pod-70081496 verification passed
2025-04-18 11:11:36,304 - INFO - Pod ctest-pod-37550160 is in running state.Got IP 10.47.255.246
2025-04-18 11:11:36,370 - DEBUG - Pod ctest-pod-37550160 has vmi dd8c9e3a-1c45-11f0-8bb8-fa163e1de319
2025-04-18 11:11:36,370 - INFO - Verified pod ctest-pod-37550160 in contrail-api
2025-04-18 11:11:36,386 - DEBUG - VMI dd8c9e3a-1c45-11f0-8bb8-fa163e1de319 is active in agent 10.0.0.65
2025-04-18 11:11:36,386 - INFO - Verified Pod ctest-pod-37550160 in agent 10.0.0.65
2025-04-18 11:11:36,386 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=277f7d7d-3487-49d6-b65c-22bae1363cb1
2025-04-18 11:11:36,392 - INFO - Pod ctest-pod-37550160 with uuid 277f7d7d-3487-49d6-b65c-22bae1363cb1 found in kube manager
2025-04-18 11:11:36,393 - INFO - Pod ctest-pod-37550160 verification passed
2025-04-18 11:11:36,400 - INFO - Pod ctest-pod-13713304 is in running state.Got IP 10.47.255.244
2025-04-18 11:11:36,420 - DEBUG - Pod ctest-pod-13713304 has vmi dea8e116-1c45-11f0-8bb8-fa163e1de319
2025-04-18 11:11:36,420 - INFO - Verified pod ctest-pod-13713304 in contrail-api
2025-04-18 11:11:36,438 - DEBUG - VMI dea8e116-1c45-11f0-8bb8-fa163e1de319 is active in agent 10.0.0.65
2025-04-18 11:11:36,438 - INFO - Verified Pod ctest-pod-13713304 in agent 10.0.0.65
2025-04-18 11:11:36,438 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=adc15d1b-438d-48d5-a04d-190afb2701cf
2025-04-18 11:11:36,444 - INFO - Pod ctest-pod-13713304 with uuid adc15d1b-438d-48d5-a04d-190afb2701cf found in kube manager
2025-04-18 11:11:36,444 - INFO - Pod ctest-pod-13713304 verification passed
2025-04-18 11:11:36,445 - INFO - ================================================================================
2025-04-18 11:11:36,445 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-04-18 11:11:36,445 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-04-18 11:11:36,694 - DEBUG - Nothing to compare xmpp stats {'10.0.0.65': {'10.0.0.48': '0'}} with
2025-04-18 11:11:36,694 - INFO - Initial checks done. Running the testcase now
2025-04-18 11:11:36,694 - INFO -
2025-04-18 11:11:36,759 - DEBUG - [Pod ctest-pod-37431827] Cmd: echo ctest-pod-37431827 > /usr/share/nginx/html/index.html, Output:
2025-04-18 11:11:36,815 - DEBUG - [Pod ctest-pod-30162102] Cmd: echo ctest-pod-30162102 > /usr/share/nginx/html/index.html, Output:
2025-04-18 11:11:36,873 - DEBUG - [Pod ctest-pod-31619838] Cmd: echo ctest-pod-31619838 > /usr/share/nginx/html/index.html, Output:
2025-04-18 11:11:36,933 - DEBUG - [Pod ctest-pod-64022992] Cmd: echo ctest-pod-64022992 > /usr/share/nginx/html/index.html, Output:
2025-04-18 11:11:36,937 - DEBUG - Service ctest-nginx-svc-88279146 not present
2025-04-18 11:11:36,937 - INFO - Creating service ctest-nginx-svc-88279146
2025-04-18 11:11:36,984 - INFO - Created Service ctest-nginx-svc-88279146
2025-04-18 11:11:36,997 - WARNING - Service UUID 71dda717-c0f8-41c8-beeb-6991d817e111 not yet found in contrail-api
2025-04-18 11:11:38,012 - INFO - Validated that Service ctest-nginx-svc-88279146 is seen in contrail-api
2025-04-18 11:11:38,012 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_LoadbalancerDatabaseList?x=71dda717-c0f8-41c8-beeb-6991d817e111
2025-04-18 11:11:38,019 - INFO - Service ctest-nginx-svc-88279146 with uuid 71dda717-c0f8-41c8-beeb-6991d817e111 found in kube manager
2025-04-18 11:11:38,019 - INFO - Service ctest-nginx-svc-88279146 verification passed
2025-04-18 11:11:39,090 - DEBUG - [Pod ctest-pod-08927505] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-37431827
2025-04-18 11:11:39,090 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 passed
2025-04-18 11:11:39,090 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-37431827
2025-04-18 11:11:39,150 - DEBUG - [Pod ctest-pod-08927505] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: ctest-pod-37431827
Connecting to 10.99.132.245:80 (10.99.132.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-18 11:11:39,150 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 passed
2025-04-18 11:11:39,150 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd output: ctest-pod-37431827
Connecting to 10.99.132.245:80 (10.99.132.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-18 11:11:39,200 - DEBUG - [Pod ctest-pod-08927505] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-30162102
2025-04-18 11:11:39,200 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 passed
2025-04-18 11:11:39,200 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-30162102
2025-04-18 11:11:39,200 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-37431827': 2, 'ctest-pod-30162102': 1}
2025-04-18 11:11:39,256 - DEBUG - [Pod ctest-pod-70081496] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: ctest-pod-37431827
Connecting to 10.99.132.245:80 (10.99.132.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-18 11:11:39,256 - DEBUG - [Pod Pod ctest-pod-70081496] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 passed
2025-04-18 11:11:39,256 - DEBUG - [Pod Pod ctest-pod-70081496] Cmd output: ctest-pod-37431827
Connecting to 10.99.132.245:80 (10.99.132.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-18 11:11:39,308 - DEBUG - [Pod ctest-pod-70081496] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-30162102
2025-04-18 11:11:39,308 - DEBUG - [Pod Pod ctest-pod-70081496] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 passed
2025-04-18 11:11:39,308 - DEBUG - [Pod Pod ctest-pod-70081496] Cmd output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-30162102
2025-04-18 11:11:39,309 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-37431827': 1, 'ctest-pod-30162102': 1}
2025-04-18 11:11:39,312 - DEBUG - Network policy ingress-on-service not present
2025-04-18 11:11:39,313 - INFO - Creating Network Policy ingress-on-service
2025-04-18 11:11:39,325 - INFO - Network policy found in k8s
2025-04-18 11:11:39,325 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=fd6689b3-894b-4ad4-a125-64f4c662ff85
2025-04-18 11:11:39,334 - INFO - Network Policy ingress-on-service with uuid fd6689b3-894b-4ad4-a125-64f4c662ff85 found in kube manager
2025-04-18 11:11:39,372 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-04-18 11:11:39,373 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-04-18 11:11:39,373 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=fd6689b3-894b-4ad4-a125-64f4c662ff85
2025-04-18 11:11:39,406 - WARNING - Network policy with name ingress-on-service not found in agent
2025-04-18 11:11:41,407 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=fd6689b3-894b-4ad4-a125-64f4c662ff85
2025-04-18 11:11:41,445 - INFO - Network policy with name ingress-on-service found in agent
2025-04-18 11:11:41,445 - INFO - Network Policy ingress-on-service verification passed
2025-04-18 11:11:46,510 - DEBUG - [Pod ctest-pod-08927505] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:11:46,510 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:11:46,510 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:11:51,567 - DEBUG - [Pod ctest-pod-08927505] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:11:51,567 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:11:51,567 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:11:56,639 - DEBUG - [Pod ctest-pod-08927505] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:11:56,639 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:11:56,639 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:12:01,697 - DEBUG - [Pod ctest-pod-08927505] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:12:01,697 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:12:01,698 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:12:06,751 - DEBUG - [Pod ctest-pod-08927505] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:12:06,752 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:12:06,752 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:12:11,806 - DEBUG - [Pod ctest-pod-08927505] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:12:11,806 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:12:11,806 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:12:16,862 - DEBUG - [Pod ctest-pod-08927505] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:12:16,862 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:12:16,863 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:12:21,918 - DEBUG - [Pod ctest-pod-08927505] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:12:21,918 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:12:21,918 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:12:26,980 - DEBUG - [Pod ctest-pod-08927505] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:12:26,980 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:12:26,980 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:12:32,033 - DEBUG - [Pod ctest-pod-08927505] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:12:32,033 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:12:32,033 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:12:32,033 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-37431827': 0, 'ctest-pod-30162102': 0}
2025-04-18 11:12:32,096 - DEBUG - [Pod ctest-pod-37550160] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: ctest-pod-30162102
Connecting to 10.99.132.245:80 (10.99.132.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-18 11:12:32,096 - DEBUG - [Pod Pod ctest-pod-37550160] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 passed
2025-04-18 11:12:32,096 - DEBUG - [Pod Pod ctest-pod-37550160] Cmd output: ctest-pod-30162102
Connecting to 10.99.132.245:80 (10.99.132.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-18 11:12:32,150 - DEBUG - [Pod ctest-pod-37550160] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: ctest-pod-37431827
Connecting to 10.99.132.245:80 (10.99.132.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-18 11:12:32,150 - DEBUG - [Pod Pod ctest-pod-37550160] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 passed
2025-04-18 11:12:32,150 - DEBUG - [Pod Pod ctest-pod-37550160] Cmd output: ctest-pod-37431827
Connecting to 10.99.132.245:80 (10.99.132.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-18 11:12:32,150 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-37431827': 1, 'ctest-pod-30162102': 1}
2025-04-18 11:12:37,206 - DEBUG - [Pod ctest-pod-70081496] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:12:37,206 - DEBUG - [Pod Pod ctest-pod-70081496] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:12:37,206 - DEBUG - [Pod Pod ctest-pod-70081496] Cmd output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:12:42,262 - DEBUG - [Pod ctest-pod-70081496] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:12:42,262 - DEBUG - [Pod Pod ctest-pod-70081496] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:12:42,262 - DEBUG - [Pod Pod ctest-pod-70081496] Cmd output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:12:47,325 - DEBUG - [Pod ctest-pod-70081496] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:12:47,325 - DEBUG - [Pod Pod ctest-pod-70081496] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:12:47,325 - DEBUG - [Pod Pod ctest-pod-70081496] Cmd output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:12:52,490 - DEBUG - [Pod ctest-pod-70081496] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:12:52,490 - DEBUG - [Pod Pod ctest-pod-70081496] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:12:52,490 - DEBUG - [Pod Pod ctest-pod-70081496] Cmd output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:12:57,563 - DEBUG - [Pod ctest-pod-70081496] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:12:57,563 - DEBUG - [Pod Pod ctest-pod-70081496] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:12:57,563 - DEBUG - [Pod Pod ctest-pod-70081496] Cmd output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:13:02,619 - DEBUG - [Pod ctest-pod-70081496] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:13:02,619 - DEBUG - [Pod Pod ctest-pod-70081496] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:13:02,619 - DEBUG - [Pod Pod ctest-pod-70081496] Cmd output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:13:07,690 - DEBUG - [Pod ctest-pod-70081496] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:13:07,690 - DEBUG - [Pod Pod ctest-pod-70081496] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:13:07,690 - DEBUG - [Pod Pod ctest-pod-70081496] Cmd output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:13:12,750 - DEBUG - [Pod ctest-pod-70081496] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:13:12,750 - DEBUG - [Pod Pod ctest-pod-70081496] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:13:12,750 - DEBUG - [Pod Pod ctest-pod-70081496] Cmd output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:13:17,810 - DEBUG - [Pod ctest-pod-70081496] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:13:17,810 - DEBUG - [Pod Pod ctest-pod-70081496] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:13:17,810 - DEBUG - [Pod Pod ctest-pod-70081496] Cmd output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:13:22,865 - DEBUG - [Pod ctest-pod-70081496] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:13:22,865 - DEBUG - [Pod Pod ctest-pod-70081496] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:13:22,865 - DEBUG - [Pod Pod ctest-pod-70081496] Cmd output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:13:22,865 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-37431827': 0, 'ctest-pod-30162102': 0}
2025-04-18 11:13:24,914 - DEBUG - [Pod ctest-pod-37550160] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.734 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.078 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.080 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.078/0.297/0.734 ms
2025-04-18 11:13:24,915 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-37550160 with expectation True passed
2025-04-18 11:13:26,972 - DEBUG - [Pod ctest-pod-08927505] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.561 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.100 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.087 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.087/0.582/1.561 ms
2025-04-18 11:13:26,972 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-08927505 with expectation True passed
2025-04-18 11:13:29,028 - DEBUG - [Pod ctest-pod-70081496] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.607 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.079 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.092 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.079/0.592/1.607 ms
2025-04-18 11:13:29,028 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-70081496 with expectation True passed
2025-04-18 11:13:29,086 - DEBUG - [Pod ctest-pod-37550160] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-18 11:13:29,086 - DEBUG - [Pod Pod ctest-pod-37550160] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-04-18 11:13:29,086 - DEBUG - [Pod Pod ctest-pod-37550160] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-18 11:13:29,086 - INFO - wget check of of http://10.47.255.251 from ctest-pod-37550160 passed
2025-04-18 11:13:29,141 - DEBUG - [Pod ctest-pod-37550160] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-18 11:13:29,141 - DEBUG - [Pod Pod ctest-pod-37550160] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-04-18 11:13:29,141 - DEBUG - [Pod Pod ctest-pod-37550160] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-18 11:13:29,141 - INFO - wget check of of http://10.47.255.250 from ctest-pod-37550160 passed
2025-04-18 11:13:31,030 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2025-04-18 11:13:41,104 - DEBUG - [Pod ctest-pod-08927505] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-18 11:13:41,104 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-18 11:13:41,104 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-18 11:13:41,104 - INFO - wget check of of http://10.47.255.250 from ctest-pod-08927505 passed
2025-04-18 11:13:46,165 - DEBUG - [Pod ctest-pod-13713304] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-04-18 11:13:46,165 - DEBUG - [Pod Pod ctest-pod-13713304] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-04-18 11:13:46,165 - DEBUG - [Pod Pod ctest-pod-13713304] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-04-18 11:13:46,165 - INFO - wget check of of http://10.47.255.251 from ctest-pod-13713304 passed
2025-04-18 11:13:46,175 - INFO - Updating Network Policy ingress-on-service
2025-04-18 11:13:51,246 - DEBUG - [Pod ctest-pod-08927505] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:13:51,246 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:13:51,246 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:13:56,302 - DEBUG - [Pod ctest-pod-08927505] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:13:56,302 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:13:56,302 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:14:01,366 - DEBUG - [Pod ctest-pod-08927505] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:14:01,366 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:14:01,366 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:14:06,427 - DEBUG - [Pod ctest-pod-08927505] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:14:06,427 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:14:06,427 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:14:11,483 - DEBUG - [Pod ctest-pod-08927505] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:14:11,483 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:14:11,483 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:14:16,538 - DEBUG - [Pod ctest-pod-08927505] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:14:16,538 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:14:16,538 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:14:21,590 - DEBUG - [Pod ctest-pod-08927505] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:14:21,590 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:14:21,590 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:14:26,661 - DEBUG - [Pod ctest-pod-08927505] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:14:26,661 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:14:26,661 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:14:31,720 - DEBUG - [Pod ctest-pod-08927505] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:14:31,720 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:14:31,720 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:14:36,774 - DEBUG - [Pod ctest-pod-08927505] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:14:36,774 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:14:36,774 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
wget: download timed out
2025-04-18 11:14:36,774 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-37431827': 0, 'ctest-pod-30162102': 0}
2025-04-18 11:14:36,832 - DEBUG - [Pod ctest-pod-37550160] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: ctest-pod-37431827
Connecting to 10.99.132.245:80 (10.99.132.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-18 11:14:36,832 - DEBUG - [Pod Pod ctest-pod-37550160] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 passed
2025-04-18 11:14:36,833 - DEBUG - [Pod Pod ctest-pod-37550160] Cmd output: ctest-pod-37431827
Connecting to 10.99.132.245:80 (10.99.132.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-18 11:14:36,889 - DEBUG - [Pod ctest-pod-37550160] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: ctest-pod-37431827
Connecting to 10.99.132.245:80 (10.99.132.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-18 11:14:36,889 - DEBUG - [Pod Pod ctest-pod-37550160] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 passed
2025-04-18 11:14:36,889 - DEBUG - [Pod Pod ctest-pod-37550160] Cmd output: ctest-pod-37431827
Connecting to 10.99.132.245:80 (10.99.132.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-18 11:14:36,954 - DEBUG - [Pod ctest-pod-37550160] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: ctest-pod-37431827
Connecting to 10.99.132.245:80 (10.99.132.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-18 11:14:36,954 - DEBUG - [Pod Pod ctest-pod-37550160] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 passed
2025-04-18 11:14:36,954 - DEBUG - [Pod Pod ctest-pod-37550160] Cmd output: ctest-pod-37431827
Connecting to 10.99.132.245:80 (10.99.132.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-18 11:14:37,010 - DEBUG - [Pod ctest-pod-37550160] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: ctest-pod-37431827
Connecting to 10.99.132.245:80 (10.99.132.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-18 11:14:37,010 - DEBUG - [Pod Pod ctest-pod-37550160] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 passed
2025-04-18 11:14:37,010 - DEBUG - [Pod Pod ctest-pod-37550160] Cmd output: ctest-pod-37431827
Connecting to 10.99.132.245:80 (10.99.132.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-18 11:14:37,070 - DEBUG - [Pod ctest-pod-37550160] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: ctest-pod-37431827
Connecting to 10.99.132.245:80 (10.99.132.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-18 11:14:37,071 - DEBUG - [Pod Pod ctest-pod-37550160] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 passed
2025-04-18 11:14:37,071 - DEBUG - [Pod Pod ctest-pod-37550160] Cmd output: ctest-pod-37431827
Connecting to 10.99.132.245:80 (10.99.132.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-18 11:14:37,135 - DEBUG - [Pod ctest-pod-37550160] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: ctest-pod-37431827
Connecting to 10.99.132.245:80 (10.99.132.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-18 11:14:37,135 - DEBUG - [Pod Pod ctest-pod-37550160] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 passed
2025-04-18 11:14:37,135 - DEBUG - [Pod Pod ctest-pod-37550160] Cmd output: ctest-pod-37431827
Connecting to 10.99.132.245:80 (10.99.132.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-18 11:14:37,199 - DEBUG - [Pod ctest-pod-37550160] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: ctest-pod-37431827
Connecting to 10.99.132.245:80 (10.99.132.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-18 11:14:37,199 - DEBUG - [Pod Pod ctest-pod-37550160] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 passed
2025-04-18 11:14:37,199 - DEBUG - [Pod Pod ctest-pod-37550160] Cmd output: ctest-pod-37431827
Connecting to 10.99.132.245:80 (10.99.132.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-18 11:14:37,251 - DEBUG - [Pod ctest-pod-37550160] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-37431827
2025-04-18 11:14:37,251 - DEBUG - [Pod Pod ctest-pod-37550160] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 passed
2025-04-18 11:14:37,251 - DEBUG - [Pod Pod ctest-pod-37550160] Cmd output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-37431827
2025-04-18 11:14:37,318 - DEBUG - [Pod ctest-pod-37550160] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: ctest-pod-30162102
Connecting to 10.99.132.245:80 (10.99.132.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-18 11:14:37,319 - DEBUG - [Pod Pod ctest-pod-37550160] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 passed
2025-04-18 11:14:37,319 - DEBUG - [Pod Pod ctest-pod-37550160] Cmd output: ctest-pod-30162102
Connecting to 10.99.132.245:80 (10.99.132.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-18 11:14:37,319 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-37431827': 8, 'ctest-pod-30162102': 1}
2025-04-18 11:14:37,387 - DEBUG - [Pod ctest-pod-70081496] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: ctest-pod-37431827
Connecting to 10.99.132.245:80 (10.99.132.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-18 11:14:37,387 - DEBUG - [Pod Pod ctest-pod-70081496] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 passed
2025-04-18 11:14:37,387 - DEBUG - [Pod Pod ctest-pod-70081496] Cmd output: ctest-pod-37431827
Connecting to 10.99.132.245:80 (10.99.132.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-18 11:14:37,451 - DEBUG - [Pod ctest-pod-70081496] Cmd: wget http://10.99.132.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-30162102
2025-04-18 11:14:37,451 - DEBUG - [Pod Pod ctest-pod-70081496] Cmd wget http://10.99.132.245:80/ -O - -T 5 -t 1 passed
2025-04-18 11:14:37,451 - DEBUG - [Pod Pod ctest-pod-70081496] Cmd output: Connecting to 10.99.132.245:80 (10.99.132.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-30162102
2025-04-18 11:14:37,451 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-37431827': 1, 'ctest-pod-30162102': 1}
2025-04-18 11:14:39,511 - DEBUG - [Pod ctest-pod-37550160] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.564 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.092 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.109 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.092/0.255/0.564 ms
2025-04-18 11:14:39,511 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-37550160 with expectation True passed
2025-04-18 11:14:41,572 - DEBUG - [Pod ctest-pod-08927505] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.163 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.083 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.091 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.083/0.445/1.163 ms
2025-04-18 11:14:41,572 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-08927505 with expectation True passed
2025-04-18 11:14:43,636 - DEBUG - [Pod ctest-pod-70081496] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.873 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.080 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.100 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.080/0.351/0.873 ms
2025-04-18 11:14:43,636 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-70081496 with expectation True passed
2025-04-18 11:14:43,691 - DEBUG - [Pod ctest-pod-37550160] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-18 11:14:43,691 - DEBUG - [Pod Pod ctest-pod-37550160] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-04-18 11:14:43,691 - DEBUG - [Pod Pod ctest-pod-37550160] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-18 11:14:43,691 - INFO - wget check of of http://10.47.255.251 from ctest-pod-37550160 passed
2025-04-18 11:14:43,752 - DEBUG - [Pod ctest-pod-37550160] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-18 11:14:43,752 - DEBUG - [Pod Pod ctest-pod-37550160] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-04-18 11:14:43,752 - DEBUG - [Pod Pod ctest-pod-37550160] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-18 11:14:43,752 - INFO - wget check of of http://10.47.255.250 from ctest-pod-37550160 passed
2025-04-18 11:14:48,802 - DEBUG - [Pod ctest-pod-08927505] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-18 11:14:48,802 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-18 11:14:48,802 - DEBUG - [Pod Pod ctest-pod-08927505] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-18 11:14:48,802 - INFO - wget check of of http://10.47.255.250 from ctest-pod-08927505 passed
2025-04-18 11:14:48,869 - DEBUG - [Pod ctest-pod-13713304] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-18 11:14:48,869 - DEBUG - [Pod Pod ctest-pod-13713304] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-04-18 11:14:48,869 - DEBUG - [Pod Pod ctest-pod-13713304] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-18 11:14:48,869 - INFO - wget check of of http://10.47.255.251 from ctest-pod-13713304 passed
2025-04-18 11:14:48,878 - INFO - Deleting Network Policy : ingress-on-service
2025-04-18 11:14:48,879 - INFO - Deleting service : ctest-nginx-svc-88279146
2025-04-18 11:14:49,144 - DEBUG - No XMPP flaps were noticed during the test
2025-04-18 11:14:49,144 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:13]
2025-04-18 11:14:49,144 - INFO - --------------------------------------------------------------------------------
2025-04-18 11:14:49,151 - INFO - Deleting pod ctest-new-default-46341287:ctest-pod-37431827
2025-04-18 11:14:49,151 - INFO - Deleting pod ctest-new-default-46341287:ctest-pod-30162102
2025-04-18 11:14:49,152 - INFO - Deleting pod ctest-non-default-28822133:ctest-pod-31619838
2025-04-18 11:14:49,152 - INFO - Deleting pod ctest-non-default-28822133:ctest-pod-64022992
2025-04-18 11:14:49,152 - INFO - Deleting pod ctest-new-default-46341287:ctest-pod-08927505
2025-04-18 11:14:49,153 - INFO - Deleting pod ctest-new-default-46341287:ctest-pod-37550160
2025-04-18 11:14:49,153 - INFO - Deleting pod ctest-non-default-28822133:ctest-pod-70081496
2025-04-18 11:14:49,153 - INFO - Deleting pod ctest-non-default-28822133:ctest-pod-13713304
2025-04-18 11:14:49,277 - WARNING - Pod uuid adc15d1b-438d-48d5-a04d-190afb2701cf is still seen in agent 10.0.0.65 VM list
2025-04-18 11:14:49,278 - WARNING - Pod uuid 17b9b136-7f26-4dd6-8ee6-5770c0297c80 is still seen in agent 10.0.0.65 VM list
2025-04-18 11:14:49,337 - WARNING - Pod uuid ec64084f-2585-4d3e-856b-47a3cde9ce10 is still seen in agent 10.0.0.65 VM list
2025-04-18 11:14:49,339 - WARNING - Pod uuid 1406e2c0-d447-4994-b28e-2b381ae80d94 is still seen in agent 10.0.0.65 VM list
2025-04-18 11:14:49,340 - WARNING - Pod uuid cdf73132-c7aa-475f-962e-19ec15359349 is still seen in agent 10.0.0.65 VM list
2025-04-18 11:14:49,340 - WARNING - Pod uuid e019af1b-76a6-45be-af40-da10c4ca1288 is still seen in agent 10.0.0.65 VM list
2025-04-18 11:14:49,341 - WARNING - Pod uuid ba5b22c0-4d3e-4dd0-ad05-638b63eb30ea is still seen in agent 10.0.0.65 VM list
2025-04-18 11:14:49,341 - WARNING - Pod uuid 277f7d7d-3487-49d6-b65c-22bae1363cb1 is still seen in agent 10.0.0.65 VM list
2025-04-18 11:14:54,292 - WARNING - Pod uuid 17b9b136-7f26-4dd6-8ee6-5770c0297c80 is still seen in agent 10.0.0.65 VM list
2025-04-18 11:14:54,294 - WARNING - Pod uuid adc15d1b-438d-48d5-a04d-190afb2701cf is still seen in agent 10.0.0.65 VM list
2025-04-18 11:14:54,368 - WARNING - Pod uuid ba5b22c0-4d3e-4dd0-ad05-638b63eb30ea is still seen in agent 10.0.0.65 VM list
2025-04-18 11:14:54,369 - DEBUG - Pod 1406e2c0-d447-4994-b28e-2b381ae80d94 is not in agent 10.0.0.65 VM list
2025-04-18 11:14:54,372 - WARNING - Pod uuid ec64084f-2585-4d3e-856b-47a3cde9ce10 is still seen in agent 10.0.0.65 VM list
2025-04-18 11:14:54,372 - DEBUG - Pod cdf73132-c7aa-475f-962e-19ec15359349 is not in agent 10.0.0.65 VM list
2025-04-18 11:14:54,377 - DEBUG - Pod e019af1b-76a6-45be-af40-da10c4ca1288 is not in agent 10.0.0.65 VM list
2025-04-18 11:14:54,379 - WARNING - Pod uuid 277f7d7d-3487-49d6-b65c-22bae1363cb1 is still seen in agent 10.0.0.65 VM list
2025-04-18 11:14:54,392 - DEBUG - VMI dbc927f8-1c45-11f0-8bb8-fa163e1de319 is removed from agent 10.0.0.65
2025-04-18 11:14:54,393 - INFO - Verified that pod ctest-pod-31619838 is removed in agent
2025-04-18 11:14:54,395 - DEBUG - VMI dc54cd08-1c45-11f0-8bb8-fa163e1de319 is removed from agent 10.0.0.65
2025-04-18 11:14:54,395 - INFO - Verified that pod ctest-pod-64022992 is removed in agent
2025-04-18 11:14:54,395 - DEBUG - VMI daf1fc74-1c45-11f0-8bb8-fa163e1de319 is removed from agent 10.0.0.65
2025-04-18 11:14:54,395 - INFO - Verified that pod ctest-pod-30162102 is removed in agent
2025-04-18 11:14:59,307 - WARNING - Pod uuid 17b9b136-7f26-4dd6-8ee6-5770c0297c80 is still seen in agent 10.0.0.65 VM list
2025-04-18 11:14:59,307 - WARNING - Pod uuid adc15d1b-438d-48d5-a04d-190afb2701cf is still seen in agent 10.0.0.65 VM list
2025-04-18 11:14:59,380 - WARNING - Pod uuid ba5b22c0-4d3e-4dd0-ad05-638b63eb30ea is still seen in agent 10.0.0.65 VM list
2025-04-18 11:14:59,383 - WARNING - Pod uuid ec64084f-2585-4d3e-856b-47a3cde9ce10 is still seen in agent 10.0.0.65 VM list
2025-04-18 11:14:59,387 - WARNING - Pod uuid 277f7d7d-3487-49d6-b65c-22bae1363cb1 is still seen in agent 10.0.0.65 VM list
2025-04-18 11:15:04,321 - WARNING - Pod uuid adc15d1b-438d-48d5-a04d-190afb2701cf is still seen in agent 10.0.0.65 VM list
2025-04-18 11:15:04,321 - WARNING - Pod uuid 17b9b136-7f26-4dd6-8ee6-5770c0297c80 is still seen in agent 10.0.0.65 VM list
2025-04-18 11:15:04,398 - WARNING - Pod uuid ec64084f-2585-4d3e-856b-47a3cde9ce10 is still seen in agent 10.0.0.65 VM list
2025-04-18 11:15:04,399 - WARNING - Pod uuid ba5b22c0-4d3e-4dd0-ad05-638b63eb30ea is still seen in agent 10.0.0.65 VM list
2025-04-18 11:15:04,400 - WARNING - Pod uuid 277f7d7d-3487-49d6-b65c-22bae1363cb1 is still seen in agent 10.0.0.65 VM list
2025-04-18 11:15:09,334 - WARNING - Pod uuid 17b9b136-7f26-4dd6-8ee6-5770c0297c80 is still seen in agent 10.0.0.65 VM list
2025-04-18 11:15:09,336 - WARNING - Pod uuid adc15d1b-438d-48d5-a04d-190afb2701cf is still seen in agent 10.0.0.65 VM list
2025-04-18 11:15:09,415 - WARNING - Pod uuid ec64084f-2585-4d3e-856b-47a3cde9ce10 is still seen in agent 10.0.0.65 VM list
2025-04-18 11:15:09,417 - WARNING - Pod uuid 277f7d7d-3487-49d6-b65c-22bae1363cb1 is still seen in agent 10.0.0.65 VM list
2025-04-18 11:15:09,418 - WARNING - Pod uuid ba5b22c0-4d3e-4dd0-ad05-638b63eb30ea is still seen in agent 10.0.0.65 VM list
2025-04-18 11:15:14,349 - WARNING - Pod uuid adc15d1b-438d-48d5-a04d-190afb2701cf is still seen in agent 10.0.0.65 VM list
2025-04-18 11:15:14,351 - WARNING - Pod uuid 17b9b136-7f26-4dd6-8ee6-5770c0297c80 is still seen in agent 10.0.0.65 VM list
2025-04-18 11:15:14,435 - WARNING - Pod uuid ba5b22c0-4d3e-4dd0-ad05-638b63eb30ea is still seen in agent 10.0.0.65 VM list
2025-04-18 11:15:14,437 - WARNING - Pod uuid ec64084f-2585-4d3e-856b-47a3cde9ce10 is still seen in agent 10.0.0.65 VM list
2025-04-18 11:15:14,437 - WARNING - Pod uuid 277f7d7d-3487-49d6-b65c-22bae1363cb1 is still seen in agent 10.0.0.65 VM list
2025-04-18 11:15:19,364 - WARNING - Pod uuid 17b9b136-7f26-4dd6-8ee6-5770c0297c80 is still seen in agent 10.0.0.65 VM list
2025-04-18 11:15:19,365 - WARNING - Pod uuid adc15d1b-438d-48d5-a04d-190afb2701cf is still seen in agent 10.0.0.65 VM list
2025-04-18 11:15:19,500 - WARNING - Pod uuid ba5b22c0-4d3e-4dd0-ad05-638b63eb30ea is still seen in agent 10.0.0.65 VM list
2025-04-18 11:15:19,502 - WARNING - Pod uuid ec64084f-2585-4d3e-856b-47a3cde9ce10 is still seen in agent 10.0.0.65 VM list
2025-04-18 11:15:19,503 - WARNING - Pod uuid 277f7d7d-3487-49d6-b65c-22bae1363cb1 is still seen in agent 10.0.0.65 VM list
2025-04-18 11:15:24,378 - DEBUG - Pod adc15d1b-438d-48d5-a04d-190afb2701cf is not in agent 10.0.0.65 VM list
2025-04-18 11:15:24,380 - DEBUG - Pod 17b9b136-7f26-4dd6-8ee6-5770c0297c80 is not in agent 10.0.0.65 VM list
2025-04-18 11:15:24,393 - DEBUG - VMI d9f579b8-1c45-11f0-8bb8-fa163e1de319 is removed from agent 10.0.0.65
2025-04-18 11:15:24,393 - INFO - Verified that pod ctest-pod-37431827 is removed in agent
2025-04-18 11:15:24,395 - DEBUG - VMI dea8e116-1c45-11f0-8bb8-fa163e1de319 is removed from agent 10.0.0.65
2025-04-18 11:15:24,395 - INFO - Verified that pod ctest-pod-13713304 is removed in agent
2025-04-18 11:15:24,522 - DEBUG - Pod 277f7d7d-3487-49d6-b65c-22bae1363cb1 is not in agent 10.0.0.65 VM list
2025-04-18 11:15:24,524 - DEBUG - Pod ba5b22c0-4d3e-4dd0-ad05-638b63eb30ea is not in agent 10.0.0.65 VM list
2025-04-18 11:15:24,528 - DEBUG - Pod ec64084f-2585-4d3e-856b-47a3cde9ce10 is not in agent 10.0.0.65 VM list
2025-04-18 11:15:24,539 - DEBUG - VMI dd8c9e3a-1c45-11f0-8bb8-fa163e1de319 is removed from agent 10.0.0.65
2025-04-18 11:15:24,539 - INFO - Verified that pod ctest-pod-37550160 is removed in agent
2025-04-18 11:15:24,541 - DEBUG - VMI de272324-1c45-11f0-8bb8-fa163e1de319 is removed from agent 10.0.0.65
2025-04-18 11:15:24,541 - INFO - Verified that pod ctest-pod-70081496 is removed in agent
2025-04-18 11:15:24,542 - DEBUG - VMI dcf4cdbc-1c45-11f0-8bb8-fa163e1de319 is removed from agent 10.0.0.65
2025-04-18 11:15:24,542 - INFO - Verified that pod ctest-pod-08927505 is removed in agent
2025-04-18 11:15:24,542 - INFO - Deleting namespace ctest-non-default-28822133
2025-04-18 11:15:24,561 - DEBUG - Namespace ctest-non-default-28822133 still in k8s
2025-04-18 11:15:26,567 - DEBUG - Namespace ctest-non-default-28822133 still in k8s
2025-04-18 11:15:28,573 - DEBUG - Namespace ctest-non-default-28822133 still in k8s
2025-04-18 11:15:30,577 - DEBUG - Namespace ctest-non-default-28822133 is not in k8s
2025-04-18 11:15:30,577 - DEBUG - No need to check project deletion in contrail-api
2025-04-18 11:15:30,577 - INFO - Deleting namespace ctest-new-default-46341287
2025-04-18 11:15:30,588 - DEBUG - Namespace ctest-new-default-46341287 still in k8s
2025-04-18 11:15:32,595 - DEBUG - Namespace ctest-new-default-46341287 still in k8s
2025-04-18 11:15:34,600 - DEBUG - Namespace ctest-new-default-46341287 still in k8s
2025-04-18 11:15:36,606 - DEBUG - Namespace ctest-new-default-46341287 is not in k8s
2025-04-18 11:15:36,606 - DEBUG - No need to check project deletion in contrail-api