2025-07-08 17:49:30,094 - INFO - Using existing project ['default-domain', 'k8s-default'](33f5294b-4432-456c-9128-a13df7b9adfa)
2025-07-08 17:49:30,116 - DEBUG - Namespace ctest-new-default-86557414 not present
2025-07-08 17:49:30,128 - INFO - Created namespace ctest-new-default-86557414
2025-07-08 17:49:33,133 - DEBUG - Namespace ctest-non-default-41209065 not present
2025-07-08 17:49:33,140 - INFO - Created namespace ctest-non-default-41209065
2025-07-08 17:49:36,159 - DEBUG - Pod ctest-pod-91264863 not present
2025-07-08 17:49:36,159 - INFO - Creating Pod ctest-pod-91264863
2025-07-08 17:49:36,176 - DEBUG - Pod : ctest-pod-91264863 UUID is c5590e0e-ab68-4922-9ff6-5dd943d1716a
2025-07-08 17:49:36,179 - DEBUG - Pod ctest-pod-61602057 not present
2025-07-08 17:49:36,179 - INFO - Creating Pod ctest-pod-61602057
2025-07-08 17:49:36,220 - DEBUG - Pod : ctest-pod-61602057 UUID is 8f541523-9f49-48ae-8237-c1b35c9ed593
2025-07-08 17:49:36,223 - DEBUG - Pod ctest-pod-89014126 not present
2025-07-08 17:49:36,223 - INFO - Creating Pod ctest-pod-89014126
2025-07-08 17:49:36,272 - DEBUG - Pod : ctest-pod-89014126 UUID is 9f625032-d942-47c8-9e81-7205d6b07438
2025-07-08 17:49:36,275 - DEBUG - Pod ctest-pod-30830625 not present
2025-07-08 17:49:36,275 - INFO - Creating Pod ctest-pod-30830625
2025-07-08 17:49:36,296 - DEBUG - Pod : ctest-pod-30830625 UUID is ddf77459-4ccc-4a98-bc1e-bf4db6f16f48
2025-07-08 17:49:36,298 - DEBUG - Pod ctest-pod-22152525 not present
2025-07-08 17:49:36,298 - INFO - Creating Pod ctest-pod-22152525
2025-07-08 17:49:36,320 - DEBUG - Pod : ctest-pod-22152525 UUID is cab674e5-5c58-4a12-9c06-b6d3268c4a53
2025-07-08 17:49:36,322 - DEBUG - Pod ctest-pod-72391870 not present
2025-07-08 17:49:36,323 - INFO - Creating Pod ctest-pod-72391870
2025-07-08 17:49:36,341 - DEBUG - Pod : ctest-pod-72391870 UUID is 0cea3104-3394-4f0f-bbe9-b2057a8e798e
2025-07-08 17:49:36,343 - DEBUG - Pod ctest-pod-51287701 not present
2025-07-08 17:49:36,343 - INFO - Creating Pod ctest-pod-51287701
2025-07-08 17:49:36,378 - DEBUG - Pod : ctest-pod-51287701 UUID is ebc882c9-3aa2-477d-a552-21dcc033e146
2025-07-08 17:49:36,380 - DEBUG - Pod ctest-pod-71525469 not present
2025-07-08 17:49:36,381 - INFO - Creating Pod ctest-pod-71525469
2025-07-08 17:49:36,395 - DEBUG - Node for Pod ctest-pod-71525469 not yet populated
2025-07-08 17:49:39,401 - DEBUG - Pod : ctest-pod-71525469 UUID is 048da35d-da9c-479d-b418-3dff3b7a71c6
2025-07-08 17:49:39,600 - INFO - Project default-domain:k8s-ctest-new-default-86557414 for Namespace ctest-new-default-86557414 is seen in contrail-api
2025-07-08 17:49:39,600 - DEBUG - Project uuid in Contrail is 7a7adeaf-33e7-46b1-8f1c-2ec85e0e913d
2025-07-08 17:49:39,780 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=e37e3561-4caa-45b8-ad42-afb47928084a
2025-07-08 17:49:39,809 - INFO - Namespace ctest-new-default-86557414 with uuid e37e3561-4caa-45b8-ad42-afb47928084a found in kube manager
2025-07-08 17:49:39,809 - INFO - Namespace ctest-new-default-86557414 verification passed
2025-07-08 17:49:39,994 - INFO - Project default-domain:k8s-ctest-non-default-41209065 for Namespace ctest-non-default-41209065 is seen in contrail-api
2025-07-08 17:49:39,994 - DEBUG - Project uuid in Contrail is e92519a7-5409-4381-8b9a-82983a2fef52
2025-07-08 17:49:39,995 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=f11b75c3-9f56-46a3-ba5f-4941b539bdbe
2025-07-08 17:49:39,999 - INFO - Namespace ctest-non-default-41209065 with uuid f11b75c3-9f56-46a3-ba5f-4941b539bdbe found in kube manager
2025-07-08 17:49:39,999 - INFO - Namespace ctest-non-default-41209065 verification passed
2025-07-08 17:49:40,004 - DEBUG - Pod ctest-pod-91264863 not in running state.Currently in Pending
2025-07-08 17:49:45,011 - INFO - Pod ctest-pod-91264863 is in running state.Got IP 10.47.255.251
2025-07-08 17:49:45,072 - DEBUG - Pod ctest-pod-91264863 has vmi ea8c844c-5c23-11f0-b5fa-fa163ea3f766
2025-07-08 17:49:45,072 - INFO - Verified pod ctest-pod-91264863 in contrail-api
2025-07-08 17:49:45,084 - DEBUG - VMI ea8c844c-5c23-11f0-b5fa-fa163ea3f766 is active in agent 10.0.0.249
2025-07-08 17:49:45,084 - INFO - Verified Pod ctest-pod-91264863 in agent 10.0.0.249
2025-07-08 17:49:45,084 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=c5590e0e-ab68-4922-9ff6-5dd943d1716a
2025-07-08 17:49:45,091 - INFO - Pod ctest-pod-91264863 with uuid c5590e0e-ab68-4922-9ff6-5dd943d1716a found in kube manager
2025-07-08 17:49:45,091 - INFO - Pod ctest-pod-91264863 verification passed
2025-07-08 17:49:45,096 - DEBUG - Pod ctest-pod-61602057 not in running state.Currently in Pending
2025-07-08 17:49:50,102 - INFO - Pod ctest-pod-61602057 is in running state.Got IP 10.47.255.250
2025-07-08 17:49:50,117 - DEBUG - Pod ctest-pod-61602057 has vmi eb0962fa-5c23-11f0-b5fa-fa163ea3f766
2025-07-08 17:49:50,117 - INFO - Verified pod ctest-pod-61602057 in contrail-api
2025-07-08 17:49:50,130 - DEBUG - VMI eb0962fa-5c23-11f0-b5fa-fa163ea3f766 is active in agent 10.0.0.249
2025-07-08 17:49:50,130 - INFO - Verified Pod ctest-pod-61602057 in agent 10.0.0.249
2025-07-08 17:49:50,131 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=8f541523-9f49-48ae-8237-c1b35c9ed593
2025-07-08 17:49:50,134 - INFO - Pod ctest-pod-61602057 with uuid 8f541523-9f49-48ae-8237-c1b35c9ed593 found in kube manager
2025-07-08 17:49:50,135 - INFO - Pod ctest-pod-61602057 verification passed
2025-07-08 17:49:50,139 - INFO - Pod ctest-pod-89014126 is in running state.Got IP 10.47.255.249
2025-07-08 17:49:50,192 - DEBUG - Pod ctest-pod-89014126 has vmi ebb6ae9c-5c23-11f0-b5fa-fa163ea3f766
2025-07-08 17:49:50,192 - INFO - Verified pod ctest-pod-89014126 in contrail-api
2025-07-08 17:49:50,204 - DEBUG - VMI ebb6ae9c-5c23-11f0-b5fa-fa163ea3f766 is active in agent 10.0.0.249
2025-07-08 17:49:50,204 - INFO - Verified Pod ctest-pod-89014126 in agent 10.0.0.249
2025-07-08 17:49:50,205 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=9f625032-d942-47c8-9e81-7205d6b07438
2025-07-08 17:49:50,209 - INFO - Pod ctest-pod-89014126 with uuid 9f625032-d942-47c8-9e81-7205d6b07438 found in kube manager
2025-07-08 17:49:50,209 - INFO - Pod ctest-pod-89014126 verification passed
2025-07-08 17:49:50,217 - INFO - Pod ctest-pod-30830625 is in running state.Got IP 10.47.255.248
2025-07-08 17:49:50,233 - DEBUG - Pod ctest-pod-30830625 has vmi ec3c2b6c-5c23-11f0-b5fa-fa163ea3f766
2025-07-08 17:49:50,233 - INFO - Verified pod ctest-pod-30830625 in contrail-api
2025-07-08 17:49:50,247 - DEBUG - VMI ec3c2b6c-5c23-11f0-b5fa-fa163ea3f766 is active in agent 10.0.0.249
2025-07-08 17:49:50,248 - INFO - Verified Pod ctest-pod-30830625 in agent 10.0.0.249
2025-07-08 17:49:50,248 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=ddf77459-4ccc-4a98-bc1e-bf4db6f16f48
2025-07-08 17:49:50,252 - INFO - Pod ctest-pod-30830625 with uuid ddf77459-4ccc-4a98-bc1e-bf4db6f16f48 found in kube manager
2025-07-08 17:49:50,252 - INFO - Pod ctest-pod-30830625 verification passed
2025-07-08 17:49:50,258 - DEBUG - Pod ctest-pod-22152525 not in running state.Currently in Pending
2025-07-08 17:49:55,263 - INFO - Pod ctest-pod-22152525 is in running state.Got IP 10.47.255.247
2025-07-08 17:49:55,320 - DEBUG - Pod ctest-pod-22152525 has vmi eccbbeb2-5c23-11f0-b5fa-fa163ea3f766
2025-07-08 17:49:55,320 - INFO - Verified pod ctest-pod-22152525 in contrail-api
2025-07-08 17:49:55,332 - DEBUG - VMI eccbbeb2-5c23-11f0-b5fa-fa163ea3f766 is active in agent 10.0.0.249
2025-07-08 17:49:55,332 - INFO - Verified Pod ctest-pod-22152525 in agent 10.0.0.249
2025-07-08 17:49:55,332 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=cab674e5-5c58-4a12-9c06-b6d3268c4a53
2025-07-08 17:49:55,336 - INFO - Pod ctest-pod-22152525 with uuid cab674e5-5c58-4a12-9c06-b6d3268c4a53 found in kube manager
2025-07-08 17:49:55,336 - INFO - Pod ctest-pod-22152525 verification passed
2025-07-08 17:49:55,341 - INFO - Pod ctest-pod-51287701 is in running state.Got IP 10.47.255.245
2025-07-08 17:49:55,353 - DEBUG - Pod ctest-pod-51287701 has vmi eda3b330-5c23-11f0-b5fa-fa163ea3f766
2025-07-08 17:49:55,353 - INFO - Verified pod ctest-pod-51287701 in contrail-api
2025-07-08 17:49:55,365 - DEBUG - VMI eda3b330-5c23-11f0-b5fa-fa163ea3f766 is active in agent 10.0.0.249
2025-07-08 17:49:55,366 - INFO - Verified Pod ctest-pod-51287701 in agent 10.0.0.249
2025-07-08 17:49:55,366 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=ebc882c9-3aa2-477d-a552-21dcc033e146
2025-07-08 17:49:55,370 - INFO - Pod ctest-pod-51287701 with uuid ebc882c9-3aa2-477d-a552-21dcc033e146 found in kube manager
2025-07-08 17:49:55,370 - INFO - Pod ctest-pod-51287701 verification passed
2025-07-08 17:49:55,436 - INFO - Pod ctest-pod-72391870 is in running state.Got IP 10.47.255.246
2025-07-08 17:49:55,492 - DEBUG - Pod ctest-pod-72391870 has vmi ed37ac12-5c23-11f0-b5fa-fa163ea3f766
2025-07-08 17:49:55,492 - INFO - Verified pod ctest-pod-72391870 in contrail-api
2025-07-08 17:49:55,504 - DEBUG - VMI ed37ac12-5c23-11f0-b5fa-fa163ea3f766 is active in agent 10.0.0.249
2025-07-08 17:49:55,504 - INFO - Verified Pod ctest-pod-72391870 in agent 10.0.0.249
2025-07-08 17:49:55,504 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=0cea3104-3394-4f0f-bbe9-b2057a8e798e
2025-07-08 17:49:55,509 - INFO - Pod ctest-pod-72391870 with uuid 0cea3104-3394-4f0f-bbe9-b2057a8e798e found in kube manager
2025-07-08 17:49:55,509 - INFO - Pod ctest-pod-72391870 verification passed
2025-07-08 17:49:55,513 - INFO - Pod ctest-pod-71525469 is in running state.Got IP 10.47.255.244
2025-07-08 17:49:55,525 - DEBUG - Pod ctest-pod-71525469 has vmi ee0e9556-5c23-11f0-b5fa-fa163ea3f766
2025-07-08 17:49:55,525 - INFO - Verified pod ctest-pod-71525469 in contrail-api
2025-07-08 17:49:55,537 - DEBUG - VMI ee0e9556-5c23-11f0-b5fa-fa163ea3f766 is active in agent 10.0.0.249
2025-07-08 17:49:55,537 - INFO - Verified Pod ctest-pod-71525469 in agent 10.0.0.249
2025-07-08 17:49:55,537 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=048da35d-da9c-479d-b418-3dff3b7a71c6
2025-07-08 17:49:55,541 - INFO - Pod ctest-pod-71525469 with uuid 048da35d-da9c-479d-b418-3dff3b7a71c6 found in kube manager
2025-07-08 17:49:55,541 - INFO - Pod ctest-pod-71525469 verification passed
2025-07-08 17:49:55,541 - INFO - ================================================================================
2025-07-08 17:49:55,541 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-07-08 17:49:55,541 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-07-08 17:49:55,772 - DEBUG - Nothing to compare xmpp stats {'10.0.0.249': {'10.0.0.22': '0'}} with
2025-07-08 17:49:55,772 - INFO - Initial checks done. Running the testcase now
2025-07-08 17:49:55,772 - INFO -
2025-07-08 17:49:55,827 - DEBUG - [Pod ctest-pod-91264863] Cmd: echo ctest-pod-91264863 > /usr/share/nginx/html/index.html, Output:
2025-07-08 17:49:55,891 - DEBUG - [Pod ctest-pod-61602057] Cmd: echo ctest-pod-61602057 > /usr/share/nginx/html/index.html, Output:
2025-07-08 17:49:55,974 - DEBUG - [Pod ctest-pod-89014126] Cmd: echo ctest-pod-89014126 > /usr/share/nginx/html/index.html, Output:
2025-07-08 17:49:56,036 - DEBUG - [Pod ctest-pod-30830625] Cmd: echo ctest-pod-30830625 > /usr/share/nginx/html/index.html, Output:
2025-07-08 17:49:56,039 - DEBUG - Service ctest-nginx-svc-63766010 not present
2025-07-08 17:49:56,039 - INFO - Creating service ctest-nginx-svc-63766010
2025-07-08 17:49:56,056 - INFO - Created Service ctest-nginx-svc-63766010
2025-07-08 17:49:56,074 - WARNING - Service UUID 2ab5f3ff-a4dc-45ea-9db1-9c1981c26561 not yet found in contrail-api
2025-07-08 17:49:57,099 - INFO - Validated that Service ctest-nginx-svc-63766010 is seen in contrail-api
2025-07-08 17:49:57,099 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_LoadbalancerDatabaseList?x=2ab5f3ff-a4dc-45ea-9db1-9c1981c26561
2025-07-08 17:49:57,106 - INFO - Service ctest-nginx-svc-63766010 with uuid 2ab5f3ff-a4dc-45ea-9db1-9c1981c26561 found in kube manager
2025-07-08 17:49:57,106 - INFO - Service ctest-nginx-svc-63766010 verification passed
2025-07-08 17:49:58,188 - DEBUG - [Pod ctest-pod-22152525] Cmd: wget http://10.110.204.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-91264863
2025-07-08 17:49:58,188 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd wget http://10.110.204.242:80/ -O - -T 5 -t 1 passed
2025-07-08 17:49:58,188 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-91264863
2025-07-08 17:49:58,246 - DEBUG - [Pod ctest-pod-22152525] Cmd: wget http://10.110.204.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-61602057
2025-07-08 17:49:58,246 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd wget http://10.110.204.242:80/ -O - -T 5 -t 1 passed
2025-07-08 17:49:58,246 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-61602057
2025-07-08 17:49:58,246 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-91264863': 1, 'ctest-pod-61602057': 1}
2025-07-08 17:49:58,301 - DEBUG - [Pod ctest-pod-51287701] Cmd: wget http://10.110.204.242:80/ -O - -T 5 -t 1 , Output: ctest-pod-91264863
Connecting to 10.110.204.242:80 (10.110.204.242:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-08 17:49:58,301 - DEBUG - [Pod Pod ctest-pod-51287701] Cmd wget http://10.110.204.242:80/ -O - -T 5 -t 1 passed
2025-07-08 17:49:58,301 - DEBUG - [Pod Pod ctest-pod-51287701] Cmd output: ctest-pod-91264863
Connecting to 10.110.204.242:80 (10.110.204.242:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-08 17:49:58,358 - DEBUG - [Pod ctest-pod-51287701] Cmd: wget http://10.110.204.242:80/ -O - -T 5 -t 1 , Output: ctest-pod-91264863
Connecting to 10.110.204.242:80 (10.110.204.242:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-08 17:49:58,358 - DEBUG - [Pod Pod ctest-pod-51287701] Cmd wget http://10.110.204.242:80/ -O - -T 5 -t 1 passed
2025-07-08 17:49:58,358 - DEBUG - [Pod Pod ctest-pod-51287701] Cmd output: ctest-pod-91264863
Connecting to 10.110.204.242:80 (10.110.204.242:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-08 17:49:58,415 - DEBUG - [Pod ctest-pod-51287701] Cmd: wget http://10.110.204.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-91264863
2025-07-08 17:49:58,415 - DEBUG - [Pod Pod ctest-pod-51287701] Cmd wget http://10.110.204.242:80/ -O - -T 5 -t 1 passed
2025-07-08 17:49:58,415 - DEBUG - [Pod Pod ctest-pod-51287701] Cmd output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-91264863
2025-07-08 17:49:58,469 - DEBUG - [Pod ctest-pod-51287701] Cmd: wget http://10.110.204.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-61602057
2025-07-08 17:49:58,469 - DEBUG - [Pod Pod ctest-pod-51287701] Cmd wget http://10.110.204.242:80/ -O - -T 5 -t 1 passed
2025-07-08 17:49:58,469 - DEBUG - [Pod Pod ctest-pod-51287701] Cmd output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-61602057
2025-07-08 17:49:58,469 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-91264863': 3, 'ctest-pod-61602057': 1}
2025-07-08 17:49:58,471 - DEBUG - Network policy ingress-on-service not present
2025-07-08 17:49:58,472 - INFO - Creating Network Policy ingress-on-service
2025-07-08 17:49:58,481 - INFO - Network policy found in k8s
2025-07-08 17:49:58,481 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=5beca5a3-a507-4056-8827-faa1f70bf119
2025-07-08 17:49:58,486 - INFO - Network Policy ingress-on-service with uuid 5beca5a3-a507-4056-8827-faa1f70bf119 found in kube manager
2025-07-08 17:49:58,517 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-07-08 17:49:58,518 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-07-08 17:49:58,518 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=5beca5a3-a507-4056-8827-faa1f70bf119
2025-07-08 17:49:58,544 - WARNING - Network policy with name ingress-on-service not found in agent
2025-07-08 17:50:00,545 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=5beca5a3-a507-4056-8827-faa1f70bf119
2025-07-08 17:50:00,576 - INFO - Network policy with name ingress-on-service found in agent
2025-07-08 17:50:00,576 - INFO - Network Policy ingress-on-service verification passed
2025-07-08 17:50:05,627 - DEBUG - [Pod ctest-pod-22152525] Cmd: wget http://10.110.204.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:50:05,627 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd wget http://10.110.204.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:50:05,627 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:50:10,681 - DEBUG - [Pod ctest-pod-22152525] Cmd: wget http://10.110.204.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:50:10,681 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd wget http://10.110.204.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:50:10,681 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:50:15,732 - DEBUG - [Pod ctest-pod-22152525] Cmd: wget http://10.110.204.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:50:15,732 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd wget http://10.110.204.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:50:15,732 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:50:20,779 - DEBUG - [Pod ctest-pod-22152525] Cmd: wget http://10.110.204.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:50:20,779 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd wget http://10.110.204.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:50:20,779 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:50:25,827 - DEBUG - [Pod ctest-pod-22152525] Cmd: wget http://10.110.204.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:50:25,827 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd wget http://10.110.204.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:50:25,827 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:50:30,879 - DEBUG - [Pod ctest-pod-22152525] Cmd: wget http://10.110.204.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:50:30,879 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd wget http://10.110.204.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:50:30,879 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:50:35,930 - DEBUG - [Pod ctest-pod-22152525] Cmd: wget http://10.110.204.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:50:35,930 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd wget http://10.110.204.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:50:35,930 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:50:40,980 - DEBUG - [Pod ctest-pod-22152525] Cmd: wget http://10.110.204.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:50:40,980 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd wget http://10.110.204.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:50:40,980 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:50:46,038 - DEBUG - [Pod ctest-pod-22152525] Cmd: wget http://10.110.204.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:50:46,038 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd wget http://10.110.204.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:50:46,038 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:50:51,179 - DEBUG - [Pod ctest-pod-22152525] Cmd: wget http://10.110.204.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:50:51,180 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd wget http://10.110.204.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:50:51,180 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:50:51,180 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-91264863': 0, 'ctest-pod-61602057': 0}
2025-07-08 17:50:51,234 - DEBUG - [Pod ctest-pod-72391870] Cmd: wget http://10.110.204.242:80/ -O - -T 5 -t 1 , Output: ctest-pod-61602057
Connecting to 10.110.204.242:80 (10.110.204.242:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-08 17:50:51,235 - DEBUG - [Pod Pod ctest-pod-72391870] Cmd wget http://10.110.204.242:80/ -O - -T 5 -t 1 passed
2025-07-08 17:50:51,235 - DEBUG - [Pod Pod ctest-pod-72391870] Cmd output: ctest-pod-61602057
Connecting to 10.110.204.242:80 (10.110.204.242:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-08 17:50:51,297 - DEBUG - [Pod ctest-pod-72391870] Cmd: wget http://10.110.204.242:80/ -O - -T 5 -t 1 , Output: ctest-pod-91264863
Connecting to 10.110.204.242:80 (10.110.204.242:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-08 17:50:51,298 - DEBUG - [Pod Pod ctest-pod-72391870] Cmd wget http://10.110.204.242:80/ -O - -T 5 -t 1 passed
2025-07-08 17:50:51,298 - DEBUG - [Pod Pod ctest-pod-72391870] Cmd output: ctest-pod-91264863
Connecting to 10.110.204.242:80 (10.110.204.242:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-08 17:50:51,298 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-91264863': 1, 'ctest-pod-61602057': 1}
2025-07-08 17:50:56,342 - DEBUG - [Pod ctest-pod-51287701] Cmd: wget http://10.110.204.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:50:56,342 - DEBUG - [Pod Pod ctest-pod-51287701] Cmd wget http://10.110.204.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:50:56,342 - DEBUG - [Pod Pod ctest-pod-51287701] Cmd output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:51:01,392 - DEBUG - [Pod ctest-pod-51287701] Cmd: wget http://10.110.204.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:51:01,392 - DEBUG - [Pod Pod ctest-pod-51287701] Cmd wget http://10.110.204.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:51:01,392 - DEBUG - [Pod Pod ctest-pod-51287701] Cmd output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:51:06,445 - DEBUG - [Pod ctest-pod-51287701] Cmd: wget http://10.110.204.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:51:06,445 - DEBUG - [Pod Pod ctest-pod-51287701] Cmd wget http://10.110.204.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:51:06,445 - DEBUG - [Pod Pod ctest-pod-51287701] Cmd output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:51:11,498 - DEBUG - [Pod ctest-pod-51287701] Cmd: wget http://10.110.204.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:51:11,499 - DEBUG - [Pod Pod ctest-pod-51287701] Cmd wget http://10.110.204.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:51:11,499 - DEBUG - [Pod Pod ctest-pod-51287701] Cmd output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:51:16,546 - DEBUG - [Pod ctest-pod-51287701] Cmd: wget http://10.110.204.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:51:16,546 - DEBUG - [Pod Pod ctest-pod-51287701] Cmd wget http://10.110.204.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:51:16,546 - DEBUG - [Pod Pod ctest-pod-51287701] Cmd output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:51:21,591 - DEBUG - [Pod ctest-pod-51287701] Cmd: wget http://10.110.204.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:51:21,591 - DEBUG - [Pod Pod ctest-pod-51287701] Cmd wget http://10.110.204.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:51:21,591 - DEBUG - [Pod Pod ctest-pod-51287701] Cmd output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:51:26,642 - DEBUG - [Pod ctest-pod-51287701] Cmd: wget http://10.110.204.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:51:26,643 - DEBUG - [Pod Pod ctest-pod-51287701] Cmd wget http://10.110.204.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:51:26,643 - DEBUG - [Pod Pod ctest-pod-51287701] Cmd output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:51:31,703 - DEBUG - [Pod ctest-pod-51287701] Cmd: wget http://10.110.204.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:51:31,703 - DEBUG - [Pod Pod ctest-pod-51287701] Cmd wget http://10.110.204.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:51:31,703 - DEBUG - [Pod Pod ctest-pod-51287701] Cmd output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:51:36,751 - DEBUG - [Pod ctest-pod-51287701] Cmd: wget http://10.110.204.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:51:36,751 - DEBUG - [Pod Pod ctest-pod-51287701] Cmd wget http://10.110.204.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:51:36,751 - DEBUG - [Pod Pod ctest-pod-51287701] Cmd output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:51:41,799 - DEBUG - [Pod ctest-pod-51287701] Cmd: wget http://10.110.204.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:51:41,799 - DEBUG - [Pod Pod ctest-pod-51287701] Cmd wget http://10.110.204.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:51:41,799 - DEBUG - [Pod Pod ctest-pod-51287701] Cmd output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:51:41,799 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-91264863': 0, 'ctest-pod-61602057': 0}
2025-07-08 17:51:43,847 - DEBUG - [Pod ctest-pod-72391870] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.410 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.077 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.078 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.077/0.188/0.410 ms
2025-07-08 17:51:43,848 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-72391870 with expectation True passed
2025-07-08 17:51:45,896 - DEBUG - [Pod ctest-pod-22152525] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.865 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.072 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.087 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.072/0.341/0.865 ms
2025-07-08 17:51:45,896 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-22152525 with expectation True passed
2025-07-08 17:51:47,939 - DEBUG - [Pod ctest-pod-51287701] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.839 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.087 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.070 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.070/0.332/0.839 ms
2025-07-08 17:51:47,939 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-51287701 with expectation True passed
2025-07-08 17:51:47,994 - DEBUG - [Pod ctest-pod-72391870] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-08 17:51:47,994 - DEBUG - [Pod Pod ctest-pod-72391870] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-07-08 17:51:47,994 - DEBUG - [Pod Pod ctest-pod-72391870] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-08 17:51:47,994 - INFO - wget check of of http://10.47.255.251 from ctest-pod-72391870 passed
2025-07-08 17:51:48,048 - DEBUG - [Pod ctest-pod-72391870] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-08 17:51:48,048 - DEBUG - [Pod Pod ctest-pod-72391870] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-07-08 17:51:48,048 - DEBUG - [Pod Pod ctest-pod-72391870] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-08 17:51:48,048 - INFO - wget check of of http://10.47.255.250 from ctest-pod-72391870 passed
2025-07-08 17:51:53,094 - DEBUG - [Pod ctest-pod-22152525] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-07-08 17:51:53,095 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-07-08 17:51:53,095 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-07-08 17:51:53,095 - INFO - wget check of of http://10.47.255.250 from ctest-pod-22152525 passed
2025-07-08 17:51:58,147 - DEBUG - [Pod ctest-pod-71525469] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-07-08 17:51:58,148 - DEBUG - [Pod Pod ctest-pod-71525469] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-07-08 17:51:58,148 - DEBUG - [Pod Pod ctest-pod-71525469] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-07-08 17:51:58,148 - INFO - wget check of of http://10.47.255.251 from ctest-pod-71525469 passed
2025-07-08 17:51:58,155 - INFO - Updating Network Policy ingress-on-service
2025-07-08 17:52:03,215 - DEBUG - [Pod ctest-pod-22152525] Cmd: wget http://10.110.204.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:52:03,216 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd wget http://10.110.204.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:52:03,216 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:52:08,268 - DEBUG - [Pod ctest-pod-22152525] Cmd: wget http://10.110.204.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:52:08,268 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd wget http://10.110.204.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:52:08,268 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:52:13,328 - DEBUG - [Pod ctest-pod-22152525] Cmd: wget http://10.110.204.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:52:13,328 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd wget http://10.110.204.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:52:13,328 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:52:18,384 - DEBUG - [Pod ctest-pod-22152525] Cmd: wget http://10.110.204.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:52:18,384 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd wget http://10.110.204.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:52:18,384 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:52:23,435 - DEBUG - [Pod ctest-pod-22152525] Cmd: wget http://10.110.204.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:52:23,436 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd wget http://10.110.204.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:52:23,436 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:52:28,487 - DEBUG - [Pod ctest-pod-22152525] Cmd: wget http://10.110.204.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:52:28,487 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd wget http://10.110.204.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:52:28,487 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:52:33,551 - DEBUG - [Pod ctest-pod-22152525] Cmd: wget http://10.110.204.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:52:33,551 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd wget http://10.110.204.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:52:33,551 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:52:38,606 - DEBUG - [Pod ctest-pod-22152525] Cmd: wget http://10.110.204.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:52:38,606 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd wget http://10.110.204.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:52:38,606 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:52:43,659 - DEBUG - [Pod ctest-pod-22152525] Cmd: wget http://10.110.204.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:52:43,659 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd wget http://10.110.204.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:52:43,659 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:52:48,710 - DEBUG - [Pod ctest-pod-22152525] Cmd: wget http://10.110.204.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:52:48,711 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd wget http://10.110.204.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:52:48,711 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd output: Connecting to 10.110.204.242:80 (10.110.204.242:80)
wget: download timed out
2025-07-08 17:52:48,711 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-91264863': 0, 'ctest-pod-61602057': 0}
2025-07-08 17:52:48,761 - DEBUG - [Pod ctest-pod-72391870] Cmd: wget http://10.110.204.242:80/ -O - -T 5 -t 1 , Output: ctest-pod-91264863
Connecting to 10.110.204.242:80 (10.110.204.242:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-08 17:52:48,761 - DEBUG - [Pod Pod ctest-pod-72391870] Cmd wget http://10.110.204.242:80/ -O - -T 5 -t 1 passed
2025-07-08 17:52:48,761 - DEBUG - [Pod Pod ctest-pod-72391870] Cmd output: ctest-pod-91264863
Connecting to 10.110.204.242:80 (10.110.204.242:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-08 17:52:48,826 - DEBUG - [Pod ctest-pod-72391870] Cmd: wget http://10.110.204.242:80/ -O - -T 5 -t 1 , Output: ctest-pod-61602057
Connecting to 10.110.204.242:80 (10.110.204.242:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-08 17:52:48,827 - DEBUG - [Pod Pod ctest-pod-72391870] Cmd wget http://10.110.204.242:80/ -O - -T 5 -t 1 passed
2025-07-08 17:52:48,827 - DEBUG - [Pod Pod ctest-pod-72391870] Cmd output: ctest-pod-61602057
Connecting to 10.110.204.242:80 (10.110.204.242:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-08 17:52:48,827 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-91264863': 1, 'ctest-pod-61602057': 1}
2025-07-08 17:52:48,882 - DEBUG - [Pod ctest-pod-51287701] Cmd: wget http://10.110.204.242:80/ -O - -T 5 -t 1 , Output: ctest-pod-61602057
Connecting to 10.110.204.242:80 (10.110.204.242:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-08 17:52:48,882 - DEBUG - [Pod Pod ctest-pod-51287701] Cmd wget http://10.110.204.242:80/ -O - -T 5 -t 1 passed
2025-07-08 17:52:48,882 - DEBUG - [Pod Pod ctest-pod-51287701] Cmd output: ctest-pod-61602057
Connecting to 10.110.204.242:80 (10.110.204.242:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-08 17:52:48,938 - DEBUG - [Pod ctest-pod-51287701] Cmd: wget http://10.110.204.242:80/ -O - -T 5 -t 1 , Output: ctest-pod-91264863
Connecting to 10.110.204.242:80 (10.110.204.242:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-08 17:52:48,938 - DEBUG - [Pod Pod ctest-pod-51287701] Cmd wget http://10.110.204.242:80/ -O - -T 5 -t 1 passed
2025-07-08 17:52:48,938 - DEBUG - [Pod Pod ctest-pod-51287701] Cmd output: ctest-pod-91264863
Connecting to 10.110.204.242:80 (10.110.204.242:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-08 17:52:48,938 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-91264863': 1, 'ctest-pod-61602057': 1}
2025-07-08 17:52:50,988 - DEBUG - [Pod ctest-pod-72391870] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.988 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.069 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.080 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.069/0.379/0.988 ms
2025-07-08 17:52:50,988 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-72391870 with expectation True passed
2025-07-08 17:52:53,040 - DEBUG - [Pod ctest-pod-22152525] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.948 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.094 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.078 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.078/0.373/0.948 ms
2025-07-08 17:52:53,040 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-22152525 with expectation True passed
2025-07-08 17:52:55,091 - DEBUG - [Pod ctest-pod-51287701] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.918 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.072 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.094 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.072/0.361/0.918 ms
2025-07-08 17:52:55,091 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-51287701 with expectation True passed
2025-07-08 17:52:55,141 - DEBUG - [Pod ctest-pod-72391870] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-08 17:52:55,141 - DEBUG - [Pod Pod ctest-pod-72391870] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-07-08 17:52:55,141 - DEBUG - [Pod Pod ctest-pod-72391870] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-08 17:52:55,141 - INFO - wget check of of http://10.47.255.251 from ctest-pod-72391870 passed
2025-07-08 17:52:55,178 - DEBUG - [Pod ctest-pod-72391870] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-08 17:52:55,178 - DEBUG - [Pod Pod ctest-pod-72391870] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-07-08 17:52:55,179 - DEBUG - [Pod Pod ctest-pod-72391870] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-08 17:52:55,179 - INFO - wget check of of http://10.47.255.250 from ctest-pod-72391870 passed
2025-07-08 17:53:00,232 - DEBUG - [Pod ctest-pod-22152525] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-07-08 17:53:00,232 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-07-08 17:53:00,232 - DEBUG - [Pod Pod ctest-pod-22152525] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-07-08 17:53:00,232 - INFO - wget check of of http://10.47.255.250 from ctest-pod-22152525 passed
2025-07-08 17:53:00,288 - DEBUG - [Pod ctest-pod-71525469] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-08 17:53:00,288 - DEBUG - [Pod Pod ctest-pod-71525469] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-07-08 17:53:00,288 - DEBUG - [Pod Pod ctest-pod-71525469] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-08 17:53:00,288 - INFO - wget check of of http://10.47.255.251 from ctest-pod-71525469 passed
2025-07-08 17:53:00,288 - INFO - Deleting Network Policy : ingress-on-service
2025-07-08 17:53:00,289 - INFO - Deleting service : ctest-nginx-svc-63766010
2025-07-08 17:53:00,520 - DEBUG - No XMPP flaps were noticed during the test
2025-07-08 17:53:00,520 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:05]
2025-07-08 17:53:00,520 - INFO - --------------------------------------------------------------------------------
2025-07-08 17:53:00,525 - INFO - Deleting pod ctest-new-default-86557414:ctest-pod-91264863
2025-07-08 17:53:00,525 - INFO - Deleting pod ctest-new-default-86557414:ctest-pod-61602057
2025-07-08 17:53:00,526 - INFO - Deleting pod ctest-non-default-41209065:ctest-pod-89014126
2025-07-08 17:53:00,526 - INFO - Deleting pod ctest-non-default-41209065:ctest-pod-30830625
2025-07-08 17:53:00,526 - INFO - Deleting pod ctest-new-default-86557414:ctest-pod-22152525
2025-07-08 17:53:00,526 - INFO - Deleting pod ctest-new-default-86557414:ctest-pod-72391870
2025-07-08 17:53:00,527 - INFO - Deleting pod ctest-non-default-41209065:ctest-pod-51287701
2025-07-08 17:53:00,527 - INFO - Deleting pod ctest-non-default-41209065:ctest-pod-71525469
2025-07-08 17:53:00,576 - WARNING - Pod uuid c5590e0e-ab68-4922-9ff6-5dd943d1716a is still seen in agent 10.0.0.249 VM list
2025-07-08 17:53:00,615 - WARNING - Pod uuid ebc882c9-3aa2-477d-a552-21dcc033e146 is still seen in agent 10.0.0.249 VM list
2025-07-08 17:53:00,664 - WARNING - Pod uuid 0cea3104-3394-4f0f-bbe9-b2057a8e798e is still seen in agent 10.0.0.249 VM list
2025-07-08 17:53:00,665 - WARNING - Pod uuid 9f625032-d942-47c8-9e81-7205d6b07438 is still seen in agent 10.0.0.249 VM list
2025-07-08 17:53:00,666 - WARNING - Pod uuid 8f541523-9f49-48ae-8237-c1b35c9ed593 is still seen in agent 10.0.0.249 VM list
2025-07-08 17:53:00,666 - WARNING - Pod uuid 048da35d-da9c-479d-b418-3dff3b7a71c6 is still seen in agent 10.0.0.249 VM list
2025-07-08 17:53:00,666 - WARNING - Pod uuid cab674e5-5c58-4a12-9c06-b6d3268c4a53 is still seen in agent 10.0.0.249 VM list
2025-07-08 17:53:00,666 - WARNING - Pod uuid ddf77459-4ccc-4a98-bc1e-bf4db6f16f48 is still seen in agent 10.0.0.249 VM list
2025-07-08 17:53:05,584 - DEBUG - Pod c5590e0e-ab68-4922-9ff6-5dd943d1716a is not in agent 10.0.0.249 VM list
2025-07-08 17:53:05,590 - DEBUG - VMI ea8c844c-5c23-11f0-b5fa-fa163ea3f766 is removed from agent 10.0.0.249
2025-07-08 17:53:05,590 - INFO - Verified that pod ctest-pod-91264863 is removed in agent
2025-07-08 17:53:05,622 - WARNING - Pod uuid ebc882c9-3aa2-477d-a552-21dcc033e146 is still seen in agent 10.0.0.249 VM list
2025-07-08 17:53:05,689 - DEBUG - Pod 8f541523-9f49-48ae-8237-c1b35c9ed593 is not in agent 10.0.0.249 VM list
2025-07-08 17:53:05,693 - DEBUG - Pod ddf77459-4ccc-4a98-bc1e-bf4db6f16f48 is not in agent 10.0.0.249 VM list
2025-07-08 17:53:05,694 - WARNING - Pod uuid cab674e5-5c58-4a12-9c06-b6d3268c4a53 is still seen in agent 10.0.0.249 VM list
2025-07-08 17:53:05,694 - WARNING - Pod uuid 048da35d-da9c-479d-b418-3dff3b7a71c6 is still seen in agent 10.0.0.249 VM list
2025-07-08 17:53:05,695 - WARNING - Pod uuid 0cea3104-3394-4f0f-bbe9-b2057a8e798e is still seen in agent 10.0.0.249 VM list
2025-07-08 17:53:05,695 - DEBUG - Pod 9f625032-d942-47c8-9e81-7205d6b07438 is not in agent 10.0.0.249 VM list
2025-07-08 17:53:05,705 - DEBUG - VMI eb0962fa-5c23-11f0-b5fa-fa163ea3f766 is removed from agent 10.0.0.249
2025-07-08 17:53:05,705 - INFO - Verified that pod ctest-pod-61602057 is removed in agent
2025-07-08 17:53:05,707 - DEBUG - VMI ec3c2b6c-5c23-11f0-b5fa-fa163ea3f766 is removed from agent 10.0.0.249
2025-07-08 17:53:05,707 - INFO - Verified that pod ctest-pod-30830625 is removed in agent
2025-07-08 17:53:05,707 - DEBUG - VMI ebb6ae9c-5c23-11f0-b5fa-fa163ea3f766 is removed from agent 10.0.0.249
2025-07-08 17:53:05,707 - INFO - Verified that pod ctest-pod-89014126 is removed in agent
2025-07-08 17:53:10,630 - WARNING - Pod uuid ebc882c9-3aa2-477d-a552-21dcc033e146 is still seen in agent 10.0.0.249 VM list
2025-07-08 17:53:10,709 - WARNING - Pod uuid cab674e5-5c58-4a12-9c06-b6d3268c4a53 is still seen in agent 10.0.0.249 VM list
2025-07-08 17:53:10,712 - WARNING - Pod uuid 0cea3104-3394-4f0f-bbe9-b2057a8e798e is still seen in agent 10.0.0.249 VM list
2025-07-08 17:53:10,712 - WARNING - Pod uuid 048da35d-da9c-479d-b418-3dff3b7a71c6 is still seen in agent 10.0.0.249 VM list
2025-07-08 17:53:15,638 - WARNING - Pod uuid ebc882c9-3aa2-477d-a552-21dcc033e146 is still seen in agent 10.0.0.249 VM list
2025-07-08 17:53:15,723 - WARNING - Pod uuid 0cea3104-3394-4f0f-bbe9-b2057a8e798e is still seen in agent 10.0.0.249 VM list
2025-07-08 17:53:15,724 - WARNING - Pod uuid cab674e5-5c58-4a12-9c06-b6d3268c4a53 is still seen in agent 10.0.0.249 VM list
2025-07-08 17:53:15,724 - WARNING - Pod uuid 048da35d-da9c-479d-b418-3dff3b7a71c6 is still seen in agent 10.0.0.249 VM list
2025-07-08 17:53:20,645 - WARNING - Pod uuid ebc882c9-3aa2-477d-a552-21dcc033e146 is still seen in agent 10.0.0.249 VM list
2025-07-08 17:53:20,738 - WARNING - Pod uuid 0cea3104-3394-4f0f-bbe9-b2057a8e798e is still seen in agent 10.0.0.249 VM list
2025-07-08 17:53:20,739 - WARNING - Pod uuid 048da35d-da9c-479d-b418-3dff3b7a71c6 is still seen in agent 10.0.0.249 VM list
2025-07-08 17:53:20,739 - WARNING - Pod uuid cab674e5-5c58-4a12-9c06-b6d3268c4a53 is still seen in agent 10.0.0.249 VM list
2025-07-08 17:53:25,657 - WARNING - Pod uuid ebc882c9-3aa2-477d-a552-21dcc033e146 is still seen in agent 10.0.0.249 VM list
2025-07-08 17:53:25,753 - WARNING - Pod uuid 0cea3104-3394-4f0f-bbe9-b2057a8e798e is still seen in agent 10.0.0.249 VM list
2025-07-08 17:53:25,755 - WARNING - Pod uuid 048da35d-da9c-479d-b418-3dff3b7a71c6 is still seen in agent 10.0.0.249 VM list
2025-07-08 17:53:25,755 - WARNING - Pod uuid cab674e5-5c58-4a12-9c06-b6d3268c4a53 is still seen in agent 10.0.0.249 VM list
2025-07-08 17:53:30,666 - WARNING - Pod uuid ebc882c9-3aa2-477d-a552-21dcc033e146 is still seen in agent 10.0.0.249 VM list
2025-07-08 17:53:30,768 - WARNING - Pod uuid 0cea3104-3394-4f0f-bbe9-b2057a8e798e is still seen in agent 10.0.0.249 VM list
2025-07-08 17:53:30,770 - WARNING - Pod uuid 048da35d-da9c-479d-b418-3dff3b7a71c6 is still seen in agent 10.0.0.249 VM list
2025-07-08 17:53:30,770 - WARNING - Pod uuid cab674e5-5c58-4a12-9c06-b6d3268c4a53 is still seen in agent 10.0.0.249 VM list
2025-07-08 17:53:35,674 - DEBUG - Pod ebc882c9-3aa2-477d-a552-21dcc033e146 is not in agent 10.0.0.249 VM list
2025-07-08 17:53:35,681 - DEBUG - VMI eda3b330-5c23-11f0-b5fa-fa163ea3f766 is removed from agent 10.0.0.249
2025-07-08 17:53:35,681 - INFO - Verified that pod ctest-pod-51287701 is removed in agent
2025-07-08 17:53:35,784 - DEBUG - Pod 0cea3104-3394-4f0f-bbe9-b2057a8e798e is not in agent 10.0.0.249 VM list
2025-07-08 17:53:35,787 - DEBUG - Pod 048da35d-da9c-479d-b418-3dff3b7a71c6 is not in agent 10.0.0.249 VM list
2025-07-08 17:53:35,789 - DEBUG - Pod cab674e5-5c58-4a12-9c06-b6d3268c4a53 is not in agent 10.0.0.249 VM list
2025-07-08 17:53:35,799 - DEBUG - VMI ed37ac12-5c23-11f0-b5fa-fa163ea3f766 is removed from agent 10.0.0.249
2025-07-08 17:53:35,799 - INFO - Verified that pod ctest-pod-72391870 is removed in agent
2025-07-08 17:53:35,800 - DEBUG - VMI eccbbeb2-5c23-11f0-b5fa-fa163ea3f766 is removed from agent 10.0.0.249
2025-07-08 17:53:35,800 - INFO - Verified that pod ctest-pod-22152525 is removed in agent
2025-07-08 17:53:35,801 - DEBUG - VMI ee0e9556-5c23-11f0-b5fa-fa163ea3f766 is removed from agent 10.0.0.249
2025-07-08 17:53:35,801 - INFO - Verified that pod ctest-pod-71525469 is removed in agent
2025-07-08 17:53:35,801 - INFO - Deleting namespace ctest-non-default-41209065
2025-07-08 17:53:35,816 - DEBUG - Namespace ctest-non-default-41209065 still in k8s
2025-07-08 17:53:37,820 - DEBUG - Namespace ctest-non-default-41209065 still in k8s
2025-07-08 17:53:39,825 - DEBUG - Namespace ctest-non-default-41209065 still in k8s
2025-07-08 17:53:41,829 - DEBUG - Namespace ctest-non-default-41209065 is not in k8s
2025-07-08 17:53:41,830 - DEBUG - No need to check project deletion in contrail-api
2025-07-08 17:53:41,830 - INFO - Deleting namespace ctest-new-default-86557414
2025-07-08 17:53:41,838 - DEBUG - Namespace ctest-new-default-86557414 still in k8s
2025-07-08 17:53:43,844 - DEBUG - Namespace ctest-new-default-86557414 still in k8s
2025-07-08 17:53:45,848 - DEBUG - Namespace ctest-new-default-86557414 still in k8s
2025-07-08 17:53:47,852 - DEBUG - Namespace ctest-new-default-86557414 is not in k8s
2025-07-08 17:53:47,853 - DEBUG - No need to check project deletion in contrail-api