2025-10-23 15:45:43,936 - INFO - Using existing project ['default-domain', 'k8s-default'](39e78434-33f9-4dba-b895-11a4f30937f8)
2025-10-23 15:45:43,965 - DEBUG - Namespace ctest-new-default-37395009 not present
2025-10-23 15:45:43,984 - INFO - Created namespace ctest-new-default-37395009
2025-10-23 15:45:46,995 - DEBUG - Namespace ctest-non-default-43832061 not present
2025-10-23 15:45:47,003 - INFO - Created namespace ctest-non-default-43832061
2025-10-23 15:45:50,041 - DEBUG - Pod ctest-pod-97722293 not present
2025-10-23 15:45:50,041 - INFO - Creating Pod ctest-pod-97722293
2025-10-23 15:45:50,092 - DEBUG - Pod : ctest-pod-97722293 UUID is da54a85f-38b4-4c1c-afff-2c09b3536f03
2025-10-23 15:45:50,095 - DEBUG - Pod ctest-pod-01329823 not present
2025-10-23 15:45:50,095 - INFO - Creating Pod ctest-pod-01329823
2025-10-23 15:45:50,142 - DEBUG - Pod : ctest-pod-01329823 UUID is 57ec5d13-5e76-46bf-a5eb-ce0456a161f4
2025-10-23 15:45:50,145 - DEBUG - Pod ctest-pod-78586551 not present
2025-10-23 15:45:50,146 - INFO - Creating Pod ctest-pod-78586551
2025-10-23 15:45:50,188 - DEBUG - Pod : ctest-pod-78586551 UUID is a92e55eb-6969-4d89-a462-c1e67c054eec
2025-10-23 15:45:50,191 - DEBUG - Pod ctest-pod-95497524 not present
2025-10-23 15:45:50,191 - INFO - Creating Pod ctest-pod-95497524
2025-10-23 15:45:50,218 - DEBUG - Pod : ctest-pod-95497524 UUID is 95699c7f-d5e4-438c-b01a-a60495b8e3d2
2025-10-23 15:45:50,220 - DEBUG - Pod ctest-pod-85159051 not present
2025-10-23 15:45:50,221 - INFO - Creating Pod ctest-pod-85159051
2025-10-23 15:45:50,253 - DEBUG - Pod : ctest-pod-85159051 UUID is de522f20-8669-441d-a711-165cae48a56f
2025-10-23 15:45:50,257 - DEBUG - Pod ctest-pod-49666761 not present
2025-10-23 15:45:50,257 - INFO - Creating Pod ctest-pod-49666761
2025-10-23 15:45:50,299 - DEBUG - Pod : ctest-pod-49666761 UUID is 3c3c946f-6a59-4216-a723-9d43f36dceba
2025-10-23 15:45:50,302 - DEBUG - Pod ctest-pod-58953554 not present
2025-10-23 15:45:50,310 - INFO - Creating Pod ctest-pod-58953554
2025-10-23 15:45:50,330 - DEBUG - Pod : ctest-pod-58953554 UUID is d3bd5571-24eb-4eb7-8967-72bda4c635e7
2025-10-23 15:45:50,333 - DEBUG - Pod ctest-pod-27062942 not present
2025-10-23 15:45:50,334 - INFO - Creating Pod ctest-pod-27062942
2025-10-23 15:45:50,357 - DEBUG - Pod : ctest-pod-27062942 UUID is 30de021e-ba83-4715-add0-4fe51b949ae8
2025-10-23 15:45:50,576 - INFO - Project default-domain:k8s-ctest-new-default-37395009 for Namespace ctest-new-default-37395009 is seen in contrail-api
2025-10-23 15:45:50,577 - DEBUG - Project uuid in Contrail is 18ca8f29-92bf-4196-b23f-a3320d1e5931
2025-10-23 15:45:50,777 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_NamespaceDatabaseList?namespace_uuid=e829045a-6471-4d41-8641-b01dce5e2c3e
2025-10-23 15:45:50,785 - INFO - Namespace ctest-new-default-37395009 with uuid e829045a-6471-4d41-8641-b01dce5e2c3e found in kube manager
2025-10-23 15:45:50,785 - INFO - Namespace ctest-new-default-37395009 verification passed
2025-10-23 15:45:51,017 - INFO - Project default-domain:k8s-ctest-non-default-43832061 for Namespace ctest-non-default-43832061 is seen in contrail-api
2025-10-23 15:45:51,018 - DEBUG - Project uuid in Contrail is 70f65922-181f-4482-a97c-91cac7cfb921
2025-10-23 15:45:51,018 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_NamespaceDatabaseList?namespace_uuid=dbb46ed1-e04e-4499-9a75-492a01d5a88c
2025-10-23 15:45:51,026 - INFO - Namespace ctest-non-default-43832061 with uuid dbb46ed1-e04e-4499-9a75-492a01d5a88c found in kube manager
2025-10-23 15:45:51,027 - INFO - Namespace ctest-non-default-43832061 verification passed
2025-10-23 15:45:51,038 - DEBUG - Pod ctest-pod-97722293 not in running state.Currently in Pending
2025-10-23 15:45:56,046 - DEBUG - Pod ctest-pod-97722293 not in running state.Currently in Pending
2025-10-23 15:46:01,054 - INFO - Pod ctest-pod-97722293 is in running state.Got IP 10.47.255.251
2025-10-23 15:46:01,110 - DEBUG - Pod ctest-pod-97722293 has vmi 5aa36ece-b027-11f0-8100-fa163eb276c7
2025-10-23 15:46:01,111 - INFO - Verified pod ctest-pod-97722293 in contrail-api
2025-10-23 15:46:01,122 - DEBUG - VMI 5aa36ece-b027-11f0-8100-fa163eb276c7 is active in agent 10.0.0.65
2025-10-23 15:46:01,123 - INFO - Verified Pod ctest-pod-97722293 in agent 10.0.0.65
2025-10-23 15:46:01,123 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=da54a85f-38b4-4c1c-afff-2c09b3536f03
2025-10-23 15:46:01,127 - INFO - Pod ctest-pod-97722293 with uuid da54a85f-38b4-4c1c-afff-2c09b3536f03 found in kube manager
2025-10-23 15:46:01,128 - INFO - Pod ctest-pod-97722293 verification passed
2025-10-23 15:46:01,136 - DEBUG - Pod ctest-pod-01329823 not in running state.Currently in Pending
2025-10-23 15:46:06,144 - INFO - Pod ctest-pod-01329823 is in running state.Got IP 10.47.255.250
2025-10-23 15:46:06,161 - DEBUG - Pod ctest-pod-01329823 has vmi 5b27db0a-b027-11f0-8100-fa163eb276c7
2025-10-23 15:46:06,161 - INFO - Verified pod ctest-pod-01329823 in contrail-api
2025-10-23 15:46:06,172 - DEBUG - VMI 5b27db0a-b027-11f0-8100-fa163eb276c7 is active in agent 10.0.0.65
2025-10-23 15:46:06,173 - INFO - Verified Pod ctest-pod-01329823 in agent 10.0.0.65
2025-10-23 15:46:06,173 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=57ec5d13-5e76-46bf-a5eb-ce0456a161f4
2025-10-23 15:46:06,177 - INFO - Pod ctest-pod-01329823 with uuid 57ec5d13-5e76-46bf-a5eb-ce0456a161f4 found in kube manager
2025-10-23 15:46:06,177 - INFO - Pod ctest-pod-01329823 verification passed
2025-10-23 15:46:06,185 - INFO - Pod ctest-pod-78586551 is in running state.Got IP 10.47.255.249
2025-10-23 15:46:06,242 - DEBUG - Pod ctest-pod-78586551 has vmi 5bcea32c-b027-11f0-8100-fa163eb276c7
2025-10-23 15:46:06,242 - INFO - Verified pod ctest-pod-78586551 in contrail-api
2025-10-23 15:46:06,256 - DEBUG - VMI 5bcea32c-b027-11f0-8100-fa163eb276c7 is active in agent 10.0.0.65
2025-10-23 15:46:06,256 - INFO - Verified Pod ctest-pod-78586551 in agent 10.0.0.65
2025-10-23 15:46:06,257 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=a92e55eb-6969-4d89-a462-c1e67c054eec
2025-10-23 15:46:06,262 - INFO - Pod ctest-pod-78586551 with uuid a92e55eb-6969-4d89-a462-c1e67c054eec found in kube manager
2025-10-23 15:46:06,262 - INFO - Pod ctest-pod-78586551 verification passed
2025-10-23 15:46:06,271 - INFO - Pod ctest-pod-95497524 is in running state.Got IP 10.47.255.248
2025-10-23 15:46:06,285 - DEBUG - Pod ctest-pod-95497524 has vmi 5c518d96-b027-11f0-8100-fa163eb276c7
2025-10-23 15:46:06,285 - INFO - Verified pod ctest-pod-95497524 in contrail-api
2025-10-23 15:46:06,296 - DEBUG - VMI 5c518d96-b027-11f0-8100-fa163eb276c7 is active in agent 10.0.0.65
2025-10-23 15:46:06,297 - INFO - Verified Pod ctest-pod-95497524 in agent 10.0.0.65
2025-10-23 15:46:06,297 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=95699c7f-d5e4-438c-b01a-a60495b8e3d2
2025-10-23 15:46:06,302 - INFO - Pod ctest-pod-95497524 with uuid 95699c7f-d5e4-438c-b01a-a60495b8e3d2 found in kube manager
2025-10-23 15:46:06,302 - INFO - Pod ctest-pod-95497524 verification passed
2025-10-23 15:46:06,311 - DEBUG - Pod ctest-pod-85159051 not in running state.Currently in Pending
2025-10-23 15:46:11,320 - INFO - Pod ctest-pod-85159051 is in running state.Got IP 10.47.255.247
2025-10-23 15:46:11,374 - DEBUG - Pod ctest-pod-85159051 has vmi 5ccfa618-b027-11f0-8100-fa163eb276c7
2025-10-23 15:46:11,374 - INFO - Verified pod ctest-pod-85159051 in contrail-api
2025-10-23 15:46:11,386 - DEBUG - VMI 5ccfa618-b027-11f0-8100-fa163eb276c7 is active in agent 10.0.0.65
2025-10-23 15:46:11,386 - INFO - Verified Pod ctest-pod-85159051 in agent 10.0.0.65
2025-10-23 15:46:11,387 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=de522f20-8669-441d-a711-165cae48a56f
2025-10-23 15:46:11,392 - INFO - Pod ctest-pod-85159051 with uuid de522f20-8669-441d-a711-165cae48a56f found in kube manager
2025-10-23 15:46:11,392 - INFO - Pod ctest-pod-85159051 verification passed
2025-10-23 15:46:11,400 - INFO - Pod ctest-pod-58953554 is in running state.Got IP 10.47.255.245
2025-10-23 15:46:11,415 - DEBUG - Pod ctest-pod-58953554 has vmi 5ddbb42a-b027-11f0-8100-fa163eb276c7
2025-10-23 15:46:11,415 - INFO - Verified pod ctest-pod-58953554 in contrail-api
2025-10-23 15:46:11,427 - DEBUG - VMI 5ddbb42a-b027-11f0-8100-fa163eb276c7 is active in agent 10.0.0.65
2025-10-23 15:46:11,427 - INFO - Verified Pod ctest-pod-58953554 in agent 10.0.0.65
2025-10-23 15:46:11,428 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=d3bd5571-24eb-4eb7-8967-72bda4c635e7
2025-10-23 15:46:11,432 - INFO - Pod ctest-pod-58953554 with uuid d3bd5571-24eb-4eb7-8967-72bda4c635e7 found in kube manager
2025-10-23 15:46:11,433 - INFO - Pod ctest-pod-58953554 verification passed
2025-10-23 15:46:11,441 - INFO - Pod ctest-pod-49666761 is in running state.Got IP 10.47.255.246
2025-10-23 15:46:11,498 - DEBUG - Pod ctest-pod-49666761 has vmi 5d4f7938-b027-11f0-8100-fa163eb276c7
2025-10-23 15:46:11,498 - INFO - Verified pod ctest-pod-49666761 in contrail-api
2025-10-23 15:46:11,513 - DEBUG - VMI 5d4f7938-b027-11f0-8100-fa163eb276c7 is active in agent 10.0.0.65
2025-10-23 15:46:11,513 - INFO - Verified Pod ctest-pod-49666761 in agent 10.0.0.65
2025-10-23 15:46:11,513 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=3c3c946f-6a59-4216-a723-9d43f36dceba
2025-10-23 15:46:11,517 - INFO - Pod ctest-pod-49666761 with uuid 3c3c946f-6a59-4216-a723-9d43f36dceba found in kube manager
2025-10-23 15:46:11,517 - INFO - Pod ctest-pod-49666761 verification passed
2025-10-23 15:46:11,523 - INFO - Pod ctest-pod-27062942 is in running state.Got IP 10.47.255.244
2025-10-23 15:46:11,578 - DEBUG - Pod ctest-pod-27062942 has vmi 5e5039ee-b027-11f0-8100-fa163eb276c7
2025-10-23 15:46:11,578 - INFO - Verified pod ctest-pod-27062942 in contrail-api
2025-10-23 15:46:11,589 - DEBUG - VMI 5e5039ee-b027-11f0-8100-fa163eb276c7 is active in agent 10.0.0.65
2025-10-23 15:46:11,590 - INFO - Verified Pod ctest-pod-27062942 in agent 10.0.0.65
2025-10-23 15:46:11,590 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=30de021e-ba83-4715-add0-4fe51b949ae8
2025-10-23 15:46:11,594 - INFO - Pod ctest-pod-27062942 with uuid 30de021e-ba83-4715-add0-4fe51b949ae8 found in kube manager
2025-10-23 15:46:11,594 - INFO - Pod ctest-pod-27062942 verification passed
2025-10-23 15:46:11,595 - INFO - ================================================================================
2025-10-23 15:46:11,595 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-10-23 15:46:11,595 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-10-23 15:46:11,821 - DEBUG - Nothing to compare xmpp stats {'10.0.0.65': {'10.0.0.38': '0'}} with
2025-10-23 15:46:11,821 - INFO - Initial checks done. Running the testcase now
2025-10-23 15:46:11,821 - INFO -
2025-10-23 15:46:11,877 - DEBUG - [Pod ctest-pod-97722293] Cmd: echo ctest-pod-97722293 > /usr/share/nginx/html/index.html, Output:
2025-10-23 15:46:11,928 - DEBUG - [Pod ctest-pod-01329823] Cmd: echo ctest-pod-01329823 > /usr/share/nginx/html/index.html, Output:
2025-10-23 15:46:11,978 - DEBUG - [Pod ctest-pod-78586551] Cmd: echo ctest-pod-78586551 > /usr/share/nginx/html/index.html, Output:
2025-10-23 15:46:12,025 - DEBUG - [Pod ctest-pod-95497524] Cmd: echo ctest-pod-95497524 > /usr/share/nginx/html/index.html, Output:
2025-10-23 15:46:12,028 - DEBUG - Service ctest-nginx-svc-22725214 not present
2025-10-23 15:46:12,029 - INFO - Creating service ctest-nginx-svc-22725214
2025-10-23 15:46:12,046 - INFO - Created Service ctest-nginx-svc-22725214
2025-10-23 15:46:12,054 - WARNING - Service UUID 1cb7256a-71f4-4e59-bebc-ce5355885078 not yet found in contrail-api
2025-10-23 15:46:13,069 - INFO - Validated that Service ctest-nginx-svc-22725214 is seen in contrail-api
2025-10-23 15:46:13,070 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_LoadbalancerDatabaseList?x=1cb7256a-71f4-4e59-bebc-ce5355885078
2025-10-23 15:46:13,074 - INFO - Service ctest-nginx-svc-22725214 with uuid 1cb7256a-71f4-4e59-bebc-ce5355885078 found in kube manager
2025-10-23 15:46:13,074 - INFO - Service ctest-nginx-svc-22725214 verification passed
2025-10-23 15:46:14,143 - DEBUG - [Pod ctest-pod-85159051] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
ctest-pod-97722293
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 15:46:14,143 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 passed
2025-10-23 15:46:14,143 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
ctest-pod-97722293
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 15:46:14,202 - DEBUG - [Pod ctest-pod-85159051] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: ctest-pod-01329823
Connecting to 10.102.138.41:80 (10.102.138.41:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 15:46:14,202 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 passed
2025-10-23 15:46:14,202 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd output: ctest-pod-01329823
Connecting to 10.102.138.41:80 (10.102.138.41:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 15:46:14,202 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-97722293': 1, 'ctest-pod-01329823': 1}
2025-10-23 15:46:14,255 - DEBUG - [Pod ctest-pod-58953554] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: ctest-pod-01329823
Connecting to 10.102.138.41:80 (10.102.138.41:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 15:46:14,255 - DEBUG - [Pod Pod ctest-pod-58953554] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 passed
2025-10-23 15:46:14,255 - DEBUG - [Pod Pod ctest-pod-58953554] Cmd output: ctest-pod-01329823
Connecting to 10.102.138.41:80 (10.102.138.41:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 15:46:14,315 - DEBUG - [Pod ctest-pod-58953554] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-01329823
2025-10-23 15:46:14,315 - DEBUG - [Pod Pod ctest-pod-58953554] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 passed
2025-10-23 15:46:14,315 - DEBUG - [Pod Pod ctest-pod-58953554] Cmd output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-01329823
2025-10-23 15:46:14,371 - DEBUG - [Pod ctest-pod-58953554] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: ctest-pod-97722293
Connecting to 10.102.138.41:80 (10.102.138.41:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 15:46:14,371 - DEBUG - [Pod Pod ctest-pod-58953554] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 passed
2025-10-23 15:46:14,371 - DEBUG - [Pod Pod ctest-pod-58953554] Cmd output: ctest-pod-97722293
Connecting to 10.102.138.41:80 (10.102.138.41:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 15:46:14,371 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-97722293': 1, 'ctest-pod-01329823': 2}
2025-10-23 15:46:14,374 - DEBUG - Network policy ingress-on-service not present
2025-10-23 15:46:14,375 - INFO - Creating Network Policy ingress-on-service
2025-10-23 15:46:14,397 - INFO - Network policy found in k8s
2025-10-23 15:46:14,397 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=37652aac-95e9-4a62-98ad-8295bf52ecef
2025-10-23 15:46:14,402 - INFO - Network Policy ingress-on-service with uuid 37652aac-95e9-4a62-98ad-8295bf52ecef found in kube manager
2025-10-23 15:46:14,431 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-10-23 15:46:14,432 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-10-23 15:46:14,432 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=37652aac-95e9-4a62-98ad-8295bf52ecef
2025-10-23 15:46:14,462 - WARNING - Network policy with name ingress-on-service not found in agent
2025-10-23 15:46:16,463 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=37652aac-95e9-4a62-98ad-8295bf52ecef
2025-10-23 15:46:16,488 - INFO - Network policy with name ingress-on-service found in agent
2025-10-23 15:46:16,488 - INFO - Network Policy ingress-on-service verification passed
2025-10-23 15:46:21,538 - DEBUG - [Pod ctest-pod-85159051] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:46:21,538 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:46:21,538 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:46:26,590 - DEBUG - [Pod ctest-pod-85159051] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:46:26,590 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:46:26,591 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:46:31,635 - DEBUG - [Pod ctest-pod-85159051] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:46:31,635 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:46:31,635 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:46:36,682 - DEBUG - [Pod ctest-pod-85159051] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:46:36,682 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:46:36,682 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:46:41,734 - DEBUG - [Pod ctest-pod-85159051] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:46:41,734 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:46:41,734 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:46:46,791 - DEBUG - [Pod ctest-pod-85159051] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:46:46,791 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:46:46,791 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:46:51,847 - DEBUG - [Pod ctest-pod-85159051] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:46:51,847 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:46:51,848 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:46:56,898 - DEBUG - [Pod ctest-pod-85159051] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:46:56,898 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:46:56,898 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:47:01,950 - DEBUG - [Pod ctest-pod-85159051] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:47:01,950 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:47:01,950 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:47:06,994 - DEBUG - [Pod ctest-pod-85159051] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:47:06,994 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:47:06,994 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:47:06,994 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-97722293': 0, 'ctest-pod-01329823': 0}
2025-10-23 15:47:07,053 - DEBUG - [Pod ctest-pod-49666761] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: ctest-pod-97722293
Connecting to 10.102.138.41:80 (10.102.138.41:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 15:47:07,053 - DEBUG - [Pod Pod ctest-pod-49666761] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 passed
2025-10-23 15:47:07,053 - DEBUG - [Pod Pod ctest-pod-49666761] Cmd output: ctest-pod-97722293
Connecting to 10.102.138.41:80 (10.102.138.41:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 15:47:07,109 - DEBUG - [Pod ctest-pod-49666761] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: ctest-pod-97722293
Connecting to 10.102.138.41:80 (10.102.138.41:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 15:47:07,110 - DEBUG - [Pod Pod ctest-pod-49666761] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 passed
2025-10-23 15:47:07,110 - DEBUG - [Pod Pod ctest-pod-49666761] Cmd output: ctest-pod-97722293
Connecting to 10.102.138.41:80 (10.102.138.41:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 15:47:07,170 - DEBUG - [Pod ctest-pod-49666761] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-97722293
2025-10-23 15:47:07,170 - DEBUG - [Pod Pod ctest-pod-49666761] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 passed
2025-10-23 15:47:07,170 - DEBUG - [Pod Pod ctest-pod-49666761] Cmd output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-97722293
2025-10-23 15:47:07,239 - DEBUG - [Pod ctest-pod-49666761] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: ctest-pod-97722293
Connecting to 10.102.138.41:80 (10.102.138.41:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 15:47:07,239 - DEBUG - [Pod Pod ctest-pod-49666761] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 passed
2025-10-23 15:47:07,239 - DEBUG - [Pod Pod ctest-pod-49666761] Cmd output: ctest-pod-97722293
Connecting to 10.102.138.41:80 (10.102.138.41:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 15:47:07,293 - DEBUG - [Pod ctest-pod-49666761] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: ctest-pod-97722293
Connecting to 10.102.138.41:80 (10.102.138.41:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 15:47:07,293 - DEBUG - [Pod Pod ctest-pod-49666761] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 passed
2025-10-23 15:47:07,293 - DEBUG - [Pod Pod ctest-pod-49666761] Cmd output: ctest-pod-97722293
Connecting to 10.102.138.41:80 (10.102.138.41:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 15:47:07,348 - DEBUG - [Pod ctest-pod-49666761] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: ctest-pod-97722293
Connecting to 10.102.138.41:80 (10.102.138.41:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 15:47:07,348 - DEBUG - [Pod Pod ctest-pod-49666761] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 passed
2025-10-23 15:47:07,348 - DEBUG - [Pod Pod ctest-pod-49666761] Cmd output: ctest-pod-97722293
Connecting to 10.102.138.41:80 (10.102.138.41:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 15:47:07,400 - DEBUG - [Pod ctest-pod-49666761] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: ctest-pod-01329823
Connecting to 10.102.138.41:80 (10.102.138.41:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 15:47:07,401 - DEBUG - [Pod Pod ctest-pod-49666761] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 passed
2025-10-23 15:47:07,401 - DEBUG - [Pod Pod ctest-pod-49666761] Cmd output: ctest-pod-01329823
Connecting to 10.102.138.41:80 (10.102.138.41:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 15:47:07,401 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-97722293': 6, 'ctest-pod-01329823': 1}
2025-10-23 15:47:12,451 - DEBUG - [Pod ctest-pod-58953554] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:47:12,451 - DEBUG - [Pod Pod ctest-pod-58953554] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:47:12,451 - DEBUG - [Pod Pod ctest-pod-58953554] Cmd output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:47:17,498 - DEBUG - [Pod ctest-pod-58953554] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:47:17,498 - DEBUG - [Pod Pod ctest-pod-58953554] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:47:17,498 - DEBUG - [Pod Pod ctest-pod-58953554] Cmd output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:47:22,542 - DEBUG - [Pod ctest-pod-58953554] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:47:22,542 - DEBUG - [Pod Pod ctest-pod-58953554] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:47:22,542 - DEBUG - [Pod Pod ctest-pod-58953554] Cmd output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:47:27,594 - DEBUG - [Pod ctest-pod-58953554] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:47:27,594 - DEBUG - [Pod Pod ctest-pod-58953554] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:47:27,594 - DEBUG - [Pod Pod ctest-pod-58953554] Cmd output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:47:32,648 - DEBUG - [Pod ctest-pod-58953554] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:47:32,648 - DEBUG - [Pod Pod ctest-pod-58953554] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:47:32,648 - DEBUG - [Pod Pod ctest-pod-58953554] Cmd output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:47:37,706 - DEBUG - [Pod ctest-pod-58953554] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:47:37,706 - DEBUG - [Pod Pod ctest-pod-58953554] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:47:37,706 - DEBUG - [Pod Pod ctest-pod-58953554] Cmd output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:47:42,755 - DEBUG - [Pod ctest-pod-58953554] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:47:42,756 - DEBUG - [Pod Pod ctest-pod-58953554] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:47:42,756 - DEBUG - [Pod Pod ctest-pod-58953554] Cmd output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:47:47,810 - DEBUG - [Pod ctest-pod-58953554] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:47:47,810 - DEBUG - [Pod Pod ctest-pod-58953554] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:47:47,810 - DEBUG - [Pod Pod ctest-pod-58953554] Cmd output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:47:52,879 - DEBUG - [Pod ctest-pod-58953554] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:47:52,881 - DEBUG - [Pod Pod ctest-pod-58953554] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:47:52,881 - DEBUG - [Pod Pod ctest-pod-58953554] Cmd output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:47:57,925 - DEBUG - [Pod ctest-pod-58953554] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:47:57,926 - DEBUG - [Pod Pod ctest-pod-58953554] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:47:57,926 - DEBUG - [Pod Pod ctest-pod-58953554] Cmd output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:47:57,926 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-97722293': 0, 'ctest-pod-01329823': 0}
2025-10-23 15:47:59,978 - DEBUG - [Pod ctest-pod-49666761] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.797 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.125 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.085 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.085/0.335/0.797 ms
2025-10-23 15:47:59,978 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-49666761 with expectation True passed
2025-10-23 15:48:02,030 - DEBUG - [Pod ctest-pod-85159051] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.662 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.072 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.075 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.072/0.269/0.662 ms
2025-10-23 15:48:02,031 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-85159051 with expectation True passed
2025-10-23 15:48:04,078 - DEBUG - [Pod ctest-pod-58953554] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.658 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.100 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.070/0.276/0.658 ms
2025-10-23 15:48:04,078 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-58953554 with expectation True passed
2025-10-23 15:48:04,134 - DEBUG - [Pod ctest-pod-49666761] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-23 15:48:04,134 - DEBUG - [Pod Pod ctest-pod-49666761] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-10-23 15:48:04,134 - DEBUG - [Pod Pod ctest-pod-49666761] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-23 15:48:04,134 - INFO - wget check of of http://10.47.255.251 from ctest-pod-49666761 passed
2025-10-23 15:48:04,184 - DEBUG - [Pod ctest-pod-49666761] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-23 15:48:04,184 - DEBUG - [Pod Pod ctest-pod-49666761] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-10-23 15:48:04,185 - DEBUG - [Pod Pod ctest-pod-49666761] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-23 15:48:04,185 - INFO - wget check of of http://10.47.255.250 from ctest-pod-49666761 passed
2025-10-23 15:48:09,238 - DEBUG - [Pod ctest-pod-85159051] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-10-23 15:48:09,238 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-10-23 15:48:09,238 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-10-23 15:48:09,238 - INFO - wget check of of http://10.47.255.250 from ctest-pod-85159051 passed
2025-10-23 15:48:14,291 - DEBUG - [Pod ctest-pod-27062942] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-10-23 15:48:14,292 - DEBUG - [Pod Pod ctest-pod-27062942] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-10-23 15:48:14,292 - DEBUG - [Pod Pod ctest-pod-27062942] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-10-23 15:48:14,292 - INFO - wget check of of http://10.47.255.251 from ctest-pod-27062942 passed
2025-10-23 15:48:14,301 - INFO - Updating Network Policy ingress-on-service
2025-10-23 15:48:19,358 - DEBUG - [Pod ctest-pod-85159051] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:48:19,358 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:48:19,358 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:48:24,417 - DEBUG - [Pod ctest-pod-85159051] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:48:24,417 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:48:24,417 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:48:29,474 - DEBUG - [Pod ctest-pod-85159051] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:48:29,474 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:48:29,474 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:48:34,526 - DEBUG - [Pod ctest-pod-85159051] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:48:34,526 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:48:34,526 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:48:36,159 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2025-10-23 15:48:46,225 - DEBUG - [Pod ctest-pod-85159051] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:48:46,225 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:48:46,225 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:48:51,282 - DEBUG - [Pod ctest-pod-85159051] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:48:51,282 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:48:51,282 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:48:56,343 - DEBUG - [Pod ctest-pod-85159051] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:48:56,343 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:48:56,343 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:49:01,390 - DEBUG - [Pod ctest-pod-85159051] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:49:01,391 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:49:01,391 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:49:06,442 - DEBUG - [Pod ctest-pod-85159051] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:49:06,442 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:49:06,442 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:49:11,495 - DEBUG - [Pod ctest-pod-85159051] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:49:11,496 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:49:11,496 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
wget: download timed out
2025-10-23 15:49:11,496 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-97722293': 0, 'ctest-pod-01329823': 0}
2025-10-23 15:49:11,548 - DEBUG - [Pod ctest-pod-49666761] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-97722293
2025-10-23 15:49:11,548 - DEBUG - [Pod Pod ctest-pod-49666761] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 passed
2025-10-23 15:49:11,548 - DEBUG - [Pod Pod ctest-pod-49666761] Cmd output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-97722293
2025-10-23 15:49:11,600 - DEBUG - [Pod ctest-pod-49666761] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: ctest-pod-01329823
Connecting to 10.102.138.41:80 (10.102.138.41:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 15:49:11,600 - DEBUG - [Pod Pod ctest-pod-49666761] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 passed
2025-10-23 15:49:11,600 - DEBUG - [Pod Pod ctest-pod-49666761] Cmd output: ctest-pod-01329823
Connecting to 10.102.138.41:80 (10.102.138.41:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 15:49:11,600 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-97722293': 1, 'ctest-pod-01329823': 1}
2025-10-23 15:49:11,654 - DEBUG - [Pod ctest-pod-58953554] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-97722293
2025-10-23 15:49:11,654 - DEBUG - [Pod Pod ctest-pod-58953554] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 passed
2025-10-23 15:49:11,654 - DEBUG - [Pod Pod ctest-pod-58953554] Cmd output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-97722293
2025-10-23 15:49:11,709 - DEBUG - [Pod ctest-pod-58953554] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-97722293
2025-10-23 15:49:11,709 - DEBUG - [Pod Pod ctest-pod-58953554] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 passed
2025-10-23 15:49:11,709 - DEBUG - [Pod Pod ctest-pod-58953554] Cmd output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-97722293
2025-10-23 15:49:11,768 - DEBUG - [Pod ctest-pod-58953554] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: ctest-pod-97722293
Connecting to 10.102.138.41:80 (10.102.138.41:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 15:49:11,768 - DEBUG - [Pod Pod ctest-pod-58953554] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 passed
2025-10-23 15:49:11,768 - DEBUG - [Pod Pod ctest-pod-58953554] Cmd output: ctest-pod-97722293
Connecting to 10.102.138.41:80 (10.102.138.41:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-23 15:49:11,816 - DEBUG - [Pod ctest-pod-58953554] Cmd: wget http://10.102.138.41:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-01329823
2025-10-23 15:49:11,816 - DEBUG - [Pod Pod ctest-pod-58953554] Cmd wget http://10.102.138.41:80/ -O - -T 5 -t 1 passed
2025-10-23 15:49:11,816 - DEBUG - [Pod Pod ctest-pod-58953554] Cmd output: Connecting to 10.102.138.41:80 (10.102.138.41:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-01329823
2025-10-23 15:49:11,816 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-97722293': 3, 'ctest-pod-01329823': 1}
2025-10-23 15:49:13,875 - DEBUG - [Pod ctest-pod-49666761] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.358 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.062 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.067 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.062/0.162/0.358 ms
2025-10-23 15:49:13,875 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-49666761 with expectation True passed
2025-10-23 15:49:15,926 - DEBUG - [Pod ctest-pod-85159051] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.437 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.068 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.069 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.068/0.191/0.437 ms
2025-10-23 15:49:15,926 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-85159051 with expectation True passed
2025-10-23 15:49:17,983 - DEBUG - [Pod ctest-pod-58953554] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.486 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.086 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.070/0.214/0.486 ms
2025-10-23 15:49:17,983 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-58953554 with expectation True passed
2025-10-23 15:49:18,035 - DEBUG - [Pod ctest-pod-49666761] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-23 15:49:18,035 - DEBUG - [Pod Pod ctest-pod-49666761] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-10-23 15:49:18,035 - DEBUG - [Pod Pod ctest-pod-49666761] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-23 15:49:18,035 - INFO - wget check of of http://10.47.255.251 from ctest-pod-49666761 passed
2025-10-23 15:49:18,087 - DEBUG - [Pod ctest-pod-49666761] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-23 15:49:18,088 - DEBUG - [Pod Pod ctest-pod-49666761] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-10-23 15:49:18,088 - DEBUG - [Pod Pod ctest-pod-49666761] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-23 15:49:18,088 - INFO - wget check of of http://10.47.255.250 from ctest-pod-49666761 passed
2025-10-23 15:49:23,138 - DEBUG - [Pod ctest-pod-85159051] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-10-23 15:49:23,138 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-10-23 15:49:23,138 - DEBUG - [Pod Pod ctest-pod-85159051] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-10-23 15:49:23,138 - INFO - wget check of of http://10.47.255.250 from ctest-pod-85159051 passed
2025-10-23 15:49:23,193 - DEBUG - [Pod ctest-pod-27062942] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-23 15:49:23,193 - DEBUG - [Pod Pod ctest-pod-27062942] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-10-23 15:49:23,193 - DEBUG - [Pod Pod ctest-pod-27062942] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-23 15:49:23,193 - INFO - wget check of of http://10.47.255.251 from ctest-pod-27062942 passed
2025-10-23 15:49:23,193 - INFO - Deleting Network Policy : ingress-on-service
2025-10-23 15:49:23,194 - INFO - Deleting service : ctest-nginx-svc-22725214
2025-10-23 15:49:23,428 - DEBUG - No XMPP flaps were noticed during the test
2025-10-23 15:49:23,428 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:12]
2025-10-23 15:49:23,428 - INFO - --------------------------------------------------------------------------------
2025-10-23 15:49:23,433 - INFO - Deleting pod ctest-new-default-37395009:ctest-pod-97722293
2025-10-23 15:49:23,433 - INFO - Deleting pod ctest-new-default-37395009:ctest-pod-01329823
2025-10-23 15:49:23,434 - INFO - Deleting pod ctest-non-default-43832061:ctest-pod-78586551
2025-10-23 15:49:23,434 - INFO - Deleting pod ctest-non-default-43832061:ctest-pod-95497524
2025-10-23 15:49:23,435 - INFO - Deleting pod ctest-new-default-37395009:ctest-pod-85159051
2025-10-23 15:49:23,435 - INFO - Deleting pod ctest-new-default-37395009:ctest-pod-49666761
2025-10-23 15:49:23,436 - INFO - Deleting pod ctest-non-default-43832061:ctest-pod-58953554
2025-10-23 15:49:23,436 - INFO - Deleting pod ctest-non-default-43832061:ctest-pod-27062942
2025-10-23 15:49:23,588 - WARNING - Pod uuid 95699c7f-d5e4-438c-b01a-a60495b8e3d2 is still seen in agent 10.0.0.65 VM list
2025-10-23 15:49:23,588 - WARNING - Pod uuid de522f20-8669-441d-a711-165cae48a56f is still seen in agent 10.0.0.65 VM list
2025-10-23 15:49:23,588 - WARNING - Pod uuid d3bd5571-24eb-4eb7-8967-72bda4c635e7 is still seen in agent 10.0.0.65 VM list
2025-10-23 15:49:23,590 - WARNING - Pod uuid 57ec5d13-5e76-46bf-a5eb-ce0456a161f4 is still seen in agent 10.0.0.65 VM list
2025-10-23 15:49:23,590 - WARNING - Pod uuid 30de021e-ba83-4715-add0-4fe51b949ae8 is still seen in agent 10.0.0.65 VM list
2025-10-23 15:49:23,590 - WARNING - Pod uuid a92e55eb-6969-4d89-a462-c1e67c054eec is still seen in agent 10.0.0.65 VM list
2025-10-23 15:49:23,591 - WARNING - Pod uuid da54a85f-38b4-4c1c-afff-2c09b3536f03 is still seen in agent 10.0.0.65 VM list
2025-10-23 15:49:23,591 - WARNING - Pod uuid 3c3c946f-6a59-4216-a723-9d43f36dceba is still seen in agent 10.0.0.65 VM list
2025-10-23 15:49:28,614 - DEBUG - Pod a92e55eb-6969-4d89-a462-c1e67c054eec is not in agent 10.0.0.65 VM list
2025-10-23 15:49:28,616 - WARNING - Pod uuid de522f20-8669-441d-a711-165cae48a56f is still seen in agent 10.0.0.65 VM list
2025-10-23 15:49:28,618 - WARNING - Pod uuid 30de021e-ba83-4715-add0-4fe51b949ae8 is still seen in agent 10.0.0.65 VM list
2025-10-23 15:49:28,619 - WARNING - Pod uuid 3c3c946f-6a59-4216-a723-9d43f36dceba is still seen in agent 10.0.0.65 VM list
2025-10-23 15:49:28,620 - DEBUG - Pod da54a85f-38b4-4c1c-afff-2c09b3536f03 is not in agent 10.0.0.65 VM list
2025-10-23 15:49:28,621 - WARNING - Pod uuid 57ec5d13-5e76-46bf-a5eb-ce0456a161f4 is still seen in agent 10.0.0.65 VM list
2025-10-23 15:49:28,621 - DEBUG - Pod 95699c7f-d5e4-438c-b01a-a60495b8e3d2 is not in agent 10.0.0.65 VM list
2025-10-23 15:49:28,622 - WARNING - Pod uuid d3bd5571-24eb-4eb7-8967-72bda4c635e7 is still seen in agent 10.0.0.65 VM list
2025-10-23 15:49:28,631 - DEBUG - VMI 5bcea32c-b027-11f0-8100-fa163eb276c7 is removed from agent 10.0.0.65
2025-10-23 15:49:28,631 - INFO - Verified that pod ctest-pod-78586551 is removed in agent
2025-10-23 15:49:28,633 - DEBUG - VMI 5c518d96-b027-11f0-8100-fa163eb276c7 is removed from agent 10.0.0.65
2025-10-23 15:49:28,633 - INFO - Verified that pod ctest-pod-95497524 is removed in agent
2025-10-23 15:49:28,633 - DEBUG - VMI 5aa36ece-b027-11f0-8100-fa163eb276c7 is removed from agent 10.0.0.65
2025-10-23 15:49:28,633 - INFO - Verified that pod ctest-pod-97722293 is removed in agent
2025-10-23 15:49:33,649 - WARNING - Pod uuid de522f20-8669-441d-a711-165cae48a56f is still seen in agent 10.0.0.65 VM list
2025-10-23 15:49:33,668 - WARNING - Pod uuid d3bd5571-24eb-4eb7-8967-72bda4c635e7 is still seen in agent 10.0.0.65 VM list
2025-10-23 15:49:33,669 - WARNING - Pod uuid 30de021e-ba83-4715-add0-4fe51b949ae8 is still seen in agent 10.0.0.65 VM list
2025-10-23 15:49:33,670 - WARNING - Pod uuid 57ec5d13-5e76-46bf-a5eb-ce0456a161f4 is still seen in agent 10.0.0.65 VM list
2025-10-23 15:49:33,671 - WARNING - Pod uuid 3c3c946f-6a59-4216-a723-9d43f36dceba is still seen in agent 10.0.0.65 VM list
2025-10-23 15:49:38,659 - WARNING - Pod uuid de522f20-8669-441d-a711-165cae48a56f is still seen in agent 10.0.0.65 VM list
2025-10-23 15:49:38,685 - WARNING - Pod uuid 57ec5d13-5e76-46bf-a5eb-ce0456a161f4 is still seen in agent 10.0.0.65 VM list
2025-10-23 15:49:38,686 - WARNING - Pod uuid d3bd5571-24eb-4eb7-8967-72bda4c635e7 is still seen in agent 10.0.0.65 VM list
2025-10-23 15:49:38,688 - WARNING - Pod uuid 3c3c946f-6a59-4216-a723-9d43f36dceba is still seen in agent 10.0.0.65 VM list
2025-10-23 15:49:38,689 - WARNING - Pod uuid 30de021e-ba83-4715-add0-4fe51b949ae8 is still seen in agent 10.0.0.65 VM list
2025-10-23 15:49:43,667 - WARNING - Pod uuid de522f20-8669-441d-a711-165cae48a56f is still seen in agent 10.0.0.65 VM list
2025-10-23 15:49:43,695 - WARNING - Pod uuid 57ec5d13-5e76-46bf-a5eb-ce0456a161f4 is still seen in agent 10.0.0.65 VM list
2025-10-23 15:49:43,696 - WARNING - Pod uuid d3bd5571-24eb-4eb7-8967-72bda4c635e7 is still seen in agent 10.0.0.65 VM list
2025-10-23 15:49:43,699 - WARNING - Pod uuid 3c3c946f-6a59-4216-a723-9d43f36dceba is still seen in agent 10.0.0.65 VM list
2025-10-23 15:49:43,700 - WARNING - Pod uuid 30de021e-ba83-4715-add0-4fe51b949ae8 is still seen in agent 10.0.0.65 VM list
2025-10-23 15:49:48,674 - WARNING - Pod uuid de522f20-8669-441d-a711-165cae48a56f is still seen in agent 10.0.0.65 VM list
2025-10-23 15:49:48,712 - WARNING - Pod uuid 57ec5d13-5e76-46bf-a5eb-ce0456a161f4 is still seen in agent 10.0.0.65 VM list
2025-10-23 15:49:48,713 - WARNING - Pod uuid d3bd5571-24eb-4eb7-8967-72bda4c635e7 is still seen in agent 10.0.0.65 VM list
2025-10-23 15:49:48,716 - WARNING - Pod uuid 3c3c946f-6a59-4216-a723-9d43f36dceba is still seen in agent 10.0.0.65 VM list
2025-10-23 15:49:48,717 - WARNING - Pod uuid 30de021e-ba83-4715-add0-4fe51b949ae8 is still seen in agent 10.0.0.65 VM list
2025-10-23 15:49:53,685 - WARNING - Pod uuid de522f20-8669-441d-a711-165cae48a56f is still seen in agent 10.0.0.65 VM list
2025-10-23 15:49:53,731 - WARNING - Pod uuid 3c3c946f-6a59-4216-a723-9d43f36dceba is still seen in agent 10.0.0.65 VM list
2025-10-23 15:49:53,731 - WARNING - Pod uuid 57ec5d13-5e76-46bf-a5eb-ce0456a161f4 is still seen in agent 10.0.0.65 VM list
2025-10-23 15:49:53,733 - WARNING - Pod uuid 30de021e-ba83-4715-add0-4fe51b949ae8 is still seen in agent 10.0.0.65 VM list
2025-10-23 15:49:53,733 - WARNING - Pod uuid d3bd5571-24eb-4eb7-8967-72bda4c635e7 is still seen in agent 10.0.0.65 VM list
2025-10-23 15:49:58,692 - DEBUG - Pod de522f20-8669-441d-a711-165cae48a56f is not in agent 10.0.0.65 VM list
2025-10-23 15:49:58,697 - DEBUG - VMI 5ccfa618-b027-11f0-8100-fa163eb276c7 is removed from agent 10.0.0.65
2025-10-23 15:49:58,697 - INFO - Verified that pod ctest-pod-85159051 is removed in agent
2025-10-23 15:49:58,745 - DEBUG - Pod 3c3c946f-6a59-4216-a723-9d43f36dceba is not in agent 10.0.0.65 VM list
2025-10-23 15:49:58,747 - DEBUG - Pod 57ec5d13-5e76-46bf-a5eb-ce0456a161f4 is not in agent 10.0.0.65 VM list
2025-10-23 15:49:58,750 - DEBUG - Pod 30de021e-ba83-4715-add0-4fe51b949ae8 is not in agent 10.0.0.65 VM list
2025-10-23 15:49:58,751 - DEBUG - Pod d3bd5571-24eb-4eb7-8967-72bda4c635e7 is not in agent 10.0.0.65 VM list
2025-10-23 15:49:58,753 - DEBUG - VMI 5b27db0a-b027-11f0-8100-fa163eb276c7 is removed from agent 10.0.0.65
2025-10-23 15:49:58,753 - INFO - Verified that pod ctest-pod-01329823 is removed in agent
2025-10-23 15:49:58,755 - DEBUG - VMI 5d4f7938-b027-11f0-8100-fa163eb276c7 is removed from agent 10.0.0.65
2025-10-23 15:49:58,755 - INFO - Verified that pod ctest-pod-49666761 is removed in agent
2025-10-23 15:49:58,758 - DEBUG - VMI 5e5039ee-b027-11f0-8100-fa163eb276c7 is removed from agent 10.0.0.65
2025-10-23 15:49:58,758 - INFO - Verified that pod ctest-pod-27062942 is removed in agent
2025-10-23 15:49:58,759 - DEBUG - VMI 5ddbb42a-b027-11f0-8100-fa163eb276c7 is removed from agent 10.0.0.65
2025-10-23 15:49:58,759 - INFO - Verified that pod ctest-pod-58953554 is removed in agent
2025-10-23 15:49:58,760 - INFO - Deleting namespace ctest-non-default-43832061
2025-10-23 15:49:58,782 - DEBUG - Namespace ctest-non-default-43832061 still in k8s
2025-10-23 15:50:00,790 - DEBUG - Namespace ctest-non-default-43832061 still in k8s
2025-10-23 15:50:02,796 - DEBUG - Namespace ctest-non-default-43832061 still in k8s
2025-10-23 15:50:04,800 - DEBUG - Namespace ctest-non-default-43832061 is not in k8s
2025-10-23 15:50:04,800 - DEBUG - No need to check project deletion in contrail-api
2025-10-23 15:50:04,800 - INFO - Deleting namespace ctest-new-default-37395009
2025-10-23 15:50:04,814 - DEBUG - Namespace ctest-new-default-37395009 still in k8s
2025-10-23 15:50:06,821 - DEBUG - Namespace ctest-new-default-37395009 still in k8s
2025-10-23 15:50:08,828 - DEBUG - Namespace ctest-new-default-37395009 still in k8s
2025-10-23 15:50:10,832 - DEBUG - Namespace ctest-new-default-37395009 is not in k8s
2025-10-23 15:50:10,832 - DEBUG - No need to check project deletion in contrail-api