2025-02-03 02:11:58,724 - INFO - Using existing project ['default-domain', 'k8s-default'](2c765f4d-9eca-4693-b812-2e89d6a04b86)
2025-02-03 02:11:58,744 - DEBUG - Namespace ctest-new-default-92963620 not present
2025-02-03 02:11:58,758 - INFO - Created namespace ctest-new-default-92963620
2025-02-03 02:12:01,764 - DEBUG - Namespace ctest-non-default-52035414 not present
2025-02-03 02:12:01,778 - INFO - Created namespace ctest-non-default-52035414
2025-02-03 02:12:04,830 - DEBUG - Pod ctest-pod-11860040 not present
2025-02-03 02:12:04,831 - INFO - Creating Pod ctest-pod-11860040
2025-02-03 02:12:04,864 - DEBUG - Pod : ctest-pod-11860040 UUID is 4f077550-647b-43ba-a71e-d3634853bb68
2025-02-03 02:12:04,878 - DEBUG - Pod ctest-pod-46617919 not present
2025-02-03 02:12:04,879 - INFO - Creating Pod ctest-pod-46617919
2025-02-03 02:12:04,905 - DEBUG - Pod : ctest-pod-46617919 UUID is 9b93121c-fc21-4566-a2b8-cdd837b298a3
2025-02-03 02:12:04,911 - DEBUG - Pod ctest-pod-47295219 not present
2025-02-03 02:12:04,911 - INFO - Creating Pod ctest-pod-47295219
2025-02-03 02:12:04,981 - DEBUG - Pod : ctest-pod-47295219 UUID is 097b957d-5b66-4b90-8a9c-1b6dc9af6241
2025-02-03 02:12:04,991 - DEBUG - Pod ctest-pod-99925021 not present
2025-02-03 02:12:04,991 - INFO - Creating Pod ctest-pod-99925021
2025-02-03 02:12:05,035 - DEBUG - Pod : ctest-pod-99925021 UUID is d2d367ea-927a-4de6-814e-7e5559d5d948
2025-02-03 02:12:05,042 - DEBUG - Pod ctest-pod-58477135 not present
2025-02-03 02:12:05,043 - INFO - Creating Pod ctest-pod-58477135
2025-02-03 02:12:05,061 - DEBUG - Pod : ctest-pod-58477135 UUID is 6b716665-3a3e-4d5e-8e6c-accc22a58eac
2025-02-03 02:12:05,066 - DEBUG - Pod ctest-pod-32536949 not present
2025-02-03 02:12:05,066 - INFO - Creating Pod ctest-pod-32536949
2025-02-03 02:12:05,089 - DEBUG - Pod : ctest-pod-32536949 UUID is 2b4e7481-8c95-472b-b26e-ae6b859699b8
2025-02-03 02:12:05,092 - DEBUG - Pod ctest-pod-37595663 not present
2025-02-03 02:12:05,092 - INFO - Creating Pod ctest-pod-37595663
2025-02-03 02:12:05,145 - DEBUG - Pod : ctest-pod-37595663 UUID is d5875482-6ffc-4522-8dd7-8cc11187b98a
2025-02-03 02:12:05,157 - DEBUG - Pod ctest-pod-14418433 not present
2025-02-03 02:12:05,158 - INFO - Creating Pod ctest-pod-14418433
2025-02-03 02:12:05,181 - DEBUG - Pod : ctest-pod-14418433 UUID is 3c99e133-d91a-401d-a427-14ba6120095e
2025-02-03 02:12:05,425 - INFO - Project default-domain:k8s-ctest-new-default-92963620 for Namespace ctest-new-default-92963620 is seen in contrail-api
2025-02-03 02:12:05,425 - DEBUG - Project uuid in Contrail is ab709028-3c55-4c03-b05b-023d11656716
2025-02-03 02:12:05,717 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_NamespaceDatabaseList?namespace_uuid=c42079e3-a8fc-46d8-b330-c06fd6879e1f
2025-02-03 02:12:05,728 - INFO - Namespace ctest-new-default-92963620 with uuid c42079e3-a8fc-46d8-b330-c06fd6879e1f found in kube manager
2025-02-03 02:12:05,729 - INFO - Namespace ctest-new-default-92963620 verification passed
2025-02-03 02:12:06,025 - INFO - Project default-domain:k8s-ctest-non-default-52035414 for Namespace ctest-non-default-52035414 is seen in contrail-api
2025-02-03 02:12:06,025 - DEBUG - Project uuid in Contrail is 925da3bb-ae31-491c-8b82-8dfebdf06b4a
2025-02-03 02:12:06,025 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_NamespaceDatabaseList?namespace_uuid=d5306a3c-d9f7-42ba-a13f-22e8538930d5
2025-02-03 02:12:06,033 - INFO - Namespace ctest-non-default-52035414 with uuid d5306a3c-d9f7-42ba-a13f-22e8538930d5 found in kube manager
2025-02-03 02:12:06,033 - INFO - Namespace ctest-non-default-52035414 verification passed
2025-02-03 02:12:06,041 - DEBUG - Pod ctest-pod-11860040 not in running state.Currently in Pending
2025-02-03 02:12:11,053 - DEBUG - Pod ctest-pod-11860040 not in running state.Currently in Pending
2025-02-03 02:12:16,068 - INFO - Pod ctest-pod-11860040 is in running state.Got IP 10.47.255.251
2025-02-03 02:12:16,154 - DEBUG - Pod ctest-pod-11860040 has vmi 4496aece-e1d4-11ef-9e73-fa163ed09ba8
2025-02-03 02:12:16,154 - INFO - Verified pod ctest-pod-11860040 in contrail-api
2025-02-03 02:12:16,169 - DEBUG - VMI 4496aece-e1d4-11ef-9e73-fa163ed09ba8 is active in agent 10.0.0.22
2025-02-03 02:12:16,169 - INFO - Verified Pod ctest-pod-11860040 in agent 10.0.0.22
2025-02-03 02:12:16,170 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_VirtualMachineDatabaseList?x=4f077550-647b-43ba-a71e-d3634853bb68
2025-02-03 02:12:16,197 - INFO - Pod ctest-pod-11860040 with uuid 4f077550-647b-43ba-a71e-d3634853bb68 found in kube manager
2025-02-03 02:12:16,197 - INFO - Pod ctest-pod-11860040 verification passed
2025-02-03 02:12:16,205 - DEBUG - Pod ctest-pod-46617919 not in running state.Currently in Pending
2025-02-03 02:12:21,213 - INFO - Pod ctest-pod-46617919 is in running state.Got IP 10.47.255.250
2025-02-03 02:12:21,230 - DEBUG - Pod ctest-pod-46617919 has vmi 453cdc72-e1d4-11ef-9e73-fa163ed09ba8
2025-02-03 02:12:21,230 - INFO - Verified pod ctest-pod-46617919 in contrail-api
2025-02-03 02:12:21,244 - DEBUG - VMI 453cdc72-e1d4-11ef-9e73-fa163ed09ba8 is active in agent 10.0.0.22
2025-02-03 02:12:21,245 - INFO - Verified Pod ctest-pod-46617919 in agent 10.0.0.22
2025-02-03 02:12:21,245 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_VirtualMachineDatabaseList?x=9b93121c-fc21-4566-a2b8-cdd837b298a3
2025-02-03 02:12:21,250 - INFO - Pod ctest-pod-46617919 with uuid 9b93121c-fc21-4566-a2b8-cdd837b298a3 found in kube manager
2025-02-03 02:12:21,251 - INFO - Pod ctest-pod-46617919 verification passed
2025-02-03 02:12:21,257 - INFO - Pod ctest-pod-47295219 is in running state.Got IP 10.47.255.249
2025-02-03 02:12:21,320 - DEBUG - Pod ctest-pod-47295219 has vmi 463306c4-e1d4-11ef-9e73-fa163ed09ba8
2025-02-03 02:12:21,320 - INFO - Verified pod ctest-pod-47295219 in contrail-api
2025-02-03 02:12:21,337 - DEBUG - VMI 463306c4-e1d4-11ef-9e73-fa163ed09ba8 is active in agent 10.0.0.22
2025-02-03 02:12:21,338 - INFO - Verified Pod ctest-pod-47295219 in agent 10.0.0.22
2025-02-03 02:12:21,338 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_VirtualMachineDatabaseList?x=097b957d-5b66-4b90-8a9c-1b6dc9af6241
2025-02-03 02:12:21,344 - INFO - Pod ctest-pod-47295219 with uuid 097b957d-5b66-4b90-8a9c-1b6dc9af6241 found in kube manager
2025-02-03 02:12:21,344 - INFO - Pod ctest-pod-47295219 verification passed
2025-02-03 02:12:21,351 - INFO - Pod ctest-pod-99925021 is in running state.Got IP 10.47.255.248
2025-02-03 02:12:21,413 - DEBUG - Pod ctest-pod-99925021 has vmi 46e9ee34-e1d4-11ef-9e73-fa163ed09ba8
2025-02-03 02:12:21,413 - INFO - Verified pod ctest-pod-99925021 in contrail-api
2025-02-03 02:12:21,427 - DEBUG - VMI 46e9ee34-e1d4-11ef-9e73-fa163ed09ba8 is active in agent 10.0.0.22
2025-02-03 02:12:21,427 - INFO - Verified Pod ctest-pod-99925021 in agent 10.0.0.22
2025-02-03 02:12:21,428 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_VirtualMachineDatabaseList?x=d2d367ea-927a-4de6-814e-7e5559d5d948
2025-02-03 02:12:21,439 - INFO - Pod ctest-pod-99925021 with uuid d2d367ea-927a-4de6-814e-7e5559d5d948 found in kube manager
2025-02-03 02:12:21,439 - INFO - Pod ctest-pod-99925021 verification passed
2025-02-03 02:12:21,445 - DEBUG - Pod ctest-pod-58477135 not in running state.Currently in Pending
2025-02-03 02:12:26,455 - DEBUG - Pod ctest-pod-58477135 not in running state.Currently in Pending
2025-02-03 02:12:31,466 - INFO - Pod ctest-pod-58477135 is in running state.Got IP 10.47.255.247
2025-02-03 02:12:31,495 - DEBUG - Pod ctest-pod-58477135 has vmi 479f28c6-e1d4-11ef-9e73-fa163ed09ba8
2025-02-03 02:12:31,496 - INFO - Verified pod ctest-pod-58477135 in contrail-api
2025-02-03 02:12:31,513 - DEBUG - VMI 479f28c6-e1d4-11ef-9e73-fa163ed09ba8 is active in agent 10.0.0.22
2025-02-03 02:12:31,513 - INFO - Verified Pod ctest-pod-58477135 in agent 10.0.0.22
2025-02-03 02:12:31,513 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_VirtualMachineDatabaseList?x=6b716665-3a3e-4d5e-8e6c-accc22a58eac
2025-02-03 02:12:31,523 - INFO - Pod ctest-pod-58477135 with uuid 6b716665-3a3e-4d5e-8e6c-accc22a58eac found in kube manager
2025-02-03 02:12:31,523 - INFO - Pod ctest-pod-58477135 verification passed
2025-02-03 02:12:31,532 - INFO - Pod ctest-pod-37595663 is in running state.Got IP 10.47.255.245
2025-02-03 02:12:31,564 - DEBUG - Pod ctest-pod-37595663 has vmi 491e001e-e1d4-11ef-9e73-fa163ed09ba8
2025-02-03 02:12:31,565 - INFO - Verified pod ctest-pod-37595663 in contrail-api
2025-02-03 02:12:31,599 - DEBUG - VMI 491e001e-e1d4-11ef-9e73-fa163ed09ba8 is active in agent 10.0.0.22
2025-02-03 02:12:31,601 - INFO - Verified Pod ctest-pod-37595663 in agent 10.0.0.22
2025-02-03 02:12:31,602 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_VirtualMachineDatabaseList?x=d5875482-6ffc-4522-8dd7-8cc11187b98a
2025-02-03 02:12:31,626 - INFO - Pod ctest-pod-37595663 with uuid d5875482-6ffc-4522-8dd7-8cc11187b98a found in kube manager
2025-02-03 02:12:31,626 - INFO - Pod ctest-pod-37595663 verification passed
2025-02-03 02:12:31,641 - INFO - Pod ctest-pod-32536949 is in running state.Got IP 10.47.255.246
2025-02-03 02:12:31,725 - DEBUG - Pod ctest-pod-32536949 has vmi 486ca094-e1d4-11ef-9e73-fa163ed09ba8
2025-02-03 02:12:31,725 - INFO - Verified pod ctest-pod-32536949 in contrail-api
2025-02-03 02:12:31,748 - DEBUG - VMI 486ca094-e1d4-11ef-9e73-fa163ed09ba8 is active in agent 10.0.0.22
2025-02-03 02:12:31,749 - INFO - Verified Pod ctest-pod-32536949 in agent 10.0.0.22
2025-02-03 02:12:31,750 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_VirtualMachineDatabaseList?x=2b4e7481-8c95-472b-b26e-ae6b859699b8
2025-02-03 02:12:31,760 - INFO - Pod ctest-pod-32536949 with uuid 2b4e7481-8c95-472b-b26e-ae6b859699b8 found in kube manager
2025-02-03 02:12:31,760 - INFO - Pod ctest-pod-32536949 verification passed
2025-02-03 02:12:31,775 - INFO - Pod ctest-pod-14418433 is in running state.Got IP 10.47.255.244
2025-02-03 02:12:31,801 - DEBUG - Pod ctest-pod-14418433 has vmi 49cac25e-e1d4-11ef-9e73-fa163ed09ba8
2025-02-03 02:12:31,802 - INFO - Verified pod ctest-pod-14418433 in contrail-api
2025-02-03 02:12:31,824 - DEBUG - VMI 49cac25e-e1d4-11ef-9e73-fa163ed09ba8 is active in agent 10.0.0.22
2025-02-03 02:12:31,824 - INFO - Verified Pod ctest-pod-14418433 in agent 10.0.0.22
2025-02-03 02:12:31,824 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_VirtualMachineDatabaseList?x=3c99e133-d91a-401d-a427-14ba6120095e
2025-02-03 02:12:31,836 - INFO - Pod ctest-pod-14418433 with uuid 3c99e133-d91a-401d-a427-14ba6120095e found in kube manager
2025-02-03 02:12:31,836 - INFO - Pod ctest-pod-14418433 verification passed
2025-02-03 02:12:31,836 - INFO - ================================================================================
2025-02-03 02:12:31,836 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-02-03 02:12:31,843 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-02-03 02:12:32,129 - DEBUG - Nothing to compare xmpp stats {'10.0.0.22': {'10.0.0.28': '0'}} with
2025-02-03 02:12:32,129 - INFO - Initial checks done. Running the testcase now
2025-02-03 02:12:32,129 - INFO -
2025-02-03 02:12:32,217 - DEBUG - [Pod ctest-pod-11860040] Cmd: echo ctest-pod-11860040 > /usr/share/nginx/html/index.html, Output:
2025-02-03 02:12:32,301 - DEBUG - [Pod ctest-pod-46617919] Cmd: echo ctest-pod-46617919 > /usr/share/nginx/html/index.html, Output:
2025-02-03 02:12:32,392 - DEBUG - [Pod ctest-pod-47295219] Cmd: echo ctest-pod-47295219 > /usr/share/nginx/html/index.html, Output:
2025-02-03 02:12:32,486 - DEBUG - [Pod ctest-pod-99925021] Cmd: echo ctest-pod-99925021 > /usr/share/nginx/html/index.html, Output:
2025-02-03 02:12:32,492 - DEBUG - Service ctest-nginx-svc-71954695 not present
2025-02-03 02:12:32,492 - INFO - Creating service ctest-nginx-svc-71954695
2025-02-03 02:12:32,517 - INFO - Created Service ctest-nginx-svc-71954695
2025-02-03 02:12:32,544 - WARNING - Service UUID 71d0c71c-12bd-4373-82ec-61a7428f56ef not yet found in contrail-api
2025-02-03 02:12:33,573 - INFO - Validated that Service ctest-nginx-svc-71954695 is seen in contrail-api
2025-02-03 02:12:33,573 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_LoadbalancerDatabaseList?x=71d0c71c-12bd-4373-82ec-61a7428f56ef
2025-02-03 02:12:33,590 - INFO - Service ctest-nginx-svc-71954695 with uuid 71d0c71c-12bd-4373-82ec-61a7428f56ef found in kube manager
2025-02-03 02:12:33,590 - INFO - Service ctest-nginx-svc-71954695 verification passed
2025-02-03 02:12:34,108 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2025-02-03 02:12:39,174 - DEBUG - [Pod ctest-pod-58477135] Cmd: wget http://10.106.16.110:80/ -O - -T 5 -t 1 , Output: ctest-pod-46617919
Connecting to 10.106.16.110:80 (10.106.16.110:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-03 02:12:39,174 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd wget http://10.106.16.110:80/ -O - -T 5 -t 1 passed
2025-02-03 02:12:39,175 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd output: ctest-pod-46617919
Connecting to 10.106.16.110:80 (10.106.16.110:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-03 02:12:39,259 - DEBUG - [Pod ctest-pod-58477135] Cmd: wget http://10.106.16.110:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-11860040
2025-02-03 02:12:39,259 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd wget http://10.106.16.110:80/ -O - -T 5 -t 1 passed
2025-02-03 02:12:39,259 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-11860040
2025-02-03 02:12:39,259 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-11860040': 1, 'ctest-pod-46617919': 1}
2025-02-03 02:12:39,342 - DEBUG - [Pod ctest-pod-37595663] Cmd: wget http://10.106.16.110:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
ctest-pod-11860040
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-03 02:12:39,342 - DEBUG - [Pod Pod ctest-pod-37595663] Cmd wget http://10.106.16.110:80/ -O - -T 5 -t 1 passed
2025-02-03 02:12:39,342 - DEBUG - [Pod Pod ctest-pod-37595663] Cmd output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
ctest-pod-11860040
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-03 02:12:39,411 - DEBUG - [Pod ctest-pod-37595663] Cmd: wget http://10.106.16.110:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
ctest-pod-46617919
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-03 02:12:39,411 - DEBUG - [Pod Pod ctest-pod-37595663] Cmd wget http://10.106.16.110:80/ -O - -T 5 -t 1 passed
2025-02-03 02:12:39,411 - DEBUG - [Pod Pod ctest-pod-37595663] Cmd output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
ctest-pod-46617919
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-03 02:12:39,411 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-11860040': 1, 'ctest-pod-46617919': 1}
2025-02-03 02:12:39,414 - DEBUG - Network policy ingress-on-service not present
2025-02-03 02:12:39,492 - INFO - Creating Network Policy ingress-on-service
2025-02-03 02:12:39,505 - INFO - Network policy found in k8s
2025-02-03 02:12:39,505 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=bcf48c67-d529-4fdb-94bb-486d0916476b
2025-02-03 02:12:39,516 - INFO - Network Policy ingress-on-service with uuid bcf48c67-d529-4fdb-94bb-486d0916476b found in kube manager
2025-02-03 02:12:39,564 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-02-03 02:12:39,565 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-02-03 02:12:39,565 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=bcf48c67-d529-4fdb-94bb-486d0916476b
2025-02-03 02:12:39,606 - WARNING - Network policy with name ingress-on-service not found in agent
2025-02-03 02:12:41,607 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=bcf48c67-d529-4fdb-94bb-486d0916476b
2025-02-03 02:12:41,649 - INFO - Network policy with name ingress-on-service found in agent
2025-02-03 02:12:41,650 - INFO - Network Policy ingress-on-service verification passed
2025-02-03 02:12:46,713 - DEBUG - [Pod ctest-pod-58477135] Cmd: wget http://10.106.16.110:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:12:46,713 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd wget http://10.106.16.110:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:12:46,713 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:12:51,789 - DEBUG - [Pod ctest-pod-58477135] Cmd: wget http://10.106.16.110:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:12:51,789 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd wget http://10.106.16.110:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:12:51,789 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:12:56,863 - DEBUG - [Pod ctest-pod-58477135] Cmd: wget http://10.106.16.110:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:12:56,863 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd wget http://10.106.16.110:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:12:56,863 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:13:01,943 - DEBUG - [Pod ctest-pod-58477135] Cmd: wget http://10.106.16.110:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:13:01,943 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd wget http://10.106.16.110:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:13:01,943 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:13:07,008 - DEBUG - [Pod ctest-pod-58477135] Cmd: wget http://10.106.16.110:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:13:07,008 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd wget http://10.106.16.110:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:13:07,008 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:13:12,075 - DEBUG - [Pod ctest-pod-58477135] Cmd: wget http://10.106.16.110:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:13:12,075 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd wget http://10.106.16.110:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:13:12,075 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:13:17,157 - DEBUG - [Pod ctest-pod-58477135] Cmd: wget http://10.106.16.110:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:13:17,158 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd wget http://10.106.16.110:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:13:17,158 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:13:22,220 - DEBUG - [Pod ctest-pod-58477135] Cmd: wget http://10.106.16.110:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:13:22,221 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd wget http://10.106.16.110:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:13:22,221 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:13:27,279 - DEBUG - [Pod ctest-pod-58477135] Cmd: wget http://10.106.16.110:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:13:27,279 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd wget http://10.106.16.110:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:13:27,279 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:13:32,339 - DEBUG - [Pod ctest-pod-58477135] Cmd: wget http://10.106.16.110:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:13:32,339 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd wget http://10.106.16.110:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:13:32,339 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:13:32,339 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-11860040': 0, 'ctest-pod-46617919': 0}
2025-02-03 02:13:32,407 - DEBUG - [Pod ctest-pod-32536949] Cmd: wget http://10.106.16.110:80/ -O - -T 5 -t 1 , Output: ctest-pod-11860040
Connecting to 10.106.16.110:80 (10.106.16.110:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-03 02:13:32,407 - DEBUG - [Pod Pod ctest-pod-32536949] Cmd wget http://10.106.16.110:80/ -O - -T 5 -t 1 passed
2025-02-03 02:13:32,407 - DEBUG - [Pod Pod ctest-pod-32536949] Cmd output: ctest-pod-11860040
Connecting to 10.106.16.110:80 (10.106.16.110:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-03 02:13:32,471 - DEBUG - [Pod ctest-pod-32536949] Cmd: wget http://10.106.16.110:80/ -O - -T 5 -t 1 , Output: ctest-pod-11860040
Connecting to 10.106.16.110:80 (10.106.16.110:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-03 02:13:32,471 - DEBUG - [Pod Pod ctest-pod-32536949] Cmd wget http://10.106.16.110:80/ -O - -T 5 -t 1 passed
2025-02-03 02:13:32,471 - DEBUG - [Pod Pod ctest-pod-32536949] Cmd output: ctest-pod-11860040
Connecting to 10.106.16.110:80 (10.106.16.110:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-03 02:13:32,545 - DEBUG - [Pod ctest-pod-32536949] Cmd: wget http://10.106.16.110:80/ -O - -T 5 -t 1 , Output: ctest-pod-11860040
Connecting to 10.106.16.110:80 (10.106.16.110:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-03 02:13:32,545 - DEBUG - [Pod Pod ctest-pod-32536949] Cmd wget http://10.106.16.110:80/ -O - -T 5 -t 1 passed
2025-02-03 02:13:32,545 - DEBUG - [Pod Pod ctest-pod-32536949] Cmd output: ctest-pod-11860040
Connecting to 10.106.16.110:80 (10.106.16.110:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-03 02:13:32,610 - DEBUG - [Pod ctest-pod-32536949] Cmd: wget http://10.106.16.110:80/ -O - -T 5 -t 1 , Output: ctest-pod-11860040
Connecting to 10.106.16.110:80 (10.106.16.110:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-03 02:13:32,610 - DEBUG - [Pod Pod ctest-pod-32536949] Cmd wget http://10.106.16.110:80/ -O - -T 5 -t 1 passed
2025-02-03 02:13:32,610 - DEBUG - [Pod Pod ctest-pod-32536949] Cmd output: ctest-pod-11860040
Connecting to 10.106.16.110:80 (10.106.16.110:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-03 02:13:32,679 - DEBUG - [Pod ctest-pod-32536949] Cmd: wget http://10.106.16.110:80/ -O - -T 5 -t 1 , Output: ctest-pod-11860040
Connecting to 10.106.16.110:80 (10.106.16.110:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-03 02:13:32,679 - DEBUG - [Pod Pod ctest-pod-32536949] Cmd wget http://10.106.16.110:80/ -O - -T 5 -t 1 passed
2025-02-03 02:13:32,679 - DEBUG - [Pod Pod ctest-pod-32536949] Cmd output: ctest-pod-11860040
Connecting to 10.106.16.110:80 (10.106.16.110:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-03 02:13:32,747 - DEBUG - [Pod ctest-pod-32536949] Cmd: wget http://10.106.16.110:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
ctest-pod-46617919
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-03 02:13:32,747 - DEBUG - [Pod Pod ctest-pod-32536949] Cmd wget http://10.106.16.110:80/ -O - -T 5 -t 1 passed
2025-02-03 02:13:32,747 - DEBUG - [Pod Pod ctest-pod-32536949] Cmd output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
ctest-pod-46617919
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-03 02:13:32,747 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-11860040': 5, 'ctest-pod-46617919': 1}
2025-02-03 02:13:37,817 - DEBUG - [Pod ctest-pod-37595663] Cmd: wget http://10.106.16.110:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:13:37,817 - DEBUG - [Pod Pod ctest-pod-37595663] Cmd wget http://10.106.16.110:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:13:37,817 - DEBUG - [Pod Pod ctest-pod-37595663] Cmd output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:13:42,871 - DEBUG - [Pod ctest-pod-37595663] Cmd: wget http://10.106.16.110:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:13:42,871 - DEBUG - [Pod Pod ctest-pod-37595663] Cmd wget http://10.106.16.110:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:13:42,871 - DEBUG - [Pod Pod ctest-pod-37595663] Cmd output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:13:47,937 - DEBUG - [Pod ctest-pod-37595663] Cmd: wget http://10.106.16.110:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:13:47,937 - DEBUG - [Pod Pod ctest-pod-37595663] Cmd wget http://10.106.16.110:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:13:47,937 - DEBUG - [Pod Pod ctest-pod-37595663] Cmd output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:13:53,004 - DEBUG - [Pod ctest-pod-37595663] Cmd: wget http://10.106.16.110:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:13:53,004 - DEBUG - [Pod Pod ctest-pod-37595663] Cmd wget http://10.106.16.110:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:13:53,004 - DEBUG - [Pod Pod ctest-pod-37595663] Cmd output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:13:58,067 - DEBUG - [Pod ctest-pod-37595663] Cmd: wget http://10.106.16.110:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:13:58,067 - DEBUG - [Pod Pod ctest-pod-37595663] Cmd wget http://10.106.16.110:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:13:58,067 - DEBUG - [Pod Pod ctest-pod-37595663] Cmd output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:14:03,123 - DEBUG - [Pod ctest-pod-37595663] Cmd: wget http://10.106.16.110:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:14:03,123 - DEBUG - [Pod Pod ctest-pod-37595663] Cmd wget http://10.106.16.110:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:14:03,123 - DEBUG - [Pod Pod ctest-pod-37595663] Cmd output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:14:08,189 - DEBUG - [Pod ctest-pod-37595663] Cmd: wget http://10.106.16.110:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:14:08,189 - DEBUG - [Pod Pod ctest-pod-37595663] Cmd wget http://10.106.16.110:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:14:08,189 - DEBUG - [Pod Pod ctest-pod-37595663] Cmd output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:14:13,259 - DEBUG - [Pod ctest-pod-37595663] Cmd: wget http://10.106.16.110:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:14:13,259 - DEBUG - [Pod Pod ctest-pod-37595663] Cmd wget http://10.106.16.110:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:14:13,259 - DEBUG - [Pod Pod ctest-pod-37595663] Cmd output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:14:18,323 - DEBUG - [Pod ctest-pod-37595663] Cmd: wget http://10.106.16.110:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:14:18,324 - DEBUG - [Pod Pod ctest-pod-37595663] Cmd wget http://10.106.16.110:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:14:18,324 - DEBUG - [Pod Pod ctest-pod-37595663] Cmd output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:14:23,399 - DEBUG - [Pod ctest-pod-37595663] Cmd: wget http://10.106.16.110:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:14:23,399 - DEBUG - [Pod Pod ctest-pod-37595663] Cmd wget http://10.106.16.110:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:14:23,399 - DEBUG - [Pod Pod ctest-pod-37595663] Cmd output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:14:23,399 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-11860040': 0, 'ctest-pod-46617919': 0}
2025-02-03 02:14:25,464 - DEBUG - [Pod ctest-pod-32536949] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.335 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.093 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.132 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.093/0.520/1.335 ms
2025-02-03 02:14:25,464 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-32536949 with expectation True passed
2025-02-03 02:14:27,522 - DEBUG - [Pod ctest-pod-58477135] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.054 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.100 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.086 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.086/0.413/1.054 ms
2025-02-03 02:14:27,522 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-58477135 with expectation True passed
2025-02-03 02:14:29,587 - DEBUG - [Pod ctest-pod-37595663] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.498 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.081 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.097 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.081/0.558/1.498 ms
2025-02-03 02:14:29,587 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-37595663 with expectation True passed
2025-02-03 02:14:29,660 - DEBUG - [Pod ctest-pod-32536949] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-03 02:14:29,660 - DEBUG - [Pod Pod ctest-pod-32536949] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-02-03 02:14:29,660 - DEBUG - [Pod Pod ctest-pod-32536949] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-03 02:14:29,660 - INFO - wget check of of http://10.47.255.251 from ctest-pod-32536949 passed
2025-02-03 02:14:29,723 - DEBUG - [Pod ctest-pod-32536949] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-03 02:14:29,723 - DEBUG - [Pod Pod ctest-pod-32536949] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-02-03 02:14:29,723 - DEBUG - [Pod Pod ctest-pod-32536949] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-03 02:14:29,723 - INFO - wget check of of http://10.47.255.250 from ctest-pod-32536949 passed
2025-02-03 02:14:34,799 - DEBUG - [Pod ctest-pod-58477135] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-02-03 02:14:34,799 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-02-03 02:14:34,799 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-02-03 02:14:34,799 - INFO - wget check of of http://10.47.255.250 from ctest-pod-58477135 passed
2025-02-03 02:14:39,867 - DEBUG - [Pod ctest-pod-14418433] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-02-03 02:14:39,867 - DEBUG - [Pod Pod ctest-pod-14418433] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-02-03 02:14:39,867 - DEBUG - [Pod Pod ctest-pod-14418433] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-02-03 02:14:39,867 - INFO - wget check of of http://10.47.255.251 from ctest-pod-14418433 passed
2025-02-03 02:14:39,875 - INFO - Updating Network Policy ingress-on-service
2025-02-03 02:14:44,939 - DEBUG - [Pod ctest-pod-58477135] Cmd: wget http://10.106.16.110:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:14:44,939 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd wget http://10.106.16.110:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:14:44,939 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:14:49,999 - DEBUG - [Pod ctest-pod-58477135] Cmd: wget http://10.106.16.110:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:14:50,000 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd wget http://10.106.16.110:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:14:50,000 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:14:55,060 - DEBUG - [Pod ctest-pod-58477135] Cmd: wget http://10.106.16.110:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:14:55,060 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd wget http://10.106.16.110:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:14:55,060 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:15:00,121 - DEBUG - [Pod ctest-pod-58477135] Cmd: wget http://10.106.16.110:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:15:00,121 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd wget http://10.106.16.110:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:15:00,122 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:15:05,180 - DEBUG - [Pod ctest-pod-58477135] Cmd: wget http://10.106.16.110:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:15:05,180 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd wget http://10.106.16.110:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:15:05,180 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:15:10,259 - DEBUG - [Pod ctest-pod-58477135] Cmd: wget http://10.106.16.110:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:15:10,260 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd wget http://10.106.16.110:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:15:10,260 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:15:15,324 - DEBUG - [Pod ctest-pod-58477135] Cmd: wget http://10.106.16.110:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:15:15,324 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd wget http://10.106.16.110:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:15:15,324 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:15:20,403 - DEBUG - [Pod ctest-pod-58477135] Cmd: wget http://10.106.16.110:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:15:20,403 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd wget http://10.106.16.110:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:15:20,403 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:15:25,485 - DEBUG - [Pod ctest-pod-58477135] Cmd: wget http://10.106.16.110:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:15:25,485 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd wget http://10.106.16.110:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:15:25,485 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:15:30,547 - DEBUG - [Pod ctest-pod-58477135] Cmd: wget http://10.106.16.110:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:15:30,547 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd wget http://10.106.16.110:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:15:30,547 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
wget: download timed out
2025-02-03 02:15:30,547 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-11860040': 0, 'ctest-pod-46617919': 0}
2025-02-03 02:15:30,625 - DEBUG - [Pod ctest-pod-32536949] Cmd: wget http://10.106.16.110:80/ -O - -T 5 -t 1 , Output: ctest-pod-46617919
Connecting to 10.106.16.110:80 (10.106.16.110:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-03 02:15:30,625 - DEBUG - [Pod Pod ctest-pod-32536949] Cmd wget http://10.106.16.110:80/ -O - -T 5 -t 1 passed
2025-02-03 02:15:30,625 - DEBUG - [Pod Pod ctest-pod-32536949] Cmd output: ctest-pod-46617919
Connecting to 10.106.16.110:80 (10.106.16.110:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-03 02:15:30,697 - DEBUG - [Pod ctest-pod-32536949] Cmd: wget http://10.106.16.110:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-46617919
2025-02-03 02:15:30,697 - DEBUG - [Pod Pod ctest-pod-32536949] Cmd wget http://10.106.16.110:80/ -O - -T 5 -t 1 passed
2025-02-03 02:15:30,697 - DEBUG - [Pod Pod ctest-pod-32536949] Cmd output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-46617919
2025-02-03 02:15:30,766 - DEBUG - [Pod ctest-pod-32536949] Cmd: wget http://10.106.16.110:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-11860040
2025-02-03 02:15:30,766 - DEBUG - [Pod Pod ctest-pod-32536949] Cmd wget http://10.106.16.110:80/ -O - -T 5 -t 1 passed
2025-02-03 02:15:30,766 - DEBUG - [Pod Pod ctest-pod-32536949] Cmd output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-11860040
2025-02-03 02:15:30,766 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-11860040': 1, 'ctest-pod-46617919': 2}
2025-02-03 02:15:30,834 - DEBUG - [Pod ctest-pod-37595663] Cmd: wget http://10.106.16.110:80/ -O - -T 5 -t 1 , Output: ctest-pod-46617919
Connecting to 10.106.16.110:80 (10.106.16.110:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-03 02:15:30,834 - DEBUG - [Pod Pod ctest-pod-37595663] Cmd wget http://10.106.16.110:80/ -O - -T 5 -t 1 passed
2025-02-03 02:15:30,834 - DEBUG - [Pod Pod ctest-pod-37595663] Cmd output: ctest-pod-46617919
Connecting to 10.106.16.110:80 (10.106.16.110:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-03 02:15:30,891 - DEBUG - [Pod ctest-pod-37595663] Cmd: wget http://10.106.16.110:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-46617919
2025-02-03 02:15:30,891 - DEBUG - [Pod Pod ctest-pod-37595663] Cmd wget http://10.106.16.110:80/ -O - -T 5 -t 1 passed
2025-02-03 02:15:30,891 - DEBUG - [Pod Pod ctest-pod-37595663] Cmd output: Connecting to 10.106.16.110:80 (10.106.16.110:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-46617919
2025-02-03 02:15:30,969 - DEBUG - [Pod ctest-pod-37595663] Cmd: wget http://10.106.16.110:80/ -O - -T 5 -t 1 , Output: ctest-pod-11860040
Connecting to 10.106.16.110:80 (10.106.16.110:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-03 02:15:30,969 - DEBUG - [Pod Pod ctest-pod-37595663] Cmd wget http://10.106.16.110:80/ -O - -T 5 -t 1 passed
2025-02-03 02:15:30,969 - DEBUG - [Pod Pod ctest-pod-37595663] Cmd output: ctest-pod-11860040
Connecting to 10.106.16.110:80 (10.106.16.110:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-03 02:15:30,969 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-11860040': 1, 'ctest-pod-46617919': 2}
2025-02-03 02:15:33,034 - DEBUG - [Pod ctest-pod-32536949] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.959 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.077 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.084 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.077/0.373/0.959 ms
2025-02-03 02:15:33,034 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-32536949 with expectation True passed
2025-02-03 02:15:35,205 - DEBUG - [Pod ctest-pod-58477135] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.261 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.088 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.098 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.088/0.149/0.261 ms
2025-02-03 02:15:35,205 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-58477135 with expectation True passed
2025-02-03 02:15:37,267 - DEBUG - [Pod ctest-pod-37595663] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.205 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.065 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.093 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.065/0.454/1.205 ms
2025-02-03 02:15:37,267 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-37595663 with expectation True passed
2025-02-03 02:15:37,349 - DEBUG - [Pod ctest-pod-32536949] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-03 02:15:37,349 - DEBUG - [Pod Pod ctest-pod-32536949] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-02-03 02:15:37,349 - DEBUG - [Pod Pod ctest-pod-32536949] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-03 02:15:37,349 - INFO - wget check of of http://10.47.255.251 from ctest-pod-32536949 passed
2025-02-03 02:15:37,406 - DEBUG - [Pod ctest-pod-32536949] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-03 02:15:37,406 - DEBUG - [Pod Pod ctest-pod-32536949] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-02-03 02:15:37,406 - DEBUG - [Pod Pod ctest-pod-32536949] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-03 02:15:37,406 - INFO - wget check of of http://10.47.255.250 from ctest-pod-32536949 passed
2025-02-03 02:15:42,487 - DEBUG - [Pod ctest-pod-58477135] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-02-03 02:15:42,488 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-02-03 02:15:42,488 - DEBUG - [Pod Pod ctest-pod-58477135] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-02-03 02:15:42,488 - INFO - wget check of of http://10.47.255.250 from ctest-pod-58477135 passed
2025-02-03 02:15:42,542 - DEBUG - [Pod ctest-pod-14418433] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-03 02:15:42,542 - DEBUG - [Pod Pod ctest-pod-14418433] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-02-03 02:15:42,542 - DEBUG - [Pod Pod ctest-pod-14418433] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-03 02:15:42,543 - INFO - wget check of of http://10.47.255.251 from ctest-pod-14418433 passed
2025-02-03 02:15:42,543 - INFO - Deleting Network Policy : ingress-on-service
2025-02-03 02:15:42,543 - INFO - Deleting service : ctest-nginx-svc-71954695
2025-02-03 02:15:42,742 - DEBUG - No XMPP flaps were noticed during the test
2025-02-03 02:15:42,742 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:11]
2025-02-03 02:15:42,742 - INFO - --------------------------------------------------------------------------------
2025-02-03 02:15:42,747 - INFO - Deleting pod ctest-new-default-92963620:ctest-pod-11860040
2025-02-03 02:15:42,748 - INFO - Deleting pod ctest-new-default-92963620:ctest-pod-46617919
2025-02-03 02:15:42,748 - INFO - Deleting pod ctest-non-default-52035414:ctest-pod-47295219
2025-02-03 02:15:42,749 - INFO - Deleting pod ctest-non-default-52035414:ctest-pod-99925021
2025-02-03 02:15:42,749 - INFO - Deleting pod ctest-new-default-92963620:ctest-pod-58477135
2025-02-03 02:15:42,750 - INFO - Deleting pod ctest-new-default-92963620:ctest-pod-32536949
2025-02-03 02:15:42,750 - INFO - Deleting pod ctest-non-default-52035414:ctest-pod-37595663
2025-02-03 02:15:42,750 - INFO - Deleting pod ctest-non-default-52035414:ctest-pod-14418433
2025-02-03 02:15:42,969 - WARNING - Pod uuid d2d367ea-927a-4de6-814e-7e5559d5d948 is still seen in agent 10.0.0.22 VM list
2025-02-03 02:15:42,969 - WARNING - Pod uuid 097b957d-5b66-4b90-8a9c-1b6dc9af6241 is still seen in agent 10.0.0.22 VM list
2025-02-03 02:15:42,970 - WARNING - Pod uuid 2b4e7481-8c95-472b-b26e-ae6b859699b8 is still seen in agent 10.0.0.22 VM list
2025-02-03 02:15:42,970 - WARNING - Pod uuid 9b93121c-fc21-4566-a2b8-cdd837b298a3 is still seen in agent 10.0.0.22 VM list
2025-02-03 02:15:42,970 - WARNING - Pod uuid 4f077550-647b-43ba-a71e-d3634853bb68 is still seen in agent 10.0.0.22 VM list
2025-02-03 02:15:42,971 - WARNING - Pod uuid 3c99e133-d91a-401d-a427-14ba6120095e is still seen in agent 10.0.0.22 VM list
2025-02-03 02:15:42,972 - WARNING - Pod uuid d5875482-6ffc-4522-8dd7-8cc11187b98a is still seen in agent 10.0.0.22 VM list
2025-02-03 02:15:42,972 - WARNING - Pod uuid 6b716665-3a3e-4d5e-8e6c-accc22a58eac is still seen in agent 10.0.0.22 VM list
2025-02-03 02:15:48,016 - WARNING - Pod uuid d5875482-6ffc-4522-8dd7-8cc11187b98a is still seen in agent 10.0.0.22 VM list
2025-02-03 02:15:48,017 - WARNING - Pod uuid 6b716665-3a3e-4d5e-8e6c-accc22a58eac is still seen in agent 10.0.0.22 VM list
2025-02-03 02:15:48,017 - WARNING - Pod uuid 3c99e133-d91a-401d-a427-14ba6120095e is still seen in agent 10.0.0.22 VM list
2025-02-03 02:15:48,018 - WARNING - Pod uuid 9b93121c-fc21-4566-a2b8-cdd837b298a3 is still seen in agent 10.0.0.22 VM list
2025-02-03 02:15:48,018 - WARNING - Pod uuid 2b4e7481-8c95-472b-b26e-ae6b859699b8 is still seen in agent 10.0.0.22 VM list
2025-02-03 02:15:48,018 - DEBUG - Pod 4f077550-647b-43ba-a71e-d3634853bb68 is not in agent 10.0.0.22 VM list
2025-02-03 02:15:48,020 - DEBUG - Pod 097b957d-5b66-4b90-8a9c-1b6dc9af6241 is not in agent 10.0.0.22 VM list
2025-02-03 02:15:48,022 - DEBUG - Pod d2d367ea-927a-4de6-814e-7e5559d5d948 is not in agent 10.0.0.22 VM list
2025-02-03 02:15:48,033 - DEBUG - VMI 4496aece-e1d4-11ef-9e73-fa163ed09ba8 is removed from agent 10.0.0.22
2025-02-03 02:15:48,033 - INFO - Verified that pod ctest-pod-11860040 is removed in agent
2025-02-03 02:15:48,035 - DEBUG - VMI 46e9ee34-e1d4-11ef-9e73-fa163ed09ba8 is removed from agent 10.0.0.22
2025-02-03 02:15:48,035 - INFO - Verified that pod ctest-pod-99925021 is removed in agent
2025-02-03 02:15:48,036 - DEBUG - VMI 463306c4-e1d4-11ef-9e73-fa163ed09ba8 is removed from agent 10.0.0.22
2025-02-03 02:15:48,036 - INFO - Verified that pod ctest-pod-47295219 is removed in agent
2025-02-03 02:15:53,048 - WARNING - Pod uuid 9b93121c-fc21-4566-a2b8-cdd837b298a3 is still seen in agent 10.0.0.22 VM list
2025-02-03 02:15:53,048 - WARNING - Pod uuid 6b716665-3a3e-4d5e-8e6c-accc22a58eac is still seen in agent 10.0.0.22 VM list
2025-02-03 02:15:53,048 - WARNING - Pod uuid 2b4e7481-8c95-472b-b26e-ae6b859699b8 is still seen in agent 10.0.0.22 VM list
2025-02-03 02:15:53,049 - WARNING - Pod uuid d5875482-6ffc-4522-8dd7-8cc11187b98a is still seen in agent 10.0.0.22 VM list
2025-02-03 02:15:53,050 - WARNING - Pod uuid 3c99e133-d91a-401d-a427-14ba6120095e is still seen in agent 10.0.0.22 VM list
2025-02-03 02:15:58,078 - WARNING - Pod uuid 6b716665-3a3e-4d5e-8e6c-accc22a58eac is still seen in agent 10.0.0.22 VM list
2025-02-03 02:15:58,079 - WARNING - Pod uuid 9b93121c-fc21-4566-a2b8-cdd837b298a3 is still seen in agent 10.0.0.22 VM list
2025-02-03 02:15:58,079 - WARNING - Pod uuid 3c99e133-d91a-401d-a427-14ba6120095e is still seen in agent 10.0.0.22 VM list
2025-02-03 02:15:58,081 - WARNING - Pod uuid 2b4e7481-8c95-472b-b26e-ae6b859699b8 is still seen in agent 10.0.0.22 VM list
2025-02-03 02:15:58,081 - WARNING - Pod uuid d5875482-6ffc-4522-8dd7-8cc11187b98a is still seen in agent 10.0.0.22 VM list
2025-02-03 02:16:03,111 - WARNING - Pod uuid 3c99e133-d91a-401d-a427-14ba6120095e is still seen in agent 10.0.0.22 VM list
2025-02-03 02:16:03,112 - WARNING - Pod uuid 9b93121c-fc21-4566-a2b8-cdd837b298a3 is still seen in agent 10.0.0.22 VM list
2025-02-03 02:16:03,112 - WARNING - Pod uuid 2b4e7481-8c95-472b-b26e-ae6b859699b8 is still seen in agent 10.0.0.22 VM list
2025-02-03 02:16:03,112 - WARNING - Pod uuid 6b716665-3a3e-4d5e-8e6c-accc22a58eac is still seen in agent 10.0.0.22 VM list
2025-02-03 02:16:03,113 - WARNING - Pod uuid d5875482-6ffc-4522-8dd7-8cc11187b98a is still seen in agent 10.0.0.22 VM list
2025-02-03 02:16:08,136 - WARNING - Pod uuid d5875482-6ffc-4522-8dd7-8cc11187b98a is still seen in agent 10.0.0.22 VM list
2025-02-03 02:16:08,137 - WARNING - Pod uuid 3c99e133-d91a-401d-a427-14ba6120095e is still seen in agent 10.0.0.22 VM list
2025-02-03 02:16:08,139 - WARNING - Pod uuid 2b4e7481-8c95-472b-b26e-ae6b859699b8 is still seen in agent 10.0.0.22 VM list
2025-02-03 02:16:08,139 - WARNING - Pod uuid 6b716665-3a3e-4d5e-8e6c-accc22a58eac is still seen in agent 10.0.0.22 VM list
2025-02-03 02:16:08,140 - WARNING - Pod uuid 9b93121c-fc21-4566-a2b8-cdd837b298a3 is still seen in agent 10.0.0.22 VM list
2025-02-03 02:16:13,184 - WARNING - Pod uuid 6b716665-3a3e-4d5e-8e6c-accc22a58eac is still seen in agent 10.0.0.22 VM list
2025-02-03 02:16:13,184 - WARNING - Pod uuid 2b4e7481-8c95-472b-b26e-ae6b859699b8 is still seen in agent 10.0.0.22 VM list
2025-02-03 02:16:13,185 - WARNING - Pod uuid 3c99e133-d91a-401d-a427-14ba6120095e is still seen in agent 10.0.0.22 VM list
2025-02-03 02:16:13,185 - WARNING - Pod uuid d5875482-6ffc-4522-8dd7-8cc11187b98a is still seen in agent 10.0.0.22 VM list
2025-02-03 02:16:13,187 - WARNING - Pod uuid 9b93121c-fc21-4566-a2b8-cdd837b298a3 is still seen in agent 10.0.0.22 VM list
2025-02-03 02:16:18,215 - DEBUG - Pod 2b4e7481-8c95-472b-b26e-ae6b859699b8 is not in agent 10.0.0.22 VM list
2025-02-03 02:16:18,217 - DEBUG - Pod 6b716665-3a3e-4d5e-8e6c-accc22a58eac is not in agent 10.0.0.22 VM list
2025-02-03 02:16:18,219 - DEBUG - Pod 9b93121c-fc21-4566-a2b8-cdd837b298a3 is not in agent 10.0.0.22 VM list
2025-02-03 02:16:18,223 - DEBUG - Pod d5875482-6ffc-4522-8dd7-8cc11187b98a is not in agent 10.0.0.22 VM list
2025-02-03 02:16:18,225 - DEBUG - Pod 3c99e133-d91a-401d-a427-14ba6120095e is not in agent 10.0.0.22 VM list
2025-02-03 02:16:18,245 - DEBUG - VMI 479f28c6-e1d4-11ef-9e73-fa163ed09ba8 is removed from agent 10.0.0.22
2025-02-03 02:16:18,246 - INFO - Verified that pod ctest-pod-58477135 is removed in agent
2025-02-03 02:16:18,246 - DEBUG - VMI 486ca094-e1d4-11ef-9e73-fa163ed09ba8 is removed from agent 10.0.0.22
2025-02-03 02:16:18,246 - INFO - Verified that pod ctest-pod-32536949 is removed in agent
2025-02-03 02:16:18,248 - DEBUG - VMI 491e001e-e1d4-11ef-9e73-fa163ed09ba8 is removed from agent 10.0.0.22
2025-02-03 02:16:18,248 - INFO - Verified that pod ctest-pod-37595663 is removed in agent
2025-02-03 02:16:18,249 - DEBUG - VMI 49cac25e-e1d4-11ef-9e73-fa163ed09ba8 is removed from agent 10.0.0.22
2025-02-03 02:16:18,249 - INFO - Verified that pod ctest-pod-14418433 is removed in agent
2025-02-03 02:16:18,249 - DEBUG - VMI 453cdc72-e1d4-11ef-9e73-fa163ed09ba8 is removed from agent 10.0.0.22
2025-02-03 02:16:18,249 - INFO - Verified that pod ctest-pod-46617919 is removed in agent
2025-02-03 02:16:18,250 - INFO - Deleting namespace ctest-non-default-52035414
2025-02-03 02:16:18,264 - DEBUG - Namespace ctest-non-default-52035414 still in k8s
2025-02-03 02:16:20,269 - DEBUG - Namespace ctest-non-default-52035414 still in k8s
2025-02-03 02:16:22,274 - DEBUG - Namespace ctest-non-default-52035414 still in k8s
2025-02-03 02:16:24,279 - DEBUG - Namespace ctest-non-default-52035414 is not in k8s
2025-02-03 02:16:24,279 - DEBUG - No need to check project deletion in contrail-api
2025-02-03 02:16:24,279 - INFO - Deleting namespace ctest-new-default-92963620
2025-02-03 02:16:24,289 - DEBUG - Namespace ctest-new-default-92963620 still in k8s
2025-02-03 02:16:26,302 - DEBUG - Namespace ctest-new-default-92963620 still in k8s
2025-02-03 02:16:28,307 - DEBUG - Namespace ctest-new-default-92963620 still in k8s
2025-02-03 02:16:30,314 - DEBUG - Namespace ctest-new-default-92963620 is not in k8s
2025-02-03 02:16:30,315 - DEBUG - No need to check project deletion in contrail-api