2025-03-28 19:58:26,303 - INFO - Using existing project ['default-domain', 'k8s-default'](95f1bddf-644b-43f5-bc03-d45a2f81ad1b)
2025-03-28 19:58:26,321 - DEBUG - Namespace ctest-new-default-94637755 not present
2025-03-28 19:58:26,330 - INFO - Created namespace ctest-new-default-94637755
2025-03-28 19:58:29,336 - DEBUG - Namespace ctest-non-default-48588254 not present
2025-03-28 19:58:29,342 - INFO - Created namespace ctest-non-default-48588254
2025-03-28 19:58:32,363 - DEBUG - Pod ctest-pod-93110782 not present
2025-03-28 19:58:32,363 - INFO - Creating Pod ctest-pod-93110782
2025-03-28 19:58:32,433 - DEBUG - Pod : ctest-pod-93110782 UUID is 1e53a03d-3150-4912-af36-8090539be858
2025-03-28 19:58:32,446 - DEBUG - Pod ctest-pod-14451100 not present
2025-03-28 19:58:32,447 - INFO - Creating Pod ctest-pod-14451100
2025-03-28 19:58:32,480 - DEBUG - Pod : ctest-pod-14451100 UUID is 5c0178ac-35b5-4b9a-b815-c147ba68cc4d
2025-03-28 19:58:32,483 - DEBUG - Pod ctest-pod-40349542 not present
2025-03-28 19:58:32,483 - INFO - Creating Pod ctest-pod-40349542
2025-03-28 19:58:32,512 - DEBUG - Pod : ctest-pod-40349542 UUID is 6f16be58-0364-4d99-b05b-6be7a0379d0c
2025-03-28 19:58:32,519 - DEBUG - Pod ctest-pod-85058415 not present
2025-03-28 19:58:32,520 - INFO - Creating Pod ctest-pod-85058415
2025-03-28 19:58:32,539 - DEBUG - Pod : ctest-pod-85058415 UUID is 69922eaa-9643-46ac-9aee-54a9b8b5d42e
2025-03-28 19:58:32,544 - DEBUG - Pod ctest-pod-16681720 not present
2025-03-28 19:58:32,544 - INFO - Creating Pod ctest-pod-16681720
2025-03-28 19:58:32,568 - DEBUG - Pod : ctest-pod-16681720 UUID is 7e358a8f-ef9a-4efa-8a78-8962ca90e6ea
2025-03-28 19:58:32,570 - DEBUG - Pod ctest-pod-79914053 not present
2025-03-28 19:58:32,570 - INFO - Creating Pod ctest-pod-79914053
2025-03-28 19:58:32,600 - DEBUG - Pod : ctest-pod-79914053 UUID is d9a33131-c2dc-4dff-922e-967d0ea63534
2025-03-28 19:58:32,602 - DEBUG - Pod ctest-pod-69020787 not present
2025-03-28 19:58:32,603 - INFO - Creating Pod ctest-pod-69020787
2025-03-28 19:58:32,631 - DEBUG - Pod : ctest-pod-69020787 UUID is 7bf49862-94f1-454c-af2c-0ba759291d50
2025-03-28 19:58:32,633 - DEBUG - Pod ctest-pod-26780754 not present
2025-03-28 19:58:32,633 - INFO - Creating Pod ctest-pod-26780754
2025-03-28 19:58:32,649 - DEBUG - Pod : ctest-pod-26780754 UUID is 0f5a987b-9cc3-4b53-95f0-ac70890ae2c0
2025-03-28 19:58:32,891 - INFO - Project default-domain:k8s-ctest-new-default-94637755 for Namespace ctest-new-default-94637755 is seen in contrail-api
2025-03-28 19:58:32,891 - DEBUG - Project uuid in Contrail is 3c18af31-04d4-423e-a318-7011b35eef70
2025-03-28 19:58:33,047 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_NamespaceDatabaseList?namespace_uuid=72e041ce-b609-43f6-937d-4ee9d85e631e
2025-03-28 19:58:33,081 - INFO - Namespace ctest-new-default-94637755 with uuid 72e041ce-b609-43f6-937d-4ee9d85e631e found in kube manager
2025-03-28 19:58:33,081 - INFO - Namespace ctest-new-default-94637755 verification passed
2025-03-28 19:58:33,299 - INFO - Project default-domain:k8s-ctest-non-default-48588254 for Namespace ctest-non-default-48588254 is seen in contrail-api
2025-03-28 19:58:33,299 - DEBUG - Project uuid in Contrail is 448c9bc6-ccdd-4a5e-b855-d2af078c10fb
2025-03-28 19:58:33,299 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_NamespaceDatabaseList?namespace_uuid=aff6ac8f-5546-4411-a3ff-eb4024eb9adb
2025-03-28 19:58:33,304 - INFO - Namespace ctest-non-default-48588254 with uuid aff6ac8f-5546-4411-a3ff-eb4024eb9adb found in kube manager
2025-03-28 19:58:33,304 - INFO - Namespace ctest-non-default-48588254 verification passed
2025-03-28 19:58:33,309 - DEBUG - Pod ctest-pod-93110782 not in running state.Currently in Pending
2025-03-28 19:58:38,317 - DEBUG - Pod ctest-pod-93110782 not in running state.Currently in Pending
2025-03-28 19:58:43,324 - DEBUG - Pod ctest-pod-93110782 not in running state.Currently in Pending
2025-03-28 19:58:48,331 - INFO - Pod ctest-pod-93110782 is in running state.Got IP 10.47.255.251
2025-03-28 19:58:48,387 - DEBUG - Pod ctest-pod-93110782 has vmi 07b874f0-0c0f-11f0-80e5-fa163e3450cc
2025-03-28 19:58:48,387 - INFO - Verified pod ctest-pod-93110782 in contrail-api
2025-03-28 19:58:48,405 - DEBUG - VMI 07b874f0-0c0f-11f0-80e5-fa163e3450cc is active in agent 10.0.0.48
2025-03-28 19:58:48,405 - INFO - Verified Pod ctest-pod-93110782 in agent 10.0.0.48
2025-03-28 19:58:48,405 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=1e53a03d-3150-4912-af36-8090539be858
2025-03-28 19:58:48,411 - INFO - Pod ctest-pod-93110782 with uuid 1e53a03d-3150-4912-af36-8090539be858 found in kube manager
2025-03-28 19:58:48,411 - INFO - Pod ctest-pod-93110782 verification passed
2025-03-28 19:58:48,418 - INFO - Pod ctest-pod-14451100 is in running state.Got IP 10.47.255.250
2025-03-28 19:58:48,440 - DEBUG - Pod ctest-pod-14451100 has vmi 084049c0-0c0f-11f0-80e5-fa163e3450cc
2025-03-28 19:58:48,440 - INFO - Verified pod ctest-pod-14451100 in contrail-api
2025-03-28 19:58:48,457 - DEBUG - VMI 084049c0-0c0f-11f0-80e5-fa163e3450cc is active in agent 10.0.0.48
2025-03-28 19:58:48,457 - INFO - Verified Pod ctest-pod-14451100 in agent 10.0.0.48
2025-03-28 19:58:48,457 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=5c0178ac-35b5-4b9a-b815-c147ba68cc4d
2025-03-28 19:58:48,463 - INFO - Pod ctest-pod-14451100 with uuid 5c0178ac-35b5-4b9a-b815-c147ba68cc4d found in kube manager
2025-03-28 19:58:48,463 - INFO - Pod ctest-pod-14451100 verification passed
2025-03-28 19:58:48,469 - INFO - Pod ctest-pod-40349542 is in running state.Got IP 10.47.255.249
2025-03-28 19:58:48,529 - DEBUG - Pod ctest-pod-40349542 has vmi 08e19154-0c0f-11f0-80e5-fa163e3450cc
2025-03-28 19:58:48,529 - INFO - Verified pod ctest-pod-40349542 in contrail-api
2025-03-28 19:58:48,547 - DEBUG - VMI 08e19154-0c0f-11f0-80e5-fa163e3450cc is active in agent 10.0.0.48
2025-03-28 19:58:48,547 - INFO - Verified Pod ctest-pod-40349542 in agent 10.0.0.48
2025-03-28 19:58:48,547 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=6f16be58-0364-4d99-b05b-6be7a0379d0c
2025-03-28 19:58:48,553 - INFO - Pod ctest-pod-40349542 with uuid 6f16be58-0364-4d99-b05b-6be7a0379d0c found in kube manager
2025-03-28 19:58:48,553 - INFO - Pod ctest-pod-40349542 verification passed
2025-03-28 19:58:48,560 - INFO - Pod ctest-pod-85058415 is in running state.Got IP 10.47.255.248
2025-03-28 19:58:48,619 - DEBUG - Pod ctest-pod-85058415 has vmi 096a54c6-0c0f-11f0-80e5-fa163e3450cc
2025-03-28 19:58:48,619 - INFO - Verified pod ctest-pod-85058415 in contrail-api
2025-03-28 19:58:48,639 - DEBUG - VMI 096a54c6-0c0f-11f0-80e5-fa163e3450cc is active in agent 10.0.0.48
2025-03-28 19:58:48,639 - INFO - Verified Pod ctest-pod-85058415 in agent 10.0.0.48
2025-03-28 19:58:48,639 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=69922eaa-9643-46ac-9aee-54a9b8b5d42e
2025-03-28 19:58:48,645 - INFO - Pod ctest-pod-85058415 with uuid 69922eaa-9643-46ac-9aee-54a9b8b5d42e found in kube manager
2025-03-28 19:58:48,645 - INFO - Pod ctest-pod-85058415 verification passed
2025-03-28 19:58:48,654 - INFO - Pod ctest-pod-16681720 is in running state.Got IP 10.47.255.247
2025-03-28 19:58:48,682 - DEBUG - Pod ctest-pod-16681720 has vmi 09f2fc72-0c0f-11f0-80e5-fa163e3450cc
2025-03-28 19:58:48,682 - INFO - Verified pod ctest-pod-16681720 in contrail-api
2025-03-28 19:58:48,708 - DEBUG - VMI 09f2fc72-0c0f-11f0-80e5-fa163e3450cc is active in agent 10.0.0.48
2025-03-28 19:58:48,709 - INFO - Verified Pod ctest-pod-16681720 in agent 10.0.0.48
2025-03-28 19:58:48,709 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=7e358a8f-ef9a-4efa-8a78-8962ca90e6ea
2025-03-28 19:58:48,714 - INFO - Pod ctest-pod-16681720 with uuid 7e358a8f-ef9a-4efa-8a78-8962ca90e6ea found in kube manager
2025-03-28 19:58:48,715 - INFO - Pod ctest-pod-16681720 verification passed
2025-03-28 19:58:48,720 - INFO - Pod ctest-pod-69020787 is in running state.Got IP 10.47.255.245
2025-03-28 19:58:48,735 - DEBUG - Pod ctest-pod-69020787 has vmi 0afbbe92-0c0f-11f0-80e5-fa163e3450cc
2025-03-28 19:58:48,735 - INFO - Verified pod ctest-pod-69020787 in contrail-api
2025-03-28 19:58:48,753 - DEBUG - VMI 0afbbe92-0c0f-11f0-80e5-fa163e3450cc is active in agent 10.0.0.48
2025-03-28 19:58:48,753 - INFO - Verified Pod ctest-pod-69020787 in agent 10.0.0.48
2025-03-28 19:58:48,753 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=7bf49862-94f1-454c-af2c-0ba759291d50
2025-03-28 19:58:48,758 - INFO - Pod ctest-pod-69020787 with uuid 7bf49862-94f1-454c-af2c-0ba759291d50 found in kube manager
2025-03-28 19:58:48,758 - INFO - Pod ctest-pod-69020787 verification passed
2025-03-28 19:58:48,826 - INFO - Pod ctest-pod-79914053 is in running state.Got IP 10.47.255.246
2025-03-28 19:58:48,883 - DEBUG - Pod ctest-pod-79914053 has vmi 0a759e2a-0c0f-11f0-80e5-fa163e3450cc
2025-03-28 19:58:48,886 - INFO - Verified pod ctest-pod-79914053 in contrail-api
2025-03-28 19:58:48,933 - DEBUG - VMI 0a759e2a-0c0f-11f0-80e5-fa163e3450cc is active in agent 10.0.0.48
2025-03-28 19:58:48,934 - INFO - Verified Pod ctest-pod-79914053 in agent 10.0.0.48
2025-03-28 19:58:48,934 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=d9a33131-c2dc-4dff-922e-967d0ea63534
2025-03-28 19:58:48,942 - INFO - Pod ctest-pod-79914053 with uuid d9a33131-c2dc-4dff-922e-967d0ea63534 found in kube manager
2025-03-28 19:58:48,942 - INFO - Pod ctest-pod-79914053 verification passed
2025-03-28 19:58:48,951 - DEBUG - Pod ctest-pod-26780754 not in running state.Currently in Pending
2025-03-28 19:58:53,958 - INFO - Pod ctest-pod-26780754 is in running state.Got IP 10.47.255.244
2025-03-28 19:58:53,974 - DEBUG - Pod ctest-pod-26780754 has vmi 0b72db76-0c0f-11f0-80e5-fa163e3450cc
2025-03-28 19:58:53,975 - INFO - Verified pod ctest-pod-26780754 in contrail-api
2025-03-28 19:58:53,991 - DEBUG - VMI 0b72db76-0c0f-11f0-80e5-fa163e3450cc is active in agent 10.0.0.48
2025-03-28 19:58:53,991 - INFO - Verified Pod ctest-pod-26780754 in agent 10.0.0.48
2025-03-28 19:58:53,991 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=0f5a987b-9cc3-4b53-95f0-ac70890ae2c0
2025-03-28 19:58:54,018 - INFO - Pod ctest-pod-26780754 with uuid 0f5a987b-9cc3-4b53-95f0-ac70890ae2c0 found in kube manager
2025-03-28 19:58:54,018 - INFO - Pod ctest-pod-26780754 verification passed
2025-03-28 19:58:54,019 - INFO - ================================================================================
2025-03-28 19:58:54,019 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-03-28 19:58:54,019 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-03-28 19:58:54,416 - DEBUG - Nothing to compare xmpp stats {'10.0.0.48': {'10.0.0.29': '0'}} with
2025-03-28 19:58:54,416 - INFO - Initial checks done. Running the testcase now
2025-03-28 19:58:54,417 - INFO -
2025-03-28 19:58:54,495 - DEBUG - [Pod ctest-pod-93110782] Cmd: echo ctest-pod-93110782 > /usr/share/nginx/html/index.html, Output:
2025-03-28 19:58:54,576 - DEBUG - [Pod ctest-pod-14451100] Cmd: echo ctest-pod-14451100 > /usr/share/nginx/html/index.html, Output:
2025-03-28 19:58:54,642 - DEBUG - [Pod ctest-pod-40349542] Cmd: echo ctest-pod-40349542 > /usr/share/nginx/html/index.html, Output:
2025-03-28 19:58:54,708 - DEBUG - [Pod ctest-pod-85058415] Cmd: echo ctest-pod-85058415 > /usr/share/nginx/html/index.html, Output:
2025-03-28 19:58:54,711 - DEBUG - Service ctest-nginx-svc-92096523 not present
2025-03-28 19:58:54,711 - INFO - Creating service ctest-nginx-svc-92096523
2025-03-28 19:58:54,749 - INFO - Created Service ctest-nginx-svc-92096523
2025-03-28 19:58:54,756 - WARNING - Service UUID 705f97a3-0c46-4615-b993-85f8edc9c126 not yet found in contrail-api
2025-03-28 19:58:55,767 - INFO - Validated that Service ctest-nginx-svc-92096523 is seen in contrail-api
2025-03-28 19:58:55,767 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_LoadbalancerDatabaseList?x=705f97a3-0c46-4615-b993-85f8edc9c126
2025-03-28 19:58:55,773 - INFO - Service ctest-nginx-svc-92096523 with uuid 705f97a3-0c46-4615-b993-85f8edc9c126 found in kube manager
2025-03-28 19:58:55,773 - INFO - Service ctest-nginx-svc-92096523 verification passed
2025-03-28 19:58:56,852 - DEBUG - [Pod ctest-pod-16681720] Cmd: wget http://10.110.235.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-93110782
2025-03-28 19:58:56,853 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd wget http://10.110.235.61:80/ -O - -T 5 -t 1 passed
2025-03-28 19:58:56,853 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-93110782
2025-03-28 19:58:56,928 - DEBUG - [Pod ctest-pod-16681720] Cmd: wget http://10.110.235.61:80/ -O - -T 5 -t 1 , Output: ctest-pod-14451100
Connecting to 10.110.235.61:80 (10.110.235.61:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-28 19:58:56,928 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd wget http://10.110.235.61:80/ -O - -T 5 -t 1 passed
2025-03-28 19:58:56,928 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd output: ctest-pod-14451100
Connecting to 10.110.235.61:80 (10.110.235.61:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-28 19:58:56,928 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-93110782': 1, 'ctest-pod-14451100': 1}
2025-03-28 19:58:56,989 - DEBUG - [Pod ctest-pod-69020787] Cmd: wget http://10.110.235.61:80/ -O - -T 5 -t 1 , Output: ctest-pod-14451100
Connecting to 10.110.235.61:80 (10.110.235.61:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-28 19:58:56,989 - DEBUG - [Pod Pod ctest-pod-69020787] Cmd wget http://10.110.235.61:80/ -O - -T 5 -t 1 passed
2025-03-28 19:58:56,989 - DEBUG - [Pod Pod ctest-pod-69020787] Cmd output: ctest-pod-14451100
Connecting to 10.110.235.61:80 (10.110.235.61:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-28 19:58:57,039 - DEBUG - [Pod ctest-pod-69020787] Cmd: wget http://10.110.235.61:80/ -O - -T 5 -t 1 , Output: ctest-pod-93110782
Connecting to 10.110.235.61:80 (10.110.235.61:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-28 19:58:57,039 - DEBUG - [Pod Pod ctest-pod-69020787] Cmd wget http://10.110.235.61:80/ -O - -T 5 -t 1 passed
2025-03-28 19:58:57,039 - DEBUG - [Pod Pod ctest-pod-69020787] Cmd output: ctest-pod-93110782
Connecting to 10.110.235.61:80 (10.110.235.61:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-28 19:58:57,039 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-93110782': 1, 'ctest-pod-14451100': 1}
2025-03-28 19:58:57,047 - DEBUG - Network policy ingress-on-service not present
2025-03-28 19:58:57,047 - INFO - Creating Network Policy ingress-on-service
2025-03-28 19:58:57,064 - INFO - Network policy found in k8s
2025-03-28 19:58:57,064 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=527a0d16-6191-4271-9fdb-06e473285b07
2025-03-28 19:58:57,071 - INFO - Network Policy ingress-on-service with uuid 527a0d16-6191-4271-9fdb-06e473285b07 found in kube manager
2025-03-28 19:58:57,111 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-03-28 19:58:57,112 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-03-28 19:58:57,113 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=527a0d16-6191-4271-9fdb-06e473285b07
2025-03-28 19:58:57,149 - WARNING - Network policy with name ingress-on-service not found in agent
2025-03-28 19:58:59,150 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=527a0d16-6191-4271-9fdb-06e473285b07
2025-03-28 19:58:59,189 - INFO - Network policy with name ingress-on-service found in agent
2025-03-28 19:58:59,190 - INFO - Network Policy ingress-on-service verification passed
2025-03-28 19:59:04,251 - DEBUG - [Pod ctest-pod-16681720] Cmd: wget http://10.110.235.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 19:59:04,251 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd wget http://10.110.235.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 19:59:04,251 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 19:59:09,315 - DEBUG - [Pod ctest-pod-16681720] Cmd: wget http://10.110.235.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 19:59:09,315 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd wget http://10.110.235.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 19:59:09,315 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 19:59:14,384 - DEBUG - [Pod ctest-pod-16681720] Cmd: wget http://10.110.235.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 19:59:14,384 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd wget http://10.110.235.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 19:59:14,384 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 19:59:19,481 - DEBUG - [Pod ctest-pod-16681720] Cmd: wget http://10.110.235.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 19:59:19,481 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd wget http://10.110.235.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 19:59:19,481 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 19:59:24,567 - DEBUG - [Pod ctest-pod-16681720] Cmd: wget http://10.110.235.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 19:59:24,567 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd wget http://10.110.235.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 19:59:24,567 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 19:59:29,659 - DEBUG - [Pod ctest-pod-16681720] Cmd: wget http://10.110.235.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 19:59:29,659 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd wget http://10.110.235.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 19:59:29,659 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 19:59:34,731 - DEBUG - [Pod ctest-pod-16681720] Cmd: wget http://10.110.235.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 19:59:34,731 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd wget http://10.110.235.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 19:59:34,731 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 19:59:39,818 - DEBUG - [Pod ctest-pod-16681720] Cmd: wget http://10.110.235.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 19:59:39,818 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd wget http://10.110.235.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 19:59:39,818 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 19:59:44,911 - DEBUG - [Pod ctest-pod-16681720] Cmd: wget http://10.110.235.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 19:59:44,911 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd wget http://10.110.235.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 19:59:44,911 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 19:59:49,991 - DEBUG - [Pod ctest-pod-16681720] Cmd: wget http://10.110.235.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 19:59:49,992 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd wget http://10.110.235.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 19:59:49,992 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 19:59:49,992 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-93110782': 0, 'ctest-pod-14451100': 0}
2025-03-28 19:59:50,075 - DEBUG - [Pod ctest-pod-79914053] Cmd: wget http://10.110.235.61:80/ -O - -T 5 -t 1 , Output: ctest-pod-93110782
Connecting to 10.110.235.61:80 (10.110.235.61:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-28 19:59:50,075 - DEBUG - [Pod Pod ctest-pod-79914053] Cmd wget http://10.110.235.61:80/ -O - -T 5 -t 1 passed
2025-03-28 19:59:50,075 - DEBUG - [Pod Pod ctest-pod-79914053] Cmd output: ctest-pod-93110782
Connecting to 10.110.235.61:80 (10.110.235.61:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-28 19:59:50,150 - DEBUG - [Pod ctest-pod-79914053] Cmd: wget http://10.110.235.61:80/ -O - -T 5 -t 1 , Output: ctest-pod-93110782
Connecting to 10.110.235.61:80 (10.110.235.61:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-28 19:59:50,150 - DEBUG - [Pod Pod ctest-pod-79914053] Cmd wget http://10.110.235.61:80/ -O - -T 5 -t 1 passed
2025-03-28 19:59:50,150 - DEBUG - [Pod Pod ctest-pod-79914053] Cmd output: ctest-pod-93110782
Connecting to 10.110.235.61:80 (10.110.235.61:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-28 19:59:50,243 - DEBUG - [Pod ctest-pod-79914053] Cmd: wget http://10.110.235.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-93110782
2025-03-28 19:59:50,243 - DEBUG - [Pod Pod ctest-pod-79914053] Cmd wget http://10.110.235.61:80/ -O - -T 5 -t 1 passed
2025-03-28 19:59:50,243 - DEBUG - [Pod Pod ctest-pod-79914053] Cmd output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-93110782
2025-03-28 19:59:50,308 - DEBUG - [Pod ctest-pod-79914053] Cmd: wget http://10.110.235.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
ctest-pod-14451100
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-28 19:59:50,308 - DEBUG - [Pod Pod ctest-pod-79914053] Cmd wget http://10.110.235.61:80/ -O - -T 5 -t 1 passed
2025-03-28 19:59:50,308 - DEBUG - [Pod Pod ctest-pod-79914053] Cmd output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
ctest-pod-14451100
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-28 19:59:50,308 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-93110782': 3, 'ctest-pod-14451100': 1}
2025-03-28 19:59:55,377 - DEBUG - [Pod ctest-pod-69020787] Cmd: wget http://10.110.235.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 19:59:55,377 - DEBUG - [Pod Pod ctest-pod-69020787] Cmd wget http://10.110.235.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 19:59:55,377 - DEBUG - [Pod Pod ctest-pod-69020787] Cmd output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:00:00,466 - DEBUG - [Pod ctest-pod-69020787] Cmd: wget http://10.110.235.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:00:00,466 - DEBUG - [Pod Pod ctest-pod-69020787] Cmd wget http://10.110.235.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:00:00,466 - DEBUG - [Pod Pod ctest-pod-69020787] Cmd output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:00:05,535 - DEBUG - [Pod ctest-pod-69020787] Cmd: wget http://10.110.235.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:00:05,535 - DEBUG - [Pod Pod ctest-pod-69020787] Cmd wget http://10.110.235.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:00:05,535 - DEBUG - [Pod Pod ctest-pod-69020787] Cmd output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:00:10,626 - DEBUG - [Pod ctest-pod-69020787] Cmd: wget http://10.110.235.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:00:10,626 - DEBUG - [Pod Pod ctest-pod-69020787] Cmd wget http://10.110.235.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:00:10,626 - DEBUG - [Pod Pod ctest-pod-69020787] Cmd output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:00:15,690 - DEBUG - [Pod ctest-pod-69020787] Cmd: wget http://10.110.235.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:00:15,690 - DEBUG - [Pod Pod ctest-pod-69020787] Cmd wget http://10.110.235.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:00:15,690 - DEBUG - [Pod Pod ctest-pod-69020787] Cmd output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:00:20,757 - DEBUG - [Pod ctest-pod-69020787] Cmd: wget http://10.110.235.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:00:20,757 - DEBUG - [Pod Pod ctest-pod-69020787] Cmd wget http://10.110.235.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:00:20,757 - DEBUG - [Pod Pod ctest-pod-69020787] Cmd output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:00:25,826 - DEBUG - [Pod ctest-pod-69020787] Cmd: wget http://10.110.235.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:00:25,826 - DEBUG - [Pod Pod ctest-pod-69020787] Cmd wget http://10.110.235.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:00:25,826 - DEBUG - [Pod Pod ctest-pod-69020787] Cmd output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:00:30,896 - DEBUG - [Pod ctest-pod-69020787] Cmd: wget http://10.110.235.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:00:30,896 - DEBUG - [Pod Pod ctest-pod-69020787] Cmd wget http://10.110.235.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:00:30,897 - DEBUG - [Pod Pod ctest-pod-69020787] Cmd output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:00:35,953 - DEBUG - [Pod ctest-pod-69020787] Cmd: wget http://10.110.235.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:00:35,954 - DEBUG - [Pod Pod ctest-pod-69020787] Cmd wget http://10.110.235.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:00:35,954 - DEBUG - [Pod Pod ctest-pod-69020787] Cmd output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:00:41,054 - DEBUG - [Pod ctest-pod-69020787] Cmd: wget http://10.110.235.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:00:41,054 - DEBUG - [Pod Pod ctest-pod-69020787] Cmd wget http://10.110.235.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:00:41,054 - DEBUG - [Pod Pod ctest-pod-69020787] Cmd output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:00:41,054 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-93110782': 0, 'ctest-pod-14451100': 0}
2025-03-28 20:00:43,132 - DEBUG - [Pod ctest-pod-79914053] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=2.237 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.096 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.093 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.093/0.808/2.237 ms
2025-03-28 20:00:43,132 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-79914053 with expectation True passed
2025-03-28 20:00:45,209 - DEBUG - [Pod ctest-pod-16681720] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.923 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.094 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.088 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.088/0.701/1.923 ms
2025-03-28 20:00:45,209 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-16681720 with expectation True passed
2025-03-28 20:00:47,282 - DEBUG - [Pod ctest-pod-69020787] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=2.186 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.087 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.186 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.087/0.819/2.186 ms
2025-03-28 20:00:47,282 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-69020787 with expectation True passed
2025-03-28 20:00:47,366 - DEBUG - [Pod ctest-pod-79914053] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-28 20:00:47,366 - DEBUG - [Pod Pod ctest-pod-79914053] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-03-28 20:00:47,366 - DEBUG - [Pod Pod ctest-pod-79914053] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-28 20:00:47,366 - INFO - wget check of of http://10.47.255.251 from ctest-pod-79914053 passed
2025-03-28 20:00:47,427 - DEBUG - [Pod ctest-pod-79914053] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-28 20:00:47,428 - DEBUG - [Pod Pod ctest-pod-79914053] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-03-28 20:00:47,428 - DEBUG - [Pod Pod ctest-pod-79914053] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-28 20:00:47,428 - INFO - wget check of of http://10.47.255.250 from ctest-pod-79914053 passed
2025-03-28 20:00:52,490 - DEBUG - [Pod ctest-pod-16681720] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-28 20:00:52,490 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-28 20:00:52,490 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-28 20:00:52,490 - INFO - wget check of of http://10.47.255.250 from ctest-pod-16681720 passed
2025-03-28 20:00:57,589 - DEBUG - [Pod ctest-pod-26780754] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-03-28 20:00:57,590 - DEBUG - [Pod Pod ctest-pod-26780754] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-03-28 20:00:57,590 - DEBUG - [Pod Pod ctest-pod-26780754] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-03-28 20:00:57,590 - INFO - wget check of of http://10.47.255.251 from ctest-pod-26780754 passed
2025-03-28 20:00:57,597 - INFO - Updating Network Policy ingress-on-service
2025-03-28 20:01:02,720 - DEBUG - [Pod ctest-pod-16681720] Cmd: wget http://10.110.235.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:01:02,721 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd wget http://10.110.235.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:01:02,721 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:01:07,812 - DEBUG - [Pod ctest-pod-16681720] Cmd: wget http://10.110.235.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:01:07,812 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd wget http://10.110.235.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:01:07,812 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:01:12,885 - DEBUG - [Pod ctest-pod-16681720] Cmd: wget http://10.110.235.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:01:12,885 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd wget http://10.110.235.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:01:12,885 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:01:17,937 - DEBUG - [Pod ctest-pod-16681720] Cmd: wget http://10.110.235.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:01:17,937 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd wget http://10.110.235.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:01:17,937 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:01:23,011 - DEBUG - [Pod ctest-pod-16681720] Cmd: wget http://10.110.235.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:01:23,011 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd wget http://10.110.235.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:01:23,011 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:01:28,073 - DEBUG - [Pod ctest-pod-16681720] Cmd: wget http://10.110.235.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:01:28,073 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd wget http://10.110.235.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:01:28,073 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:01:33,130 - DEBUG - [Pod ctest-pod-16681720] Cmd: wget http://10.110.235.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:01:33,130 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd wget http://10.110.235.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:01:33,130 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:01:38,199 - DEBUG - [Pod ctest-pod-16681720] Cmd: wget http://10.110.235.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:01:38,199 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd wget http://10.110.235.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:01:38,199 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:01:43,271 - DEBUG - [Pod ctest-pod-16681720] Cmd: wget http://10.110.235.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:01:43,272 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd wget http://10.110.235.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:01:43,272 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:01:48,396 - DEBUG - [Pod ctest-pod-16681720] Cmd: wget http://10.110.235.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:01:48,397 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd wget http://10.110.235.61:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:01:48,397 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
wget: download timed out
2025-03-28 20:01:48,397 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-93110782': 0, 'ctest-pod-14451100': 0}
2025-03-28 20:01:48,474 - DEBUG - [Pod ctest-pod-79914053] Cmd: wget http://10.110.235.61:80/ -O - -T 5 -t 1 , Output: ctest-pod-14451100
Connecting to 10.110.235.61:80 (10.110.235.61:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-28 20:01:48,474 - DEBUG - [Pod Pod ctest-pod-79914053] Cmd wget http://10.110.235.61:80/ -O - -T 5 -t 1 passed
2025-03-28 20:01:48,474 - DEBUG - [Pod Pod ctest-pod-79914053] Cmd output: ctest-pod-14451100
Connecting to 10.110.235.61:80 (10.110.235.61:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-28 20:01:48,557 - DEBUG - [Pod ctest-pod-79914053] Cmd: wget http://10.110.235.61:80/ -O - -T 5 -t 1 , Output: ctest-pod-93110782
Connecting to 10.110.235.61:80 (10.110.235.61:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-28 20:01:48,557 - DEBUG - [Pod Pod ctest-pod-79914053] Cmd wget http://10.110.235.61:80/ -O - -T 5 -t 1 passed
2025-03-28 20:01:48,557 - DEBUG - [Pod Pod ctest-pod-79914053] Cmd output: ctest-pod-93110782
Connecting to 10.110.235.61:80 (10.110.235.61:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-28 20:01:48,557 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-93110782': 1, 'ctest-pod-14451100': 1}
2025-03-28 20:01:48,644 - DEBUG - [Pod ctest-pod-69020787] Cmd: wget http://10.110.235.61:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-93110782
2025-03-28 20:01:48,644 - DEBUG - [Pod Pod ctest-pod-69020787] Cmd wget http://10.110.235.61:80/ -O - -T 5 -t 1 passed
2025-03-28 20:01:48,644 - DEBUG - [Pod Pod ctest-pod-69020787] Cmd output: Connecting to 10.110.235.61:80 (10.110.235.61:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-93110782
2025-03-28 20:01:48,708 - DEBUG - [Pod ctest-pod-69020787] Cmd: wget http://10.110.235.61:80/ -O - -T 5 -t 1 , Output: ctest-pod-14451100
Connecting to 10.110.235.61:80 (10.110.235.61:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-28 20:01:48,708 - DEBUG - [Pod Pod ctest-pod-69020787] Cmd wget http://10.110.235.61:80/ -O - -T 5 -t 1 passed
2025-03-28 20:01:48,708 - DEBUG - [Pod Pod ctest-pod-69020787] Cmd output: ctest-pod-14451100
Connecting to 10.110.235.61:80 (10.110.235.61:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-28 20:01:48,708 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-93110782': 1, 'ctest-pod-14451100': 1}
2025-03-28 20:01:50,771 - DEBUG - [Pod ctest-pod-79914053] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.001 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.073 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.098 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.073/0.390/1.001 ms
2025-03-28 20:01:50,772 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-79914053 with expectation True passed
2025-03-28 20:01:52,844 - DEBUG - [Pod ctest-pod-16681720] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.836 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.134 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.076 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.076/0.348/0.836 ms
2025-03-28 20:01:52,844 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-16681720 with expectation True passed
2025-03-28 20:01:55,027 - DEBUG - [Pod ctest-pod-69020787] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.462 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.075 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.160 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.075/0.565/1.462 ms
2025-03-28 20:01:55,034 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-69020787 with expectation True passed
2025-03-28 20:01:55,126 - DEBUG - [Pod ctest-pod-79914053] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-28 20:01:55,127 - DEBUG - [Pod Pod ctest-pod-79914053] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-03-28 20:01:55,127 - DEBUG - [Pod Pod ctest-pod-79914053] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-28 20:01:55,127 - INFO - wget check of of http://10.47.255.251 from ctest-pod-79914053 passed
2025-03-28 20:01:55,196 - DEBUG - [Pod ctest-pod-79914053] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-28 20:01:55,196 - DEBUG - [Pod Pod ctest-pod-79914053] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-03-28 20:01:55,196 - DEBUG - [Pod Pod ctest-pod-79914053] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-28 20:01:55,196 - INFO - wget check of of http://10.47.255.250 from ctest-pod-79914053 passed
2025-03-28 20:02:00,248 - DEBUG - [Pod ctest-pod-16681720] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-28 20:02:00,249 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-28 20:02:00,249 - DEBUG - [Pod Pod ctest-pod-16681720] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-28 20:02:00,249 - INFO - wget check of of http://10.47.255.250 from ctest-pod-16681720 passed
2025-03-28 20:02:00,327 - DEBUG - [Pod ctest-pod-26780754] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-28 20:02:00,328 - DEBUG - [Pod Pod ctest-pod-26780754] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-03-28 20:02:00,328 - DEBUG - [Pod Pod ctest-pod-26780754] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-28 20:02:00,328 - INFO - wget check of of http://10.47.255.251 from ctest-pod-26780754 passed
2025-03-28 20:02:00,328 - INFO - Deleting Network Policy : ingress-on-service
2025-03-28 20:02:00,328 - INFO - Deleting service : ctest-nginx-svc-92096523
2025-03-28 20:02:00,562 - DEBUG - No XMPP flaps were noticed during the test
2025-03-28 20:02:00,562 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:06]
2025-03-28 20:02:00,562 - INFO - --------------------------------------------------------------------------------
2025-03-28 20:02:00,566 - INFO - Deleting pod ctest-new-default-94637755:ctest-pod-93110782
2025-03-28 20:02:00,567 - INFO - Deleting pod ctest-new-default-94637755:ctest-pod-14451100
2025-03-28 20:02:00,567 - INFO - Deleting pod ctest-non-default-48588254:ctest-pod-40349542
2025-03-28 20:02:00,567 - INFO - Deleting pod ctest-non-default-48588254:ctest-pod-85058415
2025-03-28 20:02:00,568 - INFO - Deleting pod ctest-new-default-94637755:ctest-pod-16681720
2025-03-28 20:02:00,568 - INFO - Deleting pod ctest-new-default-94637755:ctest-pod-79914053
2025-03-28 20:02:00,568 - INFO - Deleting pod ctest-non-default-48588254:ctest-pod-69020787
2025-03-28 20:02:00,569 - INFO - Deleting pod ctest-non-default-48588254:ctest-pod-26780754
2025-03-28 20:02:00,735 - WARNING - Pod uuid 7bf49862-94f1-454c-af2c-0ba759291d50 is still seen in agent 10.0.0.48 VM list
2025-03-28 20:02:00,737 - WARNING - Pod uuid 7e358a8f-ef9a-4efa-8a78-8962ca90e6ea is still seen in agent 10.0.0.48 VM list
2025-03-28 20:02:00,737 - WARNING - Pod uuid 1e53a03d-3150-4912-af36-8090539be858 is still seen in agent 10.0.0.48 VM list
2025-03-28 20:02:00,738 - WARNING - Pod uuid 69922eaa-9643-46ac-9aee-54a9b8b5d42e is still seen in agent 10.0.0.48 VM list
2025-03-28 20:02:00,738 - WARNING - Pod uuid 0f5a987b-9cc3-4b53-95f0-ac70890ae2c0 is still seen in agent 10.0.0.48 VM list
2025-03-28 20:02:00,739 - WARNING - Pod uuid 5c0178ac-35b5-4b9a-b815-c147ba68cc4d is still seen in agent 10.0.0.48 VM list
2025-03-28 20:02:00,739 - WARNING - Pod uuid d9a33131-c2dc-4dff-922e-967d0ea63534 is still seen in agent 10.0.0.48 VM list
2025-03-28 20:02:00,739 - WARNING - Pod uuid 6f16be58-0364-4d99-b05b-6be7a0379d0c is still seen in agent 10.0.0.48 VM list
2025-03-28 20:02:05,781 - WARNING - Pod uuid d9a33131-c2dc-4dff-922e-967d0ea63534 is still seen in agent 10.0.0.48 VM list
2025-03-28 20:02:05,781 - DEBUG - Pod 69922eaa-9643-46ac-9aee-54a9b8b5d42e is not in agent 10.0.0.48 VM list
2025-03-28 20:02:05,783 - DEBUG - Pod 6f16be58-0364-4d99-b05b-6be7a0379d0c is not in agent 10.0.0.48 VM list
2025-03-28 20:02:05,785 - WARNING - Pod uuid 7bf49862-94f1-454c-af2c-0ba759291d50 is still seen in agent 10.0.0.48 VM list
2025-03-28 20:02:05,787 - WARNING - Pod uuid 0f5a987b-9cc3-4b53-95f0-ac70890ae2c0 is still seen in agent 10.0.0.48 VM list
2025-03-28 20:02:05,788 - WARNING - Pod uuid 7e358a8f-ef9a-4efa-8a78-8962ca90e6ea is still seen in agent 10.0.0.48 VM list
2025-03-28 20:02:05,788 - DEBUG - Pod 5c0178ac-35b5-4b9a-b815-c147ba68cc4d is not in agent 10.0.0.48 VM list
2025-03-28 20:02:05,790 - DEBUG - Pod 1e53a03d-3150-4912-af36-8090539be858 is not in agent 10.0.0.48 VM list
2025-03-28 20:02:05,804 - DEBUG - VMI 096a54c6-0c0f-11f0-80e5-fa163e3450cc is removed from agent 10.0.0.48
2025-03-28 20:02:05,804 - INFO - Verified that pod ctest-pod-85058415 is removed in agent
2025-03-28 20:02:05,806 - DEBUG - VMI 084049c0-0c0f-11f0-80e5-fa163e3450cc is removed from agent 10.0.0.48
2025-03-28 20:02:05,806 - INFO - Verified that pod ctest-pod-14451100 is removed in agent
2025-03-28 20:02:05,807 - DEBUG - VMI 07b874f0-0c0f-11f0-80e5-fa163e3450cc is removed from agent 10.0.0.48
2025-03-28 20:02:05,807 - INFO - Verified that pod ctest-pod-93110782 is removed in agent
2025-03-28 20:02:05,808 - DEBUG - VMI 08e19154-0c0f-11f0-80e5-fa163e3450cc is removed from agent 10.0.0.48
2025-03-28 20:02:05,808 - INFO - Verified that pod ctest-pod-40349542 is removed in agent
2025-03-28 20:02:10,792 - WARNING - Pod uuid d9a33131-c2dc-4dff-922e-967d0ea63534 is still seen in agent 10.0.0.48 VM list
2025-03-28 20:02:10,794 - WARNING - Pod uuid 7bf49862-94f1-454c-af2c-0ba759291d50 is still seen in agent 10.0.0.48 VM list
2025-03-28 20:02:10,803 - WARNING - Pod uuid 7e358a8f-ef9a-4efa-8a78-8962ca90e6ea is still seen in agent 10.0.0.48 VM list
2025-03-28 20:02:10,803 - WARNING - Pod uuid 0f5a987b-9cc3-4b53-95f0-ac70890ae2c0 is still seen in agent 10.0.0.48 VM list
2025-03-28 20:02:15,816 - WARNING - Pod uuid 7bf49862-94f1-454c-af2c-0ba759291d50 is still seen in agent 10.0.0.48 VM list
2025-03-28 20:02:15,816 - WARNING - Pod uuid d9a33131-c2dc-4dff-922e-967d0ea63534 is still seen in agent 10.0.0.48 VM list
2025-03-28 20:02:15,817 - WARNING - Pod uuid 0f5a987b-9cc3-4b53-95f0-ac70890ae2c0 is still seen in agent 10.0.0.48 VM list
2025-03-28 20:02:15,818 - WARNING - Pod uuid 7e358a8f-ef9a-4efa-8a78-8962ca90e6ea is still seen in agent 10.0.0.48 VM list
2025-03-28 20:02:20,848 - WARNING - Pod uuid d9a33131-c2dc-4dff-922e-967d0ea63534 is still seen in agent 10.0.0.48 VM list
2025-03-28 20:02:20,851 - WARNING - Pod uuid 0f5a987b-9cc3-4b53-95f0-ac70890ae2c0 is still seen in agent 10.0.0.48 VM list
2025-03-28 20:02:20,851 - WARNING - Pod uuid 7e358a8f-ef9a-4efa-8a78-8962ca90e6ea is still seen in agent 10.0.0.48 VM list
2025-03-28 20:02:20,852 - WARNING - Pod uuid 7bf49862-94f1-454c-af2c-0ba759291d50 is still seen in agent 10.0.0.48 VM list
2025-03-28 20:02:25,887 - WARNING - Pod uuid 0f5a987b-9cc3-4b53-95f0-ac70890ae2c0 is still seen in agent 10.0.0.48 VM list
2025-03-28 20:02:25,887 - WARNING - Pod uuid d9a33131-c2dc-4dff-922e-967d0ea63534 is still seen in agent 10.0.0.48 VM list
2025-03-28 20:02:25,889 - WARNING - Pod uuid 7e358a8f-ef9a-4efa-8a78-8962ca90e6ea is still seen in agent 10.0.0.48 VM list
2025-03-28 20:02:25,890 - WARNING - Pod uuid 7bf49862-94f1-454c-af2c-0ba759291d50 is still seen in agent 10.0.0.48 VM list
2025-03-28 20:02:30,911 - WARNING - Pod uuid 7e358a8f-ef9a-4efa-8a78-8962ca90e6ea is still seen in agent 10.0.0.48 VM list
2025-03-28 20:02:30,911 - WARNING - Pod uuid 7bf49862-94f1-454c-af2c-0ba759291d50 is still seen in agent 10.0.0.48 VM list
2025-03-28 20:02:30,912 - WARNING - Pod uuid d9a33131-c2dc-4dff-922e-967d0ea63534 is still seen in agent 10.0.0.48 VM list
2025-03-28 20:02:30,912 - WARNING - Pod uuid 0f5a987b-9cc3-4b53-95f0-ac70890ae2c0 is still seen in agent 10.0.0.48 VM list
2025-03-28 20:02:35,930 - DEBUG - Pod 0f5a987b-9cc3-4b53-95f0-ac70890ae2c0 is not in agent 10.0.0.48 VM list
2025-03-28 20:02:35,933 - DEBUG - Pod d9a33131-c2dc-4dff-922e-967d0ea63534 is not in agent 10.0.0.48 VM list
2025-03-28 20:02:35,934 - DEBUG - Pod 7e358a8f-ef9a-4efa-8a78-8962ca90e6ea is not in agent 10.0.0.48 VM list
2025-03-28 20:02:35,936 - DEBUG - Pod 7bf49862-94f1-454c-af2c-0ba759291d50 is not in agent 10.0.0.48 VM list
2025-03-28 20:02:35,951 - DEBUG - VMI 09f2fc72-0c0f-11f0-80e5-fa163e3450cc is removed from agent 10.0.0.48
2025-03-28 20:02:35,951 - INFO - Verified that pod ctest-pod-16681720 is removed in agent
2025-03-28 20:02:35,951 - DEBUG - VMI 0b72db76-0c0f-11f0-80e5-fa163e3450cc is removed from agent 10.0.0.48
2025-03-28 20:02:35,952 - INFO - Verified that pod ctest-pod-26780754 is removed in agent
2025-03-28 20:02:35,953 - DEBUG - VMI 0a759e2a-0c0f-11f0-80e5-fa163e3450cc is removed from agent 10.0.0.48
2025-03-28 20:02:35,953 - INFO - Verified that pod ctest-pod-79914053 is removed in agent
2025-03-28 20:02:35,953 - DEBUG - VMI 0afbbe92-0c0f-11f0-80e5-fa163e3450cc is removed from agent 10.0.0.48
2025-03-28 20:02:35,953 - INFO - Verified that pod ctest-pod-69020787 is removed in agent
2025-03-28 20:02:35,954 - INFO - Deleting namespace ctest-non-default-48588254
2025-03-28 20:02:35,978 - DEBUG - Namespace ctest-non-default-48588254 still in k8s
2025-03-28 20:02:37,983 - DEBUG - Namespace ctest-non-default-48588254 still in k8s
2025-03-28 20:02:39,988 - DEBUG - Namespace ctest-non-default-48588254 still in k8s
2025-03-28 20:02:41,996 - DEBUG - Namespace ctest-non-default-48588254 is not in k8s
2025-03-28 20:02:41,996 - DEBUG - No need to check project deletion in contrail-api
2025-03-28 20:02:41,996 - INFO - Deleting namespace ctest-new-default-94637755
2025-03-28 20:02:42,004 - DEBUG - Namespace ctest-new-default-94637755 still in k8s
2025-03-28 20:02:44,009 - DEBUG - Namespace ctest-new-default-94637755 still in k8s
2025-03-28 20:02:46,013 - DEBUG - Namespace ctest-new-default-94637755 still in k8s
2025-03-28 20:02:48,020 - DEBUG - Namespace ctest-new-default-94637755 is not in k8s
2025-03-28 20:02:48,020 - DEBUG - No need to check project deletion in contrail-api