2025-03-29 17:42:00,803 - INFO - Using existing project ['default-domain', 'k8s-default'](41916fea-fd37-40d2-aab3-fa021b28e131)
2025-03-29 17:42:00,836 - DEBUG - Namespace ctest-new-default-54294072 not present
2025-03-29 17:42:00,845 - INFO - Created namespace ctest-new-default-54294072
2025-03-29 17:42:03,851 - DEBUG - Namespace ctest-non-default-63826689 not present
2025-03-29 17:42:03,859 - INFO - Created namespace ctest-non-default-63826689
2025-03-29 17:42:06,879 - DEBUG - Pod ctest-pod-25242508 not present
2025-03-29 17:42:06,879 - INFO - Creating Pod ctest-pod-25242508
2025-03-29 17:42:06,912 - DEBUG - Pod : ctest-pod-25242508 UUID is 54ffc49a-822f-455f-9868-31747412f70c
2025-03-29 17:42:06,929 - DEBUG - Pod ctest-pod-27119403 not present
2025-03-29 17:42:06,930 - INFO - Creating Pod ctest-pod-27119403
2025-03-29 17:42:06,953 - DEBUG - Pod : ctest-pod-27119403 UUID is cad04056-4161-443a-a878-19946e525fbd
2025-03-29 17:42:06,958 - DEBUG - Pod ctest-pod-59601452 not present
2025-03-29 17:42:06,959 - INFO - Creating Pod ctest-pod-59601452
2025-03-29 17:42:07,012 - DEBUG - Pod : ctest-pod-59601452 UUID is 534d5785-7917-48ea-a3cf-7b4ff76b3d48
2025-03-29 17:42:07,015 - DEBUG - Pod ctest-pod-74551569 not present
2025-03-29 17:42:07,015 - INFO - Creating Pod ctest-pod-74551569
2025-03-29 17:42:07,040 - DEBUG - Pod : ctest-pod-74551569 UUID is 779a45bb-b682-40ee-8f5a-18351c22f57f
2025-03-29 17:42:07,042 - DEBUG - Pod ctest-pod-56553075 not present
2025-03-29 17:42:07,042 - INFO - Creating Pod ctest-pod-56553075
2025-03-29 17:42:07,062 - DEBUG - Pod : ctest-pod-56553075 UUID is ccc24fe8-1987-4478-88da-d36e22110f7d
2025-03-29 17:42:07,064 - DEBUG - Pod ctest-pod-45855966 not present
2025-03-29 17:42:07,065 - INFO - Creating Pod ctest-pod-45855966
2025-03-29 17:42:07,083 - DEBUG - Pod : ctest-pod-45855966 UUID is 60f80d13-8fec-45ed-87b8-06ccf64a52c1
2025-03-29 17:42:07,085 - DEBUG - Pod ctest-pod-06427465 not present
2025-03-29 17:42:07,085 - INFO - Creating Pod ctest-pod-06427465
2025-03-29 17:42:07,103 - DEBUG - Pod : ctest-pod-06427465 UUID is 547c8873-9449-42ab-a40c-ab9b7311dbd3
2025-03-29 17:42:07,109 - DEBUG - Pod ctest-pod-14465300 not present
2025-03-29 17:42:07,110 - INFO - Creating Pod ctest-pod-14465300
2025-03-29 17:42:07,142 - DEBUG - Pod : ctest-pod-14465300 UUID is f8ae30cb-21d1-44dc-854f-087f0c1c61a0
2025-03-29 17:42:07,343 - INFO - Project default-domain:k8s-ctest-new-default-54294072 for Namespace ctest-new-default-54294072 is seen in contrail-api
2025-03-29 17:42:07,343 - DEBUG - Project uuid in Contrail is 4282d9e1-69f2-483d-9234-62ea4874e8a5
2025-03-29 17:42:07,517 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NamespaceDatabaseList?namespace_uuid=d2a946fe-29d8-4057-9c59-a9c0a7fbed33
2025-03-29 17:42:07,531 - INFO - Namespace ctest-new-default-54294072 with uuid d2a946fe-29d8-4057-9c59-a9c0a7fbed33 found in kube manager
2025-03-29 17:42:07,531 - INFO - Namespace ctest-new-default-54294072 verification passed
2025-03-29 17:42:07,742 - INFO - Project default-domain:k8s-ctest-non-default-63826689 for Namespace ctest-non-default-63826689 is seen in contrail-api
2025-03-29 17:42:07,743 - DEBUG - Project uuid in Contrail is 0d7876dd-d243-4564-9912-fa317bfe1a16
2025-03-29 17:42:07,743 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NamespaceDatabaseList?namespace_uuid=999b6c51-c9b0-4428-8e0f-12852913afd8
2025-03-29 17:42:07,748 - INFO - Namespace ctest-non-default-63826689 with uuid 999b6c51-c9b0-4428-8e0f-12852913afd8 found in kube manager
2025-03-29 17:42:07,748 - INFO - Namespace ctest-non-default-63826689 verification passed
2025-03-29 17:42:07,754 - DEBUG - Pod ctest-pod-25242508 not in running state.Currently in Pending
2025-03-29 17:42:12,761 - DEBUG - Pod ctest-pod-25242508 not in running state.Currently in Pending
2025-03-29 17:42:17,768 - DEBUG - Pod ctest-pod-25242508 not in running state.Currently in Pending
2025-03-29 17:42:22,779 - INFO - Pod ctest-pod-25242508 is in running state.Got IP 10.47.255.251
2025-03-29 17:42:22,797 - DEBUG - Pod ctest-pod-25242508 has vmi 23426936-0cc5-11f0-964b-fa163e191163
2025-03-29 17:42:22,797 - INFO - Verified pod ctest-pod-25242508 in contrail-api
2025-03-29 17:42:22,814 - DEBUG - VMI 23426936-0cc5-11f0-964b-fa163e191163 is active in agent 10.0.0.27
2025-03-29 17:42:22,814 - INFO - Verified Pod ctest-pod-25242508 in agent 10.0.0.27
2025-03-29 17:42:22,815 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=54ffc49a-822f-455f-9868-31747412f70c
2025-03-29 17:42:22,823 - INFO - Pod ctest-pod-25242508 with uuid 54ffc49a-822f-455f-9868-31747412f70c found in kube manager
2025-03-29 17:42:22,823 - INFO - Pod ctest-pod-25242508 verification passed
2025-03-29 17:42:22,833 - INFO - Pod ctest-pod-27119403 is in running state.Got IP 10.47.255.250
2025-03-29 17:42:22,896 - DEBUG - Pod ctest-pod-27119403 has vmi 23c6953a-0cc5-11f0-964b-fa163e191163
2025-03-29 17:42:22,896 - INFO - Verified pod ctest-pod-27119403 in contrail-api
2025-03-29 17:42:22,922 - DEBUG - VMI 23c6953a-0cc5-11f0-964b-fa163e191163 is active in agent 10.0.0.27
2025-03-29 17:42:22,922 - INFO - Verified Pod ctest-pod-27119403 in agent 10.0.0.27
2025-03-29 17:42:22,922 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=cad04056-4161-443a-a878-19946e525fbd
2025-03-29 17:42:22,932 - INFO - Pod ctest-pod-27119403 with uuid cad04056-4161-443a-a878-19946e525fbd found in kube manager
2025-03-29 17:42:22,932 - INFO - Pod ctest-pod-27119403 verification passed
2025-03-29 17:42:22,939 - INFO - Pod ctest-pod-59601452 is in running state.Got IP 10.47.255.249
2025-03-29 17:42:22,967 - DEBUG - Pod ctest-pod-59601452 has vmi 2479dc44-0cc5-11f0-964b-fa163e191163
2025-03-29 17:42:22,967 - INFO - Verified pod ctest-pod-59601452 in contrail-api
2025-03-29 17:42:22,990 - DEBUG - VMI 2479dc44-0cc5-11f0-964b-fa163e191163 is active in agent 10.0.0.27
2025-03-29 17:42:22,990 - INFO - Verified Pod ctest-pod-59601452 in agent 10.0.0.27
2025-03-29 17:42:22,990 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=534d5785-7917-48ea-a3cf-7b4ff76b3d48
2025-03-29 17:42:22,997 - INFO - Pod ctest-pod-59601452 with uuid 534d5785-7917-48ea-a3cf-7b4ff76b3d48 found in kube manager
2025-03-29 17:42:22,997 - INFO - Pod ctest-pod-59601452 verification passed
2025-03-29 17:42:23,011 - INFO - Pod ctest-pod-74551569 is in running state.Got IP 10.47.255.248
2025-03-29 17:42:23,084 - DEBUG - Pod ctest-pod-74551569 has vmi 24fd58d0-0cc5-11f0-964b-fa163e191163
2025-03-29 17:42:23,085 - INFO - Verified pod ctest-pod-74551569 in contrail-api
2025-03-29 17:42:23,112 - DEBUG - VMI 24fd58d0-0cc5-11f0-964b-fa163e191163 is active in agent 10.0.0.27
2025-03-29 17:42:23,112 - INFO - Verified Pod ctest-pod-74551569 in agent 10.0.0.27
2025-03-29 17:42:23,112 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=779a45bb-b682-40ee-8f5a-18351c22f57f
2025-03-29 17:42:23,118 - INFO - Pod ctest-pod-74551569 with uuid 779a45bb-b682-40ee-8f5a-18351c22f57f found in kube manager
2025-03-29 17:42:23,118 - INFO - Pod ctest-pod-74551569 verification passed
2025-03-29 17:42:23,123 - DEBUG - Pod ctest-pod-56553075 not in running state.Currently in Pending
2025-03-29 17:42:28,130 - INFO - Pod ctest-pod-56553075 is in running state.Got IP 10.47.255.247
2025-03-29 17:42:28,144 - DEBUG - Pod ctest-pod-56553075 has vmi 258f5c80-0cc5-11f0-964b-fa163e191163
2025-03-29 17:42:28,144 - INFO - Verified pod ctest-pod-56553075 in contrail-api
2025-03-29 17:42:28,158 - DEBUG - VMI 258f5c80-0cc5-11f0-964b-fa163e191163 is active in agent 10.0.0.27
2025-03-29 17:42:28,159 - INFO - Verified Pod ctest-pod-56553075 in agent 10.0.0.27
2025-03-29 17:42:28,159 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=ccc24fe8-1987-4478-88da-d36e22110f7d
2025-03-29 17:42:28,164 - INFO - Pod ctest-pod-56553075 with uuid ccc24fe8-1987-4478-88da-d36e22110f7d found in kube manager
2025-03-29 17:42:28,164 - INFO - Pod ctest-pod-56553075 verification passed
2025-03-29 17:42:28,246 - INFO - Pod ctest-pod-06427465 is in running state.Got IP 10.47.255.245
2025-03-29 17:42:28,259 - DEBUG - Pod ctest-pod-06427465 has vmi 26938a70-0cc5-11f0-964b-fa163e191163
2025-03-29 17:42:28,260 - INFO - Verified pod ctest-pod-06427465 in contrail-api
2025-03-29 17:42:28,274 - DEBUG - VMI 26938a70-0cc5-11f0-964b-fa163e191163 is active in agent 10.0.0.27
2025-03-29 17:42:28,275 - INFO - Verified Pod ctest-pod-06427465 in agent 10.0.0.27
2025-03-29 17:42:28,275 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=547c8873-9449-42ab-a40c-ab9b7311dbd3
2025-03-29 17:42:28,280 - INFO - Pod ctest-pod-06427465 with uuid 547c8873-9449-42ab-a40c-ab9b7311dbd3 found in kube manager
2025-03-29 17:42:28,280 - INFO - Pod ctest-pod-06427465 verification passed
2025-03-29 17:42:28,285 - INFO - Pod ctest-pod-45855966 is in running state.Got IP 10.47.255.246
2025-03-29 17:42:28,344 - DEBUG - Pod ctest-pod-45855966 has vmi 260e1b74-0cc5-11f0-964b-fa163e191163
2025-03-29 17:42:28,344 - INFO - Verified pod ctest-pod-45855966 in contrail-api
2025-03-29 17:42:28,358 - DEBUG - VMI 260e1b74-0cc5-11f0-964b-fa163e191163 is active in agent 10.0.0.27
2025-03-29 17:42:28,358 - INFO - Verified Pod ctest-pod-45855966 in agent 10.0.0.27
2025-03-29 17:42:28,358 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=60f80d13-8fec-45ed-87b8-06ccf64a52c1
2025-03-29 17:42:28,363 - INFO - Pod ctest-pod-45855966 with uuid 60f80d13-8fec-45ed-87b8-06ccf64a52c1 found in kube manager
2025-03-29 17:42:28,363 - INFO - Pod ctest-pod-45855966 verification passed
2025-03-29 17:42:28,369 - INFO - Pod ctest-pod-14465300 is in running state.Got IP 10.47.255.244
2025-03-29 17:42:28,436 - DEBUG - Pod ctest-pod-14465300 has vmi 271dfdd6-0cc5-11f0-964b-fa163e191163
2025-03-29 17:42:28,437 - INFO - Verified pod ctest-pod-14465300 in contrail-api
2025-03-29 17:42:28,450 - DEBUG - VMI 271dfdd6-0cc5-11f0-964b-fa163e191163 is active in agent 10.0.0.27
2025-03-29 17:42:28,451 - INFO - Verified Pod ctest-pod-14465300 in agent 10.0.0.27
2025-03-29 17:42:28,451 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=f8ae30cb-21d1-44dc-854f-087f0c1c61a0
2025-03-29 17:42:28,455 - INFO - Pod ctest-pod-14465300 with uuid f8ae30cb-21d1-44dc-854f-087f0c1c61a0 found in kube manager
2025-03-29 17:42:28,456 - INFO - Pod ctest-pod-14465300 verification passed
2025-03-29 17:42:28,456 - INFO - ================================================================================
2025-03-29 17:42:28,456 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-03-29 17:42:28,456 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-03-29 17:42:28,657 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.0.0.12': '0'}} with
2025-03-29 17:42:28,657 - INFO - Initial checks done. Running the testcase now
2025-03-29 17:42:28,658 - INFO -
2025-03-29 17:42:28,728 - DEBUG - [Pod ctest-pod-25242508] Cmd: echo ctest-pod-25242508 > /usr/share/nginx/html/index.html, Output:
2025-03-29 17:42:28,797 - DEBUG - [Pod ctest-pod-27119403] Cmd: echo ctest-pod-27119403 > /usr/share/nginx/html/index.html, Output:
2025-03-29 17:42:28,872 - DEBUG - [Pod ctest-pod-59601452] Cmd: echo ctest-pod-59601452 > /usr/share/nginx/html/index.html, Output:
2025-03-29 17:42:28,949 - DEBUG - [Pod ctest-pod-74551569] Cmd: echo ctest-pod-74551569 > /usr/share/nginx/html/index.html, Output:
2025-03-29 17:42:28,952 - DEBUG - Service ctest-nginx-svc-81267130 not present
2025-03-29 17:42:28,952 - INFO - Creating service ctest-nginx-svc-81267130
2025-03-29 17:42:28,967 - INFO - Created Service ctest-nginx-svc-81267130
2025-03-29 17:42:28,980 - WARNING - Service UUID 333f10ce-1f96-4ac9-b4c7-1bc9dd283d1c not yet found in contrail-api
2025-03-29 17:42:29,987 - INFO - Validated that Service ctest-nginx-svc-81267130 is seen in contrail-api
2025-03-29 17:42:29,987 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_LoadbalancerDatabaseList?x=333f10ce-1f96-4ac9-b4c7-1bc9dd283d1c
2025-03-29 17:42:29,993 - INFO - Service ctest-nginx-svc-81267130 with uuid 333f10ce-1f96-4ac9-b4c7-1bc9dd283d1c found in kube manager
2025-03-29 17:42:29,993 - INFO - Service ctest-nginx-svc-81267130 verification passed
2025-03-29 17:42:31,062 - DEBUG - [Pod ctest-pod-56553075] Cmd: wget http://10.107.193.59:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-27119403
2025-03-29 17:42:31,062 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd wget http://10.107.193.59:80/ -O - -T 5 -t 1 passed
2025-03-29 17:42:31,062 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-27119403
2025-03-29 17:42:31,113 - DEBUG - [Pod ctest-pod-56553075] Cmd: wget http://10.107.193.59:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-25242508
2025-03-29 17:42:31,113 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd wget http://10.107.193.59:80/ -O - -T 5 -t 1 passed
2025-03-29 17:42:31,113 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-25242508
2025-03-29 17:42:31,113 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-25242508': 1, 'ctest-pod-27119403': 1}
2025-03-29 17:42:31,170 - DEBUG - [Pod ctest-pod-06427465] Cmd: wget http://10.107.193.59:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-25242508
2025-03-29 17:42:31,170 - DEBUG - [Pod Pod ctest-pod-06427465] Cmd wget http://10.107.193.59:80/ -O - -T 5 -t 1 passed
2025-03-29 17:42:31,170 - DEBUG - [Pod Pod ctest-pod-06427465] Cmd output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-25242508
2025-03-29 17:42:31,229 - DEBUG - [Pod ctest-pod-06427465] Cmd: wget http://10.107.193.59:80/ -O - -T 5 -t 1 , Output: ctest-pod-25242508
Connecting to 10.107.193.59:80 (10.107.193.59:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 17:42:31,229 - DEBUG - [Pod Pod ctest-pod-06427465] Cmd wget http://10.107.193.59:80/ -O - -T 5 -t 1 passed
2025-03-29 17:42:31,229 - DEBUG - [Pod Pod ctest-pod-06427465] Cmd output: ctest-pod-25242508
Connecting to 10.107.193.59:80 (10.107.193.59:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 17:42:31,285 - DEBUG - [Pod ctest-pod-06427465] Cmd: wget http://10.107.193.59:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-27119403
2025-03-29 17:42:31,285 - DEBUG - [Pod Pod ctest-pod-06427465] Cmd wget http://10.107.193.59:80/ -O - -T 5 -t 1 passed
2025-03-29 17:42:31,285 - DEBUG - [Pod Pod ctest-pod-06427465] Cmd output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-27119403
2025-03-29 17:42:31,285 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-25242508': 2, 'ctest-pod-27119403': 1}
2025-03-29 17:42:31,289 - DEBUG - Network policy ingress-on-service not present
2025-03-29 17:42:31,289 - INFO - Creating Network Policy ingress-on-service
2025-03-29 17:42:31,302 - INFO - Network policy found in k8s
2025-03-29 17:42:31,302 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=91dc4f0b-157d-4d78-955a-4817f7a98f83
2025-03-29 17:42:31,308 - INFO - Network Policy ingress-on-service with uuid 91dc4f0b-157d-4d78-955a-4817f7a98f83 found in kube manager
2025-03-29 17:42:31,365 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-03-29 17:42:31,365 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-03-29 17:42:31,365 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=91dc4f0b-157d-4d78-955a-4817f7a98f83
2025-03-29 17:42:31,406 - WARNING - Network policy with name ingress-on-service not found in agent
2025-03-29 17:42:33,407 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=91dc4f0b-157d-4d78-955a-4817f7a98f83
2025-03-29 17:42:33,441 - INFO - Network policy with name ingress-on-service found in agent
2025-03-29 17:42:33,441 - INFO - Network Policy ingress-on-service verification passed
2025-03-29 17:42:38,491 - DEBUG - [Pod ctest-pod-56553075] Cmd: wget http://10.107.193.59:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:42:38,491 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd wget http://10.107.193.59:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:42:38,491 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:42:43,557 - DEBUG - [Pod ctest-pod-56553075] Cmd: wget http://10.107.193.59:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:42:43,557 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd wget http://10.107.193.59:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:42:43,557 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:42:48,610 - DEBUG - [Pod ctest-pod-56553075] Cmd: wget http://10.107.193.59:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:42:48,610 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd wget http://10.107.193.59:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:42:48,610 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:42:53,672 - DEBUG - [Pod ctest-pod-56553075] Cmd: wget http://10.107.193.59:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:42:53,673 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd wget http://10.107.193.59:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:42:53,673 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:42:58,735 - DEBUG - [Pod ctest-pod-56553075] Cmd: wget http://10.107.193.59:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:42:58,735 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd wget http://10.107.193.59:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:42:58,735 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:43:03,783 - DEBUG - [Pod ctest-pod-56553075] Cmd: wget http://10.107.193.59:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:43:03,783 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd wget http://10.107.193.59:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:43:03,783 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:43:08,853 - DEBUG - [Pod ctest-pod-56553075] Cmd: wget http://10.107.193.59:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:43:08,853 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd wget http://10.107.193.59:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:43:08,853 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:43:13,917 - DEBUG - [Pod ctest-pod-56553075] Cmd: wget http://10.107.193.59:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:43:13,918 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd wget http://10.107.193.59:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:43:13,918 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:43:18,976 - DEBUG - [Pod ctest-pod-56553075] Cmd: wget http://10.107.193.59:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:43:18,976 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd wget http://10.107.193.59:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:43:18,976 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:43:24,056 - DEBUG - [Pod ctest-pod-56553075] Cmd: wget http://10.107.193.59:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:43:24,056 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd wget http://10.107.193.59:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:43:24,056 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:43:24,056 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-25242508': 0, 'ctest-pod-27119403': 0}
2025-03-29 17:43:24,117 - DEBUG - [Pod ctest-pod-45855966] Cmd: wget http://10.107.193.59:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-27119403
2025-03-29 17:43:24,118 - DEBUG - [Pod Pod ctest-pod-45855966] Cmd wget http://10.107.193.59:80/ -O - -T 5 -t 1 passed
2025-03-29 17:43:24,118 - DEBUG - [Pod Pod ctest-pod-45855966] Cmd output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-27119403
2025-03-29 17:43:24,201 - DEBUG - [Pod ctest-pod-45855966] Cmd: wget http://10.107.193.59:80/ -O - -T 5 -t 1 , Output: ctest-pod-27119403
Connecting to 10.107.193.59:80 (10.107.193.59:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 17:43:24,201 - DEBUG - [Pod Pod ctest-pod-45855966] Cmd wget http://10.107.193.59:80/ -O - -T 5 -t 1 passed
2025-03-29 17:43:24,201 - DEBUG - [Pod Pod ctest-pod-45855966] Cmd output: ctest-pod-27119403
Connecting to 10.107.193.59:80 (10.107.193.59:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 17:43:24,275 - DEBUG - [Pod ctest-pod-45855966] Cmd: wget http://10.107.193.59:80/ -O - -T 5 -t 1 , Output: ctest-pod-25242508
Connecting to 10.107.193.59:80 (10.107.193.59:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 17:43:24,275 - DEBUG - [Pod Pod ctest-pod-45855966] Cmd wget http://10.107.193.59:80/ -O - -T 5 -t 1 passed
2025-03-29 17:43:24,275 - DEBUG - [Pod Pod ctest-pod-45855966] Cmd output: ctest-pod-25242508
Connecting to 10.107.193.59:80 (10.107.193.59:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 17:43:24,275 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-25242508': 1, 'ctest-pod-27119403': 2}
2025-03-29 17:43:29,339 - DEBUG - [Pod ctest-pod-06427465] Cmd: wget http://10.107.193.59:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:43:29,339 - DEBUG - [Pod Pod ctest-pod-06427465] Cmd wget http://10.107.193.59:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:43:29,339 - DEBUG - [Pod Pod ctest-pod-06427465] Cmd output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:43:34,403 - DEBUG - [Pod ctest-pod-06427465] Cmd: wget http://10.107.193.59:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:43:34,403 - DEBUG - [Pod Pod ctest-pod-06427465] Cmd wget http://10.107.193.59:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:43:34,403 - DEBUG - [Pod Pod ctest-pod-06427465] Cmd output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:43:39,495 - DEBUG - [Pod ctest-pod-06427465] Cmd: wget http://10.107.193.59:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:43:39,495 - DEBUG - [Pod Pod ctest-pod-06427465] Cmd wget http://10.107.193.59:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:43:39,495 - DEBUG - [Pod Pod ctest-pod-06427465] Cmd output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:43:44,569 - DEBUG - [Pod ctest-pod-06427465] Cmd: wget http://10.107.193.59:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:43:44,569 - DEBUG - [Pod Pod ctest-pod-06427465] Cmd wget http://10.107.193.59:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:43:44,570 - DEBUG - [Pod Pod ctest-pod-06427465] Cmd output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:43:49,632 - DEBUG - [Pod ctest-pod-06427465] Cmd: wget http://10.107.193.59:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:43:49,633 - DEBUG - [Pod Pod ctest-pod-06427465] Cmd wget http://10.107.193.59:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:43:49,633 - DEBUG - [Pod Pod ctest-pod-06427465] Cmd output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:43:54,700 - DEBUG - [Pod ctest-pod-06427465] Cmd: wget http://10.107.193.59:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:43:54,700 - DEBUG - [Pod Pod ctest-pod-06427465] Cmd wget http://10.107.193.59:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:43:54,700 - DEBUG - [Pod Pod ctest-pod-06427465] Cmd output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:43:59,759 - DEBUG - [Pod ctest-pod-06427465] Cmd: wget http://10.107.193.59:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:43:59,760 - DEBUG - [Pod Pod ctest-pod-06427465] Cmd wget http://10.107.193.59:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:43:59,760 - DEBUG - [Pod Pod ctest-pod-06427465] Cmd output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:44:04,831 - DEBUG - [Pod ctest-pod-06427465] Cmd: wget http://10.107.193.59:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:44:04,831 - DEBUG - [Pod Pod ctest-pod-06427465] Cmd wget http://10.107.193.59:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:44:04,831 - DEBUG - [Pod Pod ctest-pod-06427465] Cmd output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:44:09,891 - DEBUG - [Pod ctest-pod-06427465] Cmd: wget http://10.107.193.59:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:44:09,891 - DEBUG - [Pod Pod ctest-pod-06427465] Cmd wget http://10.107.193.59:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:44:09,891 - DEBUG - [Pod Pod ctest-pod-06427465] Cmd output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:44:14,962 - DEBUG - [Pod ctest-pod-06427465] Cmd: wget http://10.107.193.59:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:44:14,963 - DEBUG - [Pod Pod ctest-pod-06427465] Cmd wget http://10.107.193.59:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:44:14,963 - DEBUG - [Pod Pod ctest-pod-06427465] Cmd output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:44:14,963 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-25242508': 0, 'ctest-pod-27119403': 0}
2025-03-29 17:44:17,028 - DEBUG - [Pod ctest-pod-45855966] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.534 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.060 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.092 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.060/0.562/1.534 ms
2025-03-29 17:44:17,028 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-45855966 with expectation True passed
2025-03-29 17:44:19,097 - DEBUG - [Pod ctest-pod-56553075] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.955 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.108 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.098 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.098/0.387/0.955 ms
2025-03-29 17:44:19,097 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-56553075 with expectation True passed
2025-03-29 17:44:21,156 - DEBUG - [Pod ctest-pod-06427465] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.112 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.083 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.105 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.083/0.433/1.112 ms
2025-03-29 17:44:21,156 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-06427465 with expectation True passed
2025-03-29 17:44:21,233 - DEBUG - [Pod ctest-pod-45855966] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-29 17:44:21,233 - DEBUG - [Pod Pod ctest-pod-45855966] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-03-29 17:44:21,233 - DEBUG - [Pod Pod ctest-pod-45855966] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-29 17:44:21,233 - INFO - wget check of of http://10.47.255.251 from ctest-pod-45855966 passed
2025-03-29 17:44:21,304 - DEBUG - [Pod ctest-pod-45855966] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-29 17:44:21,304 - DEBUG - [Pod Pod ctest-pod-45855966] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-03-29 17:44:21,304 - DEBUG - [Pod Pod ctest-pod-45855966] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-29 17:44:21,304 - INFO - wget check of of http://10.47.255.250 from ctest-pod-45855966 passed
2025-03-29 17:44:26,368 - DEBUG - [Pod ctest-pod-56553075] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-29 17:44:26,368 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-29 17:44:26,368 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-29 17:44:26,368 - INFO - wget check of of http://10.47.255.250 from ctest-pod-56553075 passed
2025-03-29 17:44:31,439 - DEBUG - [Pod ctest-pod-14465300] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-03-29 17:44:31,439 - DEBUG - [Pod Pod ctest-pod-14465300] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-03-29 17:44:31,439 - DEBUG - [Pod Pod ctest-pod-14465300] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-03-29 17:44:31,439 - INFO - wget check of of http://10.47.255.251 from ctest-pod-14465300 passed
2025-03-29 17:44:31,447 - INFO - Updating Network Policy ingress-on-service
2025-03-29 17:44:36,531 - DEBUG - [Pod ctest-pod-56553075] Cmd: wget http://10.107.193.59:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:44:36,531 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd wget http://10.107.193.59:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:44:36,531 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:44:41,598 - DEBUG - [Pod ctest-pod-56553075] Cmd: wget http://10.107.193.59:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:44:41,598 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd wget http://10.107.193.59:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:44:41,598 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:44:46,692 - DEBUG - [Pod ctest-pod-56553075] Cmd: wget http://10.107.193.59:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:44:46,692 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd wget http://10.107.193.59:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:44:46,693 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:44:51,749 - DEBUG - [Pod ctest-pod-56553075] Cmd: wget http://10.107.193.59:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:44:51,749 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd wget http://10.107.193.59:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:44:51,749 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:44:56,808 - DEBUG - [Pod ctest-pod-56553075] Cmd: wget http://10.107.193.59:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:44:56,808 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd wget http://10.107.193.59:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:44:56,808 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:45:01,883 - DEBUG - [Pod ctest-pod-56553075] Cmd: wget http://10.107.193.59:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:45:01,883 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd wget http://10.107.193.59:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:45:01,883 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:45:06,970 - DEBUG - [Pod ctest-pod-56553075] Cmd: wget http://10.107.193.59:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:45:06,970 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd wget http://10.107.193.59:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:45:06,970 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:45:12,031 - DEBUG - [Pod ctest-pod-56553075] Cmd: wget http://10.107.193.59:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:45:12,031 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd wget http://10.107.193.59:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:45:12,031 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:45:17,110 - DEBUG - [Pod ctest-pod-56553075] Cmd: wget http://10.107.193.59:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:45:17,111 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd wget http://10.107.193.59:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:45:17,111 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:45:22,189 - DEBUG - [Pod ctest-pod-56553075] Cmd: wget http://10.107.193.59:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:45:22,189 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd wget http://10.107.193.59:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:45:22,189 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
wget: download timed out
2025-03-29 17:45:22,189 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-25242508': 0, 'ctest-pod-27119403': 0}
2025-03-29 17:45:22,261 - DEBUG - [Pod ctest-pod-45855966] Cmd: wget http://10.107.193.59:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-27119403
2025-03-29 17:45:22,261 - DEBUG - [Pod Pod ctest-pod-45855966] Cmd wget http://10.107.193.59:80/ -O - -T 5 -t 1 passed
2025-03-29 17:45:22,261 - DEBUG - [Pod Pod ctest-pod-45855966] Cmd output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-27119403
2025-03-29 17:45:22,328 - DEBUG - [Pod ctest-pod-45855966] Cmd: wget http://10.107.193.59:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-25242508
2025-03-29 17:45:22,328 - DEBUG - [Pod Pod ctest-pod-45855966] Cmd wget http://10.107.193.59:80/ -O - -T 5 -t 1 passed
2025-03-29 17:45:22,328 - DEBUG - [Pod Pod ctest-pod-45855966] Cmd output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-25242508
2025-03-29 17:45:22,328 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-25242508': 1, 'ctest-pod-27119403': 1}
2025-03-29 17:45:22,397 - DEBUG - [Pod ctest-pod-06427465] Cmd: wget http://10.107.193.59:80/ -O - -T 5 -t 1 , Output: ctest-pod-25242508
Connecting to 10.107.193.59:80 (10.107.193.59:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 17:45:22,397 - DEBUG - [Pod Pod ctest-pod-06427465] Cmd wget http://10.107.193.59:80/ -O - -T 5 -t 1 passed
2025-03-29 17:45:22,397 - DEBUG - [Pod Pod ctest-pod-06427465] Cmd output: ctest-pod-25242508
Connecting to 10.107.193.59:80 (10.107.193.59:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 17:45:22,460 - DEBUG - [Pod ctest-pod-06427465] Cmd: wget http://10.107.193.59:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-27119403
2025-03-29 17:45:22,460 - DEBUG - [Pod Pod ctest-pod-06427465] Cmd wget http://10.107.193.59:80/ -O - -T 5 -t 1 passed
2025-03-29 17:45:22,460 - DEBUG - [Pod Pod ctest-pod-06427465] Cmd output: Connecting to 10.107.193.59:80 (10.107.193.59:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-27119403
2025-03-29 17:45:22,460 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-25242508': 1, 'ctest-pod-27119403': 1}
2025-03-29 17:45:24,515 - DEBUG - [Pod ctest-pod-45855966] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.557 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.090 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.091 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.090/0.246/0.557 ms
2025-03-29 17:45:24,516 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-45855966 with expectation True passed
2025-03-29 17:45:26,592 - DEBUG - [Pod ctest-pod-56553075] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.828 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.100 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.103 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.100/0.343/0.828 ms
2025-03-29 17:45:26,592 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-56553075 with expectation True passed
2025-03-29 17:45:28,662 - DEBUG - [Pod ctest-pod-06427465] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.506 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.094 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.087 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.087/0.229/0.506 ms
2025-03-29 17:45:28,662 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-06427465 with expectation True passed
2025-03-29 17:45:28,737 - DEBUG - [Pod ctest-pod-45855966] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-29 17:45:28,737 - DEBUG - [Pod Pod ctest-pod-45855966] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-03-29 17:45:28,737 - DEBUG - [Pod Pod ctest-pod-45855966] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-29 17:45:28,737 - INFO - wget check of of http://10.47.255.251 from ctest-pod-45855966 passed
2025-03-29 17:45:28,800 - DEBUG - [Pod ctest-pod-45855966] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-29 17:45:28,800 - DEBUG - [Pod Pod ctest-pod-45855966] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-03-29 17:45:28,800 - DEBUG - [Pod Pod ctest-pod-45855966] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-29 17:45:28,800 - INFO - wget check of of http://10.47.255.250 from ctest-pod-45855966 passed
2025-03-29 17:45:33,860 - DEBUG - [Pod ctest-pod-56553075] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-29 17:45:33,861 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-29 17:45:33,861 - DEBUG - [Pod Pod ctest-pod-56553075] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-29 17:45:33,861 - INFO - wget check of of http://10.47.255.250 from ctest-pod-56553075 passed
2025-03-29 17:45:33,918 - DEBUG - [Pod ctest-pod-14465300] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-29 17:45:33,919 - DEBUG - [Pod Pod ctest-pod-14465300] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-03-29 17:45:33,919 - DEBUG - [Pod Pod ctest-pod-14465300] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-29 17:45:33,919 - INFO - wget check of of http://10.47.255.251 from ctest-pod-14465300 passed
2025-03-29 17:45:33,919 - INFO - Deleting Network Policy : ingress-on-service
2025-03-29 17:45:33,920 - INFO - Deleting service : ctest-nginx-svc-81267130
2025-03-29 17:45:34,130 - DEBUG - No XMPP flaps were noticed during the test
2025-03-29 17:45:34,131 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:06]
2025-03-29 17:45:34,131 - INFO - --------------------------------------------------------------------------------
2025-03-29 17:45:34,137 - INFO - Deleting pod ctest-new-default-54294072:ctest-pod-25242508
2025-03-29 17:45:34,138 - INFO - Deleting pod ctest-new-default-54294072:ctest-pod-27119403
2025-03-29 17:45:34,138 - INFO - Deleting pod ctest-non-default-63826689:ctest-pod-59601452
2025-03-29 17:45:34,138 - INFO - Deleting pod ctest-non-default-63826689:ctest-pod-74551569
2025-03-29 17:45:34,139 - INFO - Deleting pod ctest-new-default-54294072:ctest-pod-56553075
2025-03-29 17:45:34,139 - INFO - Deleting pod ctest-new-default-54294072:ctest-pod-45855966
2025-03-29 17:45:34,139 - INFO - Deleting pod ctest-non-default-63826689:ctest-pod-06427465
2025-03-29 17:45:34,140 - INFO - Deleting pod ctest-non-default-63826689:ctest-pod-14465300
2025-03-29 17:45:34,180 - WARNING - Pod uuid 54ffc49a-822f-455f-9868-31747412f70c is still seen in agent 10.0.0.27 VM list
2025-03-29 17:45:34,215 - WARNING - Pod uuid f8ae30cb-21d1-44dc-854f-087f0c1c61a0 is still seen in agent 10.0.0.27 VM list
2025-03-29 17:45:34,237 - WARNING - Pod uuid ccc24fe8-1987-4478-88da-d36e22110f7d is still seen in agent 10.0.0.27 VM list
2025-03-29 17:45:34,240 - WARNING - Pod uuid cad04056-4161-443a-a878-19946e525fbd is still seen in agent 10.0.0.27 VM list
2025-03-29 17:45:34,270 - WARNING - Pod uuid 779a45bb-b682-40ee-8f5a-18351c22f57f is still seen in agent 10.0.0.27 VM list
2025-03-29 17:45:34,271 - WARNING - Pod uuid 60f80d13-8fec-45ed-87b8-06ccf64a52c1 is still seen in agent 10.0.0.27 VM list
2025-03-29 17:45:34,272 - WARNING - Pod uuid 534d5785-7917-48ea-a3cf-7b4ff76b3d48 is still seen in agent 10.0.0.27 VM list
2025-03-29 17:45:34,273 - WARNING - Pod uuid 547c8873-9449-42ab-a40c-ab9b7311dbd3 is still seen in agent 10.0.0.27 VM list
2025-03-29 17:45:39,189 - DEBUG - Pod 54ffc49a-822f-455f-9868-31747412f70c is not in agent 10.0.0.27 VM list
2025-03-29 17:45:39,196 - DEBUG - VMI 23426936-0cc5-11f0-964b-fa163e191163 is removed from agent 10.0.0.27
2025-03-29 17:45:39,196 - INFO - Verified that pod ctest-pod-25242508 is removed in agent
2025-03-29 17:45:39,225 - WARNING - Pod uuid f8ae30cb-21d1-44dc-854f-087f0c1c61a0 is still seen in agent 10.0.0.27 VM list
2025-03-29 17:45:39,254 - WARNING - Pod uuid ccc24fe8-1987-4478-88da-d36e22110f7d is still seen in agent 10.0.0.27 VM list
2025-03-29 17:45:39,256 - DEBUG - Pod cad04056-4161-443a-a878-19946e525fbd is not in agent 10.0.0.27 VM list
2025-03-29 17:45:39,262 - DEBUG - VMI 23c6953a-0cc5-11f0-964b-fa163e191163 is removed from agent 10.0.0.27
2025-03-29 17:45:39,262 - INFO - Verified that pod ctest-pod-27119403 is removed in agent
2025-03-29 17:45:39,288 - WARNING - Pod uuid 60f80d13-8fec-45ed-87b8-06ccf64a52c1 is still seen in agent 10.0.0.27 VM list
2025-03-29 17:45:39,289 - DEBUG - Pod 779a45bb-b682-40ee-8f5a-18351c22f57f is not in agent 10.0.0.27 VM list
2025-03-29 17:45:39,292 - WARNING - Pod uuid 547c8873-9449-42ab-a40c-ab9b7311dbd3 is still seen in agent 10.0.0.27 VM list
2025-03-29 17:45:39,293 - DEBUG - Pod 534d5785-7917-48ea-a3cf-7b4ff76b3d48 is not in agent 10.0.0.27 VM list
2025-03-29 17:45:39,304 - DEBUG - VMI 2479dc44-0cc5-11f0-964b-fa163e191163 is removed from agent 10.0.0.27
2025-03-29 17:45:39,304 - INFO - Verified that pod ctest-pod-59601452 is removed in agent
2025-03-29 17:45:39,306 - DEBUG - VMI 24fd58d0-0cc5-11f0-964b-fa163e191163 is removed from agent 10.0.0.27
2025-03-29 17:45:39,306 - INFO - Verified that pod ctest-pod-74551569 is removed in agent
2025-03-29 17:45:44,234 - WARNING - Pod uuid f8ae30cb-21d1-44dc-854f-087f0c1c61a0 is still seen in agent 10.0.0.27 VM list
2025-03-29 17:45:44,265 - WARNING - Pod uuid ccc24fe8-1987-4478-88da-d36e22110f7d is still seen in agent 10.0.0.27 VM list
2025-03-29 17:45:44,300 - WARNING - Pod uuid 60f80d13-8fec-45ed-87b8-06ccf64a52c1 is still seen in agent 10.0.0.27 VM list
2025-03-29 17:45:44,301 - WARNING - Pod uuid 547c8873-9449-42ab-a40c-ab9b7311dbd3 is still seen in agent 10.0.0.27 VM list
2025-03-29 17:45:49,242 - WARNING - Pod uuid f8ae30cb-21d1-44dc-854f-087f0c1c61a0 is still seen in agent 10.0.0.27 VM list
2025-03-29 17:45:49,272 - WARNING - Pod uuid ccc24fe8-1987-4478-88da-d36e22110f7d is still seen in agent 10.0.0.27 VM list
2025-03-29 17:45:49,312 - WARNING - Pod uuid 547c8873-9449-42ab-a40c-ab9b7311dbd3 is still seen in agent 10.0.0.27 VM list
2025-03-29 17:45:49,313 - WARNING - Pod uuid 60f80d13-8fec-45ed-87b8-06ccf64a52c1 is still seen in agent 10.0.0.27 VM list
2025-03-29 17:45:54,252 - WARNING - Pod uuid f8ae30cb-21d1-44dc-854f-087f0c1c61a0 is still seen in agent 10.0.0.27 VM list
2025-03-29 17:45:54,281 - WARNING - Pod uuid ccc24fe8-1987-4478-88da-d36e22110f7d is still seen in agent 10.0.0.27 VM list
2025-03-29 17:45:54,325 - WARNING - Pod uuid 547c8873-9449-42ab-a40c-ab9b7311dbd3 is still seen in agent 10.0.0.27 VM list
2025-03-29 17:45:54,326 - WARNING - Pod uuid 60f80d13-8fec-45ed-87b8-06ccf64a52c1 is still seen in agent 10.0.0.27 VM list
2025-03-29 17:45:59,263 - WARNING - Pod uuid f8ae30cb-21d1-44dc-854f-087f0c1c61a0 is still seen in agent 10.0.0.27 VM list
2025-03-29 17:45:59,289 - WARNING - Pod uuid ccc24fe8-1987-4478-88da-d36e22110f7d is still seen in agent 10.0.0.27 VM list
2025-03-29 17:45:59,339 - WARNING - Pod uuid 547c8873-9449-42ab-a40c-ab9b7311dbd3 is still seen in agent 10.0.0.27 VM list
2025-03-29 17:45:59,339 - WARNING - Pod uuid 60f80d13-8fec-45ed-87b8-06ccf64a52c1 is still seen in agent 10.0.0.27 VM list
2025-03-29 17:46:04,300 - WARNING - Pod uuid f8ae30cb-21d1-44dc-854f-087f0c1c61a0 is still seen in agent 10.0.0.27 VM list
2025-03-29 17:46:04,301 - WARNING - Pod uuid ccc24fe8-1987-4478-88da-d36e22110f7d is still seen in agent 10.0.0.27 VM list
2025-03-29 17:46:04,365 - WARNING - Pod uuid 547c8873-9449-42ab-a40c-ab9b7311dbd3 is still seen in agent 10.0.0.27 VM list
2025-03-29 17:46:04,366 - WARNING - Pod uuid 60f80d13-8fec-45ed-87b8-06ccf64a52c1 is still seen in agent 10.0.0.27 VM list
2025-03-29 17:46:09,312 - DEBUG - Pod f8ae30cb-21d1-44dc-854f-087f0c1c61a0 is not in agent 10.0.0.27 VM list
2025-03-29 17:46:09,316 - DEBUG - Pod ccc24fe8-1987-4478-88da-d36e22110f7d is not in agent 10.0.0.27 VM list
2025-03-29 17:46:09,324 - DEBUG - VMI 271dfdd6-0cc5-11f0-964b-fa163e191163 is removed from agent 10.0.0.27
2025-03-29 17:46:09,324 - INFO - Verified that pod ctest-pod-14465300 is removed in agent
2025-03-29 17:46:09,326 - DEBUG - VMI 258f5c80-0cc5-11f0-964b-fa163e191163 is removed from agent 10.0.0.27
2025-03-29 17:46:09,326 - INFO - Verified that pod ctest-pod-56553075 is removed in agent
2025-03-29 17:46:09,378 - DEBUG - Pod 60f80d13-8fec-45ed-87b8-06ccf64a52c1 is not in agent 10.0.0.27 VM list
2025-03-29 17:46:09,380 - DEBUG - Pod 547c8873-9449-42ab-a40c-ab9b7311dbd3 is not in agent 10.0.0.27 VM list
2025-03-29 17:46:09,388 - DEBUG - VMI 260e1b74-0cc5-11f0-964b-fa163e191163 is removed from agent 10.0.0.27
2025-03-29 17:46:09,388 - INFO - Verified that pod ctest-pod-45855966 is removed in agent
2025-03-29 17:46:09,390 - DEBUG - VMI 26938a70-0cc5-11f0-964b-fa163e191163 is removed from agent 10.0.0.27
2025-03-29 17:46:09,390 - INFO - Verified that pod ctest-pod-06427465 is removed in agent
2025-03-29 17:46:09,390 - INFO - Deleting namespace ctest-non-default-63826689
2025-03-29 17:46:09,406 - DEBUG - Namespace ctest-non-default-63826689 still in k8s
2025-03-29 17:46:11,412 - DEBUG - Namespace ctest-non-default-63826689 still in k8s
2025-03-29 17:46:13,416 - DEBUG - Namespace ctest-non-default-63826689 still in k8s
2025-03-29 17:46:15,421 - DEBUG - Namespace ctest-non-default-63826689 is not in k8s
2025-03-29 17:46:15,421 - DEBUG - No need to check project deletion in contrail-api
2025-03-29 17:46:15,421 - INFO - Deleting namespace ctest-new-default-54294072
2025-03-29 17:46:15,434 - DEBUG - Namespace ctest-new-default-54294072 still in k8s
2025-03-29 17:46:17,439 - DEBUG - Namespace ctest-new-default-54294072 still in k8s
2025-03-29 17:46:19,444 - DEBUG - Namespace ctest-new-default-54294072 still in k8s
2025-03-29 17:46:21,448 - DEBUG - Namespace ctest-new-default-54294072 is not in k8s
2025-03-29 17:46:21,448 - DEBUG - No need to check project deletion in contrail-api