2025-04-09 16:16:08,952 - INFO - Using existing project ['default-domain', 'k8s-default'](691ef60c-d1f2-4b4b-8b12-6e5549bfd107)
2025-04-09 16:16:08,971 - DEBUG - Namespace ctest-new-default-68715996 not present
2025-04-09 16:16:08,989 - INFO - Created namespace ctest-new-default-68715996
2025-04-09 16:16:12,033 - DEBUG - Namespace ctest-non-default-54316039 not present
2025-04-09 16:16:12,051 - INFO - Created namespace ctest-non-default-54316039
2025-04-09 16:16:15,110 - DEBUG - Pod ctest-pod-41875879 not present
2025-04-09 16:16:15,111 - INFO - Creating Pod ctest-pod-41875879
2025-04-09 16:16:15,162 - DEBUG - Pod : ctest-pod-41875879 UUID is 4a75f43a-0630-4565-97cd-1b867e08b8b0
2025-04-09 16:16:15,170 - DEBUG - Pod ctest-pod-74705758 not present
2025-04-09 16:16:15,170 - INFO - Creating Pod ctest-pod-74705758
2025-04-09 16:16:15,233 - DEBUG - Pod : ctest-pod-74705758 UUID is f6d5cd14-15ac-41d6-bcd1-32a28e182983
2025-04-09 16:16:15,246 - DEBUG - Pod ctest-pod-74038757 not present
2025-04-09 16:16:15,246 - INFO - Creating Pod ctest-pod-74038757
2025-04-09 16:16:15,279 - DEBUG - Pod : ctest-pod-74038757 UUID is cdeb9a13-67bd-4cd1-b590-22140b3b7b42
2025-04-09 16:16:15,281 - DEBUG - Pod ctest-pod-12360567 not present
2025-04-09 16:16:15,281 - INFO - Creating Pod ctest-pod-12360567
2025-04-09 16:16:15,311 - DEBUG - Pod : ctest-pod-12360567 UUID is 5d2b5ead-44e8-47d4-a583-9ed7000f4af4
2025-04-09 16:16:15,313 - DEBUG - Pod ctest-pod-50011583 not present
2025-04-09 16:16:15,313 - INFO - Creating Pod ctest-pod-50011583
2025-04-09 16:16:15,334 - DEBUG - Pod : ctest-pod-50011583 UUID is b676fbbd-48b0-4d44-a1a5-8c9ea02be0f9
2025-04-09 16:16:15,340 - DEBUG - Pod ctest-pod-39866323 not present
2025-04-09 16:16:15,340 - INFO - Creating Pod ctest-pod-39866323
2025-04-09 16:16:15,379 - DEBUG - Pod : ctest-pod-39866323 UUID is 64a9b1c7-0509-45f1-843f-f38896383f32
2025-04-09 16:16:15,382 - DEBUG - Pod ctest-pod-66779814 not present
2025-04-09 16:16:15,382 - INFO - Creating Pod ctest-pod-66779814
2025-04-09 16:16:15,402 - DEBUG - Pod : ctest-pod-66779814 UUID is a116cfd1-6f1c-4c7a-873a-21855dfb3928
2025-04-09 16:16:15,404 - DEBUG - Pod ctest-pod-67228472 not present
2025-04-09 16:16:15,405 - INFO - Creating Pod ctest-pod-67228472
2025-04-09 16:16:15,423 - DEBUG - Pod : ctest-pod-67228472 UUID is ecd70b35-7d0f-41c8-9640-691883206cd6
2025-04-09 16:16:15,710 - INFO - Project default-domain:k8s-ctest-new-default-68715996 for Namespace ctest-new-default-68715996 is seen in contrail-api
2025-04-09 16:16:15,710 - DEBUG - Project uuid in Contrail is 9eb409dd-7ae6-4e41-8a8f-c146973885ee
2025-04-09 16:16:15,910 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NamespaceDatabaseList?namespace_uuid=8aa4829f-917e-4b76-9e76-8e63a73b41b3
2025-04-09 16:16:15,917 - INFO - Namespace ctest-new-default-68715996 with uuid 8aa4829f-917e-4b76-9e76-8e63a73b41b3 found in kube manager
2025-04-09 16:16:15,917 - INFO - Namespace ctest-new-default-68715996 verification passed
2025-04-09 16:16:16,129 - INFO - Project default-domain:k8s-ctest-non-default-54316039 for Namespace ctest-non-default-54316039 is seen in contrail-api
2025-04-09 16:16:16,129 - DEBUG - Project uuid in Contrail is af41cc4a-0bd6-4e3b-a69a-671d8f868cd4
2025-04-09 16:16:16,130 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NamespaceDatabaseList?namespace_uuid=05f08524-9526-4172-8c05-5b7c3c71bbb7
2025-04-09 16:16:16,145 - INFO - Namespace ctest-non-default-54316039 with uuid 05f08524-9526-4172-8c05-5b7c3c71bbb7 found in kube manager
2025-04-09 16:16:16,146 - INFO - Namespace ctest-non-default-54316039 verification passed
2025-04-09 16:16:16,156 - DEBUG - Pod ctest-pod-41875879 not in running state.Currently in Pending
2025-04-09 16:16:21,162 - DEBUG - Pod ctest-pod-41875879 not in running state.Currently in Pending
2025-04-09 16:16:26,169 - INFO - Pod ctest-pod-41875879 is in running state.Got IP 10.47.255.251
2025-04-09 16:16:26,195 - DEBUG - Pod ctest-pod-41875879 has vmi f737ab3e-155d-11f0-a008-fa163e3fd57f
2025-04-09 16:16:26,195 - INFO - Verified pod ctest-pod-41875879 in contrail-api
2025-04-09 16:16:26,209 - DEBUG - VMI f737ab3e-155d-11f0-a008-fa163e3fd57f is active in agent 10.0.0.41
2025-04-09 16:16:26,209 - INFO - Verified Pod ctest-pod-41875879 in agent 10.0.0.41
2025-04-09 16:16:26,209 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=4a75f43a-0630-4565-97cd-1b867e08b8b0
2025-04-09 16:16:26,214 - INFO - Pod ctest-pod-41875879 with uuid 4a75f43a-0630-4565-97cd-1b867e08b8b0 found in kube manager
2025-04-09 16:16:26,214 - INFO - Pod ctest-pod-41875879 verification passed
2025-04-09 16:16:26,219 - DEBUG - Pod ctest-pod-74705758 not in running state.Currently in Pending
2025-04-09 16:16:31,225 - INFO - Pod ctest-pod-74705758 is in running state.Got IP 10.47.255.250
2025-04-09 16:16:31,284 - DEBUG - Pod ctest-pod-74705758 has vmi f7c68282-155d-11f0-a008-fa163e3fd57f
2025-04-09 16:16:31,284 - INFO - Verified pod ctest-pod-74705758 in contrail-api
2025-04-09 16:16:31,298 - DEBUG - VMI f7c68282-155d-11f0-a008-fa163e3fd57f is active in agent 10.0.0.41
2025-04-09 16:16:31,298 - INFO - Verified Pod ctest-pod-74705758 in agent 10.0.0.41
2025-04-09 16:16:31,298 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=f6d5cd14-15ac-41d6-bcd1-32a28e182983
2025-04-09 16:16:31,304 - INFO - Pod ctest-pod-74705758 with uuid f6d5cd14-15ac-41d6-bcd1-32a28e182983 found in kube manager
2025-04-09 16:16:31,304 - INFO - Pod ctest-pod-74705758 verification passed
2025-04-09 16:16:31,309 - INFO - Pod ctest-pod-74038757 is in running state.Got IP 10.47.255.249
2025-04-09 16:16:31,323 - DEBUG - Pod ctest-pod-74038757 has vmi f87321a4-155d-11f0-a008-fa163e3fd57f
2025-04-09 16:16:31,323 - INFO - Verified pod ctest-pod-74038757 in contrail-api
2025-04-09 16:16:31,335 - DEBUG - VMI f87321a4-155d-11f0-a008-fa163e3fd57f is active in agent 10.0.0.41
2025-04-09 16:16:31,336 - INFO - Verified Pod ctest-pod-74038757 in agent 10.0.0.41
2025-04-09 16:16:31,336 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=cdeb9a13-67bd-4cd1-b590-22140b3b7b42
2025-04-09 16:16:31,340 - INFO - Pod ctest-pod-74038757 with uuid cdeb9a13-67bd-4cd1-b590-22140b3b7b42 found in kube manager
2025-04-09 16:16:31,341 - INFO - Pod ctest-pod-74038757 verification passed
2025-04-09 16:16:31,346 - INFO - Pod ctest-pod-12360567 is in running state.Got IP 10.47.255.248
2025-04-09 16:16:31,402 - DEBUG - Pod ctest-pod-12360567 has vmi f904a87c-155d-11f0-a008-fa163e3fd57f
2025-04-09 16:16:31,402 - INFO - Verified pod ctest-pod-12360567 in contrail-api
2025-04-09 16:16:31,418 - DEBUG - VMI f904a87c-155d-11f0-a008-fa163e3fd57f is active in agent 10.0.0.41
2025-04-09 16:16:31,418 - INFO - Verified Pod ctest-pod-12360567 in agent 10.0.0.41
2025-04-09 16:16:31,418 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=5d2b5ead-44e8-47d4-a583-9ed7000f4af4
2025-04-09 16:16:31,423 - INFO - Pod ctest-pod-12360567 with uuid 5d2b5ead-44e8-47d4-a583-9ed7000f4af4 found in kube manager
2025-04-09 16:16:31,423 - INFO - Pod ctest-pod-12360567 verification passed
2025-04-09 16:16:31,430 - INFO - Pod ctest-pod-50011583 is in running state.Got IP 10.47.255.247
2025-04-09 16:16:31,488 - DEBUG - Pod ctest-pod-50011583 has vmi f9b6491a-155d-11f0-a008-fa163e3fd57f
2025-04-09 16:16:31,488 - INFO - Verified pod ctest-pod-50011583 in contrail-api
2025-04-09 16:16:31,502 - DEBUG - VMI f9b6491a-155d-11f0-a008-fa163e3fd57f is active in agent 10.0.0.41
2025-04-09 16:16:31,502 - INFO - Verified Pod ctest-pod-50011583 in agent 10.0.0.41
2025-04-09 16:16:31,502 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=b676fbbd-48b0-4d44-a1a5-8c9ea02be0f9
2025-04-09 16:16:31,507 - INFO - Pod ctest-pod-50011583 with uuid b676fbbd-48b0-4d44-a1a5-8c9ea02be0f9 found in kube manager
2025-04-09 16:16:31,507 - INFO - Pod ctest-pod-50011583 verification passed
2025-04-09 16:16:31,513 - INFO - Pod ctest-pod-66779814 is in running state.Got IP 10.47.255.245
2025-04-09 16:16:31,528 - DEBUG - Pod ctest-pod-66779814 has vmi fab973c8-155d-11f0-a008-fa163e3fd57f
2025-04-09 16:16:31,528 - INFO - Verified pod ctest-pod-66779814 in contrail-api
2025-04-09 16:16:31,542 - DEBUG - VMI fab973c8-155d-11f0-a008-fa163e3fd57f is active in agent 10.0.0.41
2025-04-09 16:16:31,543 - INFO - Verified Pod ctest-pod-66779814 in agent 10.0.0.41
2025-04-09 16:16:31,543 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=a116cfd1-6f1c-4c7a-873a-21855dfb3928
2025-04-09 16:16:31,548 - INFO - Pod ctest-pod-66779814 with uuid a116cfd1-6f1c-4c7a-873a-21855dfb3928 found in kube manager
2025-04-09 16:16:31,548 - INFO - Pod ctest-pod-66779814 verification passed
2025-04-09 16:16:31,554 - INFO - Pod ctest-pod-39866323 is in running state.Got IP 10.47.255.246
2025-04-09 16:16:31,609 - DEBUG - Pod ctest-pod-39866323 has vmi fa37483a-155d-11f0-a008-fa163e3fd57f
2025-04-09 16:16:31,609 - INFO - Verified pod ctest-pod-39866323 in contrail-api
2025-04-09 16:16:31,622 - DEBUG - VMI fa37483a-155d-11f0-a008-fa163e3fd57f is active in agent 10.0.0.41
2025-04-09 16:16:31,622 - INFO - Verified Pod ctest-pod-39866323 in agent 10.0.0.41
2025-04-09 16:16:31,622 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=64a9b1c7-0509-45f1-843f-f38896383f32
2025-04-09 16:16:31,627 - INFO - Pod ctest-pod-39866323 with uuid 64a9b1c7-0509-45f1-843f-f38896383f32 found in kube manager
2025-04-09 16:16:31,627 - INFO - Pod ctest-pod-39866323 verification passed
2025-04-09 16:16:31,632 - DEBUG - Pod ctest-pod-67228472 not in running state.Currently in Pending
2025-04-09 16:16:36,639 - INFO - Pod ctest-pod-67228472 is in running state.Got IP 10.47.255.244
2025-04-09 16:16:36,661 - DEBUG - Pod ctest-pod-67228472 has vmi fb332740-155d-11f0-a008-fa163e3fd57f
2025-04-09 16:16:36,661 - INFO - Verified pod ctest-pod-67228472 in contrail-api
2025-04-09 16:16:36,676 - DEBUG - VMI fb332740-155d-11f0-a008-fa163e3fd57f is active in agent 10.0.0.41
2025-04-09 16:16:36,676 - INFO - Verified Pod ctest-pod-67228472 in agent 10.0.0.41
2025-04-09 16:16:36,676 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=ecd70b35-7d0f-41c8-9640-691883206cd6
2025-04-09 16:16:36,682 - INFO - Pod ctest-pod-67228472 with uuid ecd70b35-7d0f-41c8-9640-691883206cd6 found in kube manager
2025-04-09 16:16:36,682 - INFO - Pod ctest-pod-67228472 verification passed
2025-04-09 16:16:36,682 - INFO - ================================================================================
2025-04-09 16:16:36,682 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-04-09 16:16:36,682 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-04-09 16:16:36,931 - DEBUG - Nothing to compare xmpp stats {'10.0.0.41': {'10.0.0.27': '0'}} with
2025-04-09 16:16:36,931 - INFO - Initial checks done. Running the testcase now
2025-04-09 16:16:36,932 - INFO -
2025-04-09 16:16:37,004 - DEBUG - [Pod ctest-pod-41875879] Cmd: echo ctest-pod-41875879 > /usr/share/nginx/html/index.html, Output:
2025-04-09 16:16:37,077 - DEBUG - [Pod ctest-pod-74705758] Cmd: echo ctest-pod-74705758 > /usr/share/nginx/html/index.html, Output:
2025-04-09 16:16:37,146 - DEBUG - [Pod ctest-pod-74038757] Cmd: echo ctest-pod-74038757 > /usr/share/nginx/html/index.html, Output:
2025-04-09 16:16:37,205 - DEBUG - [Pod ctest-pod-12360567] Cmd: echo ctest-pod-12360567 > /usr/share/nginx/html/index.html, Output:
2025-04-09 16:16:37,216 - DEBUG - Service ctest-nginx-svc-00690721 not present
2025-04-09 16:16:37,216 - INFO - Creating service ctest-nginx-svc-00690721
2025-04-09 16:16:37,230 - INFO - Created Service ctest-nginx-svc-00690721
2025-04-09 16:16:37,238 - WARNING - Service UUID 64326ee5-55b6-44f1-8e74-b38a67721964 not yet found in contrail-api
2025-04-09 16:16:38,258 - INFO - Validated that Service ctest-nginx-svc-00690721 is seen in contrail-api
2025-04-09 16:16:38,259 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_LoadbalancerDatabaseList?x=64326ee5-55b6-44f1-8e74-b38a67721964
2025-04-09 16:16:38,266 - INFO - Service ctest-nginx-svc-00690721 with uuid 64326ee5-55b6-44f1-8e74-b38a67721964 found in kube manager
2025-04-09 16:16:38,266 - INFO - Service ctest-nginx-svc-00690721 verification passed
2025-04-09 16:16:39,334 - DEBUG - [Pod ctest-pod-50011583] Cmd: wget http://10.109.69.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
ctest-pod-74705758
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-09 16:16:39,334 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd wget http://10.109.69.141:80/ -O - -T 5 -t 1 passed
2025-04-09 16:16:39,334 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
ctest-pod-74705758
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-09 16:16:39,408 - DEBUG - [Pod ctest-pod-50011583] Cmd: wget http://10.109.69.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-41875879
2025-04-09 16:16:39,408 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd wget http://10.109.69.141:80/ -O - -T 5 -t 1 passed
2025-04-09 16:16:39,408 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-41875879
2025-04-09 16:16:39,408 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-41875879': 1, 'ctest-pod-74705758': 1}
2025-04-09 16:16:39,471 - DEBUG - [Pod ctest-pod-66779814] Cmd: wget http://10.109.69.141:80/ -O - -T 5 -t 1 , Output: ctest-pod-41875879
Connecting to 10.109.69.141:80 (10.109.69.141:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-09 16:16:39,471 - DEBUG - [Pod Pod ctest-pod-66779814] Cmd wget http://10.109.69.141:80/ -O - -T 5 -t 1 passed
2025-04-09 16:16:39,471 - DEBUG - [Pod Pod ctest-pod-66779814] Cmd output: ctest-pod-41875879
Connecting to 10.109.69.141:80 (10.109.69.141:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-09 16:16:39,533 - DEBUG - [Pod ctest-pod-66779814] Cmd: wget http://10.109.69.141:80/ -O - -T 5 -t 1 , Output: ctest-pod-74705758
Connecting to 10.109.69.141:80 (10.109.69.141:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-09 16:16:39,534 - DEBUG - [Pod Pod ctest-pod-66779814] Cmd wget http://10.109.69.141:80/ -O - -T 5 -t 1 passed
2025-04-09 16:16:39,534 - DEBUG - [Pod Pod ctest-pod-66779814] Cmd output: ctest-pod-74705758
Connecting to 10.109.69.141:80 (10.109.69.141:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-09 16:16:39,534 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-41875879': 1, 'ctest-pod-74705758': 1}
2025-04-09 16:16:39,537 - DEBUG - Network policy ingress-on-service not present
2025-04-09 16:16:39,610 - INFO - Creating Network Policy ingress-on-service
2025-04-09 16:16:39,624 - INFO - Network policy found in k8s
2025-04-09 16:16:39,624 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=27a8c400-906b-404d-bcc9-561b7f67c3cd
2025-04-09 16:16:39,629 - INFO - Network Policy ingress-on-service with uuid 27a8c400-906b-404d-bcc9-561b7f67c3cd found in kube manager
2025-04-09 16:16:39,661 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-04-09 16:16:39,662 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-04-09 16:16:39,662 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=27a8c400-906b-404d-bcc9-561b7f67c3cd
2025-04-09 16:16:39,691 - WARNING - Network policy with name ingress-on-service not found in agent
2025-04-09 16:16:41,691 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=27a8c400-906b-404d-bcc9-561b7f67c3cd
2025-04-09 16:16:41,728 - INFO - Network policy with name ingress-on-service found in agent
2025-04-09 16:16:41,728 - INFO - Network Policy ingress-on-service verification passed
2025-04-09 16:16:46,787 - DEBUG - [Pod ctest-pod-50011583] Cmd: wget http://10.109.69.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:16:46,787 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd wget http://10.109.69.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:16:46,787 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:16:51,869 - DEBUG - [Pod ctest-pod-50011583] Cmd: wget http://10.109.69.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:16:51,869 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd wget http://10.109.69.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:16:51,869 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:16:56,922 - DEBUG - [Pod ctest-pod-50011583] Cmd: wget http://10.109.69.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:16:56,922 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd wget http://10.109.69.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:16:56,922 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:17:01,985 - DEBUG - [Pod ctest-pod-50011583] Cmd: wget http://10.109.69.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:17:01,985 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd wget http://10.109.69.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:17:01,986 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:17:07,043 - DEBUG - [Pod ctest-pod-50011583] Cmd: wget http://10.109.69.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:17:07,043 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd wget http://10.109.69.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:17:07,043 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:17:12,119 - DEBUG - [Pod ctest-pod-50011583] Cmd: wget http://10.109.69.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:17:12,120 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd wget http://10.109.69.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:17:12,120 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:17:17,199 - DEBUG - [Pod ctest-pod-50011583] Cmd: wget http://10.109.69.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:17:17,199 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd wget http://10.109.69.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:17:17,199 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:17:22,256 - DEBUG - [Pod ctest-pod-50011583] Cmd: wget http://10.109.69.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:17:22,256 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd wget http://10.109.69.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:17:22,256 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:17:27,322 - DEBUG - [Pod ctest-pod-50011583] Cmd: wget http://10.109.69.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:17:27,322 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd wget http://10.109.69.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:17:27,322 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:17:32,396 - DEBUG - [Pod ctest-pod-50011583] Cmd: wget http://10.109.69.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:17:32,396 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd wget http://10.109.69.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:17:32,396 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:17:32,396 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-41875879': 0, 'ctest-pod-74705758': 0}
2025-04-09 16:17:32,462 - DEBUG - [Pod ctest-pod-39866323] Cmd: wget http://10.109.69.141:80/ -O - -T 5 -t 1 , Output: ctest-pod-41875879
Connecting to 10.109.69.141:80 (10.109.69.141:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-09 16:17:32,462 - DEBUG - [Pod Pod ctest-pod-39866323] Cmd wget http://10.109.69.141:80/ -O - -T 5 -t 1 passed
2025-04-09 16:17:32,462 - DEBUG - [Pod Pod ctest-pod-39866323] Cmd output: ctest-pod-41875879
Connecting to 10.109.69.141:80 (10.109.69.141:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-09 16:17:32,538 - DEBUG - [Pod ctest-pod-39866323] Cmd: wget http://10.109.69.141:80/ -O - -T 5 -t 1 , Output: ctest-pod-41875879
Connecting to 10.109.69.141:80 (10.109.69.141:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-09 16:17:32,538 - DEBUG - [Pod Pod ctest-pod-39866323] Cmd wget http://10.109.69.141:80/ -O - -T 5 -t 1 passed
2025-04-09 16:17:32,538 - DEBUG - [Pod Pod ctest-pod-39866323] Cmd output: ctest-pod-41875879
Connecting to 10.109.69.141:80 (10.109.69.141:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-09 16:17:32,609 - DEBUG - [Pod ctest-pod-39866323] Cmd: wget http://10.109.69.141:80/ -O - -T 5 -t 1 , Output: ctest-pod-41875879
Connecting to 10.109.69.141:80 (10.109.69.141:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-09 16:17:32,609 - DEBUG - [Pod Pod ctest-pod-39866323] Cmd wget http://10.109.69.141:80/ -O - -T 5 -t 1 passed
2025-04-09 16:17:32,609 - DEBUG - [Pod Pod ctest-pod-39866323] Cmd output: ctest-pod-41875879
Connecting to 10.109.69.141:80 (10.109.69.141:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-09 16:17:32,675 - DEBUG - [Pod ctest-pod-39866323] Cmd: wget http://10.109.69.141:80/ -O - -T 5 -t 1 , Output: ctest-pod-74705758
Connecting to 10.109.69.141:80 (10.109.69.141:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-09 16:17:32,675 - DEBUG - [Pod Pod ctest-pod-39866323] Cmd wget http://10.109.69.141:80/ -O - -T 5 -t 1 passed
2025-04-09 16:17:32,676 - DEBUG - [Pod Pod ctest-pod-39866323] Cmd output: ctest-pod-74705758
Connecting to 10.109.69.141:80 (10.109.69.141:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-09 16:17:32,676 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-41875879': 3, 'ctest-pod-74705758': 1}
2025-04-09 16:17:37,731 - DEBUG - [Pod ctest-pod-66779814] Cmd: wget http://10.109.69.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:17:37,731 - DEBUG - [Pod Pod ctest-pod-66779814] Cmd wget http://10.109.69.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:17:37,731 - DEBUG - [Pod Pod ctest-pod-66779814] Cmd output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:17:42,806 - DEBUG - [Pod ctest-pod-66779814] Cmd: wget http://10.109.69.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:17:42,806 - DEBUG - [Pod Pod ctest-pod-66779814] Cmd wget http://10.109.69.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:17:42,806 - DEBUG - [Pod Pod ctest-pod-66779814] Cmd output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:17:47,868 - DEBUG - [Pod ctest-pod-66779814] Cmd: wget http://10.109.69.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:17:47,868 - DEBUG - [Pod Pod ctest-pod-66779814] Cmd wget http://10.109.69.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:17:47,868 - DEBUG - [Pod Pod ctest-pod-66779814] Cmd output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:17:52,942 - DEBUG - [Pod ctest-pod-66779814] Cmd: wget http://10.109.69.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:17:52,943 - DEBUG - [Pod Pod ctest-pod-66779814] Cmd wget http://10.109.69.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:17:52,943 - DEBUG - [Pod Pod ctest-pod-66779814] Cmd output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:17:58,014 - DEBUG - [Pod ctest-pod-66779814] Cmd: wget http://10.109.69.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:17:58,014 - DEBUG - [Pod Pod ctest-pod-66779814] Cmd wget http://10.109.69.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:17:58,014 - DEBUG - [Pod Pod ctest-pod-66779814] Cmd output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:18:03,078 - DEBUG - [Pod ctest-pod-66779814] Cmd: wget http://10.109.69.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:18:03,078 - DEBUG - [Pod Pod ctest-pod-66779814] Cmd wget http://10.109.69.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:18:03,078 - DEBUG - [Pod Pod ctest-pod-66779814] Cmd output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:18:08,135 - DEBUG - [Pod ctest-pod-66779814] Cmd: wget http://10.109.69.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:18:08,135 - DEBUG - [Pod Pod ctest-pod-66779814] Cmd wget http://10.109.69.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:18:08,136 - DEBUG - [Pod Pod ctest-pod-66779814] Cmd output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:18:13,208 - DEBUG - [Pod ctest-pod-66779814] Cmd: wget http://10.109.69.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:18:13,208 - DEBUG - [Pod Pod ctest-pod-66779814] Cmd wget http://10.109.69.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:18:13,208 - DEBUG - [Pod Pod ctest-pod-66779814] Cmd output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:18:18,286 - DEBUG - [Pod ctest-pod-66779814] Cmd: wget http://10.109.69.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:18:18,287 - DEBUG - [Pod Pod ctest-pod-66779814] Cmd wget http://10.109.69.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:18:18,287 - DEBUG - [Pod Pod ctest-pod-66779814] Cmd output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:18:23,359 - DEBUG - [Pod ctest-pod-66779814] Cmd: wget http://10.109.69.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:18:23,359 - DEBUG - [Pod Pod ctest-pod-66779814] Cmd wget http://10.109.69.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:18:23,359 - DEBUG - [Pod Pod ctest-pod-66779814] Cmd output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:18:23,359 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-41875879': 0, 'ctest-pod-74705758': 0}
2025-04-09 16:18:25,420 - DEBUG - [Pod ctest-pod-39866323] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.891 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.077 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.081 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.077/0.349/0.891 ms
2025-04-09 16:18:25,420 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-39866323 with expectation True passed
2025-04-09 16:18:27,482 - DEBUG - [Pod ctest-pod-50011583] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.458 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.082 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.076 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.076/0.538/1.458 ms
2025-04-09 16:18:27,482 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-50011583 with expectation True passed
2025-04-09 16:18:29,551 - DEBUG - [Pod ctest-pod-66779814] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.058 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.074 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.075 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.074/0.402/1.058 ms
2025-04-09 16:18:29,551 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-66779814 with expectation True passed
2025-04-09 16:18:29,613 - DEBUG - [Pod ctest-pod-39866323] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-09 16:18:29,613 - DEBUG - [Pod Pod ctest-pod-39866323] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-04-09 16:18:29,613 - DEBUG - [Pod Pod ctest-pod-39866323] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-09 16:18:29,613 - INFO - wget check of of http://10.47.255.251 from ctest-pod-39866323 passed
2025-04-09 16:18:29,677 - DEBUG - [Pod ctest-pod-39866323] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-09 16:18:29,678 - DEBUG - [Pod Pod ctest-pod-39866323] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-04-09 16:18:29,678 - DEBUG - [Pod Pod ctest-pod-39866323] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-09 16:18:29,678 - INFO - wget check of of http://10.47.255.250 from ctest-pod-39866323 passed
2025-04-09 16:18:34,738 - DEBUG - [Pod ctest-pod-50011583] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-09 16:18:34,738 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-09 16:18:34,738 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-09 16:18:34,738 - INFO - wget check of of http://10.47.255.250 from ctest-pod-50011583 passed
2025-04-09 16:18:39,816 - DEBUG - [Pod ctest-pod-67228472] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-04-09 16:18:39,816 - DEBUG - [Pod Pod ctest-pod-67228472] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-04-09 16:18:39,816 - DEBUG - [Pod Pod ctest-pod-67228472] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-04-09 16:18:39,817 - INFO - wget check of of http://10.47.255.251 from ctest-pod-67228472 passed
2025-04-09 16:18:39,827 - INFO - Updating Network Policy ingress-on-service
2025-04-09 16:18:44,899 - DEBUG - [Pod ctest-pod-50011583] Cmd: wget http://10.109.69.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:18:44,900 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd wget http://10.109.69.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:18:44,900 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:18:49,957 - DEBUG - [Pod ctest-pod-50011583] Cmd: wget http://10.109.69.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:18:49,958 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd wget http://10.109.69.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:18:49,958 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:18:55,007 - DEBUG - [Pod ctest-pod-50011583] Cmd: wget http://10.109.69.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:18:55,007 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd wget http://10.109.69.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:18:55,007 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:19:00,067 - DEBUG - [Pod ctest-pod-50011583] Cmd: wget http://10.109.69.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:19:00,067 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd wget http://10.109.69.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:19:00,067 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:19:05,121 - DEBUG - [Pod ctest-pod-50011583] Cmd: wget http://10.109.69.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:19:05,121 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd wget http://10.109.69.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:19:05,121 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:19:10,194 - DEBUG - [Pod ctest-pod-50011583] Cmd: wget http://10.109.69.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:19:10,194 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd wget http://10.109.69.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:19:10,194 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:19:15,251 - DEBUG - [Pod ctest-pod-50011583] Cmd: wget http://10.109.69.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:19:15,251 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd wget http://10.109.69.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:19:15,251 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:19:20,303 - DEBUG - [Pod ctest-pod-50011583] Cmd: wget http://10.109.69.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:19:20,303 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd wget http://10.109.69.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:19:20,303 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:19:25,350 - DEBUG - [Pod ctest-pod-50011583] Cmd: wget http://10.109.69.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:19:25,350 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd wget http://10.109.69.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:19:25,350 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:19:30,408 - DEBUG - [Pod ctest-pod-50011583] Cmd: wget http://10.109.69.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:19:30,409 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd wget http://10.109.69.141:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:19:30,409 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
wget: download timed out
2025-04-09 16:19:30,409 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-41875879': 0, 'ctest-pod-74705758': 0}
2025-04-09 16:19:30,476 - DEBUG - [Pod ctest-pod-39866323] Cmd: wget http://10.109.69.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
ctest-pod-74705758
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-09 16:19:30,476 - DEBUG - [Pod Pod ctest-pod-39866323] Cmd wget http://10.109.69.141:80/ -O - -T 5 -t 1 passed
2025-04-09 16:19:30,476 - DEBUG - [Pod Pod ctest-pod-39866323] Cmd output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
ctest-pod-74705758
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-09 16:19:30,546 - DEBUG - [Pod ctest-pod-39866323] Cmd: wget http://10.109.69.141:80/ -O - -T 5 -t 1 , Output: ctest-pod-41875879
Connecting to 10.109.69.141:80 (10.109.69.141:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-09 16:19:30,546 - DEBUG - [Pod Pod ctest-pod-39866323] Cmd wget http://10.109.69.141:80/ -O - -T 5 -t 1 passed
2025-04-09 16:19:30,546 - DEBUG - [Pod Pod ctest-pod-39866323] Cmd output: ctest-pod-41875879
Connecting to 10.109.69.141:80 (10.109.69.141:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-09 16:19:30,546 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-41875879': 1, 'ctest-pod-74705758': 1}
2025-04-09 16:19:30,624 - DEBUG - [Pod ctest-pod-66779814] Cmd: wget http://10.109.69.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-74705758
2025-04-09 16:19:30,624 - DEBUG - [Pod Pod ctest-pod-66779814] Cmd wget http://10.109.69.141:80/ -O - -T 5 -t 1 passed
2025-04-09 16:19:30,624 - DEBUG - [Pod Pod ctest-pod-66779814] Cmd output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-74705758
2025-04-09 16:19:30,677 - DEBUG - [Pod ctest-pod-66779814] Cmd: wget http://10.109.69.141:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-41875879
2025-04-09 16:19:30,677 - DEBUG - [Pod Pod ctest-pod-66779814] Cmd wget http://10.109.69.141:80/ -O - -T 5 -t 1 passed
2025-04-09 16:19:30,677 - DEBUG - [Pod Pod ctest-pod-66779814] Cmd output: Connecting to 10.109.69.141:80 (10.109.69.141:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-41875879
2025-04-09 16:19:30,677 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-41875879': 1, 'ctest-pod-74705758': 1}
2025-04-09 16:19:32,791 - DEBUG - [Pod ctest-pod-39866323] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.976 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.092 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.094 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.092/0.387/0.976 ms
2025-04-09 16:19:32,791 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-39866323 with expectation True passed
2025-04-09 16:19:34,871 - DEBUG - [Pod ctest-pod-50011583] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.035 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.085 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.092 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.085/0.404/1.035 ms
2025-04-09 16:19:34,871 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-50011583 with expectation True passed
2025-04-09 16:19:36,924 - DEBUG - [Pod ctest-pod-66779814] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.441 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.083 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.095 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.083/0.206/0.441 ms
2025-04-09 16:19:36,924 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-66779814 with expectation True passed
2025-04-09 16:19:36,992 - DEBUG - [Pod ctest-pod-39866323] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-09 16:19:36,992 - DEBUG - [Pod Pod ctest-pod-39866323] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-04-09 16:19:36,992 - DEBUG - [Pod Pod ctest-pod-39866323] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-09 16:19:36,992 - INFO - wget check of of http://10.47.255.251 from ctest-pod-39866323 passed
2025-04-09 16:19:37,051 - DEBUG - [Pod ctest-pod-39866323] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-09 16:19:37,051 - DEBUG - [Pod Pod ctest-pod-39866323] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-04-09 16:19:37,051 - DEBUG - [Pod Pod ctest-pod-39866323] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-09 16:19:37,051 - INFO - wget check of of http://10.47.255.250 from ctest-pod-39866323 passed
2025-04-09 16:19:42,120 - DEBUG - [Pod ctest-pod-50011583] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-09 16:19:42,121 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-09 16:19:42,121 - DEBUG - [Pod Pod ctest-pod-50011583] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-09 16:19:42,121 - INFO - wget check of of http://10.47.255.250 from ctest-pod-50011583 passed
2025-04-09 16:19:42,193 - DEBUG - [Pod ctest-pod-67228472] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-09 16:19:42,194 - DEBUG - [Pod Pod ctest-pod-67228472] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-04-09 16:19:42,194 - DEBUG - [Pod Pod ctest-pod-67228472] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-09 16:19:42,194 - INFO - wget check of of http://10.47.255.251 from ctest-pod-67228472 passed
2025-04-09 16:19:42,194 - INFO - Deleting Network Policy : ingress-on-service
2025-04-09 16:19:42,194 - INFO - Deleting service : ctest-nginx-svc-00690721
2025-04-09 16:19:42,454 - DEBUG - No XMPP flaps were noticed during the test
2025-04-09 16:19:42,454 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:06]
2025-04-09 16:19:42,454 - INFO - --------------------------------------------------------------------------------
2025-04-09 16:19:42,460 - INFO - Deleting pod ctest-new-default-68715996:ctest-pod-41875879
2025-04-09 16:19:42,461 - INFO - Deleting pod ctest-new-default-68715996:ctest-pod-74705758
2025-04-09 16:19:42,462 - INFO - Deleting pod ctest-non-default-54316039:ctest-pod-74038757
2025-04-09 16:19:42,462 - INFO - Deleting pod ctest-non-default-54316039:ctest-pod-12360567
2025-04-09 16:19:42,463 - INFO - Deleting pod ctest-new-default-68715996:ctest-pod-50011583
2025-04-09 16:19:42,464 - INFO - Deleting pod ctest-new-default-68715996:ctest-pod-39866323
2025-04-09 16:19:42,464 - INFO - Deleting pod ctest-non-default-54316039:ctest-pod-66779814
2025-04-09 16:19:42,465 - INFO - Deleting pod ctest-non-default-54316039:ctest-pod-67228472
2025-04-09 16:19:42,506 - WARNING - Pod uuid 4a75f43a-0630-4565-97cd-1b867e08b8b0 is still seen in agent 10.0.0.41 VM list
2025-04-09 16:19:42,718 - WARNING - Pod uuid ecd70b35-7d0f-41c8-9640-691883206cd6 is still seen in agent 10.0.0.41 VM list
2025-04-09 16:19:42,719 - WARNING - Pod uuid b676fbbd-48b0-4d44-a1a5-8c9ea02be0f9 is still seen in agent 10.0.0.41 VM list
2025-04-09 16:19:42,719 - WARNING - Pod uuid 5d2b5ead-44e8-47d4-a583-9ed7000f4af4 is still seen in agent 10.0.0.41 VM list
2025-04-09 16:19:42,719 - WARNING - Pod uuid cdeb9a13-67bd-4cd1-b590-22140b3b7b42 is still seen in agent 10.0.0.41 VM list
2025-04-09 16:19:42,720 - WARNING - Pod uuid f6d5cd14-15ac-41d6-bcd1-32a28e182983 is still seen in agent 10.0.0.41 VM list
2025-04-09 16:19:42,720 - WARNING - Pod uuid 64a9b1c7-0509-45f1-843f-f38896383f32 is still seen in agent 10.0.0.41 VM list
2025-04-09 16:19:42,721 - WARNING - Pod uuid a116cfd1-6f1c-4c7a-873a-21855dfb3928 is still seen in agent 10.0.0.41 VM list
2025-04-09 16:19:47,519 - DEBUG - Pod 4a75f43a-0630-4565-97cd-1b867e08b8b0 is not in agent 10.0.0.41 VM list
2025-04-09 16:19:47,528 - DEBUG - VMI f737ab3e-155d-11f0-a008-fa163e3fd57f is removed from agent 10.0.0.41
2025-04-09 16:19:47,528 - INFO - Verified that pod ctest-pod-41875879 is removed in agent
2025-04-09 16:19:47,740 - WARNING - Pod uuid ecd70b35-7d0f-41c8-9640-691883206cd6 is still seen in agent 10.0.0.41 VM list
2025-04-09 16:19:47,742 - DEBUG - Pod 5d2b5ead-44e8-47d4-a583-9ed7000f4af4 is not in agent 10.0.0.41 VM list
2025-04-09 16:19:47,743 - WARNING - Pod uuid b676fbbd-48b0-4d44-a1a5-8c9ea02be0f9 is still seen in agent 10.0.0.41 VM list
2025-04-09 16:19:47,753 - WARNING - Pod uuid a116cfd1-6f1c-4c7a-873a-21855dfb3928 is still seen in agent 10.0.0.41 VM list
2025-04-09 16:19:47,755 - DEBUG - VMI f904a87c-155d-11f0-a008-fa163e3fd57f is removed from agent 10.0.0.41
2025-04-09 16:19:47,755 - INFO - Verified that pod ctest-pod-12360567 is removed in agent
2025-04-09 16:19:47,756 - DEBUG - Pod f6d5cd14-15ac-41d6-bcd1-32a28e182983 is not in agent 10.0.0.41 VM list
2025-04-09 16:19:47,757 - DEBUG - Pod cdeb9a13-67bd-4cd1-b590-22140b3b7b42 is not in agent 10.0.0.41 VM list
2025-04-09 16:19:47,758 - WARNING - Pod uuid 64a9b1c7-0509-45f1-843f-f38896383f32 is still seen in agent 10.0.0.41 VM list
2025-04-09 16:19:47,766 - DEBUG - VMI f87321a4-155d-11f0-a008-fa163e3fd57f is removed from agent 10.0.0.41
2025-04-09 16:19:47,766 - INFO - Verified that pod ctest-pod-74038757 is removed in agent
2025-04-09 16:19:47,767 - DEBUG - VMI f7c68282-155d-11f0-a008-fa163e3fd57f is removed from agent 10.0.0.41
2025-04-09 16:19:47,767 - INFO - Verified that pod ctest-pod-74705758 is removed in agent
2025-04-09 16:19:52,750 - WARNING - Pod uuid ecd70b35-7d0f-41c8-9640-691883206cd6 is still seen in agent 10.0.0.41 VM list
2025-04-09 16:19:52,751 - WARNING - Pod uuid b676fbbd-48b0-4d44-a1a5-8c9ea02be0f9 is still seen in agent 10.0.0.41 VM list
2025-04-09 16:19:52,761 - WARNING - Pod uuid a116cfd1-6f1c-4c7a-873a-21855dfb3928 is still seen in agent 10.0.0.41 VM list
2025-04-09 16:19:52,766 - WARNING - Pod uuid 64a9b1c7-0509-45f1-843f-f38896383f32 is still seen in agent 10.0.0.41 VM list
2025-04-09 16:19:57,761 - WARNING - Pod uuid b676fbbd-48b0-4d44-a1a5-8c9ea02be0f9 is still seen in agent 10.0.0.41 VM list
2025-04-09 16:19:57,762 - WARNING - Pod uuid ecd70b35-7d0f-41c8-9640-691883206cd6 is still seen in agent 10.0.0.41 VM list
2025-04-09 16:19:57,769 - WARNING - Pod uuid a116cfd1-6f1c-4c7a-873a-21855dfb3928 is still seen in agent 10.0.0.41 VM list
2025-04-09 16:19:57,774 - WARNING - Pod uuid 64a9b1c7-0509-45f1-843f-f38896383f32 is still seen in agent 10.0.0.41 VM list
2025-04-09 16:20:02,775 - WARNING - Pod uuid b676fbbd-48b0-4d44-a1a5-8c9ea02be0f9 is still seen in agent 10.0.0.41 VM list
2025-04-09 16:20:02,777 - WARNING - Pod uuid ecd70b35-7d0f-41c8-9640-691883206cd6 is still seen in agent 10.0.0.41 VM list
2025-04-09 16:20:02,788 - WARNING - Pod uuid a116cfd1-6f1c-4c7a-873a-21855dfb3928 is still seen in agent 10.0.0.41 VM list
2025-04-09 16:20:02,790 - WARNING - Pod uuid 64a9b1c7-0509-45f1-843f-f38896383f32 is still seen in agent 10.0.0.41 VM list
2025-04-09 16:20:07,787 - WARNING - Pod uuid b676fbbd-48b0-4d44-a1a5-8c9ea02be0f9 is still seen in agent 10.0.0.41 VM list
2025-04-09 16:20:07,794 - WARNING - Pod uuid ecd70b35-7d0f-41c8-9640-691883206cd6 is still seen in agent 10.0.0.41 VM list
2025-04-09 16:20:07,806 - WARNING - Pod uuid 64a9b1c7-0509-45f1-843f-f38896383f32 is still seen in agent 10.0.0.41 VM list
2025-04-09 16:20:07,806 - WARNING - Pod uuid a116cfd1-6f1c-4c7a-873a-21855dfb3928 is still seen in agent 10.0.0.41 VM list
2025-04-09 16:20:12,825 - WARNING - Pod uuid ecd70b35-7d0f-41c8-9640-691883206cd6 is still seen in agent 10.0.0.41 VM list
2025-04-09 16:20:12,826 - WARNING - Pod uuid b676fbbd-48b0-4d44-a1a5-8c9ea02be0f9 is still seen in agent 10.0.0.41 VM list
2025-04-09 16:20:12,827 - WARNING - Pod uuid a116cfd1-6f1c-4c7a-873a-21855dfb3928 is still seen in agent 10.0.0.41 VM list
2025-04-09 16:20:12,828 - WARNING - Pod uuid 64a9b1c7-0509-45f1-843f-f38896383f32 is still seen in agent 10.0.0.41 VM list
2025-04-09 16:20:17,851 - DEBUG - Pod a116cfd1-6f1c-4c7a-873a-21855dfb3928 is not in agent 10.0.0.41 VM list
2025-04-09 16:20:17,853 - DEBUG - Pod 64a9b1c7-0509-45f1-843f-f38896383f32 is not in agent 10.0.0.41 VM list
2025-04-09 16:20:17,855 - DEBUG - Pod ecd70b35-7d0f-41c8-9640-691883206cd6 is not in agent 10.0.0.41 VM list
2025-04-09 16:20:17,861 - DEBUG - Pod b676fbbd-48b0-4d44-a1a5-8c9ea02be0f9 is not in agent 10.0.0.41 VM list
2025-04-09 16:20:17,878 - DEBUG - VMI fb332740-155d-11f0-a008-fa163e3fd57f is removed from agent 10.0.0.41
2025-04-09 16:20:17,878 - INFO - Verified that pod ctest-pod-67228472 is removed in agent
2025-04-09 16:20:17,879 - DEBUG - VMI fa37483a-155d-11f0-a008-fa163e3fd57f is removed from agent 10.0.0.41
2025-04-09 16:20:17,879 - INFO - Verified that pod ctest-pod-39866323 is removed in agent
2025-04-09 16:20:17,880 - DEBUG - VMI fab973c8-155d-11f0-a008-fa163e3fd57f is removed from agent 10.0.0.41
2025-04-09 16:20:17,880 - INFO - Verified that pod ctest-pod-66779814 is removed in agent
2025-04-09 16:20:17,881 - DEBUG - VMI f9b6491a-155d-11f0-a008-fa163e3fd57f is removed from agent 10.0.0.41
2025-04-09 16:20:17,881 - INFO - Verified that pod ctest-pod-50011583 is removed in agent
2025-04-09 16:20:17,882 - INFO - Deleting namespace ctest-non-default-54316039
2025-04-09 16:20:17,919 - DEBUG - Namespace ctest-non-default-54316039 still in k8s
2025-04-09 16:20:19,924 - DEBUG - Namespace ctest-non-default-54316039 still in k8s
2025-04-09 16:20:21,930 - DEBUG - Namespace ctest-non-default-54316039 still in k8s
2025-04-09 16:20:23,935 - DEBUG - Namespace ctest-non-default-54316039 is not in k8s
2025-04-09 16:20:23,935 - DEBUG - No need to check project deletion in contrail-api
2025-04-09 16:20:23,935 - INFO - Deleting namespace ctest-new-default-68715996
2025-04-09 16:20:23,945 - DEBUG - Namespace ctest-new-default-68715996 still in k8s
2025-04-09 16:20:25,949 - DEBUG - Namespace ctest-new-default-68715996 still in k8s
2025-04-09 16:20:27,955 - DEBUG - Namespace ctest-new-default-68715996 still in k8s
2025-04-09 16:20:29,963 - DEBUG - Namespace ctest-new-default-68715996 is not in k8s
2025-04-09 16:20:29,963 - DEBUG - No need to check project deletion in contrail-api