2025-07-19 07:39:50,995 - INFO - Using existing project ['default-domain', 'k8s-default'](9659eda2-e404-4c75-9f60-e725fcd5a860)
2025-07-19 07:39:51,014 - DEBUG - Namespace ctest-new-default-28501305 not present
2025-07-19 07:39:51,026 - INFO - Created namespace ctest-new-default-28501305
2025-07-19 07:39:54,033 - DEBUG - Namespace ctest-non-default-34690400 not present
2025-07-19 07:39:54,046 - INFO - Created namespace ctest-non-default-34690400
2025-07-19 07:39:57,082 - DEBUG - Pod ctest-pod-25431980 not present
2025-07-19 07:39:57,083 - INFO - Creating Pod ctest-pod-25431980
2025-07-19 07:39:57,112 - DEBUG - Pod : ctest-pod-25431980 UUID is 8513f6e8-d01b-44de-adbd-9008fa3fe8c9
2025-07-19 07:39:57,118 - DEBUG - Pod ctest-pod-80972834 not present
2025-07-19 07:39:57,118 - INFO - Creating Pod ctest-pod-80972834
2025-07-19 07:39:57,149 - DEBUG - Pod : ctest-pod-80972834 UUID is f4586e6a-9aed-40d5-9f31-239cb09cea72
2025-07-19 07:39:57,152 - DEBUG - Pod ctest-pod-51293780 not present
2025-07-19 07:39:57,152 - INFO - Creating Pod ctest-pod-51293780
2025-07-19 07:39:57,173 - DEBUG - Pod : ctest-pod-51293780 UUID is 578893aa-6905-4918-9d66-7f53e005b5f4
2025-07-19 07:39:57,182 - DEBUG - Pod ctest-pod-75469089 not present
2025-07-19 07:39:57,182 - INFO - Creating Pod ctest-pod-75469089
2025-07-19 07:39:57,212 - DEBUG - Pod : ctest-pod-75469089 UUID is a05a2fc1-4053-4421-bb94-da08a64e5b1b
2025-07-19 07:39:57,216 - DEBUG - Pod ctest-pod-83744124 not present
2025-07-19 07:39:57,216 - INFO - Creating Pod ctest-pod-83744124
2025-07-19 07:39:57,241 - DEBUG - Pod : ctest-pod-83744124 UUID is 221d399f-bc6b-4c4d-8737-54509cd70ddf
2025-07-19 07:39:57,243 - DEBUG - Pod ctest-pod-84366007 not present
2025-07-19 07:39:57,244 - INFO - Creating Pod ctest-pod-84366007
2025-07-19 07:39:57,269 - DEBUG - Pod : ctest-pod-84366007 UUID is 461c604e-a271-4e9a-830c-7a13acab55b1
2025-07-19 07:39:57,271 - DEBUG - Pod ctest-pod-30570763 not present
2025-07-19 07:39:57,272 - INFO - Creating Pod ctest-pod-30570763
2025-07-19 07:39:57,293 - DEBUG - Pod : ctest-pod-30570763 UUID is 8c64b82b-ace6-4b50-91af-46531814ea49
2025-07-19 07:39:57,295 - DEBUG - Pod ctest-pod-89222776 not present
2025-07-19 07:39:57,295 - INFO - Creating Pod ctest-pod-89222776
2025-07-19 07:39:57,336 - DEBUG - Pod : ctest-pod-89222776 UUID is 1c352ddf-df68-4ca4-891f-f2eae37055bc
2025-07-19 07:39:57,531 - INFO - Project default-domain:k8s-ctest-new-default-28501305 for Namespace ctest-new-default-28501305 is seen in contrail-api
2025-07-19 07:39:57,532 - DEBUG - Project uuid in Contrail is e6f65a44-ff72-4433-aa54-43fa3755376b
2025-07-19 07:39:57,752 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_NamespaceDatabaseList?namespace_uuid=91aa5796-577c-454c-9cb8-3e4ac21ea2f9
2025-07-19 07:39:57,757 - INFO - Namespace ctest-new-default-28501305 with uuid 91aa5796-577c-454c-9cb8-3e4ac21ea2f9 found in kube manager
2025-07-19 07:39:57,757 - INFO - Namespace ctest-new-default-28501305 verification passed
2025-07-19 07:39:57,977 - INFO - Project default-domain:k8s-ctest-non-default-34690400 for Namespace ctest-non-default-34690400 is seen in contrail-api
2025-07-19 07:39:57,977 - DEBUG - Project uuid in Contrail is a94565b2-764c-400f-b146-f5d424998077
2025-07-19 07:39:57,978 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_NamespaceDatabaseList?namespace_uuid=b23fc04f-f421-40fd-8aeb-9544f2f51390
2025-07-19 07:39:57,989 - INFO - Namespace ctest-non-default-34690400 with uuid b23fc04f-f421-40fd-8aeb-9544f2f51390 found in kube manager
2025-07-19 07:39:57,989 - INFO - Namespace ctest-non-default-34690400 verification passed
2025-07-19 07:39:57,994 - DEBUG - Pod ctest-pod-25431980 not in running state.Currently in Pending
2025-07-19 07:40:03,002 - DEBUG - Pod ctest-pod-25431980 not in running state.Currently in Pending
2025-07-19 07:40:08,009 - DEBUG - Pod ctest-pod-25431980 not in running state.Currently in Pending
2025-07-19 07:40:13,017 - INFO - Pod ctest-pod-25431980 is in running state.Got IP 10.47.255.251
2025-07-19 07:40:13,031 - DEBUG - Pod ctest-pod-25431980 has vmi 927b7594-6473-11f0-b55d-fa163ee2578d
2025-07-19 07:40:13,031 - INFO - Verified pod ctest-pod-25431980 in contrail-api
2025-07-19 07:40:13,048 - DEBUG - VMI 927b7594-6473-11f0-b55d-fa163ee2578d is active in agent 10.0.0.41
2025-07-19 07:40:13,048 - INFO - Verified Pod ctest-pod-25431980 in agent 10.0.0.41
2025-07-19 07:40:13,048 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_VirtualMachineDatabaseList?x=8513f6e8-d01b-44de-adbd-9008fa3fe8c9
2025-07-19 07:40:13,053 - INFO - Pod ctest-pod-25431980 with uuid 8513f6e8-d01b-44de-adbd-9008fa3fe8c9 found in kube manager
2025-07-19 07:40:13,053 - INFO - Pod ctest-pod-25431980 verification passed
2025-07-19 07:40:13,058 - INFO - Pod ctest-pod-80972834 is in running state.Got IP 10.47.255.250
2025-07-19 07:40:13,114 - DEBUG - Pod ctest-pod-80972834 has vmi 92fd2468-6473-11f0-b55d-fa163ee2578d
2025-07-19 07:40:13,114 - INFO - Verified pod ctest-pod-80972834 in contrail-api
2025-07-19 07:40:13,130 - DEBUG - VMI 92fd2468-6473-11f0-b55d-fa163ee2578d is active in agent 10.0.0.41
2025-07-19 07:40:13,130 - INFO - Verified Pod ctest-pod-80972834 in agent 10.0.0.41
2025-07-19 07:40:13,130 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_VirtualMachineDatabaseList?x=f4586e6a-9aed-40d5-9f31-239cb09cea72
2025-07-19 07:40:13,135 - INFO - Pod ctest-pod-80972834 with uuid f4586e6a-9aed-40d5-9f31-239cb09cea72 found in kube manager
2025-07-19 07:40:13,135 - INFO - Pod ctest-pod-80972834 verification passed
2025-07-19 07:40:13,140 - INFO - Pod ctest-pod-51293780 is in running state.Got IP 10.47.255.249
2025-07-19 07:40:13,202 - DEBUG - Pod ctest-pod-51293780 has vmi 93abb244-6473-11f0-b55d-fa163ee2578d
2025-07-19 07:40:13,202 - INFO - Verified pod ctest-pod-51293780 in contrail-api
2025-07-19 07:40:13,215 - DEBUG - VMI 93abb244-6473-11f0-b55d-fa163ee2578d is active in agent 10.0.0.41
2025-07-19 07:40:13,215 - INFO - Verified Pod ctest-pod-51293780 in agent 10.0.0.41
2025-07-19 07:40:13,215 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_VirtualMachineDatabaseList?x=578893aa-6905-4918-9d66-7f53e005b5f4
2025-07-19 07:40:13,220 - INFO - Pod ctest-pod-51293780 with uuid 578893aa-6905-4918-9d66-7f53e005b5f4 found in kube manager
2025-07-19 07:40:13,220 - INFO - Pod ctest-pod-51293780 verification passed
2025-07-19 07:40:13,226 - INFO - Pod ctest-pod-75469089 is in running state.Got IP 10.47.255.248
2025-07-19 07:40:13,240 - DEBUG - Pod ctest-pod-75469089 has vmi 942a6e5e-6473-11f0-b55d-fa163ee2578d
2025-07-19 07:40:13,240 - INFO - Verified pod ctest-pod-75469089 in contrail-api
2025-07-19 07:40:13,253 - DEBUG - VMI 942a6e5e-6473-11f0-b55d-fa163ee2578d is active in agent 10.0.0.41
2025-07-19 07:40:13,254 - INFO - Verified Pod ctest-pod-75469089 in agent 10.0.0.41
2025-07-19 07:40:13,254 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_VirtualMachineDatabaseList?x=a05a2fc1-4053-4421-bb94-da08a64e5b1b
2025-07-19 07:40:13,258 - INFO - Pod ctest-pod-75469089 with uuid a05a2fc1-4053-4421-bb94-da08a64e5b1b found in kube manager
2025-07-19 07:40:13,258 - INFO - Pod ctest-pod-75469089 verification passed
2025-07-19 07:40:13,264 - INFO - Pod ctest-pod-83744124 is in running state.Got IP 10.47.255.247
2025-07-19 07:40:13,323 - DEBUG - Pod ctest-pod-83744124 has vmi 94bd38a6-6473-11f0-b55d-fa163ee2578d
2025-07-19 07:40:13,324 - INFO - Verified pod ctest-pod-83744124 in contrail-api
2025-07-19 07:40:13,340 - DEBUG - VMI 94bd38a6-6473-11f0-b55d-fa163ee2578d is active in agent 10.0.0.41
2025-07-19 07:40:13,340 - INFO - Verified Pod ctest-pod-83744124 in agent 10.0.0.41
2025-07-19 07:40:13,340 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_VirtualMachineDatabaseList?x=221d399f-bc6b-4c4d-8737-54509cd70ddf
2025-07-19 07:40:13,345 - INFO - Pod ctest-pod-83744124 with uuid 221d399f-bc6b-4c4d-8737-54509cd70ddf found in kube manager
2025-07-19 07:40:13,345 - INFO - Pod ctest-pod-83744124 verification passed
2025-07-19 07:40:13,352 - INFO - Pod ctest-pod-30570763 is in running state.Got IP 10.47.255.245
2025-07-19 07:40:13,406 - DEBUG - Pod ctest-pod-30570763 has vmi 95b92f44-6473-11f0-b55d-fa163ee2578d
2025-07-19 07:40:13,406 - INFO - Verified pod ctest-pod-30570763 in contrail-api
2025-07-19 07:40:13,421 - DEBUG - VMI 95b92f44-6473-11f0-b55d-fa163ee2578d is active in agent 10.0.0.41
2025-07-19 07:40:13,421 - INFO - Verified Pod ctest-pod-30570763 in agent 10.0.0.41
2025-07-19 07:40:13,422 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_VirtualMachineDatabaseList?x=8c64b82b-ace6-4b50-91af-46531814ea49
2025-07-19 07:40:13,427 - INFO - Pod ctest-pod-30570763 with uuid 8c64b82b-ace6-4b50-91af-46531814ea49 found in kube manager
2025-07-19 07:40:13,427 - INFO - Pod ctest-pod-30570763 verification passed
2025-07-19 07:40:13,432 - DEBUG - Pod ctest-pod-84366007 not in running state.Currently in Pending
2025-07-19 07:40:18,438 - INFO - Pod ctest-pod-84366007 is in running state.Got IP 10.47.255.246
2025-07-19 07:40:18,451 - DEBUG - Pod ctest-pod-84366007 has vmi 954028c4-6473-11f0-b55d-fa163ee2578d
2025-07-19 07:40:18,452 - INFO - Verified pod ctest-pod-84366007 in contrail-api
2025-07-19 07:40:18,465 - DEBUG - VMI 954028c4-6473-11f0-b55d-fa163ee2578d is active in agent 10.0.0.41
2025-07-19 07:40:18,465 - INFO - Verified Pod ctest-pod-84366007 in agent 10.0.0.41
2025-07-19 07:40:18,465 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_VirtualMachineDatabaseList?x=461c604e-a271-4e9a-830c-7a13acab55b1
2025-07-19 07:40:18,470 - INFO - Pod ctest-pod-84366007 with uuid 461c604e-a271-4e9a-830c-7a13acab55b1 found in kube manager
2025-07-19 07:40:18,471 - INFO - Pod ctest-pod-84366007 verification passed
2025-07-19 07:40:18,476 - INFO - Pod ctest-pod-89222776 is in running state.Got IP 10.47.255.244
2025-07-19 07:40:18,538 - DEBUG - Pod ctest-pod-89222776 has vmi 96305114-6473-11f0-b55d-fa163ee2578d
2025-07-19 07:40:18,538 - INFO - Verified pod ctest-pod-89222776 in contrail-api
2025-07-19 07:40:18,554 - DEBUG - VMI 96305114-6473-11f0-b55d-fa163ee2578d is active in agent 10.0.0.41
2025-07-19 07:40:18,554 - INFO - Verified Pod ctest-pod-89222776 in agent 10.0.0.41
2025-07-19 07:40:18,554 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_VirtualMachineDatabaseList?x=1c352ddf-df68-4ca4-891f-f2eae37055bc
2025-07-19 07:40:18,559 - INFO - Pod ctest-pod-89222776 with uuid 1c352ddf-df68-4ca4-891f-f2eae37055bc found in kube manager
2025-07-19 07:40:18,559 - INFO - Pod ctest-pod-89222776 verification passed
2025-07-19 07:40:18,560 - INFO - ================================================================================
2025-07-19 07:40:18,560 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-07-19 07:40:18,560 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-07-19 07:40:18,751 - DEBUG - Nothing to compare xmpp stats {'10.0.0.41': {'10.0.0.129': '0'}} with
2025-07-19 07:40:18,751 - INFO - Initial checks done. Running the testcase now
2025-07-19 07:40:18,751 - INFO -
2025-07-19 07:40:18,807 - DEBUG - [Pod ctest-pod-25431980] Cmd: echo ctest-pod-25431980 > /usr/share/nginx/html/index.html, Output:
2025-07-19 07:40:18,861 - DEBUG - [Pod ctest-pod-80972834] Cmd: echo ctest-pod-80972834 > /usr/share/nginx/html/index.html, Output:
2025-07-19 07:40:18,916 - DEBUG - [Pod ctest-pod-51293780] Cmd: echo ctest-pod-51293780 > /usr/share/nginx/html/index.html, Output:
2025-07-19 07:40:18,968 - DEBUG - [Pod ctest-pod-75469089] Cmd: echo ctest-pod-75469089 > /usr/share/nginx/html/index.html, Output:
2025-07-19 07:40:18,971 - DEBUG - Service ctest-nginx-svc-54137636 not present
2025-07-19 07:40:18,971 - INFO - Creating service ctest-nginx-svc-54137636
2025-07-19 07:40:18,983 - INFO - Created Service ctest-nginx-svc-54137636
2025-07-19 07:40:18,991 - WARNING - Service UUID 54bb2fd5-93d7-423b-869e-284b3425ae77 not yet found in contrail-api
2025-07-19 07:40:20,005 - INFO - Validated that Service ctest-nginx-svc-54137636 is seen in contrail-api
2025-07-19 07:40:20,006 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_LoadbalancerDatabaseList?x=54bb2fd5-93d7-423b-869e-284b3425ae77
2025-07-19 07:40:20,011 - INFO - Service ctest-nginx-svc-54137636 with uuid 54bb2fd5-93d7-423b-869e-284b3425ae77 found in kube manager
2025-07-19 07:40:20,011 - INFO - Service ctest-nginx-svc-54137636 verification passed
2025-07-19 07:40:21,071 - DEBUG - [Pod ctest-pod-83744124] Cmd: wget http://10.102.69.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-25431980
2025-07-19 07:40:21,072 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd wget http://10.102.69.164:80/ -O - -T 5 -t 1 passed
2025-07-19 07:40:21,072 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-25431980
2025-07-19 07:40:21,133 - DEBUG - [Pod ctest-pod-83744124] Cmd: wget http://10.102.69.164:80/ -O - -T 5 -t 1 , Output: ctest-pod-25431980
Connecting to 10.102.69.164:80 (10.102.69.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-19 07:40:21,133 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd wget http://10.102.69.164:80/ -O - -T 5 -t 1 passed
2025-07-19 07:40:21,133 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd output: ctest-pod-25431980
Connecting to 10.102.69.164:80 (10.102.69.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-19 07:40:21,193 - DEBUG - [Pod ctest-pod-83744124] Cmd: wget http://10.102.69.164:80/ -O - -T 5 -t 1 , Output: ctest-pod-80972834
Connecting to 10.102.69.164:80 (10.102.69.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-19 07:40:21,193 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd wget http://10.102.69.164:80/ -O - -T 5 -t 1 passed
2025-07-19 07:40:21,193 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd output: ctest-pod-80972834
Connecting to 10.102.69.164:80 (10.102.69.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-19 07:40:21,193 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-25431980': 2, 'ctest-pod-80972834': 1}
2025-07-19 07:40:21,253 - DEBUG - [Pod ctest-pod-30570763] Cmd: wget http://10.102.69.164:80/ -O - -T 5 -t 1 , Output: ctest-pod-80972834
Connecting to 10.102.69.164:80 (10.102.69.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-19 07:40:21,253 - DEBUG - [Pod Pod ctest-pod-30570763] Cmd wget http://10.102.69.164:80/ -O - -T 5 -t 1 passed
2025-07-19 07:40:21,253 - DEBUG - [Pod Pod ctest-pod-30570763] Cmd output: ctest-pod-80972834
Connecting to 10.102.69.164:80 (10.102.69.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-19 07:40:21,318 - DEBUG - [Pod ctest-pod-30570763] Cmd: wget http://10.102.69.164:80/ -O - -T 5 -t 1 , Output: ctest-pod-25431980
Connecting to 10.102.69.164:80 (10.102.69.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-19 07:40:21,319 - DEBUG - [Pod Pod ctest-pod-30570763] Cmd wget http://10.102.69.164:80/ -O - -T 5 -t 1 passed
2025-07-19 07:40:21,319 - DEBUG - [Pod Pod ctest-pod-30570763] Cmd output: ctest-pod-25431980
Connecting to 10.102.69.164:80 (10.102.69.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-19 07:40:21,319 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-25431980': 1, 'ctest-pod-80972834': 1}
2025-07-19 07:40:21,323 - DEBUG - Network policy ingress-on-service not present
2025-07-19 07:40:21,419 - INFO - Creating Network Policy ingress-on-service
2025-07-19 07:40:21,438 - INFO - Network policy found in k8s
2025-07-19 07:40:21,439 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=538648ed-d2db-4910-a6c9-351066993087
2025-07-19 07:40:21,446 - INFO - Network Policy ingress-on-service with uuid 538648ed-d2db-4910-a6c9-351066993087 found in kube manager
2025-07-19 07:40:21,492 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-07-19 07:40:21,492 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-07-19 07:40:21,493 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=538648ed-d2db-4910-a6c9-351066993087
2025-07-19 07:40:21,526 - WARNING - Network policy with name ingress-on-service not found in agent
2025-07-19 07:40:23,527 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=538648ed-d2db-4910-a6c9-351066993087
2025-07-19 07:40:23,559 - INFO - Network policy with name ingress-on-service found in agent
2025-07-19 07:40:23,559 - INFO - Network Policy ingress-on-service verification passed
2025-07-19 07:40:28,612 - DEBUG - [Pod ctest-pod-83744124] Cmd: wget http://10.102.69.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:40:28,612 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd wget http://10.102.69.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:40:28,612 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:40:33,661 - DEBUG - [Pod ctest-pod-83744124] Cmd: wget http://10.102.69.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:40:33,661 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd wget http://10.102.69.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:40:33,661 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:40:38,715 - DEBUG - [Pod ctest-pod-83744124] Cmd: wget http://10.102.69.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:40:38,716 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd wget http://10.102.69.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:40:38,716 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:40:43,768 - DEBUG - [Pod ctest-pod-83744124] Cmd: wget http://10.102.69.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:40:43,768 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd wget http://10.102.69.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:40:43,768 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:40:48,816 - DEBUG - [Pod ctest-pod-83744124] Cmd: wget http://10.102.69.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:40:48,816 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd wget http://10.102.69.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:40:48,816 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:40:53,882 - DEBUG - [Pod ctest-pod-83744124] Cmd: wget http://10.102.69.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:40:53,882 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd wget http://10.102.69.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:40:53,882 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:40:58,937 - DEBUG - [Pod ctest-pod-83744124] Cmd: wget http://10.102.69.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:40:58,937 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd wget http://10.102.69.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:40:58,937 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:41:03,987 - DEBUG - [Pod ctest-pod-83744124] Cmd: wget http://10.102.69.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:41:03,987 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd wget http://10.102.69.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:41:03,988 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:41:09,041 - DEBUG - [Pod ctest-pod-83744124] Cmd: wget http://10.102.69.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:41:09,041 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd wget http://10.102.69.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:41:09,041 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:41:14,093 - DEBUG - [Pod ctest-pod-83744124] Cmd: wget http://10.102.69.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:41:14,093 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd wget http://10.102.69.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:41:14,093 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:41:14,093 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-25431980': 0, 'ctest-pod-80972834': 0}
2025-07-19 07:41:14,164 - DEBUG - [Pod ctest-pod-84366007] Cmd: wget http://10.102.69.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-80972834
2025-07-19 07:41:14,164 - DEBUG - [Pod Pod ctest-pod-84366007] Cmd wget http://10.102.69.164:80/ -O - -T 5 -t 1 passed
2025-07-19 07:41:14,164 - DEBUG - [Pod Pod ctest-pod-84366007] Cmd output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-80972834
2025-07-19 07:41:14,223 - DEBUG - [Pod ctest-pod-84366007] Cmd: wget http://10.102.69.164:80/ -O - -T 5 -t 1 , Output: ctest-pod-80972834
Connecting to 10.102.69.164:80 (10.102.69.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-19 07:41:14,223 - DEBUG - [Pod Pod ctest-pod-84366007] Cmd wget http://10.102.69.164:80/ -O - -T 5 -t 1 passed
2025-07-19 07:41:14,223 - DEBUG - [Pod Pod ctest-pod-84366007] Cmd output: ctest-pod-80972834
Connecting to 10.102.69.164:80 (10.102.69.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-19 07:41:14,278 - DEBUG - [Pod ctest-pod-84366007] Cmd: wget http://10.102.69.164:80/ -O - -T 5 -t 1 , Output: ctest-pod-25431980
Connecting to 10.102.69.164:80 (10.102.69.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-19 07:41:14,279 - DEBUG - [Pod Pod ctest-pod-84366007] Cmd wget http://10.102.69.164:80/ -O - -T 5 -t 1 passed
2025-07-19 07:41:14,279 - DEBUG - [Pod Pod ctest-pod-84366007] Cmd output: ctest-pod-25431980
Connecting to 10.102.69.164:80 (10.102.69.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-19 07:41:14,279 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-25431980': 1, 'ctest-pod-80972834': 2}
2025-07-19 07:41:19,342 - DEBUG - [Pod ctest-pod-30570763] Cmd: wget http://10.102.69.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:41:19,342 - DEBUG - [Pod Pod ctest-pod-30570763] Cmd wget http://10.102.69.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:41:19,342 - DEBUG - [Pod Pod ctest-pod-30570763] Cmd output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:41:24,390 - DEBUG - [Pod ctest-pod-30570763] Cmd: wget http://10.102.69.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:41:24,390 - DEBUG - [Pod Pod ctest-pod-30570763] Cmd wget http://10.102.69.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:41:24,390 - DEBUG - [Pod Pod ctest-pod-30570763] Cmd output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:41:29,443 - DEBUG - [Pod ctest-pod-30570763] Cmd: wget http://10.102.69.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:41:29,443 - DEBUG - [Pod Pod ctest-pod-30570763] Cmd wget http://10.102.69.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:41:29,443 - DEBUG - [Pod Pod ctest-pod-30570763] Cmd output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:41:34,496 - DEBUG - [Pod ctest-pod-30570763] Cmd: wget http://10.102.69.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:41:34,497 - DEBUG - [Pod Pod ctest-pod-30570763] Cmd wget http://10.102.69.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:41:34,497 - DEBUG - [Pod Pod ctest-pod-30570763] Cmd output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:41:39,547 - DEBUG - [Pod ctest-pod-30570763] Cmd: wget http://10.102.69.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:41:39,548 - DEBUG - [Pod Pod ctest-pod-30570763] Cmd wget http://10.102.69.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:41:39,548 - DEBUG - [Pod Pod ctest-pod-30570763] Cmd output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:41:44,599 - DEBUG - [Pod ctest-pod-30570763] Cmd: wget http://10.102.69.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:41:44,600 - DEBUG - [Pod Pod ctest-pod-30570763] Cmd wget http://10.102.69.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:41:44,600 - DEBUG - [Pod Pod ctest-pod-30570763] Cmd output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:41:49,649 - DEBUG - [Pod ctest-pod-30570763] Cmd: wget http://10.102.69.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:41:49,649 - DEBUG - [Pod Pod ctest-pod-30570763] Cmd wget http://10.102.69.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:41:49,649 - DEBUG - [Pod Pod ctest-pod-30570763] Cmd output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:41:53,845 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2025-07-19 07:42:03,932 - DEBUG - [Pod ctest-pod-30570763] Cmd: wget http://10.102.69.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:42:03,932 - DEBUG - [Pod Pod ctest-pod-30570763] Cmd wget http://10.102.69.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:42:03,932 - DEBUG - [Pod Pod ctest-pod-30570763] Cmd output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:42:08,980 - DEBUG - [Pod ctest-pod-30570763] Cmd: wget http://10.102.69.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:42:08,981 - DEBUG - [Pod Pod ctest-pod-30570763] Cmd wget http://10.102.69.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:42:08,981 - DEBUG - [Pod Pod ctest-pod-30570763] Cmd output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:42:14,033 - DEBUG - [Pod ctest-pod-30570763] Cmd: wget http://10.102.69.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:42:14,033 - DEBUG - [Pod Pod ctest-pod-30570763] Cmd wget http://10.102.69.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:42:14,034 - DEBUG - [Pod Pod ctest-pod-30570763] Cmd output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:42:14,034 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-25431980': 0, 'ctest-pod-80972834': 0}
2025-07-19 07:42:16,088 - DEBUG - [Pod ctest-pod-84366007] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.382 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.070 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.103 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.070/0.518/1.382 ms
2025-07-19 07:42:16,089 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-84366007 with expectation True passed
2025-07-19 07:42:18,139 - DEBUG - [Pod ctest-pod-83744124] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.997 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.074 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.087 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.074/0.386/0.997 ms
2025-07-19 07:42:18,139 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-83744124 with expectation True passed
2025-07-19 07:42:20,191 - DEBUG - [Pod ctest-pod-30570763] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.112 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.090 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.091 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.090/0.431/1.112 ms
2025-07-19 07:42:20,191 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-30570763 with expectation True passed
2025-07-19 07:42:20,251 - DEBUG - [Pod ctest-pod-84366007] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-19 07:42:20,251 - DEBUG - [Pod Pod ctest-pod-84366007] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-07-19 07:42:20,251 - DEBUG - [Pod Pod ctest-pod-84366007] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-19 07:42:20,251 - INFO - wget check of of http://10.47.255.251 from ctest-pod-84366007 passed
2025-07-19 07:42:20,308 - DEBUG - [Pod ctest-pod-84366007] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-19 07:42:20,308 - DEBUG - [Pod Pod ctest-pod-84366007] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-07-19 07:42:20,308 - DEBUG - [Pod Pod ctest-pod-84366007] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-19 07:42:20,308 - INFO - wget check of of http://10.47.255.250 from ctest-pod-84366007 passed
2025-07-19 07:42:25,361 - DEBUG - [Pod ctest-pod-83744124] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-07-19 07:42:25,361 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-07-19 07:42:25,362 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-07-19 07:42:25,362 - INFO - wget check of of http://10.47.255.250 from ctest-pod-83744124 passed
2025-07-19 07:42:30,421 - DEBUG - [Pod ctest-pod-89222776] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-07-19 07:42:30,422 - DEBUG - [Pod Pod ctest-pod-89222776] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-07-19 07:42:30,422 - DEBUG - [Pod Pod ctest-pod-89222776] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-07-19 07:42:30,422 - INFO - wget check of of http://10.47.255.251 from ctest-pod-89222776 passed
2025-07-19 07:42:30,431 - INFO - Updating Network Policy ingress-on-service
2025-07-19 07:42:35,492 - DEBUG - [Pod ctest-pod-83744124] Cmd: wget http://10.102.69.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:42:35,493 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd wget http://10.102.69.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:42:35,493 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:42:40,545 - DEBUG - [Pod ctest-pod-83744124] Cmd: wget http://10.102.69.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:42:40,545 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd wget http://10.102.69.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:42:40,545 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:42:45,603 - DEBUG - [Pod ctest-pod-83744124] Cmd: wget http://10.102.69.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:42:45,603 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd wget http://10.102.69.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:42:45,603 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:42:50,656 - DEBUG - [Pod ctest-pod-83744124] Cmd: wget http://10.102.69.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:42:50,656 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd wget http://10.102.69.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:42:50,657 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:42:55,700 - DEBUG - [Pod ctest-pod-83744124] Cmd: wget http://10.102.69.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:42:55,700 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd wget http://10.102.69.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:42:55,700 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:43:00,752 - DEBUG - [Pod ctest-pod-83744124] Cmd: wget http://10.102.69.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:43:00,752 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd wget http://10.102.69.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:43:00,752 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:43:05,810 - DEBUG - [Pod ctest-pod-83744124] Cmd: wget http://10.102.69.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:43:05,810 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd wget http://10.102.69.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:43:05,810 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:43:10,860 - DEBUG - [Pod ctest-pod-83744124] Cmd: wget http://10.102.69.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:43:10,860 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd wget http://10.102.69.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:43:10,860 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:43:15,921 - DEBUG - [Pod ctest-pod-83744124] Cmd: wget http://10.102.69.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:43:15,921 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd wget http://10.102.69.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:43:15,921 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:43:21,004 - DEBUG - [Pod ctest-pod-83744124] Cmd: wget http://10.102.69.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:43:21,004 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd wget http://10.102.69.164:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:43:21,004 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
wget: download timed out
2025-07-19 07:43:21,004 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-25431980': 0, 'ctest-pod-80972834': 0}
2025-07-19 07:43:21,059 - DEBUG - [Pod ctest-pod-84366007] Cmd: wget http://10.102.69.164:80/ -O - -T 5 -t 1 , Output: ctest-pod-25431980
Connecting to 10.102.69.164:80 (10.102.69.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-19 07:43:21,059 - DEBUG - [Pod Pod ctest-pod-84366007] Cmd wget http://10.102.69.164:80/ -O - -T 5 -t 1 passed
2025-07-19 07:43:21,059 - DEBUG - [Pod Pod ctest-pod-84366007] Cmd output: ctest-pod-25431980
Connecting to 10.102.69.164:80 (10.102.69.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-19 07:43:21,114 - DEBUG - [Pod ctest-pod-84366007] Cmd: wget http://10.102.69.164:80/ -O - -T 5 -t 1 , Output: ctest-pod-80972834
Connecting to 10.102.69.164:80 (10.102.69.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-19 07:43:21,114 - DEBUG - [Pod Pod ctest-pod-84366007] Cmd wget http://10.102.69.164:80/ -O - -T 5 -t 1 passed
2025-07-19 07:43:21,114 - DEBUG - [Pod Pod ctest-pod-84366007] Cmd output: ctest-pod-80972834
Connecting to 10.102.69.164:80 (10.102.69.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-19 07:43:21,115 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-25431980': 1, 'ctest-pod-80972834': 1}
2025-07-19 07:43:21,178 - DEBUG - [Pod ctest-pod-30570763] Cmd: wget http://10.102.69.164:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-80972834
2025-07-19 07:43:21,178 - DEBUG - [Pod Pod ctest-pod-30570763] Cmd wget http://10.102.69.164:80/ -O - -T 5 -t 1 passed
2025-07-19 07:43:21,178 - DEBUG - [Pod Pod ctest-pod-30570763] Cmd output: Connecting to 10.102.69.164:80 (10.102.69.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-80972834
2025-07-19 07:43:21,244 - DEBUG - [Pod ctest-pod-30570763] Cmd: wget http://10.102.69.164:80/ -O - -T 5 -t 1 , Output: ctest-pod-25431980
Connecting to 10.102.69.164:80 (10.102.69.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-19 07:43:21,244 - DEBUG - [Pod Pod ctest-pod-30570763] Cmd wget http://10.102.69.164:80/ -O - -T 5 -t 1 passed
2025-07-19 07:43:21,244 - DEBUG - [Pod Pod ctest-pod-30570763] Cmd output: ctest-pod-25431980
Connecting to 10.102.69.164:80 (10.102.69.164:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-19 07:43:21,244 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-25431980': 1, 'ctest-pod-80972834': 1}
2025-07-19 07:43:23,297 - DEBUG - [Pod ctest-pod-84366007] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.530 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.079 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.089 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.079/0.232/0.530 ms
2025-07-19 07:43:23,297 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-84366007 with expectation True passed
2025-07-19 07:43:25,350 - DEBUG - [Pod ctest-pod-83744124] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.049 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.093 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.090 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.090/0.410/1.049 ms
2025-07-19 07:43:25,350 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-83744124 with expectation True passed
2025-07-19 07:43:27,400 - DEBUG - [Pod ctest-pod-30570763] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.732 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.087 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.088 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.087/0.302/0.732 ms
2025-07-19 07:43:27,400 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-30570763 with expectation True passed
2025-07-19 07:43:27,449 - DEBUG - [Pod ctest-pod-84366007] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-19 07:43:27,450 - DEBUG - [Pod Pod ctest-pod-84366007] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-07-19 07:43:27,450 - DEBUG - [Pod Pod ctest-pod-84366007] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-19 07:43:27,450 - INFO - wget check of of http://10.47.255.251 from ctest-pod-84366007 passed
2025-07-19 07:43:27,508 - DEBUG - [Pod ctest-pod-84366007] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-19 07:43:27,508 - DEBUG - [Pod Pod ctest-pod-84366007] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-07-19 07:43:27,508 - DEBUG - [Pod Pod ctest-pod-84366007] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-19 07:43:27,508 - INFO - wget check of of http://10.47.255.250 from ctest-pod-84366007 passed
2025-07-19 07:43:32,542 - DEBUG - [Pod ctest-pod-83744124] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-07-19 07:43:32,542 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-07-19 07:43:32,542 - DEBUG - [Pod Pod ctest-pod-83744124] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-07-19 07:43:32,542 - INFO - wget check of of http://10.47.255.250 from ctest-pod-83744124 passed
2025-07-19 07:43:32,598 - DEBUG - [Pod ctest-pod-89222776] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-19 07:43:32,598 - DEBUG - [Pod Pod ctest-pod-89222776] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-07-19 07:43:32,598 - DEBUG - [Pod Pod ctest-pod-89222776] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-19 07:43:32,598 - INFO - wget check of of http://10.47.255.251 from ctest-pod-89222776 passed
2025-07-19 07:43:32,598 - INFO - Deleting Network Policy : ingress-on-service
2025-07-19 07:43:32,599 - INFO - Deleting service : ctest-nginx-svc-54137636
2025-07-19 07:43:32,857 - DEBUG - No XMPP flaps were noticed during the test
2025-07-19 07:43:32,857 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:14]
2025-07-19 07:43:32,857 - INFO - --------------------------------------------------------------------------------
2025-07-19 07:43:32,862 - INFO - Deleting pod ctest-new-default-28501305:ctest-pod-25431980
2025-07-19 07:43:32,863 - INFO - Deleting pod ctest-new-default-28501305:ctest-pod-80972834
2025-07-19 07:43:32,863 - INFO - Deleting pod ctest-non-default-34690400:ctest-pod-51293780
2025-07-19 07:43:32,863 - INFO - Deleting pod ctest-non-default-34690400:ctest-pod-75469089
2025-07-19 07:43:32,864 - INFO - Deleting pod ctest-new-default-28501305:ctest-pod-83744124
2025-07-19 07:43:32,864 - INFO - Deleting pod ctest-new-default-28501305:ctest-pod-84366007
2025-07-19 07:43:32,864 - INFO - Deleting pod ctest-non-default-34690400:ctest-pod-30570763
2025-07-19 07:43:32,865 - INFO - Deleting pod ctest-non-default-34690400:ctest-pod-89222776
2025-07-19 07:43:33,034 - WARNING - Pod uuid 8513f6e8-d01b-44de-adbd-9008fa3fe8c9 is still seen in agent 10.0.0.41 VM list
2025-07-19 07:43:33,119 - WARNING - Pod uuid 578893aa-6905-4918-9d66-7f53e005b5f4 is still seen in agent 10.0.0.41 VM list
2025-07-19 07:43:33,121 - WARNING - Pod uuid f4586e6a-9aed-40d5-9f31-239cb09cea72 is still seen in agent 10.0.0.41 VM list
2025-07-19 07:43:33,122 - WARNING - Pod uuid 461c604e-a271-4e9a-830c-7a13acab55b1 is still seen in agent 10.0.0.41 VM list
2025-07-19 07:43:33,125 - WARNING - Pod uuid 8c64b82b-ace6-4b50-91af-46531814ea49 is still seen in agent 10.0.0.41 VM list
2025-07-19 07:43:33,126 - WARNING - Pod uuid 1c352ddf-df68-4ca4-891f-f2eae37055bc is still seen in agent 10.0.0.41 VM list
2025-07-19 07:43:33,126 - WARNING - Pod uuid 221d399f-bc6b-4c4d-8737-54509cd70ddf is still seen in agent 10.0.0.41 VM list
2025-07-19 07:43:33,127 - WARNING - Pod uuid a05a2fc1-4053-4421-bb94-da08a64e5b1b is still seen in agent 10.0.0.41 VM list
2025-07-19 07:43:38,042 - DEBUG - Pod 8513f6e8-d01b-44de-adbd-9008fa3fe8c9 is not in agent 10.0.0.41 VM list
2025-07-19 07:43:38,048 - DEBUG - VMI 927b7594-6473-11f0-b55d-fa163ee2578d is removed from agent 10.0.0.41
2025-07-19 07:43:38,048 - INFO - Verified that pod ctest-pod-25431980 is removed in agent
2025-07-19 07:43:38,157 - DEBUG - Pod 578893aa-6905-4918-9d66-7f53e005b5f4 is not in agent 10.0.0.41 VM list
2025-07-19 07:43:38,159 - DEBUG - Pod f4586e6a-9aed-40d5-9f31-239cb09cea72 is not in agent 10.0.0.41 VM list
2025-07-19 07:43:38,160 - WARNING - Pod uuid 221d399f-bc6b-4c4d-8737-54509cd70ddf is still seen in agent 10.0.0.41 VM list
2025-07-19 07:43:38,161 - DEBUG - Pod a05a2fc1-4053-4421-bb94-da08a64e5b1b is not in agent 10.0.0.41 VM list
2025-07-19 07:43:38,162 - WARNING - Pod uuid 461c604e-a271-4e9a-830c-7a13acab55b1 is still seen in agent 10.0.0.41 VM list
2025-07-19 07:43:38,165 - WARNING - Pod uuid 8c64b82b-ace6-4b50-91af-46531814ea49 is still seen in agent 10.0.0.41 VM list
2025-07-19 07:43:38,165 - WARNING - Pod uuid 1c352ddf-df68-4ca4-891f-f2eae37055bc is still seen in agent 10.0.0.41 VM list
2025-07-19 07:43:38,177 - DEBUG - VMI 942a6e5e-6473-11f0-b55d-fa163ee2578d is removed from agent 10.0.0.41
2025-07-19 07:43:38,177 - INFO - Verified that pod ctest-pod-75469089 is removed in agent
2025-07-19 07:43:38,178 - DEBUG - VMI 93abb244-6473-11f0-b55d-fa163ee2578d is removed from agent 10.0.0.41
2025-07-19 07:43:38,178 - INFO - Verified that pod ctest-pod-51293780 is removed in agent
2025-07-19 07:43:38,178 - DEBUG - VMI 92fd2468-6473-11f0-b55d-fa163ee2578d is removed from agent 10.0.0.41
2025-07-19 07:43:38,178 - INFO - Verified that pod ctest-pod-80972834 is removed in agent
2025-07-19 07:43:43,181 - WARNING - Pod uuid 461c604e-a271-4e9a-830c-7a13acab55b1 is still seen in agent 10.0.0.41 VM list
2025-07-19 07:43:43,181 - WARNING - Pod uuid 221d399f-bc6b-4c4d-8737-54509cd70ddf is still seen in agent 10.0.0.41 VM list
2025-07-19 07:43:43,182 - WARNING - Pod uuid 1c352ddf-df68-4ca4-891f-f2eae37055bc is still seen in agent 10.0.0.41 VM list
2025-07-19 07:43:43,183 - WARNING - Pod uuid 8c64b82b-ace6-4b50-91af-46531814ea49 is still seen in agent 10.0.0.41 VM list
2025-07-19 07:43:48,203 - WARNING - Pod uuid 8c64b82b-ace6-4b50-91af-46531814ea49 is still seen in agent 10.0.0.41 VM list
2025-07-19 07:43:48,203 - WARNING - Pod uuid 221d399f-bc6b-4c4d-8737-54509cd70ddf is still seen in agent 10.0.0.41 VM list
2025-07-19 07:43:48,204 - WARNING - Pod uuid 1c352ddf-df68-4ca4-891f-f2eae37055bc is still seen in agent 10.0.0.41 VM list
2025-07-19 07:43:48,205 - WARNING - Pod uuid 461c604e-a271-4e9a-830c-7a13acab55b1 is still seen in agent 10.0.0.41 VM list
2025-07-19 07:43:53,223 - WARNING - Pod uuid 461c604e-a271-4e9a-830c-7a13acab55b1 is still seen in agent 10.0.0.41 VM list
2025-07-19 07:43:53,223 - WARNING - Pod uuid 221d399f-bc6b-4c4d-8737-54509cd70ddf is still seen in agent 10.0.0.41 VM list
2025-07-19 07:43:53,223 - WARNING - Pod uuid 8c64b82b-ace6-4b50-91af-46531814ea49 is still seen in agent 10.0.0.41 VM list
2025-07-19 07:43:53,224 - WARNING - Pod uuid 1c352ddf-df68-4ca4-891f-f2eae37055bc is still seen in agent 10.0.0.41 VM list
2025-07-19 07:43:58,242 - WARNING - Pod uuid 221d399f-bc6b-4c4d-8737-54509cd70ddf is still seen in agent 10.0.0.41 VM list
2025-07-19 07:43:58,242 - WARNING - Pod uuid 461c604e-a271-4e9a-830c-7a13acab55b1 is still seen in agent 10.0.0.41 VM list
2025-07-19 07:43:58,244 - WARNING - Pod uuid 8c64b82b-ace6-4b50-91af-46531814ea49 is still seen in agent 10.0.0.41 VM list
2025-07-19 07:43:58,244 - WARNING - Pod uuid 1c352ddf-df68-4ca4-891f-f2eae37055bc is still seen in agent 10.0.0.41 VM list
2025-07-19 07:44:03,313 - WARNING - Pod uuid 1c352ddf-df68-4ca4-891f-f2eae37055bc is still seen in agent 10.0.0.41 VM list
2025-07-19 07:44:03,314 - WARNING - Pod uuid 8c64b82b-ace6-4b50-91af-46531814ea49 is still seen in agent 10.0.0.41 VM list
2025-07-19 07:44:03,315 - WARNING - Pod uuid 461c604e-a271-4e9a-830c-7a13acab55b1 is still seen in agent 10.0.0.41 VM list
2025-07-19 07:44:03,315 - WARNING - Pod uuid 221d399f-bc6b-4c4d-8737-54509cd70ddf is still seen in agent 10.0.0.41 VM list
2025-07-19 07:44:08,331 - DEBUG - Pod 8c64b82b-ace6-4b50-91af-46531814ea49 is not in agent 10.0.0.41 VM list
2025-07-19 07:44:08,334 - DEBUG - Pod 221d399f-bc6b-4c4d-8737-54509cd70ddf is not in agent 10.0.0.41 VM list
2025-07-19 07:44:08,336 - DEBUG - Pod 1c352ddf-df68-4ca4-891f-f2eae37055bc is not in agent 10.0.0.41 VM list
2025-07-19 07:44:08,337 - DEBUG - Pod 461c604e-a271-4e9a-830c-7a13acab55b1 is not in agent 10.0.0.41 VM list
2025-07-19 07:44:08,350 - DEBUG - VMI 954028c4-6473-11f0-b55d-fa163ee2578d is removed from agent 10.0.0.41
2025-07-19 07:44:08,350 - INFO - Verified that pod ctest-pod-84366007 is removed in agent
2025-07-19 07:44:08,351 - DEBUG - VMI 95b92f44-6473-11f0-b55d-fa163ee2578d is removed from agent 10.0.0.41
2025-07-19 07:44:08,351 - INFO - Verified that pod ctest-pod-30570763 is removed in agent
2025-07-19 07:44:08,352 - DEBUG - VMI 94bd38a6-6473-11f0-b55d-fa163ee2578d is removed from agent 10.0.0.41
2025-07-19 07:44:08,352 - INFO - Verified that pod ctest-pod-83744124 is removed in agent
2025-07-19 07:44:08,353 - DEBUG - VMI 96305114-6473-11f0-b55d-fa163ee2578d is removed from agent 10.0.0.41
2025-07-19 07:44:08,353 - INFO - Verified that pod ctest-pod-89222776 is removed in agent
2025-07-19 07:44:08,353 - INFO - Deleting namespace ctest-non-default-34690400
2025-07-19 07:44:08,382 - DEBUG - Namespace ctest-non-default-34690400 still in k8s
2025-07-19 07:44:10,387 - DEBUG - Namespace ctest-non-default-34690400 still in k8s
2025-07-19 07:44:12,392 - DEBUG - Namespace ctest-non-default-34690400 still in k8s
2025-07-19 07:44:14,396 - DEBUG - Namespace ctest-non-default-34690400 is not in k8s
2025-07-19 07:44:14,396 - DEBUG - No need to check project deletion in contrail-api
2025-07-19 07:44:14,396 - INFO - Deleting namespace ctest-new-default-28501305
2025-07-19 07:44:14,404 - DEBUG - Namespace ctest-new-default-28501305 still in k8s
2025-07-19 07:44:16,409 - DEBUG - Namespace ctest-new-default-28501305 still in k8s
2025-07-19 07:44:18,417 - DEBUG - Namespace ctest-new-default-28501305 still in k8s
2025-07-19 07:44:20,421 - DEBUG - Namespace ctest-new-default-28501305 is not in k8s
2025-07-19 07:44:20,421 - DEBUG - No need to check project deletion in contrail-api