2025-10-02 01:32:32,525 - INFO - Using existing project ['default-domain', 'k8s-default'](9fabaa61-35c9-43a9-8ba2-4341f78b4e52)
2025-10-02 01:32:32,543 - DEBUG - Namespace ctest-new-default-25494294 not present
2025-10-02 01:32:32,550 - INFO - Created namespace ctest-new-default-25494294
2025-10-02 01:32:35,553 - DEBUG - Namespace ctest-non-default-74049945 not present
2025-10-02 01:32:35,562 - INFO - Created namespace ctest-non-default-74049945
2025-10-02 01:32:38,580 - DEBUG - Pod ctest-pod-98207663 not present
2025-10-02 01:32:38,581 - INFO - Creating Pod ctest-pod-98207663
2025-10-02 01:32:38,620 - DEBUG - Pod : ctest-pod-98207663 UUID is 5f35a110-0133-4ef7-9106-620879eb2592
2025-10-02 01:32:38,622 - DEBUG - Pod ctest-pod-81575004 not present
2025-10-02 01:32:38,622 - INFO - Creating Pod ctest-pod-81575004
2025-10-02 01:32:38,662 - DEBUG - Pod : ctest-pod-81575004 UUID is ef0648cc-7ad3-4697-8668-2296472d6477
2025-10-02 01:32:38,665 - DEBUG - Pod ctest-pod-37720784 not present
2025-10-02 01:32:38,666 - INFO - Creating Pod ctest-pod-37720784
2025-10-02 01:32:38,693 - DEBUG - Pod : ctest-pod-37720784 UUID is 1ecc75bb-c769-41f7-98c4-0c9e0dd49e71
2025-10-02 01:32:38,696 - DEBUG - Pod ctest-pod-57987458 not present
2025-10-02 01:32:38,696 - INFO - Creating Pod ctest-pod-57987458
2025-10-02 01:32:38,719 - DEBUG - Pod : ctest-pod-57987458 UUID is 1f089edd-27a4-4f55-85ff-4cf1d57bf5b4
2025-10-02 01:32:38,721 - DEBUG - Pod ctest-pod-57337242 not present
2025-10-02 01:32:38,721 - INFO - Creating Pod ctest-pod-57337242
2025-10-02 01:32:38,744 - DEBUG - Pod : ctest-pod-57337242 UUID is d365fbad-1c89-46d0-b100-a30e3debade6
2025-10-02 01:32:38,746 - DEBUG - Pod ctest-pod-39373485 not present
2025-10-02 01:32:38,747 - INFO - Creating Pod ctest-pod-39373485
2025-10-02 01:32:38,782 - DEBUG - Pod : ctest-pod-39373485 UUID is 5110c752-937c-40e8-896a-7f6248fed202
2025-10-02 01:32:38,789 - DEBUG - Pod ctest-pod-30570156 not present
2025-10-02 01:32:38,790 - INFO - Creating Pod ctest-pod-30570156
2025-10-02 01:32:38,814 - DEBUG - Pod : ctest-pod-30570156 UUID is f6ef1359-eb1d-460d-8fc2-6f740b18f6b2
2025-10-02 01:32:38,816 - DEBUG - Pod ctest-pod-27014249 not present
2025-10-02 01:32:38,816 - INFO - Creating Pod ctest-pod-27014249
2025-10-02 01:32:38,831 - DEBUG - Pod : ctest-pod-27014249 UUID is 7dfd19f0-f993-4048-abaa-378e29991ba8
2025-10-02 01:32:39,030 - INFO - Project default-domain:k8s-ctest-new-default-25494294 for Namespace ctest-new-default-25494294 is seen in contrail-api
2025-10-02 01:32:39,031 - DEBUG - Project uuid in Contrail is 25063b54-c29f-4c42-954f-4f0b410f01e7
2025-10-02 01:32:39,196 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NamespaceDatabaseList?namespace_uuid=60549050-c45d-4427-b29a-b6d730aa5d6d
2025-10-02 01:32:39,201 - INFO - Namespace ctest-new-default-25494294 with uuid 60549050-c45d-4427-b29a-b6d730aa5d6d found in kube manager
2025-10-02 01:32:39,201 - INFO - Namespace ctest-new-default-25494294 verification passed
2025-10-02 01:32:39,383 - INFO - Project default-domain:k8s-ctest-non-default-74049945 for Namespace ctest-non-default-74049945 is seen in contrail-api
2025-10-02 01:32:39,384 - DEBUG - Project uuid in Contrail is d77d1d87-126e-49d8-ae60-e9bff8befabd
2025-10-02 01:32:39,384 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NamespaceDatabaseList?namespace_uuid=9b09eb17-3b04-4ca2-b6bd-734b979afe4d
2025-10-02 01:32:39,388 - INFO - Namespace ctest-non-default-74049945 with uuid 9b09eb17-3b04-4ca2-b6bd-734b979afe4d found in kube manager
2025-10-02 01:32:39,388 - INFO - Namespace ctest-non-default-74049945 verification passed
2025-10-02 01:32:39,393 - DEBUG - Pod ctest-pod-98207663 not in running state.Currently in Pending
2025-10-02 01:32:44,399 - DEBUG - Pod ctest-pod-98207663 not in running state.Currently in Pending
2025-10-02 01:32:49,406 - INFO - Pod ctest-pod-98207663 is in running state.Got IP 10.47.255.251
2025-10-02 01:32:49,416 - DEBUG - Pod ctest-pod-98207663 has vmi af4457bc-9f2f-11f0-8780-fa163ec7a04b
2025-10-02 01:32:49,417 - INFO - Verified pod ctest-pod-98207663 in contrail-api
2025-10-02 01:32:49,426 - DEBUG - VMI af4457bc-9f2f-11f0-8780-fa163ec7a04b is active in agent 10.0.0.22
2025-10-02 01:32:49,426 - INFO - Verified Pod ctest-pod-98207663 in agent 10.0.0.22
2025-10-02 01:32:49,426 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=5f35a110-0133-4ef7-9106-620879eb2592
2025-10-02 01:32:49,430 - INFO - Pod ctest-pod-98207663 with uuid 5f35a110-0133-4ef7-9106-620879eb2592 found in kube manager
2025-10-02 01:32:49,430 - INFO - Pod ctest-pod-98207663 verification passed
2025-10-02 01:32:49,436 - INFO - Pod ctest-pod-81575004 is in running state.Got IP 10.47.255.250
2025-10-02 01:32:49,488 - DEBUG - Pod ctest-pod-81575004 has vmi afacf9ca-9f2f-11f0-8780-fa163ec7a04b
2025-10-02 01:32:49,489 - INFO - Verified pod ctest-pod-81575004 in contrail-api
2025-10-02 01:32:49,497 - DEBUG - VMI afacf9ca-9f2f-11f0-8780-fa163ec7a04b is active in agent 10.0.0.22
2025-10-02 01:32:49,497 - INFO - Verified Pod ctest-pod-81575004 in agent 10.0.0.22
2025-10-02 01:32:49,497 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=ef0648cc-7ad3-4697-8668-2296472d6477
2025-10-02 01:32:49,500 - INFO - Pod ctest-pod-81575004 with uuid ef0648cc-7ad3-4697-8668-2296472d6477 found in kube manager
2025-10-02 01:32:49,500 - INFO - Pod ctest-pod-81575004 verification passed
2025-10-02 01:32:49,506 - DEBUG - Pod ctest-pod-37720784 not in running state.Currently in Pending
2025-10-02 01:32:54,513 - INFO - Pod ctest-pod-37720784 is in running state.Got IP 10.47.255.249
2025-10-02 01:32:54,527 - DEBUG - Pod ctest-pod-37720784 has vmi b04304ec-9f2f-11f0-8780-fa163ec7a04b
2025-10-02 01:32:54,527 - INFO - Verified pod ctest-pod-37720784 in contrail-api
2025-10-02 01:32:54,539 - DEBUG - VMI b04304ec-9f2f-11f0-8780-fa163ec7a04b is active in agent 10.0.0.22
2025-10-02 01:32:54,539 - INFO - Verified Pod ctest-pod-37720784 in agent 10.0.0.22
2025-10-02 01:32:54,539 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=1ecc75bb-c769-41f7-98c4-0c9e0dd49e71
2025-10-02 01:32:54,542 - INFO - Pod ctest-pod-37720784 with uuid 1ecc75bb-c769-41f7-98c4-0c9e0dd49e71 found in kube manager
2025-10-02 01:32:54,542 - INFO - Pod ctest-pod-37720784 verification passed
2025-10-02 01:32:54,548 - INFO - Pod ctest-pod-57987458 is in running state.Got IP 10.47.255.248
2025-10-02 01:32:54,600 - DEBUG - Pod ctest-pod-57987458 has vmi b0b27d5e-9f2f-11f0-8780-fa163ec7a04b
2025-10-02 01:32:54,601 - INFO - Verified pod ctest-pod-57987458 in contrail-api
2025-10-02 01:32:54,612 - DEBUG - VMI b0b27d5e-9f2f-11f0-8780-fa163ec7a04b is active in agent 10.0.0.22
2025-10-02 01:32:54,613 - INFO - Verified Pod ctest-pod-57987458 in agent 10.0.0.22
2025-10-02 01:32:54,613 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=1f089edd-27a4-4f55-85ff-4cf1d57bf5b4
2025-10-02 01:32:54,616 - INFO - Pod ctest-pod-57987458 with uuid 1f089edd-27a4-4f55-85ff-4cf1d57bf5b4 found in kube manager
2025-10-02 01:32:54,616 - INFO - Pod ctest-pod-57987458 verification passed
2025-10-02 01:32:54,622 - INFO - Pod ctest-pod-57337242 is in running state.Got IP 10.47.255.247
2025-10-02 01:32:54,678 - DEBUG - Pod ctest-pod-57337242 has vmi b12e343a-9f2f-11f0-8780-fa163ec7a04b
2025-10-02 01:32:54,678 - INFO - Verified pod ctest-pod-57337242 in contrail-api
2025-10-02 01:32:54,687 - DEBUG - VMI b12e343a-9f2f-11f0-8780-fa163ec7a04b is active in agent 10.0.0.22
2025-10-02 01:32:54,687 - INFO - Verified Pod ctest-pod-57337242 in agent 10.0.0.22
2025-10-02 01:32:54,687 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=d365fbad-1c89-46d0-b100-a30e3debade6
2025-10-02 01:32:54,691 - INFO - Pod ctest-pod-57337242 with uuid d365fbad-1c89-46d0-b100-a30e3debade6 found in kube manager
2025-10-02 01:32:54,691 - INFO - Pod ctest-pod-57337242 verification passed
2025-10-02 01:32:54,696 - DEBUG - Pod ctest-pod-30570156 not in running state.Currently in Pending
2025-10-02 01:32:59,702 - INFO - Pod ctest-pod-30570156 is in running state.Got IP 10.47.255.245
2025-10-02 01:32:59,712 - DEBUG - Pod ctest-pod-30570156 has vmi b1f5411a-9f2f-11f0-8780-fa163ec7a04b
2025-10-02 01:32:59,712 - INFO - Verified pod ctest-pod-30570156 in contrail-api
2025-10-02 01:32:59,722 - DEBUG - VMI b1f5411a-9f2f-11f0-8780-fa163ec7a04b is active in agent 10.0.0.22
2025-10-02 01:32:59,722 - INFO - Verified Pod ctest-pod-30570156 in agent 10.0.0.22
2025-10-02 01:32:59,722 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=f6ef1359-eb1d-460d-8fc2-6f740b18f6b2
2025-10-02 01:32:59,725 - INFO - Pod ctest-pod-30570156 with uuid f6ef1359-eb1d-460d-8fc2-6f740b18f6b2 found in kube manager
2025-10-02 01:32:59,726 - INFO - Pod ctest-pod-30570156 verification passed
2025-10-02 01:32:59,731 - INFO - Pod ctest-pod-39373485 is in running state.Got IP 10.47.255.246
2025-10-02 01:32:59,782 - DEBUG - Pod ctest-pod-39373485 has vmi b19321a6-9f2f-11f0-8780-fa163ec7a04b
2025-10-02 01:32:59,782 - INFO - Verified pod ctest-pod-39373485 in contrail-api
2025-10-02 01:32:59,791 - DEBUG - VMI b19321a6-9f2f-11f0-8780-fa163ec7a04b is active in agent 10.0.0.22
2025-10-02 01:32:59,791 - INFO - Verified Pod ctest-pod-39373485 in agent 10.0.0.22
2025-10-02 01:32:59,791 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=5110c752-937c-40e8-896a-7f6248fed202
2025-10-02 01:32:59,794 - INFO - Pod ctest-pod-39373485 with uuid 5110c752-937c-40e8-896a-7f6248fed202 found in kube manager
2025-10-02 01:32:59,794 - INFO - Pod ctest-pod-39373485 verification passed
2025-10-02 01:32:59,799 - INFO - Pod ctest-pod-27014249 is in running state.Got IP 10.47.255.244
2025-10-02 01:32:59,809 - DEBUG - Pod ctest-pod-27014249 has vmi b25b5072-9f2f-11f0-8780-fa163ec7a04b
2025-10-02 01:32:59,809 - INFO - Verified pod ctest-pod-27014249 in contrail-api
2025-10-02 01:32:59,818 - DEBUG - VMI b25b5072-9f2f-11f0-8780-fa163ec7a04b is active in agent 10.0.0.22
2025-10-02 01:32:59,818 - INFO - Verified Pod ctest-pod-27014249 in agent 10.0.0.22
2025-10-02 01:32:59,818 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=7dfd19f0-f993-4048-abaa-378e29991ba8
2025-10-02 01:32:59,821 - INFO - Pod ctest-pod-27014249 with uuid 7dfd19f0-f993-4048-abaa-378e29991ba8 found in kube manager
2025-10-02 01:32:59,821 - INFO - Pod ctest-pod-27014249 verification passed
2025-10-02 01:32:59,821 - INFO - ================================================================================
2025-10-02 01:32:59,821 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-10-02 01:32:59,821 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-10-02 01:33:00,052 - DEBUG - Nothing to compare xmpp stats {'10.0.0.22': {'10.0.0.50': '0'}} with
2025-10-02 01:33:00,052 - INFO - Initial checks done. Running the testcase now
2025-10-02 01:33:00,052 - INFO -
2025-10-02 01:33:00,123 - DEBUG - [Pod ctest-pod-98207663] Cmd: echo ctest-pod-98207663 > /usr/share/nginx/html/index.html, Output:
2025-10-02 01:33:00,177 - DEBUG - [Pod ctest-pod-81575004] Cmd: echo ctest-pod-81575004 > /usr/share/nginx/html/index.html, Output:
2025-10-02 01:33:00,233 - DEBUG - [Pod ctest-pod-37720784] Cmd: echo ctest-pod-37720784 > /usr/share/nginx/html/index.html, Output:
2025-10-02 01:33:00,284 - DEBUG - [Pod ctest-pod-57987458] Cmd: echo ctest-pod-57987458 > /usr/share/nginx/html/index.html, Output:
2025-10-02 01:33:00,287 - DEBUG - Service ctest-nginx-svc-76981987 not present
2025-10-02 01:33:00,287 - INFO - Creating service ctest-nginx-svc-76981987
2025-10-02 01:33:00,306 - INFO - Created Service ctest-nginx-svc-76981987
2025-10-02 01:33:00,313 - WARNING - Service UUID 86d896ae-b98c-42e8-8079-ecc47b8dfe37 not yet found in contrail-api
2025-10-02 01:33:01,327 - INFO - Validated that Service ctest-nginx-svc-76981987 is seen in contrail-api
2025-10-02 01:33:01,327 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_LoadbalancerDatabaseList?x=86d896ae-b98c-42e8-8079-ecc47b8dfe37
2025-10-02 01:33:01,337 - INFO - Service ctest-nginx-svc-76981987 with uuid 86d896ae-b98c-42e8-8079-ecc47b8dfe37 found in kube manager
2025-10-02 01:33:01,337 - INFO - Service ctest-nginx-svc-76981987 verification passed
2025-10-02 01:33:01,398 - DEBUG - [Pod ctest-pod-57337242] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: ctest-pod-98207663
Connecting to 10.97.227.148:80 (10.97.227.148:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-02 01:33:01,398 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 passed
2025-10-02 01:33:01,398 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd output: ctest-pod-98207663
Connecting to 10.97.227.148:80 (10.97.227.148:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-02 01:33:01,446 - DEBUG - [Pod ctest-pod-57337242] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: ctest-pod-98207663
Connecting to 10.97.227.148:80 (10.97.227.148:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-02 01:33:01,446 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 passed
2025-10-02 01:33:01,446 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd output: ctest-pod-98207663
Connecting to 10.97.227.148:80 (10.97.227.148:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-02 01:33:01,511 - DEBUG - [Pod ctest-pod-57337242] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: ctest-pod-98207663
Connecting to 10.97.227.148:80 (10.97.227.148:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-02 01:33:01,511 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 passed
2025-10-02 01:33:01,511 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd output: ctest-pod-98207663
Connecting to 10.97.227.148:80 (10.97.227.148:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-02 01:33:01,567 - DEBUG - [Pod ctest-pod-57337242] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: ctest-pod-98207663
Connecting to 10.97.227.148:80 (10.97.227.148:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-02 01:33:01,567 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 passed
2025-10-02 01:33:01,567 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd output: ctest-pod-98207663
Connecting to 10.97.227.148:80 (10.97.227.148:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-02 01:33:01,632 - DEBUG - [Pod ctest-pod-57337242] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-98207663
2025-10-02 01:33:01,632 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 passed
2025-10-02 01:33:01,632 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-98207663
2025-10-02 01:33:01,696 - DEBUG - [Pod ctest-pod-57337242] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-81575004
2025-10-02 01:33:01,696 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 passed
2025-10-02 01:33:01,696 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-81575004
2025-10-02 01:33:01,696 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-98207663': 5, 'ctest-pod-81575004': 1}
2025-10-02 01:33:01,771 - DEBUG - [Pod ctest-pod-30570156] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: ctest-pod-98207663
Connecting to 10.97.227.148:80 (10.97.227.148:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-02 01:33:01,771 - DEBUG - [Pod Pod ctest-pod-30570156] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 passed
2025-10-02 01:33:01,771 - DEBUG - [Pod Pod ctest-pod-30570156] Cmd output: ctest-pod-98207663
Connecting to 10.97.227.148:80 (10.97.227.148:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-02 01:33:01,826 - DEBUG - [Pod ctest-pod-30570156] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: ctest-pod-98207663
Connecting to 10.97.227.148:80 (10.97.227.148:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-02 01:33:01,826 - DEBUG - [Pod Pod ctest-pod-30570156] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 passed
2025-10-02 01:33:01,826 - DEBUG - [Pod Pod ctest-pod-30570156] Cmd output: ctest-pod-98207663
Connecting to 10.97.227.148:80 (10.97.227.148:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-02 01:33:01,882 - DEBUG - [Pod ctest-pod-30570156] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: ctest-pod-98207663
Connecting to 10.97.227.148:80 (10.97.227.148:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-02 01:33:01,882 - DEBUG - [Pod Pod ctest-pod-30570156] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 passed
2025-10-02 01:33:01,882 - DEBUG - [Pod Pod ctest-pod-30570156] Cmd output: ctest-pod-98207663
Connecting to 10.97.227.148:80 (10.97.227.148:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-02 01:33:01,936 - DEBUG - [Pod ctest-pod-30570156] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: ctest-pod-98207663
Connecting to 10.97.227.148:80 (10.97.227.148:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-02 01:33:01,936 - DEBUG - [Pod Pod ctest-pod-30570156] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 passed
2025-10-02 01:33:01,936 - DEBUG - [Pod Pod ctest-pod-30570156] Cmd output: ctest-pod-98207663
Connecting to 10.97.227.148:80 (10.97.227.148:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-02 01:33:01,988 - DEBUG - [Pod ctest-pod-30570156] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: ctest-pod-81575004
Connecting to 10.97.227.148:80 (10.97.227.148:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-02 01:33:01,988 - DEBUG - [Pod Pod ctest-pod-30570156] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 passed
2025-10-02 01:33:01,988 - DEBUG - [Pod Pod ctest-pod-30570156] Cmd output: ctest-pod-81575004
Connecting to 10.97.227.148:80 (10.97.227.148:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-02 01:33:01,988 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-98207663': 4, 'ctest-pod-81575004': 1}
2025-10-02 01:33:01,991 - DEBUG - Network policy ingress-on-service not present
2025-10-02 01:33:01,992 - INFO - Creating Network Policy ingress-on-service
2025-10-02 01:33:02,004 - INFO - Network policy found in k8s
2025-10-02 01:33:02,005 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=b98c1b2a-d98e-4238-a375-34631b650562
2025-10-02 01:33:02,010 - INFO - Network Policy ingress-on-service with uuid b98c1b2a-d98e-4238-a375-34631b650562 found in kube manager
2025-10-02 01:33:02,037 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-10-02 01:33:02,037 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-10-02 01:33:02,037 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=b98c1b2a-d98e-4238-a375-34631b650562
2025-10-02 01:33:02,058 - WARNING - Network policy with name ingress-on-service not found in agent
2025-10-02 01:33:04,060 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=b98c1b2a-d98e-4238-a375-34631b650562
2025-10-02 01:33:04,083 - INFO - Network policy with name ingress-on-service found in agent
2025-10-02 01:33:04,083 - INFO - Network Policy ingress-on-service verification passed
2025-10-02 01:33:09,134 - DEBUG - [Pod ctest-pod-57337242] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:33:09,134 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:33:09,134 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:33:14,181 - DEBUG - [Pod ctest-pod-57337242] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:33:14,182 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:33:14,182 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:33:19,226 - DEBUG - [Pod ctest-pod-57337242] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:33:19,226 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:33:19,226 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:33:24,301 - DEBUG - [Pod ctest-pod-57337242] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:33:24,301 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:33:24,301 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:33:29,354 - DEBUG - [Pod ctest-pod-57337242] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:33:29,354 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:33:29,354 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:33:34,405 - DEBUG - [Pod ctest-pod-57337242] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:33:34,406 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:33:34,406 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:33:39,454 - DEBUG - [Pod ctest-pod-57337242] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:33:39,455 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:33:39,455 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:33:44,505 - DEBUG - [Pod ctest-pod-57337242] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:33:44,505 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:33:44,505 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:33:49,544 - DEBUG - [Pod ctest-pod-57337242] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:33:49,544 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:33:49,545 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:33:54,589 - DEBUG - [Pod ctest-pod-57337242] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:33:54,589 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:33:54,589 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:33:54,589 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-98207663': 0, 'ctest-pod-81575004': 0}
2025-10-02 01:33:54,636 - DEBUG - [Pod ctest-pod-39373485] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: ctest-pod-98207663
Connecting to 10.97.227.148:80 (10.97.227.148:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-02 01:33:54,636 - DEBUG - [Pod Pod ctest-pod-39373485] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 passed
2025-10-02 01:33:54,636 - DEBUG - [Pod Pod ctest-pod-39373485] Cmd output: ctest-pod-98207663
Connecting to 10.97.227.148:80 (10.97.227.148:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-02 01:33:54,683 - DEBUG - [Pod ctest-pod-39373485] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: ctest-pod-98207663
Connecting to 10.97.227.148:80 (10.97.227.148:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-02 01:33:54,683 - DEBUG - [Pod Pod ctest-pod-39373485] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 passed
2025-10-02 01:33:54,683 - DEBUG - [Pod Pod ctest-pod-39373485] Cmd output: ctest-pod-98207663
Connecting to 10.97.227.148:80 (10.97.227.148:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-02 01:33:54,714 - DEBUG - [Pod ctest-pod-39373485] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: ctest-pod-81575004
Connecting to 10.97.227.148:80 (10.97.227.148:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-02 01:33:54,714 - DEBUG - [Pod Pod ctest-pod-39373485] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 passed
2025-10-02 01:33:54,714 - DEBUG - [Pod Pod ctest-pod-39373485] Cmd output: ctest-pod-81575004
Connecting to 10.97.227.148:80 (10.97.227.148:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-02 01:33:54,714 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-98207663': 2, 'ctest-pod-81575004': 1}
2025-10-02 01:33:59,757 - DEBUG - [Pod ctest-pod-30570156] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:33:59,757 - DEBUG - [Pod Pod ctest-pod-30570156] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:33:59,757 - DEBUG - [Pod Pod ctest-pod-30570156] Cmd output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:34:04,805 - DEBUG - [Pod ctest-pod-30570156] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:34:04,805 - DEBUG - [Pod Pod ctest-pod-30570156] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:34:04,805 - DEBUG - [Pod Pod ctest-pod-30570156] Cmd output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:34:09,856 - DEBUG - [Pod ctest-pod-30570156] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:34:09,857 - DEBUG - [Pod Pod ctest-pod-30570156] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:34:09,857 - DEBUG - [Pod Pod ctest-pod-30570156] Cmd output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:34:14,901 - DEBUG - [Pod ctest-pod-30570156] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:34:14,901 - DEBUG - [Pod Pod ctest-pod-30570156] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:34:14,901 - DEBUG - [Pod Pod ctest-pod-30570156] Cmd output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:34:19,949 - DEBUG - [Pod ctest-pod-30570156] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:34:19,949 - DEBUG - [Pod Pod ctest-pod-30570156] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:34:19,950 - DEBUG - [Pod Pod ctest-pod-30570156] Cmd output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:34:25,005 - DEBUG - [Pod ctest-pod-30570156] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:34:25,005 - DEBUG - [Pod Pod ctest-pod-30570156] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:34:25,005 - DEBUG - [Pod Pod ctest-pod-30570156] Cmd output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:34:30,050 - DEBUG - [Pod ctest-pod-30570156] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:34:30,050 - DEBUG - [Pod Pod ctest-pod-30570156] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:34:30,050 - DEBUG - [Pod Pod ctest-pod-30570156] Cmd output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:34:35,118 - DEBUG - [Pod ctest-pod-30570156] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:34:35,118 - DEBUG - [Pod Pod ctest-pod-30570156] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:34:35,118 - DEBUG - [Pod Pod ctest-pod-30570156] Cmd output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:34:40,167 - DEBUG - [Pod ctest-pod-30570156] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:34:40,167 - DEBUG - [Pod Pod ctest-pod-30570156] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:34:40,167 - DEBUG - [Pod Pod ctest-pod-30570156] Cmd output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:34:45,217 - DEBUG - [Pod ctest-pod-30570156] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:34:45,217 - DEBUG - [Pod Pod ctest-pod-30570156] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:34:45,217 - DEBUG - [Pod Pod ctest-pod-30570156] Cmd output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:34:45,217 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-98207663': 0, 'ctest-pod-81575004': 0}
2025-10-02 01:34:47,262 - DEBUG - [Pod ctest-pod-39373485] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.675 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.067 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.085 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.067/0.275/0.675 ms
2025-10-02 01:34:47,262 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-39373485 with expectation True passed
2025-10-02 01:34:47,783 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2025-10-02 01:34:54,833 - DEBUG - [Pod ctest-pod-57337242] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.902 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.077 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.092 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.077/0.357/0.902 ms
2025-10-02 01:34:54,833 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-57337242 with expectation True passed
2025-10-02 01:34:56,882 - DEBUG - [Pod ctest-pod-30570156] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.124 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.075 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.080 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.075/0.426/1.124 ms
2025-10-02 01:34:56,882 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-30570156 with expectation True passed
2025-10-02 01:34:56,931 - DEBUG - [Pod ctest-pod-39373485] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-02 01:34:56,931 - DEBUG - [Pod Pod ctest-pod-39373485] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-10-02 01:34:56,931 - DEBUG - [Pod Pod ctest-pod-39373485] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-02 01:34:56,931 - INFO - wget check of of http://10.47.255.251 from ctest-pod-39373485 passed
2025-10-02 01:34:56,983 - DEBUG - [Pod ctest-pod-39373485] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-02 01:34:56,983 - DEBUG - [Pod Pod ctest-pod-39373485] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-10-02 01:34:56,983 - DEBUG - [Pod Pod ctest-pod-39373485] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-02 01:34:56,983 - INFO - wget check of of http://10.47.255.250 from ctest-pod-39373485 passed
2025-10-02 01:35:02,014 - DEBUG - [Pod ctest-pod-57337242] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-10-02 01:35:02,014 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-10-02 01:35:02,014 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-10-02 01:35:02,014 - INFO - wget check of of http://10.47.255.250 from ctest-pod-57337242 passed
2025-10-02 01:35:07,058 - DEBUG - [Pod ctest-pod-27014249] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-10-02 01:35:07,059 - DEBUG - [Pod Pod ctest-pod-27014249] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-10-02 01:35:07,059 - DEBUG - [Pod Pod ctest-pod-27014249] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-10-02 01:35:07,059 - INFO - wget check of of http://10.47.255.251 from ctest-pod-27014249 passed
2025-10-02 01:35:07,067 - INFO - Updating Network Policy ingress-on-service
2025-10-02 01:35:12,122 - DEBUG - [Pod ctest-pod-57337242] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:35:12,123 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:35:12,123 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:35:17,165 - DEBUG - [Pod ctest-pod-57337242] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:35:17,166 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:35:17,166 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:35:22,213 - DEBUG - [Pod ctest-pod-57337242] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:35:22,213 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:35:22,213 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:35:27,262 - DEBUG - [Pod ctest-pod-57337242] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:35:27,262 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:35:27,262 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:35:32,318 - DEBUG - [Pod ctest-pod-57337242] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:35:32,319 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:35:32,319 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:35:37,365 - DEBUG - [Pod ctest-pod-57337242] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:35:37,365 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:35:37,365 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:35:42,409 - DEBUG - [Pod ctest-pod-57337242] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:35:42,410 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:35:42,410 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:35:47,457 - DEBUG - [Pod ctest-pod-57337242] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:35:47,457 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:35:47,457 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:35:52,501 - DEBUG - [Pod ctest-pod-57337242] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:35:52,501 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:35:52,501 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:35:57,554 - DEBUG - [Pod ctest-pod-57337242] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:35:57,554 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:35:57,554 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
wget: download timed out
2025-10-02 01:35:57,554 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-98207663': 0, 'ctest-pod-81575004': 0}
2025-10-02 01:35:57,612 - DEBUG - [Pod ctest-pod-39373485] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: ctest-pod-81575004
Connecting to 10.97.227.148:80 (10.97.227.148:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-02 01:35:57,612 - DEBUG - [Pod Pod ctest-pod-39373485] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 passed
2025-10-02 01:35:57,612 - DEBUG - [Pod Pod ctest-pod-39373485] Cmd output: ctest-pod-81575004
Connecting to 10.97.227.148:80 (10.97.227.148:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-02 01:35:57,663 - DEBUG - [Pod ctest-pod-39373485] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: ctest-pod-98207663
Connecting to 10.97.227.148:80 (10.97.227.148:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-02 01:35:57,664 - DEBUG - [Pod Pod ctest-pod-39373485] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 passed
2025-10-02 01:35:57,664 - DEBUG - [Pod Pod ctest-pod-39373485] Cmd output: ctest-pod-98207663
Connecting to 10.97.227.148:80 (10.97.227.148:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-02 01:35:57,664 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-98207663': 1, 'ctest-pod-81575004': 1}
2025-10-02 01:35:57,715 - DEBUG - [Pod ctest-pod-30570156] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: ctest-pod-98207663
Connecting to 10.97.227.148:80 (10.97.227.148:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-02 01:35:57,715 - DEBUG - [Pod Pod ctest-pod-30570156] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 passed
2025-10-02 01:35:57,715 - DEBUG - [Pod Pod ctest-pod-30570156] Cmd output: ctest-pod-98207663
Connecting to 10.97.227.148:80 (10.97.227.148:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-02 01:35:57,770 - DEBUG - [Pod ctest-pod-30570156] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: ctest-pod-98207663
Connecting to 10.97.227.148:80 (10.97.227.148:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-02 01:35:57,770 - DEBUG - [Pod Pod ctest-pod-30570156] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 passed
2025-10-02 01:35:57,770 - DEBUG - [Pod Pod ctest-pod-30570156] Cmd output: ctest-pod-98207663
Connecting to 10.97.227.148:80 (10.97.227.148:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-10-02 01:35:57,823 - DEBUG - [Pod ctest-pod-30570156] Cmd: wget http://10.97.227.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-81575004
2025-10-02 01:35:57,823 - DEBUG - [Pod Pod ctest-pod-30570156] Cmd wget http://10.97.227.148:80/ -O - -T 5 -t 1 passed
2025-10-02 01:35:57,823 - DEBUG - [Pod Pod ctest-pod-30570156] Cmd output: Connecting to 10.97.227.148:80 (10.97.227.148:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-81575004
2025-10-02 01:35:57,823 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-98207663': 2, 'ctest-pod-81575004': 1}
2025-10-02 01:35:59,878 - DEBUG - [Pod ctest-pod-39373485] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.713 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.097 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.096 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.096/0.302/0.713 ms
2025-10-02 01:35:59,878 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-39373485 with expectation True passed
2025-10-02 01:36:01,921 - DEBUG - [Pod ctest-pod-57337242] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.207 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.076 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.086 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.076/0.456/1.207 ms
2025-10-02 01:36:01,922 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-57337242 with expectation True passed
2025-10-02 01:36:03,985 - DEBUG - [Pod ctest-pod-30570156] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.347 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.078 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.082 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.078/0.502/1.347 ms
2025-10-02 01:36:03,985 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-30570156 with expectation True passed
2025-10-02 01:36:04,034 - DEBUG - [Pod ctest-pod-39373485] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-02 01:36:04,034 - DEBUG - [Pod Pod ctest-pod-39373485] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-10-02 01:36:04,034 - DEBUG - [Pod Pod ctest-pod-39373485] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-02 01:36:04,034 - INFO - wget check of of http://10.47.255.251 from ctest-pod-39373485 passed
2025-10-02 01:36:04,079 - DEBUG - [Pod ctest-pod-39373485] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-02 01:36:04,079 - DEBUG - [Pod Pod ctest-pod-39373485] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-10-02 01:36:04,079 - DEBUG - [Pod Pod ctest-pod-39373485] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-02 01:36:04,079 - INFO - wget check of of http://10.47.255.250 from ctest-pod-39373485 passed
2025-10-02 01:36:09,125 - DEBUG - [Pod ctest-pod-57337242] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-10-02 01:36:09,125 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-10-02 01:36:09,125 - DEBUG - [Pod Pod ctest-pod-57337242] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-10-02 01:36:09,125 - INFO - wget check of of http://10.47.255.250 from ctest-pod-57337242 passed
2025-10-02 01:36:09,179 - DEBUG - [Pod ctest-pod-27014249] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-02 01:36:09,179 - DEBUG - [Pod Pod ctest-pod-27014249] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-10-02 01:36:09,179 - DEBUG - [Pod Pod ctest-pod-27014249] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-10-02 01:36:09,179 - INFO - wget check of of http://10.47.255.251 from ctest-pod-27014249 passed
2025-10-02 01:36:09,179 - INFO - Deleting Network Policy : ingress-on-service
2025-10-02 01:36:09,180 - INFO - Deleting service : ctest-nginx-svc-76981987
2025-10-02 01:36:09,411 - DEBUG - No XMPP flaps were noticed during the test
2025-10-02 01:36:09,412 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:10]
2025-10-02 01:36:09,412 - INFO - --------------------------------------------------------------------------------
2025-10-02 01:36:09,415 - INFO - Deleting pod ctest-new-default-25494294:ctest-pod-98207663
2025-10-02 01:36:09,415 - INFO - Deleting pod ctest-new-default-25494294:ctest-pod-81575004
2025-10-02 01:36:09,416 - INFO - Deleting pod ctest-non-default-74049945:ctest-pod-37720784
2025-10-02 01:36:09,416 - INFO - Deleting pod ctest-non-default-74049945:ctest-pod-57987458
2025-10-02 01:36:09,416 - INFO - Deleting pod ctest-new-default-25494294:ctest-pod-57337242
2025-10-02 01:36:09,417 - INFO - Deleting pod ctest-new-default-25494294:ctest-pod-39373485
2025-10-02 01:36:09,417 - INFO - Deleting pod ctest-non-default-74049945:ctest-pod-30570156
2025-10-02 01:36:09,417 - INFO - Deleting pod ctest-non-default-74049945:ctest-pod-27014249
2025-10-02 01:36:09,449 - WARNING - Pod uuid 5f35a110-0133-4ef7-9106-620879eb2592 is still seen in agent 10.0.0.22 VM list
2025-10-02 01:36:09,502 - WARNING - Pod uuid ef0648cc-7ad3-4697-8668-2296472d6477 is still seen in agent 10.0.0.22 VM list
2025-10-02 01:36:09,503 - WARNING - Pod uuid 1f089edd-27a4-4f55-85ff-4cf1d57bf5b4 is still seen in agent 10.0.0.22 VM list
2025-10-02 01:36:09,537 - WARNING - Pod uuid f6ef1359-eb1d-460d-8fc2-6f740b18f6b2 is still seen in agent 10.0.0.22 VM list
2025-10-02 01:36:09,538 - WARNING - Pod uuid 7dfd19f0-f993-4048-abaa-378e29991ba8 is still seen in agent 10.0.0.22 VM list
2025-10-02 01:36:09,543 - WARNING - Pod uuid 1ecc75bb-c769-41f7-98c4-0c9e0dd49e71 is still seen in agent 10.0.0.22 VM list
2025-10-02 01:36:09,544 - WARNING - Pod uuid d365fbad-1c89-46d0-b100-a30e3debade6 is still seen in agent 10.0.0.22 VM list
2025-10-02 01:36:09,544 - WARNING - Pod uuid 5110c752-937c-40e8-896a-7f6248fed202 is still seen in agent 10.0.0.22 VM list
2025-10-02 01:36:14,457 - DEBUG - Pod 5f35a110-0133-4ef7-9106-620879eb2592 is not in agent 10.0.0.22 VM list
2025-10-02 01:36:14,461 - DEBUG - VMI af4457bc-9f2f-11f0-8780-fa163ec7a04b is removed from agent 10.0.0.22
2025-10-02 01:36:14,461 - INFO - Verified that pod ctest-pod-98207663 is removed in agent
2025-10-02 01:36:14,510 - DEBUG - Pod ef0648cc-7ad3-4697-8668-2296472d6477 is not in agent 10.0.0.22 VM list
2025-10-02 01:36:14,511 - DEBUG - Pod 1f089edd-27a4-4f55-85ff-4cf1d57bf5b4 is not in agent 10.0.0.22 VM list
2025-10-02 01:36:14,518 - DEBUG - VMI b0b27d5e-9f2f-11f0-8780-fa163ec7a04b is removed from agent 10.0.0.22
2025-10-02 01:36:14,518 - INFO - Verified that pod ctest-pod-57987458 is removed in agent
2025-10-02 01:36:14,518 - DEBUG - VMI afacf9ca-9f2f-11f0-8780-fa163ec7a04b is removed from agent 10.0.0.22
2025-10-02 01:36:14,518 - INFO - Verified that pod ctest-pod-81575004 is removed in agent
2025-10-02 01:36:14,548 - WARNING - Pod uuid f6ef1359-eb1d-460d-8fc2-6f740b18f6b2 is still seen in agent 10.0.0.22 VM list
2025-10-02 01:36:14,548 - WARNING - Pod uuid 7dfd19f0-f993-4048-abaa-378e29991ba8 is still seen in agent 10.0.0.22 VM list
2025-10-02 01:36:14,556 - DEBUG - Pod 1ecc75bb-c769-41f7-98c4-0c9e0dd49e71 is not in agent 10.0.0.22 VM list
2025-10-02 01:36:14,558 - WARNING - Pod uuid d365fbad-1c89-46d0-b100-a30e3debade6 is still seen in agent 10.0.0.22 VM list
2025-10-02 01:36:14,558 - WARNING - Pod uuid 5110c752-937c-40e8-896a-7f6248fed202 is still seen in agent 10.0.0.22 VM list
2025-10-02 01:36:14,561 - DEBUG - VMI b04304ec-9f2f-11f0-8780-fa163ec7a04b is removed from agent 10.0.0.22
2025-10-02 01:36:14,561 - INFO - Verified that pod ctest-pod-37720784 is removed in agent
2025-10-02 01:36:19,556 - WARNING - Pod uuid 7dfd19f0-f993-4048-abaa-378e29991ba8 is still seen in agent 10.0.0.22 VM list
2025-10-02 01:36:19,557 - WARNING - Pod uuid f6ef1359-eb1d-460d-8fc2-6f740b18f6b2 is still seen in agent 10.0.0.22 VM list
2025-10-02 01:36:19,564 - WARNING - Pod uuid d365fbad-1c89-46d0-b100-a30e3debade6 is still seen in agent 10.0.0.22 VM list
2025-10-02 01:36:19,565 - WARNING - Pod uuid 5110c752-937c-40e8-896a-7f6248fed202 is still seen in agent 10.0.0.22 VM list
2025-10-02 01:36:24,564 - WARNING - Pod uuid 7dfd19f0-f993-4048-abaa-378e29991ba8 is still seen in agent 10.0.0.22 VM list
2025-10-02 01:36:24,567 - WARNING - Pod uuid f6ef1359-eb1d-460d-8fc2-6f740b18f6b2 is still seen in agent 10.0.0.22 VM list
2025-10-02 01:36:24,572 - WARNING - Pod uuid d365fbad-1c89-46d0-b100-a30e3debade6 is still seen in agent 10.0.0.22 VM list
2025-10-02 01:36:24,573 - WARNING - Pod uuid 5110c752-937c-40e8-896a-7f6248fed202 is still seen in agent 10.0.0.22 VM list
2025-10-02 01:36:29,572 - WARNING - Pod uuid 7dfd19f0-f993-4048-abaa-378e29991ba8 is still seen in agent 10.0.0.22 VM list
2025-10-02 01:36:29,574 - WARNING - Pod uuid f6ef1359-eb1d-460d-8fc2-6f740b18f6b2 is still seen in agent 10.0.0.22 VM list
2025-10-02 01:36:29,579 - WARNING - Pod uuid 5110c752-937c-40e8-896a-7f6248fed202 is still seen in agent 10.0.0.22 VM list
2025-10-02 01:36:29,580 - WARNING - Pod uuid d365fbad-1c89-46d0-b100-a30e3debade6 is still seen in agent 10.0.0.22 VM list
2025-10-02 01:36:34,583 - WARNING - Pod uuid f6ef1359-eb1d-460d-8fc2-6f740b18f6b2 is still seen in agent 10.0.0.22 VM list
2025-10-02 01:36:34,583 - WARNING - Pod uuid 7dfd19f0-f993-4048-abaa-378e29991ba8 is still seen in agent 10.0.0.22 VM list
2025-10-02 01:36:34,589 - WARNING - Pod uuid d365fbad-1c89-46d0-b100-a30e3debade6 is still seen in agent 10.0.0.22 VM list
2025-10-02 01:36:34,590 - WARNING - Pod uuid 5110c752-937c-40e8-896a-7f6248fed202 is still seen in agent 10.0.0.22 VM list
2025-10-02 01:36:39,594 - WARNING - Pod uuid f6ef1359-eb1d-460d-8fc2-6f740b18f6b2 is still seen in agent 10.0.0.22 VM list
2025-10-02 01:36:39,598 - WARNING - Pod uuid 7dfd19f0-f993-4048-abaa-378e29991ba8 is still seen in agent 10.0.0.22 VM list
2025-10-02 01:36:39,600 - WARNING - Pod uuid 5110c752-937c-40e8-896a-7f6248fed202 is still seen in agent 10.0.0.22 VM list
2025-10-02 01:36:39,601 - WARNING - Pod uuid d365fbad-1c89-46d0-b100-a30e3debade6 is still seen in agent 10.0.0.22 VM list
2025-10-02 01:36:44,600 - DEBUG - Pod f6ef1359-eb1d-460d-8fc2-6f740b18f6b2 is not in agent 10.0.0.22 VM list
2025-10-02 01:36:44,610 - DEBUG - VMI b1f5411a-9f2f-11f0-8780-fa163ec7a04b is removed from agent 10.0.0.22
2025-10-02 01:36:44,610 - INFO - Verified that pod ctest-pod-30570156 is removed in agent
2025-10-02 01:36:44,610 - DEBUG - Pod 7dfd19f0-f993-4048-abaa-378e29991ba8 is not in agent 10.0.0.22 VM list
2025-10-02 01:36:44,612 - DEBUG - Pod d365fbad-1c89-46d0-b100-a30e3debade6 is not in agent 10.0.0.22 VM list
2025-10-02 01:36:44,613 - DEBUG - Pod 5110c752-937c-40e8-896a-7f6248fed202 is not in agent 10.0.0.22 VM list
2025-10-02 01:36:44,620 - DEBUG - VMI b25b5072-9f2f-11f0-8780-fa163ec7a04b is removed from agent 10.0.0.22
2025-10-02 01:36:44,620 - INFO - Verified that pod ctest-pod-27014249 is removed in agent
2025-10-02 01:36:44,621 - DEBUG - VMI b19321a6-9f2f-11f0-8780-fa163ec7a04b is removed from agent 10.0.0.22
2025-10-02 01:36:44,621 - INFO - Verified that pod ctest-pod-39373485 is removed in agent
2025-10-02 01:36:44,621 - DEBUG - VMI b12e343a-9f2f-11f0-8780-fa163ec7a04b is removed from agent 10.0.0.22
2025-10-02 01:36:44,621 - INFO - Verified that pod ctest-pod-57337242 is removed in agent
2025-10-02 01:36:44,621 - INFO - Deleting namespace ctest-non-default-74049945
2025-10-02 01:36:44,638 - DEBUG - Namespace ctest-non-default-74049945 still in k8s
2025-10-02 01:36:46,643 - DEBUG - Namespace ctest-non-default-74049945 still in k8s
2025-10-02 01:36:48,647 - DEBUG - Namespace ctest-non-default-74049945 still in k8s
2025-10-02 01:36:50,650 - DEBUG - Namespace ctest-non-default-74049945 is not in k8s
2025-10-02 01:36:50,650 - DEBUG - No need to check project deletion in contrail-api
2025-10-02 01:36:50,651 - INFO - Deleting namespace ctest-new-default-25494294
2025-10-02 01:36:50,659 - DEBUG - Namespace ctest-new-default-25494294 still in k8s
2025-10-02 01:36:52,667 - DEBUG - Namespace ctest-new-default-25494294 still in k8s
2025-10-02 01:36:54,672 - DEBUG - Namespace ctest-new-default-25494294 still in k8s
2025-10-02 01:36:56,677 - DEBUG - Namespace ctest-new-default-25494294 is not in k8s
2025-10-02 01:36:56,677 - DEBUG - No need to check project deletion in contrail-api