2025-11-10 01:44:20,331 - INFO - Using existing project ['default-domain', 'k8s-default'](56301b9c-feeb-4e28-b1c4-ae3983580c5c)
2025-11-10 01:44:20,347 - DEBUG - Namespace ctest-new-default-11380348 not present
2025-11-10 01:44:20,354 - INFO - Created namespace ctest-new-default-11380348
2025-11-10 01:44:23,358 - DEBUG - Namespace ctest-non-default-50526433 not present
2025-11-10 01:44:23,372 - INFO - Created namespace ctest-non-default-50526433
2025-11-10 01:44:26,397 - DEBUG - Pod ctest-pod-72328124 not present
2025-11-10 01:44:26,398 - INFO - Creating Pod ctest-pod-72328124
2025-11-10 01:44:26,439 - DEBUG - Pod : ctest-pod-72328124 UUID is 0917fe48-e228-455b-8f15-7c72014959ea
2025-11-10 01:44:26,442 - DEBUG - Pod ctest-pod-73745361 not present
2025-11-10 01:44:26,444 - INFO - Creating Pod ctest-pod-73745361
2025-11-10 01:44:26,479 - DEBUG - Pod : ctest-pod-73745361 UUID is e4ad14f7-a848-4323-9166-7b6add6e0ff8
2025-11-10 01:44:26,481 - DEBUG - Pod ctest-pod-48742372 not present
2025-11-10 01:44:26,482 - INFO - Creating Pod ctest-pod-48742372
2025-11-10 01:44:26,513 - DEBUG - Pod : ctest-pod-48742372 UUID is a0fe3fe5-1e4e-4972-8a00-9e97adf2d14c
2025-11-10 01:44:26,515 - DEBUG - Pod ctest-pod-07556299 not present
2025-11-10 01:44:26,516 - INFO - Creating Pod ctest-pod-07556299
2025-11-10 01:44:26,547 - DEBUG - Pod : ctest-pod-07556299 UUID is 8bdda783-f547-4af5-a597-f379810c3842
2025-11-10 01:44:26,550 - DEBUG - Pod ctest-pod-10957994 not present
2025-11-10 01:44:26,550 - INFO - Creating Pod ctest-pod-10957994
2025-11-10 01:44:26,578 - DEBUG - Pod : ctest-pod-10957994 UUID is 98abe18e-7667-4cfa-87d7-8a909b521f54
2025-11-10 01:44:26,580 - DEBUG - Pod ctest-pod-72844790 not present
2025-11-10 01:44:26,580 - INFO - Creating Pod ctest-pod-72844790
2025-11-10 01:44:26,604 - DEBUG - Pod : ctest-pod-72844790 UUID is 8c218b3b-20e0-445b-a19c-18f3a02b506f
2025-11-10 01:44:26,606 - DEBUG - Pod ctest-pod-20314763 not present
2025-11-10 01:44:26,607 - INFO - Creating Pod ctest-pod-20314763
2025-11-10 01:44:26,640 - DEBUG - Pod : ctest-pod-20314763 UUID is 03ff3b55-736e-4499-be07-aeddfeb80294
2025-11-10 01:44:26,643 - DEBUG - Pod ctest-pod-55570722 not present
2025-11-10 01:44:26,643 - INFO - Creating Pod ctest-pod-55570722
2025-11-10 01:44:26,668 - DEBUG - Pod : ctest-pod-55570722 UUID is c183afc1-dc62-46e2-b74f-45f5b2ae0241
2025-11-10 01:44:26,938 - INFO - Project default-domain:k8s-ctest-new-default-11380348 for Namespace ctest-new-default-11380348 is seen in contrail-api
2025-11-10 01:44:26,939 - DEBUG - Project uuid in Contrail is 37e6ac04-b594-4ecb-aeef-0411e910c57c
2025-11-10 01:44:27,162 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_NamespaceDatabaseList?namespace_uuid=6c764926-7fb0-4ec9-8527-54d2d5fee412
2025-11-10 01:44:27,182 - INFO - Namespace ctest-new-default-11380348 with uuid 6c764926-7fb0-4ec9-8527-54d2d5fee412 found in kube manager
2025-11-10 01:44:27,182 - INFO - Namespace ctest-new-default-11380348 verification passed
2025-11-10 01:44:27,486 - INFO - Project default-domain:k8s-ctest-non-default-50526433 for Namespace ctest-non-default-50526433 is seen in contrail-api
2025-11-10 01:44:27,486 - DEBUG - Project uuid in Contrail is 0bacbfc7-7c4e-45ea-9a1b-62530109b89e
2025-11-10 01:44:27,486 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_NamespaceDatabaseList?namespace_uuid=48b805d4-9c46-4067-a742-e0601bbf669a
2025-11-10 01:44:27,490 - INFO - Namespace ctest-non-default-50526433 with uuid 48b805d4-9c46-4067-a742-e0601bbf669a found in kube manager
2025-11-10 01:44:27,490 - INFO - Namespace ctest-non-default-50526433 verification passed
2025-11-10 01:44:27,498 - DEBUG - Pod ctest-pod-72328124 not in running state.Currently in Pending
2025-11-10 01:44:32,506 - DEBUG - Pod ctest-pod-72328124 not in running state.Currently in Pending
2025-11-10 01:44:37,515 - DEBUG - Pod ctest-pod-72328124 not in running state.Currently in Pending
2025-11-10 01:44:42,522 - INFO - Pod ctest-pod-72328124 is in running state.Got IP 10.47.255.251
2025-11-10 01:44:42,583 - DEBUG - Pod ctest-pod-72328124 has vmi cb53c6e8-bdd6-11f0-bb93-fa163ed32009
2025-11-10 01:44:42,583 - INFO - Verified pod ctest-pod-72328124 in contrail-api
2025-11-10 01:44:42,595 - DEBUG - VMI cb53c6e8-bdd6-11f0-bb93-fa163ed32009 is active in agent 10.0.0.242
2025-11-10 01:44:42,595 - INFO - Verified Pod ctest-pod-72328124 in agent 10.0.0.242
2025-11-10 01:44:42,595 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=0917fe48-e228-455b-8f15-7c72014959ea
2025-11-10 01:44:42,599 - INFO - Pod ctest-pod-72328124 with uuid 0917fe48-e228-455b-8f15-7c72014959ea found in kube manager
2025-11-10 01:44:42,599 - INFO - Pod ctest-pod-72328124 verification passed
2025-11-10 01:44:42,606 - INFO - Pod ctest-pod-73745361 is in running state.Got IP 10.47.255.250
2025-11-10 01:44:42,618 - DEBUG - Pod ctest-pod-73745361 has vmi cbc643c6-bdd6-11f0-bb93-fa163ed32009
2025-11-10 01:44:42,618 - INFO - Verified pod ctest-pod-73745361 in contrail-api
2025-11-10 01:44:42,628 - DEBUG - VMI cbc643c6-bdd6-11f0-bb93-fa163ed32009 is active in agent 10.0.0.242
2025-11-10 01:44:42,629 - INFO - Verified Pod ctest-pod-73745361 in agent 10.0.0.242
2025-11-10 01:44:42,629 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=e4ad14f7-a848-4323-9166-7b6add6e0ff8
2025-11-10 01:44:42,632 - INFO - Pod ctest-pod-73745361 with uuid e4ad14f7-a848-4323-9166-7b6add6e0ff8 found in kube manager
2025-11-10 01:44:42,632 - INFO - Pod ctest-pod-73745361 verification passed
2025-11-10 01:44:42,639 - INFO - Pod ctest-pod-48742372 is in running state.Got IP 10.47.255.249
2025-11-10 01:44:42,694 - DEBUG - Pod ctest-pod-48742372 has vmi cc5a4788-bdd6-11f0-bb93-fa163ed32009
2025-11-10 01:44:42,694 - INFO - Verified pod ctest-pod-48742372 in contrail-api
2025-11-10 01:44:42,705 - DEBUG - VMI cc5a4788-bdd6-11f0-bb93-fa163ed32009 is active in agent 10.0.0.242
2025-11-10 01:44:42,705 - INFO - Verified Pod ctest-pod-48742372 in agent 10.0.0.242
2025-11-10 01:44:42,705 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=a0fe3fe5-1e4e-4972-8a00-9e97adf2d14c
2025-11-10 01:44:42,709 - INFO - Pod ctest-pod-48742372 with uuid a0fe3fe5-1e4e-4972-8a00-9e97adf2d14c found in kube manager
2025-11-10 01:44:42,710 - INFO - Pod ctest-pod-48742372 verification passed
2025-11-10 01:44:42,716 - INFO - Pod ctest-pod-07556299 is in running state.Got IP 10.47.255.248
2025-11-10 01:44:42,767 - DEBUG - Pod ctest-pod-07556299 has vmi ccc8c21c-bdd6-11f0-bb93-fa163ed32009
2025-11-10 01:44:42,767 - INFO - Verified pod ctest-pod-07556299 in contrail-api
2025-11-10 01:44:42,777 - DEBUG - VMI ccc8c21c-bdd6-11f0-bb93-fa163ed32009 is active in agent 10.0.0.242
2025-11-10 01:44:42,777 - INFO - Verified Pod ctest-pod-07556299 in agent 10.0.0.242
2025-11-10 01:44:42,777 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=8bdda783-f547-4af5-a597-f379810c3842
2025-11-10 01:44:42,781 - INFO - Pod ctest-pod-07556299 with uuid 8bdda783-f547-4af5-a597-f379810c3842 found in kube manager
2025-11-10 01:44:42,781 - INFO - Pod ctest-pod-07556299 verification passed
2025-11-10 01:44:42,786 - INFO - Pod ctest-pod-10957994 is in running state.Got IP 10.47.255.247
2025-11-10 01:44:42,796 - DEBUG - Pod ctest-pod-10957994 has vmi cd58bdae-bdd6-11f0-bb93-fa163ed32009
2025-11-10 01:44:42,796 - INFO - Verified pod ctest-pod-10957994 in contrail-api
2025-11-10 01:44:42,806 - DEBUG - VMI cd58bdae-bdd6-11f0-bb93-fa163ed32009 is active in agent 10.0.0.242
2025-11-10 01:44:42,807 - INFO - Verified Pod ctest-pod-10957994 in agent 10.0.0.242
2025-11-10 01:44:42,807 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=98abe18e-7667-4cfa-87d7-8a909b521f54
2025-11-10 01:44:42,810 - INFO - Pod ctest-pod-10957994 with uuid 98abe18e-7667-4cfa-87d7-8a909b521f54 found in kube manager
2025-11-10 01:44:42,810 - INFO - Pod ctest-pod-10957994 verification passed
2025-11-10 01:44:42,817 - DEBUG - Pod ctest-pod-20314763 not in running state.Currently in Pending
2025-11-10 01:44:47,826 - INFO - Pod ctest-pod-20314763 is in running state.Got IP 10.47.255.245
2025-11-10 01:44:47,883 - DEBUG - Pod ctest-pod-20314763 has vmi ce372558-bdd6-11f0-bb93-fa163ed32009
2025-11-10 01:44:47,883 - INFO - Verified pod ctest-pod-20314763 in contrail-api
2025-11-10 01:44:47,895 - DEBUG - VMI ce372558-bdd6-11f0-bb93-fa163ed32009 is active in agent 10.0.0.242
2025-11-10 01:44:47,895 - INFO - Verified Pod ctest-pod-20314763 in agent 10.0.0.242
2025-11-10 01:44:47,895 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=03ff3b55-736e-4499-be07-aeddfeb80294
2025-11-10 01:44:47,899 - INFO - Pod ctest-pod-20314763 with uuid 03ff3b55-736e-4499-be07-aeddfeb80294 found in kube manager
2025-11-10 01:44:47,899 - INFO - Pod ctest-pod-20314763 verification passed
2025-11-10 01:44:47,905 - INFO - Pod ctest-pod-72844790 is in running state.Got IP 10.47.255.246
2025-11-10 01:44:47,917 - DEBUG - Pod ctest-pod-72844790 has vmi cdcd6816-bdd6-11f0-bb93-fa163ed32009
2025-11-10 01:44:47,917 - INFO - Verified pod ctest-pod-72844790 in contrail-api
2025-11-10 01:44:47,928 - DEBUG - VMI cdcd6816-bdd6-11f0-bb93-fa163ed32009 is active in agent 10.0.0.242
2025-11-10 01:44:47,928 - INFO - Verified Pod ctest-pod-72844790 in agent 10.0.0.242
2025-11-10 01:44:47,928 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=8c218b3b-20e0-445b-a19c-18f3a02b506f
2025-11-10 01:44:47,931 - INFO - Pod ctest-pod-72844790 with uuid 8c218b3b-20e0-445b-a19c-18f3a02b506f found in kube manager
2025-11-10 01:44:47,931 - INFO - Pod ctest-pod-72844790 verification passed
2025-11-10 01:44:47,938 - INFO - Pod ctest-pod-55570722 is in running state.Got IP 10.47.255.244
2025-11-10 01:44:47,993 - DEBUG - Pod ctest-pod-55570722 has vmi ce9c3f7e-bdd6-11f0-bb93-fa163ed32009
2025-11-10 01:44:47,993 - INFO - Verified pod ctest-pod-55570722 in contrail-api
2025-11-10 01:44:48,004 - DEBUG - VMI ce9c3f7e-bdd6-11f0-bb93-fa163ed32009 is active in agent 10.0.0.242
2025-11-10 01:44:48,004 - INFO - Verified Pod ctest-pod-55570722 in agent 10.0.0.242
2025-11-10 01:44:48,004 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=c183afc1-dc62-46e2-b74f-45f5b2ae0241
2025-11-10 01:44:48,007 - INFO - Pod ctest-pod-55570722 with uuid c183afc1-dc62-46e2-b74f-45f5b2ae0241 found in kube manager
2025-11-10 01:44:48,007 - INFO - Pod ctest-pod-55570722 verification passed
2025-11-10 01:44:48,008 - INFO - ================================================================================
2025-11-10 01:44:48,008 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-11-10 01:44:48,008 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-11-10 01:44:48,192 - DEBUG - Nothing to compare xmpp stats {'10.0.0.242': {'10.0.0.19': '0'}} with
2025-11-10 01:44:48,192 - INFO - Initial checks done. Running the testcase now
2025-11-10 01:44:48,193 - INFO -
2025-11-10 01:44:48,254 - DEBUG - [Pod ctest-pod-72328124] Cmd: echo ctest-pod-72328124 > /usr/share/nginx/html/index.html, Output:
2025-11-10 01:44:48,302 - DEBUG - [Pod ctest-pod-73745361] Cmd: echo ctest-pod-73745361 > /usr/share/nginx/html/index.html, Output:
2025-11-10 01:44:48,355 - DEBUG - [Pod ctest-pod-48742372] Cmd: echo ctest-pod-48742372 > /usr/share/nginx/html/index.html, Output:
2025-11-10 01:44:48,406 - DEBUG - [Pod ctest-pod-07556299] Cmd: echo ctest-pod-07556299 > /usr/share/nginx/html/index.html, Output:
2025-11-10 01:44:48,409 - DEBUG - Service ctest-nginx-svc-09560400 not present
2025-11-10 01:44:48,410 - INFO - Creating service ctest-nginx-svc-09560400
2025-11-10 01:44:48,422 - INFO - Created Service ctest-nginx-svc-09560400
2025-11-10 01:44:48,431 - WARNING - Service UUID 581680de-a87b-42dd-b67c-74d3cafcc2f4 not yet found in contrail-api
2025-11-10 01:44:49,437 - INFO - Validated that Service ctest-nginx-svc-09560400 is seen in contrail-api
2025-11-10 01:44:49,438 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_LoadbalancerDatabaseList?x=581680de-a87b-42dd-b67c-74d3cafcc2f4
2025-11-10 01:44:49,442 - INFO - Service ctest-nginx-svc-09560400 with uuid 581680de-a87b-42dd-b67c-74d3cafcc2f4 found in kube manager
2025-11-10 01:44:49,442 - INFO - Service ctest-nginx-svc-09560400 verification passed
2025-11-10 01:44:50,519 - DEBUG - [Pod ctest-pod-10957994] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-73745361
2025-11-10 01:44:50,519 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 passed
2025-11-10 01:44:50,519 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-73745361
2025-11-10 01:44:50,576 - DEBUG - [Pod ctest-pod-10957994] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-73745361
2025-11-10 01:44:50,576 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 passed
2025-11-10 01:44:50,576 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-73745361
2025-11-10 01:44:50,639 - DEBUG - [Pod ctest-pod-10957994] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: ctest-pod-72328124
Connecting to 10.103.9.198:80 (10.103.9.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-10 01:44:50,639 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 passed
2025-11-10 01:44:50,639 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd output: ctest-pod-72328124
Connecting to 10.103.9.198:80 (10.103.9.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-10 01:44:50,639 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-72328124': 1, 'ctest-pod-73745361': 2}
2025-11-10 01:44:50,695 - DEBUG - [Pod ctest-pod-20314763] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: ctest-pod-73745361
Connecting to 10.103.9.198:80 (10.103.9.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-10 01:44:50,695 - DEBUG - [Pod Pod ctest-pod-20314763] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 passed
2025-11-10 01:44:50,695 - DEBUG - [Pod Pod ctest-pod-20314763] Cmd output: ctest-pod-73745361
Connecting to 10.103.9.198:80 (10.103.9.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-10 01:44:50,729 - DEBUG - [Pod ctest-pod-20314763] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-73745361
2025-11-10 01:44:50,729 - DEBUG - [Pod Pod ctest-pod-20314763] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 passed
2025-11-10 01:44:50,729 - DEBUG - [Pod Pod ctest-pod-20314763] Cmd output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-73745361
2025-11-10 01:44:50,780 - DEBUG - [Pod ctest-pod-20314763] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: ctest-pod-73745361
Connecting to 10.103.9.198:80 (10.103.9.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-10 01:44:50,780 - DEBUG - [Pod Pod ctest-pod-20314763] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 passed
2025-11-10 01:44:50,780 - DEBUG - [Pod Pod ctest-pod-20314763] Cmd output: ctest-pod-73745361
Connecting to 10.103.9.198:80 (10.103.9.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-10 01:44:50,822 - DEBUG - [Pod ctest-pod-20314763] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-72328124
2025-11-10 01:44:50,822 - DEBUG - [Pod Pod ctest-pod-20314763] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 passed
2025-11-10 01:44:50,822 - DEBUG - [Pod Pod ctest-pod-20314763] Cmd output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-72328124
2025-11-10 01:44:50,822 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-72328124': 1, 'ctest-pod-73745361': 3}
2025-11-10 01:44:50,827 - DEBUG - Network policy ingress-on-service not present
2025-11-10 01:44:50,827 - INFO - Creating Network Policy ingress-on-service
2025-11-10 01:44:50,856 - INFO - Network policy found in k8s
2025-11-10 01:44:50,856 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=14422844-aa85-43e4-a30b-7b0e0b5b2afd
2025-11-10 01:44:50,860 - INFO - Network Policy ingress-on-service with uuid 14422844-aa85-43e4-a30b-7b0e0b5b2afd found in kube manager
2025-11-10 01:44:50,895 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-11-10 01:44:50,895 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-11-10 01:44:50,895 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=14422844-aa85-43e4-a30b-7b0e0b5b2afd
2025-11-10 01:44:50,918 - WARNING - Network policy with name ingress-on-service not found in agent
2025-11-10 01:44:52,919 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=14422844-aa85-43e4-a30b-7b0e0b5b2afd
2025-11-10 01:44:52,942 - INFO - Network policy with name ingress-on-service found in agent
2025-11-10 01:44:52,943 - INFO - Network Policy ingress-on-service verification passed
2025-11-10 01:44:57,998 - DEBUG - [Pod ctest-pod-10957994] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:44:57,998 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:44:57,998 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:45:03,057 - DEBUG - [Pod ctest-pod-10957994] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:45:03,058 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:45:03,058 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:45:08,118 - DEBUG - [Pod ctest-pod-10957994] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:45:08,118 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:45:08,118 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:45:13,170 - DEBUG - [Pod ctest-pod-10957994] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:45:13,170 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:45:13,170 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:45:18,224 - DEBUG - [Pod ctest-pod-10957994] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:45:18,224 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:45:18,224 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:45:23,277 - DEBUG - [Pod ctest-pod-10957994] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:45:23,277 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:45:23,277 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:45:28,322 - DEBUG - [Pod ctest-pod-10957994] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:45:28,322 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:45:28,323 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:45:33,373 - DEBUG - [Pod ctest-pod-10957994] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:45:33,373 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:45:33,373 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:45:37,706 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2025-11-10 01:45:47,766 - DEBUG - [Pod ctest-pod-10957994] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:45:47,766 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:45:47,766 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:45:52,818 - DEBUG - [Pod ctest-pod-10957994] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:45:52,818 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:45:52,818 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:45:52,818 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-72328124': 0, 'ctest-pod-73745361': 0}
2025-11-10 01:45:52,876 - DEBUG - [Pod ctest-pod-72844790] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: ctest-pod-73745361
Connecting to 10.103.9.198:80 (10.103.9.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-10 01:45:52,876 - DEBUG - [Pod Pod ctest-pod-72844790] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 passed
2025-11-10 01:45:52,876 - DEBUG - [Pod Pod ctest-pod-72844790] Cmd output: ctest-pod-73745361
Connecting to 10.103.9.198:80 (10.103.9.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-10 01:45:52,923 - DEBUG - [Pod ctest-pod-72844790] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: ctest-pod-73745361
Connecting to 10.103.9.198:80 (10.103.9.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-10 01:45:52,924 - DEBUG - [Pod Pod ctest-pod-72844790] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 passed
2025-11-10 01:45:52,924 - DEBUG - [Pod Pod ctest-pod-72844790] Cmd output: ctest-pod-73745361
Connecting to 10.103.9.198:80 (10.103.9.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-10 01:45:52,978 - DEBUG - [Pod ctest-pod-72844790] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
ctest-pod-73745361
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-10 01:45:52,978 - DEBUG - [Pod Pod ctest-pod-72844790] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 passed
2025-11-10 01:45:52,978 - DEBUG - [Pod Pod ctest-pod-72844790] Cmd output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
ctest-pod-73745361
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-10 01:45:53,032 - DEBUG - [Pod ctest-pod-72844790] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: ctest-pod-73745361
Connecting to 10.103.9.198:80 (10.103.9.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-10 01:45:53,032 - DEBUG - [Pod Pod ctest-pod-72844790] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 passed
2025-11-10 01:45:53,032 - DEBUG - [Pod Pod ctest-pod-72844790] Cmd output: ctest-pod-73745361
Connecting to 10.103.9.198:80 (10.103.9.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-10 01:45:53,079 - DEBUG - [Pod ctest-pod-72844790] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-72328124
2025-11-10 01:45:53,079 - DEBUG - [Pod Pod ctest-pod-72844790] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 passed
2025-11-10 01:45:53,079 - DEBUG - [Pod Pod ctest-pod-72844790] Cmd output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-72328124
2025-11-10 01:45:53,079 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-72328124': 1, 'ctest-pod-73745361': 4}
2025-11-10 01:45:58,126 - DEBUG - [Pod ctest-pod-20314763] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:45:58,126 - DEBUG - [Pod Pod ctest-pod-20314763] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:45:58,126 - DEBUG - [Pod Pod ctest-pod-20314763] Cmd output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:46:03,182 - DEBUG - [Pod ctest-pod-20314763] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:46:03,182 - DEBUG - [Pod Pod ctest-pod-20314763] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:46:03,182 - DEBUG - [Pod Pod ctest-pod-20314763] Cmd output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:46:08,233 - DEBUG - [Pod ctest-pod-20314763] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:46:08,234 - DEBUG - [Pod Pod ctest-pod-20314763] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:46:08,234 - DEBUG - [Pod Pod ctest-pod-20314763] Cmd output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:46:13,302 - DEBUG - [Pod ctest-pod-20314763] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:46:13,302 - DEBUG - [Pod Pod ctest-pod-20314763] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:46:13,303 - DEBUG - [Pod Pod ctest-pod-20314763] Cmd output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:46:18,354 - DEBUG - [Pod ctest-pod-20314763] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:46:18,354 - DEBUG - [Pod Pod ctest-pod-20314763] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:46:18,354 - DEBUG - [Pod Pod ctest-pod-20314763] Cmd output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:46:23,410 - DEBUG - [Pod ctest-pod-20314763] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:46:23,410 - DEBUG - [Pod Pod ctest-pod-20314763] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:46:23,410 - DEBUG - [Pod Pod ctest-pod-20314763] Cmd output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:46:28,462 - DEBUG - [Pod ctest-pod-20314763] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:46:28,462 - DEBUG - [Pod Pod ctest-pod-20314763] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:46:28,462 - DEBUG - [Pod Pod ctest-pod-20314763] Cmd output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:46:33,513 - DEBUG - [Pod ctest-pod-20314763] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:46:33,513 - DEBUG - [Pod Pod ctest-pod-20314763] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:46:33,513 - DEBUG - [Pod Pod ctest-pod-20314763] Cmd output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:46:38,569 - DEBUG - [Pod ctest-pod-20314763] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:46:38,570 - DEBUG - [Pod Pod ctest-pod-20314763] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:46:38,570 - DEBUG - [Pod Pod ctest-pod-20314763] Cmd output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:46:43,618 - DEBUG - [Pod ctest-pod-20314763] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:46:43,619 - DEBUG - [Pod Pod ctest-pod-20314763] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:46:43,619 - DEBUG - [Pod Pod ctest-pod-20314763] Cmd output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:46:43,619 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-72328124': 0, 'ctest-pod-73745361': 0}
2025-11-10 01:46:45,665 - DEBUG - [Pod ctest-pod-72844790] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.166 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.065 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.070 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.065/0.433/1.166 ms
2025-11-10 01:46:45,665 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-72844790 with expectation True passed
2025-11-10 01:46:47,714 - DEBUG - [Pod ctest-pod-10957994] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.497 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.086 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.070/0.217/0.497 ms
2025-11-10 01:46:47,714 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-10957994 with expectation True passed
2025-11-10 01:46:49,763 - DEBUG - [Pod ctest-pod-20314763] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.031 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.072 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.085 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.072/0.396/1.031 ms
2025-11-10 01:46:49,763 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-20314763 with expectation True passed
2025-11-10 01:46:49,823 - DEBUG - [Pod ctest-pod-72844790] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-11-10 01:46:49,823 - DEBUG - [Pod Pod ctest-pod-72844790] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-11-10 01:46:49,823 - DEBUG - [Pod Pod ctest-pod-72844790] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-11-10 01:46:49,823 - INFO - wget check of of http://10.47.255.251 from ctest-pod-72844790 passed
2025-11-10 01:46:49,884 - DEBUG - [Pod ctest-pod-72844790] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-11-10 01:46:49,884 - DEBUG - [Pod Pod ctest-pod-72844790] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-11-10 01:46:49,884 - DEBUG - [Pod Pod ctest-pod-72844790] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-11-10 01:46:49,884 - INFO - wget check of of http://10.47.255.250 from ctest-pod-72844790 passed
2025-11-10 01:46:54,926 - DEBUG - [Pod ctest-pod-10957994] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-11-10 01:46:54,926 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-11-10 01:46:54,926 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-11-10 01:46:54,926 - INFO - wget check of of http://10.47.255.250 from ctest-pod-10957994 passed
2025-11-10 01:46:59,978 - DEBUG - [Pod ctest-pod-55570722] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-11-10 01:46:59,978 - DEBUG - [Pod Pod ctest-pod-55570722] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-11-10 01:46:59,978 - DEBUG - [Pod Pod ctest-pod-55570722] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-11-10 01:46:59,978 - INFO - wget check of of http://10.47.255.251 from ctest-pod-55570722 passed
2025-11-10 01:46:59,986 - INFO - Updating Network Policy ingress-on-service
2025-11-10 01:47:05,055 - DEBUG - [Pod ctest-pod-10957994] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:47:05,055 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:47:05,055 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:47:10,101 - DEBUG - [Pod ctest-pod-10957994] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:47:10,102 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:47:10,102 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:47:15,163 - DEBUG - [Pod ctest-pod-10957994] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:47:15,163 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:47:15,163 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:47:20,214 - DEBUG - [Pod ctest-pod-10957994] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:47:20,214 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:47:20,214 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:47:25,261 - DEBUG - [Pod ctest-pod-10957994] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:47:25,262 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:47:25,262 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:47:30,313 - DEBUG - [Pod ctest-pod-10957994] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:47:30,313 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:47:30,313 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:47:35,362 - DEBUG - [Pod ctest-pod-10957994] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:47:35,362 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:47:35,362 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:47:40,414 - DEBUG - [Pod ctest-pod-10957994] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:47:40,414 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:47:40,414 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:47:45,465 - DEBUG - [Pod ctest-pod-10957994] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:47:45,465 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:47:45,465 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:47:50,523 - DEBUG - [Pod ctest-pod-10957994] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:47:50,523 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:47:50,523 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
wget: download timed out
2025-11-10 01:47:50,523 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-72328124': 0, 'ctest-pod-73745361': 0}
2025-11-10 01:47:50,577 - DEBUG - [Pod ctest-pod-72844790] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: ctest-pod-72328124
Connecting to 10.103.9.198:80 (10.103.9.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-10 01:47:50,577 - DEBUG - [Pod Pod ctest-pod-72844790] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 passed
2025-11-10 01:47:50,577 - DEBUG - [Pod Pod ctest-pod-72844790] Cmd output: ctest-pod-72328124
Connecting to 10.103.9.198:80 (10.103.9.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-10 01:47:50,613 - DEBUG - [Pod ctest-pod-72844790] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: ctest-pod-72328124
Connecting to 10.103.9.198:80 (10.103.9.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-10 01:47:50,613 - DEBUG - [Pod Pod ctest-pod-72844790] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 passed
2025-11-10 01:47:50,613 - DEBUG - [Pod Pod ctest-pod-72844790] Cmd output: ctest-pod-72328124
Connecting to 10.103.9.198:80 (10.103.9.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-10 01:47:50,668 - DEBUG - [Pod ctest-pod-72844790] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: ctest-pod-72328124
Connecting to 10.103.9.198:80 (10.103.9.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-10 01:47:50,668 - DEBUG - [Pod Pod ctest-pod-72844790] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 passed
2025-11-10 01:47:50,668 - DEBUG - [Pod Pod ctest-pod-72844790] Cmd output: ctest-pod-72328124
Connecting to 10.103.9.198:80 (10.103.9.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-10 01:47:50,719 - DEBUG - [Pod ctest-pod-72844790] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: ctest-pod-72328124
Connecting to 10.103.9.198:80 (10.103.9.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-10 01:47:50,719 - DEBUG - [Pod Pod ctest-pod-72844790] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 passed
2025-11-10 01:47:50,720 - DEBUG - [Pod Pod ctest-pod-72844790] Cmd output: ctest-pod-72328124
Connecting to 10.103.9.198:80 (10.103.9.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-10 01:47:50,771 - DEBUG - [Pod ctest-pod-72844790] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: ctest-pod-72328124
Connecting to 10.103.9.198:80 (10.103.9.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-10 01:47:50,772 - DEBUG - [Pod Pod ctest-pod-72844790] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 passed
2025-11-10 01:47:50,772 - DEBUG - [Pod Pod ctest-pod-72844790] Cmd output: ctest-pod-72328124
Connecting to 10.103.9.198:80 (10.103.9.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-10 01:47:50,806 - DEBUG - [Pod ctest-pod-72844790] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: ctest-pod-73745361
Connecting to 10.103.9.198:80 (10.103.9.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-10 01:47:50,806 - DEBUG - [Pod Pod ctest-pod-72844790] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 passed
2025-11-10 01:47:50,806 - DEBUG - [Pod Pod ctest-pod-72844790] Cmd output: ctest-pod-73745361
Connecting to 10.103.9.198:80 (10.103.9.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-10 01:47:50,806 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-72328124': 5, 'ctest-pod-73745361': 1}
2025-11-10 01:47:50,859 - DEBUG - [Pod ctest-pod-20314763] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: ctest-pod-72328124
Connecting to 10.103.9.198:80 (10.103.9.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-10 01:47:50,859 - DEBUG - [Pod Pod ctest-pod-20314763] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 passed
2025-11-10 01:47:50,859 - DEBUG - [Pod Pod ctest-pod-20314763] Cmd output: ctest-pod-72328124
Connecting to 10.103.9.198:80 (10.103.9.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-11-10 01:47:50,915 - DEBUG - [Pod ctest-pod-20314763] Cmd: wget http://10.103.9.198:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-73745361
2025-11-10 01:47:50,915 - DEBUG - [Pod Pod ctest-pod-20314763] Cmd wget http://10.103.9.198:80/ -O - -T 5 -t 1 passed
2025-11-10 01:47:50,915 - DEBUG - [Pod Pod ctest-pod-20314763] Cmd output: Connecting to 10.103.9.198:80 (10.103.9.198:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-73745361
2025-11-10 01:47:50,915 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-72328124': 1, 'ctest-pod-73745361': 1}
2025-11-10 01:47:52,970 - DEBUG - [Pod ctest-pod-72844790] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.683 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.072 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.091 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.072/0.282/0.683 ms
2025-11-10 01:47:52,970 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-72844790 with expectation True passed
2025-11-10 01:47:55,023 - DEBUG - [Pod ctest-pod-10957994] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.049 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.086 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.096 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.086/0.410/1.049 ms
2025-11-10 01:47:55,023 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-10957994 with expectation True passed
2025-11-10 01:47:57,110 - DEBUG - [Pod ctest-pod-20314763] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.275 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.119 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.071/0.488/1.275 ms
2025-11-10 01:47:57,110 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-20314763 with expectation True passed
2025-11-10 01:47:57,165 - DEBUG - [Pod ctest-pod-72844790] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-11-10 01:47:57,165 - DEBUG - [Pod Pod ctest-pod-72844790] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-11-10 01:47:57,165 - DEBUG - [Pod Pod ctest-pod-72844790] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-11-10 01:47:57,165 - INFO - wget check of of http://10.47.255.251 from ctest-pod-72844790 passed
2025-11-10 01:47:57,217 - DEBUG - [Pod ctest-pod-72844790] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-11-10 01:47:57,217 - DEBUG - [Pod Pod ctest-pod-72844790] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-11-10 01:47:57,217 - DEBUG - [Pod Pod ctest-pod-72844790] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-11-10 01:47:57,217 - INFO - wget check of of http://10.47.255.250 from ctest-pod-72844790 passed
2025-11-10 01:48:02,274 - DEBUG - [Pod ctest-pod-10957994] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-11-10 01:48:02,274 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-11-10 01:48:02,275 - DEBUG - [Pod Pod ctest-pod-10957994] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-11-10 01:48:02,275 - INFO - wget check of of http://10.47.255.250 from ctest-pod-10957994 passed
2025-11-10 01:48:02,336 - DEBUG - [Pod ctest-pod-55570722] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-11-10 01:48:02,336 - DEBUG - [Pod Pod ctest-pod-55570722] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-11-10 01:48:02,336 - DEBUG - [Pod Pod ctest-pod-55570722] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-11-10 01:48:02,336 - INFO - wget check of of http://10.47.255.251 from ctest-pod-55570722 passed
2025-11-10 01:48:02,336 - INFO - Deleting Network Policy : ingress-on-service
2025-11-10 01:48:02,337 - INFO - Deleting service : ctest-nginx-svc-09560400
2025-11-10 01:48:02,551 - DEBUG - No XMPP flaps were noticed during the test
2025-11-10 01:48:02,551 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:14]
2025-11-10 01:48:02,552 - INFO - --------------------------------------------------------------------------------
2025-11-10 01:48:02,555 - INFO - Deleting pod ctest-new-default-11380348:ctest-pod-72328124
2025-11-10 01:48:02,556 - INFO - Deleting pod ctest-new-default-11380348:ctest-pod-73745361
2025-11-10 01:48:02,556 - INFO - Deleting pod ctest-non-default-50526433:ctest-pod-48742372
2025-11-10 01:48:02,557 - INFO - Deleting pod ctest-non-default-50526433:ctest-pod-07556299
2025-11-10 01:48:02,557 - INFO - Deleting pod ctest-new-default-11380348:ctest-pod-10957994
2025-11-10 01:48:02,558 - INFO - Deleting pod ctest-new-default-11380348:ctest-pod-72844790
2025-11-10 01:48:02,558 - INFO - Deleting pod ctest-non-default-50526433:ctest-pod-20314763
2025-11-10 01:48:02,558 - INFO - Deleting pod ctest-non-default-50526433:ctest-pod-55570722
2025-11-10 01:48:02,581 - WARNING - Pod uuid 0917fe48-e228-455b-8f15-7c72014959ea is still seen in agent 10.0.0.242 VM list
2025-11-10 01:48:02,733 - WARNING - Pod uuid 98abe18e-7667-4cfa-87d7-8a909b521f54 is still seen in agent 10.0.0.242 VM list
2025-11-10 01:48:02,735 - WARNING - Pod uuid 03ff3b55-736e-4499-be07-aeddfeb80294 is still seen in agent 10.0.0.242 VM list
2025-11-10 01:48:02,735 - WARNING - Pod uuid a0fe3fe5-1e4e-4972-8a00-9e97adf2d14c is still seen in agent 10.0.0.242 VM list
2025-11-10 01:48:02,735 - WARNING - Pod uuid 8c218b3b-20e0-445b-a19c-18f3a02b506f is still seen in agent 10.0.0.242 VM list
2025-11-10 01:48:02,736 - WARNING - Pod uuid 8bdda783-f547-4af5-a597-f379810c3842 is still seen in agent 10.0.0.242 VM list
2025-11-10 01:48:02,736 - WARNING - Pod uuid e4ad14f7-a848-4323-9166-7b6add6e0ff8 is still seen in agent 10.0.0.242 VM list
2025-11-10 01:48:02,736 - WARNING - Pod uuid c183afc1-dc62-46e2-b74f-45f5b2ae0241 is still seen in agent 10.0.0.242 VM list
2025-11-10 01:48:07,588 - DEBUG - Pod 0917fe48-e228-455b-8f15-7c72014959ea is not in agent 10.0.0.242 VM list
2025-11-10 01:48:07,594 - DEBUG - VMI cb53c6e8-bdd6-11f0-bb93-fa163ed32009 is removed from agent 10.0.0.242
2025-11-10 01:48:07,594 - INFO - Verified that pod ctest-pod-72328124 is removed in agent
2025-11-10 01:48:07,756 - WARNING - Pod uuid 98abe18e-7667-4cfa-87d7-8a909b521f54 is still seen in agent 10.0.0.242 VM list
2025-11-10 01:48:07,757 - WARNING - Pod uuid 03ff3b55-736e-4499-be07-aeddfeb80294 is still seen in agent 10.0.0.242 VM list
2025-11-10 01:48:07,757 - DEBUG - Pod a0fe3fe5-1e4e-4972-8a00-9e97adf2d14c is not in agent 10.0.0.242 VM list
2025-11-10 01:48:07,760 - WARNING - Pod uuid c183afc1-dc62-46e2-b74f-45f5b2ae0241 is still seen in agent 10.0.0.242 VM list
2025-11-10 01:48:07,760 - DEBUG - Pod 8bdda783-f547-4af5-a597-f379810c3842 is not in agent 10.0.0.242 VM list
2025-11-10 01:48:07,761 - WARNING - Pod uuid 8c218b3b-20e0-445b-a19c-18f3a02b506f is still seen in agent 10.0.0.242 VM list
2025-11-10 01:48:07,761 - DEBUG - Pod e4ad14f7-a848-4323-9166-7b6add6e0ff8 is not in agent 10.0.0.242 VM list
2025-11-10 01:48:07,769 - DEBUG - VMI cc5a4788-bdd6-11f0-bb93-fa163ed32009 is removed from agent 10.0.0.242
2025-11-10 01:48:07,769 - INFO - Verified that pod ctest-pod-48742372 is removed in agent
2025-11-10 01:48:07,770 - DEBUG - VMI ccc8c21c-bdd6-11f0-bb93-fa163ed32009 is removed from agent 10.0.0.242
2025-11-10 01:48:07,770 - INFO - Verified that pod ctest-pod-07556299 is removed in agent
2025-11-10 01:48:07,771 - DEBUG - VMI cbc643c6-bdd6-11f0-bb93-fa163ed32009 is removed from agent 10.0.0.242
2025-11-10 01:48:07,771 - INFO - Verified that pod ctest-pod-73745361 is removed in agent
2025-11-10 01:48:12,773 - WARNING - Pod uuid 98abe18e-7667-4cfa-87d7-8a909b521f54 is still seen in agent 10.0.0.242 VM list
2025-11-10 01:48:12,773 - WARNING - Pod uuid 03ff3b55-736e-4499-be07-aeddfeb80294 is still seen in agent 10.0.0.242 VM list
2025-11-10 01:48:12,774 - WARNING - Pod uuid 8c218b3b-20e0-445b-a19c-18f3a02b506f is still seen in agent 10.0.0.242 VM list
2025-11-10 01:48:12,775 - WARNING - Pod uuid c183afc1-dc62-46e2-b74f-45f5b2ae0241 is still seen in agent 10.0.0.242 VM list
2025-11-10 01:48:17,789 - WARNING - Pod uuid c183afc1-dc62-46e2-b74f-45f5b2ae0241 is still seen in agent 10.0.0.242 VM list
2025-11-10 01:48:17,789 - WARNING - Pod uuid 98abe18e-7667-4cfa-87d7-8a909b521f54 is still seen in agent 10.0.0.242 VM list
2025-11-10 01:48:17,790 - WARNING - Pod uuid 03ff3b55-736e-4499-be07-aeddfeb80294 is still seen in agent 10.0.0.242 VM list
2025-11-10 01:48:17,790 - WARNING - Pod uuid 8c218b3b-20e0-445b-a19c-18f3a02b506f is still seen in agent 10.0.0.242 VM list
2025-11-10 01:48:22,807 - WARNING - Pod uuid c183afc1-dc62-46e2-b74f-45f5b2ae0241 is still seen in agent 10.0.0.242 VM list
2025-11-10 01:48:22,808 - WARNING - Pod uuid 03ff3b55-736e-4499-be07-aeddfeb80294 is still seen in agent 10.0.0.242 VM list
2025-11-10 01:48:22,809 - WARNING - Pod uuid 8c218b3b-20e0-445b-a19c-18f3a02b506f is still seen in agent 10.0.0.242 VM list
2025-11-10 01:48:22,809 - WARNING - Pod uuid 98abe18e-7667-4cfa-87d7-8a909b521f54 is still seen in agent 10.0.0.242 VM list
2025-11-10 01:48:27,824 - WARNING - Pod uuid 03ff3b55-736e-4499-be07-aeddfeb80294 is still seen in agent 10.0.0.242 VM list
2025-11-10 01:48:27,826 - WARNING - Pod uuid 8c218b3b-20e0-445b-a19c-18f3a02b506f is still seen in agent 10.0.0.242 VM list
2025-11-10 01:48:27,826 - WARNING - Pod uuid 98abe18e-7667-4cfa-87d7-8a909b521f54 is still seen in agent 10.0.0.242 VM list
2025-11-10 01:48:27,826 - WARNING - Pod uuid c183afc1-dc62-46e2-b74f-45f5b2ae0241 is still seen in agent 10.0.0.242 VM list
2025-11-10 01:48:32,887 - WARNING - Pod uuid 98abe18e-7667-4cfa-87d7-8a909b521f54 is still seen in agent 10.0.0.242 VM list
2025-11-10 01:48:32,887 - WARNING - Pod uuid 8c218b3b-20e0-445b-a19c-18f3a02b506f is still seen in agent 10.0.0.242 VM list
2025-11-10 01:48:32,888 - WARNING - Pod uuid 03ff3b55-736e-4499-be07-aeddfeb80294 is still seen in agent 10.0.0.242 VM list
2025-11-10 01:48:32,889 - WARNING - Pod uuid c183afc1-dc62-46e2-b74f-45f5b2ae0241 is still seen in agent 10.0.0.242 VM list
2025-11-10 01:48:37,902 - DEBUG - Pod 8c218b3b-20e0-445b-a19c-18f3a02b506f is not in agent 10.0.0.242 VM list
2025-11-10 01:48:37,903 - DEBUG - Pod 98abe18e-7667-4cfa-87d7-8a909b521f54 is not in agent 10.0.0.242 VM list
2025-11-10 01:48:37,906 - DEBUG - Pod c183afc1-dc62-46e2-b74f-45f5b2ae0241 is not in agent 10.0.0.242 VM list
2025-11-10 01:48:37,907 - DEBUG - Pod 03ff3b55-736e-4499-be07-aeddfeb80294 is not in agent 10.0.0.242 VM list
2025-11-10 01:48:37,918 - DEBUG - VMI ce9c3f7e-bdd6-11f0-bb93-fa163ed32009 is removed from agent 10.0.0.242
2025-11-10 01:48:37,918 - INFO - Verified that pod ctest-pod-55570722 is removed in agent
2025-11-10 01:48:37,919 - DEBUG - VMI cd58bdae-bdd6-11f0-bb93-fa163ed32009 is removed from agent 10.0.0.242
2025-11-10 01:48:37,919 - INFO - Verified that pod ctest-pod-10957994 is removed in agent
2025-11-10 01:48:37,919 - DEBUG - VMI cdcd6816-bdd6-11f0-bb93-fa163ed32009 is removed from agent 10.0.0.242
2025-11-10 01:48:37,919 - INFO - Verified that pod ctest-pod-72844790 is removed in agent
2025-11-10 01:48:37,920 - DEBUG - VMI ce372558-bdd6-11f0-bb93-fa163ed32009 is removed from agent 10.0.0.242
2025-11-10 01:48:37,920 - INFO - Verified that pod ctest-pod-20314763 is removed in agent
2025-11-10 01:48:37,921 - INFO - Deleting namespace ctest-non-default-50526433
2025-11-10 01:48:37,939 - DEBUG - Namespace ctest-non-default-50526433 still in k8s
2025-11-10 01:48:39,946 - DEBUG - Namespace ctest-non-default-50526433 still in k8s
2025-11-10 01:48:41,951 - DEBUG - Namespace ctest-non-default-50526433 still in k8s
2025-11-10 01:48:43,956 - DEBUG - Namespace ctest-non-default-50526433 is not in k8s
2025-11-10 01:48:43,957 - DEBUG - No need to check project deletion in contrail-api
2025-11-10 01:48:43,957 - INFO - Deleting namespace ctest-new-default-11380348
2025-11-10 01:48:43,968 - DEBUG - Namespace ctest-new-default-11380348 still in k8s
2025-11-10 01:48:45,973 - DEBUG - Namespace ctest-new-default-11380348 still in k8s
2025-11-10 01:48:47,979 - DEBUG - Namespace ctest-new-default-11380348 still in k8s
2025-11-10 01:48:49,983 - DEBUG - Namespace ctest-new-default-11380348 is not in k8s
2025-11-10 01:48:49,983 - DEBUG - No need to check project deletion in contrail-api