2025-08-04 01:58:31,194 - INFO - Using existing project ['default-domain', 'k8s-default'](d54b2aab-797f-430b-9de8-1563dea8094f)
2025-08-04 01:58:31,221 - DEBUG - Namespace ctest-new-default-47247881 not present
2025-08-04 01:58:31,251 - INFO - Created namespace ctest-new-default-47247881
2025-08-04 01:58:34,255 - DEBUG - Namespace ctest-non-default-46946419 not present
2025-08-04 01:58:34,261 - INFO - Created namespace ctest-non-default-46946419
2025-08-04 01:58:37,276 - DEBUG - Pod ctest-pod-27716989 not present
2025-08-04 01:58:37,276 - INFO - Creating Pod ctest-pod-27716989
2025-08-04 01:58:37,298 - DEBUG - Pod : ctest-pod-27716989 UUID is 71761a23-899a-4b36-aaef-8b41f697eeaa
2025-08-04 01:58:37,304 - DEBUG - Pod ctest-pod-97524553 not present
2025-08-04 01:58:37,304 - INFO - Creating Pod ctest-pod-97524553
2025-08-04 01:58:37,326 - DEBUG - Pod : ctest-pod-97524553 UUID is 7d2fdbdf-ce6f-4dbd-976f-da881e41f002
2025-08-04 01:58:37,331 - DEBUG - Pod ctest-pod-80378023 not present
2025-08-04 01:58:37,331 - INFO - Creating Pod ctest-pod-80378023
2025-08-04 01:58:37,354 - DEBUG - Pod : ctest-pod-80378023 UUID is 2731dfdc-7577-43f1-acb6-7106ba01166d
2025-08-04 01:58:37,358 - DEBUG - Pod ctest-pod-85627617 not present
2025-08-04 01:58:37,359 - INFO - Creating Pod ctest-pod-85627617
2025-08-04 01:58:37,379 - DEBUG - Pod : ctest-pod-85627617 UUID is ec4038bd-6d5e-49ee-8fa0-bcf36d60cf53
2025-08-04 01:58:37,382 - DEBUG - Pod ctest-pod-27658580 not present
2025-08-04 01:58:37,383 - INFO - Creating Pod ctest-pod-27658580
2025-08-04 01:58:37,401 - DEBUG - Pod : ctest-pod-27658580 UUID is f5e88aee-be67-4f2a-8c0e-3cb90020cf39
2025-08-04 01:58:37,410 - DEBUG - Pod ctest-pod-48926250 not present
2025-08-04 01:58:37,411 - INFO - Creating Pod ctest-pod-48926250
2025-08-04 01:58:37,430 - DEBUG - Pod : ctest-pod-48926250 UUID is eb870e18-c757-40e5-aa9c-f62458db14c1
2025-08-04 01:58:37,438 - DEBUG - Pod ctest-pod-90370795 not present
2025-08-04 01:58:37,438 - INFO - Creating Pod ctest-pod-90370795
2025-08-04 01:58:37,462 - DEBUG - Pod : ctest-pod-90370795 UUID is b8ee7e2b-4bc9-41ce-b180-4d95306bee0e
2025-08-04 01:58:37,467 - DEBUG - Pod ctest-pod-58419354 not present
2025-08-04 01:58:37,468 - INFO - Creating Pod ctest-pod-58419354
2025-08-04 01:58:37,485 - DEBUG - Pod : ctest-pod-58419354 UUID is 071ede4e-4456-489e-92a0-e774b826a1cf
2025-08-04 01:58:37,759 - INFO - Project default-domain:k8s-ctest-new-default-47247881 for Namespace ctest-new-default-47247881 is seen in contrail-api
2025-08-04 01:58:37,759 - DEBUG - Project uuid in Contrail is bae32bc5-5132-4a16-a777-90b245ec1684
2025-08-04 01:58:37,932 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NamespaceDatabaseList?namespace_uuid=161a17d1-35e4-4249-905d-3b23bf652c06
2025-08-04 01:58:37,936 - INFO - Namespace ctest-new-default-47247881 with uuid 161a17d1-35e4-4249-905d-3b23bf652c06 found in kube manager
2025-08-04 01:58:37,937 - INFO - Namespace ctest-new-default-47247881 verification passed
2025-08-04 01:58:38,188 - INFO - Project default-domain:k8s-ctest-non-default-46946419 for Namespace ctest-non-default-46946419 is seen in contrail-api
2025-08-04 01:58:38,189 - DEBUG - Project uuid in Contrail is 2b86fad2-6350-468c-87e1-2b5f0f804522
2025-08-04 01:58:38,189 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NamespaceDatabaseList?namespace_uuid=10824acf-0fb9-4c4e-a609-1c54175357af
2025-08-04 01:58:38,194 - INFO - Namespace ctest-non-default-46946419 with uuid 10824acf-0fb9-4c4e-a609-1c54175357af found in kube manager
2025-08-04 01:58:38,195 - INFO - Namespace ctest-non-default-46946419 verification passed
2025-08-04 01:58:38,203 - DEBUG - Pod ctest-pod-27716989 not in running state.Currently in Pending
2025-08-04 01:58:43,210 - DEBUG - Pod ctest-pod-27716989 not in running state.Currently in Pending
2025-08-04 01:58:48,217 - INFO - Pod ctest-pod-27716989 is in running state.Got IP 10.47.255.250
2025-08-04 01:58:48,272 - DEBUG - Pod ctest-pod-27716989 has vmi 8b091450-70d6-11f0-a417-0242248b7446
2025-08-04 01:58:48,272 - INFO - Verified pod ctest-pod-27716989 in contrail-api
2025-08-04 01:58:48,282 - DEBUG - VMI 8b091450-70d6-11f0-a417-0242248b7446 is active in agent 10.0.0.48
2025-08-04 01:58:48,282 - INFO - Verified Pod ctest-pod-27716989 in agent 10.0.0.48
2025-08-04 01:58:48,282 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=71761a23-899a-4b36-aaef-8b41f697eeaa
2025-08-04 01:58:48,296 - INFO - Pod ctest-pod-27716989 with uuid 71761a23-899a-4b36-aaef-8b41f697eeaa found in kube manager
2025-08-04 01:58:48,296 - INFO - Pod ctest-pod-27716989 verification passed
2025-08-04 01:58:48,303 - DEBUG - Pod ctest-pod-97524553 not in running state.Currently in Pending
2025-08-04 01:58:53,309 - INFO - Pod ctest-pod-97524553 is in running state.Got IP 10.47.255.249
2025-08-04 01:58:53,363 - DEBUG - Pod ctest-pod-97524553 has vmi 8bbd0fe6-70d6-11f0-a417-0242248b7446
2025-08-04 01:58:53,364 - INFO - Verified pod ctest-pod-97524553 in contrail-api
2025-08-04 01:58:53,375 - DEBUG - VMI 8bbd0fe6-70d6-11f0-a417-0242248b7446 is active in agent 10.0.0.48
2025-08-04 01:58:53,376 - INFO - Verified Pod ctest-pod-97524553 in agent 10.0.0.48
2025-08-04 01:58:53,376 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=7d2fdbdf-ce6f-4dbd-976f-da881e41f002
2025-08-04 01:58:53,380 - INFO - Pod ctest-pod-97524553 with uuid 7d2fdbdf-ce6f-4dbd-976f-da881e41f002 found in kube manager
2025-08-04 01:58:53,380 - INFO - Pod ctest-pod-97524553 verification passed
2025-08-04 01:58:53,386 - DEBUG - Pod ctest-pod-80378023 not in running state.Currently in Pending
2025-08-04 01:58:58,392 - INFO - Pod ctest-pod-80378023 is in running state.Got IP 10.47.255.248
2025-08-04 01:58:58,453 - DEBUG - Pod ctest-pod-80378023 has vmi 8cb91bba-70d6-11f0-a417-0242248b7446
2025-08-04 01:58:58,453 - INFO - Verified pod ctest-pod-80378023 in contrail-api
2025-08-04 01:58:58,466 - DEBUG - VMI 8cb91bba-70d6-11f0-a417-0242248b7446 is active in agent 10.0.0.48
2025-08-04 01:58:58,466 - INFO - Verified Pod ctest-pod-80378023 in agent 10.0.0.48
2025-08-04 01:58:58,466 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=2731dfdc-7577-43f1-acb6-7106ba01166d
2025-08-04 01:58:58,471 - INFO - Pod ctest-pod-80378023 with uuid 2731dfdc-7577-43f1-acb6-7106ba01166d found in kube manager
2025-08-04 01:58:58,471 - INFO - Pod ctest-pod-80378023 verification passed
2025-08-04 01:58:58,476 - INFO - Pod ctest-pod-85627617 is in running state.Got IP 10.47.255.247
2025-08-04 01:58:58,570 - DEBUG - Pod ctest-pod-85627617 has vmi 8d7b7246-70d6-11f0-a417-0242248b7446
2025-08-04 01:58:58,570 - INFO - Verified pod ctest-pod-85627617 in contrail-api
2025-08-04 01:58:58,581 - DEBUG - VMI 8d7b7246-70d6-11f0-a417-0242248b7446 is active in agent 10.0.0.48
2025-08-04 01:58:58,582 - INFO - Verified Pod ctest-pod-85627617 in agent 10.0.0.48
2025-08-04 01:58:58,582 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=ec4038bd-6d5e-49ee-8fa0-bcf36d60cf53
2025-08-04 01:58:58,587 - INFO - Pod ctest-pod-85627617 with uuid ec4038bd-6d5e-49ee-8fa0-bcf36d60cf53 found in kube manager
2025-08-04 01:58:58,587 - INFO - Pod ctest-pod-85627617 verification passed
2025-08-04 01:58:58,594 - INFO - Pod ctest-pod-27658580 is in running state.Got IP 10.47.255.246
2025-08-04 01:58:58,689 - DEBUG - Pod ctest-pod-27658580 has vmi 8e64f4c0-70d6-11f0-a417-0242248b7446
2025-08-04 01:58:58,689 - INFO - Verified pod ctest-pod-27658580 in contrail-api
2025-08-04 01:58:58,701 - DEBUG - VMI 8e64f4c0-70d6-11f0-a417-0242248b7446 is active in agent 10.0.0.48
2025-08-04 01:58:58,701 - INFO - Verified Pod ctest-pod-27658580 in agent 10.0.0.48
2025-08-04 01:58:58,701 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=f5e88aee-be67-4f2a-8c0e-3cb90020cf39
2025-08-04 01:58:58,705 - INFO - Pod ctest-pod-27658580 with uuid f5e88aee-be67-4f2a-8c0e-3cb90020cf39 found in kube manager
2025-08-04 01:58:58,705 - INFO - Pod ctest-pod-27658580 verification passed
2025-08-04 01:58:58,711 - INFO - Pod ctest-pod-90370795 is in running state.Got IP 10.47.255.244
2025-08-04 01:58:58,805 - DEBUG - Pod ctest-pod-90370795 has vmi 8fee201e-70d6-11f0-a417-0242248b7446
2025-08-04 01:58:58,805 - INFO - Verified pod ctest-pod-90370795 in contrail-api
2025-08-04 01:58:58,816 - DEBUG - VMI 8fee201e-70d6-11f0-a417-0242248b7446 is active in agent 10.0.0.48
2025-08-04 01:58:58,816 - INFO - Verified Pod ctest-pod-90370795 in agent 10.0.0.48
2025-08-04 01:58:58,816 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=b8ee7e2b-4bc9-41ce-b180-4d95306bee0e
2025-08-04 01:58:58,820 - INFO - Pod ctest-pod-90370795 with uuid b8ee7e2b-4bc9-41ce-b180-4d95306bee0e found in kube manager
2025-08-04 01:58:58,820 - INFO - Pod ctest-pod-90370795 verification passed
2025-08-04 01:58:58,825 - INFO - Pod ctest-pod-48926250 is in running state.Got IP 10.47.255.245
2025-08-04 01:58:58,918 - DEBUG - Pod ctest-pod-48926250 has vmi 8f276cb2-70d6-11f0-a417-0242248b7446
2025-08-04 01:58:58,918 - INFO - Verified pod ctest-pod-48926250 in contrail-api
2025-08-04 01:58:58,929 - DEBUG - VMI 8f276cb2-70d6-11f0-a417-0242248b7446 is active in agent 10.0.0.48
2025-08-04 01:58:58,929 - INFO - Verified Pod ctest-pod-48926250 in agent 10.0.0.48
2025-08-04 01:58:58,929 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=eb870e18-c757-40e5-aa9c-f62458db14c1
2025-08-04 01:58:58,933 - INFO - Pod ctest-pod-48926250 with uuid eb870e18-c757-40e5-aa9c-f62458db14c1 found in kube manager
2025-08-04 01:58:58,933 - INFO - Pod ctest-pod-48926250 verification passed
2025-08-04 01:58:58,938 - DEBUG - Pod ctest-pod-58419354 not in running state.Currently in Pending
2025-08-04 01:59:03,945 - INFO - Pod ctest-pod-58419354 is in running state.Got IP 10.47.255.243
2025-08-04 01:59:04,002 - DEBUG - Pod ctest-pod-58419354 has vmi 90ba80c8-70d6-11f0-a417-0242248b7446
2025-08-04 01:59:04,002 - INFO - Verified pod ctest-pod-58419354 in contrail-api
2025-08-04 01:59:04,014 - DEBUG - VMI 90ba80c8-70d6-11f0-a417-0242248b7446 is active in agent 10.0.0.48
2025-08-04 01:59:04,014 - INFO - Verified Pod ctest-pod-58419354 in agent 10.0.0.48
2025-08-04 01:59:04,014 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=071ede4e-4456-489e-92a0-e774b826a1cf
2025-08-04 01:59:04,018 - INFO - Pod ctest-pod-58419354 with uuid 071ede4e-4456-489e-92a0-e774b826a1cf found in kube manager
2025-08-04 01:59:04,018 - INFO - Pod ctest-pod-58419354 verification passed
2025-08-04 01:59:04,019 - INFO - ================================================================================
2025-08-04 01:59:04,019 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-08-04 01:59:04,019 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-08-04 01:59:04,272 - DEBUG - Nothing to compare xmpp stats {'10.0.0.48': {'10.0.0.48': '2'}} with
2025-08-04 01:59:04,272 - INFO - Initial checks done. Running the testcase now
2025-08-04 01:59:04,272 - INFO -
2025-08-04 01:59:04,343 - DEBUG - [Pod ctest-pod-27716989] Cmd: echo ctest-pod-27716989 > /usr/share/nginx/html/index.html, Output:
2025-08-04 01:59:04,409 - DEBUG - [Pod ctest-pod-97524553] Cmd: echo ctest-pod-97524553 > /usr/share/nginx/html/index.html, Output:
2025-08-04 01:59:04,476 - DEBUG - [Pod ctest-pod-80378023] Cmd: echo ctest-pod-80378023 > /usr/share/nginx/html/index.html, Output:
2025-08-04 01:59:04,552 - DEBUG - [Pod ctest-pod-85627617] Cmd: echo ctest-pod-85627617 > /usr/share/nginx/html/index.html, Output:
2025-08-04 01:59:04,555 - DEBUG - Service ctest-nginx-svc-68922114 not present
2025-08-04 01:59:04,556 - INFO - Creating service ctest-nginx-svc-68922114
2025-08-04 01:59:04,572 - INFO - Created Service ctest-nginx-svc-68922114
2025-08-04 01:59:04,579 - WARNING - Service UUID 468f9478-74b1-4e99-8f19-f7bbda518276 not yet found in contrail-api
2025-08-04 01:59:05,605 - INFO - Validated that Service ctest-nginx-svc-68922114 is seen in contrail-api
2025-08-04 01:59:05,605 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_LoadbalancerDatabaseList?x=468f9478-74b1-4e99-8f19-f7bbda518276
2025-08-04 01:59:05,614 - INFO - Service ctest-nginx-svc-68922114 with uuid 468f9478-74b1-4e99-8f19-f7bbda518276 found in kube manager
2025-08-04 01:59:05,614 - INFO - Service ctest-nginx-svc-68922114 verification passed
2025-08-04 01:59:06,737 - DEBUG - [Pod ctest-pod-27658580] Cmd: wget http://10.101.26.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-97524553
2025-08-04 01:59:06,737 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd wget http://10.101.26.78:80/ -O - -T 5 -t 1 passed
2025-08-04 01:59:06,737 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-97524553
2025-08-04 01:59:06,874 - DEBUG - [Pod ctest-pod-27658580] Cmd: wget http://10.101.26.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-97524553
2025-08-04 01:59:06,875 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd wget http://10.101.26.78:80/ -O - -T 5 -t 1 passed
2025-08-04 01:59:06,875 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-97524553
2025-08-04 01:59:06,972 - DEBUG - [Pod ctest-pod-27658580] Cmd: wget http://10.101.26.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
writing to stdout
ctest-pod-97524553
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-08-04 01:59:06,972 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd wget http://10.101.26.78:80/ -O - -T 5 -t 1 passed
2025-08-04 01:59:06,972 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
writing to stdout
ctest-pod-97524553
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-08-04 01:59:07,049 - DEBUG - [Pod ctest-pod-27658580] Cmd: wget http://10.101.26.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
ctest-pod-97524553
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-08-04 01:59:07,049 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd wget http://10.101.26.78:80/ -O - -T 5 -t 1 passed
2025-08-04 01:59:07,049 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
ctest-pod-97524553
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-08-04 01:59:07,139 - DEBUG - [Pod ctest-pod-27658580] Cmd: wget http://10.101.26.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
ctest-pod-27716989
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-08-04 01:59:07,139 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd wget http://10.101.26.78:80/ -O - -T 5 -t 1 passed
2025-08-04 01:59:07,139 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
ctest-pod-27716989
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-08-04 01:59:07,139 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-27716989': 1, 'ctest-pod-97524553': 4}
2025-08-04 01:59:07,209 - DEBUG - [Pod ctest-pod-90370795] Cmd: wget http://10.101.26.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
ctest-pod-27716989
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-08-04 01:59:07,209 - DEBUG - [Pod Pod ctest-pod-90370795] Cmd wget http://10.101.26.78:80/ -O - -T 5 -t 1 passed
2025-08-04 01:59:07,209 - DEBUG - [Pod Pod ctest-pod-90370795] Cmd output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
ctest-pod-27716989
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-08-04 01:59:07,287 - DEBUG - [Pod ctest-pod-90370795] Cmd: wget http://10.101.26.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
writing to stdout
- 100% |********************************| 19ctest-pod-97524553
0:00:00 ETA
written to stdout
2025-08-04 01:59:07,287 - DEBUG - [Pod Pod ctest-pod-90370795] Cmd wget http://10.101.26.78:80/ -O - -T 5 -t 1 passed
2025-08-04 01:59:07,287 - DEBUG - [Pod Pod ctest-pod-90370795] Cmd output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
writing to stdout
- 100% |********************************| 19ctest-pod-97524553
0:00:00 ETA
written to stdout
2025-08-04 01:59:07,287 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-27716989': 1, 'ctest-pod-97524553': 1}
2025-08-04 01:59:07,291 - DEBUG - Network policy ingress-on-service not present
2025-08-04 01:59:07,292 - INFO - Creating Network Policy ingress-on-service
2025-08-04 01:59:07,303 - INFO - Network policy found in k8s
2025-08-04 01:59:07,303 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=461be913-ed2b-44dc-9598-a88a66a46a32
2025-08-04 01:59:07,309 - INFO - Network Policy ingress-on-service with uuid 461be913-ed2b-44dc-9598-a88a66a46a32 found in kube manager
2025-08-04 01:59:07,335 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-08-04 01:59:07,335 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-08-04 01:59:07,335 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=461be913-ed2b-44dc-9598-a88a66a46a32
2025-08-04 01:59:07,361 - WARNING - Network policy with name ingress-on-service not found in agent
2025-08-04 01:59:09,362 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=461be913-ed2b-44dc-9598-a88a66a46a32
2025-08-04 01:59:09,388 - WARNING - Network policy with name ingress-on-service not found in agent
2025-08-04 01:59:11,389 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=461be913-ed2b-44dc-9598-a88a66a46a32
2025-08-04 01:59:11,418 - INFO - Network policy with name ingress-on-service found in agent
2025-08-04 01:59:11,418 - INFO - Network Policy ingress-on-service verification passed
2025-08-04 01:59:16,486 - DEBUG - [Pod ctest-pod-27658580] Cmd: wget http://10.101.26.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 01:59:16,486 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd wget http://10.101.26.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 01:59:16,486 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 01:59:21,551 - DEBUG - [Pod ctest-pod-27658580] Cmd: wget http://10.101.26.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 01:59:21,551 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd wget http://10.101.26.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 01:59:21,551 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 01:59:26,618 - DEBUG - [Pod ctest-pod-27658580] Cmd: wget http://10.101.26.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 01:59:26,618 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd wget http://10.101.26.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 01:59:26,618 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 01:59:31,687 - DEBUG - [Pod ctest-pod-27658580] Cmd: wget http://10.101.26.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 01:59:31,687 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd wget http://10.101.26.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 01:59:31,687 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 01:59:36,769 - DEBUG - [Pod ctest-pod-27658580] Cmd: wget http://10.101.26.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 01:59:36,769 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd wget http://10.101.26.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 01:59:36,769 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 01:59:41,835 - DEBUG - [Pod ctest-pod-27658580] Cmd: wget http://10.101.26.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 01:59:41,835 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd wget http://10.101.26.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 01:59:41,835 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 01:59:46,923 - DEBUG - [Pod ctest-pod-27658580] Cmd: wget http://10.101.26.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 01:59:46,924 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd wget http://10.101.26.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 01:59:46,924 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 01:59:51,985 - DEBUG - [Pod ctest-pod-27658580] Cmd: wget http://10.101.26.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 01:59:51,985 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd wget http://10.101.26.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 01:59:51,985 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 01:59:57,068 - DEBUG - [Pod ctest-pod-27658580] Cmd: wget http://10.101.26.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 01:59:57,068 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd wget http://10.101.26.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 01:59:57,068 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:00:02,137 - DEBUG - [Pod ctest-pod-27658580] Cmd: wget http://10.101.26.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:00:02,138 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd wget http://10.101.26.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:00:02,138 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:00:02,138 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-27716989': 0, 'ctest-pod-97524553': 0}
2025-08-04 02:00:02,205 - DEBUG - [Pod ctest-pod-48926250] Cmd: wget http://10.101.26.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-27716989
2025-08-04 02:00:02,206 - DEBUG - [Pod Pod ctest-pod-48926250] Cmd wget http://10.101.26.78:80/ -O - -T 5 -t 1 passed
2025-08-04 02:00:02,206 - DEBUG - [Pod Pod ctest-pod-48926250] Cmd output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-27716989
2025-08-04 02:00:02,280 - DEBUG - [Pod ctest-pod-48926250] Cmd: wget http://10.101.26.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
ctest-pod-97524553
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-08-04 02:00:02,281 - DEBUG - [Pod Pod ctest-pod-48926250] Cmd wget http://10.101.26.78:80/ -O - -T 5 -t 1 passed
2025-08-04 02:00:02,281 - DEBUG - [Pod Pod ctest-pod-48926250] Cmd output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
ctest-pod-97524553
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-08-04 02:00:02,281 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-27716989': 1, 'ctest-pod-97524553': 1}
2025-08-04 02:00:07,349 - DEBUG - [Pod ctest-pod-90370795] Cmd: wget http://10.101.26.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:00:07,349 - DEBUG - [Pod Pod ctest-pod-90370795] Cmd wget http://10.101.26.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:00:07,349 - DEBUG - [Pod Pod ctest-pod-90370795] Cmd output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:00:12,419 - DEBUG - [Pod ctest-pod-90370795] Cmd: wget http://10.101.26.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:00:12,419 - DEBUG - [Pod Pod ctest-pod-90370795] Cmd wget http://10.101.26.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:00:12,419 - DEBUG - [Pod Pod ctest-pod-90370795] Cmd output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:00:17,485 - DEBUG - [Pod ctest-pod-90370795] Cmd: wget http://10.101.26.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:00:17,486 - DEBUG - [Pod Pod ctest-pod-90370795] Cmd wget http://10.101.26.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:00:17,486 - DEBUG - [Pod Pod ctest-pod-90370795] Cmd output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:00:22,598 - DEBUG - [Pod ctest-pod-90370795] Cmd: wget http://10.101.26.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:00:22,598 - DEBUG - [Pod Pod ctest-pod-90370795] Cmd wget http://10.101.26.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:00:22,598 - DEBUG - [Pod Pod ctest-pod-90370795] Cmd output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:00:27,663 - DEBUG - [Pod ctest-pod-90370795] Cmd: wget http://10.101.26.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:00:27,663 - DEBUG - [Pod Pod ctest-pod-90370795] Cmd wget http://10.101.26.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:00:27,663 - DEBUG - [Pod Pod ctest-pod-90370795] Cmd output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:00:32,742 - DEBUG - [Pod ctest-pod-90370795] Cmd: wget http://10.101.26.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:00:32,743 - DEBUG - [Pod Pod ctest-pod-90370795] Cmd wget http://10.101.26.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:00:32,743 - DEBUG - [Pod Pod ctest-pod-90370795] Cmd output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:00:37,816 - DEBUG - [Pod ctest-pod-90370795] Cmd: wget http://10.101.26.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:00:37,816 - DEBUG - [Pod Pod ctest-pod-90370795] Cmd wget http://10.101.26.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:00:37,816 - DEBUG - [Pod Pod ctest-pod-90370795] Cmd output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:00:42,915 - DEBUG - [Pod ctest-pod-90370795] Cmd: wget http://10.101.26.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:00:42,916 - DEBUG - [Pod Pod ctest-pod-90370795] Cmd wget http://10.101.26.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:00:42,916 - DEBUG - [Pod Pod ctest-pod-90370795] Cmd output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:00:47,998 - DEBUG - [Pod ctest-pod-90370795] Cmd: wget http://10.101.26.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:00:47,998 - DEBUG - [Pod Pod ctest-pod-90370795] Cmd wget http://10.101.26.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:00:47,998 - DEBUG - [Pod Pod ctest-pod-90370795] Cmd output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:00:53,060 - DEBUG - [Pod ctest-pod-90370795] Cmd: wget http://10.101.26.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:00:53,060 - DEBUG - [Pod Pod ctest-pod-90370795] Cmd wget http://10.101.26.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:00:53,060 - DEBUG - [Pod Pod ctest-pod-90370795] Cmd output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:00:53,060 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-27716989': 0, 'ctest-pod-97524553': 0}
2025-08-04 02:00:55,122 - DEBUG - [Pod ctest-pod-48926250] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=2.608 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.073 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.081 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.073/0.920/2.608 ms
2025-08-04 02:00:55,122 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-48926250 with expectation True passed
2025-08-04 02:00:57,188 - DEBUG - [Pod ctest-pod-27658580] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes
64 bytes from 10.47.255.245: seq=0 ttl=63 time=1.760 ms
64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.072 ms
64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.077 ms
--- 10.47.255.245 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.072/0.636/1.760 ms
2025-08-04 02:00:57,189 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-27658580 with expectation True passed
2025-08-04 02:00:59,254 - DEBUG - [Pod ctest-pod-90370795] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes
64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.826 ms
64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.087 ms
64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.070 ms
--- 10.47.255.245 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.070/0.327/0.826 ms
2025-08-04 02:00:59,254 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-90370795 with expectation True passed
2025-08-04 02:00:59,319 - DEBUG - [Pod ctest-pod-48926250] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-08-04 02:00:59,319 - DEBUG - [Pod Pod ctest-pod-48926250] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-08-04 02:00:59,319 - DEBUG - [Pod Pod ctest-pod-48926250] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-08-04 02:00:59,319 - INFO - wget check of of http://10.47.255.250 from ctest-pod-48926250 passed
2025-08-04 02:00:59,386 - DEBUG - [Pod ctest-pod-48926250] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-08-04 02:00:59,387 - DEBUG - [Pod Pod ctest-pod-48926250] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 passed
2025-08-04 02:00:59,387 - DEBUG - [Pod Pod ctest-pod-48926250] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-08-04 02:00:59,387 - INFO - wget check of of http://10.47.255.249 from ctest-pod-48926250 passed
2025-08-04 02:01:04,452 - DEBUG - [Pod ctest-pod-27658580] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2025-08-04 02:01:04,452 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2025-08-04 02:01:04,452 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2025-08-04 02:01:04,452 - INFO - wget check of of http://10.47.255.249 from ctest-pod-27658580 passed
2025-08-04 02:01:09,533 - DEBUG - [Pod ctest-pod-58419354] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-08-04 02:01:09,533 - DEBUG - [Pod Pod ctest-pod-58419354] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-08-04 02:01:09,533 - DEBUG - [Pod Pod ctest-pod-58419354] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-08-04 02:01:09,533 - INFO - wget check of of http://10.47.255.250 from ctest-pod-58419354 passed
2025-08-04 02:01:09,543 - INFO - Updating Network Policy ingress-on-service
2025-08-04 02:01:14,643 - DEBUG - [Pod ctest-pod-27658580] Cmd: wget http://10.101.26.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:01:14,643 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd wget http://10.101.26.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:01:14,643 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:01:19,721 - DEBUG - [Pod ctest-pod-27658580] Cmd: wget http://10.101.26.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:01:19,721 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd wget http://10.101.26.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:01:19,721 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:01:24,784 - DEBUG - [Pod ctest-pod-27658580] Cmd: wget http://10.101.26.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:01:24,785 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd wget http://10.101.26.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:01:24,785 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:01:29,861 - DEBUG - [Pod ctest-pod-27658580] Cmd: wget http://10.101.26.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:01:29,861 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd wget http://10.101.26.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:01:29,861 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:01:34,923 - DEBUG - [Pod ctest-pod-27658580] Cmd: wget http://10.101.26.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:01:34,924 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd wget http://10.101.26.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:01:34,924 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:01:39,987 - DEBUG - [Pod ctest-pod-27658580] Cmd: wget http://10.101.26.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:01:39,988 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd wget http://10.101.26.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:01:39,988 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:01:45,061 - DEBUG - [Pod ctest-pod-27658580] Cmd: wget http://10.101.26.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:01:45,061 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd wget http://10.101.26.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:01:45,061 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:01:50,128 - DEBUG - [Pod ctest-pod-27658580] Cmd: wget http://10.101.26.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:01:50,129 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd wget http://10.101.26.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:01:50,129 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:01:55,204 - DEBUG - [Pod ctest-pod-27658580] Cmd: wget http://10.101.26.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:01:55,204 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd wget http://10.101.26.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:01:55,204 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:02:00,278 - DEBUG - [Pod ctest-pod-27658580] Cmd: wget http://10.101.26.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:02:00,278 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd wget http://10.101.26.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:02:00,278 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
wget: download timed out
2025-08-04 02:02:00,278 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-27716989': 0, 'ctest-pod-97524553': 0}
2025-08-04 02:02:00,348 - DEBUG - [Pod ctest-pod-48926250] Cmd: wget http://10.101.26.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-27716989
2025-08-04 02:02:00,348 - DEBUG - [Pod Pod ctest-pod-48926250] Cmd wget http://10.101.26.78:80/ -O - -T 5 -t 1 passed
2025-08-04 02:02:00,348 - DEBUG - [Pod Pod ctest-pod-48926250] Cmd output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-27716989
2025-08-04 02:02:00,412 - DEBUG - [Pod ctest-pod-48926250] Cmd: wget http://10.101.26.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
ctest-pod-27716989
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-08-04 02:02:00,412 - DEBUG - [Pod Pod ctest-pod-48926250] Cmd wget http://10.101.26.78:80/ -O - -T 5 -t 1 passed
2025-08-04 02:02:00,412 - DEBUG - [Pod Pod ctest-pod-48926250] Cmd output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
ctest-pod-27716989
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-08-04 02:02:00,480 - DEBUG - [Pod ctest-pod-48926250] Cmd: wget http://10.101.26.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
writing to stdout
ctest-pod-97524553
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-08-04 02:02:00,480 - DEBUG - [Pod Pod ctest-pod-48926250] Cmd wget http://10.101.26.78:80/ -O - -T 5 -t 1 passed
2025-08-04 02:02:00,480 - DEBUG - [Pod Pod ctest-pod-48926250] Cmd output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
writing to stdout
ctest-pod-97524553
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-08-04 02:02:00,480 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-27716989': 2, 'ctest-pod-97524553': 1}
2025-08-04 02:02:00,551 - DEBUG - [Pod ctest-pod-90370795] Cmd: wget http://10.101.26.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-97524553
2025-08-04 02:02:00,552 - DEBUG - [Pod Pod ctest-pod-90370795] Cmd wget http://10.101.26.78:80/ -O - -T 5 -t 1 passed
2025-08-04 02:02:00,552 - DEBUG - [Pod Pod ctest-pod-90370795] Cmd output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-97524553
2025-08-04 02:02:00,638 - DEBUG - [Pod ctest-pod-90370795] Cmd: wget http://10.101.26.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-27716989
2025-08-04 02:02:00,638 - DEBUG - [Pod Pod ctest-pod-90370795] Cmd wget http://10.101.26.78:80/ -O - -T 5 -t 1 passed
2025-08-04 02:02:00,638 - DEBUG - [Pod Pod ctest-pod-90370795] Cmd output: Connecting to 10.101.26.78:80 (10.101.26.78:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-27716989
2025-08-04 02:02:00,638 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-27716989': 1, 'ctest-pod-97524553': 1}
2025-08-04 02:02:02,712 - DEBUG - [Pod ctest-pod-48926250] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.941 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.075 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.089 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.075/0.368/0.941 ms
2025-08-04 02:02:02,712 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-48926250 with expectation True passed
2025-08-04 02:02:04,794 - DEBUG - [Pod ctest-pod-27658580] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes
64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.686 ms
64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.098 ms
64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.080 ms
--- 10.47.255.245 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.080/0.288/0.686 ms
2025-08-04 02:02:04,795 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-27658580 with expectation True passed
2025-08-04 02:02:06,867 - DEBUG - [Pod ctest-pod-90370795] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes
64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.516 ms
64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.073 ms
64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.070 ms
--- 10.47.255.245 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.070/0.219/0.516 ms
2025-08-04 02:02:06,868 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-90370795 with expectation True passed
2025-08-04 02:02:06,942 - DEBUG - [Pod ctest-pod-48926250] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-08-04 02:02:06,942 - DEBUG - [Pod Pod ctest-pod-48926250] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-08-04 02:02:06,942 - DEBUG - [Pod Pod ctest-pod-48926250] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-08-04 02:02:06,942 - INFO - wget check of of http://10.47.255.250 from ctest-pod-48926250 passed
2025-08-04 02:02:07,012 - DEBUG - [Pod ctest-pod-48926250] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-08-04 02:02:07,012 - DEBUG - [Pod Pod ctest-pod-48926250] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 passed
2025-08-04 02:02:07,012 - DEBUG - [Pod Pod ctest-pod-48926250] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-08-04 02:02:07,012 - INFO - wget check of of http://10.47.255.249 from ctest-pod-48926250 passed
2025-08-04 02:02:12,077 - DEBUG - [Pod ctest-pod-27658580] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2025-08-04 02:02:12,077 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2025-08-04 02:02:12,077 - DEBUG - [Pod Pod ctest-pod-27658580] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2025-08-04 02:02:12,077 - INFO - wget check of of http://10.47.255.249 from ctest-pod-27658580 passed
2025-08-04 02:02:12,153 - DEBUG - [Pod ctest-pod-58419354] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-08-04 02:02:12,153 - DEBUG - [Pod Pod ctest-pod-58419354] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-08-04 02:02:12,153 - DEBUG - [Pod Pod ctest-pod-58419354] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-08-04 02:02:12,153 - INFO - wget check of of http://10.47.255.250 from ctest-pod-58419354 passed
2025-08-04 02:02:12,153 - INFO - Deleting Network Policy : ingress-on-service
2025-08-04 02:02:12,154 - INFO - Deleting service : ctest-nginx-svc-68922114
2025-08-04 02:02:12,663 - DEBUG - No XMPP flaps were noticed during the test
2025-08-04 02:02:12,663 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:08]
2025-08-04 02:02:12,663 - INFO - --------------------------------------------------------------------------------
2025-08-04 02:02:12,673 - INFO - Deleting pod ctest-new-default-47247881:ctest-pod-27716989
2025-08-04 02:02:12,674 - INFO - Deleting pod ctest-new-default-47247881:ctest-pod-97524553
2025-08-04 02:02:12,675 - INFO - Deleting pod ctest-non-default-46946419:ctest-pod-80378023
2025-08-04 02:02:12,675 - INFO - Deleting pod ctest-non-default-46946419:ctest-pod-85627617
2025-08-04 02:02:12,676 - INFO - Deleting pod ctest-new-default-47247881:ctest-pod-27658580
2025-08-04 02:02:12,676 - INFO - Deleting pod ctest-new-default-47247881:ctest-pod-48926250
2025-08-04 02:02:12,678 - INFO - Deleting pod ctest-non-default-46946419:ctest-pod-90370795
2025-08-04 02:02:12,678 - INFO - Deleting pod ctest-non-default-46946419:ctest-pod-58419354
2025-08-04 02:02:12,825 - WARNING - Pod uuid 71761a23-899a-4b36-aaef-8b41f697eeaa is still seen in agent 10.0.0.48 VM list
2025-08-04 02:02:13,107 - WARNING - Pod uuid 071ede4e-4456-489e-92a0-e774b826a1cf is still seen in agent 10.0.0.48 VM list
2025-08-04 02:02:13,189 - WARNING - Pod uuid f5e88aee-be67-4f2a-8c0e-3cb90020cf39 is still seen in agent 10.0.0.48 VM list
2025-08-04 02:02:13,481 - WARNING - Pod uuid 2731dfdc-7577-43f1-acb6-7106ba01166d is still seen in agent 10.0.0.48 VM list
2025-08-04 02:02:13,481 - WARNING - Pod uuid eb870e18-c757-40e5-aa9c-f62458db14c1 is still seen in agent 10.0.0.48 VM list
2025-08-04 02:02:13,492 - WARNING - Pod uuid ec4038bd-6d5e-49ee-8fa0-bcf36d60cf53 is still seen in agent 10.0.0.48 VM list
2025-08-04 02:02:13,497 - WARNING - Pod uuid 7d2fdbdf-ce6f-4dbd-976f-da881e41f002 is still seen in agent 10.0.0.48 VM list
2025-08-04 02:02:13,497 - WARNING - Pod uuid b8ee7e2b-4bc9-41ce-b180-4d95306bee0e is still seen in agent 10.0.0.48 VM list
2025-08-04 02:02:17,833 - DEBUG - Pod 71761a23-899a-4b36-aaef-8b41f697eeaa is not in agent 10.0.0.48 VM list
2025-08-04 02:02:17,838 - DEBUG - VMI 8b091450-70d6-11f0-a417-0242248b7446 is removed from agent 10.0.0.48
2025-08-04 02:02:17,838 - INFO - Verified that pod ctest-pod-27716989 is removed in agent
2025-08-04 02:02:18,116 - WARNING - Pod uuid 071ede4e-4456-489e-92a0-e774b826a1cf is still seen in agent 10.0.0.48 VM list
2025-08-04 02:02:18,197 - WARNING - Pod uuid f5e88aee-be67-4f2a-8c0e-3cb90020cf39 is still seen in agent 10.0.0.48 VM list
2025-08-04 02:02:18,491 - DEBUG - Pod 2731dfdc-7577-43f1-acb6-7106ba01166d is not in agent 10.0.0.48 VM list
2025-08-04 02:02:18,505 - DEBUG - VMI 8cb91bba-70d6-11f0-a417-0242248b7446 is removed from agent 10.0.0.48
2025-08-04 02:02:18,505 - INFO - Verified that pod ctest-pod-80378023 is removed in agent
2025-08-04 02:02:18,505 - DEBUG - Pod ec4038bd-6d5e-49ee-8fa0-bcf36d60cf53 is not in agent 10.0.0.48 VM list
2025-08-04 02:02:18,506 - WARNING - Pod uuid eb870e18-c757-40e5-aa9c-f62458db14c1 is still seen in agent 10.0.0.48 VM list
2025-08-04 02:02:18,518 - DEBUG - VMI 8d7b7246-70d6-11f0-a417-0242248b7446 is removed from agent 10.0.0.48
2025-08-04 02:02:18,518 - INFO - Verified that pod ctest-pod-85627617 is removed in agent
2025-08-04 02:02:18,518 - WARNING - Pod uuid b8ee7e2b-4bc9-41ce-b180-4d95306bee0e is still seen in agent 10.0.0.48 VM list
2025-08-04 02:02:18,519 - WARNING - Pod uuid 7d2fdbdf-ce6f-4dbd-976f-da881e41f002 is still seen in agent 10.0.0.48 VM list
2025-08-04 02:02:23,123 - WARNING - Pod uuid 071ede4e-4456-489e-92a0-e774b826a1cf is still seen in agent 10.0.0.48 VM list
2025-08-04 02:02:23,204 - WARNING - Pod uuid f5e88aee-be67-4f2a-8c0e-3cb90020cf39 is still seen in agent 10.0.0.48 VM list
2025-08-04 02:02:23,514 - WARNING - Pod uuid eb870e18-c757-40e5-aa9c-f62458db14c1 is still seen in agent 10.0.0.48 VM list
2025-08-04 02:02:23,528 - WARNING - Pod uuid 7d2fdbdf-ce6f-4dbd-976f-da881e41f002 is still seen in agent 10.0.0.48 VM list
2025-08-04 02:02:23,529 - WARNING - Pod uuid b8ee7e2b-4bc9-41ce-b180-4d95306bee0e is still seen in agent 10.0.0.48 VM list
2025-08-04 02:02:28,132 - WARNING - Pod uuid 071ede4e-4456-489e-92a0-e774b826a1cf is still seen in agent 10.0.0.48 VM list
2025-08-04 02:02:28,212 - WARNING - Pod uuid f5e88aee-be67-4f2a-8c0e-3cb90020cf39 is still seen in agent 10.0.0.48 VM list
2025-08-04 02:02:28,522 - WARNING - Pod uuid eb870e18-c757-40e5-aa9c-f62458db14c1 is still seen in agent 10.0.0.48 VM list
2025-08-04 02:02:28,538 - WARNING - Pod uuid b8ee7e2b-4bc9-41ce-b180-4d95306bee0e is still seen in agent 10.0.0.48 VM list
2025-08-04 02:02:28,539 - WARNING - Pod uuid 7d2fdbdf-ce6f-4dbd-976f-da881e41f002 is still seen in agent 10.0.0.48 VM list
2025-08-04 02:02:33,139 - WARNING - Pod uuid 071ede4e-4456-489e-92a0-e774b826a1cf is still seen in agent 10.0.0.48 VM list
2025-08-04 02:02:33,219 - WARNING - Pod uuid f5e88aee-be67-4f2a-8c0e-3cb90020cf39 is still seen in agent 10.0.0.48 VM list
2025-08-04 02:02:33,529 - WARNING - Pod uuid eb870e18-c757-40e5-aa9c-f62458db14c1 is still seen in agent 10.0.0.48 VM list
2025-08-04 02:02:33,548 - WARNING - Pod uuid b8ee7e2b-4bc9-41ce-b180-4d95306bee0e is still seen in agent 10.0.0.48 VM list
2025-08-04 02:02:33,549 - WARNING - Pod uuid 7d2fdbdf-ce6f-4dbd-976f-da881e41f002 is still seen in agent 10.0.0.48 VM list
2025-08-04 02:02:38,145 - WARNING - Pod uuid 071ede4e-4456-489e-92a0-e774b826a1cf is still seen in agent 10.0.0.48 VM list
2025-08-04 02:02:38,225 - WARNING - Pod uuid f5e88aee-be67-4f2a-8c0e-3cb90020cf39 is still seen in agent 10.0.0.48 VM list
2025-08-04 02:02:38,535 - WARNING - Pod uuid eb870e18-c757-40e5-aa9c-f62458db14c1 is still seen in agent 10.0.0.48 VM list
2025-08-04 02:02:38,557 - WARNING - Pod uuid b8ee7e2b-4bc9-41ce-b180-4d95306bee0e is still seen in agent 10.0.0.48 VM list
2025-08-04 02:02:38,557 - WARNING - Pod uuid 7d2fdbdf-ce6f-4dbd-976f-da881e41f002 is still seen in agent 10.0.0.48 VM list
2025-08-04 02:02:43,152 - WARNING - Pod uuid 071ede4e-4456-489e-92a0-e774b826a1cf is still seen in agent 10.0.0.48 VM list
2025-08-04 02:02:43,232 - WARNING - Pod uuid f5e88aee-be67-4f2a-8c0e-3cb90020cf39 is still seen in agent 10.0.0.48 VM list
2025-08-04 02:02:43,544 - WARNING - Pod uuid eb870e18-c757-40e5-aa9c-f62458db14c1 is still seen in agent 10.0.0.48 VM list
2025-08-04 02:02:43,569 - WARNING - Pod uuid b8ee7e2b-4bc9-41ce-b180-4d95306bee0e is still seen in agent 10.0.0.48 VM list
2025-08-04 02:02:43,570 - WARNING - Pod uuid 7d2fdbdf-ce6f-4dbd-976f-da881e41f002 is still seen in agent 10.0.0.48 VM list
2025-08-04 02:02:48,159 - DEBUG - Pod 071ede4e-4456-489e-92a0-e774b826a1cf is not in agent 10.0.0.48 VM list
2025-08-04 02:02:48,164 - DEBUG - VMI 90ba80c8-70d6-11f0-a417-0242248b7446 is removed from agent 10.0.0.48
2025-08-04 02:02:48,164 - INFO - Verified that pod ctest-pod-58419354 is removed in agent
2025-08-04 02:02:48,241 - DEBUG - Pod f5e88aee-be67-4f2a-8c0e-3cb90020cf39 is not in agent 10.0.0.48 VM list
2025-08-04 02:02:48,246 - DEBUG - VMI 8e64f4c0-70d6-11f0-a417-0242248b7446 is removed from agent 10.0.0.48
2025-08-04 02:02:48,246 - INFO - Verified that pod ctest-pod-27658580 is removed in agent
2025-08-04 02:02:48,550 - DEBUG - Pod eb870e18-c757-40e5-aa9c-f62458db14c1 is not in agent 10.0.0.48 VM list
2025-08-04 02:02:48,555 - DEBUG - VMI 8f276cb2-70d6-11f0-a417-0242248b7446 is removed from agent 10.0.0.48
2025-08-04 02:02:48,555 - INFO - Verified that pod ctest-pod-48926250 is removed in agent
2025-08-04 02:02:48,580 - DEBUG - Pod 7d2fdbdf-ce6f-4dbd-976f-da881e41f002 is not in agent 10.0.0.48 VM list
2025-08-04 02:02:48,582 - DEBUG - Pod b8ee7e2b-4bc9-41ce-b180-4d95306bee0e is not in agent 10.0.0.48 VM list
2025-08-04 02:02:48,591 - DEBUG - VMI 8fee201e-70d6-11f0-a417-0242248b7446 is removed from agent 10.0.0.48
2025-08-04 02:02:48,591 - INFO - Verified that pod ctest-pod-90370795 is removed in agent
2025-08-04 02:02:48,592 - DEBUG - VMI 8bbd0fe6-70d6-11f0-a417-0242248b7446 is removed from agent 10.0.0.48
2025-08-04 02:02:48,592 - INFO - Verified that pod ctest-pod-97524553 is removed in agent
2025-08-04 02:02:48,592 - INFO - Deleting namespace ctest-non-default-46946419
2025-08-04 02:02:48,604 - DEBUG - Namespace ctest-non-default-46946419 still in k8s
2025-08-04 02:02:50,609 - DEBUG - Namespace ctest-non-default-46946419 still in k8s
2025-08-04 02:02:52,614 - DEBUG - Namespace ctest-non-default-46946419 still in k8s
2025-08-04 02:02:54,618 - DEBUG - Namespace ctest-non-default-46946419 is not in k8s
2025-08-04 02:02:54,618 - DEBUG - No need to check project deletion in contrail-api
2025-08-04 02:02:54,618 - INFO - Deleting namespace ctest-new-default-47247881
2025-08-04 02:02:54,626 - DEBUG - Namespace ctest-new-default-47247881 still in k8s
2025-08-04 02:02:56,632 - DEBUG - Namespace ctest-new-default-47247881 still in k8s
2025-08-04 02:02:58,637 - DEBUG - Namespace ctest-new-default-47247881 still in k8s
2025-08-04 02:03:00,640 - DEBUG - Namespace ctest-new-default-47247881 is not in k8s
2025-08-04 02:03:00,641 - DEBUG - No need to check project deletion in contrail-api