2025-02-11 19:20:17,829 - INFO - Using existing project ['default-domain', 'k8s-default'](c704984d-4d61-47d3-99db-1ce31ad09ccb)
2025-02-11 19:20:17,852 - DEBUG - Namespace ctest-new-default-41758632 not present
2025-02-11 19:20:17,866 - INFO - Created namespace ctest-new-default-41758632
2025-02-11 19:20:20,870 - DEBUG - Namespace ctest-non-default-38715680 not present
2025-02-11 19:20:20,887 - INFO - Created namespace ctest-non-default-38715680
2025-02-11 19:20:23,916 - DEBUG - Pod ctest-pod-88088038 not present
2025-02-11 19:20:23,916 - INFO - Creating Pod ctest-pod-88088038
2025-02-11 19:20:23,964 - DEBUG - Pod : ctest-pod-88088038 UUID is a941512f-9f28-4393-9f18-6104834f42e3
2025-02-11 19:20:23,971 - DEBUG - Pod ctest-pod-20558646 not present
2025-02-11 19:20:23,972 - INFO - Creating Pod ctest-pod-20558646
2025-02-11 19:20:24,007 - DEBUG - Pod : ctest-pod-20558646 UUID is f45b5b4d-bd09-4ac2-9982-5269874254f7
2025-02-11 19:20:24,013 - DEBUG - Pod ctest-pod-11899596 not present
2025-02-11 19:20:24,013 - INFO - Creating Pod ctest-pod-11899596
2025-02-11 19:20:24,072 - DEBUG - Pod : ctest-pod-11899596 UUID is 6b589b1e-5e76-4c59-882c-d1fc654ae9f5
2025-02-11 19:20:24,075 - DEBUG - Pod ctest-pod-85991840 not present
2025-02-11 19:20:24,075 - INFO - Creating Pod ctest-pod-85991840
2025-02-11 19:20:24,105 - DEBUG - Pod : ctest-pod-85991840 UUID is 2fe56e55-ab76-4ae9-be0a-af4aeb76cc06
2025-02-11 19:20:24,108 - DEBUG - Pod ctest-pod-67389145 not present
2025-02-11 19:20:24,108 - INFO - Creating Pod ctest-pod-67389145
2025-02-11 19:20:24,126 - DEBUG - Pod : ctest-pod-67389145 UUID is 1857e7b9-d79e-422b-9f7f-7b11408efd3b
2025-02-11 19:20:24,128 - DEBUG - Pod ctest-pod-30325397 not present
2025-02-11 19:20:24,128 - INFO - Creating Pod ctest-pod-30325397
2025-02-11 19:20:24,162 - DEBUG - Pod : ctest-pod-30325397 UUID is 6f02b650-41e8-4fba-a59e-2a7006d7367c
2025-02-11 19:20:24,170 - DEBUG - Pod ctest-pod-09592859 not present
2025-02-11 19:20:24,170 - INFO - Creating Pod ctest-pod-09592859
2025-02-11 19:20:24,209 - DEBUG - Pod : ctest-pod-09592859 UUID is 4f9447d5-953b-4c85-8c7b-4591f44eaba8
2025-02-11 19:20:24,212 - DEBUG - Pod ctest-pod-78954178 not present
2025-02-11 19:20:24,212 - INFO - Creating Pod ctest-pod-78954178
2025-02-11 19:20:24,240 - DEBUG - Pod : ctest-pod-78954178 UUID is 17b6a06e-99da-4b27-9b3d-2ec7fbe18589
2025-02-11 19:20:24,490 - INFO - Project default-domain:k8s-ctest-new-default-41758632 for Namespace ctest-new-default-41758632 is seen in contrail-api
2025-02-11 19:20:24,490 - DEBUG - Project uuid in Contrail is 24cadf7c-0920-40d5-9802-2d3d0b1d6bef
2025-02-11 19:20:24,696 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_NamespaceDatabaseList?namespace_uuid=48c59e61-bbe6-4930-a4a9-4d5da43b9f2a
2025-02-11 19:20:24,715 - INFO - Namespace ctest-new-default-41758632 with uuid 48c59e61-bbe6-4930-a4a9-4d5da43b9f2a found in kube manager
2025-02-11 19:20:24,715 - INFO - Namespace ctest-new-default-41758632 verification passed
2025-02-11 19:20:24,971 - INFO - Project default-domain:k8s-ctest-non-default-38715680 for Namespace ctest-non-default-38715680 is seen in contrail-api
2025-02-11 19:20:24,971 - DEBUG - Project uuid in Contrail is 8bd93af7-85ea-4d75-ab0b-b66e6f8025a4
2025-02-11 19:20:24,971 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_NamespaceDatabaseList?namespace_uuid=53f99b14-d292-491c-b775-1366775bb1d1
2025-02-11 19:20:24,976 - INFO - Namespace ctest-non-default-38715680 with uuid 53f99b14-d292-491c-b775-1366775bb1d1 found in kube manager
2025-02-11 19:20:24,976 - INFO - Namespace ctest-non-default-38715680 verification passed
2025-02-11 19:20:24,990 - DEBUG - Pod ctest-pod-88088038 not in running state.Currently in Pending
2025-02-11 19:20:30,010 - DEBUG - Pod ctest-pod-88088038 not in running state.Currently in Pending
2025-02-11 19:20:35,017 - DEBUG - Pod ctest-pod-88088038 not in running state.Currently in Pending
2025-02-11 19:20:40,024 - INFO - Pod ctest-pod-88088038 is in running state.Got IP 10.47.255.251
2025-02-11 19:20:40,083 - DEBUG - Pod ctest-pod-88088038 has vmi 3f5532c0-e8ad-11ef-831e-fa163e508488
2025-02-11 19:20:40,083 - INFO - Verified pod ctest-pod-88088038 in contrail-api
2025-02-11 19:20:40,103 - DEBUG - VMI 3f5532c0-e8ad-11ef-831e-fa163e508488 is active in agent 10.0.0.22
2025-02-11 19:20:40,104 - INFO - Verified Pod ctest-pod-88088038 in agent 10.0.0.22
2025-02-11 19:20:40,104 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_VirtualMachineDatabaseList?x=a941512f-9f28-4393-9f18-6104834f42e3
2025-02-11 19:20:40,110 - INFO - Pod ctest-pod-88088038 with uuid a941512f-9f28-4393-9f18-6104834f42e3 found in kube manager
2025-02-11 19:20:40,110 - INFO - Pod ctest-pod-88088038 verification passed
2025-02-11 19:20:40,118 - INFO - Pod ctest-pod-20558646 is in running state.Got IP 10.47.255.250
2025-02-11 19:20:40,137 - DEBUG - Pod ctest-pod-20558646 has vmi 3ff0b542-e8ad-11ef-831e-fa163e508488
2025-02-11 19:20:40,138 - INFO - Verified pod ctest-pod-20558646 in contrail-api
2025-02-11 19:20:40,168 - DEBUG - VMI 3ff0b542-e8ad-11ef-831e-fa163e508488 is active in agent 10.0.0.22
2025-02-11 19:20:40,169 - INFO - Verified Pod ctest-pod-20558646 in agent 10.0.0.22
2025-02-11 19:20:40,169 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_VirtualMachineDatabaseList?x=f45b5b4d-bd09-4ac2-9982-5269874254f7
2025-02-11 19:20:40,176 - INFO - Pod ctest-pod-20558646 with uuid f45b5b4d-bd09-4ac2-9982-5269874254f7 found in kube manager
2025-02-11 19:20:40,176 - INFO - Pod ctest-pod-20558646 verification passed
2025-02-11 19:20:40,184 - INFO - Pod ctest-pod-11899596 is in running state.Got IP 10.47.255.249
2025-02-11 19:20:40,243 - DEBUG - Pod ctest-pod-11899596 has vmi 40ad51ac-e8ad-11ef-831e-fa163e508488
2025-02-11 19:20:40,243 - INFO - Verified pod ctest-pod-11899596 in contrail-api
2025-02-11 19:20:40,257 - DEBUG - VMI 40ad51ac-e8ad-11ef-831e-fa163e508488 is active in agent 10.0.0.22
2025-02-11 19:20:40,258 - INFO - Verified Pod ctest-pod-11899596 in agent 10.0.0.22
2025-02-11 19:20:40,258 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_VirtualMachineDatabaseList?x=6b589b1e-5e76-4c59-882c-d1fc654ae9f5
2025-02-11 19:20:40,263 - INFO - Pod ctest-pod-11899596 with uuid 6b589b1e-5e76-4c59-882c-d1fc654ae9f5 found in kube manager
2025-02-11 19:20:40,263 - INFO - Pod ctest-pod-11899596 verification passed
2025-02-11 19:20:40,271 - DEBUG - Pod ctest-pod-85991840 not in running state.Currently in Pending
2025-02-11 19:20:45,280 - INFO - Pod ctest-pod-85991840 is in running state.Got IP 10.47.255.248
2025-02-11 19:20:45,309 - DEBUG - Pod ctest-pod-85991840 has vmi 41405876-e8ad-11ef-831e-fa163e508488
2025-02-11 19:20:45,309 - INFO - Verified pod ctest-pod-85991840 in contrail-api
2025-02-11 19:20:45,328 - DEBUG - VMI 41405876-e8ad-11ef-831e-fa163e508488 is active in agent 10.0.0.22
2025-02-11 19:20:45,328 - INFO - Verified Pod ctest-pod-85991840 in agent 10.0.0.22
2025-02-11 19:20:45,328 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_VirtualMachineDatabaseList?x=2fe56e55-ab76-4ae9-be0a-af4aeb76cc06
2025-02-11 19:20:45,335 - INFO - Pod ctest-pod-85991840 with uuid 2fe56e55-ab76-4ae9-be0a-af4aeb76cc06 found in kube manager
2025-02-11 19:20:45,335 - INFO - Pod ctest-pod-85991840 verification passed
2025-02-11 19:20:45,341 - INFO - Pod ctest-pod-67389145 is in running state.Got IP 10.47.255.247
2025-02-11 19:20:45,399 - DEBUG - Pod ctest-pod-67389145 has vmi 41e3bad4-e8ad-11ef-831e-fa163e508488
2025-02-11 19:20:45,399 - INFO - Verified pod ctest-pod-67389145 in contrail-api
2025-02-11 19:20:45,413 - DEBUG - VMI 41e3bad4-e8ad-11ef-831e-fa163e508488 is active in agent 10.0.0.22
2025-02-11 19:20:45,413 - INFO - Verified Pod ctest-pod-67389145 in agent 10.0.0.22
2025-02-11 19:20:45,414 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_VirtualMachineDatabaseList?x=1857e7b9-d79e-422b-9f7f-7b11408efd3b
2025-02-11 19:20:45,420 - INFO - Pod ctest-pod-67389145 with uuid 1857e7b9-d79e-422b-9f7f-7b11408efd3b found in kube manager
2025-02-11 19:20:45,420 - INFO - Pod ctest-pod-67389145 verification passed
2025-02-11 19:20:45,427 - INFO - Pod ctest-pod-09592859 is in running state.Got IP 10.47.255.245
2025-02-11 19:20:45,448 - DEBUG - Pod ctest-pod-09592859 has vmi 42e054b0-e8ad-11ef-831e-fa163e508488
2025-02-11 19:20:45,448 - INFO - Verified pod ctest-pod-09592859 in contrail-api
2025-02-11 19:20:45,464 - DEBUG - VMI 42e054b0-e8ad-11ef-831e-fa163e508488 is active in agent 10.0.0.22
2025-02-11 19:20:45,464 - INFO - Verified Pod ctest-pod-09592859 in agent 10.0.0.22
2025-02-11 19:20:45,464 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_VirtualMachineDatabaseList?x=4f9447d5-953b-4c85-8c7b-4591f44eaba8
2025-02-11 19:20:45,470 - INFO - Pod ctest-pod-09592859 with uuid 4f9447d5-953b-4c85-8c7b-4591f44eaba8 found in kube manager
2025-02-11 19:20:45,470 - INFO - Pod ctest-pod-09592859 verification passed
2025-02-11 19:20:45,551 - INFO - Pod ctest-pod-30325397 is in running state.Got IP 10.47.255.246
2025-02-11 19:20:45,623 - DEBUG - Pod ctest-pod-30325397 has vmi 42665f8e-e8ad-11ef-831e-fa163e508488
2025-02-11 19:20:45,623 - INFO - Verified pod ctest-pod-30325397 in contrail-api
2025-02-11 19:20:45,640 - DEBUG - VMI 42665f8e-e8ad-11ef-831e-fa163e508488 is active in agent 10.0.0.22
2025-02-11 19:20:45,641 - INFO - Verified Pod ctest-pod-30325397 in agent 10.0.0.22
2025-02-11 19:20:45,641 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_VirtualMachineDatabaseList?x=6f02b650-41e8-4fba-a59e-2a7006d7367c
2025-02-11 19:20:45,686 - INFO - Pod ctest-pod-30325397 with uuid 6f02b650-41e8-4fba-a59e-2a7006d7367c found in kube manager
2025-02-11 19:20:45,687 - INFO - Pod ctest-pod-30325397 verification passed
2025-02-11 19:20:45,696 - INFO - Pod ctest-pod-78954178 is in running state.Got IP 10.47.255.244
2025-02-11 19:20:45,717 - DEBUG - Pod ctest-pod-78954178 has vmi 4363dc18-e8ad-11ef-831e-fa163e508488
2025-02-11 19:20:45,717 - INFO - Verified pod ctest-pod-78954178 in contrail-api
2025-02-11 19:20:45,785 - DEBUG - VMI 4363dc18-e8ad-11ef-831e-fa163e508488 is active in agent 10.0.0.22
2025-02-11 19:20:45,786 - INFO - Verified Pod ctest-pod-78954178 in agent 10.0.0.22
2025-02-11 19:20:45,786 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_VirtualMachineDatabaseList?x=17b6a06e-99da-4b27-9b3d-2ec7fbe18589
2025-02-11 19:20:45,829 - INFO - Pod ctest-pod-78954178 with uuid 17b6a06e-99da-4b27-9b3d-2ec7fbe18589 found in kube manager
2025-02-11 19:20:45,829 - INFO - Pod ctest-pod-78954178 verification passed
2025-02-11 19:20:45,829 - INFO - ================================================================================
2025-02-11 19:20:45,831 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-02-11 19:20:45,831 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-02-11 19:20:46,125 - DEBUG - Nothing to compare xmpp stats {'10.0.0.22': {'10.0.0.28': '0'}} with
2025-02-11 19:20:46,125 - INFO - Initial checks done. Running the testcase now
2025-02-11 19:20:46,125 - INFO -
2025-02-11 19:20:46,194 - DEBUG - [Pod ctest-pod-88088038] Cmd: echo ctest-pod-88088038 > /usr/share/nginx/html/index.html, Output:
2025-02-11 19:20:46,265 - DEBUG - [Pod ctest-pod-20558646] Cmd: echo ctest-pod-20558646 > /usr/share/nginx/html/index.html, Output:
2025-02-11 19:20:46,326 - DEBUG - [Pod ctest-pod-11899596] Cmd: echo ctest-pod-11899596 > /usr/share/nginx/html/index.html, Output:
2025-02-11 19:20:46,395 - DEBUG - [Pod ctest-pod-85991840] Cmd: echo ctest-pod-85991840 > /usr/share/nginx/html/index.html, Output:
2025-02-11 19:20:46,399 - DEBUG - Service ctest-nginx-svc-40646085 not present
2025-02-11 19:20:46,400 - INFO - Creating service ctest-nginx-svc-40646085
2025-02-11 19:20:46,445 - INFO - Created Service ctest-nginx-svc-40646085
2025-02-11 19:20:46,460 - WARNING - Service UUID 2713b48c-3d69-466e-bd51-fa8ef0ed7a68 not yet found in contrail-api
2025-02-11 19:20:47,470 - INFO - Validated that Service ctest-nginx-svc-40646085 is seen in contrail-api
2025-02-11 19:20:47,471 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_LoadbalancerDatabaseList?x=2713b48c-3d69-466e-bd51-fa8ef0ed7a68
2025-02-11 19:20:47,477 - INFO - Service ctest-nginx-svc-40646085 with uuid 2713b48c-3d69-466e-bd51-fa8ef0ed7a68 found in kube manager
2025-02-11 19:20:47,477 - INFO - Service ctest-nginx-svc-40646085 verification passed
2025-02-11 19:20:48,556 - DEBUG - [Pod ctest-pod-67389145] Cmd: wget http://10.102.128.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
ctest-pod-88088038
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-11 19:20:48,556 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd wget http://10.102.128.57:80/ -O - -T 5 -t 1 passed
2025-02-11 19:20:48,556 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
ctest-pod-88088038
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-11 19:20:48,615 - DEBUG - [Pod ctest-pod-67389145] Cmd: wget http://10.102.128.57:80/ -O - -T 5 -t 1 , Output: ctest-pod-20558646
Connecting to 10.102.128.57:80 (10.102.128.57:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-11 19:20:48,616 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd wget http://10.102.128.57:80/ -O - -T 5 -t 1 passed
2025-02-11 19:20:48,616 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd output: ctest-pod-20558646
Connecting to 10.102.128.57:80 (10.102.128.57:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-11 19:20:48,616 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-88088038': 1, 'ctest-pod-20558646': 1}
2025-02-11 19:20:48,676 - DEBUG - [Pod ctest-pod-09592859] Cmd: wget http://10.102.128.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-88088038
2025-02-11 19:20:48,676 - DEBUG - [Pod Pod ctest-pod-09592859] Cmd wget http://10.102.128.57:80/ -O - -T 5 -t 1 passed
2025-02-11 19:20:48,676 - DEBUG - [Pod Pod ctest-pod-09592859] Cmd output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-88088038
2025-02-11 19:20:48,730 - DEBUG - [Pod ctest-pod-09592859] Cmd: wget http://10.102.128.57:80/ -O - -T 5 -t 1 , Output: ctest-pod-88088038
Connecting to 10.102.128.57:80 (10.102.128.57:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-11 19:20:48,730 - DEBUG - [Pod Pod ctest-pod-09592859] Cmd wget http://10.102.128.57:80/ -O - -T 5 -t 1 passed
2025-02-11 19:20:48,730 - DEBUG - [Pod Pod ctest-pod-09592859] Cmd output: ctest-pod-88088038
Connecting to 10.102.128.57:80 (10.102.128.57:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-11 19:20:48,798 - DEBUG - [Pod ctest-pod-09592859] Cmd: wget http://10.102.128.57:80/ -O - -T 5 -t 1 , Output: ctest-pod-88088038
Connecting to 10.102.128.57:80 (10.102.128.57:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-11 19:20:48,798 - DEBUG - [Pod Pod ctest-pod-09592859] Cmd wget http://10.102.128.57:80/ -O - -T 5 -t 1 passed
2025-02-11 19:20:48,798 - DEBUG - [Pod Pod ctest-pod-09592859] Cmd output: ctest-pod-88088038
Connecting to 10.102.128.57:80 (10.102.128.57:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-11 19:20:48,861 - DEBUG - [Pod ctest-pod-09592859] Cmd: wget http://10.102.128.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-20558646
2025-02-11 19:20:48,861 - DEBUG - [Pod Pod ctest-pod-09592859] Cmd wget http://10.102.128.57:80/ -O - -T 5 -t 1 passed
2025-02-11 19:20:48,861 - DEBUG - [Pod Pod ctest-pod-09592859] Cmd output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-20558646
2025-02-11 19:20:48,861 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-88088038': 3, 'ctest-pod-20558646': 1}
2025-02-11 19:20:48,864 - DEBUG - Network policy ingress-on-service not present
2025-02-11 19:20:48,865 - INFO - Creating Network Policy ingress-on-service
2025-02-11 19:20:48,880 - INFO - Network policy found in k8s
2025-02-11 19:20:48,881 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=2afff5ed-ade9-4bbf-b805-7490583e4c5a
2025-02-11 19:20:48,903 - INFO - Network Policy ingress-on-service with uuid 2afff5ed-ade9-4bbf-b805-7490583e4c5a found in kube manager
2025-02-11 19:20:48,940 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-02-11 19:20:48,941 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-02-11 19:20:48,941 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=2afff5ed-ade9-4bbf-b805-7490583e4c5a
2025-02-11 19:20:48,973 - WARNING - Network policy with name ingress-on-service not found in agent
2025-02-11 19:20:50,973 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=2afff5ed-ade9-4bbf-b805-7490583e4c5a
2025-02-11 19:20:51,008 - INFO - Network policy with name ingress-on-service found in agent
2025-02-11 19:20:51,008 - INFO - Network Policy ingress-on-service verification passed
2025-02-11 19:20:56,076 - DEBUG - [Pod ctest-pod-67389145] Cmd: wget http://10.102.128.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:20:56,077 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd wget http://10.102.128.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:20:56,077 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:21:01,154 - DEBUG - [Pod ctest-pod-67389145] Cmd: wget http://10.102.128.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:21:01,154 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd wget http://10.102.128.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:21:01,154 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:21:06,204 - DEBUG - [Pod ctest-pod-67389145] Cmd: wget http://10.102.128.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:21:06,204 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd wget http://10.102.128.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:21:06,204 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:21:11,272 - DEBUG - [Pod ctest-pod-67389145] Cmd: wget http://10.102.128.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:21:11,273 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd wget http://10.102.128.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:21:11,273 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:21:16,340 - DEBUG - [Pod ctest-pod-67389145] Cmd: wget http://10.102.128.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:21:16,340 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd wget http://10.102.128.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:21:16,340 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:21:21,401 - DEBUG - [Pod ctest-pod-67389145] Cmd: wget http://10.102.128.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:21:21,402 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd wget http://10.102.128.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:21:21,402 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:21:26,465 - DEBUG - [Pod ctest-pod-67389145] Cmd: wget http://10.102.128.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:21:26,465 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd wget http://10.102.128.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:21:26,465 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:21:31,530 - DEBUG - [Pod ctest-pod-67389145] Cmd: wget http://10.102.128.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:21:31,530 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd wget http://10.102.128.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:21:31,530 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:21:36,591 - DEBUG - [Pod ctest-pod-67389145] Cmd: wget http://10.102.128.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:21:36,591 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd wget http://10.102.128.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:21:36,591 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:21:41,656 - DEBUG - [Pod ctest-pod-67389145] Cmd: wget http://10.102.128.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:21:41,657 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd wget http://10.102.128.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:21:41,657 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:21:41,657 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-88088038': 0, 'ctest-pod-20558646': 0}
2025-02-11 19:21:41,721 - DEBUG - [Pod ctest-pod-30325397] Cmd: wget http://10.102.128.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-20558646
2025-02-11 19:21:41,721 - DEBUG - [Pod Pod ctest-pod-30325397] Cmd wget http://10.102.128.57:80/ -O - -T 5 -t 1 passed
2025-02-11 19:21:41,721 - DEBUG - [Pod Pod ctest-pod-30325397] Cmd output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-20558646
2025-02-11 19:21:41,793 - DEBUG - [Pod ctest-pod-30325397] Cmd: wget http://10.102.128.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-20558646
2025-02-11 19:21:41,793 - DEBUG - [Pod Pod ctest-pod-30325397] Cmd wget http://10.102.128.57:80/ -O - -T 5 -t 1 passed
2025-02-11 19:21:41,793 - DEBUG - [Pod Pod ctest-pod-30325397] Cmd output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-20558646
2025-02-11 19:21:41,858 - DEBUG - [Pod ctest-pod-30325397] Cmd: wget http://10.102.128.57:80/ -O - -T 5 -t 1 , Output: ctest-pod-20558646
Connecting to 10.102.128.57:80 (10.102.128.57:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-11 19:21:41,858 - DEBUG - [Pod Pod ctest-pod-30325397] Cmd wget http://10.102.128.57:80/ -O - -T 5 -t 1 passed
2025-02-11 19:21:41,858 - DEBUG - [Pod Pod ctest-pod-30325397] Cmd output: ctest-pod-20558646
Connecting to 10.102.128.57:80 (10.102.128.57:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-11 19:21:41,909 - DEBUG - [Pod ctest-pod-30325397] Cmd: wget http://10.102.128.57:80/ -O - -T 5 -t 1 , Output: ctest-pod-20558646
Connecting to 10.102.128.57:80 (10.102.128.57:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-11 19:21:41,909 - DEBUG - [Pod Pod ctest-pod-30325397] Cmd wget http://10.102.128.57:80/ -O - -T 5 -t 1 passed
2025-02-11 19:21:41,909 - DEBUG - [Pod Pod ctest-pod-30325397] Cmd output: ctest-pod-20558646
Connecting to 10.102.128.57:80 (10.102.128.57:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-11 19:21:41,975 - DEBUG - [Pod ctest-pod-30325397] Cmd: wget http://10.102.128.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-88088038
2025-02-11 19:21:41,976 - DEBUG - [Pod Pod ctest-pod-30325397] Cmd wget http://10.102.128.57:80/ -O - -T 5 -t 1 passed
2025-02-11 19:21:41,976 - DEBUG - [Pod Pod ctest-pod-30325397] Cmd output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-88088038
2025-02-11 19:21:41,976 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-88088038': 1, 'ctest-pod-20558646': 4}
2025-02-11 19:21:47,032 - DEBUG - [Pod ctest-pod-09592859] Cmd: wget http://10.102.128.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:21:47,032 - DEBUG - [Pod Pod ctest-pod-09592859] Cmd wget http://10.102.128.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:21:47,032 - DEBUG - [Pod Pod ctest-pod-09592859] Cmd output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:21:52,105 - DEBUG - [Pod ctest-pod-09592859] Cmd: wget http://10.102.128.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:21:52,105 - DEBUG - [Pod Pod ctest-pod-09592859] Cmd wget http://10.102.128.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:21:52,105 - DEBUG - [Pod Pod ctest-pod-09592859] Cmd output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:21:57,164 - DEBUG - [Pod ctest-pod-09592859] Cmd: wget http://10.102.128.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:21:57,164 - DEBUG - [Pod Pod ctest-pod-09592859] Cmd wget http://10.102.128.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:21:57,164 - DEBUG - [Pod Pod ctest-pod-09592859] Cmd output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:22:02,233 - DEBUG - [Pod ctest-pod-09592859] Cmd: wget http://10.102.128.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:22:02,233 - DEBUG - [Pod Pod ctest-pod-09592859] Cmd wget http://10.102.128.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:22:02,233 - DEBUG - [Pod Pod ctest-pod-09592859] Cmd output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:22:07,297 - DEBUG - [Pod ctest-pod-09592859] Cmd: wget http://10.102.128.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:22:07,297 - DEBUG - [Pod Pod ctest-pod-09592859] Cmd wget http://10.102.128.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:22:07,297 - DEBUG - [Pod Pod ctest-pod-09592859] Cmd output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:22:12,352 - DEBUG - [Pod ctest-pod-09592859] Cmd: wget http://10.102.128.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:22:12,352 - DEBUG - [Pod Pod ctest-pod-09592859] Cmd wget http://10.102.128.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:22:12,352 - DEBUG - [Pod Pod ctest-pod-09592859] Cmd output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:22:17,414 - DEBUG - [Pod ctest-pod-09592859] Cmd: wget http://10.102.128.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:22:17,414 - DEBUG - [Pod Pod ctest-pod-09592859] Cmd wget http://10.102.128.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:22:17,414 - DEBUG - [Pod Pod ctest-pod-09592859] Cmd output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:22:22,477 - DEBUG - [Pod ctest-pod-09592859] Cmd: wget http://10.102.128.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:22:22,477 - DEBUG - [Pod Pod ctest-pod-09592859] Cmd wget http://10.102.128.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:22:22,477 - DEBUG - [Pod Pod ctest-pod-09592859] Cmd output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:22:27,532 - DEBUG - [Pod ctest-pod-09592859] Cmd: wget http://10.102.128.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:22:27,532 - DEBUG - [Pod Pod ctest-pod-09592859] Cmd wget http://10.102.128.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:22:27,532 - DEBUG - [Pod Pod ctest-pod-09592859] Cmd output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:22:32,597 - DEBUG - [Pod ctest-pod-09592859] Cmd: wget http://10.102.128.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:22:32,597 - DEBUG - [Pod Pod ctest-pod-09592859] Cmd wget http://10.102.128.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:22:32,597 - DEBUG - [Pod Pod ctest-pod-09592859] Cmd output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:22:32,597 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-88088038': 0, 'ctest-pod-20558646': 0}
2025-02-11 19:22:34,670 - DEBUG - [Pod ctest-pod-30325397] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.267 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.110 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.118 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.110/0.498/1.267 ms
2025-02-11 19:22:34,670 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-30325397 with expectation True passed
2025-02-11 19:22:36,744 - DEBUG - [Pod ctest-pod-67389145] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.387 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.080 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.118 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.080/0.195/0.387 ms
2025-02-11 19:22:36,745 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-67389145 with expectation True passed
2025-02-11 19:22:38,833 - DEBUG - [Pod ctest-pod-09592859] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.715 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.078 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.100 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.078/0.297/0.715 ms
2025-02-11 19:22:38,833 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-09592859 with expectation True passed
2025-02-11 19:22:38,891 - DEBUG - [Pod ctest-pod-30325397] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-11 19:22:38,891 - DEBUG - [Pod Pod ctest-pod-30325397] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-02-11 19:22:38,891 - DEBUG - [Pod Pod ctest-pod-30325397] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-11 19:22:38,891 - INFO - wget check of of http://10.47.255.251 from ctest-pod-30325397 passed
2025-02-11 19:22:38,946 - DEBUG - [Pod ctest-pod-30325397] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-11 19:22:38,946 - DEBUG - [Pod Pod ctest-pod-30325397] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-02-11 19:22:38,946 - DEBUG - [Pod Pod ctest-pod-30325397] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-11 19:22:38,947 - INFO - wget check of of http://10.47.255.250 from ctest-pod-30325397 passed
2025-02-11 19:22:44,013 - DEBUG - [Pod ctest-pod-67389145] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-02-11 19:22:44,013 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-02-11 19:22:44,013 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-02-11 19:22:44,013 - INFO - wget check of of http://10.47.255.250 from ctest-pod-67389145 passed
2025-02-11 19:22:49,077 - DEBUG - [Pod ctest-pod-78954178] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-02-11 19:22:49,077 - DEBUG - [Pod Pod ctest-pod-78954178] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-02-11 19:22:49,077 - DEBUG - [Pod Pod ctest-pod-78954178] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-02-11 19:22:49,077 - INFO - wget check of of http://10.47.255.251 from ctest-pod-78954178 passed
2025-02-11 19:22:49,086 - INFO - Updating Network Policy ingress-on-service
2025-02-11 19:22:54,157 - DEBUG - [Pod ctest-pod-67389145] Cmd: wget http://10.102.128.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:22:54,157 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd wget http://10.102.128.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:22:54,157 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:22:59,241 - DEBUG - [Pod ctest-pod-67389145] Cmd: wget http://10.102.128.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:22:59,241 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd wget http://10.102.128.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:22:59,241 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:23:04,305 - DEBUG - [Pod ctest-pod-67389145] Cmd: wget http://10.102.128.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:23:04,305 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd wget http://10.102.128.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:23:04,305 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:23:09,352 - DEBUG - [Pod ctest-pod-67389145] Cmd: wget http://10.102.128.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:23:09,353 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd wget http://10.102.128.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:23:09,353 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:23:14,416 - DEBUG - [Pod ctest-pod-67389145] Cmd: wget http://10.102.128.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:23:14,416 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd wget http://10.102.128.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:23:14,416 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:23:19,474 - DEBUG - [Pod ctest-pod-67389145] Cmd: wget http://10.102.128.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:23:19,474 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd wget http://10.102.128.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:23:19,474 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:23:24,544 - DEBUG - [Pod ctest-pod-67389145] Cmd: wget http://10.102.128.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:23:24,544 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd wget http://10.102.128.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:23:24,544 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:23:29,619 - DEBUG - [Pod ctest-pod-67389145] Cmd: wget http://10.102.128.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:23:29,619 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd wget http://10.102.128.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:23:29,619 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:23:34,692 - DEBUG - [Pod ctest-pod-67389145] Cmd: wget http://10.102.128.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:23:34,692 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd wget http://10.102.128.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:23:34,692 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:23:39,766 - DEBUG - [Pod ctest-pod-67389145] Cmd: wget http://10.102.128.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:23:39,766 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd wget http://10.102.128.57:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:23:39,766 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
wget: download timed out
2025-02-11 19:23:39,766 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-88088038': 0, 'ctest-pod-20558646': 0}
2025-02-11 19:23:39,831 - DEBUG - [Pod ctest-pod-30325397] Cmd: wget http://10.102.128.57:80/ -O - -T 5 -t 1 , Output: ctest-pod-88088038
Connecting to 10.102.128.57:80 (10.102.128.57:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-11 19:23:39,831 - DEBUG - [Pod Pod ctest-pod-30325397] Cmd wget http://10.102.128.57:80/ -O - -T 5 -t 1 passed
2025-02-11 19:23:39,831 - DEBUG - [Pod Pod ctest-pod-30325397] Cmd output: ctest-pod-88088038
Connecting to 10.102.128.57:80 (10.102.128.57:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-11 19:23:39,881 - DEBUG - [Pod ctest-pod-30325397] Cmd: wget http://10.102.128.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
ctest-pod-20558646
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-11 19:23:39,881 - DEBUG - [Pod Pod ctest-pod-30325397] Cmd wget http://10.102.128.57:80/ -O - -T 5 -t 1 passed
2025-02-11 19:23:39,881 - DEBUG - [Pod Pod ctest-pod-30325397] Cmd output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
ctest-pod-20558646
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-11 19:23:39,881 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-88088038': 1, 'ctest-pod-20558646': 1}
2025-02-11 19:23:39,938 - DEBUG - [Pod ctest-pod-09592859] Cmd: wget http://10.102.128.57:80/ -O - -T 5 -t 1 , Output: ctest-pod-20558646
Connecting to 10.102.128.57:80 (10.102.128.57:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-11 19:23:39,939 - DEBUG - [Pod Pod ctest-pod-09592859] Cmd wget http://10.102.128.57:80/ -O - -T 5 -t 1 passed
2025-02-11 19:23:39,939 - DEBUG - [Pod Pod ctest-pod-09592859] Cmd output: ctest-pod-20558646
Connecting to 10.102.128.57:80 (10.102.128.57:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-11 19:23:40,002 - DEBUG - [Pod ctest-pod-09592859] Cmd: wget http://10.102.128.57:80/ -O - -T 5 -t 1 , Output: ctest-pod-20558646
Connecting to 10.102.128.57:80 (10.102.128.57:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-11 19:23:40,003 - DEBUG - [Pod Pod ctest-pod-09592859] Cmd wget http://10.102.128.57:80/ -O - -T 5 -t 1 passed
2025-02-11 19:23:40,003 - DEBUG - [Pod Pod ctest-pod-09592859] Cmd output: ctest-pod-20558646
Connecting to 10.102.128.57:80 (10.102.128.57:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-11 19:23:40,070 - DEBUG - [Pod ctest-pod-09592859] Cmd: wget http://10.102.128.57:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-88088038
2025-02-11 19:23:40,070 - DEBUG - [Pod Pod ctest-pod-09592859] Cmd wget http://10.102.128.57:80/ -O - -T 5 -t 1 passed
2025-02-11 19:23:40,070 - DEBUG - [Pod Pod ctest-pod-09592859] Cmd output: Connecting to 10.102.128.57:80 (10.102.128.57:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-88088038
2025-02-11 19:23:40,070 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-88088038': 1, 'ctest-pod-20558646': 2}
2025-02-11 19:23:42,137 - DEBUG - [Pod ctest-pod-30325397] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.770 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.106 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.085 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.085/0.320/0.770 ms
2025-02-11 19:23:42,137 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-30325397 with expectation True passed
2025-02-11 19:23:44,205 - DEBUG - [Pod ctest-pod-67389145] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.664 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.089 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.096 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.089/0.283/0.664 ms
2025-02-11 19:23:44,205 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-67389145 with expectation True passed
2025-02-11 19:23:46,284 - DEBUG - [Pod ctest-pod-09592859] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.685 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.081 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.094 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.081/0.286/0.685 ms
2025-02-11 19:23:46,284 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-09592859 with expectation True passed
2025-02-11 19:23:46,350 - DEBUG - [Pod ctest-pod-30325397] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-11 19:23:46,350 - DEBUG - [Pod Pod ctest-pod-30325397] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-02-11 19:23:46,350 - DEBUG - [Pod Pod ctest-pod-30325397] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-11 19:23:46,350 - INFO - wget check of of http://10.47.255.251 from ctest-pod-30325397 passed
2025-02-11 19:23:46,414 - DEBUG - [Pod ctest-pod-30325397] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-11 19:23:46,415 - DEBUG - [Pod Pod ctest-pod-30325397] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-02-11 19:23:46,415 - DEBUG - [Pod Pod ctest-pod-30325397] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-11 19:23:46,415 - INFO - wget check of of http://10.47.255.250 from ctest-pod-30325397 passed
2025-02-11 19:23:51,477 - DEBUG - [Pod ctest-pod-67389145] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-02-11 19:23:51,477 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-02-11 19:23:51,477 - DEBUG - [Pod Pod ctest-pod-67389145] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-02-11 19:23:51,477 - INFO - wget check of of http://10.47.255.250 from ctest-pod-67389145 passed
2025-02-11 19:23:51,537 - DEBUG - [Pod ctest-pod-78954178] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-11 19:23:51,537 - DEBUG - [Pod Pod ctest-pod-78954178] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-02-11 19:23:51,537 - DEBUG - [Pod Pod ctest-pod-78954178] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-11 19:23:51,538 - INFO - wget check of of http://10.47.255.251 from ctest-pod-78954178 passed
2025-02-11 19:23:51,538 - INFO - Deleting Network Policy : ingress-on-service
2025-02-11 19:23:51,538 - INFO - Deleting service : ctest-nginx-svc-40646085
2025-02-11 19:23:51,780 - DEBUG - No XMPP flaps were noticed during the test
2025-02-11 19:23:51,780 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:06]
2025-02-11 19:23:51,780 - INFO - --------------------------------------------------------------------------------
2025-02-11 19:23:51,786 - INFO - Deleting pod ctest-new-default-41758632:ctest-pod-88088038
2025-02-11 19:23:51,786 - INFO - Deleting pod ctest-new-default-41758632:ctest-pod-20558646
2025-02-11 19:23:51,787 - INFO - Deleting pod ctest-non-default-38715680:ctest-pod-11899596
2025-02-11 19:23:51,787 - INFO - Deleting pod ctest-non-default-38715680:ctest-pod-85991840
2025-02-11 19:23:51,787 - INFO - Deleting pod ctest-new-default-41758632:ctest-pod-67389145
2025-02-11 19:23:51,788 - INFO - Deleting pod ctest-new-default-41758632:ctest-pod-30325397
2025-02-11 19:23:51,788 - INFO - Deleting pod ctest-non-default-38715680:ctest-pod-09592859
2025-02-11 19:23:51,788 - INFO - Deleting pod ctest-non-default-38715680:ctest-pod-78954178
2025-02-11 19:23:51,894 - WARNING - Pod uuid 2fe56e55-ab76-4ae9-be0a-af4aeb76cc06 is still seen in agent 10.0.0.22 VM list
2025-02-11 19:23:51,898 - WARNING - Pod uuid 6f02b650-41e8-4fba-a59e-2a7006d7367c is still seen in agent 10.0.0.22 VM list
2025-02-11 19:23:51,900 - WARNING - Pod uuid a941512f-9f28-4393-9f18-6104834f42e3 is still seen in agent 10.0.0.22 VM list
2025-02-11 19:23:51,946 - WARNING - Pod uuid 1857e7b9-d79e-422b-9f7f-7b11408efd3b is still seen in agent 10.0.0.22 VM list
2025-02-11 19:23:51,947 - WARNING - Pod uuid f45b5b4d-bd09-4ac2-9982-5269874254f7 is still seen in agent 10.0.0.22 VM list
2025-02-11 19:23:51,947 - WARNING - Pod uuid 17b6a06e-99da-4b27-9b3d-2ec7fbe18589 is still seen in agent 10.0.0.22 VM list
2025-02-11 19:23:51,948 - WARNING - Pod uuid 4f9447d5-953b-4c85-8c7b-4591f44eaba8 is still seen in agent 10.0.0.22 VM list
2025-02-11 19:23:51,949 - WARNING - Pod uuid 6b589b1e-5e76-4c59-882c-d1fc654ae9f5 is still seen in agent 10.0.0.22 VM list
2025-02-11 19:23:56,904 - DEBUG - Pod 2fe56e55-ab76-4ae9-be0a-af4aeb76cc06 is not in agent 10.0.0.22 VM list
2025-02-11 19:23:56,912 - DEBUG - Pod a941512f-9f28-4393-9f18-6104834f42e3 is not in agent 10.0.0.22 VM list
2025-02-11 19:23:56,916 - DEBUG - VMI 41405876-e8ad-11ef-831e-fa163e508488 is removed from agent 10.0.0.22
2025-02-11 19:23:56,916 - INFO - Verified that pod ctest-pod-85991840 is removed in agent
2025-02-11 19:23:56,916 - WARNING - Pod uuid 6f02b650-41e8-4fba-a59e-2a7006d7367c is still seen in agent 10.0.0.22 VM list
2025-02-11 19:23:56,921 - DEBUG - VMI 3f5532c0-e8ad-11ef-831e-fa163e508488 is removed from agent 10.0.0.22
2025-02-11 19:23:56,921 - INFO - Verified that pod ctest-pod-88088038 is removed in agent
2025-02-11 19:23:56,969 - DEBUG - Pod f45b5b4d-bd09-4ac2-9982-5269874254f7 is not in agent 10.0.0.22 VM list
2025-02-11 19:23:56,971 - WARNING - Pod uuid 1857e7b9-d79e-422b-9f7f-7b11408efd3b is still seen in agent 10.0.0.22 VM list
2025-02-11 19:23:56,973 - DEBUG - Pod 6b589b1e-5e76-4c59-882c-d1fc654ae9f5 is not in agent 10.0.0.22 VM list
2025-02-11 19:23:56,975 - WARNING - Pod uuid 17b6a06e-99da-4b27-9b3d-2ec7fbe18589 is still seen in agent 10.0.0.22 VM list
2025-02-11 19:23:56,975 - WARNING - Pod uuid 4f9447d5-953b-4c85-8c7b-4591f44eaba8 is still seen in agent 10.0.0.22 VM list
2025-02-11 19:23:56,983 - DEBUG - VMI 3ff0b542-e8ad-11ef-831e-fa163e508488 is removed from agent 10.0.0.22
2025-02-11 19:23:56,983 - INFO - Verified that pod ctest-pod-20558646 is removed in agent
2025-02-11 19:23:56,984 - DEBUG - VMI 40ad51ac-e8ad-11ef-831e-fa163e508488 is removed from agent 10.0.0.22
2025-02-11 19:23:56,985 - INFO - Verified that pod ctest-pod-11899596 is removed in agent
2025-02-11 19:24:01,925 - WARNING - Pod uuid 6f02b650-41e8-4fba-a59e-2a7006d7367c is still seen in agent 10.0.0.22 VM list
2025-02-11 19:24:01,980 - WARNING - Pod uuid 1857e7b9-d79e-422b-9f7f-7b11408efd3b is still seen in agent 10.0.0.22 VM list
2025-02-11 19:24:01,989 - WARNING - Pod uuid 17b6a06e-99da-4b27-9b3d-2ec7fbe18589 is still seen in agent 10.0.0.22 VM list
2025-02-11 19:24:01,989 - WARNING - Pod uuid 4f9447d5-953b-4c85-8c7b-4591f44eaba8 is still seen in agent 10.0.0.22 VM list
2025-02-11 19:24:06,933 - WARNING - Pod uuid 6f02b650-41e8-4fba-a59e-2a7006d7367c is still seen in agent 10.0.0.22 VM list
2025-02-11 19:24:06,989 - WARNING - Pod uuid 1857e7b9-d79e-422b-9f7f-7b11408efd3b is still seen in agent 10.0.0.22 VM list
2025-02-11 19:24:07,000 - WARNING - Pod uuid 17b6a06e-99da-4b27-9b3d-2ec7fbe18589 is still seen in agent 10.0.0.22 VM list
2025-02-11 19:24:07,001 - WARNING - Pod uuid 4f9447d5-953b-4c85-8c7b-4591f44eaba8 is still seen in agent 10.0.0.22 VM list
2025-02-11 19:24:11,943 - WARNING - Pod uuid 6f02b650-41e8-4fba-a59e-2a7006d7367c is still seen in agent 10.0.0.22 VM list
2025-02-11 19:24:11,998 - WARNING - Pod uuid 1857e7b9-d79e-422b-9f7f-7b11408efd3b is still seen in agent 10.0.0.22 VM list
2025-02-11 19:24:12,012 - WARNING - Pod uuid 17b6a06e-99da-4b27-9b3d-2ec7fbe18589 is still seen in agent 10.0.0.22 VM list
2025-02-11 19:24:12,013 - WARNING - Pod uuid 4f9447d5-953b-4c85-8c7b-4591f44eaba8 is still seen in agent 10.0.0.22 VM list
2025-02-11 19:24:16,951 - WARNING - Pod uuid 6f02b650-41e8-4fba-a59e-2a7006d7367c is still seen in agent 10.0.0.22 VM list
2025-02-11 19:24:17,006 - WARNING - Pod uuid 1857e7b9-d79e-422b-9f7f-7b11408efd3b is still seen in agent 10.0.0.22 VM list
2025-02-11 19:24:17,025 - WARNING - Pod uuid 4f9447d5-953b-4c85-8c7b-4591f44eaba8 is still seen in agent 10.0.0.22 VM list
2025-02-11 19:24:17,026 - WARNING - Pod uuid 17b6a06e-99da-4b27-9b3d-2ec7fbe18589 is still seen in agent 10.0.0.22 VM list
2025-02-11 19:24:21,960 - WARNING - Pod uuid 6f02b650-41e8-4fba-a59e-2a7006d7367c is still seen in agent 10.0.0.22 VM list
2025-02-11 19:24:22,015 - WARNING - Pod uuid 1857e7b9-d79e-422b-9f7f-7b11408efd3b is still seen in agent 10.0.0.22 VM list
2025-02-11 19:24:22,054 - WARNING - Pod uuid 4f9447d5-953b-4c85-8c7b-4591f44eaba8 is still seen in agent 10.0.0.22 VM list
2025-02-11 19:24:22,055 - WARNING - Pod uuid 17b6a06e-99da-4b27-9b3d-2ec7fbe18589 is still seen in agent 10.0.0.22 VM list
2025-02-11 19:24:26,968 - DEBUG - Pod 6f02b650-41e8-4fba-a59e-2a7006d7367c is not in agent 10.0.0.22 VM list
2025-02-11 19:24:26,975 - DEBUG - VMI 42665f8e-e8ad-11ef-831e-fa163e508488 is removed from agent 10.0.0.22
2025-02-11 19:24:26,975 - INFO - Verified that pod ctest-pod-30325397 is removed in agent
2025-02-11 19:24:27,024 - DEBUG - Pod 1857e7b9-d79e-422b-9f7f-7b11408efd3b is not in agent 10.0.0.22 VM list
2025-02-11 19:24:27,035 - DEBUG - VMI 41e3bad4-e8ad-11ef-831e-fa163e508488 is removed from agent 10.0.0.22
2025-02-11 19:24:27,035 - INFO - Verified that pod ctest-pod-67389145 is removed in agent
2025-02-11 19:24:27,067 - DEBUG - Pod 4f9447d5-953b-4c85-8c7b-4591f44eaba8 is not in agent 10.0.0.22 VM list
2025-02-11 19:24:27,069 - DEBUG - Pod 17b6a06e-99da-4b27-9b3d-2ec7fbe18589 is not in agent 10.0.0.22 VM list
2025-02-11 19:24:27,079 - DEBUG - VMI 42e054b0-e8ad-11ef-831e-fa163e508488 is removed from agent 10.0.0.22
2025-02-11 19:24:27,079 - INFO - Verified that pod ctest-pod-09592859 is removed in agent
2025-02-11 19:24:27,080 - DEBUG - VMI 4363dc18-e8ad-11ef-831e-fa163e508488 is removed from agent 10.0.0.22
2025-02-11 19:24:27,080 - INFO - Verified that pod ctest-pod-78954178 is removed in agent
2025-02-11 19:24:27,081 - INFO - Deleting namespace ctest-non-default-38715680
2025-02-11 19:24:27,091 - DEBUG - Namespace ctest-non-default-38715680 still in k8s
2025-02-11 19:24:29,096 - DEBUG - Namespace ctest-non-default-38715680 still in k8s
2025-02-11 19:24:31,101 - DEBUG - Namespace ctest-non-default-38715680 still in k8s
2025-02-11 19:24:33,106 - DEBUG - Namespace ctest-non-default-38715680 is not in k8s
2025-02-11 19:24:33,106 - DEBUG - No need to check project deletion in contrail-api
2025-02-11 19:24:33,106 - INFO - Deleting namespace ctest-new-default-41758632
2025-02-11 19:24:33,127 - DEBUG - Namespace ctest-new-default-41758632 still in k8s
2025-02-11 19:24:35,133 - DEBUG - Namespace ctest-new-default-41758632 still in k8s
2025-02-11 19:24:37,137 - DEBUG - Namespace ctest-new-default-41758632 still in k8s
2025-02-11 19:24:39,149 - DEBUG - Namespace ctest-new-default-41758632 is not in k8s
2025-02-11 19:24:39,149 - DEBUG - No need to check project deletion in contrail-api