2025-04-22 20:12:07,611 - INFO - Using existing project ['default-domain', 'k8s-default'](0aee06f9-a7bc-40ab-8e98-7d13ebcba375)
2025-04-22 20:12:07,635 - DEBUG - Namespace ctest-new-default-55626280 not present
2025-04-22 20:12:07,647 - INFO - Created namespace ctest-new-default-55626280
2025-04-22 20:12:10,651 - DEBUG - Namespace ctest-non-default-86346790 not present
2025-04-22 20:12:10,664 - INFO - Created namespace ctest-non-default-86346790
2025-04-22 20:12:13,687 - DEBUG - Pod ctest-pod-51372412 not present
2025-04-22 20:12:13,687 - INFO - Creating Pod ctest-pod-51372412
2025-04-22 20:12:13,737 - DEBUG - Pod : ctest-pod-51372412 UUID is 17e4f7c2-9ca7-4234-b2a3-c4ece3f60f33
2025-04-22 20:12:13,740 - DEBUG - Pod ctest-pod-11228789 not present
2025-04-22 20:12:13,740 - INFO - Creating Pod ctest-pod-11228789
2025-04-22 20:12:13,786 - DEBUG - Pod : ctest-pod-11228789 UUID is ea1104ae-225f-44d4-8fb3-67c8d05805c6
2025-04-22 20:12:13,789 - DEBUG - Pod ctest-pod-03440369 not present
2025-04-22 20:12:13,789 - INFO - Creating Pod ctest-pod-03440369
2025-04-22 20:12:13,822 - DEBUG - Pod : ctest-pod-03440369 UUID is afab0676-4c02-4e30-b1f2-bb454958ab95
2025-04-22 20:12:13,824 - DEBUG - Pod ctest-pod-28167601 not present
2025-04-22 20:12:13,825 - INFO - Creating Pod ctest-pod-28167601
2025-04-22 20:12:13,854 - DEBUG - Pod : ctest-pod-28167601 UUID is 8172c223-1d42-43e3-9adf-ad830b45e726
2025-04-22 20:12:13,859 - DEBUG - Pod ctest-pod-26716374 not present
2025-04-22 20:12:13,859 - INFO - Creating Pod ctest-pod-26716374
2025-04-22 20:12:13,897 - DEBUG - Pod : ctest-pod-26716374 UUID is 09ebb49b-74c1-42d9-89e4-730c05cb10b8
2025-04-22 20:12:13,916 - DEBUG - Pod ctest-pod-08735177 not present
2025-04-22 20:12:13,916 - INFO - Creating Pod ctest-pod-08735177
2025-04-22 20:12:13,941 - DEBUG - Pod : ctest-pod-08735177 UUID is 90ca79ea-a301-4e86-a408-e99074e73c39
2025-04-22 20:12:13,943 - DEBUG - Pod ctest-pod-84369383 not present
2025-04-22 20:12:13,944 - INFO - Creating Pod ctest-pod-84369383
2025-04-22 20:12:13,968 - DEBUG - Pod : ctest-pod-84369383 UUID is 6fe746d9-18e9-468a-81e8-df9446b22227
2025-04-22 20:12:13,971 - DEBUG - Pod ctest-pod-22980554 not present
2025-04-22 20:12:13,971 - INFO - Creating Pod ctest-pod-22980554
2025-04-22 20:12:13,988 - DEBUG - Pod : ctest-pod-22980554 UUID is 5eb3aff2-1c86-4f3a-8f8b-cad55ce59a85
2025-04-22 20:12:14,269 - INFO - Project default-domain:k8s-ctest-new-default-55626280 for Namespace ctest-new-default-55626280 is seen in contrail-api
2025-04-22 20:12:14,269 - DEBUG - Project uuid in Contrail is 0ac20456-5ae5-41c7-83ee-c93c52cf7eb9
2025-04-22 20:12:14,508 - DEBUG - Requesting: http://10.0.0.137:8108/Snh_NamespaceDatabaseList?namespace_uuid=ac499441-ba7a-4f9d-9743-586bacb8c3f9
2025-04-22 20:12:14,513 - INFO - Namespace ctest-new-default-55626280 with uuid ac499441-ba7a-4f9d-9743-586bacb8c3f9 found in kube manager
2025-04-22 20:12:14,514 - INFO - Namespace ctest-new-default-55626280 verification passed
2025-04-22 20:12:14,785 - INFO - Project default-domain:k8s-ctest-non-default-86346790 for Namespace ctest-non-default-86346790 is seen in contrail-api
2025-04-22 20:12:14,785 - DEBUG - Project uuid in Contrail is 1b3b1326-8e0c-48f3-9264-6df18c9e5b98
2025-04-22 20:12:14,785 - DEBUG - Requesting: http://10.0.0.137:8108/Snh_NamespaceDatabaseList?namespace_uuid=e8a3298d-649a-431d-809d-6c4fd914f938
2025-04-22 20:12:14,792 - INFO - Namespace ctest-non-default-86346790 with uuid e8a3298d-649a-431d-809d-6c4fd914f938 found in kube manager
2025-04-22 20:12:14,792 - INFO - Namespace ctest-non-default-86346790 verification passed
2025-04-22 20:12:14,800 - DEBUG - Pod ctest-pod-51372412 not in running state.Currently in Pending
2025-04-22 20:12:19,815 - DEBUG - Pod ctest-pod-51372412 not in running state.Currently in Pending
2025-04-22 20:12:24,823 - DEBUG - Pod ctest-pod-51372412 not in running state.Currently in Pending
2025-04-22 20:12:29,836 - INFO - Pod ctest-pod-51372412 is in running state.Got IP 10.47.255.251
2025-04-22 20:12:29,849 - DEBUG - Pod ctest-pod-51372412 has vmi 15add2f2-1fb6-11f0-9ee4-fa163efb1208
2025-04-22 20:12:29,849 - INFO - Verified pod ctest-pod-51372412 in contrail-api
2025-04-22 20:12:29,863 - DEBUG - VMI 15add2f2-1fb6-11f0-9ee4-fa163efb1208 is active in agent 10.0.0.41
2025-04-22 20:12:29,864 - INFO - Verified Pod ctest-pod-51372412 in agent 10.0.0.41
2025-04-22 20:12:29,864 - DEBUG - Requesting: http://10.0.0.137:8108/Snh_VirtualMachineDatabaseList?x=17e4f7c2-9ca7-4234-b2a3-c4ece3f60f33
2025-04-22 20:12:29,868 - INFO - Pod ctest-pod-51372412 with uuid 17e4f7c2-9ca7-4234-b2a3-c4ece3f60f33 found in kube manager
2025-04-22 20:12:29,868 - INFO - Pod ctest-pod-51372412 verification passed
2025-04-22 20:12:29,873 - INFO - Pod ctest-pod-11228789 is in running state.Got IP 10.47.255.250
2025-04-22 20:12:29,931 - DEBUG - Pod ctest-pod-11228789 has vmi 1631ec72-1fb6-11f0-9ee4-fa163efb1208
2025-04-22 20:12:29,931 - INFO - Verified pod ctest-pod-11228789 in contrail-api
2025-04-22 20:12:29,943 - DEBUG - VMI 1631ec72-1fb6-11f0-9ee4-fa163efb1208 is active in agent 10.0.0.41
2025-04-22 20:12:29,943 - INFO - Verified Pod ctest-pod-11228789 in agent 10.0.0.41
2025-04-22 20:12:29,943 - DEBUG - Requesting: http://10.0.0.137:8108/Snh_VirtualMachineDatabaseList?x=ea1104ae-225f-44d4-8fb3-67c8d05805c6
2025-04-22 20:12:29,947 - INFO - Pod ctest-pod-11228789 with uuid ea1104ae-225f-44d4-8fb3-67c8d05805c6 found in kube manager
2025-04-22 20:12:29,947 - INFO - Pod ctest-pod-11228789 verification passed
2025-04-22 20:12:29,952 - INFO - Pod ctest-pod-03440369 is in running state.Got IP 10.47.255.249
2025-04-22 20:12:30,007 - DEBUG - Pod ctest-pod-03440369 has vmi 170613bc-1fb6-11f0-9ee4-fa163efb1208
2025-04-22 20:12:30,007 - INFO - Verified pod ctest-pod-03440369 in contrail-api
2025-04-22 20:12:30,022 - DEBUG - VMI 170613bc-1fb6-11f0-9ee4-fa163efb1208 is active in agent 10.0.0.41
2025-04-22 20:12:30,022 - INFO - Verified Pod ctest-pod-03440369 in agent 10.0.0.41
2025-04-22 20:12:30,022 - DEBUG - Requesting: http://10.0.0.137:8108/Snh_VirtualMachineDatabaseList?x=afab0676-4c02-4e30-b1f2-bb454958ab95
2025-04-22 20:12:30,028 - INFO - Pod ctest-pod-03440369 with uuid afab0676-4c02-4e30-b1f2-bb454958ab95 found in kube manager
2025-04-22 20:12:30,028 - INFO - Pod ctest-pod-03440369 verification passed
2025-04-22 20:12:30,035 - INFO - Pod ctest-pod-28167601 is in running state.Got IP 10.47.255.248
2025-04-22 20:12:30,050 - DEBUG - Pod ctest-pod-28167601 has vmi 179ff644-1fb6-11f0-9ee4-fa163efb1208
2025-04-22 20:12:30,051 - INFO - Verified pod ctest-pod-28167601 in contrail-api
2025-04-22 20:12:30,062 - DEBUG - VMI 179ff644-1fb6-11f0-9ee4-fa163efb1208 is active in agent 10.0.0.41
2025-04-22 20:12:30,062 - INFO - Verified Pod ctest-pod-28167601 in agent 10.0.0.41
2025-04-22 20:12:30,062 - DEBUG - Requesting: http://10.0.0.137:8108/Snh_VirtualMachineDatabaseList?x=8172c223-1d42-43e3-9adf-ad830b45e726
2025-04-22 20:12:30,066 - INFO - Pod ctest-pod-28167601 with uuid 8172c223-1d42-43e3-9adf-ad830b45e726 found in kube manager
2025-04-22 20:12:30,066 - INFO - Pod ctest-pod-28167601 verification passed
2025-04-22 20:12:30,071 - DEBUG - Pod ctest-pod-26716374 not in running state.Currently in Pending
2025-04-22 20:12:35,077 - INFO - Pod ctest-pod-26716374 is in running state.Got IP 10.47.255.247
2025-04-22 20:12:35,090 - DEBUG - Pod ctest-pod-26716374 has vmi 1823dcd4-1fb6-11f0-9ee4-fa163efb1208
2025-04-22 20:12:35,091 - INFO - Verified pod ctest-pod-26716374 in contrail-api
2025-04-22 20:12:35,103 - DEBUG - VMI 1823dcd4-1fb6-11f0-9ee4-fa163efb1208 is active in agent 10.0.0.41
2025-04-22 20:12:35,103 - INFO - Verified Pod ctest-pod-26716374 in agent 10.0.0.41
2025-04-22 20:12:35,103 - DEBUG - Requesting: http://10.0.0.137:8108/Snh_VirtualMachineDatabaseList?x=09ebb49b-74c1-42d9-89e4-730c05cb10b8
2025-04-22 20:12:35,107 - INFO - Pod ctest-pod-26716374 with uuid 09ebb49b-74c1-42d9-89e4-730c05cb10b8 found in kube manager
2025-04-22 20:12:35,107 - INFO - Pod ctest-pod-26716374 verification passed
2025-04-22 20:12:35,112 - INFO - Pod ctest-pod-84369383 is in running state.Got IP 10.47.255.245
2025-04-22 20:12:35,166 - DEBUG - Pod ctest-pod-84369383 has vmi 19168358-1fb6-11f0-9ee4-fa163efb1208
2025-04-22 20:12:35,166 - INFO - Verified pod ctest-pod-84369383 in contrail-api
2025-04-22 20:12:35,178 - DEBUG - VMI 19168358-1fb6-11f0-9ee4-fa163efb1208 is active in agent 10.0.0.41
2025-04-22 20:12:35,178 - INFO - Verified Pod ctest-pod-84369383 in agent 10.0.0.41
2025-04-22 20:12:35,179 - DEBUG - Requesting: http://10.0.0.137:8108/Snh_VirtualMachineDatabaseList?x=6fe746d9-18e9-468a-81e8-df9446b22227
2025-04-22 20:12:35,184 - INFO - Pod ctest-pod-84369383 with uuid 6fe746d9-18e9-468a-81e8-df9446b22227 found in kube manager
2025-04-22 20:12:35,184 - INFO - Pod ctest-pod-84369383 verification passed
2025-04-22 20:12:35,250 - INFO - Pod ctest-pod-08735177 is in running state.Got IP 10.47.255.246
2025-04-22 20:12:35,263 - DEBUG - Pod ctest-pod-08735177 has vmi 18a5b5e2-1fb6-11f0-9ee4-fa163efb1208
2025-04-22 20:12:35,264 - INFO - Verified pod ctest-pod-08735177 in contrail-api
2025-04-22 20:12:35,276 - DEBUG - VMI 18a5b5e2-1fb6-11f0-9ee4-fa163efb1208 is active in agent 10.0.0.41
2025-04-22 20:12:35,276 - INFO - Verified Pod ctest-pod-08735177 in agent 10.0.0.41
2025-04-22 20:12:35,277 - DEBUG - Requesting: http://10.0.0.137:8108/Snh_VirtualMachineDatabaseList?x=90ca79ea-a301-4e86-a408-e99074e73c39
2025-04-22 20:12:35,282 - INFO - Pod ctest-pod-08735177 with uuid 90ca79ea-a301-4e86-a408-e99074e73c39 found in kube manager
2025-04-22 20:12:35,284 - INFO - Pod ctest-pod-08735177 verification passed
2025-04-22 20:12:35,294 - INFO - Pod ctest-pod-22980554 is in running state.Got IP 10.47.255.244
2025-04-22 20:12:35,359 - DEBUG - Pod ctest-pod-22980554 has vmi 1986744c-1fb6-11f0-9ee4-fa163efb1208
2025-04-22 20:12:35,359 - INFO - Verified pod ctest-pod-22980554 in contrail-api
2025-04-22 20:12:35,371 - DEBUG - VMI 1986744c-1fb6-11f0-9ee4-fa163efb1208 is active in agent 10.0.0.41
2025-04-22 20:12:35,371 - INFO - Verified Pod ctest-pod-22980554 in agent 10.0.0.41
2025-04-22 20:12:35,371 - DEBUG - Requesting: http://10.0.0.137:8108/Snh_VirtualMachineDatabaseList?x=5eb3aff2-1c86-4f3a-8f8b-cad55ce59a85
2025-04-22 20:12:35,375 - INFO - Pod ctest-pod-22980554 with uuid 5eb3aff2-1c86-4f3a-8f8b-cad55ce59a85 found in kube manager
2025-04-22 20:12:35,375 - INFO - Pod ctest-pod-22980554 verification passed
2025-04-22 20:12:35,375 - INFO - ================================================================================
2025-04-22 20:12:35,375 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-04-22 20:12:35,375 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-04-22 20:12:35,598 - DEBUG - Nothing to compare xmpp stats {'10.0.0.41': {'10.0.0.137': '0'}} with
2025-04-22 20:12:35,598 - INFO - Initial checks done. Running the testcase now
2025-04-22 20:12:35,598 - INFO -
2025-04-22 20:12:35,645 - DEBUG - [Pod ctest-pod-51372412] Cmd: echo ctest-pod-51372412 > /usr/share/nginx/html/index.html, Output:
2025-04-22 20:12:35,694 - DEBUG - [Pod ctest-pod-11228789] Cmd: echo ctest-pod-11228789 > /usr/share/nginx/html/index.html, Output:
2025-04-22 20:12:35,743 - DEBUG - [Pod ctest-pod-03440369] Cmd: echo ctest-pod-03440369 > /usr/share/nginx/html/index.html, Output:
2025-04-22 20:12:35,795 - DEBUG - [Pod ctest-pod-28167601] Cmd: echo ctest-pod-28167601 > /usr/share/nginx/html/index.html, Output:
2025-04-22 20:12:35,797 - DEBUG - Service ctest-nginx-svc-13305313 not present
2025-04-22 20:12:35,798 - INFO - Creating service ctest-nginx-svc-13305313
2025-04-22 20:12:35,812 - INFO - Created Service ctest-nginx-svc-13305313
2025-04-22 20:12:35,821 - WARNING - Service UUID 721e5714-dbb0-4338-8bc5-ae5dc400b8a7 not yet found in contrail-api
2025-04-22 20:12:36,827 - INFO - Validated that Service ctest-nginx-svc-13305313 is seen in contrail-api
2025-04-22 20:12:36,827 - DEBUG - Requesting: http://10.0.0.137:8108/Snh_LoadbalancerDatabaseList?x=721e5714-dbb0-4338-8bc5-ae5dc400b8a7
2025-04-22 20:12:36,836 - INFO - Service ctest-nginx-svc-13305313 with uuid 721e5714-dbb0-4338-8bc5-ae5dc400b8a7 found in kube manager
2025-04-22 20:12:36,836 - INFO - Service ctest-nginx-svc-13305313 verification passed
2025-04-22 20:12:37,893 - DEBUG - [Pod ctest-pod-26716374] Cmd: wget http://10.109.43.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-51372412
2025-04-22 20:12:37,893 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd wget http://10.109.43.248:80/ -O - -T 5 -t 1 passed
2025-04-22 20:12:37,893 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-51372412
2025-04-22 20:12:37,947 - DEBUG - [Pod ctest-pod-26716374] Cmd: wget http://10.109.43.248:80/ -O - -T 5 -t 1 , Output: ctest-pod-11228789
Connecting to 10.109.43.248:80 (10.109.43.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 20:12:37,947 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd wget http://10.109.43.248:80/ -O - -T 5 -t 1 passed
2025-04-22 20:12:37,947 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd output: ctest-pod-11228789
Connecting to 10.109.43.248:80 (10.109.43.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 20:12:37,947 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-51372412': 1, 'ctest-pod-11228789': 1}
2025-04-22 20:12:38,002 - DEBUG - [Pod ctest-pod-84369383] Cmd: wget http://10.109.43.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-11228789
2025-04-22 20:12:38,002 - DEBUG - [Pod Pod ctest-pod-84369383] Cmd wget http://10.109.43.248:80/ -O - -T 5 -t 1 passed
2025-04-22 20:12:38,002 - DEBUG - [Pod Pod ctest-pod-84369383] Cmd output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-11228789
2025-04-22 20:12:38,053 - DEBUG - [Pod ctest-pod-84369383] Cmd: wget http://10.109.43.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-11228789
2025-04-22 20:12:38,053 - DEBUG - [Pod Pod ctest-pod-84369383] Cmd wget http://10.109.43.248:80/ -O - -T 5 -t 1 passed
2025-04-22 20:12:38,053 - DEBUG - [Pod Pod ctest-pod-84369383] Cmd output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-11228789
2025-04-22 20:12:38,097 - DEBUG - [Pod ctest-pod-84369383] Cmd: wget http://10.109.43.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
ctest-pod-51372412
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 20:12:38,097 - DEBUG - [Pod Pod ctest-pod-84369383] Cmd wget http://10.109.43.248:80/ -O - -T 5 -t 1 passed
2025-04-22 20:12:38,097 - DEBUG - [Pod Pod ctest-pod-84369383] Cmd output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
ctest-pod-51372412
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 20:12:38,097 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-51372412': 1, 'ctest-pod-11228789': 2}
2025-04-22 20:12:38,100 - DEBUG - Network policy ingress-on-service not present
2025-04-22 20:12:38,101 - INFO - Creating Network Policy ingress-on-service
2025-04-22 20:12:38,117 - INFO - Network policy found in k8s
2025-04-22 20:12:38,117 - DEBUG - Requesting: http://10.0.0.137:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=340dbdad-3f2a-446e-8abd-c20043cb90f4
2025-04-22 20:12:38,124 - INFO - Network Policy ingress-on-service with uuid 340dbdad-3f2a-446e-8abd-c20043cb90f4 found in kube manager
2025-04-22 20:12:38,156 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-04-22 20:12:38,156 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-04-22 20:12:38,156 - DEBUG - Requesting: http://10.0.0.137:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=340dbdad-3f2a-446e-8abd-c20043cb90f4
2025-04-22 20:12:38,184 - WARNING - Network policy with name ingress-on-service not found in agent
2025-04-22 20:12:40,185 - DEBUG - Requesting: http://10.0.0.137:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=340dbdad-3f2a-446e-8abd-c20043cb90f4
2025-04-22 20:12:40,220 - INFO - Network policy with name ingress-on-service found in agent
2025-04-22 20:12:40,221 - INFO - Network Policy ingress-on-service verification passed
2025-04-22 20:12:45,263 - DEBUG - [Pod ctest-pod-26716374] Cmd: wget http://10.109.43.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:12:45,264 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd wget http://10.109.43.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:12:45,264 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:12:50,312 - DEBUG - [Pod ctest-pod-26716374] Cmd: wget http://10.109.43.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:12:50,312 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd wget http://10.109.43.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:12:50,312 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:12:55,364 - DEBUG - [Pod ctest-pod-26716374] Cmd: wget http://10.109.43.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:12:55,364 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd wget http://10.109.43.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:12:55,364 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:13:00,415 - DEBUG - [Pod ctest-pod-26716374] Cmd: wget http://10.109.43.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:13:00,415 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd wget http://10.109.43.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:13:00,415 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:13:05,459 - DEBUG - [Pod ctest-pod-26716374] Cmd: wget http://10.109.43.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:13:05,459 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd wget http://10.109.43.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:13:05,459 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:13:10,503 - DEBUG - [Pod ctest-pod-26716374] Cmd: wget http://10.109.43.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:13:10,503 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd wget http://10.109.43.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:13:10,503 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:13:15,552 - DEBUG - [Pod ctest-pod-26716374] Cmd: wget http://10.109.43.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:13:15,552 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd wget http://10.109.43.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:13:15,552 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:13:20,596 - DEBUG - [Pod ctest-pod-26716374] Cmd: wget http://10.109.43.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:13:20,596 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd wget http://10.109.43.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:13:20,596 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:13:25,639 - DEBUG - [Pod ctest-pod-26716374] Cmd: wget http://10.109.43.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:13:25,640 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd wget http://10.109.43.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:13:25,640 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:13:30,687 - DEBUG - [Pod ctest-pod-26716374] Cmd: wget http://10.109.43.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:13:30,687 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd wget http://10.109.43.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:13:30,687 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:13:30,687 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-51372412': 0, 'ctest-pod-11228789': 0}
2025-04-22 20:13:30,743 - DEBUG - [Pod ctest-pod-08735177] Cmd: wget http://10.109.43.248:80/ -O - -T 5 -t 1 , Output: ctest-pod-51372412
Connecting to 10.109.43.248:80 (10.109.43.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 20:13:30,744 - DEBUG - [Pod Pod ctest-pod-08735177] Cmd wget http://10.109.43.248:80/ -O - -T 5 -t 1 passed
2025-04-22 20:13:30,744 - DEBUG - [Pod Pod ctest-pod-08735177] Cmd output: ctest-pod-51372412
Connecting to 10.109.43.248:80 (10.109.43.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 20:13:30,788 - DEBUG - [Pod ctest-pod-08735177] Cmd: wget http://10.109.43.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
ctest-pod-51372412
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 20:13:30,789 - DEBUG - [Pod Pod ctest-pod-08735177] Cmd wget http://10.109.43.248:80/ -O - -T 5 -t 1 passed
2025-04-22 20:13:30,789 - DEBUG - [Pod Pod ctest-pod-08735177] Cmd output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
ctest-pod-51372412
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 20:13:30,833 - DEBUG - [Pod ctest-pod-08735177] Cmd: wget http://10.109.43.248:80/ -O - -T 5 -t 1 , Output: ctest-pod-51372412
Connecting to 10.109.43.248:80 (10.109.43.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 20:13:30,833 - DEBUG - [Pod Pod ctest-pod-08735177] Cmd wget http://10.109.43.248:80/ -O - -T 5 -t 1 passed
2025-04-22 20:13:30,833 - DEBUG - [Pod Pod ctest-pod-08735177] Cmd output: ctest-pod-51372412
Connecting to 10.109.43.248:80 (10.109.43.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 20:13:30,881 - DEBUG - [Pod ctest-pod-08735177] Cmd: wget http://10.109.43.248:80/ -O - -T 5 -t 1 , Output: ctest-pod-11228789
Connecting to 10.109.43.248:80 (10.109.43.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 20:13:30,881 - DEBUG - [Pod Pod ctest-pod-08735177] Cmd wget http://10.109.43.248:80/ -O - -T 5 -t 1 passed
2025-04-22 20:13:30,881 - DEBUG - [Pod Pod ctest-pod-08735177] Cmd output: ctest-pod-11228789
Connecting to 10.109.43.248:80 (10.109.43.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 20:13:30,881 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-51372412': 3, 'ctest-pod-11228789': 1}
2025-04-22 20:13:35,910 - DEBUG - [Pod ctest-pod-84369383] Cmd: wget http://10.109.43.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:13:35,910 - DEBUG - [Pod Pod ctest-pod-84369383] Cmd wget http://10.109.43.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:13:35,910 - DEBUG - [Pod Pod ctest-pod-84369383] Cmd output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:13:40,955 - DEBUG - [Pod ctest-pod-84369383] Cmd: wget http://10.109.43.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:13:40,955 - DEBUG - [Pod Pod ctest-pod-84369383] Cmd wget http://10.109.43.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:13:40,955 - DEBUG - [Pod Pod ctest-pod-84369383] Cmd output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:13:45,999 - DEBUG - [Pod ctest-pod-84369383] Cmd: wget http://10.109.43.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:13:45,999 - DEBUG - [Pod Pod ctest-pod-84369383] Cmd wget http://10.109.43.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:13:45,999 - DEBUG - [Pod Pod ctest-pod-84369383] Cmd output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:13:49,055 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2025-04-22 20:13:59,384 - DEBUG - [Pod ctest-pod-84369383] Cmd: wget http://10.109.43.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:13:59,384 - DEBUG - [Pod Pod ctest-pod-84369383] Cmd wget http://10.109.43.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:13:59,384 - DEBUG - [Pod Pod ctest-pod-84369383] Cmd output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:14:04,435 - DEBUG - [Pod ctest-pod-84369383] Cmd: wget http://10.109.43.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:14:04,435 - DEBUG - [Pod Pod ctest-pod-84369383] Cmd wget http://10.109.43.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:14:04,435 - DEBUG - [Pod Pod ctest-pod-84369383] Cmd output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:14:09,507 - DEBUG - [Pod ctest-pod-84369383] Cmd: wget http://10.109.43.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:14:09,508 - DEBUG - [Pod Pod ctest-pod-84369383] Cmd wget http://10.109.43.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:14:09,508 - DEBUG - [Pod Pod ctest-pod-84369383] Cmd output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:14:14,556 - DEBUG - [Pod ctest-pod-84369383] Cmd: wget http://10.109.43.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:14:14,556 - DEBUG - [Pod Pod ctest-pod-84369383] Cmd wget http://10.109.43.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:14:14,556 - DEBUG - [Pod Pod ctest-pod-84369383] Cmd output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:14:19,603 - DEBUG - [Pod ctest-pod-84369383] Cmd: wget http://10.109.43.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:14:19,603 - DEBUG - [Pod Pod ctest-pod-84369383] Cmd wget http://10.109.43.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:14:19,603 - DEBUG - [Pod Pod ctest-pod-84369383] Cmd output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:14:24,659 - DEBUG - [Pod ctest-pod-84369383] Cmd: wget http://10.109.43.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:14:24,660 - DEBUG - [Pod Pod ctest-pod-84369383] Cmd wget http://10.109.43.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:14:24,660 - DEBUG - [Pod Pod ctest-pod-84369383] Cmd output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:14:29,713 - DEBUG - [Pod ctest-pod-84369383] Cmd: wget http://10.109.43.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:14:29,713 - DEBUG - [Pod Pod ctest-pod-84369383] Cmd wget http://10.109.43.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:14:29,713 - DEBUG - [Pod Pod ctest-pod-84369383] Cmd output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:14:29,713 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-51372412': 0, 'ctest-pod-11228789': 0}
2025-04-22 20:14:31,837 - DEBUG - [Pod ctest-pod-08735177] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.905 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.067 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.080 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.067/0.350/0.905 ms
2025-04-22 20:14:31,837 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-08735177 with expectation True passed
2025-04-22 20:14:33,884 - DEBUG - [Pod ctest-pod-26716374] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.932 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.054 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.064 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.054/0.350/0.932 ms
2025-04-22 20:14:33,884 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-26716374 with expectation True passed
2025-04-22 20:14:35,935 - DEBUG - [Pod ctest-pod-84369383] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.475 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.057 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.076 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.057/0.536/1.475 ms
2025-04-22 20:14:35,935 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-84369383 with expectation True passed
2025-04-22 20:14:35,993 - DEBUG - [Pod ctest-pod-08735177] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-22 20:14:35,993 - DEBUG - [Pod Pod ctest-pod-08735177] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-04-22 20:14:35,993 - DEBUG - [Pod Pod ctest-pod-08735177] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-22 20:14:35,993 - INFO - wget check of of http://10.47.255.251 from ctest-pod-08735177 passed
2025-04-22 20:14:36,045 - DEBUG - [Pod ctest-pod-08735177] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-22 20:14:36,045 - DEBUG - [Pod Pod ctest-pod-08735177] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-04-22 20:14:36,045 - DEBUG - [Pod Pod ctest-pod-08735177] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-22 20:14:36,045 - INFO - wget check of of http://10.47.255.250 from ctest-pod-08735177 passed
2025-04-22 20:14:41,091 - DEBUG - [Pod ctest-pod-26716374] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-22 20:14:41,091 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-22 20:14:41,091 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-22 20:14:41,092 - INFO - wget check of of http://10.47.255.250 from ctest-pod-26716374 passed
2025-04-22 20:14:46,137 - DEBUG - [Pod ctest-pod-22980554] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-04-22 20:14:46,137 - DEBUG - [Pod Pod ctest-pod-22980554] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-04-22 20:14:46,137 - DEBUG - [Pod Pod ctest-pod-22980554] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-04-22 20:14:46,137 - INFO - wget check of of http://10.47.255.251 from ctest-pod-22980554 passed
2025-04-22 20:14:46,145 - INFO - Updating Network Policy ingress-on-service
2025-04-22 20:14:51,203 - DEBUG - [Pod ctest-pod-26716374] Cmd: wget http://10.109.43.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:14:51,203 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd wget http://10.109.43.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:14:51,203 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:14:56,252 - DEBUG - [Pod ctest-pod-26716374] Cmd: wget http://10.109.43.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:14:56,252 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd wget http://10.109.43.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:14:56,252 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:15:01,295 - DEBUG - [Pod ctest-pod-26716374] Cmd: wget http://10.109.43.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:15:01,295 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd wget http://10.109.43.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:15:01,295 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:15:06,344 - DEBUG - [Pod ctest-pod-26716374] Cmd: wget http://10.109.43.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:15:06,344 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd wget http://10.109.43.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:15:06,344 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:15:11,396 - DEBUG - [Pod ctest-pod-26716374] Cmd: wget http://10.109.43.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:15:11,396 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd wget http://10.109.43.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:15:11,396 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:15:16,439 - DEBUG - [Pod ctest-pod-26716374] Cmd: wget http://10.109.43.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:15:16,439 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd wget http://10.109.43.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:15:16,439 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:15:21,487 - DEBUG - [Pod ctest-pod-26716374] Cmd: wget http://10.109.43.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:15:21,487 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd wget http://10.109.43.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:15:21,487 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:15:26,535 - DEBUG - [Pod ctest-pod-26716374] Cmd: wget http://10.109.43.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:15:26,536 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd wget http://10.109.43.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:15:26,536 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:15:31,583 - DEBUG - [Pod ctest-pod-26716374] Cmd: wget http://10.109.43.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:15:31,583 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd wget http://10.109.43.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:15:31,583 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:15:36,627 - DEBUG - [Pod ctest-pod-26716374] Cmd: wget http://10.109.43.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:15:36,628 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd wget http://10.109.43.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:15:36,628 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
wget: download timed out
2025-04-22 20:15:36,628 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-51372412': 0, 'ctest-pod-11228789': 0}
2025-04-22 20:15:36,685 - DEBUG - [Pod ctest-pod-08735177] Cmd: wget http://10.109.43.248:80/ -O - -T 5 -t 1 , Output: ctest-pod-51372412
Connecting to 10.109.43.248:80 (10.109.43.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 20:15:36,685 - DEBUG - [Pod Pod ctest-pod-08735177] Cmd wget http://10.109.43.248:80/ -O - -T 5 -t 1 passed
2025-04-22 20:15:36,685 - DEBUG - [Pod Pod ctest-pod-08735177] Cmd output: ctest-pod-51372412
Connecting to 10.109.43.248:80 (10.109.43.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 20:15:36,728 - DEBUG - [Pod ctest-pod-08735177] Cmd: wget http://10.109.43.248:80/ -O - -T 5 -t 1 , Output: ctest-pod-51372412
Connecting to 10.109.43.248:80 (10.109.43.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 20:15:36,728 - DEBUG - [Pod Pod ctest-pod-08735177] Cmd wget http://10.109.43.248:80/ -O - -T 5 -t 1 passed
2025-04-22 20:15:36,728 - DEBUG - [Pod Pod ctest-pod-08735177] Cmd output: ctest-pod-51372412
Connecting to 10.109.43.248:80 (10.109.43.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 20:15:36,761 - DEBUG - [Pod ctest-pod-08735177] Cmd: wget http://10.109.43.248:80/ -O - -T 5 -t 1 , Output: ctest-pod-51372412
Connecting to 10.109.43.248:80 (10.109.43.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 20:15:36,761 - DEBUG - [Pod Pod ctest-pod-08735177] Cmd wget http://10.109.43.248:80/ -O - -T 5 -t 1 passed
2025-04-22 20:15:36,761 - DEBUG - [Pod Pod ctest-pod-08735177] Cmd output: ctest-pod-51372412
Connecting to 10.109.43.248:80 (10.109.43.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 20:15:36,814 - DEBUG - [Pod ctest-pod-08735177] Cmd: wget http://10.109.43.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-51372412
2025-04-22 20:15:36,814 - DEBUG - [Pod Pod ctest-pod-08735177] Cmd wget http://10.109.43.248:80/ -O - -T 5 -t 1 passed
2025-04-22 20:15:36,814 - DEBUG - [Pod Pod ctest-pod-08735177] Cmd output: Connecting to 10.109.43.248:80 (10.109.43.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-51372412
2025-04-22 20:15:36,851 - DEBUG - [Pod ctest-pod-08735177] Cmd: wget http://10.109.43.248:80/ -O - -T 5 -t 1 , Output: ctest-pod-51372412
Connecting to 10.109.43.248:80 (10.109.43.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 20:15:36,851 - DEBUG - [Pod Pod ctest-pod-08735177] Cmd wget http://10.109.43.248:80/ -O - -T 5 -t 1 passed
2025-04-22 20:15:36,851 - DEBUG - [Pod Pod ctest-pod-08735177] Cmd output: ctest-pod-51372412
Connecting to 10.109.43.248:80 (10.109.43.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 20:15:36,896 - DEBUG - [Pod ctest-pod-08735177] Cmd: wget http://10.109.43.248:80/ -O - -T 5 -t 1 , Output: ctest-pod-11228789
Connecting to 10.109.43.248:80 (10.109.43.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 20:15:36,897 - DEBUG - [Pod Pod ctest-pod-08735177] Cmd wget http://10.109.43.248:80/ -O - -T 5 -t 1 passed
2025-04-22 20:15:36,897 - DEBUG - [Pod Pod ctest-pod-08735177] Cmd output: ctest-pod-11228789
Connecting to 10.109.43.248:80 (10.109.43.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 20:15:36,897 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-51372412': 5, 'ctest-pod-11228789': 1}
2025-04-22 20:15:36,944 - DEBUG - [Pod ctest-pod-84369383] Cmd: wget http://10.109.43.248:80/ -O - -T 5 -t 1 , Output: ctest-pod-51372412
Connecting to 10.109.43.248:80 (10.109.43.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 20:15:36,945 - DEBUG - [Pod Pod ctest-pod-84369383] Cmd wget http://10.109.43.248:80/ -O - -T 5 -t 1 passed
2025-04-22 20:15:36,945 - DEBUG - [Pod Pod ctest-pod-84369383] Cmd output: ctest-pod-51372412
Connecting to 10.109.43.248:80 (10.109.43.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 20:15:36,988 - DEBUG - [Pod ctest-pod-84369383] Cmd: wget http://10.109.43.248:80/ -O - -T 5 -t 1 , Output: ctest-pod-11228789
Connecting to 10.109.43.248:80 (10.109.43.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 20:15:36,988 - DEBUG - [Pod Pod ctest-pod-84369383] Cmd wget http://10.109.43.248:80/ -O - -T 5 -t 1 passed
2025-04-22 20:15:36,988 - DEBUG - [Pod Pod ctest-pod-84369383] Cmd output: ctest-pod-11228789
Connecting to 10.109.43.248:80 (10.109.43.248:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-22 20:15:36,988 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-51372412': 1, 'ctest-pod-11228789': 1}
2025-04-22 20:15:39,036 - DEBUG - [Pod ctest-pod-08735177] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.677 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.069 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.067 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.067/0.271/0.677 ms
2025-04-22 20:15:39,037 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-08735177 with expectation True passed
2025-04-22 20:15:41,079 - DEBUG - [Pod ctest-pod-26716374] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.919 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.067 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.072 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.067/0.352/0.919 ms
2025-04-22 20:15:41,079 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-26716374 with expectation True passed
2025-04-22 20:15:43,123 - DEBUG - [Pod ctest-pod-84369383] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.033 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.059 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.100 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.059/0.397/1.033 ms
2025-04-22 20:15:43,123 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-84369383 with expectation True passed
2025-04-22 20:15:43,174 - DEBUG - [Pod ctest-pod-08735177] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-22 20:15:43,174 - DEBUG - [Pod Pod ctest-pod-08735177] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-04-22 20:15:43,174 - DEBUG - [Pod Pod ctest-pod-08735177] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-22 20:15:43,174 - INFO - wget check of of http://10.47.255.251 from ctest-pod-08735177 passed
2025-04-22 20:15:43,224 - DEBUG - [Pod ctest-pod-08735177] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-22 20:15:43,224 - DEBUG - [Pod Pod ctest-pod-08735177] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-04-22 20:15:43,224 - DEBUG - [Pod Pod ctest-pod-08735177] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-22 20:15:43,224 - INFO - wget check of of http://10.47.255.250 from ctest-pod-08735177 passed
2025-04-22 20:15:48,271 - DEBUG - [Pod ctest-pod-26716374] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-22 20:15:48,271 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-22 20:15:48,271 - DEBUG - [Pod Pod ctest-pod-26716374] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-22 20:15:48,271 - INFO - wget check of of http://10.47.255.250 from ctest-pod-26716374 passed
2025-04-22 20:15:48,318 - DEBUG - [Pod ctest-pod-22980554] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-22 20:15:48,318 - DEBUG - [Pod Pod ctest-pod-22980554] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-04-22 20:15:48,318 - DEBUG - [Pod Pod ctest-pod-22980554] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-22 20:15:48,318 - INFO - wget check of of http://10.47.255.251 from ctest-pod-22980554 passed
2025-04-22 20:15:48,319 - INFO - Deleting Network Policy : ingress-on-service
2025-04-22 20:15:48,319 - INFO - Deleting service : ctest-nginx-svc-13305313
2025-04-22 20:15:48,550 - DEBUG - No XMPP flaps were noticed during the test
2025-04-22 20:15:48,550 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:13]
2025-04-22 20:15:48,550 - INFO - --------------------------------------------------------------------------------
2025-04-22 20:15:48,555 - INFO - Deleting pod ctest-new-default-55626280:ctest-pod-51372412
2025-04-22 20:15:48,555 - INFO - Deleting pod ctest-new-default-55626280:ctest-pod-11228789
2025-04-22 20:15:48,556 - INFO - Deleting pod ctest-non-default-86346790:ctest-pod-03440369
2025-04-22 20:15:48,556 - INFO - Deleting pod ctest-non-default-86346790:ctest-pod-28167601
2025-04-22 20:15:48,556 - INFO - Deleting pod ctest-new-default-55626280:ctest-pod-26716374
2025-04-22 20:15:48,557 - INFO - Deleting pod ctest-new-default-55626280:ctest-pod-08735177
2025-04-22 20:15:48,557 - INFO - Deleting pod ctest-non-default-86346790:ctest-pod-84369383
2025-04-22 20:15:48,557 - INFO - Deleting pod ctest-non-default-86346790:ctest-pod-22980554
2025-04-22 20:15:48,653 - WARNING - Pod uuid 17e4f7c2-9ca7-4234-b2a3-c4ece3f60f33 is still seen in agent 10.0.0.41 VM list
2025-04-22 20:15:48,802 - WARNING - Pod uuid 09ebb49b-74c1-42d9-89e4-730c05cb10b8 is still seen in agent 10.0.0.41 VM list
2025-04-22 20:15:48,803 - WARNING - Pod uuid 90ca79ea-a301-4e86-a408-e99074e73c39 is still seen in agent 10.0.0.41 VM list
2025-04-22 20:15:48,804 - WARNING - Pod uuid 8172c223-1d42-43e3-9adf-ad830b45e726 is still seen in agent 10.0.0.41 VM list
2025-04-22 20:15:48,806 - WARNING - Pod uuid ea1104ae-225f-44d4-8fb3-67c8d05805c6 is still seen in agent 10.0.0.41 VM list
2025-04-22 20:15:48,807 - WARNING - Pod uuid 5eb3aff2-1c86-4f3a-8f8b-cad55ce59a85 is still seen in agent 10.0.0.41 VM list
2025-04-22 20:15:48,808 - WARNING - Pod uuid afab0676-4c02-4e30-b1f2-bb454958ab95 is still seen in agent 10.0.0.41 VM list
2025-04-22 20:15:48,808 - WARNING - Pod uuid 6fe746d9-18e9-468a-81e8-df9446b22227 is still seen in agent 10.0.0.41 VM list
2025-04-22 20:15:53,662 - DEBUG - Pod 17e4f7c2-9ca7-4234-b2a3-c4ece3f60f33 is not in agent 10.0.0.41 VM list
2025-04-22 20:15:53,667 - DEBUG - VMI 15add2f2-1fb6-11f0-9ee4-fa163efb1208 is removed from agent 10.0.0.41
2025-04-22 20:15:53,667 - INFO - Verified that pod ctest-pod-51372412 is removed in agent
2025-04-22 20:15:53,839 - DEBUG - Pod afab0676-4c02-4e30-b1f2-bb454958ab95 is not in agent 10.0.0.41 VM list
2025-04-22 20:15:53,841 - WARNING - Pod uuid 6fe746d9-18e9-468a-81e8-df9446b22227 is still seen in agent 10.0.0.41 VM list
2025-04-22 20:15:53,842 - DEBUG - Pod ea1104ae-225f-44d4-8fb3-67c8d05805c6 is not in agent 10.0.0.41 VM list
2025-04-22 20:15:53,844 - WARNING - Pod uuid 90ca79ea-a301-4e86-a408-e99074e73c39 is still seen in agent 10.0.0.41 VM list
2025-04-22 20:15:53,845 - WARNING - Pod uuid 09ebb49b-74c1-42d9-89e4-730c05cb10b8 is still seen in agent 10.0.0.41 VM list
2025-04-22 20:15:53,845 - WARNING - Pod uuid 5eb3aff2-1c86-4f3a-8f8b-cad55ce59a85 is still seen in agent 10.0.0.41 VM list
2025-04-22 20:15:53,846 - DEBUG - Pod 8172c223-1d42-43e3-9adf-ad830b45e726 is not in agent 10.0.0.41 VM list
2025-04-22 20:15:53,857 - DEBUG - VMI 170613bc-1fb6-11f0-9ee4-fa163efb1208 is removed from agent 10.0.0.41
2025-04-22 20:15:53,857 - INFO - Verified that pod ctest-pod-03440369 is removed in agent
2025-04-22 20:15:53,860 - DEBUG - VMI 179ff644-1fb6-11f0-9ee4-fa163efb1208 is removed from agent 10.0.0.41
2025-04-22 20:15:53,860 - INFO - Verified that pod ctest-pod-28167601 is removed in agent
2025-04-22 20:15:53,860 - DEBUG - VMI 1631ec72-1fb6-11f0-9ee4-fa163efb1208 is removed from agent 10.0.0.41
2025-04-22 20:15:53,860 - INFO - Verified that pod ctest-pod-11228789 is removed in agent
2025-04-22 20:15:58,851 - WARNING - Pod uuid 6fe746d9-18e9-468a-81e8-df9446b22227 is still seen in agent 10.0.0.41 VM list
2025-04-22 20:15:58,859 - WARNING - Pod uuid 90ca79ea-a301-4e86-a408-e99074e73c39 is still seen in agent 10.0.0.41 VM list
2025-04-22 20:15:58,860 - WARNING - Pod uuid 09ebb49b-74c1-42d9-89e4-730c05cb10b8 is still seen in agent 10.0.0.41 VM list
2025-04-22 20:15:58,861 - WARNING - Pod uuid 5eb3aff2-1c86-4f3a-8f8b-cad55ce59a85 is still seen in agent 10.0.0.41 VM list
2025-04-22 20:16:03,859 - WARNING - Pod uuid 6fe746d9-18e9-468a-81e8-df9446b22227 is still seen in agent 10.0.0.41 VM list
2025-04-22 20:16:03,872 - WARNING - Pod uuid 90ca79ea-a301-4e86-a408-e99074e73c39 is still seen in agent 10.0.0.41 VM list
2025-04-22 20:16:03,874 - WARNING - Pod uuid 5eb3aff2-1c86-4f3a-8f8b-cad55ce59a85 is still seen in agent 10.0.0.41 VM list
2025-04-22 20:16:03,874 - WARNING - Pod uuid 09ebb49b-74c1-42d9-89e4-730c05cb10b8 is still seen in agent 10.0.0.41 VM list
2025-04-22 20:16:08,866 - WARNING - Pod uuid 6fe746d9-18e9-468a-81e8-df9446b22227 is still seen in agent 10.0.0.41 VM list
2025-04-22 20:16:08,885 - WARNING - Pod uuid 90ca79ea-a301-4e86-a408-e99074e73c39 is still seen in agent 10.0.0.41 VM list
2025-04-22 20:16:08,886 - WARNING - Pod uuid 09ebb49b-74c1-42d9-89e4-730c05cb10b8 is still seen in agent 10.0.0.41 VM list
2025-04-22 20:16:08,886 - WARNING - Pod uuid 5eb3aff2-1c86-4f3a-8f8b-cad55ce59a85 is still seen in agent 10.0.0.41 VM list
2025-04-22 20:16:13,880 - WARNING - Pod uuid 6fe746d9-18e9-468a-81e8-df9446b22227 is still seen in agent 10.0.0.41 VM list
2025-04-22 20:16:13,903 - WARNING - Pod uuid 90ca79ea-a301-4e86-a408-e99074e73c39 is still seen in agent 10.0.0.41 VM list
2025-04-22 20:16:13,905 - WARNING - Pod uuid 09ebb49b-74c1-42d9-89e4-730c05cb10b8 is still seen in agent 10.0.0.41 VM list
2025-04-22 20:16:13,905 - WARNING - Pod uuid 5eb3aff2-1c86-4f3a-8f8b-cad55ce59a85 is still seen in agent 10.0.0.41 VM list
2025-04-22 20:16:18,889 - WARNING - Pod uuid 6fe746d9-18e9-468a-81e8-df9446b22227 is still seen in agent 10.0.0.41 VM list
2025-04-22 20:16:18,917 - WARNING - Pod uuid 90ca79ea-a301-4e86-a408-e99074e73c39 is still seen in agent 10.0.0.41 VM list
2025-04-22 20:16:18,919 - WARNING - Pod uuid 5eb3aff2-1c86-4f3a-8f8b-cad55ce59a85 is still seen in agent 10.0.0.41 VM list
2025-04-22 20:16:18,920 - WARNING - Pod uuid 09ebb49b-74c1-42d9-89e4-730c05cb10b8 is still seen in agent 10.0.0.41 VM list
2025-04-22 20:16:23,896 - DEBUG - Pod 6fe746d9-18e9-468a-81e8-df9446b22227 is not in agent 10.0.0.41 VM list
2025-04-22 20:16:23,902 - DEBUG - VMI 19168358-1fb6-11f0-9ee4-fa163efb1208 is removed from agent 10.0.0.41
2025-04-22 20:16:23,902 - INFO - Verified that pod ctest-pod-84369383 is removed in agent
2025-04-22 20:16:23,930 - DEBUG - Pod 90ca79ea-a301-4e86-a408-e99074e73c39 is not in agent 10.0.0.41 VM list
2025-04-22 20:16:23,933 - DEBUG - Pod 09ebb49b-74c1-42d9-89e4-730c05cb10b8 is not in agent 10.0.0.41 VM list
2025-04-22 20:16:23,934 - DEBUG - Pod 5eb3aff2-1c86-4f3a-8f8b-cad55ce59a85 is not in agent 10.0.0.41 VM list
2025-04-22 20:16:23,944 - DEBUG - VMI 18a5b5e2-1fb6-11f0-9ee4-fa163efb1208 is removed from agent 10.0.0.41
2025-04-22 20:16:23,944 - INFO - Verified that pod ctest-pod-08735177 is removed in agent
2025-04-22 20:16:23,945 - DEBUG - VMI 1986744c-1fb6-11f0-9ee4-fa163efb1208 is removed from agent 10.0.0.41
2025-04-22 20:16:23,946 - INFO - Verified that pod ctest-pod-22980554 is removed in agent
2025-04-22 20:16:23,946 - DEBUG - VMI 1823dcd4-1fb6-11f0-9ee4-fa163efb1208 is removed from agent 10.0.0.41
2025-04-22 20:16:23,946 - INFO - Verified that pod ctest-pod-26716374 is removed in agent
2025-04-22 20:16:23,946 - INFO - Deleting namespace ctest-non-default-86346790
2025-04-22 20:16:23,956 - DEBUG - Namespace ctest-non-default-86346790 still in k8s
2025-04-22 20:16:25,960 - DEBUG - Namespace ctest-non-default-86346790 still in k8s
2025-04-22 20:16:27,964 - DEBUG - Namespace ctest-non-default-86346790 still in k8s
2025-04-22 20:16:29,972 - DEBUG - Namespace ctest-non-default-86346790 is not in k8s
2025-04-22 20:16:29,972 - DEBUG - No need to check project deletion in contrail-api
2025-04-22 20:16:29,972 - INFO - Deleting namespace ctest-new-default-55626280
2025-04-22 20:16:29,999 - DEBUG - Namespace ctest-new-default-55626280 still in k8s
2025-04-22 20:16:32,004 - DEBUG - Namespace ctest-new-default-55626280 still in k8s
2025-04-22 20:16:34,009 - DEBUG - Namespace ctest-new-default-55626280 still in k8s
2025-04-22 20:16:36,013 - DEBUG - Namespace ctest-new-default-55626280 is not in k8s
2025-04-22 20:16:36,013 - DEBUG - No need to check project deletion in contrail-api