2024-10-26 09:36:32,782 - INFO - Using existing project ['default-domain', 'k8s-default'](b599f92f-e125-44fb-b663-4da9101efcbf)
2024-10-26 09:36:32,803 - DEBUG - Namespace ctest-new-default-79541366 not present
2024-10-26 09:36:32,812 - INFO - Created namespace ctest-new-default-79541366
2024-10-26 09:36:35,818 - DEBUG - Namespace ctest-non-default-48378675 not present
2024-10-26 09:36:35,833 - INFO - Created namespace ctest-non-default-48378675
2024-10-26 09:36:38,866 - DEBUG - Pod ctest-pod-11248193 not present
2024-10-26 09:36:38,867 - INFO - Creating Pod ctest-pod-11248193
2024-10-26 09:36:38,913 - DEBUG - Pod : ctest-pod-11248193 UUID is d74fefa1-3f91-4513-8295-036f2f780c97
2024-10-26 09:36:38,917 - DEBUG - Pod ctest-pod-74885198 not present
2024-10-26 09:36:38,917 - INFO - Creating Pod ctest-pod-74885198
2024-10-26 09:36:38,956 - DEBUG - Pod : ctest-pod-74885198 UUID is eca505ad-9aaf-46ec-b374-c83eea21518a
2024-10-26 09:36:38,981 - DEBUG - Pod ctest-pod-17587451 not present
2024-10-26 09:36:38,982 - INFO - Creating Pod ctest-pod-17587451
2024-10-26 09:36:39,021 - DEBUG - Pod : ctest-pod-17587451 UUID is ce62c9bc-ebc9-481f-8d2e-c37c94ff01e9
2024-10-26 09:36:39,026 - DEBUG - Pod ctest-pod-63946219 not present
2024-10-26 09:36:39,026 - INFO - Creating Pod ctest-pod-63946219
2024-10-26 09:36:39,114 - DEBUG - Pod : ctest-pod-63946219 UUID is 61497e0a-fcd6-43d8-b0e3-9eb540aa30b0
2024-10-26 09:36:39,132 - DEBUG - Pod ctest-pod-42288320 not present
2024-10-26 09:36:39,133 - INFO - Creating Pod ctest-pod-42288320
2024-10-26 09:36:39,187 - DEBUG - Pod : ctest-pod-42288320 UUID is e30cd6f2-30e7-4740-bfb0-876885507266
2024-10-26 09:36:39,189 - DEBUG - Pod ctest-pod-47237954 not present
2024-10-26 09:36:39,190 - INFO - Creating Pod ctest-pod-47237954
2024-10-26 09:36:39,231 - DEBUG - Pod : ctest-pod-47237954 UUID is a4dd57c2-5031-443a-8820-082060beb213
2024-10-26 09:36:39,235 - DEBUG - Pod ctest-pod-24099959 not present
2024-10-26 09:36:39,235 - INFO - Creating Pod ctest-pod-24099959
2024-10-26 09:36:39,270 - DEBUG - Pod : ctest-pod-24099959 UUID is f8b804fe-9448-438e-b958-6582b0e7dc01
2024-10-26 09:36:39,279 - DEBUG - Pod ctest-pod-00875964 not present
2024-10-26 09:36:39,279 - INFO - Creating Pod ctest-pod-00875964
2024-10-26 09:36:39,309 - DEBUG - Pod : ctest-pod-00875964 UUID is f44eb37d-7dac-4f63-8175-8573a30df6c5
2024-10-26 09:36:39,549 - INFO - Project default-domain:k8s-ctest-new-default-79541366 for Namespace ctest-new-default-79541366 is seen in contrail-api
2024-10-26 09:36:39,549 - DEBUG - Project uuid in Contrail is 5a7260e9-e3a8-469b-8699-8ee653134590
2024-10-26 09:36:39,730 - DEBUG - Requesting: http://10.0.0.30:8108/Snh_NamespaceDatabaseList?namespace_uuid=40fdf396-b700-4df9-b37c-9f184a4e9571
2024-10-26 09:36:39,760 - INFO - Namespace ctest-new-default-79541366 with uuid 40fdf396-b700-4df9-b37c-9f184a4e9571 found in kube manager
2024-10-26 09:36:39,760 - INFO - Namespace ctest-new-default-79541366 verification passed
2024-10-26 09:36:40,123 - INFO - Project default-domain:k8s-ctest-non-default-48378675 for Namespace ctest-non-default-48378675 is seen in contrail-api
2024-10-26 09:36:40,123 - DEBUG - Project uuid in Contrail is 187bd391-12d3-4c29-b8b4-7a19ffdc2232
2024-10-26 09:36:40,123 - DEBUG - Requesting: http://10.0.0.30:8108/Snh_NamespaceDatabaseList?namespace_uuid=0018950c-0c37-4a84-81b0-ff6296777056
2024-10-26 09:36:40,129 - INFO - Namespace ctest-non-default-48378675 with uuid 0018950c-0c37-4a84-81b0-ff6296777056 found in kube manager
2024-10-26 09:36:40,130 - INFO - Namespace ctest-non-default-48378675 verification passed
2024-10-26 09:36:40,136 - DEBUG - Pod ctest-pod-11248193 not in running state.Currently in Pending
2024-10-26 09:36:45,147 - DEBUG - Pod ctest-pod-11248193 not in running state.Currently in Pending
2024-10-26 09:36:50,155 - DEBUG - Pod ctest-pod-11248193 not in running state.Currently in Pending
2024-10-26 09:36:55,163 - INFO - Pod ctest-pod-11248193 is in running state.Got IP 10.47.255.251
2024-10-26 09:36:55,184 - DEBUG - Pod ctest-pod-11248193 has vmi ce7d7e42-937d-11ef-bff7-fa163ef88782
2024-10-26 09:36:55,184 - INFO - Verified pod ctest-pod-11248193 in contrail-api
2024-10-26 09:36:55,200 - DEBUG - VMI ce7d7e42-937d-11ef-bff7-fa163ef88782 is active in agent 10.0.0.41
2024-10-26 09:36:55,200 - INFO - Verified Pod ctest-pod-11248193 in agent 10.0.0.41
2024-10-26 09:36:55,200 - DEBUG - Requesting: http://10.0.0.30:8108/Snh_VirtualMachineDatabaseList?x=d74fefa1-3f91-4513-8295-036f2f780c97
2024-10-26 09:36:55,205 - INFO - Pod ctest-pod-11248193 with uuid d74fefa1-3f91-4513-8295-036f2f780c97 found in kube manager
2024-10-26 09:36:55,206 - INFO - Pod ctest-pod-11248193 verification passed
2024-10-26 09:36:55,216 - INFO - Pod ctest-pod-74885198 is in running state.Got IP 10.47.255.250
2024-10-26 09:36:55,287 - DEBUG - Pod ctest-pod-74885198 has vmi cf365016-937d-11ef-bff7-fa163ef88782
2024-10-26 09:36:55,287 - INFO - Verified pod ctest-pod-74885198 in contrail-api
2024-10-26 09:36:55,306 - DEBUG - VMI cf365016-937d-11ef-bff7-fa163ef88782 is active in agent 10.0.0.41
2024-10-26 09:36:55,306 - INFO - Verified Pod ctest-pod-74885198 in agent 10.0.0.41
2024-10-26 09:36:55,306 - DEBUG - Requesting: http://10.0.0.30:8108/Snh_VirtualMachineDatabaseList?x=eca505ad-9aaf-46ec-b374-c83eea21518a
2024-10-26 09:36:55,313 - INFO - Pod ctest-pod-74885198 with uuid eca505ad-9aaf-46ec-b374-c83eea21518a found in kube manager
2024-10-26 09:36:55,313 - INFO - Pod ctest-pod-74885198 verification passed
2024-10-26 09:36:55,325 - INFO - Pod ctest-pod-17587451 is in running state.Got IP 10.47.255.249
2024-10-26 09:36:55,352 - DEBUG - Pod ctest-pod-17587451 has vmi d0289b28-937d-11ef-bff7-fa163ef88782
2024-10-26 09:36:55,352 - INFO - Verified pod ctest-pod-17587451 in contrail-api
2024-10-26 09:36:55,367 - DEBUG - VMI d0289b28-937d-11ef-bff7-fa163ef88782 is active in agent 10.0.0.41
2024-10-26 09:36:55,368 - INFO - Verified Pod ctest-pod-17587451 in agent 10.0.0.41
2024-10-26 09:36:55,368 - DEBUG - Requesting: http://10.0.0.30:8108/Snh_VirtualMachineDatabaseList?x=ce62c9bc-ebc9-481f-8d2e-c37c94ff01e9
2024-10-26 09:36:55,373 - INFO - Pod ctest-pod-17587451 with uuid ce62c9bc-ebc9-481f-8d2e-c37c94ff01e9 found in kube manager
2024-10-26 09:36:55,373 - INFO - Pod ctest-pod-17587451 verification passed
2024-10-26 09:36:55,381 - INFO - Pod ctest-pod-63946219 is in running state.Got IP 10.47.255.248
2024-10-26 09:36:55,447 - DEBUG - Pod ctest-pod-63946219 has vmi d0d5802c-937d-11ef-bff7-fa163ef88782
2024-10-26 09:36:55,447 - INFO - Verified pod ctest-pod-63946219 in contrail-api
2024-10-26 09:36:55,463 - DEBUG - VMI d0d5802c-937d-11ef-bff7-fa163ef88782 is active in agent 10.0.0.41
2024-10-26 09:36:55,463 - INFO - Verified Pod ctest-pod-63946219 in agent 10.0.0.41
2024-10-26 09:36:55,463 - DEBUG - Requesting: http://10.0.0.30:8108/Snh_VirtualMachineDatabaseList?x=61497e0a-fcd6-43d8-b0e3-9eb540aa30b0
2024-10-26 09:36:55,470 - INFO - Pod ctest-pod-63946219 with uuid 61497e0a-fcd6-43d8-b0e3-9eb540aa30b0 found in kube manager
2024-10-26 09:36:55,470 - INFO - Pod ctest-pod-63946219 verification passed
2024-10-26 09:36:55,479 - DEBUG - Pod ctest-pod-42288320 not in running state.Currently in Pending
2024-10-26 09:37:00,487 - INFO - Pod ctest-pod-42288320 is in running state.Got IP 10.47.255.247
2024-10-26 09:37:00,510 - DEBUG - Pod ctest-pod-42288320 has vmi d182db78-937d-11ef-bff7-fa163ef88782
2024-10-26 09:37:00,510 - INFO - Verified pod ctest-pod-42288320 in contrail-api
2024-10-26 09:37:00,531 - DEBUG - VMI d182db78-937d-11ef-bff7-fa163ef88782 is active in agent 10.0.0.41
2024-10-26 09:37:00,531 - INFO - Verified Pod ctest-pod-42288320 in agent 10.0.0.41
2024-10-26 09:37:00,532 - DEBUG - Requesting: http://10.0.0.30:8108/Snh_VirtualMachineDatabaseList?x=e30cd6f2-30e7-4740-bfb0-876885507266
2024-10-26 09:37:00,539 - INFO - Pod ctest-pod-42288320 with uuid e30cd6f2-30e7-4740-bfb0-876885507266 found in kube manager
2024-10-26 09:37:00,539 - INFO - Pod ctest-pod-42288320 verification passed
2024-10-26 09:37:00,546 - INFO - Pod ctest-pod-24099959 is in running state.Got IP 10.47.255.245
2024-10-26 09:37:00,571 - DEBUG - Pod ctest-pod-24099959 has vmi d2b98096-937d-11ef-bff7-fa163ef88782
2024-10-26 09:37:00,571 - INFO - Verified pod ctest-pod-24099959 in contrail-api
2024-10-26 09:37:00,585 - DEBUG - VMI d2b98096-937d-11ef-bff7-fa163ef88782 is active in agent 10.0.0.41
2024-10-26 09:37:00,585 - INFO - Verified Pod ctest-pod-24099959 in agent 10.0.0.41
2024-10-26 09:37:00,586 - DEBUG - Requesting: http://10.0.0.30:8108/Snh_VirtualMachineDatabaseList?x=f8b804fe-9448-438e-b958-6582b0e7dc01
2024-10-26 09:37:00,592 - INFO - Pod ctest-pod-24099959 with uuid f8b804fe-9448-438e-b958-6582b0e7dc01 found in kube manager
2024-10-26 09:37:00,592 - INFO - Pod ctest-pod-24099959 verification passed
2024-10-26 09:37:00,599 - DEBUG - Pod ctest-pod-47237954 not in running state.Currently in Pending
2024-10-26 09:37:05,606 - INFO - Pod ctest-pod-47237954 is in running state.Got IP 10.47.255.246
2024-10-26 09:37:05,671 - DEBUG - Pod ctest-pod-47237954 has vmi d21e4018-937d-11ef-bff7-fa163ef88782
2024-10-26 09:37:05,671 - INFO - Verified pod ctest-pod-47237954 in contrail-api
2024-10-26 09:37:05,686 - DEBUG - VMI d21e4018-937d-11ef-bff7-fa163ef88782 is active in agent 10.0.0.41
2024-10-26 09:37:05,686 - INFO - Verified Pod ctest-pod-47237954 in agent 10.0.0.41
2024-10-26 09:37:05,686 - DEBUG - Requesting: http://10.0.0.30:8108/Snh_VirtualMachineDatabaseList?x=a4dd57c2-5031-443a-8820-082060beb213
2024-10-26 09:37:05,691 - INFO - Pod ctest-pod-47237954 with uuid a4dd57c2-5031-443a-8820-082060beb213 found in kube manager
2024-10-26 09:37:05,692 - INFO - Pod ctest-pod-47237954 verification passed
2024-10-26 09:37:05,697 - INFO - Pod ctest-pod-00875964 is in running state.Got IP 10.47.255.244
2024-10-26 09:37:05,720 - DEBUG - Pod ctest-pod-00875964 has vmi d3524c04-937d-11ef-bff7-fa163ef88782
2024-10-26 09:37:05,721 - INFO - Verified pod ctest-pod-00875964 in contrail-api
2024-10-26 09:37:05,739 - DEBUG - VMI d3524c04-937d-11ef-bff7-fa163ef88782 is active in agent 10.0.0.41
2024-10-26 09:37:05,739 - INFO - Verified Pod ctest-pod-00875964 in agent 10.0.0.41
2024-10-26 09:37:05,740 - DEBUG - Requesting: http://10.0.0.30:8108/Snh_VirtualMachineDatabaseList?x=f44eb37d-7dac-4f63-8175-8573a30df6c5
2024-10-26 09:37:05,746 - INFO - Pod ctest-pod-00875964 with uuid f44eb37d-7dac-4f63-8175-8573a30df6c5 found in kube manager
2024-10-26 09:37:05,746 - INFO - Pod ctest-pod-00875964 verification passed
2024-10-26 09:37:05,746 - INFO - ================================================================================
2024-10-26 09:37:05,746 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2024-10-26 09:37:05,746 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2024-10-26 09:37:05,966 - DEBUG - Nothing to compare xmpp stats {'10.0.0.41': {'10.0.0.30': '0'}} with
2024-10-26 09:37:05,966 - INFO - Initial checks done. Running the testcase now
2024-10-26 09:37:05,966 - INFO -
2024-10-26 09:37:06,031 - DEBUG - [Pod ctest-pod-11248193] Cmd: echo ctest-pod-11248193 > /usr/share/nginx/html/index.html, Output:
2024-10-26 09:37:06,087 - DEBUG - [Pod ctest-pod-74885198] Cmd: echo ctest-pod-74885198 > /usr/share/nginx/html/index.html, Output:
2024-10-26 09:37:06,166 - DEBUG - [Pod ctest-pod-17587451] Cmd: echo ctest-pod-17587451 > /usr/share/nginx/html/index.html, Output:
2024-10-26 09:37:06,236 - DEBUG - [Pod ctest-pod-63946219] Cmd: echo ctest-pod-63946219 > /usr/share/nginx/html/index.html, Output:
2024-10-26 09:37:06,240 - DEBUG - Service ctest-nginx-svc-67023580 not present
2024-10-26 09:37:06,241 - INFO - Creating service ctest-nginx-svc-67023580
2024-10-26 09:37:06,258 - INFO - Created Service ctest-nginx-svc-67023580
2024-10-26 09:37:06,265 - WARNING - Service UUID 4ea10cfb-5d9a-494a-9f2a-12c08bbcaae0 not yet found in contrail-api
2024-10-26 09:37:07,275 - INFO - Validated that Service ctest-nginx-svc-67023580 is seen in contrail-api
2024-10-26 09:37:07,275 - DEBUG - Requesting: http://10.0.0.30:8108/Snh_LoadbalancerDatabaseList?x=4ea10cfb-5d9a-494a-9f2a-12c08bbcaae0
2024-10-26 09:37:07,282 - INFO - Service ctest-nginx-svc-67023580 with uuid 4ea10cfb-5d9a-494a-9f2a-12c08bbcaae0 found in kube manager
2024-10-26 09:37:07,282 - INFO - Service ctest-nginx-svc-67023580 verification passed
2024-10-26 09:37:08,362 - DEBUG - [Pod ctest-pod-42288320] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-11248193
2024-10-26 09:37:08,362 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 passed
2024-10-26 09:37:08,362 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-11248193
2024-10-26 09:37:08,438 - DEBUG - [Pod ctest-pod-42288320] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: ctest-pod-74885198
Connecting to 10.100.135.65:80 (10.100.135.65:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-26 09:37:08,439 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 passed
2024-10-26 09:37:08,439 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd output: ctest-pod-74885198
Connecting to 10.100.135.65:80 (10.100.135.65:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-26 09:37:08,439 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-11248193': 1, 'ctest-pod-74885198': 1}
2024-10-26 09:37:08,504 - DEBUG - [Pod ctest-pod-24099959] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: ctest-pod-74885198
Connecting to 10.100.135.65:80 (10.100.135.65:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-26 09:37:08,504 - DEBUG - [Pod Pod ctest-pod-24099959] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 passed
2024-10-26 09:37:08,504 - DEBUG - [Pod Pod ctest-pod-24099959] Cmd output: ctest-pod-74885198
Connecting to 10.100.135.65:80 (10.100.135.65:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-26 09:37:08,558 - DEBUG - [Pod ctest-pod-24099959] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: ctest-pod-11248193
Connecting to 10.100.135.65:80 (10.100.135.65:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-26 09:37:08,558 - DEBUG - [Pod Pod ctest-pod-24099959] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 passed
2024-10-26 09:37:08,558 - DEBUG - [Pod Pod ctest-pod-24099959] Cmd output: ctest-pod-11248193
Connecting to 10.100.135.65:80 (10.100.135.65:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-26 09:37:08,558 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-11248193': 1, 'ctest-pod-74885198': 1}
2024-10-26 09:37:08,563 - DEBUG - Network policy ingress-on-service not present
2024-10-26 09:37:08,565 - INFO - Creating Network Policy ingress-on-service
2024-10-26 09:37:08,577 - INFO - Network policy found in k8s
2024-10-26 09:37:08,577 - DEBUG - Requesting: http://10.0.0.30:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=af2390e0-9508-4cad-9c59-2b2f5aff4b45
2024-10-26 09:37:08,585 - INFO - Network Policy ingress-on-service with uuid af2390e0-9508-4cad-9c59-2b2f5aff4b45 found in kube manager
2024-10-26 09:37:08,631 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2024-10-26 09:37:08,631 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2024-10-26 09:37:08,632 - DEBUG - Requesting: http://10.0.0.30:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=af2390e0-9508-4cad-9c59-2b2f5aff4b45
2024-10-26 09:37:08,669 - WARNING - Network policy with name ingress-on-service not found in agent
2024-10-26 09:37:10,670 - DEBUG - Requesting: http://10.0.0.30:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=af2390e0-9508-4cad-9c59-2b2f5aff4b45
2024-10-26 09:37:10,747 - INFO - Network policy with name ingress-on-service found in agent
2024-10-26 09:37:10,754 - INFO - Network Policy ingress-on-service verification passed
2024-10-26 09:37:15,815 - DEBUG - [Pod ctest-pod-42288320] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:37:15,815 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:37:15,815 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:37:20,889 - DEBUG - [Pod ctest-pod-42288320] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:37:20,889 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:37:20,889 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:37:25,947 - DEBUG - [Pod ctest-pod-42288320] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:37:25,948 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:37:25,948 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:37:31,019 - DEBUG - [Pod ctest-pod-42288320] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:37:31,019 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:37:31,019 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:37:36,087 - DEBUG - [Pod ctest-pod-42288320] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:37:36,087 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:37:36,087 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:37:41,157 - DEBUG - [Pod ctest-pod-42288320] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:37:41,158 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:37:41,158 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:37:46,230 - DEBUG - [Pod ctest-pod-42288320] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:37:46,230 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:37:46,230 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:37:51,292 - DEBUG - [Pod ctest-pod-42288320] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:37:51,292 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:37:51,292 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:37:56,353 - DEBUG - [Pod ctest-pod-42288320] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:37:56,353 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:37:56,353 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:38:01,424 - DEBUG - [Pod ctest-pod-42288320] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:38:01,424 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:38:01,424 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:38:01,424 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-11248193': 0, 'ctest-pod-74885198': 0}
2024-10-26 09:38:01,487 - DEBUG - [Pod ctest-pod-47237954] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: ctest-pod-11248193
Connecting to 10.100.135.65:80 (10.100.135.65:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-26 09:38:01,488 - DEBUG - [Pod Pod ctest-pod-47237954] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 passed
2024-10-26 09:38:01,488 - DEBUG - [Pod Pod ctest-pod-47237954] Cmd output: ctest-pod-11248193
Connecting to 10.100.135.65:80 (10.100.135.65:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-26 09:38:01,556 - DEBUG - [Pod ctest-pod-47237954] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: ctest-pod-11248193
Connecting to 10.100.135.65:80 (10.100.135.65:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-26 09:38:01,556 - DEBUG - [Pod Pod ctest-pod-47237954] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 passed
2024-10-26 09:38:01,556 - DEBUG - [Pod Pod ctest-pod-47237954] Cmd output: ctest-pod-11248193
Connecting to 10.100.135.65:80 (10.100.135.65:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-26 09:38:01,629 - DEBUG - [Pod ctest-pod-47237954] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: ctest-pod-11248193
Connecting to 10.100.135.65:80 (10.100.135.65:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-26 09:38:01,629 - DEBUG - [Pod Pod ctest-pod-47237954] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 passed
2024-10-26 09:38:01,629 - DEBUG - [Pod Pod ctest-pod-47237954] Cmd output: ctest-pod-11248193
Connecting to 10.100.135.65:80 (10.100.135.65:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-26 09:38:01,698 - DEBUG - [Pod ctest-pod-47237954] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: ctest-pod-11248193
Connecting to 10.100.135.65:80 (10.100.135.65:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-26 09:38:01,698 - DEBUG - [Pod Pod ctest-pod-47237954] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 passed
2024-10-26 09:38:01,698 - DEBUG - [Pod Pod ctest-pod-47237954] Cmd output: ctest-pod-11248193
Connecting to 10.100.135.65:80 (10.100.135.65:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-26 09:38:01,791 - DEBUG - [Pod ctest-pod-47237954] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: ctest-pod-11248193
Connecting to 10.100.135.65:80 (10.100.135.65:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-26 09:38:01,791 - DEBUG - [Pod Pod ctest-pod-47237954] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 passed
2024-10-26 09:38:01,791 - DEBUG - [Pod Pod ctest-pod-47237954] Cmd output: ctest-pod-11248193
Connecting to 10.100.135.65:80 (10.100.135.65:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-26 09:38:01,850 - DEBUG - [Pod ctest-pod-47237954] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-11248193
2024-10-26 09:38:01,850 - DEBUG - [Pod Pod ctest-pod-47237954] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 passed
2024-10-26 09:38:01,850 - DEBUG - [Pod Pod ctest-pod-47237954] Cmd output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-11248193
2024-10-26 09:38:01,927 - DEBUG - [Pod ctest-pod-47237954] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-74885198
2024-10-26 09:38:01,927 - DEBUG - [Pod Pod ctest-pod-47237954] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 passed
2024-10-26 09:38:01,927 - DEBUG - [Pod Pod ctest-pod-47237954] Cmd output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-74885198
2024-10-26 09:38:01,927 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-11248193': 6, 'ctest-pod-74885198': 1}
2024-10-26 09:38:06,991 - DEBUG - [Pod ctest-pod-24099959] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:38:06,991 - DEBUG - [Pod Pod ctest-pod-24099959] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:38:06,991 - DEBUG - [Pod Pod ctest-pod-24099959] Cmd output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:38:12,067 - DEBUG - [Pod ctest-pod-24099959] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:38:12,067 - DEBUG - [Pod Pod ctest-pod-24099959] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:38:12,067 - DEBUG - [Pod Pod ctest-pod-24099959] Cmd output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:38:17,140 - DEBUG - [Pod ctest-pod-24099959] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:38:17,140 - DEBUG - [Pod Pod ctest-pod-24099959] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:38:17,140 - DEBUG - [Pod Pod ctest-pod-24099959] Cmd output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:38:22,220 - DEBUG - [Pod ctest-pod-24099959] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:38:22,220 - DEBUG - [Pod Pod ctest-pod-24099959] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:38:22,220 - DEBUG - [Pod Pod ctest-pod-24099959] Cmd output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:38:26,717 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2024-10-26 09:38:37,343 - DEBUG - [Pod ctest-pod-24099959] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:38:37,344 - DEBUG - [Pod Pod ctest-pod-24099959] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:38:37,344 - DEBUG - [Pod Pod ctest-pod-24099959] Cmd output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:38:42,403 - DEBUG - [Pod ctest-pod-24099959] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:38:42,403 - DEBUG - [Pod Pod ctest-pod-24099959] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:38:42,403 - DEBUG - [Pod Pod ctest-pod-24099959] Cmd output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:38:47,483 - DEBUG - [Pod ctest-pod-24099959] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:38:47,484 - DEBUG - [Pod Pod ctest-pod-24099959] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:38:47,484 - DEBUG - [Pod Pod ctest-pod-24099959] Cmd output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:38:52,549 - DEBUG - [Pod ctest-pod-24099959] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:38:52,549 - DEBUG - [Pod Pod ctest-pod-24099959] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:38:52,549 - DEBUG - [Pod Pod ctest-pod-24099959] Cmd output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:38:57,625 - DEBUG - [Pod ctest-pod-24099959] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:38:57,625 - DEBUG - [Pod Pod ctest-pod-24099959] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:38:57,625 - DEBUG - [Pod Pod ctest-pod-24099959] Cmd output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:39:02,699 - DEBUG - [Pod ctest-pod-24099959] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:39:02,700 - DEBUG - [Pod Pod ctest-pod-24099959] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:39:02,700 - DEBUG - [Pod Pod ctest-pod-24099959] Cmd output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:39:02,700 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-11248193': 0, 'ctest-pod-74885198': 0}
2024-10-26 09:39:04,757 - DEBUG - [Pod ctest-pod-47237954] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.119 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.085 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.086 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.085/0.430/1.119 ms
2024-10-26 09:39:04,758 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-47237954 with expectation True passed
2024-10-26 09:39:06,812 - DEBUG - [Pod ctest-pod-42288320] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.589 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.082 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.086 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.082/0.252/0.589 ms
2024-10-26 09:39:06,812 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-42288320 with expectation True passed
2024-10-26 09:39:08,885 - DEBUG - [Pod ctest-pod-24099959] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.024 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.083 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.099 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.083/0.402/1.024 ms
2024-10-26 09:39:08,885 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-24099959 with expectation True passed
2024-10-26 09:39:08,946 - DEBUG - [Pod ctest-pod-47237954] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-26 09:39:08,946 - DEBUG - [Pod Pod ctest-pod-47237954] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-10-26 09:39:08,946 - DEBUG - [Pod Pod ctest-pod-47237954] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-26 09:39:08,946 - INFO - wget check of of http://10.47.255.251 from ctest-pod-47237954 passed
2024-10-26 09:39:09,013 - DEBUG - [Pod ctest-pod-47237954] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-26 09:39:09,013 - DEBUG - [Pod Pod ctest-pod-47237954] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-10-26 09:39:09,013 - DEBUG - [Pod Pod ctest-pod-47237954] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-26 09:39:09,013 - INFO - wget check of of http://10.47.255.250 from ctest-pod-47237954 passed
2024-10-26 09:39:14,071 - DEBUG - [Pod ctest-pod-42288320] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-10-26 09:39:14,071 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-10-26 09:39:14,071 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-10-26 09:39:14,071 - INFO - wget check of of http://10.47.255.250 from ctest-pod-42288320 passed
2024-10-26 09:39:19,128 - DEBUG - [Pod ctest-pod-00875964] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-10-26 09:39:19,129 - DEBUG - [Pod Pod ctest-pod-00875964] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-10-26 09:39:19,129 - DEBUG - [Pod Pod ctest-pod-00875964] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-10-26 09:39:19,129 - INFO - wget check of of http://10.47.255.251 from ctest-pod-00875964 passed
2024-10-26 09:39:19,139 - INFO - Updating Network Policy ingress-on-service
2024-10-26 09:39:24,218 - DEBUG - [Pod ctest-pod-42288320] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:39:24,218 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:39:24,218 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:39:29,289 - DEBUG - [Pod ctest-pod-42288320] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:39:29,289 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:39:29,289 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:39:34,352 - DEBUG - [Pod ctest-pod-42288320] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:39:34,352 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:39:34,352 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:39:39,423 - DEBUG - [Pod ctest-pod-42288320] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:39:39,423 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:39:39,423 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:39:44,484 - DEBUG - [Pod ctest-pod-42288320] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:39:44,484 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:39:44,484 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:39:50,135 - DEBUG - [Pod ctest-pod-42288320] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:39:50,135 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:39:50,135 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:39:55,201 - DEBUG - [Pod ctest-pod-42288320] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:39:55,201 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:39:55,201 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:40:00,264 - DEBUG - [Pod ctest-pod-42288320] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:40:00,265 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:40:00,265 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:40:05,761 - DEBUG - [Pod ctest-pod-42288320] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:40:05,762 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:40:05,762 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:40:10,868 - DEBUG - [Pod ctest-pod-42288320] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:40:10,868 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:40:10,869 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
wget: download timed out
2024-10-26 09:40:10,869 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-11248193': 0, 'ctest-pod-74885198': 0}
2024-10-26 09:40:10,948 - DEBUG - [Pod ctest-pod-47237954] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: ctest-pod-11248193
Connecting to 10.100.135.65:80 (10.100.135.65:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-26 09:40:10,948 - DEBUG - [Pod Pod ctest-pod-47237954] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 passed
2024-10-26 09:40:10,948 - DEBUG - [Pod Pod ctest-pod-47237954] Cmd output: ctest-pod-11248193
Connecting to 10.100.135.65:80 (10.100.135.65:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-26 09:40:11,014 - DEBUG - [Pod ctest-pod-47237954] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: ctest-pod-11248193
Connecting to 10.100.135.65:80 (10.100.135.65:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-26 09:40:11,014 - DEBUG - [Pod Pod ctest-pod-47237954] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 passed
2024-10-26 09:40:11,014 - DEBUG - [Pod Pod ctest-pod-47237954] Cmd output: ctest-pod-11248193
Connecting to 10.100.135.65:80 (10.100.135.65:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-26 09:40:12,576 - DEBUG - [Pod ctest-pod-47237954] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: ctest-pod-74885198
Connecting to 10.100.135.65:80 (10.100.135.65:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-26 09:40:12,576 - DEBUG - [Pod Pod ctest-pod-47237954] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 passed
2024-10-26 09:40:12,576 - DEBUG - [Pod Pod ctest-pod-47237954] Cmd output: ctest-pod-74885198
Connecting to 10.100.135.65:80 (10.100.135.65:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-26 09:40:12,576 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-11248193': 2, 'ctest-pod-74885198': 1}
2024-10-26 09:40:12,651 - DEBUG - [Pod ctest-pod-24099959] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: ctest-pod-11248193
Connecting to 10.100.135.65:80 (10.100.135.65:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-26 09:40:12,652 - DEBUG - [Pod Pod ctest-pod-24099959] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 passed
2024-10-26 09:40:12,652 - DEBUG - [Pod Pod ctest-pod-24099959] Cmd output: ctest-pod-11248193
Connecting to 10.100.135.65:80 (10.100.135.65:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-26 09:40:12,709 - DEBUG - [Pod ctest-pod-24099959] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-11248193
2024-10-26 09:40:12,710 - DEBUG - [Pod Pod ctest-pod-24099959] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 passed
2024-10-26 09:40:12,710 - DEBUG - [Pod Pod ctest-pod-24099959] Cmd output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-11248193
2024-10-26 09:40:12,777 - DEBUG - [Pod ctest-pod-24099959] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-11248193
2024-10-26 09:40:12,777 - DEBUG - [Pod Pod ctest-pod-24099959] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 passed
2024-10-26 09:40:12,777 - DEBUG - [Pod Pod ctest-pod-24099959] Cmd output: Connecting to 10.100.135.65:80 (10.100.135.65:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-11248193
2024-10-26 09:40:12,853 - DEBUG - [Pod ctest-pod-24099959] Cmd: wget http://10.100.135.65:80/ -O - -T 5 -t 1 , Output: ctest-pod-74885198
Connecting to 10.100.135.65:80 (10.100.135.65:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-26 09:40:12,854 - DEBUG - [Pod Pod ctest-pod-24099959] Cmd wget http://10.100.135.65:80/ -O - -T 5 -t 1 passed
2024-10-26 09:40:12,854 - DEBUG - [Pod Pod ctest-pod-24099959] Cmd output: ctest-pod-74885198
Connecting to 10.100.135.65:80 (10.100.135.65:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-26 09:40:12,854 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-11248193': 3, 'ctest-pod-74885198': 1}
2024-10-26 09:40:14,936 - DEBUG - [Pod ctest-pod-47237954] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.619 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.082 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.097 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.082/0.266/0.619 ms
2024-10-26 09:40:14,936 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-47237954 with expectation True passed
2024-10-26 09:40:16,991 - DEBUG - [Pod ctest-pod-42288320] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.405 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.089 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.099 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.089/0.531/1.405 ms
2024-10-26 09:40:16,991 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-42288320 with expectation True passed
2024-10-26 09:40:19,084 - DEBUG - [Pod ctest-pod-24099959] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.503 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.088 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.087 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.087/0.226/0.503 ms
2024-10-26 09:40:19,084 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-24099959 with expectation True passed
2024-10-26 09:40:19,157 - DEBUG - [Pod ctest-pod-47237954] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-26 09:40:19,158 - DEBUG - [Pod Pod ctest-pod-47237954] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-10-26 09:40:19,158 - DEBUG - [Pod Pod ctest-pod-47237954] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-26 09:40:19,158 - INFO - wget check of of http://10.47.255.251 from ctest-pod-47237954 passed
2024-10-26 09:40:19,231 - DEBUG - [Pod ctest-pod-47237954] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-26 09:40:19,231 - DEBUG - [Pod Pod ctest-pod-47237954] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-10-26 09:40:19,231 - DEBUG - [Pod Pod ctest-pod-47237954] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-26 09:40:19,232 - INFO - wget check of of http://10.47.255.250 from ctest-pod-47237954 passed
2024-10-26 09:40:24,302 - DEBUG - [Pod ctest-pod-42288320] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-10-26 09:40:24,302 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-10-26 09:40:24,302 - DEBUG - [Pod Pod ctest-pod-42288320] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-10-26 09:40:24,302 - INFO - wget check of of http://10.47.255.250 from ctest-pod-42288320 passed
2024-10-26 09:40:24,375 - DEBUG - [Pod ctest-pod-00875964] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-26 09:40:24,376 - DEBUG - [Pod Pod ctest-pod-00875964] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-10-26 09:40:24,376 - DEBUG - [Pod Pod ctest-pod-00875964] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-26 09:40:24,376 - INFO - wget check of of http://10.47.255.251 from ctest-pod-00875964 passed
2024-10-26 09:40:24,376 - INFO - Deleting Network Policy : ingress-on-service
2024-10-26 09:40:24,377 - INFO - Deleting service : ctest-nginx-svc-67023580
2024-10-26 09:40:24,648 - DEBUG - No XMPP flaps were noticed during the test
2024-10-26 09:40:24,649 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:19]
2024-10-26 09:40:24,649 - INFO - --------------------------------------------------------------------------------
2024-10-26 09:40:24,656 - INFO - Deleting pod ctest-new-default-79541366:ctest-pod-11248193
2024-10-26 09:40:24,657 - INFO - Deleting pod ctest-new-default-79541366:ctest-pod-74885198
2024-10-26 09:40:24,659 - INFO - Deleting pod ctest-non-default-48378675:ctest-pod-17587451
2024-10-26 09:40:24,660 - INFO - Deleting pod ctest-non-default-48378675:ctest-pod-63946219
2024-10-26 09:40:24,661 - INFO - Deleting pod ctest-new-default-79541366:ctest-pod-42288320
2024-10-26 09:40:24,661 - INFO - Deleting pod ctest-new-default-79541366:ctest-pod-47237954
2024-10-26 09:40:24,662 - INFO - Deleting pod ctest-non-default-48378675:ctest-pod-24099959
2024-10-26 09:40:24,662 - INFO - Deleting pod ctest-non-default-48378675:ctest-pod-00875964
2024-10-26 09:40:24,819 - WARNING - Pod uuid d74fefa1-3f91-4513-8295-036f2f780c97 is still seen in agent 10.0.0.41 VM list
2024-10-26 09:40:24,839 - WARNING - Pod uuid ce62c9bc-ebc9-481f-8d2e-c37c94ff01e9 is still seen in agent 10.0.0.41 VM list
2024-10-26 09:40:24,839 - WARNING - Pod uuid a4dd57c2-5031-443a-8820-082060beb213 is still seen in agent 10.0.0.41 VM list
2024-10-26 09:40:24,840 - WARNING - Pod uuid 61497e0a-fcd6-43d8-b0e3-9eb540aa30b0 is still seen in agent 10.0.0.41 VM list
2024-10-26 09:40:24,840 - WARNING - Pod uuid eca505ad-9aaf-46ec-b374-c83eea21518a is still seen in agent 10.0.0.41 VM list
2024-10-26 09:40:24,841 - WARNING - Pod uuid f8b804fe-9448-438e-b958-6582b0e7dc01 is still seen in agent 10.0.0.41 VM list
2024-10-26 09:40:24,848 - WARNING - Pod uuid f44eb37d-7dac-4f63-8175-8573a30df6c5 is still seen in agent 10.0.0.41 VM list
2024-10-26 09:40:24,849 - WARNING - Pod uuid e30cd6f2-30e7-4740-bfb0-876885507266 is still seen in agent 10.0.0.41 VM list
2024-10-26 09:40:29,829 - DEBUG - Pod d74fefa1-3f91-4513-8295-036f2f780c97 is not in agent 10.0.0.41 VM list
2024-10-26 09:40:29,842 - DEBUG - VMI ce7d7e42-937d-11ef-bff7-fa163ef88782 is removed from agent 10.0.0.41
2024-10-26 09:40:29,842 - INFO - Verified that pod ctest-pod-11248193 is removed in agent
2024-10-26 09:40:29,880 - WARNING - Pod uuid e30cd6f2-30e7-4740-bfb0-876885507266 is still seen in agent 10.0.0.41 VM list
2024-10-26 09:40:29,881 - WARNING - Pod uuid a4dd57c2-5031-443a-8820-082060beb213 is still seen in agent 10.0.0.41 VM list
2024-10-26 09:40:29,881 - DEBUG - Pod 61497e0a-fcd6-43d8-b0e3-9eb540aa30b0 is not in agent 10.0.0.41 VM list
2024-10-26 09:40:29,885 - DEBUG - Pod eca505ad-9aaf-46ec-b374-c83eea21518a is not in agent 10.0.0.41 VM list
2024-10-26 09:40:29,886 - WARNING - Pod uuid f44eb37d-7dac-4f63-8175-8573a30df6c5 is still seen in agent 10.0.0.41 VM list
2024-10-26 09:40:29,887 - DEBUG - Pod ce62c9bc-ebc9-481f-8d2e-c37c94ff01e9 is not in agent 10.0.0.41 VM list
2024-10-26 09:40:29,898 - DEBUG - VMI d0d5802c-937d-11ef-bff7-fa163ef88782 is removed from agent 10.0.0.41
2024-10-26 09:40:29,898 - INFO - Verified that pod ctest-pod-63946219 is removed in agent
2024-10-26 09:40:29,900 - DEBUG - VMI cf365016-937d-11ef-bff7-fa163ef88782 is removed from agent 10.0.0.41
2024-10-26 09:40:29,900 - INFO - Verified that pod ctest-pod-74885198 is removed in agent
2024-10-26 09:40:29,900 - DEBUG - VMI d0289b28-937d-11ef-bff7-fa163ef88782 is removed from agent 10.0.0.41
2024-10-26 09:40:29,900 - INFO - Verified that pod ctest-pod-17587451 is removed in agent
2024-10-26 09:40:30,849 - WARNING - Pod uuid f8b804fe-9448-438e-b958-6582b0e7dc01 is still seen in agent 10.0.0.41 VM list
2024-10-26 09:40:34,895 - WARNING - Pod uuid a4dd57c2-5031-443a-8820-082060beb213 is still seen in agent 10.0.0.41 VM list
2024-10-26 09:40:34,897 - WARNING - Pod uuid f44eb37d-7dac-4f63-8175-8573a30df6c5 is still seen in agent 10.0.0.41 VM list
2024-10-26 09:40:34,897 - WARNING - Pod uuid e30cd6f2-30e7-4740-bfb0-876885507266 is still seen in agent 10.0.0.41 VM list
2024-10-26 09:40:35,861 - WARNING - Pod uuid f8b804fe-9448-438e-b958-6582b0e7dc01 is still seen in agent 10.0.0.41 VM list
2024-10-26 09:40:39,912 - WARNING - Pod uuid a4dd57c2-5031-443a-8820-082060beb213 is still seen in agent 10.0.0.41 VM list
2024-10-26 09:40:39,914 - WARNING - Pod uuid e30cd6f2-30e7-4740-bfb0-876885507266 is still seen in agent 10.0.0.41 VM list
2024-10-26 09:40:39,914 - WARNING - Pod uuid f44eb37d-7dac-4f63-8175-8573a30df6c5 is still seen in agent 10.0.0.41 VM list
2024-10-26 09:40:40,870 - WARNING - Pod uuid f8b804fe-9448-438e-b958-6582b0e7dc01 is still seen in agent 10.0.0.41 VM list
2024-10-26 09:40:44,931 - WARNING - Pod uuid f44eb37d-7dac-4f63-8175-8573a30df6c5 is still seen in agent 10.0.0.41 VM list
2024-10-26 09:40:44,933 - WARNING - Pod uuid a4dd57c2-5031-443a-8820-082060beb213 is still seen in agent 10.0.0.41 VM list
2024-10-26 09:40:44,936 - WARNING - Pod uuid e30cd6f2-30e7-4740-bfb0-876885507266 is still seen in agent 10.0.0.41 VM list
2024-10-26 09:40:45,880 - WARNING - Pod uuid f8b804fe-9448-438e-b958-6582b0e7dc01 is still seen in agent 10.0.0.41 VM list
2024-10-26 09:40:49,946 - WARNING - Pod uuid f44eb37d-7dac-4f63-8175-8573a30df6c5 is still seen in agent 10.0.0.41 VM list
2024-10-26 09:40:49,948 - WARNING - Pod uuid e30cd6f2-30e7-4740-bfb0-876885507266 is still seen in agent 10.0.0.41 VM list
2024-10-26 09:40:49,948 - WARNING - Pod uuid a4dd57c2-5031-443a-8820-082060beb213 is still seen in agent 10.0.0.41 VM list
2024-10-26 09:40:50,889 - WARNING - Pod uuid f8b804fe-9448-438e-b958-6582b0e7dc01 is still seen in agent 10.0.0.41 VM list
2024-10-26 09:40:54,964 - WARNING - Pod uuid f44eb37d-7dac-4f63-8175-8573a30df6c5 is still seen in agent 10.0.0.41 VM list
2024-10-26 09:40:54,966 - WARNING - Pod uuid a4dd57c2-5031-443a-8820-082060beb213 is still seen in agent 10.0.0.41 VM list
2024-10-26 09:40:54,967 - WARNING - Pod uuid e30cd6f2-30e7-4740-bfb0-876885507266 is still seen in agent 10.0.0.41 VM list
2024-10-26 09:40:55,898 - WARNING - Pod uuid f8b804fe-9448-438e-b958-6582b0e7dc01 is still seen in agent 10.0.0.41 VM list
2024-10-26 09:40:59,980 - DEBUG - Pod f44eb37d-7dac-4f63-8175-8573a30df6c5 is not in agent 10.0.0.41 VM list
2024-10-26 09:40:59,983 - DEBUG - Pod a4dd57c2-5031-443a-8820-082060beb213 is not in agent 10.0.0.41 VM list
2024-10-26 09:40:59,985 - DEBUG - Pod e30cd6f2-30e7-4740-bfb0-876885507266 is not in agent 10.0.0.41 VM list
2024-10-26 09:40:59,996 - DEBUG - VMI d3524c04-937d-11ef-bff7-fa163ef88782 is removed from agent 10.0.0.41
2024-10-26 09:40:59,996 - INFO - Verified that pod ctest-pod-00875964 is removed in agent
2024-10-26 09:40:59,997 - DEBUG - VMI d182db78-937d-11ef-bff7-fa163ef88782 is removed from agent 10.0.0.41
2024-10-26 09:40:59,997 - INFO - Verified that pod ctest-pod-42288320 is removed in agent
2024-10-26 09:40:59,998 - DEBUG - VMI d21e4018-937d-11ef-bff7-fa163ef88782 is removed from agent 10.0.0.41
2024-10-26 09:40:59,998 - INFO - Verified that pod ctest-pod-47237954 is removed in agent
2024-10-26 09:41:00,907 - DEBUG - Pod f8b804fe-9448-438e-b958-6582b0e7dc01 is not in agent 10.0.0.41 VM list
2024-10-26 09:41:00,915 - DEBUG - VMI d2b98096-937d-11ef-bff7-fa163ef88782 is removed from agent 10.0.0.41
2024-10-26 09:41:00,915 - INFO - Verified that pod ctest-pod-24099959 is removed in agent
2024-10-26 09:41:00,915 - INFO - Deleting namespace ctest-non-default-48378675
2024-10-26 09:41:00,935 - DEBUG - Namespace ctest-non-default-48378675 still in k8s
2024-10-26 09:41:02,941 - DEBUG - Namespace ctest-non-default-48378675 still in k8s
2024-10-26 09:41:04,948 - DEBUG - Namespace ctest-non-default-48378675 still in k8s
2024-10-26 09:41:06,953 - DEBUG - Namespace ctest-non-default-48378675 is not in k8s
2024-10-26 09:41:06,953 - DEBUG - No need to check project deletion in contrail-api
2024-10-26 09:41:06,953 - INFO - Deleting namespace ctest-new-default-79541366
2024-10-26 09:41:06,965 - DEBUG - Namespace ctest-new-default-79541366 still in k8s
2024-10-26 09:41:08,970 - DEBUG - Namespace ctest-new-default-79541366 still in k8s
2024-10-26 09:41:10,975 - DEBUG - Namespace ctest-new-default-79541366 still in k8s
2024-10-26 09:41:12,980 - DEBUG - Namespace ctest-new-default-79541366 is not in k8s
2024-10-26 09:41:12,980 - DEBUG - No need to check project deletion in contrail-api