2024-08-26 10:19:54,230 - INFO - Using existing project ['default-domain', 'k8s-default'](0a2e327c-421a-4920-9707-134fb7eb9acf) 2024-08-26 10:19:54,259 - DEBUG - Namespace ctest-new-default-31889956 not present 2024-08-26 10:19:54,271 - INFO - Created namespace ctest-new-default-31889956 2024-08-26 10:19:57,292 - DEBUG - Namespace ctest-non-default-51319982 not present 2024-08-26 10:19:57,320 - INFO - Created namespace ctest-non-default-51319982 2024-08-26 10:20:00,352 - DEBUG - Pod ctest-pod-57283209 not present 2024-08-26 10:20:00,353 - INFO - Creating Pod ctest-pod-57283209 2024-08-26 10:20:00,384 - DEBUG - Pod : ctest-pod-57283209 UUID is 6687530a-04d2-4880-9cc5-96d3cfa24fbc 2024-08-26 10:20:00,393 - DEBUG - Pod ctest-pod-24537169 not present 2024-08-26 10:20:00,394 - INFO - Creating Pod ctest-pod-24537169 2024-08-26 10:20:00,420 - DEBUG - Pod : ctest-pod-24537169 UUID is d2d76e04-fb8d-4076-839f-9227465f8af3 2024-08-26 10:20:00,426 - DEBUG - Pod ctest-pod-21117257 not present 2024-08-26 10:20:00,427 - INFO - Creating Pod ctest-pod-21117257 2024-08-26 10:20:00,478 - DEBUG - Pod : ctest-pod-21117257 UUID is c43dc9a5-06aa-4e87-8ae2-a87872d37790 2024-08-26 10:20:00,486 - DEBUG - Pod ctest-pod-12701077 not present 2024-08-26 10:20:00,486 - INFO - Creating Pod ctest-pod-12701077 2024-08-26 10:20:00,522 - DEBUG - Pod : ctest-pod-12701077 UUID is 0972f09f-5bf7-4550-8017-eaa69700f22e 2024-08-26 10:20:00,527 - DEBUG - Pod ctest-pod-47150489 not present 2024-08-26 10:20:00,527 - INFO - Creating Pod ctest-pod-47150489 2024-08-26 10:20:00,579 - DEBUG - Pod : ctest-pod-47150489 UUID is 8344ad1c-518f-4f79-b1e3-84dbfb29942f 2024-08-26 10:20:00,589 - DEBUG - Pod ctest-pod-70324861 not present 2024-08-26 10:20:00,589 - INFO - Creating Pod ctest-pod-70324861 2024-08-26 10:20:00,614 - DEBUG - Pod : ctest-pod-70324861 UUID is eb1b1f49-cdd8-4945-88a2-06bf539b032a 2024-08-26 10:20:00,621 - DEBUG - Pod ctest-pod-73729253 not present 2024-08-26 10:20:00,621 - INFO - Creating Pod ctest-pod-73729253 2024-08-26 10:20:00,662 - DEBUG - Pod : ctest-pod-73729253 UUID is d015e8ce-cb34-4214-8af4-dbe47ff38100 2024-08-26 10:20:00,667 - DEBUG - Pod ctest-pod-93074729 not present 2024-08-26 10:20:00,667 - INFO - Creating Pod ctest-pod-93074729 2024-08-26 10:20:00,690 - DEBUG - Pod : ctest-pod-93074729 UUID is 7f972a6e-17a6-428b-a545-3bffe346af66 2024-08-26 10:20:00,950 - INFO - Project default-domain:k8s-ctest-new-default-31889956 for Namespace ctest-new-default-31889956 is seen in contrail-api 2024-08-26 10:20:00,950 - DEBUG - Project uuid in Contrail is 023787d0-2ce2-48e3-ac9f-eb4867a9a0ef 2024-08-26 10:20:01,106 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NamespaceDatabaseList?namespace_uuid=1dda1d4f-9a3d-4d42-a844-000c15cb0f2b 2024-08-26 10:20:01,113 - INFO - Namespace ctest-new-default-31889956 with uuid 1dda1d4f-9a3d-4d42-a844-000c15cb0f2b found in kube manager 2024-08-26 10:20:01,113 - INFO - Namespace ctest-new-default-31889956 verification passed 2024-08-26 10:20:01,355 - INFO - Project default-domain:k8s-ctest-non-default-51319982 for Namespace ctest-non-default-51319982 is seen in contrail-api 2024-08-26 10:20:01,355 - DEBUG - Project uuid in Contrail is 011a1df5-4cf9-44ae-a96a-2bb7ce767f1d 2024-08-26 10:20:01,356 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NamespaceDatabaseList?namespace_uuid=0f513a46-88e4-469e-bd7d-18fb34838aca 2024-08-26 10:20:01,360 - INFO - Namespace ctest-non-default-51319982 with uuid 0f513a46-88e4-469e-bd7d-18fb34838aca found in kube manager 2024-08-26 10:20:01,360 - INFO - Namespace ctest-non-default-51319982 verification passed 2024-08-26 10:20:01,366 - DEBUG - Pod ctest-pod-57283209 not in running state.Currently in Pending 2024-08-26 10:20:06,376 - DEBUG - Pod ctest-pod-57283209 not in running state.Currently in Pending 2024-08-26 10:20:11,394 - DEBUG - Pod ctest-pod-57283209 not in running state.Currently in Pending 2024-08-26 10:20:16,408 - INFO - Pod ctest-pod-57283209 is in running state.Got IP 10.47.255.251 2024-08-26 10:20:16,440 - DEBUG - Pod ctest-pod-57283209 has vmi c152899c-6394-11ef-8bd6-fa163ec8a58e 2024-08-26 10:20:16,441 - INFO - Verified pod ctest-pod-57283209 in contrail-api 2024-08-26 10:20:16,482 - DEBUG - VMI c152899c-6394-11ef-8bd6-fa163ec8a58e is active in agent 10.0.0.46 2024-08-26 10:20:16,483 - INFO - Verified Pod ctest-pod-57283209 in agent 10.0.0.46 2024-08-26 10:20:16,483 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=6687530a-04d2-4880-9cc5-96d3cfa24fbc 2024-08-26 10:20:16,495 - INFO - Pod ctest-pod-57283209 with uuid 6687530a-04d2-4880-9cc5-96d3cfa24fbc found in kube manager 2024-08-26 10:20:16,495 - INFO - Pod ctest-pod-57283209 verification passed 2024-08-26 10:20:16,505 - INFO - Pod ctest-pod-24537169 is in running state.Got IP 10.47.255.250 2024-08-26 10:20:16,521 - DEBUG - Pod ctest-pod-24537169 has vmi c1df981e-6394-11ef-8bd6-fa163ec8a58e 2024-08-26 10:20:16,521 - INFO - Verified pod ctest-pod-24537169 in contrail-api 2024-08-26 10:20:16,540 - DEBUG - VMI c1df981e-6394-11ef-8bd6-fa163ec8a58e is active in agent 10.0.0.46 2024-08-26 10:20:16,541 - INFO - Verified Pod ctest-pod-24537169 in agent 10.0.0.46 2024-08-26 10:20:16,541 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=d2d76e04-fb8d-4076-839f-9227465f8af3 2024-08-26 10:20:16,549 - INFO - Pod ctest-pod-24537169 with uuid d2d76e04-fb8d-4076-839f-9227465f8af3 found in kube manager 2024-08-26 10:20:16,550 - INFO - Pod ctest-pod-24537169 verification passed 2024-08-26 10:20:16,559 - INFO - Pod ctest-pod-21117257 is in running state.Got IP 10.47.255.249 2024-08-26 10:20:16,616 - DEBUG - Pod ctest-pod-21117257 has vmi c2801e88-6394-11ef-8bd6-fa163ec8a58e 2024-08-26 10:20:16,617 - INFO - Verified pod ctest-pod-21117257 in contrail-api 2024-08-26 10:20:16,638 - DEBUG - VMI c2801e88-6394-11ef-8bd6-fa163ec8a58e is active in agent 10.0.0.46 2024-08-26 10:20:16,639 - INFO - Verified Pod ctest-pod-21117257 in agent 10.0.0.46 2024-08-26 10:20:16,639 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=c43dc9a5-06aa-4e87-8ae2-a87872d37790 2024-08-26 10:20:16,646 - INFO - Pod ctest-pod-21117257 with uuid c43dc9a5-06aa-4e87-8ae2-a87872d37790 found in kube manager 2024-08-26 10:20:16,647 - INFO - Pod ctest-pod-21117257 verification passed 2024-08-26 10:20:16,659 - INFO - Pod ctest-pod-12701077 is in running state.Got IP 10.47.255.248 2024-08-26 10:20:16,677 - DEBUG - Pod ctest-pod-12701077 has vmi c301c820-6394-11ef-8bd6-fa163ec8a58e 2024-08-26 10:20:16,677 - INFO - Verified pod ctest-pod-12701077 in contrail-api 2024-08-26 10:20:16,696 - DEBUG - VMI c301c820-6394-11ef-8bd6-fa163ec8a58e is active in agent 10.0.0.46 2024-08-26 10:20:16,696 - INFO - Verified Pod ctest-pod-12701077 in agent 10.0.0.46 2024-08-26 10:20:16,696 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=0972f09f-5bf7-4550-8017-eaa69700f22e 2024-08-26 10:20:16,710 - INFO - Pod ctest-pod-12701077 with uuid 0972f09f-5bf7-4550-8017-eaa69700f22e found in kube manager 2024-08-26 10:20:16,710 - INFO - Pod ctest-pod-12701077 verification passed 2024-08-26 10:20:16,723 - INFO - Pod ctest-pod-47150489 is in running state.Got IP 10.47.255.247 2024-08-26 10:20:16,746 - DEBUG - Pod ctest-pod-47150489 has vmi c39c8f36-6394-11ef-8bd6-fa163ec8a58e 2024-08-26 10:20:16,747 - INFO - Verified pod ctest-pod-47150489 in contrail-api 2024-08-26 10:20:16,766 - DEBUG - VMI c39c8f36-6394-11ef-8bd6-fa163ec8a58e is active in agent 10.0.0.46 2024-08-26 10:20:16,767 - INFO - Verified Pod ctest-pod-47150489 in agent 10.0.0.46 2024-08-26 10:20:16,767 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=8344ad1c-518f-4f79-b1e3-84dbfb29942f 2024-08-26 10:20:16,774 - INFO - Pod ctest-pod-47150489 with uuid 8344ad1c-518f-4f79-b1e3-84dbfb29942f found in kube manager 2024-08-26 10:20:16,774 - INFO - Pod ctest-pod-47150489 verification passed 2024-08-26 10:20:16,782 - INFO - Pod ctest-pod-73729253 is in running state.Got IP 10.47.255.245 2024-08-26 10:20:16,840 - DEBUG - Pod ctest-pod-73729253 has vmi c49bebd4-6394-11ef-8bd6-fa163ec8a58e 2024-08-26 10:20:16,840 - INFO - Verified pod ctest-pod-73729253 in contrail-api 2024-08-26 10:20:16,865 - DEBUG - VMI c49bebd4-6394-11ef-8bd6-fa163ec8a58e is active in agent 10.0.0.46 2024-08-26 10:20:16,866 - INFO - Verified Pod ctest-pod-73729253 in agent 10.0.0.46 2024-08-26 10:20:16,866 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=d015e8ce-cb34-4214-8af4-dbe47ff38100 2024-08-26 10:20:16,876 - INFO - Pod ctest-pod-73729253 with uuid d015e8ce-cb34-4214-8af4-dbe47ff38100 found in kube manager 2024-08-26 10:20:16,876 - INFO - Pod ctest-pod-73729253 verification passed 2024-08-26 10:20:16,886 - DEBUG - Pod ctest-pod-70324861 not in running state.Currently in Pending 2024-08-26 10:20:21,906 - INFO - Pod ctest-pod-70324861 is in running state.Got IP 10.47.255.246 2024-08-26 10:20:21,939 - DEBUG - Pod ctest-pod-70324861 has vmi c41495d0-6394-11ef-8bd6-fa163ec8a58e 2024-08-26 10:20:21,939 - INFO - Verified pod ctest-pod-70324861 in contrail-api 2024-08-26 10:20:21,962 - DEBUG - VMI c41495d0-6394-11ef-8bd6-fa163ec8a58e is active in agent 10.0.0.46 2024-08-26 10:20:21,962 - INFO - Verified Pod ctest-pod-70324861 in agent 10.0.0.46 2024-08-26 10:20:21,963 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=eb1b1f49-cdd8-4945-88a2-06bf539b032a 2024-08-26 10:20:21,973 - INFO - Pod ctest-pod-70324861 with uuid eb1b1f49-cdd8-4945-88a2-06bf539b032a found in kube manager 2024-08-26 10:20:21,973 - INFO - Pod ctest-pod-70324861 verification passed 2024-08-26 10:20:21,984 - INFO - Pod ctest-pod-93074729 is in running state.Got IP 10.47.255.244 2024-08-26 10:20:22,015 - DEBUG - Pod ctest-pod-93074729 has vmi c520f4be-6394-11ef-8bd6-fa163ec8a58e 2024-08-26 10:20:22,015 - INFO - Verified pod ctest-pod-93074729 in contrail-api 2024-08-26 10:20:22,039 - DEBUG - VMI c520f4be-6394-11ef-8bd6-fa163ec8a58e is active in agent 10.0.0.46 2024-08-26 10:20:22,040 - INFO - Verified Pod ctest-pod-93074729 in agent 10.0.0.46 2024-08-26 10:20:22,040 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=7f972a6e-17a6-428b-a545-3bffe346af66 2024-08-26 10:20:22,053 - INFO - Pod ctest-pod-93074729 with uuid 7f972a6e-17a6-428b-a545-3bffe346af66 found in kube manager 2024-08-26 10:20:22,053 - INFO - Pod ctest-pod-93074729 verification passed 2024-08-26 10:20:22,053 - INFO - ================================================================================ 2024-08-26 10:20:22,054 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-08-26 10:20:22,054 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-08-26 10:20:22,386 - DEBUG - Nothing to compare xmpp stats {'10.0.0.46': {'10.0.0.27': '0'}} with 2024-08-26 10:20:22,386 - INFO - Initial checks done. Running the testcase now 2024-08-26 10:20:22,386 - INFO - 2024-08-26 10:20:22,459 - DEBUG - [Pod ctest-pod-57283209] Cmd: echo ctest-pod-57283209 > /usr/share/nginx/html/index.html, Output: 2024-08-26 10:20:22,540 - DEBUG - [Pod ctest-pod-24537169] Cmd: echo ctest-pod-24537169 > /usr/share/nginx/html/index.html, Output: 2024-08-26 10:20:22,622 - DEBUG - [Pod ctest-pod-21117257] Cmd: echo ctest-pod-21117257 > /usr/share/nginx/html/index.html, Output: 2024-08-26 10:20:22,716 - DEBUG - [Pod ctest-pod-12701077] Cmd: echo ctest-pod-12701077 > /usr/share/nginx/html/index.html, Output: 2024-08-26 10:20:22,725 - DEBUG - Service ctest-nginx-svc-25403587 not present 2024-08-26 10:20:22,726 - INFO - Creating service ctest-nginx-svc-25403587 2024-08-26 10:20:22,761 - INFO - Created Service ctest-nginx-svc-25403587 2024-08-26 10:20:22,810 - WARNING - Service UUID 6372595d-a7dc-4831-9660-f8cc8f953225 not yet found in contrail-api 2024-08-26 10:20:23,819 - INFO - Validated that Service ctest-nginx-svc-25403587 is seen in contrail-api 2024-08-26 10:20:23,819 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_LoadbalancerDatabaseList?x=6372595d-a7dc-4831-9660-f8cc8f953225 2024-08-26 10:20:23,836 - INFO - Service ctest-nginx-svc-25403587 with uuid 6372595d-a7dc-4831-9660-f8cc8f953225 found in kube manager 2024-08-26 10:20:23,837 - INFO - Service ctest-nginx-svc-25403587 verification passed 2024-08-26 10:20:24,929 - DEBUG - [Pod ctest-pod-47150489] Cmd: wget http://10.111.44.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.44.231:80 (10.111.44.231:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-24537169 2024-08-26 10:20:24,930 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd wget http://10.111.44.231:80/ -O - -T 5 -t 1 passed 2024-08-26 10:20:24,930 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd output: Connecting to 10.111.44.231:80 (10.111.44.231:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-24537169 2024-08-26 10:20:24,991 - DEBUG - [Pod ctest-pod-47150489] Cmd: wget http://10.111.44.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.44.231:80 (10.111.44.231:80) ctest-pod-24537169 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 10:20:24,991 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd wget http://10.111.44.231:80/ -O - -T 5 -t 1 passed 2024-08-26 10:20:24,992 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd output: Connecting to 10.111.44.231:80 (10.111.44.231:80) ctest-pod-24537169 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 10:20:25,070 - DEBUG - [Pod ctest-pod-47150489] Cmd: wget http://10.111.44.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.44.231:80 (10.111.44.231:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-24537169 2024-08-26 10:20:25,070 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd wget http://10.111.44.231:80/ -O - -T 5 -t 1 passed 2024-08-26 10:20:25,070 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd output: Connecting to 10.111.44.231:80 (10.111.44.231:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-24537169 2024-08-26 10:20:25,145 - DEBUG - [Pod ctest-pod-47150489] Cmd: wget http://10.111.44.231:80/ -O - -T 5 -t 1 , Output: ctest-pod-57283209 Connecting to 10.111.44.231:80 (10.111.44.231:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 10:20:25,145 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd wget http://10.111.44.231:80/ -O - -T 5 -t 1 passed 2024-08-26 10:20:25,145 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd output: ctest-pod-57283209 Connecting to 10.111.44.231:80 (10.111.44.231:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 10:20:25,145 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-57283209': 1, 'ctest-pod-24537169': 3} 2024-08-26 10:20:25,231 - DEBUG - [Pod ctest-pod-73729253] Cmd: wget http://10.111.44.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.44.231:80 (10.111.44.231:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-24537169 2024-08-26 10:20:25,231 - DEBUG - [Pod Pod ctest-pod-73729253] Cmd wget http://10.111.44.231:80/ -O - -T 5 -t 1 passed 2024-08-26 10:20:25,231 - DEBUG - [Pod Pod ctest-pod-73729253] Cmd output: Connecting to 10.111.44.231:80 (10.111.44.231:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-24537169 2024-08-26 10:20:25,303 - DEBUG - [Pod ctest-pod-73729253] Cmd: wget http://10.111.44.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.44.231:80 (10.111.44.231:80) ctest-pod-57283209 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 10:20:25,303 - DEBUG - [Pod Pod ctest-pod-73729253] Cmd wget http://10.111.44.231:80/ -O - -T 5 -t 1 passed 2024-08-26 10:20:25,304 - DEBUG - [Pod Pod ctest-pod-73729253] Cmd output: Connecting to 10.111.44.231:80 (10.111.44.231:80) ctest-pod-57283209 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 10:20:25,304 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-57283209': 1, 'ctest-pod-24537169': 1} 2024-08-26 10:20:25,316 - DEBUG - Network policy ingress-on-service not present 2024-08-26 10:20:25,317 - INFO - Creating Network Policy ingress-on-service 2024-08-26 10:20:25,351 - INFO - Network policy found in k8s 2024-08-26 10:20:25,351 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=a313a8c9-d1c2-4808-8fc2-492843b4480a 2024-08-26 10:20:25,360 - INFO - Network Policy ingress-on-service with uuid a313a8c9-d1c2-4808-8fc2-492843b4480a found in kube manager 2024-08-26 10:20:25,633 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-08-26 10:20:25,634 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-08-26 10:20:25,634 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=a313a8c9-d1c2-4808-8fc2-492843b4480a 2024-08-26 10:20:25,691 - WARNING - Network policy with name ingress-on-service not found in agent 2024-08-26 10:20:27,693 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=a313a8c9-d1c2-4808-8fc2-492843b4480a 2024-08-26 10:20:27,767 - INFO - Network policy with name ingress-on-service found in agent 2024-08-26 10:20:27,768 - INFO - Network Policy ingress-on-service verification passed 2024-08-26 10:20:32,869 - DEBUG - [Pod ctest-pod-47150489] Cmd: wget http://10.111.44.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:20:32,869 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd wget http://10.111.44.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:20:32,869 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:20:38,078 - DEBUG - [Pod ctest-pod-47150489] Cmd: wget http://10.111.44.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:20:38,078 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd wget http://10.111.44.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:20:38,078 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:20:43,162 - DEBUG - [Pod ctest-pod-47150489] Cmd: wget http://10.111.44.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:20:43,162 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd wget http://10.111.44.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:20:43,163 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:20:48,220 - DEBUG - [Pod ctest-pod-47150489] Cmd: wget http://10.111.44.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:20:48,220 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd wget http://10.111.44.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:20:48,220 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:20:53,289 - DEBUG - [Pod ctest-pod-47150489] Cmd: wget http://10.111.44.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:20:53,289 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd wget http://10.111.44.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:20:53,289 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:20:58,371 - DEBUG - [Pod ctest-pod-47150489] Cmd: wget http://10.111.44.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:20:58,372 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd wget http://10.111.44.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:20:58,372 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:21:03,436 - DEBUG - [Pod ctest-pod-47150489] Cmd: wget http://10.111.44.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:21:03,437 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd wget http://10.111.44.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:21:03,437 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:21:08,507 - DEBUG - [Pod ctest-pod-47150489] Cmd: wget http://10.111.44.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:21:08,507 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd wget http://10.111.44.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:21:08,507 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:21:13,581 - DEBUG - [Pod ctest-pod-47150489] Cmd: wget http://10.111.44.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:21:13,581 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd wget http://10.111.44.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:21:13,581 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:21:18,639 - DEBUG - [Pod ctest-pod-47150489] Cmd: wget http://10.111.44.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:21:18,639 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd wget http://10.111.44.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:21:18,639 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:21:18,639 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-57283209': 0, 'ctest-pod-24537169': 0} 2024-08-26 10:21:18,714 - DEBUG - [Pod ctest-pod-70324861] Cmd: wget http://10.111.44.231:80/ -O - -T 5 -t 1 , Output: ctest-pod-57283209 Connecting to 10.111.44.231:80 (10.111.44.231:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 10:21:18,715 - DEBUG - [Pod Pod ctest-pod-70324861] Cmd wget http://10.111.44.231:80/ -O - -T 5 -t 1 passed 2024-08-26 10:21:18,715 - DEBUG - [Pod Pod ctest-pod-70324861] Cmd output: ctest-pod-57283209 Connecting to 10.111.44.231:80 (10.111.44.231:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 10:21:18,763 - DEBUG - [Pod ctest-pod-70324861] Cmd: wget http://10.111.44.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.44.231:80 (10.111.44.231:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-24537169 2024-08-26 10:21:18,763 - DEBUG - [Pod Pod ctest-pod-70324861] Cmd wget http://10.111.44.231:80/ -O - -T 5 -t 1 passed 2024-08-26 10:21:18,763 - DEBUG - [Pod Pod ctest-pod-70324861] Cmd output: Connecting to 10.111.44.231:80 (10.111.44.231:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-24537169 2024-08-26 10:21:18,763 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-57283209': 1, 'ctest-pod-24537169': 1} 2024-08-26 10:21:23,823 - DEBUG - [Pod ctest-pod-73729253] Cmd: wget http://10.111.44.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:21:23,824 - DEBUG - [Pod Pod ctest-pod-73729253] Cmd wget http://10.111.44.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:21:23,824 - DEBUG - [Pod Pod ctest-pod-73729253] Cmd output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:21:28,896 - DEBUG - [Pod ctest-pod-73729253] Cmd: wget http://10.111.44.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:21:28,896 - DEBUG - [Pod Pod ctest-pod-73729253] Cmd wget http://10.111.44.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:21:28,896 - DEBUG - [Pod Pod ctest-pod-73729253] Cmd output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:21:33,972 - DEBUG - [Pod ctest-pod-73729253] Cmd: wget http://10.111.44.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:21:33,972 - DEBUG - [Pod Pod ctest-pod-73729253] Cmd wget http://10.111.44.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:21:33,972 - DEBUG - [Pod Pod ctest-pod-73729253] Cmd output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:21:39,042 - DEBUG - [Pod ctest-pod-73729253] Cmd: wget http://10.111.44.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:21:39,043 - DEBUG - [Pod Pod ctest-pod-73729253] Cmd wget http://10.111.44.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:21:39,043 - DEBUG - [Pod Pod ctest-pod-73729253] Cmd output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:21:44,109 - DEBUG - [Pod ctest-pod-73729253] Cmd: wget http://10.111.44.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:21:44,109 - DEBUG - [Pod Pod ctest-pod-73729253] Cmd wget http://10.111.44.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:21:44,109 - DEBUG - [Pod Pod ctest-pod-73729253] Cmd output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:21:49,180 - DEBUG - [Pod ctest-pod-73729253] Cmd: wget http://10.111.44.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:21:49,180 - DEBUG - [Pod Pod ctest-pod-73729253] Cmd wget http://10.111.44.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:21:49,180 - DEBUG - [Pod Pod ctest-pod-73729253] Cmd output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:21:54,256 - DEBUG - [Pod ctest-pod-73729253] Cmd: wget http://10.111.44.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:21:54,256 - DEBUG - [Pod Pod ctest-pod-73729253] Cmd wget http://10.111.44.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:21:54,256 - DEBUG - [Pod Pod ctest-pod-73729253] Cmd output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:21:59,334 - DEBUG - [Pod ctest-pod-73729253] Cmd: wget http://10.111.44.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:21:59,334 - DEBUG - [Pod Pod ctest-pod-73729253] Cmd wget http://10.111.44.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:21:59,335 - DEBUG - [Pod Pod ctest-pod-73729253] Cmd output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:22:04,397 - DEBUG - [Pod ctest-pod-73729253] Cmd: wget http://10.111.44.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:22:04,397 - DEBUG - [Pod Pod ctest-pod-73729253] Cmd wget http://10.111.44.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:22:04,397 - DEBUG - [Pod Pod ctest-pod-73729253] Cmd output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:22:09,461 - DEBUG - [Pod ctest-pod-73729253] Cmd: wget http://10.111.44.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:22:09,462 - DEBUG - [Pod Pod ctest-pod-73729253] Cmd wget http://10.111.44.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:22:09,462 - DEBUG - [Pod Pod ctest-pod-73729253] Cmd output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:22:09,462 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-57283209': 0, 'ctest-pod-24537169': 0} 2024-08-26 10:22:11,531 - DEBUG - [Pod ctest-pod-70324861] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.673 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.073 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.070/0.272/0.673 ms 2024-08-26 10:22:11,531 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-70324861 with expectation True passed 2024-08-26 10:22:13,593 - DEBUG - [Pod ctest-pod-47150489] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.059 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.075 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.093 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.075/0.409/1.059 ms 2024-08-26 10:22:13,593 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-47150489 with expectation True passed 2024-08-26 10:22:15,660 - DEBUG - [Pod ctest-pod-73729253] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.769 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.058 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.088 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.058/0.305/0.769 ms 2024-08-26 10:22:15,661 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-73729253 with expectation True passed 2024-08-26 10:22:15,735 - DEBUG - [Pod ctest-pod-70324861] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-26 10:22:15,736 - DEBUG - [Pod Pod ctest-pod-70324861] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-08-26 10:22:15,736 - DEBUG - [Pod Pod ctest-pod-70324861] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-26 10:22:15,736 - INFO - wget check of of http://10.47.255.251 from ctest-pod-70324861 passed 2024-08-26 10:22:15,799 - DEBUG - [Pod ctest-pod-70324861] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-26 10:22:15,799 - DEBUG - [Pod Pod ctest-pod-70324861] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-08-26 10:22:15,799 - DEBUG - [Pod Pod ctest-pod-70324861] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-26 10:22:15,799 - INFO - wget check of of http://10.47.255.250 from ctest-pod-70324861 passed 2024-08-26 10:22:20,871 - DEBUG - [Pod ctest-pod-47150489] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-26 10:22:20,872 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-26 10:22:20,872 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-26 10:22:20,872 - INFO - wget check of of http://10.47.255.250 from ctest-pod-47150489 passed 2024-08-26 10:22:25,951 - DEBUG - [Pod ctest-pod-93074729] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-08-26 10:22:25,951 - DEBUG - [Pod Pod ctest-pod-93074729] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-08-26 10:22:25,951 - DEBUG - [Pod Pod ctest-pod-93074729] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-08-26 10:22:25,952 - INFO - wget check of of http://10.47.255.251 from ctest-pod-93074729 passed 2024-08-26 10:22:25,968 - INFO - Updating Network Policy ingress-on-service 2024-08-26 10:22:31,046 - DEBUG - [Pod ctest-pod-47150489] Cmd: wget http://10.111.44.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:22:31,046 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd wget http://10.111.44.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:22:31,047 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:22:36,103 - DEBUG - [Pod ctest-pod-47150489] Cmd: wget http://10.111.44.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:22:36,104 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd wget http://10.111.44.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:22:36,104 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:22:41,163 - DEBUG - [Pod ctest-pod-47150489] Cmd: wget http://10.111.44.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:22:41,163 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd wget http://10.111.44.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:22:41,164 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:22:46,235 - DEBUG - [Pod ctest-pod-47150489] Cmd: wget http://10.111.44.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:22:46,235 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd wget http://10.111.44.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:22:46,235 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:22:51,296 - DEBUG - [Pod ctest-pod-47150489] Cmd: wget http://10.111.44.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:22:51,297 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd wget http://10.111.44.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:22:51,297 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:22:56,380 - DEBUG - [Pod ctest-pod-47150489] Cmd: wget http://10.111.44.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:22:56,381 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd wget http://10.111.44.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:22:56,381 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:23:01,461 - DEBUG - [Pod ctest-pod-47150489] Cmd: wget http://10.111.44.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:23:01,461 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd wget http://10.111.44.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:23:01,461 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:23:06,531 - DEBUG - [Pod ctest-pod-47150489] Cmd: wget http://10.111.44.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:23:06,531 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd wget http://10.111.44.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:23:06,531 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:23:11,604 - DEBUG - [Pod ctest-pod-47150489] Cmd: wget http://10.111.44.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:23:11,604 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd wget http://10.111.44.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:23:11,604 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:23:16,692 - DEBUG - [Pod ctest-pod-47150489] Cmd: wget http://10.111.44.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:23:16,692 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd wget http://10.111.44.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:23:16,692 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd output: Connecting to 10.111.44.231:80 (10.111.44.231:80) wget: download timed out 2024-08-26 10:23:16,692 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-57283209': 0, 'ctest-pod-24537169': 0} 2024-08-26 10:23:16,781 - DEBUG - [Pod ctest-pod-70324861] Cmd: wget http://10.111.44.231:80/ -O - -T 5 -t 1 , Output: ctest-pod-57283209 Connecting to 10.111.44.231:80 (10.111.44.231:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 10:23:16,782 - DEBUG - [Pod Pod ctest-pod-70324861] Cmd wget http://10.111.44.231:80/ -O - -T 5 -t 1 passed 2024-08-26 10:23:16,782 - DEBUG - [Pod Pod ctest-pod-70324861] Cmd output: ctest-pod-57283209 Connecting to 10.111.44.231:80 (10.111.44.231:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 10:23:16,858 - DEBUG - [Pod ctest-pod-70324861] Cmd: wget http://10.111.44.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.44.231:80 (10.111.44.231:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-24537169 2024-08-26 10:23:16,858 - DEBUG - [Pod Pod ctest-pod-70324861] Cmd wget http://10.111.44.231:80/ -O - -T 5 -t 1 passed 2024-08-26 10:23:16,858 - DEBUG - [Pod Pod ctest-pod-70324861] Cmd output: Connecting to 10.111.44.231:80 (10.111.44.231:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-24537169 2024-08-26 10:23:16,858 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-57283209': 1, 'ctest-pod-24537169': 1} 2024-08-26 10:23:16,954 - DEBUG - [Pod ctest-pod-73729253] Cmd: wget http://10.111.44.231:80/ -O - -T 5 -t 1 , Output: ctest-pod-57283209 Connecting to 10.111.44.231:80 (10.111.44.231:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 10:23:16,955 - DEBUG - [Pod Pod ctest-pod-73729253] Cmd wget http://10.111.44.231:80/ -O - -T 5 -t 1 passed 2024-08-26 10:23:16,955 - DEBUG - [Pod Pod ctest-pod-73729253] Cmd output: ctest-pod-57283209 Connecting to 10.111.44.231:80 (10.111.44.231:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 10:23:17,027 - DEBUG - [Pod ctest-pod-73729253] Cmd: wget http://10.111.44.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.44.231:80 (10.111.44.231:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-24537169 2024-08-26 10:23:17,027 - DEBUG - [Pod Pod ctest-pod-73729253] Cmd wget http://10.111.44.231:80/ -O - -T 5 -t 1 passed 2024-08-26 10:23:17,028 - DEBUG - [Pod Pod ctest-pod-73729253] Cmd output: Connecting to 10.111.44.231:80 (10.111.44.231:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-24537169 2024-08-26 10:23:17,028 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-57283209': 1, 'ctest-pod-24537169': 1} 2024-08-26 10:23:19,107 - DEBUG - [Pod ctest-pod-70324861] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.405 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.067 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.080 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.067/0.184/0.405 ms 2024-08-26 10:23:19,108 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-70324861 with expectation True passed 2024-08-26 10:23:21,224 - DEBUG - [Pod ctest-pod-47150489] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.532 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.094 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.088 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.088/0.238/0.532 ms 2024-08-26 10:23:21,225 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-47150489 with expectation True passed 2024-08-26 10:23:23,316 - DEBUG - [Pod ctest-pod-73729253] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.744 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.083 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.299/0.744 ms 2024-08-26 10:23:23,316 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-73729253 with expectation True passed 2024-08-26 10:23:23,397 - DEBUG - [Pod ctest-pod-70324861] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-26 10:23:23,397 - DEBUG - [Pod Pod ctest-pod-70324861] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-08-26 10:23:23,397 - DEBUG - [Pod Pod ctest-pod-70324861] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-26 10:23:23,397 - INFO - wget check of of http://10.47.255.251 from ctest-pod-70324861 passed 2024-08-26 10:23:23,470 - DEBUG - [Pod ctest-pod-70324861] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-26 10:23:23,470 - DEBUG - [Pod Pod ctest-pod-70324861] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-08-26 10:23:23,470 - DEBUG - [Pod Pod ctest-pod-70324861] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-26 10:23:23,470 - INFO - wget check of of http://10.47.255.250 from ctest-pod-70324861 passed 2024-08-26 10:23:28,533 - DEBUG - [Pod ctest-pod-47150489] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-26 10:23:28,533 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-26 10:23:28,534 - DEBUG - [Pod Pod ctest-pod-47150489] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-26 10:23:28,534 - INFO - wget check of of http://10.47.255.250 from ctest-pod-47150489 passed 2024-08-26 10:23:28,613 - DEBUG - [Pod ctest-pod-93074729] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-26 10:23:28,613 - DEBUG - [Pod Pod ctest-pod-93074729] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-08-26 10:23:28,613 - DEBUG - [Pod Pod ctest-pod-93074729] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-26 10:23:28,614 - INFO - wget check of of http://10.47.255.251 from ctest-pod-93074729 passed 2024-08-26 10:23:28,614 - INFO - Deleting Network Policy : ingress-on-service 2024-08-26 10:23:28,615 - INFO - Deleting service : ctest-nginx-svc-25403587 2024-08-26 10:23:28,930 - DEBUG - No XMPP flaps were noticed during the test
2024-08-26 10:23:28,930 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:06]
2024-08-26 10:23:28,931 - INFO - -------------------------------------------------------------------------------- 2024-08-26 10:23:28,940 - INFO - Deleting pod ctest-new-default-31889956:ctest-pod-57283209 2024-08-26 10:23:28,941 - INFO - Deleting pod ctest-new-default-31889956:ctest-pod-24537169 2024-08-26 10:23:28,941 - INFO - Deleting pod ctest-non-default-51319982:ctest-pod-21117257 2024-08-26 10:23:28,942 - INFO - Deleting pod ctest-non-default-51319982:ctest-pod-12701077 2024-08-26 10:23:28,942 - INFO - Deleting pod ctest-new-default-31889956:ctest-pod-47150489 2024-08-26 10:23:28,943 - INFO - Deleting pod ctest-new-default-31889956:ctest-pod-70324861 2024-08-26 10:23:28,943 - INFO - Deleting pod ctest-non-default-51319982:ctest-pod-73729253 2024-08-26 10:23:28,944 - INFO - Deleting pod ctest-non-default-51319982:ctest-pod-93074729 2024-08-26 10:23:28,995 - WARNING - Pod uuid 6687530a-04d2-4880-9cc5-96d3cfa24fbc is still seen in agent 10.0.0.46 VM list 2024-08-26 10:23:29,118 - WARNING - Pod uuid 0972f09f-5bf7-4550-8017-eaa69700f22e is still seen in agent 10.0.0.46 VM list 2024-08-26 10:23:29,118 - WARNING - Pod uuid 8344ad1c-518f-4f79-b1e3-84dbfb29942f is still seen in agent 10.0.0.46 VM list 2024-08-26 10:23:29,119 - WARNING - Pod uuid d015e8ce-cb34-4214-8af4-dbe47ff38100 is still seen in agent 10.0.0.46 VM list 2024-08-26 10:23:29,119 - WARNING - Pod uuid d2d76e04-fb8d-4076-839f-9227465f8af3 is still seen in agent 10.0.0.46 VM list 2024-08-26 10:23:29,120 - WARNING - Pod uuid c43dc9a5-06aa-4e87-8ae2-a87872d37790 is still seen in agent 10.0.0.46 VM list 2024-08-26 10:23:29,120 - WARNING - Pod uuid eb1b1f49-cdd8-4945-88a2-06bf539b032a is still seen in agent 10.0.0.46 VM list 2024-08-26 10:23:29,121 - WARNING - Pod uuid 7f972a6e-17a6-428b-a545-3bffe346af66 is still seen in agent 10.0.0.46 VM list 2024-08-26 10:23:34,004 - DEBUG - Pod 6687530a-04d2-4880-9cc5-96d3cfa24fbc is not in agent 10.0.0.46 VM list 2024-08-26 10:23:34,014 - DEBUG - VMI c152899c-6394-11ef-8bd6-fa163ec8a58e is removed from agent 10.0.0.46 2024-08-26 10:23:34,014 - INFO - Verified that pod ctest-pod-57283209 is removed in agent 2024-08-26 10:23:34,163 - DEBUG - Pod 0972f09f-5bf7-4550-8017-eaa69700f22e is not in agent 10.0.0.46 VM list 2024-08-26 10:23:34,177 - WARNING - Pod uuid d015e8ce-cb34-4214-8af4-dbe47ff38100 is still seen in agent 10.0.0.46 VM list 2024-08-26 10:23:34,177 - DEBUG - Pod c43dc9a5-06aa-4e87-8ae2-a87872d37790 is not in agent 10.0.0.46 VM list 2024-08-26 10:23:34,183 - DEBUG - Pod d2d76e04-fb8d-4076-839f-9227465f8af3 is not in agent 10.0.0.46 VM list 2024-08-26 10:23:34,186 - WARNING - Pod uuid eb1b1f49-cdd8-4945-88a2-06bf539b032a is still seen in agent 10.0.0.46 VM list 2024-08-26 10:23:34,186 - WARNING - Pod uuid 7f972a6e-17a6-428b-a545-3bffe346af66 is still seen in agent 10.0.0.46 VM list 2024-08-26 10:23:34,187 - WARNING - Pod uuid 8344ad1c-518f-4f79-b1e3-84dbfb29942f is still seen in agent 10.0.0.46 VM list 2024-08-26 10:23:34,189 - DEBUG - VMI c301c820-6394-11ef-8bd6-fa163ec8a58e is removed from agent 10.0.0.46 2024-08-26 10:23:34,189 - INFO - Verified that pod ctest-pod-12701077 is removed in agent 2024-08-26 10:23:34,198 - DEBUG - VMI c1df981e-6394-11ef-8bd6-fa163ec8a58e is removed from agent 10.0.0.46 2024-08-26 10:23:34,198 - INFO - Verified that pod ctest-pod-24537169 is removed in agent 2024-08-26 10:23:34,199 - DEBUG - VMI c2801e88-6394-11ef-8bd6-fa163ec8a58e is removed from agent 10.0.0.46 2024-08-26 10:23:34,199 - INFO - Verified that pod ctest-pod-21117257 is removed in agent 2024-08-26 10:23:39,210 - WARNING - Pod uuid d015e8ce-cb34-4214-8af4-dbe47ff38100 is still seen in agent 10.0.0.46 VM list 2024-08-26 10:23:39,226 - WARNING - Pod uuid eb1b1f49-cdd8-4945-88a2-06bf539b032a is still seen in agent 10.0.0.46 VM list 2024-08-26 10:23:39,235 - WARNING - Pod uuid 8344ad1c-518f-4f79-b1e3-84dbfb29942f is still seen in agent 10.0.0.46 VM list 2024-08-26 10:23:39,237 - WARNING - Pod uuid 7f972a6e-17a6-428b-a545-3bffe346af66 is still seen in agent 10.0.0.46 VM list 2024-08-26 10:23:44,224 - WARNING - Pod uuid d015e8ce-cb34-4214-8af4-dbe47ff38100 is still seen in agent 10.0.0.46 VM list 2024-08-26 10:23:44,235 - WARNING - Pod uuid eb1b1f49-cdd8-4945-88a2-06bf539b032a is still seen in agent 10.0.0.46 VM list 2024-08-26 10:23:44,253 - WARNING - Pod uuid 8344ad1c-518f-4f79-b1e3-84dbfb29942f is still seen in agent 10.0.0.46 VM list 2024-08-26 10:23:44,256 - WARNING - Pod uuid 7f972a6e-17a6-428b-a545-3bffe346af66 is still seen in agent 10.0.0.46 VM list 2024-08-26 10:23:49,315 - WARNING - Pod uuid 7f972a6e-17a6-428b-a545-3bffe346af66 is still seen in agent 10.0.0.46 VM list 2024-08-26 10:23:49,316 - WARNING - Pod uuid d015e8ce-cb34-4214-8af4-dbe47ff38100 is still seen in agent 10.0.0.46 VM list 2024-08-26 10:23:49,317 - WARNING - Pod uuid 8344ad1c-518f-4f79-b1e3-84dbfb29942f is still seen in agent 10.0.0.46 VM list 2024-08-26 10:23:49,319 - WARNING - Pod uuid eb1b1f49-cdd8-4945-88a2-06bf539b032a is still seen in agent 10.0.0.46 VM list 2024-08-26 10:23:54,360 - WARNING - Pod uuid d015e8ce-cb34-4214-8af4-dbe47ff38100 is still seen in agent 10.0.0.46 VM list 2024-08-26 10:23:54,361 - WARNING - Pod uuid 7f972a6e-17a6-428b-a545-3bffe346af66 is still seen in agent 10.0.0.46 VM list 2024-08-26 10:23:54,366 - WARNING - Pod uuid eb1b1f49-cdd8-4945-88a2-06bf539b032a is still seen in agent 10.0.0.46 VM list 2024-08-26 10:23:54,367 - WARNING - Pod uuid 8344ad1c-518f-4f79-b1e3-84dbfb29942f is still seen in agent 10.0.0.46 VM list 2024-08-26 10:23:59,427 - WARNING - Pod uuid d015e8ce-cb34-4214-8af4-dbe47ff38100 is still seen in agent 10.0.0.46 VM list 2024-08-26 10:23:59,430 - WARNING - Pod uuid eb1b1f49-cdd8-4945-88a2-06bf539b032a is still seen in agent 10.0.0.46 VM list 2024-08-26 10:23:59,430 - WARNING - Pod uuid 8344ad1c-518f-4f79-b1e3-84dbfb29942f is still seen in agent 10.0.0.46 VM list 2024-08-26 10:23:59,431 - WARNING - Pod uuid 7f972a6e-17a6-428b-a545-3bffe346af66 is still seen in agent 10.0.0.46 VM list 2024-08-26 10:24:04,460 - DEBUG - Pod d015e8ce-cb34-4214-8af4-dbe47ff38100 is not in agent 10.0.0.46 VM list 2024-08-26 10:24:04,477 - DEBUG - Pod 8344ad1c-518f-4f79-b1e3-84dbfb29942f is not in agent 10.0.0.46 VM list 2024-08-26 10:24:04,484 - DEBUG - Pod eb1b1f49-cdd8-4945-88a2-06bf539b032a is not in agent 10.0.0.46 VM list 2024-08-26 10:24:04,488 - DEBUG - Pod 7f972a6e-17a6-428b-a545-3bffe346af66 is not in agent 10.0.0.46 VM list 2024-08-26 10:24:04,508 - DEBUG - VMI c520f4be-6394-11ef-8bd6-fa163ec8a58e is removed from agent 10.0.0.46 2024-08-26 10:24:04,508 - INFO - Verified that pod ctest-pod-93074729 is removed in agent 2024-08-26 10:24:04,513 - DEBUG - VMI c39c8f36-6394-11ef-8bd6-fa163ec8a58e is removed from agent 10.0.0.46 2024-08-26 10:24:04,513 - INFO - Verified that pod ctest-pod-47150489 is removed in agent 2024-08-26 10:24:04,514 - DEBUG - VMI c41495d0-6394-11ef-8bd6-fa163ec8a58e is removed from agent 10.0.0.46 2024-08-26 10:24:04,514 - INFO - Verified that pod ctest-pod-70324861 is removed in agent 2024-08-26 10:24:04,515 - DEBUG - VMI c49bebd4-6394-11ef-8bd6-fa163ec8a58e is removed from agent 10.0.0.46 2024-08-26 10:24:04,515 - INFO - Verified that pod ctest-pod-73729253 is removed in agent 2024-08-26 10:24:04,515 - INFO - Deleting namespace ctest-non-default-51319982 2024-08-26 10:24:04,551 - DEBUG - Namespace ctest-non-default-51319982 still in k8s 2024-08-26 10:24:06,562 - DEBUG - Namespace ctest-non-default-51319982 still in k8s 2024-08-26 10:24:08,566 - DEBUG - Namespace ctest-non-default-51319982 still in k8s 2024-08-26 10:24:10,570 - DEBUG - Namespace ctest-non-default-51319982 is not in k8s 2024-08-26 10:24:10,570 - DEBUG - No need to check project deletion in contrail-api 2024-08-26 10:24:10,570 - INFO - Deleting namespace ctest-new-default-31889956 2024-08-26 10:24:10,583 - DEBUG - Namespace ctest-new-default-31889956 still in k8s 2024-08-26 10:24:12,595 - DEBUG - Namespace ctest-new-default-31889956 still in k8s 2024-08-26 10:24:14,606 - DEBUG - Namespace ctest-new-default-31889956 still in k8s 2024-08-26 10:24:16,610 - DEBUG - Namespace ctest-new-default-31889956 is not in k8s 2024-08-26 10:24:16,610 - DEBUG - No need to check project deletion in contrail-api