2024-09-02 16:09:25,924 - INFO - Using existing project ['default-domain', 'k8s-default'](3aae144d-d251-41d8-93f5-a64982e4146f) 2024-09-02 16:09:25,962 - DEBUG - Namespace ctest-new-default-30550737 not present 2024-09-02 16:09:25,972 - INFO - Created namespace ctest-new-default-30550737 2024-09-02 16:09:28,977 - DEBUG - Namespace ctest-non-default-75538988 not present 2024-09-02 16:09:28,984 - INFO - Created namespace ctest-non-default-75538988 2024-09-02 16:09:32,010 - DEBUG - Pod ctest-pod-09459130 not present 2024-09-02 16:09:32,010 - INFO - Creating Pod ctest-pod-09459130 2024-09-02 16:09:32,039 - DEBUG - Pod : ctest-pod-09459130 UUID is 4eee576b-a116-4197-879d-13335a0c1076 2024-09-02 16:09:32,051 - DEBUG - Pod ctest-pod-58729001 not present 2024-09-02 16:09:32,052 - INFO - Creating Pod ctest-pod-58729001 2024-09-02 16:09:32,074 - DEBUG - Pod : ctest-pod-58729001 UUID is be0772f8-0a25-4906-adf3-34ed5526948a 2024-09-02 16:09:32,079 - DEBUG - Pod ctest-pod-24919276 not present 2024-09-02 16:09:32,079 - INFO - Creating Pod ctest-pod-24919276 2024-09-02 16:09:32,115 - DEBUG - Pod : ctest-pod-24919276 UUID is b11a9657-dbb5-4aea-97b0-01bd4e36723b 2024-09-02 16:09:32,118 - DEBUG - Pod ctest-pod-60553582 not present 2024-09-02 16:09:32,118 - INFO - Creating Pod ctest-pod-60553582 2024-09-02 16:09:32,145 - DEBUG - Pod : ctest-pod-60553582 UUID is 2eda77bd-cb7f-464d-9622-a6e884f33ca2 2024-09-02 16:09:32,147 - DEBUG - Pod ctest-pod-97612474 not present 2024-09-02 16:09:32,149 - INFO - Creating Pod ctest-pod-97612474 2024-09-02 16:09:32,176 - DEBUG - Pod : ctest-pod-97612474 UUID is 3caa9958-75be-46f3-9c87-9ce392d06437 2024-09-02 16:09:32,178 - DEBUG - Pod ctest-pod-29376918 not present 2024-09-02 16:09:32,178 - INFO - Creating Pod ctest-pod-29376918 2024-09-02 16:09:32,196 - DEBUG - Pod : ctest-pod-29376918 UUID is 066f64f8-193b-4ad7-8d4e-ccba3c50d3d2 2024-09-02 16:09:32,198 - DEBUG - Pod ctest-pod-91421700 not present 2024-09-02 16:09:32,198 - INFO - Creating Pod ctest-pod-91421700 2024-09-02 16:09:32,223 - DEBUG - Pod : ctest-pod-91421700 UUID is 614b72bc-cba7-4230-8381-e4f9022f8de3 2024-09-02 16:09:32,225 - DEBUG - Pod ctest-pod-91045416 not present 2024-09-02 16:09:32,225 - INFO - Creating Pod ctest-pod-91045416 2024-09-02 16:09:32,258 - DEBUG - Pod : ctest-pod-91045416 UUID is 18262be6-1ead-4caa-8374-c0ac02343183 2024-09-02 16:09:32,407 - INFO - Project default-domain:k8s-ctest-new-default-30550737 for Namespace ctest-new-default-30550737 is seen in contrail-api 2024-09-02 16:09:32,407 - DEBUG - Project uuid in Contrail is d1e1d770-f342-486e-bf18-74cc786068e7 2024-09-02 16:09:32,548 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NamespaceDatabaseList?namespace_uuid=e49df0f8-8890-42a4-9f56-b1d5a4022bb5 2024-09-02 16:09:32,557 - INFO - Namespace ctest-new-default-30550737 with uuid e49df0f8-8890-42a4-9f56-b1d5a4022bb5 found in kube manager 2024-09-02 16:09:32,557 - INFO - Namespace ctest-new-default-30550737 verification passed 2024-09-02 16:09:32,731 - INFO - Project default-domain:k8s-ctest-non-default-75538988 for Namespace ctest-non-default-75538988 is seen in contrail-api 2024-09-02 16:09:32,732 - DEBUG - Project uuid in Contrail is dabb42e7-9362-46a8-8336-bf9f3555bda2 2024-09-02 16:09:32,732 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NamespaceDatabaseList?namespace_uuid=70f14b74-73ad-47cc-a325-796270e1c8a3 2024-09-02 16:09:32,738 - INFO - Namespace ctest-non-default-75538988 with uuid 70f14b74-73ad-47cc-a325-796270e1c8a3 found in kube manager 2024-09-02 16:09:32,738 - INFO - Namespace ctest-non-default-75538988 verification passed 2024-09-02 16:09:32,747 - DEBUG - Pod ctest-pod-09459130 not in running state.Currently in Pending 2024-09-02 16:09:37,755 - DEBUG - Pod ctest-pod-09459130 not in running state.Currently in Pending 2024-09-02 16:09:42,761 - INFO - Pod ctest-pod-09459130 is in running state.Got IP 10.47.255.251 2024-09-02 16:09:42,816 - DEBUG - Pod ctest-pod-09459130 has vmi be30bffc-6945-11ef-ad8d-fa163e786fc7 2024-09-02 16:09:42,816 - INFO - Verified pod ctest-pod-09459130 in contrail-api 2024-09-02 16:09:42,836 - DEBUG - VMI be30bffc-6945-11ef-ad8d-fa163e786fc7 is active in agent 10.0.0.24 2024-09-02 16:09:42,836 - INFO - Verified Pod ctest-pod-09459130 in agent 10.0.0.24 2024-09-02 16:09:42,836 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=4eee576b-a116-4197-879d-13335a0c1076 2024-09-02 16:09:42,841 - INFO - Pod ctest-pod-09459130 with uuid 4eee576b-a116-4197-879d-13335a0c1076 found in kube manager 2024-09-02 16:09:42,841 - INFO - Pod ctest-pod-09459130 verification passed 2024-09-02 16:09:42,846 - DEBUG - Pod ctest-pod-58729001 not in running state.Currently in Pending 2024-09-02 16:09:47,853 - DEBUG - Pod ctest-pod-58729001 not in running state.Currently in Pending 2024-09-02 16:09:52,859 - DEBUG - Pod ctest-pod-58729001 not in running state.Currently in Pending 2024-09-02 16:09:57,866 - INFO - Pod ctest-pod-58729001 is in running state.Got IP 10.47.255.250 2024-09-02 16:09:57,877 - DEBUG - Pod ctest-pod-58729001 has vmi beaee134-6945-11ef-ad8d-fa163e786fc7 2024-09-02 16:09:57,877 - INFO - Verified pod ctest-pod-58729001 in contrail-api 2024-09-02 16:09:57,893 - DEBUG - VMI beaee134-6945-11ef-ad8d-fa163e786fc7 is active in agent 10.0.0.24 2024-09-02 16:09:57,894 - INFO - Verified Pod ctest-pod-58729001 in agent 10.0.0.24 2024-09-02 16:09:57,894 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=be0772f8-0a25-4906-adf3-34ed5526948a 2024-09-02 16:09:57,899 - INFO - Pod ctest-pod-58729001 with uuid be0772f8-0a25-4906-adf3-34ed5526948a found in kube manager 2024-09-02 16:09:57,899 - INFO - Pod ctest-pod-58729001 verification passed 2024-09-02 16:09:57,904 - INFO - Pod ctest-pod-24919276 is in running state.Got IP 10.47.255.249 2024-09-02 16:09:57,916 - DEBUG - Pod ctest-pod-24919276 has vmi bf429be0-6945-11ef-ad8d-fa163e786fc7 2024-09-02 16:09:57,916 - INFO - Verified pod ctest-pod-24919276 in contrail-api 2024-09-02 16:09:57,931 - DEBUG - VMI bf429be0-6945-11ef-ad8d-fa163e786fc7 is active in agent 10.0.0.24 2024-09-02 16:09:57,932 - INFO - Verified Pod ctest-pod-24919276 in agent 10.0.0.24 2024-09-02 16:09:57,932 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=b11a9657-dbb5-4aea-97b0-01bd4e36723b 2024-09-02 16:09:57,937 - INFO - Pod ctest-pod-24919276 with uuid b11a9657-dbb5-4aea-97b0-01bd4e36723b found in kube manager 2024-09-02 16:09:57,937 - INFO - Pod ctest-pod-24919276 verification passed 2024-09-02 16:09:57,944 - INFO - Pod ctest-pod-60553582 is in running state.Got IP 10.47.255.248 2024-09-02 16:09:58,008 - DEBUG - Pod ctest-pod-60553582 has vmi bfbbb48a-6945-11ef-ad8d-fa163e786fc7 2024-09-02 16:09:58,008 - INFO - Verified pod ctest-pod-60553582 in contrail-api 2024-09-02 16:09:58,025 - DEBUG - VMI bfbbb48a-6945-11ef-ad8d-fa163e786fc7 is active in agent 10.0.0.24 2024-09-02 16:09:58,026 - INFO - Verified Pod ctest-pod-60553582 in agent 10.0.0.24 2024-09-02 16:09:58,026 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=2eda77bd-cb7f-464d-9622-a6e884f33ca2 2024-09-02 16:09:58,032 - INFO - Pod ctest-pod-60553582 with uuid 2eda77bd-cb7f-464d-9622-a6e884f33ca2 found in kube manager 2024-09-02 16:09:58,032 - INFO - Pod ctest-pod-60553582 verification passed 2024-09-02 16:09:58,040 - INFO - Pod ctest-pod-97612474 is in running state.Got IP 10.47.255.247 2024-09-02 16:09:58,057 - DEBUG - Pod ctest-pod-97612474 has vmi c0405e42-6945-11ef-ad8d-fa163e786fc7 2024-09-02 16:09:58,057 - INFO - Verified pod ctest-pod-97612474 in contrail-api 2024-09-02 16:09:58,074 - DEBUG - VMI c0405e42-6945-11ef-ad8d-fa163e786fc7 is active in agent 10.0.0.24 2024-09-02 16:09:58,074 - INFO - Verified Pod ctest-pod-97612474 in agent 10.0.0.24 2024-09-02 16:09:58,075 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=3caa9958-75be-46f3-9c87-9ce392d06437 2024-09-02 16:09:58,080 - INFO - Pod ctest-pod-97612474 with uuid 3caa9958-75be-46f3-9c87-9ce392d06437 found in kube manager 2024-09-02 16:09:58,080 - INFO - Pod ctest-pod-97612474 verification passed 2024-09-02 16:09:58,086 - INFO - Pod ctest-pod-91421700 is in running state.Got IP 10.47.255.245 2024-09-02 16:09:58,141 - DEBUG - Pod ctest-pod-91421700 has vmi c120a9e8-6945-11ef-ad8d-fa163e786fc7 2024-09-02 16:09:58,141 - INFO - Verified pod ctest-pod-91421700 in contrail-api 2024-09-02 16:09:58,158 - DEBUG - VMI c120a9e8-6945-11ef-ad8d-fa163e786fc7 is active in agent 10.0.0.24 2024-09-02 16:09:58,158 - INFO - Verified Pod ctest-pod-91421700 in agent 10.0.0.24 2024-09-02 16:09:58,159 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=614b72bc-cba7-4230-8381-e4f9022f8de3 2024-09-02 16:09:58,165 - INFO - Pod ctest-pod-91421700 with uuid 614b72bc-cba7-4230-8381-e4f9022f8de3 found in kube manager 2024-09-02 16:09:58,165 - INFO - Pod ctest-pod-91421700 verification passed 2024-09-02 16:09:58,172 - INFO - Pod ctest-pod-29376918 is in running state.Got IP 10.47.255.246 2024-09-02 16:09:58,195 - DEBUG - Pod ctest-pod-29376918 has vmi c0afd916-6945-11ef-ad8d-fa163e786fc7 2024-09-02 16:09:58,195 - INFO - Verified pod ctest-pod-29376918 in contrail-api 2024-09-02 16:09:58,210 - DEBUG - VMI c0afd916-6945-11ef-ad8d-fa163e786fc7 is active in agent 10.0.0.24 2024-09-02 16:09:58,211 - INFO - Verified Pod ctest-pod-29376918 in agent 10.0.0.24 2024-09-02 16:09:58,211 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=066f64f8-193b-4ad7-8d4e-ccba3c50d3d2 2024-09-02 16:09:58,216 - INFO - Pod ctest-pod-29376918 with uuid 066f64f8-193b-4ad7-8d4e-ccba3c50d3d2 found in kube manager 2024-09-02 16:09:58,216 - INFO - Pod ctest-pod-29376918 verification passed 2024-09-02 16:09:58,223 - INFO - Pod ctest-pod-91045416 is in running state.Got IP 10.47.255.244 2024-09-02 16:09:58,282 - DEBUG - Pod ctest-pod-91045416 has vmi c18bfb08-6945-11ef-ad8d-fa163e786fc7 2024-09-02 16:09:58,282 - INFO - Verified pod ctest-pod-91045416 in contrail-api 2024-09-02 16:09:58,296 - DEBUG - VMI c18bfb08-6945-11ef-ad8d-fa163e786fc7 is active in agent 10.0.0.24 2024-09-02 16:09:58,297 - INFO - Verified Pod ctest-pod-91045416 in agent 10.0.0.24 2024-09-02 16:09:58,297 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=18262be6-1ead-4caa-8374-c0ac02343183 2024-09-02 16:09:58,302 - INFO - Pod ctest-pod-91045416 with uuid 18262be6-1ead-4caa-8374-c0ac02343183 found in kube manager 2024-09-02 16:09:58,302 - INFO - Pod ctest-pod-91045416 verification passed 2024-09-02 16:09:58,302 - INFO - ================================================================================ 2024-09-02 16:09:58,302 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-09-02 16:09:58,303 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-09-02 16:09:58,551 - DEBUG - Nothing to compare xmpp stats {'10.0.0.24': {'10.0.0.50': '3'}} with 2024-09-02 16:09:58,551 - INFO - Initial checks done. Running the testcase now 2024-09-02 16:09:58,551 - INFO - 2024-09-02 16:09:58,612 - DEBUG - [Pod ctest-pod-09459130] Cmd: echo ctest-pod-09459130 > /usr/share/nginx/html/index.html, Output: 2024-09-02 16:09:58,674 - DEBUG - [Pod ctest-pod-58729001] Cmd: echo ctest-pod-58729001 > /usr/share/nginx/html/index.html, Output: 2024-09-02 16:09:58,751 - DEBUG - [Pod ctest-pod-24919276] Cmd: echo ctest-pod-24919276 > /usr/share/nginx/html/index.html, Output: 2024-09-02 16:09:58,816 - DEBUG - [Pod ctest-pod-60553582] Cmd: echo ctest-pod-60553582 > /usr/share/nginx/html/index.html, Output: 2024-09-02 16:09:58,819 - DEBUG - Service ctest-nginx-svc-05644048 not present 2024-09-02 16:09:58,820 - INFO - Creating service ctest-nginx-svc-05644048 2024-09-02 16:09:58,840 - INFO - Created Service ctest-nginx-svc-05644048 2024-09-02 16:09:58,856 - WARNING - Service UUID 16061de3-6354-4daf-9e15-9cc945e66390 not yet found in contrail-api 2024-09-02 16:09:59,870 - INFO - Validated that Service ctest-nginx-svc-05644048 is seen in contrail-api 2024-09-02 16:09:59,870 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_LoadbalancerDatabaseList?x=16061de3-6354-4daf-9e15-9cc945e66390 2024-09-02 16:09:59,881 - INFO - Service ctest-nginx-svc-05644048 with uuid 16061de3-6354-4daf-9e15-9cc945e66390 found in kube manager 2024-09-02 16:09:59,881 - INFO - Service ctest-nginx-svc-05644048 verification passed 2024-09-02 16:10:00,952 - DEBUG - [Pod ctest-pod-97612474] Cmd: wget http://10.111.120.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.120.170:80 (10.111.120.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-58729001 2024-09-02 16:10:00,953 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd wget http://10.111.120.170:80/ -O - -T 5 -t 1 passed 2024-09-02 16:10:00,953 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd output: Connecting to 10.111.120.170:80 (10.111.120.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-58729001 2024-09-02 16:10:01,013 - DEBUG - [Pod ctest-pod-97612474] Cmd: wget http://10.111.120.170:80/ -O - -T 5 -t 1 , Output: ctest-pod-09459130 Connecting to 10.111.120.170:80 (10.111.120.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-02 16:10:01,013 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd wget http://10.111.120.170:80/ -O - -T 5 -t 1 passed 2024-09-02 16:10:01,013 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd output: ctest-pod-09459130 Connecting to 10.111.120.170:80 (10.111.120.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-02 16:10:01,013 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-09459130': 1, 'ctest-pod-58729001': 1} 2024-09-02 16:10:01,082 - DEBUG - [Pod ctest-pod-91421700] Cmd: wget http://10.111.120.170:80/ -O - -T 5 -t 1 , Output: ctest-pod-09459130 Connecting to 10.111.120.170:80 (10.111.120.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-02 16:10:01,082 - DEBUG - [Pod Pod ctest-pod-91421700] Cmd wget http://10.111.120.170:80/ -O - -T 5 -t 1 passed 2024-09-02 16:10:01,082 - DEBUG - [Pod Pod ctest-pod-91421700] Cmd output: ctest-pod-09459130 Connecting to 10.111.120.170:80 (10.111.120.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-02 16:10:01,136 - DEBUG - [Pod ctest-pod-91421700] Cmd: wget http://10.111.120.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.120.170:80 (10.111.120.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-09459130 2024-09-02 16:10:01,136 - DEBUG - [Pod Pod ctest-pod-91421700] Cmd wget http://10.111.120.170:80/ -O - -T 5 -t 1 passed 2024-09-02 16:10:01,136 - DEBUG - [Pod Pod ctest-pod-91421700] Cmd output: Connecting to 10.111.120.170:80 (10.111.120.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-09459130 2024-09-02 16:10:01,203 - DEBUG - [Pod ctest-pod-91421700] Cmd: wget http://10.111.120.170:80/ -O - -T 5 -t 1 , Output: ctest-pod-09459130 Connecting to 10.111.120.170:80 (10.111.120.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-02 16:10:01,203 - DEBUG - [Pod Pod ctest-pod-91421700] Cmd wget http://10.111.120.170:80/ -O - -T 5 -t 1 passed 2024-09-02 16:10:01,204 - DEBUG - [Pod Pod ctest-pod-91421700] Cmd output: ctest-pod-09459130 Connecting to 10.111.120.170:80 (10.111.120.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-02 16:10:01,263 - DEBUG - [Pod ctest-pod-91421700] Cmd: wget http://10.111.120.170:80/ -O - -T 5 -t 1 , Output: ctest-pod-58729001 Connecting to 10.111.120.170:80 (10.111.120.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-02 16:10:01,264 - DEBUG - [Pod Pod ctest-pod-91421700] Cmd wget http://10.111.120.170:80/ -O - -T 5 -t 1 passed 2024-09-02 16:10:01,264 - DEBUG - [Pod Pod ctest-pod-91421700] Cmd output: ctest-pod-58729001 Connecting to 10.111.120.170:80 (10.111.120.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-02 16:10:01,264 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-09459130': 3, 'ctest-pod-58729001': 1} 2024-09-02 16:10:01,268 - DEBUG - Network policy ingress-on-service not present 2024-09-02 16:10:01,269 - INFO - Creating Network Policy ingress-on-service 2024-09-02 16:10:01,285 - INFO - Network policy found in k8s 2024-09-02 16:10:01,286 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=0acbc567-1715-4090-ac54-e509fe126f99 2024-09-02 16:10:01,304 - INFO - Network Policy ingress-on-service with uuid 0acbc567-1715-4090-ac54-e509fe126f99 found in kube manager 2024-09-02 16:10:01,359 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-09-02 16:10:01,360 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-09-02 16:10:01,361 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=0acbc567-1715-4090-ac54-e509fe126f99 2024-09-02 16:10:01,421 - WARNING - Network policy with name ingress-on-service not found in agent 2024-09-02 16:10:03,423 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=0acbc567-1715-4090-ac54-e509fe126f99 2024-09-02 16:10:06,284 - WARNING - Network policy with name ingress-on-service not found in agent 2024-09-02 16:10:08,318 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=0acbc567-1715-4090-ac54-e509fe126f99 2024-09-02 16:10:08,356 - INFO - Network policy with name ingress-on-service found in agent 2024-09-02 16:10:08,357 - INFO - Network Policy ingress-on-service verification passed 2024-09-02 16:10:14,562 - DEBUG - [Pod ctest-pod-97612474] Cmd: wget http://10.111.120.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:10:14,562 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd wget http://10.111.120.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:10:14,562 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:10:24,097 - DEBUG - [Pod ctest-pod-97612474] Cmd: wget http://10.111.120.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:10:24,097 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd wget http://10.111.120.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:10:24,097 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:10:29,177 - DEBUG - [Pod ctest-pod-97612474] Cmd: wget http://10.111.120.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:10:29,178 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd wget http://10.111.120.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:10:29,178 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:10:34,228 - DEBUG - [Pod ctest-pod-97612474] Cmd: wget http://10.111.120.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:10:34,228 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd wget http://10.111.120.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:10:34,228 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:10:39,275 - DEBUG - [Pod ctest-pod-97612474] Cmd: wget http://10.111.120.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:10:39,275 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd wget http://10.111.120.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:10:39,276 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:10:44,337 - DEBUG - [Pod ctest-pod-97612474] Cmd: wget http://10.111.120.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:10:44,337 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd wget http://10.111.120.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:10:44,337 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:10:52,426 - DEBUG - [Pod ctest-pod-97612474] Cmd: wget http://10.111.120.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:10:52,426 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd wget http://10.111.120.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:10:52,426 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:10:57,489 - DEBUG - [Pod ctest-pod-97612474] Cmd: wget http://10.111.120.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:10:57,489 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd wget http://10.111.120.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:10:57,489 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:11:05,071 - DEBUG - [Pod ctest-pod-97612474] Cmd: wget http://10.111.120.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:11:05,071 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd wget http://10.111.120.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:11:05,071 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:11:10,125 - DEBUG - [Pod ctest-pod-97612474] Cmd: wget http://10.111.120.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:11:10,125 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd wget http://10.111.120.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:11:10,125 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:11:10,125 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-09459130': 0, 'ctest-pod-58729001': 0} 2024-09-02 16:11:10,207 - DEBUG - [Pod ctest-pod-29376918] Cmd: wget http://10.111.120.170:80/ -O - -T 5 -t 1 , Output: ctest-pod-09459130 Connecting to 10.111.120.170:80 (10.111.120.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-02 16:11:10,207 - DEBUG - [Pod Pod ctest-pod-29376918] Cmd wget http://10.111.120.170:80/ -O - -T 5 -t 1 passed 2024-09-02 16:11:10,207 - DEBUG - [Pod Pod ctest-pod-29376918] Cmd output: ctest-pod-09459130 Connecting to 10.111.120.170:80 (10.111.120.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-02 16:11:10,268 - DEBUG - [Pod ctest-pod-29376918] Cmd: wget http://10.111.120.170:80/ -O - -T 5 -t 1 , Output: ctest-pod-58729001 Connecting to 10.111.120.170:80 (10.111.120.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-02 16:11:10,268 - DEBUG - [Pod Pod ctest-pod-29376918] Cmd wget http://10.111.120.170:80/ -O - -T 5 -t 1 passed 2024-09-02 16:11:10,268 - DEBUG - [Pod Pod ctest-pod-29376918] Cmd output: ctest-pod-58729001 Connecting to 10.111.120.170:80 (10.111.120.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-02 16:11:10,268 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-09459130': 1, 'ctest-pod-58729001': 1} 2024-09-02 16:11:17,076 - DEBUG - [Pod ctest-pod-91421700] Cmd: wget http://10.111.120.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:11:17,077 - DEBUG - [Pod Pod ctest-pod-91421700] Cmd wget http://10.111.120.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:11:17,077 - DEBUG - [Pod Pod ctest-pod-91421700] Cmd output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:11:22,133 - DEBUG - [Pod ctest-pod-91421700] Cmd: wget http://10.111.120.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:11:22,133 - DEBUG - [Pod Pod ctest-pod-91421700] Cmd wget http://10.111.120.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:11:22,133 - DEBUG - [Pod Pod ctest-pod-91421700] Cmd output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:11:27,558 - DEBUG - [Pod ctest-pod-91421700] Cmd: wget http://10.111.120.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:11:27,558 - DEBUG - [Pod Pod ctest-pod-91421700] Cmd wget http://10.111.120.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:11:27,558 - DEBUG - [Pod Pod ctest-pod-91421700] Cmd output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:11:32,619 - DEBUG - [Pod ctest-pod-91421700] Cmd: wget http://10.111.120.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:11:32,620 - DEBUG - [Pod Pod ctest-pod-91421700] Cmd wget http://10.111.120.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:11:32,620 - DEBUG - [Pod Pod ctest-pod-91421700] Cmd output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:11:37,692 - DEBUG - [Pod ctest-pod-91421700] Cmd: wget http://10.111.120.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:11:37,693 - DEBUG - [Pod Pod ctest-pod-91421700] Cmd wget http://10.111.120.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:11:37,693 - DEBUG - [Pod Pod ctest-pod-91421700] Cmd output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:11:42,933 - DEBUG - [Pod ctest-pod-91421700] Cmd: wget http://10.111.120.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:11:42,933 - DEBUG - [Pod Pod ctest-pod-91421700] Cmd wget http://10.111.120.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:11:42,933 - DEBUG - [Pod Pod ctest-pod-91421700] Cmd output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:11:48,004 - DEBUG - [Pod ctest-pod-91421700] Cmd: wget http://10.111.120.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:11:48,004 - DEBUG - [Pod Pod ctest-pod-91421700] Cmd wget http://10.111.120.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:11:48,004 - DEBUG - [Pod Pod ctest-pod-91421700] Cmd output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:11:53,470 - DEBUG - [Pod ctest-pod-91421700] Cmd: wget http://10.111.120.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:11:53,470 - DEBUG - [Pod Pod ctest-pod-91421700] Cmd wget http://10.111.120.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:11:53,470 - DEBUG - [Pod Pod ctest-pod-91421700] Cmd output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:11:58,524 - DEBUG - [Pod ctest-pod-91421700] Cmd: wget http://10.111.120.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:11:58,524 - DEBUG - [Pod Pod ctest-pod-91421700] Cmd wget http://10.111.120.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:11:58,524 - DEBUG - [Pod Pod ctest-pod-91421700] Cmd output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:12:03,581 - DEBUG - [Pod ctest-pod-91421700] Cmd: wget http://10.111.120.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:12:03,581 - DEBUG - [Pod Pod ctest-pod-91421700] Cmd wget http://10.111.120.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:12:03,581 - DEBUG - [Pod Pod ctest-pod-91421700] Cmd output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:12:03,581 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-09459130': 0, 'ctest-pod-58729001': 0} 2024-09-02 16:12:05,640 - DEBUG - [Pod ctest-pod-29376918] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.432 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.073 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.072 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.072/0.525/1.432 ms 2024-09-02 16:12:05,641 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-29376918 with expectation True passed 2024-09-02 16:12:13,095 - DEBUG - [Pod ctest-pod-97612474] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.402 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.077 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.111 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.077/0.196/0.402 ms 2024-09-02 16:12:13,095 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-97612474 with expectation True passed 2024-09-02 16:12:15,193 - DEBUG - [Pod ctest-pod-91421700] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.199 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.075 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.643 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.075/0.639/1.199 ms 2024-09-02 16:12:15,193 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-91421700 with expectation True passed 2024-09-02 16:12:15,268 - DEBUG - [Pod ctest-pod-29376918] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-02 16:12:15,268 - DEBUG - [Pod Pod ctest-pod-29376918] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-02 16:12:15,268 - DEBUG - [Pod Pod ctest-pod-29376918] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-02 16:12:15,268 - INFO - wget check of of http://10.47.255.251 from ctest-pod-29376918 passed 2024-09-02 16:12:15,347 - DEBUG - [Pod ctest-pod-29376918] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-02 16:12:15,347 - DEBUG - [Pod Pod ctest-pod-29376918] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-09-02 16:12:15,347 - DEBUG - [Pod Pod ctest-pod-29376918] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-02 16:12:15,347 - INFO - wget check of of http://10.47.255.250 from ctest-pod-29376918 passed 2024-09-02 16:12:20,413 - DEBUG - [Pod ctest-pod-97612474] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-02 16:12:20,413 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-02 16:12:20,413 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-02 16:12:20,413 - INFO - wget check of of http://10.47.255.250 from ctest-pod-97612474 passed 2024-09-02 16:12:25,478 - DEBUG - [Pod ctest-pod-91045416] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-02 16:12:25,478 - DEBUG - [Pod Pod ctest-pod-91045416] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-02 16:12:25,478 - DEBUG - [Pod Pod ctest-pod-91045416] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-02 16:12:25,478 - INFO - wget check of of http://10.47.255.251 from ctest-pod-91045416 passed 2024-09-02 16:12:25,487 - INFO - Updating Network Policy ingress-on-service 2024-09-02 16:12:30,561 - DEBUG - [Pod ctest-pod-97612474] Cmd: wget http://10.111.120.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:12:30,561 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd wget http://10.111.120.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:12:30,561 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:12:35,620 - DEBUG - [Pod ctest-pod-97612474] Cmd: wget http://10.111.120.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:12:35,620 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd wget http://10.111.120.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:12:35,620 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:12:46,909 - DEBUG - [Pod ctest-pod-97612474] Cmd: wget http://10.111.120.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:12:46,909 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd wget http://10.111.120.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:12:46,909 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:12:52,000 - DEBUG - [Pod ctest-pod-97612474] Cmd: wget http://10.111.120.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:12:52,001 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd wget http://10.111.120.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:12:52,001 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:12:57,052 - DEBUG - [Pod ctest-pod-97612474] Cmd: wget http://10.111.120.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:12:57,052 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd wget http://10.111.120.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:12:57,052 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:13:02,114 - DEBUG - [Pod ctest-pod-97612474] Cmd: wget http://10.111.120.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:13:02,114 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd wget http://10.111.120.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:13:02,114 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:13:07,171 - DEBUG - [Pod ctest-pod-97612474] Cmd: wget http://10.111.120.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:13:07,171 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd wget http://10.111.120.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:13:07,171 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:13:12,231 - DEBUG - [Pod ctest-pod-97612474] Cmd: wget http://10.111.120.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:13:12,231 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd wget http://10.111.120.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:13:12,231 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:13:17,297 - DEBUG - [Pod ctest-pod-97612474] Cmd: wget http://10.111.120.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:13:17,298 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd wget http://10.111.120.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:13:17,298 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:13:22,357 - DEBUG - [Pod ctest-pod-97612474] Cmd: wget http://10.111.120.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:13:22,357 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd wget http://10.111.120.170:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:13:22,357 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd output: Connecting to 10.111.120.170:80 (10.111.120.170:80) wget: download timed out 2024-09-02 16:13:22,357 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-09459130': 0, 'ctest-pod-58729001': 0} 2024-09-02 16:13:22,428 - DEBUG - [Pod ctest-pod-29376918] Cmd: wget http://10.111.120.170:80/ -O - -T 5 -t 1 , Output: ctest-pod-09459130 Connecting to 10.111.120.170:80 (10.111.120.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-02 16:13:22,428 - DEBUG - [Pod Pod ctest-pod-29376918] Cmd wget http://10.111.120.170:80/ -O - -T 5 -t 1 passed 2024-09-02 16:13:22,428 - DEBUG - [Pod Pod ctest-pod-29376918] Cmd output: ctest-pod-09459130 Connecting to 10.111.120.170:80 (10.111.120.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-02 16:13:22,482 - DEBUG - [Pod ctest-pod-29376918] Cmd: wget http://10.111.120.170:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.120.170:80 (10.111.120.170:80) ctest-pod-58729001 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-02 16:13:22,482 - DEBUG - [Pod Pod ctest-pod-29376918] Cmd wget http://10.111.120.170:80/ -O - -T 5 -t 1 passed 2024-09-02 16:13:22,482 - DEBUG - [Pod Pod ctest-pod-29376918] Cmd output: Connecting to 10.111.120.170:80 (10.111.120.170:80) ctest-pod-58729001 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-02 16:13:22,482 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-09459130': 1, 'ctest-pod-58729001': 1} 2024-09-02 16:13:22,556 - DEBUG - [Pod ctest-pod-91421700] Cmd: wget http://10.111.120.170:80/ -O - -T 5 -t 1 , Output: ctest-pod-09459130 Connecting to 10.111.120.170:80 (10.111.120.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-02 16:13:22,556 - DEBUG - [Pod Pod ctest-pod-91421700] Cmd wget http://10.111.120.170:80/ -O - -T 5 -t 1 passed 2024-09-02 16:13:22,556 - DEBUG - [Pod Pod ctest-pod-91421700] Cmd output: ctest-pod-09459130 Connecting to 10.111.120.170:80 (10.111.120.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-02 16:13:22,615 - DEBUG - [Pod ctest-pod-91421700] Cmd: wget http://10.111.120.170:80/ -O - -T 5 -t 1 , Output: ctest-pod-58729001 Connecting to 10.111.120.170:80 (10.111.120.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-02 16:13:22,615 - DEBUG - [Pod Pod ctest-pod-91421700] Cmd wget http://10.111.120.170:80/ -O - -T 5 -t 1 passed 2024-09-02 16:13:22,615 - DEBUG - [Pod Pod ctest-pod-91421700] Cmd output: ctest-pod-58729001 Connecting to 10.111.120.170:80 (10.111.120.170:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-02 16:13:22,615 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-09459130': 1, 'ctest-pod-58729001': 1} 2024-09-02 16:13:24,668 - DEBUG - [Pod ctest-pod-29376918] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.368 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.072 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.090 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.072/0.176/0.368 ms 2024-09-02 16:13:24,668 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-29376918 with expectation True passed 2024-09-02 16:13:26,724 - DEBUG - [Pod ctest-pod-97612474] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.842 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.073 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.101 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.073/0.338/0.842 ms 2024-09-02 16:13:26,724 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-97612474 with expectation True passed 2024-09-02 16:13:28,806 - DEBUG - [Pod ctest-pod-91421700] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.470 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.087 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.077 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.077/0.211/0.470 ms 2024-09-02 16:13:28,806 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-91421700 with expectation True passed 2024-09-02 16:13:28,865 - DEBUG - [Pod ctest-pod-29376918] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-02 16:13:28,865 - DEBUG - [Pod Pod ctest-pod-29376918] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-02 16:13:28,865 - DEBUG - [Pod Pod ctest-pod-29376918] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-02 16:13:28,865 - INFO - wget check of of http://10.47.255.251 from ctest-pod-29376918 passed 2024-09-02 16:13:28,925 - DEBUG - [Pod ctest-pod-29376918] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-02 16:13:28,925 - DEBUG - [Pod Pod ctest-pod-29376918] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-09-02 16:13:28,926 - DEBUG - [Pod Pod ctest-pod-29376918] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-02 16:13:28,926 - INFO - wget check of of http://10.47.255.250 from ctest-pod-29376918 passed 2024-09-02 16:13:34,007 - DEBUG - [Pod ctest-pod-97612474] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-02 16:13:34,007 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-02 16:13:34,007 - DEBUG - [Pod Pod ctest-pod-97612474] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-02 16:13:34,007 - INFO - wget check of of http://10.47.255.250 from ctest-pod-97612474 passed 2024-09-02 16:13:34,069 - DEBUG - [Pod ctest-pod-91045416] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-02 16:13:34,069 - DEBUG - [Pod Pod ctest-pod-91045416] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-02 16:13:34,069 - DEBUG - [Pod Pod ctest-pod-91045416] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-02 16:13:34,069 - INFO - wget check of of http://10.47.255.251 from ctest-pod-91045416 passed 2024-09-02 16:13:34,069 - INFO - Deleting Network Policy : ingress-on-service 2024-09-02 16:13:34,070 - INFO - Deleting service : ctest-nginx-svc-05644048 2024-09-02 16:13:34,304 - ERROR - XMPP status is {'10.0.0.24': {'10.0.0.50': '5'}}, Expected: {'10.0.0.24': {'10.0.0.50': '3'}} 2024-09-02 16:13:34,305 - INFO - 2024-09-02 16:13:34,305 - INFO - END TEST : test_ingress_rule_on_pod_with_service : FAILED[0:03:36] 2024-09-02 16:13:34,305 - INFO - -------------------------------------------------------------------------------- 2024-09-02 16:13:34,312 - INFO - Deleting pod ctest-new-default-30550737:ctest-pod-09459130 2024-09-02 16:13:34,313 - INFO - Deleting pod ctest-new-default-30550737:ctest-pod-58729001 2024-09-02 16:13:34,313 - INFO - Deleting pod ctest-non-default-75538988:ctest-pod-24919276 2024-09-02 16:13:34,313 - INFO - Deleting pod ctest-non-default-75538988:ctest-pod-60553582 2024-09-02 16:13:34,314 - INFO - Deleting pod ctest-new-default-30550737:ctest-pod-97612474 2024-09-02 16:13:34,314 - INFO - Deleting pod ctest-new-default-30550737:ctest-pod-29376918 2024-09-02 16:13:34,314 - INFO - Deleting pod ctest-non-default-75538988:ctest-pod-91421700 2024-09-02 16:13:34,315 - INFO - Deleting pod ctest-non-default-75538988:ctest-pod-91045416 2024-09-02 16:13:34,405 - WARNING - Pod uuid b11a9657-dbb5-4aea-97b0-01bd4e36723b is still seen in agent 10.0.0.24 VM list 2024-09-02 16:13:34,450 - WARNING - Pod uuid 4eee576b-a116-4197-879d-13335a0c1076 is still seen in agent 10.0.0.24 VM list 2024-09-02 16:13:34,452 - WARNING - Pod uuid 066f64f8-193b-4ad7-8d4e-ccba3c50d3d2 is still seen in agent 10.0.0.24 VM list 2024-09-02 16:13:34,453 - WARNING - Pod uuid 18262be6-1ead-4caa-8374-c0ac02343183 is still seen in agent 10.0.0.24 VM list 2024-09-02 16:13:34,453 - WARNING - Pod uuid be0772f8-0a25-4906-adf3-34ed5526948a is still seen in agent 10.0.0.24 VM list 2024-09-02 16:13:34,454 - WARNING - Pod uuid 614b72bc-cba7-4230-8381-e4f9022f8de3 is still seen in agent 10.0.0.24 VM list 2024-09-02 16:13:34,454 - WARNING - Pod uuid 2eda77bd-cb7f-464d-9622-a6e884f33ca2 is still seen in agent 10.0.0.24 VM list 2024-09-02 16:13:34,455 - WARNING - Pod uuid 3caa9958-75be-46f3-9c87-9ce392d06437 is still seen in agent 10.0.0.24 VM list 2024-09-02 16:13:39,473 - WARNING - Pod uuid be0772f8-0a25-4906-adf3-34ed5526948a is still seen in agent 10.0.0.24 VM list 2024-09-02 16:13:39,475 - WARNING - Pod uuid 614b72bc-cba7-4230-8381-e4f9022f8de3 is still seen in agent 10.0.0.24 VM list 2024-09-02 16:13:39,476 - WARNING - Pod uuid 2eda77bd-cb7f-464d-9622-a6e884f33ca2 is still seen in agent 10.0.0.24 VM list 2024-09-02 16:13:40,187 - DEBUG - Pod 4eee576b-a116-4197-879d-13335a0c1076 is not in agent 10.0.0.24 VM list 2024-09-02 16:13:40,195 - DEBUG - VMI be30bffc-6945-11ef-ad8d-fa163e786fc7 is removed from agent 10.0.0.24 2024-09-02 16:13:40,195 - INFO - Verified that pod ctest-pod-09459130 is removed in agent 2024-09-02 16:13:40,215 - WARNING - Pod uuid 3caa9958-75be-46f3-9c87-9ce392d06437 is still seen in agent 10.0.0.24 VM list 2024-09-02 16:13:40,217 - DEBUG - Pod b11a9657-dbb5-4aea-97b0-01bd4e36723b is not in agent 10.0.0.24 VM list 2024-09-02 16:13:40,233 - WARNING - Pod uuid 066f64f8-193b-4ad7-8d4e-ccba3c50d3d2 is still seen in agent 10.0.0.24 VM list 2024-09-02 16:13:40,234 - WARNING - Pod uuid 18262be6-1ead-4caa-8374-c0ac02343183 is still seen in agent 10.0.0.24 VM list 2024-09-02 16:13:40,234 - DEBUG - VMI bf429be0-6945-11ef-ad8d-fa163e786fc7 is removed from agent 10.0.0.24 2024-09-02 16:13:40,234 - INFO - Verified that pod ctest-pod-24919276 is removed in agent 2024-09-02 16:13:44,486 - DEBUG - Pod be0772f8-0a25-4906-adf3-34ed5526948a is not in agent 10.0.0.24 VM list 2024-09-02 16:13:44,489 - DEBUG - Pod 2eda77bd-cb7f-464d-9622-a6e884f33ca2 is not in agent 10.0.0.24 VM list 2024-09-02 16:13:44,495 - DEBUG - VMI bfbbb48a-6945-11ef-ad8d-fa163e786fc7 is removed from agent 10.0.0.24 2024-09-02 16:13:44,495 - INFO - Verified that pod ctest-pod-60553582 is removed in agent 2024-09-02 16:13:47,580 - DEBUG - VMI beaee134-6945-11ef-ad8d-fa163e786fc7 is removed from agent 10.0.0.24 2024-09-02 16:13:47,580 - INFO - Verified that pod ctest-pod-58729001 is removed in agent 2024-09-02 16:13:47,581 - WARNING - Pod uuid 3caa9958-75be-46f3-9c87-9ce392d06437 is still seen in agent 10.0.0.24 VM list 2024-09-02 16:13:47,583 - WARNING - Pod uuid 066f64f8-193b-4ad7-8d4e-ccba3c50d3d2 is still seen in agent 10.0.0.24 VM list 2024-09-02 16:13:47,584 - WARNING - Pod uuid 614b72bc-cba7-4230-8381-e4f9022f8de3 is still seen in agent 10.0.0.24 VM list 2024-09-02 16:13:48,269 - WARNING - Pod uuid 18262be6-1ead-4caa-8374-c0ac02343183 is still seen in agent 10.0.0.24 VM list 2024-09-02 16:13:52,595 - WARNING - Pod uuid 3caa9958-75be-46f3-9c87-9ce392d06437 is still seen in agent 10.0.0.24 VM list 2024-09-02 16:13:52,596 - WARNING - Pod uuid 066f64f8-193b-4ad7-8d4e-ccba3c50d3d2 is still seen in agent 10.0.0.24 VM list 2024-09-02 16:13:58,814 - WARNING - Pod uuid 3caa9958-75be-46f3-9c87-9ce392d06437 is still seen in agent 10.0.0.24 VM list 2024-09-02 16:13:58,815 - WARNING - Pod uuid 066f64f8-193b-4ad7-8d4e-ccba3c50d3d2 is still seen in agent 10.0.0.24 VM list 2024-09-02 16:14:03,827 - WARNING - Pod uuid 3caa9958-75be-46f3-9c87-9ce392d06437 is still seen in agent 10.0.0.24 VM list 2024-09-02 16:14:03,829 - WARNING - Pod uuid 066f64f8-193b-4ad7-8d4e-ccba3c50d3d2 is still seen in agent 10.0.0.24 VM list 2024-09-02 16:14:05,546 - WARNING - Pod uuid 614b72bc-cba7-4230-8381-e4f9022f8de3 is still seen in agent 10.0.0.24 VM list 2024-09-02 16:14:05,809 - WARNING - Pod uuid 18262be6-1ead-4caa-8374-c0ac02343183 is still seen in agent 10.0.0.24 VM list 2024-09-02 16:14:08,840 - WARNING - Pod uuid 3caa9958-75be-46f3-9c87-9ce392d06437 is still seen in agent 10.0.0.24 VM list 2024-09-02 16:14:08,841 - WARNING - Pod uuid 066f64f8-193b-4ad7-8d4e-ccba3c50d3d2 is still seen in agent 10.0.0.24 VM list 2024-09-02 16:14:10,555 - DEBUG - Pod 614b72bc-cba7-4230-8381-e4f9022f8de3 is not in agent 10.0.0.24 VM list 2024-09-02 16:14:10,562 - DEBUG - VMI c120a9e8-6945-11ef-ad8d-fa163e786fc7 is removed from agent 10.0.0.24 2024-09-02 16:14:10,562 - INFO - Verified that pod ctest-pod-91421700 is removed in agent 2024-09-02 16:14:10,817 - DEBUG - Pod 18262be6-1ead-4caa-8374-c0ac02343183 is not in agent 10.0.0.24 VM list 2024-09-02 16:14:10,825 - DEBUG - VMI c18bfb08-6945-11ef-ad8d-fa163e786fc7 is removed from agent 10.0.0.24 2024-09-02 16:14:10,825 - INFO - Verified that pod ctest-pod-91045416 is removed in agent 2024-09-02 16:14:13,852 - DEBUG - Pod 066f64f8-193b-4ad7-8d4e-ccba3c50d3d2 is not in agent 10.0.0.24 VM list 2024-09-02 16:14:13,854 - DEBUG - Pod 3caa9958-75be-46f3-9c87-9ce392d06437 is not in agent 10.0.0.24 VM list 2024-09-02 16:14:13,864 - DEBUG - VMI c0afd916-6945-11ef-ad8d-fa163e786fc7 is removed from agent 10.0.0.24 2024-09-02 16:14:13,864 - INFO - Verified that pod ctest-pod-29376918 is removed in agent 2024-09-02 16:14:13,864 - DEBUG - VMI c0405e42-6945-11ef-ad8d-fa163e786fc7 is removed from agent 10.0.0.24 2024-09-02 16:14:13,864 - INFO - Verified that pod ctest-pod-97612474 is removed in agent 2024-09-02 16:14:13,864 - INFO - Deleting namespace ctest-non-default-75538988 2024-09-02 16:14:13,882 - DEBUG - Namespace ctest-non-default-75538988 still in k8s 2024-09-02 16:14:15,888 - DEBUG - Namespace ctest-non-default-75538988 still in k8s 2024-09-02 16:14:17,899 - DEBUG - Namespace ctest-non-default-75538988 still in k8s 2024-09-02 16:14:19,904 - DEBUG - Namespace ctest-non-default-75538988 is not in k8s 2024-09-02 16:14:19,904 - DEBUG - No need to check project deletion in contrail-api 2024-09-02 16:14:19,904 - INFO - Deleting namespace ctest-new-default-30550737 2024-09-02 16:14:19,913 - DEBUG - Namespace ctest-new-default-30550737 still in k8s 2024-09-02 16:14:21,919 - DEBUG - Namespace ctest-new-default-30550737 still in k8s 2024-09-02 16:14:23,924 - DEBUG - Namespace ctest-new-default-30550737 still in k8s 2024-09-02 16:14:25,927 - DEBUG - Namespace ctest-new-default-30550737 is not in k8s 2024-09-02 16:14:25,927 - DEBUG - No need to check project deletion in contrail-api