2024-09-05 02:21:39,830 - INFO - Using existing project ['default-domain', 'k8s-default'](55b63f79-2404-489e-9bfd-75c11996306f) 2024-09-05 02:21:39,864 - DEBUG - Namespace ctest-new-default-53158373 not present 2024-09-05 02:21:39,881 - INFO - Created namespace ctest-new-default-53158373 2024-09-05 02:21:42,887 - DEBUG - Namespace ctest-non-default-70078783 not present 2024-09-05 02:21:42,910 - INFO - Created namespace ctest-non-default-70078783 2024-09-05 02:21:45,965 - DEBUG - Pod ctest-pod-44850204 not present 2024-09-05 02:21:45,968 - INFO - Creating Pod ctest-pod-44850204 2024-09-05 02:21:46,031 - DEBUG - Pod : ctest-pod-44850204 UUID is b46ee361-b2d3-4844-bdd6-7938cf439eda 2024-09-05 02:21:46,034 - DEBUG - Pod ctest-pod-65560100 not present 2024-09-05 02:21:46,034 - INFO - Creating Pod ctest-pod-65560100 2024-09-05 02:21:46,066 - DEBUG - Pod : ctest-pod-65560100 UUID is 86db69c3-1b4d-4c47-9441-f798f7bb75e8 2024-09-05 02:21:46,069 - DEBUG - Pod ctest-pod-93661295 not present 2024-09-05 02:21:46,069 - INFO - Creating Pod ctest-pod-93661295 2024-09-05 02:21:46,112 - DEBUG - Pod : ctest-pod-93661295 UUID is 0f453bc5-54e5-42ef-a34d-f8cfcc5cf7e6 2024-09-05 02:21:46,117 - DEBUG - Pod ctest-pod-60480638 not present 2024-09-05 02:21:46,117 - INFO - Creating Pod ctest-pod-60480638 2024-09-05 02:21:46,140 - DEBUG - Pod : ctest-pod-60480638 UUID is ed38e5b9-86ff-4e89-88b4-b41024f924b3 2024-09-05 02:21:46,142 - DEBUG - Pod ctest-pod-63432553 not present 2024-09-05 02:21:46,142 - INFO - Creating Pod ctest-pod-63432553 2024-09-05 02:21:46,163 - DEBUG - Pod : ctest-pod-63432553 UUID is 38adccb1-00a1-4373-b506-a61b1a39a551 2024-09-05 02:21:46,165 - DEBUG - Pod ctest-pod-70207192 not present 2024-09-05 02:21:46,165 - INFO - Creating Pod ctest-pod-70207192 2024-09-05 02:21:46,181 - DEBUG - Pod : ctest-pod-70207192 UUID is 7f3ee1df-ff91-4d8a-a13b-5c200347c1b4 2024-09-05 02:21:46,183 - DEBUG - Pod ctest-pod-72484234 not present 2024-09-05 02:21:46,184 - INFO - Creating Pod ctest-pod-72484234 2024-09-05 02:21:46,203 - DEBUG - Pod : ctest-pod-72484234 UUID is af194ee3-8e65-447d-8329-1e7e1cae9bef 2024-09-05 02:21:46,208 - DEBUG - Pod ctest-pod-52452883 not present 2024-09-05 02:21:46,210 - INFO - Creating Pod ctest-pod-52452883 2024-09-05 02:21:46,243 - DEBUG - Pod : ctest-pod-52452883 UUID is 62ae11d3-003e-4d3b-9dcb-48314dacaeae 2024-09-05 02:21:46,401 - INFO - Project default-domain:k8s-ctest-new-default-53158373 for Namespace ctest-new-default-53158373 is seen in contrail-api 2024-09-05 02:21:46,401 - DEBUG - Project uuid in Contrail is cbdc32ff-4f26-413d-837a-8abfefe0f88f 2024-09-05 02:21:46,597 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_NamespaceDatabaseList?namespace_uuid=cf8ad771-f788-427e-b49d-b17f6982b523 2024-09-05 02:21:46,602 - INFO - Namespace ctest-new-default-53158373 with uuid cf8ad771-f788-427e-b49d-b17f6982b523 found in kube manager 2024-09-05 02:21:46,602 - INFO - Namespace ctest-new-default-53158373 verification passed 2024-09-05 02:21:46,827 - INFO - Project default-domain:k8s-ctest-non-default-70078783 for Namespace ctest-non-default-70078783 is seen in contrail-api 2024-09-05 02:21:46,827 - DEBUG - Project uuid in Contrail is 92cec5d0-2d4a-46e4-a848-f4678688a33d 2024-09-05 02:21:46,828 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_NamespaceDatabaseList?namespace_uuid=9672d794-f553-4c4f-8425-b4c4fccf01e6 2024-09-05 02:21:46,844 - INFO - Namespace ctest-non-default-70078783 with uuid 9672d794-f553-4c4f-8425-b4c4fccf01e6 found in kube manager 2024-09-05 02:21:46,845 - INFO - Namespace ctest-non-default-70078783 verification passed 2024-09-05 02:21:46,857 - DEBUG - Pod ctest-pod-44850204 not in running state.Currently in Pending 2024-09-05 02:21:51,873 - DEBUG - Pod ctest-pod-44850204 not in running state.Currently in Pending 2024-09-05 02:21:56,893 - DEBUG - Pod ctest-pod-44850204 not in running state.Currently in Pending 2024-09-05 02:22:01,900 - INFO - Pod ctest-pod-44850204 is in running state.Got IP 10.47.255.251 2024-09-05 02:22:01,960 - DEBUG - Pod ctest-pod-44850204 has vmi 9a4802aa-6b2d-11ef-aaef-fa163e5b306a 2024-09-05 02:22:01,960 - INFO - Verified pod ctest-pod-44850204 in contrail-api 2024-09-05 02:22:01,985 - DEBUG - VMI 9a4802aa-6b2d-11ef-aaef-fa163e5b306a is active in agent 10.0.0.37 2024-09-05 02:22:01,985 - INFO - Verified Pod ctest-pod-44850204 in agent 10.0.0.37 2024-09-05 02:22:01,985 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=b46ee361-b2d3-4844-bdd6-7938cf439eda 2024-09-05 02:22:01,998 - INFO - Pod ctest-pod-44850204 with uuid b46ee361-b2d3-4844-bdd6-7938cf439eda found in kube manager 2024-09-05 02:22:01,998 - INFO - Pod ctest-pod-44850204 verification passed 2024-09-05 02:22:02,010 - DEBUG - Pod ctest-pod-65560100 not in running state.Currently in Pending 2024-09-05 02:22:07,028 - INFO - Pod ctest-pod-65560100 is in running state.Got IP 10.47.255.250 2024-09-05 02:22:07,058 - DEBUG - Pod ctest-pod-65560100 has vmi 9abc9b1a-6b2d-11ef-aaef-fa163e5b306a 2024-09-05 02:22:07,059 - INFO - Verified pod ctest-pod-65560100 in contrail-api 2024-09-05 02:22:07,085 - DEBUG - VMI 9abc9b1a-6b2d-11ef-aaef-fa163e5b306a is active in agent 10.0.0.37 2024-09-05 02:22:07,085 - INFO - Verified Pod ctest-pod-65560100 in agent 10.0.0.37 2024-09-05 02:22:07,086 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=86db69c3-1b4d-4c47-9441-f798f7bb75e8 2024-09-05 02:22:07,099 - INFO - Pod ctest-pod-65560100 with uuid 86db69c3-1b4d-4c47-9441-f798f7bb75e8 found in kube manager 2024-09-05 02:22:07,100 - INFO - Pod ctest-pod-65560100 verification passed 2024-09-05 02:22:07,110 - INFO - Pod ctest-pod-93661295 is in running state.Got IP 10.47.255.249 2024-09-05 02:22:07,126 - DEBUG - Pod ctest-pod-93661295 has vmi 9b96ac7e-6b2d-11ef-aaef-fa163e5b306a 2024-09-05 02:22:07,127 - INFO - Verified pod ctest-pod-93661295 in contrail-api 2024-09-05 02:22:07,143 - DEBUG - VMI 9b96ac7e-6b2d-11ef-aaef-fa163e5b306a is active in agent 10.0.0.37 2024-09-05 02:22:07,143 - INFO - Verified Pod ctest-pod-93661295 in agent 10.0.0.37 2024-09-05 02:22:07,144 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=0f453bc5-54e5-42ef-a34d-f8cfcc5cf7e6 2024-09-05 02:22:07,150 - INFO - Pod ctest-pod-93661295 with uuid 0f453bc5-54e5-42ef-a34d-f8cfcc5cf7e6 found in kube manager 2024-09-05 02:22:07,150 - INFO - Pod ctest-pod-93661295 verification passed 2024-09-05 02:22:07,157 - INFO - Pod ctest-pod-60480638 is in running state.Got IP 10.47.255.248 2024-09-05 02:22:07,219 - DEBUG - Pod ctest-pod-60480638 has vmi 9c228136-6b2d-11ef-aaef-fa163e5b306a 2024-09-05 02:22:07,219 - INFO - Verified pod ctest-pod-60480638 in contrail-api 2024-09-05 02:22:07,234 - DEBUG - VMI 9c228136-6b2d-11ef-aaef-fa163e5b306a is active in agent 10.0.0.37 2024-09-05 02:22:07,234 - INFO - Verified Pod ctest-pod-60480638 in agent 10.0.0.37 2024-09-05 02:22:07,235 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=ed38e5b9-86ff-4e89-88b4-b41024f924b3 2024-09-05 02:22:07,240 - INFO - Pod ctest-pod-60480638 with uuid ed38e5b9-86ff-4e89-88b4-b41024f924b3 found in kube manager 2024-09-05 02:22:07,240 - INFO - Pod ctest-pod-60480638 verification passed 2024-09-05 02:22:07,253 - INFO - Pod ctest-pod-63432553 is in running state.Got IP 10.47.255.247 2024-09-05 02:22:07,318 - DEBUG - Pod ctest-pod-63432553 has vmi 9cc7e036-6b2d-11ef-aaef-fa163e5b306a 2024-09-05 02:22:07,318 - INFO - Verified pod ctest-pod-63432553 in contrail-api 2024-09-05 02:22:07,337 - DEBUG - VMI 9cc7e036-6b2d-11ef-aaef-fa163e5b306a is active in agent 10.0.0.37 2024-09-05 02:22:07,337 - INFO - Verified Pod ctest-pod-63432553 in agent 10.0.0.37 2024-09-05 02:22:07,337 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=38adccb1-00a1-4373-b506-a61b1a39a551 2024-09-05 02:22:07,343 - INFO - Pod ctest-pod-63432553 with uuid 38adccb1-00a1-4373-b506-a61b1a39a551 found in kube manager 2024-09-05 02:22:07,343 - INFO - Pod ctest-pod-63432553 verification passed 2024-09-05 02:22:07,349 - INFO - Pod ctest-pod-72484234 is in running state.Got IP 10.47.255.245 2024-09-05 02:22:07,366 - DEBUG - Pod ctest-pod-72484234 has vmi 9db8541c-6b2d-11ef-aaef-fa163e5b306a 2024-09-05 02:22:07,367 - INFO - Verified pod ctest-pod-72484234 in contrail-api 2024-09-05 02:22:07,381 - DEBUG - VMI 9db8541c-6b2d-11ef-aaef-fa163e5b306a is active in agent 10.0.0.37 2024-09-05 02:22:07,381 - INFO - Verified Pod ctest-pod-72484234 in agent 10.0.0.37 2024-09-05 02:22:07,381 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=af194ee3-8e65-447d-8329-1e7e1cae9bef 2024-09-05 02:22:07,386 - INFO - Pod ctest-pod-72484234 with uuid af194ee3-8e65-447d-8329-1e7e1cae9bef found in kube manager 2024-09-05 02:22:07,386 - INFO - Pod ctest-pod-72484234 verification passed 2024-09-05 02:22:07,391 - INFO - Pod ctest-pod-70207192 is in running state.Got IP 10.47.255.246 2024-09-05 02:22:07,448 - DEBUG - Pod ctest-pod-70207192 has vmi 9d3eba94-6b2d-11ef-aaef-fa163e5b306a 2024-09-05 02:22:07,448 - INFO - Verified pod ctest-pod-70207192 in contrail-api 2024-09-05 02:22:07,464 - DEBUG - VMI 9d3eba94-6b2d-11ef-aaef-fa163e5b306a is active in agent 10.0.0.37 2024-09-05 02:22:07,464 - INFO - Verified Pod ctest-pod-70207192 in agent 10.0.0.37 2024-09-05 02:22:07,464 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=7f3ee1df-ff91-4d8a-a13b-5c200347c1b4 2024-09-05 02:22:07,469 - INFO - Pod ctest-pod-70207192 with uuid 7f3ee1df-ff91-4d8a-a13b-5c200347c1b4 found in kube manager 2024-09-05 02:22:07,469 - INFO - Pod ctest-pod-70207192 verification passed 2024-09-05 02:22:07,474 - INFO - Pod ctest-pod-52452883 is in running state.Got IP 10.47.255.244 2024-09-05 02:22:07,485 - DEBUG - Pod ctest-pod-52452883 has vmi 9e2c138e-6b2d-11ef-aaef-fa163e5b306a 2024-09-05 02:22:07,485 - INFO - Verified pod ctest-pod-52452883 in contrail-api 2024-09-05 02:22:07,500 - DEBUG - VMI 9e2c138e-6b2d-11ef-aaef-fa163e5b306a is active in agent 10.0.0.37 2024-09-05 02:22:07,500 - INFO - Verified Pod ctest-pod-52452883 in agent 10.0.0.37 2024-09-05 02:22:07,500 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=62ae11d3-003e-4d3b-9dcb-48314dacaeae 2024-09-05 02:22:07,506 - INFO - Pod ctest-pod-52452883 with uuid 62ae11d3-003e-4d3b-9dcb-48314dacaeae found in kube manager 2024-09-05 02:22:07,507 - INFO - Pod ctest-pod-52452883 verification passed 2024-09-05 02:22:07,507 - INFO - ================================================================================ 2024-09-05 02:22:07,507 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-09-05 02:22:07,507 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-09-05 02:22:07,751 - DEBUG - Nothing to compare xmpp stats {'10.0.0.37': {'10.0.0.29': '0'}} with 2024-09-05 02:22:07,751 - INFO - Initial checks done. Running the testcase now 2024-09-05 02:22:07,751 - INFO - 2024-09-05 02:22:07,815 - DEBUG - [Pod ctest-pod-44850204] Cmd: echo ctest-pod-44850204 > /usr/share/nginx/html/index.html, Output: 2024-09-05 02:22:07,876 - DEBUG - [Pod ctest-pod-65560100] Cmd: echo ctest-pod-65560100 > /usr/share/nginx/html/index.html, Output: 2024-09-05 02:22:07,944 - DEBUG - [Pod ctest-pod-93661295] Cmd: echo ctest-pod-93661295 > /usr/share/nginx/html/index.html, Output: 2024-09-05 02:22:07,991 - DEBUG - [Pod ctest-pod-60480638] Cmd: echo ctest-pod-60480638 > /usr/share/nginx/html/index.html, Output: 2024-09-05 02:22:07,995 - DEBUG - Service ctest-nginx-svc-08171327 not present 2024-09-05 02:22:07,995 - INFO - Creating service ctest-nginx-svc-08171327 2024-09-05 02:22:08,023 - INFO - Created Service ctest-nginx-svc-08171327 2024-09-05 02:22:08,040 - WARNING - Service UUID 421da170-6ac1-4a0f-aa15-6ab9060a47cb not yet found in contrail-api 2024-09-05 02:22:09,050 - INFO - Validated that Service ctest-nginx-svc-08171327 is seen in contrail-api 2024-09-05 02:22:09,050 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_LoadbalancerDatabaseList?x=421da170-6ac1-4a0f-aa15-6ab9060a47cb 2024-09-05 02:22:09,058 - INFO - Service ctest-nginx-svc-08171327 with uuid 421da170-6ac1-4a0f-aa15-6ab9060a47cb found in kube manager 2024-09-05 02:22:09,058 - INFO - Service ctest-nginx-svc-08171327 verification passed 2024-09-05 02:22:10,129 - DEBUG - [Pod ctest-pod-63432553] Cmd: wget http://10.109.15.172:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.15.172:80 (10.109.15.172:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-65560100 2024-09-05 02:22:10,129 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd wget http://10.109.15.172:80/ -O - -T 5 -t 1 passed 2024-09-05 02:22:10,129 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd output: Connecting to 10.109.15.172:80 (10.109.15.172:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-65560100 2024-09-05 02:22:10,171 - DEBUG - [Pod ctest-pod-63432553] Cmd: wget http://10.109.15.172:80/ -O - -T 5 -t 1 , Output: ctest-pod-44850204 Connecting to 10.109.15.172:80 (10.109.15.172:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 02:22:10,171 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd wget http://10.109.15.172:80/ -O - -T 5 -t 1 passed 2024-09-05 02:22:10,171 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd output: ctest-pod-44850204 Connecting to 10.109.15.172:80 (10.109.15.172:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 02:22:10,171 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-44850204': 1, 'ctest-pod-65560100': 1} 2024-09-05 02:22:10,228 - DEBUG - [Pod ctest-pod-72484234] Cmd: wget http://10.109.15.172:80/ -O - -T 5 -t 1 , Output: ctest-pod-44850204 Connecting to 10.109.15.172:80 (10.109.15.172:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 02:22:10,228 - DEBUG - [Pod Pod ctest-pod-72484234] Cmd wget http://10.109.15.172:80/ -O - -T 5 -t 1 passed 2024-09-05 02:22:10,228 - DEBUG - [Pod Pod ctest-pod-72484234] Cmd output: ctest-pod-44850204 Connecting to 10.109.15.172:80 (10.109.15.172:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 02:22:10,290 - DEBUG - [Pod ctest-pod-72484234] Cmd: wget http://10.109.15.172:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.15.172:80 (10.109.15.172:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-65560100 2024-09-05 02:22:10,290 - DEBUG - [Pod Pod ctest-pod-72484234] Cmd wget http://10.109.15.172:80/ -O - -T 5 -t 1 passed 2024-09-05 02:22:10,290 - DEBUG - [Pod Pod ctest-pod-72484234] Cmd output: Connecting to 10.109.15.172:80 (10.109.15.172:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-65560100 2024-09-05 02:22:10,290 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-44850204': 1, 'ctest-pod-65560100': 1} 2024-09-05 02:22:10,294 - DEBUG - Network policy ingress-on-service not present 2024-09-05 02:22:10,295 - INFO - Creating Network Policy ingress-on-service 2024-09-05 02:22:10,315 - INFO - Network policy found in k8s 2024-09-05 02:22:10,315 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=b97fbdd1-90d3-4234-9c7a-494169f5f75a 2024-09-05 02:22:10,325 - INFO - Network Policy ingress-on-service with uuid b97fbdd1-90d3-4234-9c7a-494169f5f75a found in kube manager 2024-09-05 02:22:10,367 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-09-05 02:22:10,367 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-09-05 02:22:10,367 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=b97fbdd1-90d3-4234-9c7a-494169f5f75a 2024-09-05 02:22:10,403 - WARNING - Network policy with name ingress-on-service not found in agent 2024-09-05 02:22:12,403 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=b97fbdd1-90d3-4234-9c7a-494169f5f75a 2024-09-05 02:22:12,480 - INFO - Network policy with name ingress-on-service found in agent 2024-09-05 02:22:12,481 - INFO - Network Policy ingress-on-service verification passed 2024-09-05 02:22:17,539 - DEBUG - [Pod ctest-pod-63432553] Cmd: wget http://10.109.15.172:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:22:17,539 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd wget http://10.109.15.172:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:22:17,540 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:22:22,612 - DEBUG - [Pod ctest-pod-63432553] Cmd: wget http://10.109.15.172:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:22:22,612 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd wget http://10.109.15.172:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:22:22,613 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:22:27,665 - DEBUG - [Pod ctest-pod-63432553] Cmd: wget http://10.109.15.172:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:22:27,666 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd wget http://10.109.15.172:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:22:27,666 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:22:32,738 - DEBUG - [Pod ctest-pod-63432553] Cmd: wget http://10.109.15.172:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:22:32,738 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd wget http://10.109.15.172:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:22:32,739 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:22:37,814 - DEBUG - [Pod ctest-pod-63432553] Cmd: wget http://10.109.15.172:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:22:37,814 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd wget http://10.109.15.172:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:22:37,815 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:22:42,884 - DEBUG - [Pod ctest-pod-63432553] Cmd: wget http://10.109.15.172:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:22:42,884 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd wget http://10.109.15.172:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:22:42,884 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:22:47,945 - DEBUG - [Pod ctest-pod-63432553] Cmd: wget http://10.109.15.172:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:22:47,946 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd wget http://10.109.15.172:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:22:47,946 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:22:53,017 - DEBUG - [Pod ctest-pod-63432553] Cmd: wget http://10.109.15.172:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:22:53,018 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd wget http://10.109.15.172:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:22:53,018 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:22:58,105 - DEBUG - [Pod ctest-pod-63432553] Cmd: wget http://10.109.15.172:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:22:58,105 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd wget http://10.109.15.172:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:22:58,105 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:23:03,167 - DEBUG - [Pod ctest-pod-63432553] Cmd: wget http://10.109.15.172:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:23:03,167 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd wget http://10.109.15.172:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:23:03,167 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:23:03,167 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-44850204': 0, 'ctest-pod-65560100': 0} 2024-09-05 02:23:03,242 - DEBUG - [Pod ctest-pod-70207192] Cmd: wget http://10.109.15.172:80/ -O - -T 5 -t 1 , Output: ctest-pod-44850204 Connecting to 10.109.15.172:80 (10.109.15.172:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 02:23:03,243 - DEBUG - [Pod Pod ctest-pod-70207192] Cmd wget http://10.109.15.172:80/ -O - -T 5 -t 1 passed 2024-09-05 02:23:03,243 - DEBUG - [Pod Pod ctest-pod-70207192] Cmd output: ctest-pod-44850204 Connecting to 10.109.15.172:80 (10.109.15.172:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 02:23:03,301 - DEBUG - [Pod ctest-pod-70207192] Cmd: wget http://10.109.15.172:80/ -O - -T 5 -t 1 , Output: ctest-pod-65560100 Connecting to 10.109.15.172:80 (10.109.15.172:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 02:23:03,301 - DEBUG - [Pod Pod ctest-pod-70207192] Cmd wget http://10.109.15.172:80/ -O - -T 5 -t 1 passed 2024-09-05 02:23:03,301 - DEBUG - [Pod Pod ctest-pod-70207192] Cmd output: ctest-pod-65560100 Connecting to 10.109.15.172:80 (10.109.15.172:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 02:23:03,301 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-44850204': 1, 'ctest-pod-65560100': 1} 2024-09-05 02:23:08,352 - DEBUG - [Pod ctest-pod-72484234] Cmd: wget http://10.109.15.172:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:23:08,352 - DEBUG - [Pod Pod ctest-pod-72484234] Cmd wget http://10.109.15.172:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:23:08,352 - DEBUG - [Pod Pod ctest-pod-72484234] Cmd output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:23:13,403 - DEBUG - [Pod ctest-pod-72484234] Cmd: wget http://10.109.15.172:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:23:13,403 - DEBUG - [Pod Pod ctest-pod-72484234] Cmd wget http://10.109.15.172:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:23:13,403 - DEBUG - [Pod Pod ctest-pod-72484234] Cmd output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:23:18,534 - DEBUG - [Pod ctest-pod-72484234] Cmd: wget http://10.109.15.172:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:23:18,534 - DEBUG - [Pod Pod ctest-pod-72484234] Cmd wget http://10.109.15.172:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:23:18,535 - DEBUG - [Pod Pod ctest-pod-72484234] Cmd output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:23:23,603 - DEBUG - [Pod ctest-pod-72484234] Cmd: wget http://10.109.15.172:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:23:23,604 - DEBUG - [Pod Pod ctest-pod-72484234] Cmd wget http://10.109.15.172:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:23:23,604 - DEBUG - [Pod Pod ctest-pod-72484234] Cmd output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:23:28,686 - DEBUG - [Pod ctest-pod-72484234] Cmd: wget http://10.109.15.172:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:23:28,686 - DEBUG - [Pod Pod ctest-pod-72484234] Cmd wget http://10.109.15.172:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:23:28,687 - DEBUG - [Pod Pod ctest-pod-72484234] Cmd output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:23:33,747 - DEBUG - [Pod ctest-pod-72484234] Cmd: wget http://10.109.15.172:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:23:33,747 - DEBUG - [Pod Pod ctest-pod-72484234] Cmd wget http://10.109.15.172:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:23:33,747 - DEBUG - [Pod Pod ctest-pod-72484234] Cmd output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:23:38,823 - DEBUG - [Pod ctest-pod-72484234] Cmd: wget http://10.109.15.172:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:23:38,824 - DEBUG - [Pod Pod ctest-pod-72484234] Cmd wget http://10.109.15.172:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:23:38,825 - DEBUG - [Pod Pod ctest-pod-72484234] Cmd output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:23:43,890 - DEBUG - [Pod ctest-pod-72484234] Cmd: wget http://10.109.15.172:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:23:43,890 - DEBUG - [Pod Pod ctest-pod-72484234] Cmd wget http://10.109.15.172:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:23:43,890 - DEBUG - [Pod Pod ctest-pod-72484234] Cmd output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:23:48,971 - DEBUG - [Pod ctest-pod-72484234] Cmd: wget http://10.109.15.172:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:23:48,971 - DEBUG - [Pod Pod ctest-pod-72484234] Cmd wget http://10.109.15.172:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:23:48,971 - DEBUG - [Pod Pod ctest-pod-72484234] Cmd output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:23:54,052 - DEBUG - [Pod ctest-pod-72484234] Cmd: wget http://10.109.15.172:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:23:54,052 - DEBUG - [Pod Pod ctest-pod-72484234] Cmd wget http://10.109.15.172:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:23:54,052 - DEBUG - [Pod Pod ctest-pod-72484234] Cmd output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:23:54,052 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-44850204': 0, 'ctest-pod-65560100': 0} 2024-09-05 02:23:56,161 - DEBUG - [Pod ctest-pod-70207192] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.859 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.074 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.073 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.073/0.335/0.859 ms 2024-09-05 02:23:56,162 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-70207192 with expectation True passed 2024-09-05 02:23:58,234 - DEBUG - [Pod ctest-pod-63432553] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.466 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.091 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.097 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.091/0.218/0.466 ms 2024-09-05 02:23:58,234 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-63432553 with expectation True passed 2024-09-05 02:24:00,319 - DEBUG - [Pod ctest-pod-72484234] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.553 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.068 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.083 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.068/0.234/0.553 ms 2024-09-05 02:24:00,319 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-72484234 with expectation True passed 2024-09-05 02:24:00,395 - DEBUG - [Pod ctest-pod-70207192] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-05 02:24:00,395 - DEBUG - [Pod Pod ctest-pod-70207192] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-05 02:24:00,395 - DEBUG - [Pod Pod ctest-pod-70207192] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-05 02:24:00,395 - INFO - wget check of of http://10.47.255.251 from ctest-pod-70207192 passed 2024-09-05 02:24:00,450 - DEBUG - [Pod ctest-pod-70207192] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-05 02:24:00,450 - DEBUG - [Pod Pod ctest-pod-70207192] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-09-05 02:24:00,450 - DEBUG - [Pod Pod ctest-pod-70207192] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-05 02:24:00,450 - INFO - wget check of of http://10.47.255.250 from ctest-pod-70207192 passed 2024-09-05 02:24:05,506 - DEBUG - [Pod ctest-pod-63432553] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-05 02:24:05,506 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-05 02:24:05,507 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-05 02:24:05,507 - INFO - wget check of of http://10.47.255.250 from ctest-pod-63432553 passed 2024-09-05 02:24:10,574 - DEBUG - [Pod ctest-pod-52452883] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-05 02:24:10,574 - DEBUG - [Pod Pod ctest-pod-52452883] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-05 02:24:10,574 - DEBUG - [Pod Pod ctest-pod-52452883] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-05 02:24:10,574 - INFO - wget check of of http://10.47.255.251 from ctest-pod-52452883 passed 2024-09-05 02:24:10,586 - INFO - Updating Network Policy ingress-on-service 2024-09-05 02:24:15,650 - DEBUG - [Pod ctest-pod-63432553] Cmd: wget http://10.109.15.172:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:24:15,650 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd wget http://10.109.15.172:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:24:15,651 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:24:20,732 - DEBUG - [Pod ctest-pod-63432553] Cmd: wget http://10.109.15.172:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:24:20,733 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd wget http://10.109.15.172:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:24:20,733 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:24:25,797 - DEBUG - [Pod ctest-pod-63432553] Cmd: wget http://10.109.15.172:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:24:25,797 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd wget http://10.109.15.172:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:24:25,797 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:24:30,867 - DEBUG - [Pod ctest-pod-63432553] Cmd: wget http://10.109.15.172:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:24:30,868 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd wget http://10.109.15.172:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:24:30,868 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:24:35,934 - DEBUG - [Pod ctest-pod-63432553] Cmd: wget http://10.109.15.172:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:24:35,935 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd wget http://10.109.15.172:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:24:35,936 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:24:41,010 - DEBUG - [Pod ctest-pod-63432553] Cmd: wget http://10.109.15.172:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:24:41,010 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd wget http://10.109.15.172:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:24:41,010 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:24:46,078 - DEBUG - [Pod ctest-pod-63432553] Cmd: wget http://10.109.15.172:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:24:46,078 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd wget http://10.109.15.172:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:24:46,078 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:24:51,143 - DEBUG - [Pod ctest-pod-63432553] Cmd: wget http://10.109.15.172:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:24:51,143 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd wget http://10.109.15.172:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:24:51,143 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:24:56,208 - DEBUG - [Pod ctest-pod-63432553] Cmd: wget http://10.109.15.172:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:24:56,209 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd wget http://10.109.15.172:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:24:56,209 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:25:01,282 - DEBUG - [Pod ctest-pod-63432553] Cmd: wget http://10.109.15.172:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:25:01,282 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd wget http://10.109.15.172:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:25:01,282 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd output: Connecting to 10.109.15.172:80 (10.109.15.172:80) wget: download timed out 2024-09-05 02:25:01,282 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-44850204': 0, 'ctest-pod-65560100': 0} 2024-09-05 02:25:01,338 - DEBUG - [Pod ctest-pod-70207192] Cmd: wget http://10.109.15.172:80/ -O - -T 5 -t 1 , Output: ctest-pod-44850204 Connecting to 10.109.15.172:80 (10.109.15.172:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 02:25:01,339 - DEBUG - [Pod Pod ctest-pod-70207192] Cmd wget http://10.109.15.172:80/ -O - -T 5 -t 1 passed 2024-09-05 02:25:01,339 - DEBUG - [Pod Pod ctest-pod-70207192] Cmd output: ctest-pod-44850204 Connecting to 10.109.15.172:80 (10.109.15.172:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 02:25:01,404 - DEBUG - [Pod ctest-pod-70207192] Cmd: wget http://10.109.15.172:80/ -O - -T 5 -t 1 , Output: ctest-pod-44850204 Connecting to 10.109.15.172:80 (10.109.15.172:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 02:25:01,404 - DEBUG - [Pod Pod ctest-pod-70207192] Cmd wget http://10.109.15.172:80/ -O - -T 5 -t 1 passed 2024-09-05 02:25:01,404 - DEBUG - [Pod Pod ctest-pod-70207192] Cmd output: ctest-pod-44850204 Connecting to 10.109.15.172:80 (10.109.15.172:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 02:25:01,460 - DEBUG - [Pod ctest-pod-70207192] Cmd: wget http://10.109.15.172:80/ -O - -T 5 -t 1 , Output: ctest-pod-44850204 Connecting to 10.109.15.172:80 (10.109.15.172:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 02:25:01,460 - DEBUG - [Pod Pod ctest-pod-70207192] Cmd wget http://10.109.15.172:80/ -O - -T 5 -t 1 passed 2024-09-05 02:25:01,460 - DEBUG - [Pod Pod ctest-pod-70207192] Cmd output: ctest-pod-44850204 Connecting to 10.109.15.172:80 (10.109.15.172:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 02:25:01,509 - DEBUG - [Pod ctest-pod-70207192] Cmd: wget http://10.109.15.172:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.15.172:80 (10.109.15.172:80) ctest-pod-44850204 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 02:25:01,509 - DEBUG - [Pod Pod ctest-pod-70207192] Cmd wget http://10.109.15.172:80/ -O - -T 5 -t 1 passed 2024-09-05 02:25:01,509 - DEBUG - [Pod Pod ctest-pod-70207192] Cmd output: Connecting to 10.109.15.172:80 (10.109.15.172:80) ctest-pod-44850204 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 02:25:01,575 - DEBUG - [Pod ctest-pod-70207192] Cmd: wget http://10.109.15.172:80/ -O - -T 5 -t 1 , Output: ctest-pod-65560100 Connecting to 10.109.15.172:80 (10.109.15.172:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 02:25:01,575 - DEBUG - [Pod Pod ctest-pod-70207192] Cmd wget http://10.109.15.172:80/ -O - -T 5 -t 1 passed 2024-09-05 02:25:01,575 - DEBUG - [Pod Pod ctest-pod-70207192] Cmd output: ctest-pod-65560100 Connecting to 10.109.15.172:80 (10.109.15.172:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 02:25:01,576 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-44850204': 4, 'ctest-pod-65560100': 1} 2024-09-05 02:25:01,636 - DEBUG - [Pod ctest-pod-72484234] Cmd: wget http://10.109.15.172:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.15.172:80 (10.109.15.172:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-44850204 2024-09-05 02:25:01,636 - DEBUG - [Pod Pod ctest-pod-72484234] Cmd wget http://10.109.15.172:80/ -O - -T 5 -t 1 passed 2024-09-05 02:25:01,636 - DEBUG - [Pod Pod ctest-pod-72484234] Cmd output: Connecting to 10.109.15.172:80 (10.109.15.172:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-44850204 2024-09-05 02:25:01,691 - DEBUG - [Pod ctest-pod-72484234] Cmd: wget http://10.109.15.172:80/ -O - -T 5 -t 1 , Output: ctest-pod-44850204 Connecting to 10.109.15.172:80 (10.109.15.172:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 02:25:01,691 - DEBUG - [Pod Pod ctest-pod-72484234] Cmd wget http://10.109.15.172:80/ -O - -T 5 -t 1 passed 2024-09-05 02:25:01,692 - DEBUG - [Pod Pod ctest-pod-72484234] Cmd output: ctest-pod-44850204 Connecting to 10.109.15.172:80 (10.109.15.172:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 02:25:01,748 - DEBUG - [Pod ctest-pod-72484234] Cmd: wget http://10.109.15.172:80/ -O - -T 5 -t 1 , Output: ctest-pod-65560100 Connecting to 10.109.15.172:80 (10.109.15.172:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 02:25:01,748 - DEBUG - [Pod Pod ctest-pod-72484234] Cmd wget http://10.109.15.172:80/ -O - -T 5 -t 1 passed 2024-09-05 02:25:01,748 - DEBUG - [Pod Pod ctest-pod-72484234] Cmd output: ctest-pod-65560100 Connecting to 10.109.15.172:80 (10.109.15.172:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 02:25:01,749 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-44850204': 2, 'ctest-pod-65560100': 1} 2024-09-05 02:25:03,801 - DEBUG - [Pod ctest-pod-70207192] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.358 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.090 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.070 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.070/0.172/0.358 ms 2024-09-05 02:25:03,802 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-70207192 with expectation True passed 2024-09-05 02:25:05,867 - DEBUG - [Pod ctest-pod-63432553] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.695 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.066 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.082 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.066/0.281/0.695 ms 2024-09-05 02:25:05,868 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-63432553 with expectation True passed 2024-09-05 02:25:07,925 - DEBUG - [Pod ctest-pod-72484234] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.712 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.089 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.070/0.290/0.712 ms 2024-09-05 02:25:07,925 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-72484234 with expectation True passed 2024-09-05 02:25:07,994 - DEBUG - [Pod ctest-pod-70207192] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-05 02:25:07,994 - DEBUG - [Pod Pod ctest-pod-70207192] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-05 02:25:07,994 - DEBUG - [Pod Pod ctest-pod-70207192] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-05 02:25:07,995 - INFO - wget check of of http://10.47.255.251 from ctest-pod-70207192 passed 2024-09-05 02:25:08,050 - DEBUG - [Pod ctest-pod-70207192] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-05 02:25:08,050 - DEBUG - [Pod Pod ctest-pod-70207192] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-09-05 02:25:08,050 - DEBUG - [Pod Pod ctest-pod-70207192] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-05 02:25:08,050 - INFO - wget check of of http://10.47.255.250 from ctest-pod-70207192 passed 2024-09-05 02:25:13,103 - DEBUG - [Pod ctest-pod-63432553] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-05 02:25:13,104 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-05 02:25:13,104 - DEBUG - [Pod Pod ctest-pod-63432553] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-05 02:25:13,104 - INFO - wget check of of http://10.47.255.250 from ctest-pod-63432553 passed 2024-09-05 02:25:13,183 - DEBUG - [Pod ctest-pod-52452883] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-05 02:25:13,183 - DEBUG - [Pod Pod ctest-pod-52452883] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-05 02:25:13,183 - DEBUG - [Pod Pod ctest-pod-52452883] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-05 02:25:13,183 - INFO - wget check of of http://10.47.255.251 from ctest-pod-52452883 passed 2024-09-05 02:25:13,184 - INFO - Deleting Network Policy : ingress-on-service 2024-09-05 02:25:13,185 - INFO - Deleting service : ctest-nginx-svc-08171327 2024-09-05 02:25:13,695 - DEBUG - No XMPP flaps were noticed during the test 2024-09-05 02:25:13,695 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:06] 2024-09-05 02:25:13,695 - INFO - -------------------------------------------------------------------------------- 2024-09-05 02:25:13,713 - INFO - Deleting pod ctest-new-default-53158373:ctest-pod-44850204 2024-09-05 02:25:13,715 - INFO - Deleting pod ctest-new-default-53158373:ctest-pod-65560100 2024-09-05 02:25:13,716 - INFO - Deleting pod ctest-non-default-70078783:ctest-pod-93661295 2024-09-05 02:25:13,717 - INFO - Deleting pod ctest-non-default-70078783:ctest-pod-60480638 2024-09-05 02:25:13,718 - INFO - Deleting pod ctest-new-default-53158373:ctest-pod-63432553 2024-09-05 02:25:13,719 - INFO - Deleting pod ctest-new-default-53158373:ctest-pod-70207192 2024-09-05 02:25:13,720 - INFO - Deleting pod ctest-non-default-70078783:ctest-pod-72484234 2024-09-05 02:25:13,721 - INFO - Deleting pod ctest-non-default-70078783:ctest-pod-52452883 2024-09-05 02:25:13,840 - WARNING - Pod uuid 62ae11d3-003e-4d3b-9dcb-48314dacaeae is still seen in agent 10.0.0.37 VM list 2024-09-05 02:25:13,843 - WARNING - Pod uuid 86db69c3-1b4d-4c47-9441-f798f7bb75e8 is still seen in agent 10.0.0.37 VM list 2024-09-05 02:25:13,843 - WARNING - Pod uuid 7f3ee1df-ff91-4d8a-a13b-5c200347c1b4 is still seen in agent 10.0.0.37 VM list 2024-09-05 02:25:13,844 - WARNING - Pod uuid af194ee3-8e65-447d-8329-1e7e1cae9bef is still seen in agent 10.0.0.37 VM list 2024-09-05 02:25:13,845 - WARNING - Pod uuid b46ee361-b2d3-4844-bdd6-7938cf439eda is still seen in agent 10.0.0.37 VM list 2024-09-05 02:25:13,853 - WARNING - Pod uuid 0f453bc5-54e5-42ef-a34d-f8cfcc5cf7e6 is still seen in agent 10.0.0.37 VM list 2024-09-05 02:25:13,854 - WARNING - Pod uuid 38adccb1-00a1-4373-b506-a61b1a39a551 is still seen in agent 10.0.0.37 VM list 2024-09-05 02:25:13,855 - WARNING - Pod uuid ed38e5b9-86ff-4e89-88b4-b41024f924b3 is still seen in agent 10.0.0.37 VM list 2024-09-05 02:25:18,867 - WARNING - Pod uuid 62ae11d3-003e-4d3b-9dcb-48314dacaeae is still seen in agent 10.0.0.37 VM list 2024-09-05 02:25:18,885 - DEBUG - Pod b46ee361-b2d3-4844-bdd6-7938cf439eda is not in agent 10.0.0.37 VM list 2024-09-05 02:25:18,892 - DEBUG - Pod 86db69c3-1b4d-4c47-9441-f798f7bb75e8 is not in agent 10.0.0.37 VM list 2024-09-05 02:25:18,895 - DEBUG - Pod 0f453bc5-54e5-42ef-a34d-f8cfcc5cf7e6 is not in agent 10.0.0.37 VM list 2024-09-05 02:25:18,898 - WARNING - Pod uuid 38adccb1-00a1-4373-b506-a61b1a39a551 is still seen in agent 10.0.0.37 VM list 2024-09-05 02:25:18,898 - DEBUG - Pod ed38e5b9-86ff-4e89-88b4-b41024f924b3 is not in agent 10.0.0.37 VM list 2024-09-05 02:25:18,901 - WARNING - Pod uuid af194ee3-8e65-447d-8329-1e7e1cae9bef is still seen in agent 10.0.0.37 VM list 2024-09-05 02:25:18,915 - DEBUG - VMI 9a4802aa-6b2d-11ef-aaef-fa163e5b306a is removed from agent 10.0.0.37 2024-09-05 02:25:18,915 - INFO - Verified that pod ctest-pod-44850204 is removed in agent 2024-09-05 02:25:18,917 - DEBUG - VMI 9abc9b1a-6b2d-11ef-aaef-fa163e5b306a is removed from agent 10.0.0.37 2024-09-05 02:25:18,917 - INFO - Verified that pod ctest-pod-65560100 is removed in agent 2024-09-05 02:25:18,917 - DEBUG - VMI 9b96ac7e-6b2d-11ef-aaef-fa163e5b306a is removed from agent 10.0.0.37 2024-09-05 02:25:18,917 - INFO - Verified that pod ctest-pod-93661295 is removed in agent 2024-09-05 02:25:18,918 - DEBUG - VMI 9c228136-6b2d-11ef-aaef-fa163e5b306a is removed from agent 10.0.0.37 2024-09-05 02:25:18,918 - INFO - Verified that pod ctest-pod-60480638 is removed in agent 2024-09-05 02:25:20,696 - WARNING - Pod uuid 7f3ee1df-ff91-4d8a-a13b-5c200347c1b4 is still seen in agent 10.0.0.37 VM list 2024-09-05 02:25:23,883 - WARNING - Pod uuid 62ae11d3-003e-4d3b-9dcb-48314dacaeae is still seen in agent 10.0.0.37 VM list 2024-09-05 02:25:23,918 - WARNING - Pod uuid 38adccb1-00a1-4373-b506-a61b1a39a551 is still seen in agent 10.0.0.37 VM list 2024-09-05 02:25:23,921 - WARNING - Pod uuid af194ee3-8e65-447d-8329-1e7e1cae9bef is still seen in agent 10.0.0.37 VM list 2024-09-05 02:25:25,717 - WARNING - Pod uuid 7f3ee1df-ff91-4d8a-a13b-5c200347c1b4 is still seen in agent 10.0.0.37 VM list 2024-09-05 02:25:28,899 - WARNING - Pod uuid 62ae11d3-003e-4d3b-9dcb-48314dacaeae is still seen in agent 10.0.0.37 VM list 2024-09-05 02:25:28,942 - WARNING - Pod uuid af194ee3-8e65-447d-8329-1e7e1cae9bef is still seen in agent 10.0.0.37 VM list 2024-09-05 02:25:28,946 - WARNING - Pod uuid 38adccb1-00a1-4373-b506-a61b1a39a551 is still seen in agent 10.0.0.37 VM list 2024-09-05 02:25:30,734 - WARNING - Pod uuid 7f3ee1df-ff91-4d8a-a13b-5c200347c1b4 is still seen in agent 10.0.0.37 VM list 2024-09-05 02:25:33,909 - WARNING - Pod uuid 62ae11d3-003e-4d3b-9dcb-48314dacaeae is still seen in agent 10.0.0.37 VM list 2024-09-05 02:25:33,960 - WARNING - Pod uuid 38adccb1-00a1-4373-b506-a61b1a39a551 is still seen in agent 10.0.0.37 VM list 2024-09-05 02:25:33,962 - WARNING - Pod uuid af194ee3-8e65-447d-8329-1e7e1cae9bef is still seen in agent 10.0.0.37 VM list 2024-09-05 02:25:35,751 - WARNING - Pod uuid 7f3ee1df-ff91-4d8a-a13b-5c200347c1b4 is still seen in agent 10.0.0.37 VM list 2024-09-05 02:25:38,920 - WARNING - Pod uuid 62ae11d3-003e-4d3b-9dcb-48314dacaeae is still seen in agent 10.0.0.37 VM list 2024-09-05 02:25:38,978 - WARNING - Pod uuid af194ee3-8e65-447d-8329-1e7e1cae9bef is still seen in agent 10.0.0.37 VM list 2024-09-05 02:25:38,979 - WARNING - Pod uuid 38adccb1-00a1-4373-b506-a61b1a39a551 is still seen in agent 10.0.0.37 VM list 2024-09-05 02:25:40,763 - WARNING - Pod uuid 7f3ee1df-ff91-4d8a-a13b-5c200347c1b4 is still seen in agent 10.0.0.37 VM list 2024-09-05 02:25:43,930 - WARNING - Pod uuid 62ae11d3-003e-4d3b-9dcb-48314dacaeae is still seen in agent 10.0.0.37 VM list 2024-09-05 02:25:43,991 - WARNING - Pod uuid af194ee3-8e65-447d-8329-1e7e1cae9bef is still seen in agent 10.0.0.37 VM list 2024-09-05 02:25:43,992 - WARNING - Pod uuid 38adccb1-00a1-4373-b506-a61b1a39a551 is still seen in agent 10.0.0.37 VM list 2024-09-05 02:25:45,771 - WARNING - Pod uuid 7f3ee1df-ff91-4d8a-a13b-5c200347c1b4 is still seen in agent 10.0.0.37 VM list 2024-09-05 02:25:48,947 - DEBUG - Pod 62ae11d3-003e-4d3b-9dcb-48314dacaeae is not in agent 10.0.0.37 VM list 2024-09-05 02:25:48,959 - DEBUG - VMI 9e2c138e-6b2d-11ef-aaef-fa163e5b306a is removed from agent 10.0.0.37 2024-09-05 02:25:48,959 - INFO - Verified that pod ctest-pod-52452883 is removed in agent 2024-09-05 02:25:49,016 - DEBUG - Pod af194ee3-8e65-447d-8329-1e7e1cae9bef is not in agent 10.0.0.37 VM list 2024-09-05 02:25:49,021 - DEBUG - Pod 38adccb1-00a1-4373-b506-a61b1a39a551 is not in agent 10.0.0.37 VM list 2024-09-05 02:25:49,041 - DEBUG - VMI 9db8541c-6b2d-11ef-aaef-fa163e5b306a is removed from agent 10.0.0.37 2024-09-05 02:25:49,041 - INFO - Verified that pod ctest-pod-72484234 is removed in agent 2024-09-05 02:25:49,048 - DEBUG - VMI 9cc7e036-6b2d-11ef-aaef-fa163e5b306a is removed from agent 10.0.0.37 2024-09-05 02:25:49,048 - INFO - Verified that pod ctest-pod-63432553 is removed in agent 2024-09-05 02:25:50,792 - DEBUG - Pod 7f3ee1df-ff91-4d8a-a13b-5c200347c1b4 is not in agent 10.0.0.37 VM list 2024-09-05 02:25:50,811 - DEBUG - VMI 9d3eba94-6b2d-11ef-aaef-fa163e5b306a is removed from agent 10.0.0.37 2024-09-05 02:25:50,812 - INFO - Verified that pod ctest-pod-70207192 is removed in agent 2024-09-05 02:25:50,812 - INFO - Deleting namespace ctest-non-default-70078783 2024-09-05 02:25:50,838 - DEBUG - Namespace ctest-non-default-70078783 still in k8s 2024-09-05 02:25:52,843 - DEBUG - Namespace ctest-non-default-70078783 still in k8s 2024-09-05 02:25:54,847 - DEBUG - Namespace ctest-non-default-70078783 still in k8s 2024-09-05 02:25:56,851 - DEBUG - Namespace ctest-non-default-70078783 is not in k8s 2024-09-05 02:25:56,851 - DEBUG - No need to check project deletion in contrail-api 2024-09-05 02:25:56,852 - INFO - Deleting namespace ctest-new-default-53158373 2024-09-05 02:25:56,865 - DEBUG - Namespace ctest-new-default-53158373 still in k8s 2024-09-05 02:25:58,870 - DEBUG - Namespace ctest-new-default-53158373 still in k8s 2024-09-05 02:26:00,877 - DEBUG - Namespace ctest-new-default-53158373 still in k8s 2024-09-05 02:26:02,881 - DEBUG - Namespace ctest-new-default-53158373 is not in k8s 2024-09-05 02:26:02,881 - DEBUG - No need to check project deletion in contrail-api