2024-09-12 21:45:12,649 - INFO - Using existing project ['default-domain', 'k8s-default'](3d50fcc9-b92c-4717-adce-641a3804572f) 2024-09-12 21:45:12,667 - DEBUG - Namespace ctest-new-default-22718182 not present 2024-09-12 21:45:12,677 - INFO - Created namespace ctest-new-default-22718182 2024-09-12 21:45:15,681 - DEBUG - Namespace ctest-non-default-03433111 not present 2024-09-12 21:45:15,693 - INFO - Created namespace ctest-non-default-03433111 2024-09-12 21:45:18,744 - DEBUG - Pod ctest-pod-76921258 not present 2024-09-12 21:45:18,744 - INFO - Creating Pod ctest-pod-76921258 2024-09-12 21:45:18,765 - DEBUG - Pod : ctest-pod-76921258 UUID is 61908dff-b62e-4840-b507-f840734927c9 2024-09-12 21:45:18,768 - DEBUG - Pod ctest-pod-92462662 not present 2024-09-12 21:45:18,768 - INFO - Creating Pod ctest-pod-92462662 2024-09-12 21:45:18,808 - DEBUG - Pod : ctest-pod-92462662 UUID is 2469a7b9-06fc-42d5-a764-9d30a0e6b360 2024-09-12 21:45:18,811 - DEBUG - Pod ctest-pod-34381185 not present 2024-09-12 21:45:18,812 - INFO - Creating Pod ctest-pod-34381185 2024-09-12 21:45:18,831 - DEBUG - Pod : ctest-pod-34381185 UUID is 33626ffc-cb6c-412c-9c72-3378abd9802f 2024-09-12 21:45:18,833 - DEBUG - Pod ctest-pod-90609685 not present 2024-09-12 21:45:18,834 - INFO - Creating Pod ctest-pod-90609685 2024-09-12 21:45:18,861 - DEBUG - Pod : ctest-pod-90609685 UUID is d95f4837-3720-4f2d-8ca2-681c21c14e44 2024-09-12 21:45:18,867 - DEBUG - Pod ctest-pod-15045460 not present 2024-09-12 21:45:18,868 - INFO - Creating Pod ctest-pod-15045460 2024-09-12 21:45:18,907 - DEBUG - Pod : ctest-pod-15045460 UUID is 494aa22f-aff7-46a5-9eab-4563e928b575 2024-09-12 21:45:18,909 - DEBUG - Pod ctest-pod-20740333 not present 2024-09-12 21:45:18,909 - INFO - Creating Pod ctest-pod-20740333 2024-09-12 21:45:18,925 - DEBUG - Pod : ctest-pod-20740333 UUID is 99bb2c7b-a021-4bb9-b0d8-aa5fd9522e58 2024-09-12 21:45:18,927 - DEBUG - Pod ctest-pod-11618464 not present 2024-09-12 21:45:18,927 - INFO - Creating Pod ctest-pod-11618464 2024-09-12 21:45:18,943 - DEBUG - Pod : ctest-pod-11618464 UUID is 86e57337-6ce8-44b2-8082-79f44640d290 2024-09-12 21:45:18,945 - DEBUG - Pod ctest-pod-99959927 not present 2024-09-12 21:45:18,945 - INFO - Creating Pod ctest-pod-99959927 2024-09-12 21:45:18,960 - DEBUG - Pod : ctest-pod-99959927 UUID is 11e069b7-e061-48de-aef9-e46d973c2889 2024-09-12 21:45:19,148 - INFO - Project default-domain:k8s-ctest-new-default-22718182 for Namespace ctest-new-default-22718182 is seen in contrail-api 2024-09-12 21:45:19,148 - DEBUG - Project uuid in Contrail is 87d2d3be-b27c-49fc-b0f6-34ead767bacd 2024-09-12 21:45:19,275 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_NamespaceDatabaseList?namespace_uuid=6be4ae88-8b74-4cf7-a9a0-7bb8335402ce 2024-09-12 21:45:19,279 - INFO - Namespace ctest-new-default-22718182 with uuid 6be4ae88-8b74-4cf7-a9a0-7bb8335402ce found in kube manager 2024-09-12 21:45:19,279 - INFO - Namespace ctest-new-default-22718182 verification passed 2024-09-12 21:45:19,517 - INFO - Project default-domain:k8s-ctest-non-default-03433111 for Namespace ctest-non-default-03433111 is seen in contrail-api 2024-09-12 21:45:19,517 - DEBUG - Project uuid in Contrail is fdda98a1-561c-46e0-aafe-7ab81e80c0c9 2024-09-12 21:45:19,517 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_NamespaceDatabaseList?namespace_uuid=d974b39e-0b2f-4db6-a90e-aba6fe15b544 2024-09-12 21:45:19,522 - INFO - Namespace ctest-non-default-03433111 with uuid d974b39e-0b2f-4db6-a90e-aba6fe15b544 found in kube manager 2024-09-12 21:45:19,522 - INFO - Namespace ctest-non-default-03433111 verification passed 2024-09-12 21:45:19,528 - DEBUG - Pod ctest-pod-76921258 not in running state.Currently in Pending 2024-09-12 21:45:24,537 - DEBUG - Pod ctest-pod-76921258 not in running state.Currently in Pending 2024-09-12 21:45:29,543 - DEBUG - Pod ctest-pod-76921258 not in running state.Currently in Pending 2024-09-12 21:45:34,558 - INFO - Pod ctest-pod-76921258 is in running state.Got IP 10.47.255.251 2024-09-12 21:45:34,618 - DEBUG - Pod ctest-pod-76921258 has vmi 4eec7ca4-7150-11ef-b0d6-fa163e5072fe 2024-09-12 21:45:34,618 - INFO - Verified pod ctest-pod-76921258 in contrail-api 2024-09-12 21:45:34,633 - DEBUG - VMI 4eec7ca4-7150-11ef-b0d6-fa163e5072fe is active in agent 10.0.0.40 2024-09-12 21:45:34,633 - INFO - Verified Pod ctest-pod-76921258 in agent 10.0.0.40 2024-09-12 21:45:34,633 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_VirtualMachineDatabaseList?x=61908dff-b62e-4840-b507-f840734927c9 2024-09-12 21:45:34,639 - INFO - Pod ctest-pod-76921258 with uuid 61908dff-b62e-4840-b507-f840734927c9 found in kube manager 2024-09-12 21:45:34,639 - INFO - Pod ctest-pod-76921258 verification passed 2024-09-12 21:45:34,643 - INFO - Pod ctest-pod-92462662 is in running state.Got IP 10.47.255.250 2024-09-12 21:45:34,662 - DEBUG - Pod ctest-pod-92462662 has vmi 4f67efd8-7150-11ef-b0d6-fa163e5072fe 2024-09-12 21:45:34,662 - INFO - Verified pod ctest-pod-92462662 in contrail-api 2024-09-12 21:45:34,676 - DEBUG - VMI 4f67efd8-7150-11ef-b0d6-fa163e5072fe is active in agent 10.0.0.40 2024-09-12 21:45:34,677 - INFO - Verified Pod ctest-pod-92462662 in agent 10.0.0.40 2024-09-12 21:45:34,677 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_VirtualMachineDatabaseList?x=2469a7b9-06fc-42d5-a764-9d30a0e6b360 2024-09-12 21:45:34,681 - INFO - Pod ctest-pod-92462662 with uuid 2469a7b9-06fc-42d5-a764-9d30a0e6b360 found in kube manager 2024-09-12 21:45:34,681 - INFO - Pod ctest-pod-92462662 verification passed 2024-09-12 21:45:34,687 - INFO - Pod ctest-pod-34381185 is in running state.Got IP 10.47.255.249 2024-09-12 21:45:34,746 - DEBUG - Pod ctest-pod-34381185 has vmi 50095f76-7150-11ef-b0d6-fa163e5072fe 2024-09-12 21:45:34,746 - INFO - Verified pod ctest-pod-34381185 in contrail-api 2024-09-12 21:45:34,758 - DEBUG - VMI 50095f76-7150-11ef-b0d6-fa163e5072fe is active in agent 10.0.0.40 2024-09-12 21:45:34,759 - INFO - Verified Pod ctest-pod-34381185 in agent 10.0.0.40 2024-09-12 21:45:34,759 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_VirtualMachineDatabaseList?x=33626ffc-cb6c-412c-9c72-3378abd9802f 2024-09-12 21:45:34,763 - INFO - Pod ctest-pod-34381185 with uuid 33626ffc-cb6c-412c-9c72-3378abd9802f found in kube manager 2024-09-12 21:45:34,763 - INFO - Pod ctest-pod-34381185 verification passed 2024-09-12 21:45:34,769 - INFO - Pod ctest-pod-90609685 is in running state.Got IP 10.47.255.248 2024-09-12 21:45:34,838 - DEBUG - Pod ctest-pod-90609685 has vmi 50854834-7150-11ef-b0d6-fa163e5072fe 2024-09-12 21:45:34,838 - INFO - Verified pod ctest-pod-90609685 in contrail-api 2024-09-12 21:45:34,851 - DEBUG - VMI 50854834-7150-11ef-b0d6-fa163e5072fe is active in agent 10.0.0.40 2024-09-12 21:45:34,851 - INFO - Verified Pod ctest-pod-90609685 in agent 10.0.0.40 2024-09-12 21:45:34,852 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_VirtualMachineDatabaseList?x=d95f4837-3720-4f2d-8ca2-681c21c14e44 2024-09-12 21:45:34,856 - INFO - Pod ctest-pod-90609685 with uuid d95f4837-3720-4f2d-8ca2-681c21c14e44 found in kube manager 2024-09-12 21:45:34,856 - INFO - Pod ctest-pod-90609685 verification passed 2024-09-12 21:45:34,860 - INFO - Pod ctest-pod-15045460 is in running state.Got IP 10.47.255.247 2024-09-12 21:45:34,879 - DEBUG - Pod ctest-pod-15045460 has vmi 510df580-7150-11ef-b0d6-fa163e5072fe 2024-09-12 21:45:34,879 - INFO - Verified pod ctest-pod-15045460 in contrail-api 2024-09-12 21:45:34,891 - DEBUG - VMI 510df580-7150-11ef-b0d6-fa163e5072fe is active in agent 10.0.0.40 2024-09-12 21:45:34,891 - INFO - Verified Pod ctest-pod-15045460 in agent 10.0.0.40 2024-09-12 21:45:34,891 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_VirtualMachineDatabaseList?x=494aa22f-aff7-46a5-9eab-4563e928b575 2024-09-12 21:45:34,895 - INFO - Pod ctest-pod-15045460 with uuid 494aa22f-aff7-46a5-9eab-4563e928b575 found in kube manager 2024-09-12 21:45:34,895 - INFO - Pod ctest-pod-15045460 verification passed 2024-09-12 21:45:34,900 - INFO - Pod ctest-pod-11618464 is in running state.Got IP 10.47.255.245 2024-09-12 21:45:34,961 - DEBUG - Pod ctest-pod-11618464 has vmi 51fa4e44-7150-11ef-b0d6-fa163e5072fe 2024-09-12 21:45:34,961 - INFO - Verified pod ctest-pod-11618464 in contrail-api 2024-09-12 21:45:34,974 - DEBUG - VMI 51fa4e44-7150-11ef-b0d6-fa163e5072fe is active in agent 10.0.0.40 2024-09-12 21:45:34,974 - INFO - Verified Pod ctest-pod-11618464 in agent 10.0.0.40 2024-09-12 21:45:34,974 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_VirtualMachineDatabaseList?x=86e57337-6ce8-44b2-8082-79f44640d290 2024-09-12 21:45:34,979 - INFO - Pod ctest-pod-11618464 with uuid 86e57337-6ce8-44b2-8082-79f44640d290 found in kube manager 2024-09-12 21:45:34,979 - INFO - Pod ctest-pod-11618464 verification passed 2024-09-12 21:45:34,983 - INFO - Pod ctest-pod-20740333 is in running state.Got IP 10.47.255.246 2024-09-12 21:45:35,046 - DEBUG - Pod ctest-pod-20740333 has vmi 5183f14a-7150-11ef-b0d6-fa163e5072fe 2024-09-12 21:45:35,046 - INFO - Verified pod ctest-pod-20740333 in contrail-api 2024-09-12 21:45:35,059 - DEBUG - VMI 5183f14a-7150-11ef-b0d6-fa163e5072fe is active in agent 10.0.0.40 2024-09-12 21:45:35,059 - INFO - Verified Pod ctest-pod-20740333 in agent 10.0.0.40 2024-09-12 21:45:35,059 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_VirtualMachineDatabaseList?x=99bb2c7b-a021-4bb9-b0d8-aa5fd9522e58 2024-09-12 21:45:35,064 - INFO - Pod ctest-pod-20740333 with uuid 99bb2c7b-a021-4bb9-b0d8-aa5fd9522e58 found in kube manager 2024-09-12 21:45:35,064 - INFO - Pod ctest-pod-20740333 verification passed 2024-09-12 21:45:35,069 - DEBUG - Pod ctest-pod-99959927 not in running state.Currently in Pending 2024-09-12 21:45:40,075 - INFO - Pod ctest-pod-99959927 is in running state.Got IP 10.47.255.244 2024-09-12 21:45:40,092 - DEBUG - Pod ctest-pod-99959927 has vmi 526bc0e2-7150-11ef-b0d6-fa163e5072fe 2024-09-12 21:45:40,092 - INFO - Verified pod ctest-pod-99959927 in contrail-api 2024-09-12 21:45:40,103 - DEBUG - VMI 526bc0e2-7150-11ef-b0d6-fa163e5072fe is active in agent 10.0.0.40 2024-09-12 21:45:40,104 - INFO - Verified Pod ctest-pod-99959927 in agent 10.0.0.40 2024-09-12 21:45:40,104 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_VirtualMachineDatabaseList?x=11e069b7-e061-48de-aef9-e46d973c2889 2024-09-12 21:45:40,108 - INFO - Pod ctest-pod-99959927 with uuid 11e069b7-e061-48de-aef9-e46d973c2889 found in kube manager 2024-09-12 21:45:40,109 - INFO - Pod ctest-pod-99959927 verification passed 2024-09-12 21:45:40,109 - INFO - ================================================================================ 2024-09-12 21:45:40,109 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-09-12 21:45:40,109 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-09-12 21:45:40,346 - DEBUG - Nothing to compare xmpp stats {'10.0.0.40': {'10.0.0.17': '0'}} with 2024-09-12 21:45:40,346 - INFO - Initial checks done. Running the testcase now 2024-09-12 21:45:40,346 - INFO - 2024-09-12 21:45:40,395 - DEBUG - [Pod ctest-pod-76921258] Cmd: echo ctest-pod-76921258 > /usr/share/nginx/html/index.html, Output: 2024-09-12 21:45:40,459 - DEBUG - [Pod ctest-pod-92462662] Cmd: echo ctest-pod-92462662 > /usr/share/nginx/html/index.html, Output: 2024-09-12 21:45:40,511 - DEBUG - [Pod ctest-pod-34381185] Cmd: echo ctest-pod-34381185 > /usr/share/nginx/html/index.html, Output: 2024-09-12 21:45:40,573 - DEBUG - [Pod ctest-pod-90609685] Cmd: echo ctest-pod-90609685 > /usr/share/nginx/html/index.html, Output: 2024-09-12 21:45:40,576 - DEBUG - Service ctest-nginx-svc-59975083 not present 2024-09-12 21:45:40,576 - INFO - Creating service ctest-nginx-svc-59975083 2024-09-12 21:45:40,590 - INFO - Created Service ctest-nginx-svc-59975083 2024-09-12 21:45:40,602 - WARNING - Service UUID 49901fa1-1669-4966-bad1-408605640551 not yet found in contrail-api 2024-09-12 21:45:41,611 - INFO - Validated that Service ctest-nginx-svc-59975083 is seen in contrail-api 2024-09-12 21:45:41,611 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_LoadbalancerDatabaseList?x=49901fa1-1669-4966-bad1-408605640551 2024-09-12 21:45:41,617 - INFO - Service ctest-nginx-svc-59975083 with uuid 49901fa1-1669-4966-bad1-408605640551 found in kube manager 2024-09-12 21:45:41,617 - INFO - Service ctest-nginx-svc-59975083 verification passed 2024-09-12 21:45:42,699 - DEBUG - [Pod ctest-pod-15045460] Cmd: wget http://10.102.166.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.166.87:80 (10.102.166.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-76921258 2024-09-12 21:45:42,699 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd wget http://10.102.166.87:80/ -O - -T 5 -t 1 passed 2024-09-12 21:45:42,699 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd output: Connecting to 10.102.166.87:80 (10.102.166.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-76921258 2024-09-12 21:45:42,755 - DEBUG - [Pod ctest-pod-15045460] Cmd: wget http://10.102.166.87:80/ -O - -T 5 -t 1 , Output: ctest-pod-92462662 Connecting to 10.102.166.87:80 (10.102.166.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-12 21:45:42,755 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd wget http://10.102.166.87:80/ -O - -T 5 -t 1 passed 2024-09-12 21:45:42,755 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd output: ctest-pod-92462662 Connecting to 10.102.166.87:80 (10.102.166.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-12 21:45:42,755 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-76921258': 1, 'ctest-pod-92462662': 1} 2024-09-12 21:45:42,830 - DEBUG - [Pod ctest-pod-11618464] Cmd: wget http://10.102.166.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.166.87:80 (10.102.166.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-92462662 2024-09-12 21:45:42,830 - DEBUG - [Pod Pod ctest-pod-11618464] Cmd wget http://10.102.166.87:80/ -O - -T 5 -t 1 passed 2024-09-12 21:45:42,830 - DEBUG - [Pod Pod ctest-pod-11618464] Cmd output: Connecting to 10.102.166.87:80 (10.102.166.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-92462662 2024-09-12 21:45:42,909 - DEBUG - [Pod ctest-pod-11618464] Cmd: wget http://10.102.166.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.166.87:80 (10.102.166.87:80) ctest-pod-76921258 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-12 21:45:42,909 - DEBUG - [Pod Pod ctest-pod-11618464] Cmd wget http://10.102.166.87:80/ -O - -T 5 -t 1 passed 2024-09-12 21:45:42,909 - DEBUG - [Pod Pod ctest-pod-11618464] Cmd output: Connecting to 10.102.166.87:80 (10.102.166.87:80) ctest-pod-76921258 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-12 21:45:42,909 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-76921258': 1, 'ctest-pod-92462662': 1} 2024-09-12 21:45:42,913 - DEBUG - Network policy ingress-on-service not present 2024-09-12 21:45:42,913 - INFO - Creating Network Policy ingress-on-service 2024-09-12 21:45:42,931 - INFO - Network policy found in k8s 2024-09-12 21:45:42,931 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=0fb78f7e-3c82-41c1-be45-7ca2338cae7f 2024-09-12 21:45:42,937 - INFO - Network Policy ingress-on-service with uuid 0fb78f7e-3c82-41c1-be45-7ca2338cae7f found in kube manager 2024-09-12 21:45:42,965 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-09-12 21:45:42,965 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-09-12 21:45:42,966 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=0fb78f7e-3c82-41c1-be45-7ca2338cae7f 2024-09-12 21:45:43,005 - WARNING - Network policy with name ingress-on-service not found in agent 2024-09-12 21:45:45,006 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=0fb78f7e-3c82-41c1-be45-7ca2338cae7f 2024-09-12 21:45:45,034 - INFO - Network policy with name ingress-on-service found in agent 2024-09-12 21:45:45,035 - INFO - Network Policy ingress-on-service verification passed 2024-09-12 21:45:50,097 - DEBUG - [Pod ctest-pod-15045460] Cmd: wget http://10.102.166.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:45:50,097 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd wget http://10.102.166.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:45:50,097 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:45:55,167 - DEBUG - [Pod ctest-pod-15045460] Cmd: wget http://10.102.166.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:45:55,168 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd wget http://10.102.166.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:45:55,168 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:46:00,226 - DEBUG - [Pod ctest-pod-15045460] Cmd: wget http://10.102.166.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:46:00,226 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd wget http://10.102.166.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:46:00,226 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:46:05,275 - DEBUG - [Pod ctest-pod-15045460] Cmd: wget http://10.102.166.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:46:05,275 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd wget http://10.102.166.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:46:05,275 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:46:10,340 - DEBUG - [Pod ctest-pod-15045460] Cmd: wget http://10.102.166.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:46:10,340 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd wget http://10.102.166.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:46:10,340 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:46:15,404 - DEBUG - [Pod ctest-pod-15045460] Cmd: wget http://10.102.166.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:46:15,404 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd wget http://10.102.166.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:46:15,404 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:46:20,461 - DEBUG - [Pod ctest-pod-15045460] Cmd: wget http://10.102.166.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:46:20,461 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd wget http://10.102.166.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:46:20,461 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:46:25,532 - DEBUG - [Pod ctest-pod-15045460] Cmd: wget http://10.102.166.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:46:25,532 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd wget http://10.102.166.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:46:25,532 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:46:30,586 - DEBUG - [Pod ctest-pod-15045460] Cmd: wget http://10.102.166.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:46:30,586 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd wget http://10.102.166.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:46:30,586 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:46:35,648 - DEBUG - [Pod ctest-pod-15045460] Cmd: wget http://10.102.166.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:46:35,648 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd wget http://10.102.166.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:46:35,648 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:46:35,648 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-76921258': 0, 'ctest-pod-92462662': 0} 2024-09-12 21:46:35,706 - DEBUG - [Pod ctest-pod-20740333] Cmd: wget http://10.102.166.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.166.87:80 (10.102.166.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-76921258 2024-09-12 21:46:35,706 - DEBUG - [Pod Pod ctest-pod-20740333] Cmd wget http://10.102.166.87:80/ -O - -T 5 -t 1 passed 2024-09-12 21:46:35,706 - DEBUG - [Pod Pod ctest-pod-20740333] Cmd output: Connecting to 10.102.166.87:80 (10.102.166.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-76921258 2024-09-12 21:46:35,768 - DEBUG - [Pod ctest-pod-20740333] Cmd: wget http://10.102.166.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.166.87:80 (10.102.166.87:80) ctest-pod-76921258 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-12 21:46:35,768 - DEBUG - [Pod Pod ctest-pod-20740333] Cmd wget http://10.102.166.87:80/ -O - -T 5 -t 1 passed 2024-09-12 21:46:35,768 - DEBUG - [Pod Pod ctest-pod-20740333] Cmd output: Connecting to 10.102.166.87:80 (10.102.166.87:80) ctest-pod-76921258 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-12 21:46:35,827 - DEBUG - [Pod ctest-pod-20740333] Cmd: wget http://10.102.166.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.166.87:80 (10.102.166.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-92462662 2024-09-12 21:46:35,827 - DEBUG - [Pod Pod ctest-pod-20740333] Cmd wget http://10.102.166.87:80/ -O - -T 5 -t 1 passed 2024-09-12 21:46:35,827 - DEBUG - [Pod Pod ctest-pod-20740333] Cmd output: Connecting to 10.102.166.87:80 (10.102.166.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-92462662 2024-09-12 21:46:35,827 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-76921258': 2, 'ctest-pod-92462662': 1} 2024-09-12 21:46:41,028 - DEBUG - [Pod ctest-pod-11618464] Cmd: wget http://10.102.166.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:46:41,028 - DEBUG - [Pod Pod ctest-pod-11618464] Cmd wget http://10.102.166.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:46:41,028 - DEBUG - [Pod Pod ctest-pod-11618464] Cmd output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:46:46,086 - DEBUG - [Pod ctest-pod-11618464] Cmd: wget http://10.102.166.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:46:46,087 - DEBUG - [Pod Pod ctest-pod-11618464] Cmd wget http://10.102.166.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:46:46,087 - DEBUG - [Pod Pod ctest-pod-11618464] Cmd output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:46:51,149 - DEBUG - [Pod ctest-pod-11618464] Cmd: wget http://10.102.166.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:46:51,158 - DEBUG - [Pod Pod ctest-pod-11618464] Cmd wget http://10.102.166.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:46:51,158 - DEBUG - [Pod Pod ctest-pod-11618464] Cmd output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:46:56,218 - DEBUG - [Pod ctest-pod-11618464] Cmd: wget http://10.102.166.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:46:56,218 - DEBUG - [Pod Pod ctest-pod-11618464] Cmd wget http://10.102.166.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:46:56,218 - DEBUG - [Pod Pod ctest-pod-11618464] Cmd output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:47:01,276 - DEBUG - [Pod ctest-pod-11618464] Cmd: wget http://10.102.166.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:47:01,276 - DEBUG - [Pod Pod ctest-pod-11618464] Cmd wget http://10.102.166.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:47:01,276 - DEBUG - [Pod Pod ctest-pod-11618464] Cmd output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:47:05,193 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2024-09-12 21:47:15,524 - DEBUG - [Pod ctest-pod-11618464] Cmd: wget http://10.102.166.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:47:15,524 - DEBUG - [Pod Pod ctest-pod-11618464] Cmd wget http://10.102.166.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:47:15,524 - DEBUG - [Pod Pod ctest-pod-11618464] Cmd output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:47:20,581 - DEBUG - [Pod ctest-pod-11618464] Cmd: wget http://10.102.166.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:47:20,582 - DEBUG - [Pod Pod ctest-pod-11618464] Cmd wget http://10.102.166.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:47:20,582 - DEBUG - [Pod Pod ctest-pod-11618464] Cmd output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:47:25,648 - DEBUG - [Pod ctest-pod-11618464] Cmd: wget http://10.102.166.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:47:25,648 - DEBUG - [Pod Pod ctest-pod-11618464] Cmd wget http://10.102.166.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:47:25,648 - DEBUG - [Pod Pod ctest-pod-11618464] Cmd output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:47:30,722 - DEBUG - [Pod ctest-pod-11618464] Cmd: wget http://10.102.166.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:47:30,722 - DEBUG - [Pod Pod ctest-pod-11618464] Cmd wget http://10.102.166.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:47:30,722 - DEBUG - [Pod Pod ctest-pod-11618464] Cmd output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:47:35,773 - DEBUG - [Pod ctest-pod-11618464] Cmd: wget http://10.102.166.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:47:35,773 - DEBUG - [Pod Pod ctest-pod-11618464] Cmd wget http://10.102.166.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:47:35,773 - DEBUG - [Pod Pod ctest-pod-11618464] Cmd output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:47:35,773 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-76921258': 0, 'ctest-pod-92462662': 0} 2024-09-12 21:47:37,835 - DEBUG - [Pod ctest-pod-20740333] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=2.057 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.079 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.089 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.079/0.741/2.057 ms 2024-09-12 21:47:37,835 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-20740333 with expectation True passed 2024-09-12 21:47:39,892 - DEBUG - [Pod ctest-pod-15045460] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.193 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.094 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.452/1.193 ms 2024-09-12 21:47:39,892 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-15045460 with expectation True passed 2024-09-12 21:47:41,945 - DEBUG - [Pod ctest-pod-11618464] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.353 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.068 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.092 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.068/0.504/1.353 ms 2024-09-12 21:47:41,945 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-11618464 with expectation True passed 2024-09-12 21:47:42,394 - DEBUG - [Pod ctest-pod-20740333] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-12 21:47:42,394 - DEBUG - [Pod Pod ctest-pod-20740333] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-12 21:47:42,394 - DEBUG - [Pod Pod ctest-pod-20740333] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-12 21:47:42,394 - INFO - wget check of of http://10.47.255.251 from ctest-pod-20740333 passed 2024-09-12 21:47:42,463 - DEBUG - [Pod ctest-pod-20740333] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-12 21:47:42,463 - DEBUG - [Pod Pod ctest-pod-20740333] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-09-12 21:47:42,463 - DEBUG - [Pod Pod ctest-pod-20740333] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-12 21:47:42,463 - INFO - wget check of of http://10.47.255.250 from ctest-pod-20740333 passed 2024-09-12 21:47:47,529 - DEBUG - [Pod ctest-pod-15045460] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-12 21:47:47,529 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-12 21:47:47,529 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-12 21:47:47,529 - INFO - wget check of of http://10.47.255.250 from ctest-pod-15045460 passed 2024-09-12 21:47:52,596 - DEBUG - [Pod ctest-pod-99959927] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-12 21:47:52,596 - DEBUG - [Pod Pod ctest-pod-99959927] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-12 21:47:52,596 - DEBUG - [Pod Pod ctest-pod-99959927] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-12 21:47:52,596 - INFO - wget check of of http://10.47.255.251 from ctest-pod-99959927 passed 2024-09-12 21:47:52,603 - INFO - Updating Network Policy ingress-on-service 2024-09-12 21:47:57,672 - DEBUG - [Pod ctest-pod-15045460] Cmd: wget http://10.102.166.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:47:57,673 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd wget http://10.102.166.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:47:57,673 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:48:02,737 - DEBUG - [Pod ctest-pod-15045460] Cmd: wget http://10.102.166.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:48:02,737 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd wget http://10.102.166.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:48:02,737 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:48:07,806 - DEBUG - [Pod ctest-pod-15045460] Cmd: wget http://10.102.166.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:48:07,806 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd wget http://10.102.166.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:48:07,806 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:48:12,864 - DEBUG - [Pod ctest-pod-15045460] Cmd: wget http://10.102.166.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:48:12,864 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd wget http://10.102.166.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:48:12,864 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:48:17,931 - DEBUG - [Pod ctest-pod-15045460] Cmd: wget http://10.102.166.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:48:17,931 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd wget http://10.102.166.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:48:17,931 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:48:22,992 - DEBUG - [Pod ctest-pod-15045460] Cmd: wget http://10.102.166.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:48:22,993 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd wget http://10.102.166.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:48:22,993 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:48:28,051 - DEBUG - [Pod ctest-pod-15045460] Cmd: wget http://10.102.166.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:48:28,051 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd wget http://10.102.166.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:48:28,052 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:48:33,258 - DEBUG - [Pod ctest-pod-15045460] Cmd: wget http://10.102.166.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:48:33,258 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd wget http://10.102.166.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:48:33,258 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:48:38,318 - DEBUG - [Pod ctest-pod-15045460] Cmd: wget http://10.102.166.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:48:38,318 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd wget http://10.102.166.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:48:38,318 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:48:43,389 - DEBUG - [Pod ctest-pod-15045460] Cmd: wget http://10.102.166.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:48:43,389 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd wget http://10.102.166.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:48:43,389 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd output: Connecting to 10.102.166.87:80 (10.102.166.87:80) wget: download timed out 2024-09-12 21:48:43,389 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-76921258': 0, 'ctest-pod-92462662': 0} 2024-09-12 21:48:43,464 - DEBUG - [Pod ctest-pod-20740333] Cmd: wget http://10.102.166.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.166.87:80 (10.102.166.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-92462662 2024-09-12 21:48:43,464 - DEBUG - [Pod Pod ctest-pod-20740333] Cmd wget http://10.102.166.87:80/ -O - -T 5 -t 1 passed 2024-09-12 21:48:43,464 - DEBUG - [Pod Pod ctest-pod-20740333] Cmd output: Connecting to 10.102.166.87:80 (10.102.166.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-92462662 2024-09-12 21:48:43,546 - DEBUG - [Pod ctest-pod-20740333] Cmd: wget http://10.102.166.87:80/ -O - -T 5 -t 1 , Output: ctest-pod-92462662 Connecting to 10.102.166.87:80 (10.102.166.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-12 21:48:43,547 - DEBUG - [Pod Pod ctest-pod-20740333] Cmd wget http://10.102.166.87:80/ -O - -T 5 -t 1 passed 2024-09-12 21:48:43,547 - DEBUG - [Pod Pod ctest-pod-20740333] Cmd output: ctest-pod-92462662 Connecting to 10.102.166.87:80 (10.102.166.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-12 21:48:43,626 - DEBUG - [Pod ctest-pod-20740333] Cmd: wget http://10.102.166.87:80/ -O - -T 5 -t 1 , Output: ctest-pod-92462662 Connecting to 10.102.166.87:80 (10.102.166.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-12 21:48:43,626 - DEBUG - [Pod Pod ctest-pod-20740333] Cmd wget http://10.102.166.87:80/ -O - -T 5 -t 1 passed 2024-09-12 21:48:43,626 - DEBUG - [Pod Pod ctest-pod-20740333] Cmd output: ctest-pod-92462662 Connecting to 10.102.166.87:80 (10.102.166.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-12 21:48:43,690 - DEBUG - [Pod ctest-pod-20740333] Cmd: wget http://10.102.166.87:80/ -O - -T 5 -t 1 , Output: ctest-pod-92462662 Connecting to 10.102.166.87:80 (10.102.166.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-12 21:48:43,690 - DEBUG - [Pod Pod ctest-pod-20740333] Cmd wget http://10.102.166.87:80/ -O - -T 5 -t 1 passed 2024-09-12 21:48:43,690 - DEBUG - [Pod Pod ctest-pod-20740333] Cmd output: ctest-pod-92462662 Connecting to 10.102.166.87:80 (10.102.166.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-12 21:48:43,757 - DEBUG - [Pod ctest-pod-20740333] Cmd: wget http://10.102.166.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.166.87:80 (10.102.166.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-76921258 2024-09-12 21:48:43,757 - DEBUG - [Pod Pod ctest-pod-20740333] Cmd wget http://10.102.166.87:80/ -O - -T 5 -t 1 passed 2024-09-12 21:48:43,757 - DEBUG - [Pod Pod ctest-pod-20740333] Cmd output: Connecting to 10.102.166.87:80 (10.102.166.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-76921258 2024-09-12 21:48:43,757 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-76921258': 1, 'ctest-pod-92462662': 4} 2024-09-12 21:48:43,829 - DEBUG - [Pod ctest-pod-11618464] Cmd: wget http://10.102.166.87:80/ -O - -T 5 -t 1 , Output: ctest-pod-76921258 Connecting to 10.102.166.87:80 (10.102.166.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-12 21:48:43,829 - DEBUG - [Pod Pod ctest-pod-11618464] Cmd wget http://10.102.166.87:80/ -O - -T 5 -t 1 passed 2024-09-12 21:48:43,829 - DEBUG - [Pod Pod ctest-pod-11618464] Cmd output: ctest-pod-76921258 Connecting to 10.102.166.87:80 (10.102.166.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-12 21:48:43,890 - DEBUG - [Pod ctest-pod-11618464] Cmd: wget http://10.102.166.87:80/ -O - -T 5 -t 1 , Output: ctest-pod-76921258 Connecting to 10.102.166.87:80 (10.102.166.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-12 21:48:43,890 - DEBUG - [Pod Pod ctest-pod-11618464] Cmd wget http://10.102.166.87:80/ -O - -T 5 -t 1 passed 2024-09-12 21:48:43,890 - DEBUG - [Pod Pod ctest-pod-11618464] Cmd output: ctest-pod-76921258 Connecting to 10.102.166.87:80 (10.102.166.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-12 21:48:43,954 - DEBUG - [Pod ctest-pod-11618464] Cmd: wget http://10.102.166.87:80/ -O - -T 5 -t 1 , Output: ctest-pod-92462662 Connecting to 10.102.166.87:80 (10.102.166.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-12 21:48:43,955 - DEBUG - [Pod Pod ctest-pod-11618464] Cmd wget http://10.102.166.87:80/ -O - -T 5 -t 1 passed 2024-09-12 21:48:43,955 - DEBUG - [Pod Pod ctest-pod-11618464] Cmd output: ctest-pod-92462662 Connecting to 10.102.166.87:80 (10.102.166.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-12 21:48:43,955 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-76921258': 2, 'ctest-pod-92462662': 1} 2024-09-12 21:48:46,007 - DEBUG - [Pod ctest-pod-20740333] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.191 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.076 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.076 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.076/0.447/1.191 ms 2024-09-12 21:48:46,007 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-20740333 with expectation True passed 2024-09-12 21:48:48,064 - DEBUG - [Pod ctest-pod-15045460] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.779 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.080 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.081 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.080/0.313/0.779 ms 2024-09-12 21:48:48,064 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-15045460 with expectation True passed 2024-09-12 21:48:50,384 - DEBUG - [Pod ctest-pod-11618464] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.154 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.068 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.073 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.068/0.431/1.154 ms 2024-09-12 21:48:50,384 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-11618464 with expectation True passed 2024-09-12 21:48:50,453 - DEBUG - [Pod ctest-pod-20740333] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-12 21:48:50,453 - DEBUG - [Pod Pod ctest-pod-20740333] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-12 21:48:50,453 - DEBUG - [Pod Pod ctest-pod-20740333] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-12 21:48:50,453 - INFO - wget check of of http://10.47.255.251 from ctest-pod-20740333 passed 2024-09-12 21:48:50,518 - DEBUG - [Pod ctest-pod-20740333] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-12 21:48:50,518 - DEBUG - [Pod Pod ctest-pod-20740333] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-09-12 21:48:50,518 - DEBUG - [Pod Pod ctest-pod-20740333] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-12 21:48:50,519 - INFO - wget check of of http://10.47.255.250 from ctest-pod-20740333 passed 2024-09-12 21:48:55,595 - DEBUG - [Pod ctest-pod-15045460] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-12 21:48:55,595 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-12 21:48:55,595 - DEBUG - [Pod Pod ctest-pod-15045460] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-12 21:48:55,595 - INFO - wget check of of http://10.47.255.250 from ctest-pod-15045460 passed 2024-09-12 21:48:55,674 - DEBUG - [Pod ctest-pod-99959927] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-12 21:48:55,674 - DEBUG - [Pod Pod ctest-pod-99959927] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-12 21:48:55,674 - DEBUG - [Pod Pod ctest-pod-99959927] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-12 21:48:55,675 - INFO - wget check of of http://10.47.255.251 from ctest-pod-99959927 passed 2024-09-12 21:48:55,675 - INFO - Deleting Network Policy : ingress-on-service 2024-09-12 21:48:55,675 - INFO - Deleting service : ctest-nginx-svc-59975083 2024-09-12 21:48:55,903 - DEBUG - No XMPP flaps were noticed during the test 2024-09-12 21:48:55,903 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:15] 2024-09-12 21:48:55,903 - INFO - -------------------------------------------------------------------------------- 2024-09-12 21:48:55,910 - INFO - Deleting pod ctest-new-default-22718182:ctest-pod-76921258 2024-09-12 21:48:55,910 - INFO - Deleting pod ctest-new-default-22718182:ctest-pod-92462662 2024-09-12 21:48:55,911 - INFO - Deleting pod ctest-non-default-03433111:ctest-pod-34381185 2024-09-12 21:48:55,911 - INFO - Deleting pod ctest-non-default-03433111:ctest-pod-90609685 2024-09-12 21:48:55,911 - INFO - Deleting pod ctest-new-default-22718182:ctest-pod-15045460 2024-09-12 21:48:55,912 - INFO - Deleting pod ctest-new-default-22718182:ctest-pod-20740333 2024-09-12 21:48:55,912 - INFO - Deleting pod ctest-non-default-03433111:ctest-pod-11618464 2024-09-12 21:48:55,912 - INFO - Deleting pod ctest-non-default-03433111:ctest-pod-99959927 2024-09-12 21:48:55,934 - WARNING - Pod uuid 61908dff-b62e-4840-b507-f840734927c9 is still seen in agent 10.0.0.40 VM list 2024-09-12 21:48:56,039 - WARNING - Pod uuid 99bb2c7b-a021-4bb9-b0d8-aa5fd9522e58 is still seen in agent 10.0.0.40 VM list 2024-09-12 21:48:56,041 - WARNING - Pod uuid 494aa22f-aff7-46a5-9eab-4563e928b575 is still seen in agent 10.0.0.40 VM list 2024-09-12 21:48:56,041 - WARNING - Pod uuid d95f4837-3720-4f2d-8ca2-681c21c14e44 is still seen in agent 10.0.0.40 VM list 2024-09-12 21:48:56,042 - WARNING - Pod uuid 33626ffc-cb6c-412c-9c72-3378abd9802f is still seen in agent 10.0.0.40 VM list 2024-09-12 21:48:56,042 - WARNING - Pod uuid 2469a7b9-06fc-42d5-a764-9d30a0e6b360 is still seen in agent 10.0.0.40 VM list 2024-09-12 21:48:56,044 - WARNING - Pod uuid 11e069b7-e061-48de-aef9-e46d973c2889 is still seen in agent 10.0.0.40 VM list 2024-09-12 21:48:56,045 - WARNING - Pod uuid 86e57337-6ce8-44b2-8082-79f44640d290 is still seen in agent 10.0.0.40 VM list 2024-09-12 21:49:00,942 - DEBUG - Pod 61908dff-b62e-4840-b507-f840734927c9 is not in agent 10.0.0.40 VM list 2024-09-12 21:49:00,948 - DEBUG - VMI 4eec7ca4-7150-11ef-b0d6-fa163e5072fe is removed from agent 10.0.0.40 2024-09-12 21:49:00,948 - INFO - Verified that pod ctest-pod-76921258 is removed in agent 2024-09-12 21:49:01,069 - WARNING - Pod uuid 2469a7b9-06fc-42d5-a764-9d30a0e6b360 is still seen in agent 10.0.0.40 VM list 2024-09-12 21:49:01,070 - WARNING - Pod uuid 99bb2c7b-a021-4bb9-b0d8-aa5fd9522e58 is still seen in agent 10.0.0.40 VM list 2024-09-12 21:49:01,070 - WARNING - Pod uuid 494aa22f-aff7-46a5-9eab-4563e928b575 is still seen in agent 10.0.0.40 VM list 2024-09-12 21:49:01,070 - DEBUG - Pod 33626ffc-cb6c-412c-9c72-3378abd9802f is not in agent 10.0.0.40 VM list 2024-09-12 21:49:01,073 - WARNING - Pod uuid 11e069b7-e061-48de-aef9-e46d973c2889 is still seen in agent 10.0.0.40 VM list 2024-09-12 21:49:01,074 - DEBUG - Pod d95f4837-3720-4f2d-8ca2-681c21c14e44 is not in agent 10.0.0.40 VM list 2024-09-12 21:49:01,075 - WARNING - Pod uuid 86e57337-6ce8-44b2-8082-79f44640d290 is still seen in agent 10.0.0.40 VM list 2024-09-12 21:49:01,082 - DEBUG - VMI 50854834-7150-11ef-b0d6-fa163e5072fe is removed from agent 10.0.0.40 2024-09-12 21:49:01,082 - INFO - Verified that pod ctest-pod-90609685 is removed in agent 2024-09-12 21:49:01,083 - DEBUG - VMI 50095f76-7150-11ef-b0d6-fa163e5072fe is removed from agent 10.0.0.40 2024-09-12 21:49:01,083 - INFO - Verified that pod ctest-pod-34381185 is removed in agent 2024-09-12 21:49:06,091 - WARNING - Pod uuid 494aa22f-aff7-46a5-9eab-4563e928b575 is still seen in agent 10.0.0.40 VM list 2024-09-12 21:49:06,092 - WARNING - Pod uuid 99bb2c7b-a021-4bb9-b0d8-aa5fd9522e58 is still seen in agent 10.0.0.40 VM list 2024-09-12 21:49:06,093 - WARNING - Pod uuid 86e57337-6ce8-44b2-8082-79f44640d290 is still seen in agent 10.0.0.40 VM list 2024-09-12 21:49:06,094 - WARNING - Pod uuid 2469a7b9-06fc-42d5-a764-9d30a0e6b360 is still seen in agent 10.0.0.40 VM list 2024-09-12 21:49:06,095 - WARNING - Pod uuid 11e069b7-e061-48de-aef9-e46d973c2889 is still seen in agent 10.0.0.40 VM list 2024-09-12 21:49:11,114 - WARNING - Pod uuid 86e57337-6ce8-44b2-8082-79f44640d290 is still seen in agent 10.0.0.40 VM list 2024-09-12 21:49:11,114 - WARNING - Pod uuid 2469a7b9-06fc-42d5-a764-9d30a0e6b360 is still seen in agent 10.0.0.40 VM list 2024-09-12 21:49:11,114 - WARNING - Pod uuid 11e069b7-e061-48de-aef9-e46d973c2889 is still seen in agent 10.0.0.40 VM list 2024-09-12 21:49:11,115 - WARNING - Pod uuid 99bb2c7b-a021-4bb9-b0d8-aa5fd9522e58 is still seen in agent 10.0.0.40 VM list 2024-09-12 21:49:11,115 - WARNING - Pod uuid 494aa22f-aff7-46a5-9eab-4563e928b575 is still seen in agent 10.0.0.40 VM list 2024-09-12 21:49:16,135 - WARNING - Pod uuid 494aa22f-aff7-46a5-9eab-4563e928b575 is still seen in agent 10.0.0.40 VM list 2024-09-12 21:49:16,135 - WARNING - Pod uuid 86e57337-6ce8-44b2-8082-79f44640d290 is still seen in agent 10.0.0.40 VM list 2024-09-12 21:49:16,136 - WARNING - Pod uuid 99bb2c7b-a021-4bb9-b0d8-aa5fd9522e58 is still seen in agent 10.0.0.40 VM list 2024-09-12 21:49:16,137 - WARNING - Pod uuid 11e069b7-e061-48de-aef9-e46d973c2889 is still seen in agent 10.0.0.40 VM list 2024-09-12 21:49:16,267 - WARNING - Pod uuid 2469a7b9-06fc-42d5-a764-9d30a0e6b360 is still seen in agent 10.0.0.40 VM list 2024-09-12 21:49:21,153 - WARNING - Pod uuid 99bb2c7b-a021-4bb9-b0d8-aa5fd9522e58 is still seen in agent 10.0.0.40 VM list 2024-09-12 21:49:21,153 - WARNING - Pod uuid 86e57337-6ce8-44b2-8082-79f44640d290 is still seen in agent 10.0.0.40 VM list 2024-09-12 21:49:21,153 - WARNING - Pod uuid 494aa22f-aff7-46a5-9eab-4563e928b575 is still seen in agent 10.0.0.40 VM list 2024-09-12 21:49:21,154 - WARNING - Pod uuid 11e069b7-e061-48de-aef9-e46d973c2889 is still seen in agent 10.0.0.40 VM list 2024-09-12 21:49:21,275 - WARNING - Pod uuid 2469a7b9-06fc-42d5-a764-9d30a0e6b360 is still seen in agent 10.0.0.40 VM list 2024-09-12 21:49:26,172 - WARNING - Pod uuid 86e57337-6ce8-44b2-8082-79f44640d290 is still seen in agent 10.0.0.40 VM list 2024-09-12 21:49:26,172 - WARNING - Pod uuid 494aa22f-aff7-46a5-9eab-4563e928b575 is still seen in agent 10.0.0.40 VM list 2024-09-12 21:49:26,173 - WARNING - Pod uuid 99bb2c7b-a021-4bb9-b0d8-aa5fd9522e58 is still seen in agent 10.0.0.40 VM list 2024-09-12 21:49:26,174 - WARNING - Pod uuid 11e069b7-e061-48de-aef9-e46d973c2889 is still seen in agent 10.0.0.40 VM list 2024-09-12 21:49:26,283 - WARNING - Pod uuid 2469a7b9-06fc-42d5-a764-9d30a0e6b360 is still seen in agent 10.0.0.40 VM list 2024-09-12 21:49:31,190 - DEBUG - Pod 99bb2c7b-a021-4bb9-b0d8-aa5fd9522e58 is not in agent 10.0.0.40 VM list 2024-09-12 21:49:31,191 - DEBUG - Pod 86e57337-6ce8-44b2-8082-79f44640d290 is not in agent 10.0.0.40 VM list 2024-09-12 21:49:31,193 - DEBUG - Pod 11e069b7-e061-48de-aef9-e46d973c2889 is not in agent 10.0.0.40 VM list 2024-09-12 21:49:31,194 - DEBUG - Pod 494aa22f-aff7-46a5-9eab-4563e928b575 is not in agent 10.0.0.40 VM list 2024-09-12 21:49:31,207 - DEBUG - VMI 5183f14a-7150-11ef-b0d6-fa163e5072fe is removed from agent 10.0.0.40 2024-09-12 21:49:31,207 - INFO - Verified that pod ctest-pod-20740333 is removed in agent 2024-09-12 21:49:31,209 - DEBUG - VMI 526bc0e2-7150-11ef-b0d6-fa163e5072fe is removed from agent 10.0.0.40 2024-09-12 21:49:31,209 - INFO - Verified that pod ctest-pod-99959927 is removed in agent 2024-09-12 21:49:31,209 - DEBUG - VMI 51fa4e44-7150-11ef-b0d6-fa163e5072fe is removed from agent 10.0.0.40 2024-09-12 21:49:31,209 - INFO - Verified that pod ctest-pod-11618464 is removed in agent 2024-09-12 21:49:31,209 - DEBUG - VMI 510df580-7150-11ef-b0d6-fa163e5072fe is removed from agent 10.0.0.40 2024-09-12 21:49:31,209 - INFO - Verified that pod ctest-pod-15045460 is removed in agent 2024-09-12 21:49:31,290 - DEBUG - Pod 2469a7b9-06fc-42d5-a764-9d30a0e6b360 is not in agent 10.0.0.40 VM list 2024-09-12 21:49:31,302 - DEBUG - VMI 4f67efd8-7150-11ef-b0d6-fa163e5072fe is removed from agent 10.0.0.40 2024-09-12 21:49:31,302 - INFO - Verified that pod ctest-pod-92462662 is removed in agent 2024-09-12 21:49:31,302 - INFO - Deleting namespace ctest-non-default-03433111 2024-09-12 21:49:31,312 - DEBUG - Namespace ctest-non-default-03433111 still in k8s 2024-09-12 21:49:33,317 - DEBUG - Namespace ctest-non-default-03433111 still in k8s 2024-09-12 21:49:35,320 - DEBUG - Namespace ctest-non-default-03433111 still in k8s 2024-09-12 21:49:37,323 - DEBUG - Namespace ctest-non-default-03433111 is not in k8s 2024-09-12 21:49:37,324 - DEBUG - No need to check project deletion in contrail-api 2024-09-12 21:49:37,324 - INFO - Deleting namespace ctest-new-default-22718182 2024-09-12 21:49:37,330 - DEBUG - Namespace ctest-new-default-22718182 still in k8s 2024-09-12 21:49:39,335 - DEBUG - Namespace ctest-new-default-22718182 still in k8s 2024-09-12 21:49:41,338 - DEBUG - Namespace ctest-new-default-22718182 still in k8s 2024-09-12 21:49:43,343 - DEBUG - Namespace ctest-new-default-22718182 is not in k8s 2024-09-12 21:49:43,343 - DEBUG - No need to check project deletion in contrail-api