2024-09-18 00:27:33,588 - INFO - Using existing project ['default-domain', 'k8s-default'](1864362b-33a7-46ca-9856-378cde19b718) 2024-09-18 00:27:33,611 - DEBUG - Namespace ctest-new-default-51013264 not present 2024-09-18 00:27:33,618 - INFO - Created namespace ctest-new-default-51013264 2024-09-18 00:27:36,621 - DEBUG - Namespace ctest-non-default-29630681 not present 2024-09-18 00:27:36,629 - INFO - Created namespace ctest-non-default-29630681 2024-09-18 00:27:39,645 - DEBUG - Pod ctest-pod-89057150 not present 2024-09-18 00:27:39,645 - INFO - Creating Pod ctest-pod-89057150 2024-09-18 00:27:39,663 - DEBUG - Pod : ctest-pod-89057150 UUID is 9f1c7fe1-0a42-4adf-9b61-124cf0bf653c 2024-09-18 00:27:39,665 - DEBUG - Pod ctest-pod-55348754 not present 2024-09-18 00:27:39,665 - INFO - Creating Pod ctest-pod-55348754 2024-09-18 00:27:39,680 - DEBUG - Pod : ctest-pod-55348754 UUID is 54652f87-07c8-463c-a2ee-72a819f8b07d 2024-09-18 00:27:39,682 - DEBUG - Pod ctest-pod-93908669 not present 2024-09-18 00:27:39,682 - INFO - Creating Pod ctest-pod-93908669 2024-09-18 00:27:39,700 - DEBUG - Pod : ctest-pod-93908669 UUID is 4c6f8ff7-8e2a-47e2-ae8b-21bc8a287d8a 2024-09-18 00:27:39,709 - DEBUG - Pod ctest-pod-84931580 not present 2024-09-18 00:27:39,709 - INFO - Creating Pod ctest-pod-84931580 2024-09-18 00:27:39,728 - DEBUG - Pod : ctest-pod-84931580 UUID is bdbca4fa-1f21-4b7f-ade0-75a5325bf762 2024-09-18 00:27:39,737 - DEBUG - Pod ctest-pod-77456041 not present 2024-09-18 00:27:39,737 - INFO - Creating Pod ctest-pod-77456041 2024-09-18 00:27:39,753 - DEBUG - Pod : ctest-pod-77456041 UUID is 4c6ed4e0-b9c2-4228-b6ef-b6f187cb0148 2024-09-18 00:27:39,760 - DEBUG - Pod ctest-pod-65952240 not present 2024-09-18 00:27:39,760 - INFO - Creating Pod ctest-pod-65952240 2024-09-18 00:27:39,785 - DEBUG - Pod : ctest-pod-65952240 UUID is e4549221-49c4-4eb8-b811-10a06f0a7f63 2024-09-18 00:27:39,789 - DEBUG - Pod ctest-pod-42489245 not present 2024-09-18 00:27:39,789 - INFO - Creating Pod ctest-pod-42489245 2024-09-18 00:27:39,810 - DEBUG - Pod : ctest-pod-42489245 UUID is 5f4900bb-6b01-4ae9-a5b6-ba7a7f3aeafa 2024-09-18 00:27:39,812 - DEBUG - Pod ctest-pod-89430591 not present 2024-09-18 00:27:39,813 - INFO - Creating Pod ctest-pod-89430591 2024-09-18 00:27:39,832 - DEBUG - Pod : ctest-pod-89430591 UUID is 835391c6-1ebe-4d2d-8d6f-71b2c2b4ebc7 2024-09-18 00:27:40,032 - INFO - Project default-domain:k8s-ctest-new-default-51013264 for Namespace ctest-new-default-51013264 is seen in contrail-api 2024-09-18 00:27:40,032 - DEBUG - Project uuid in Contrail is f8cbeb96-4d8f-4ddf-a773-879e542698c0 2024-09-18 00:27:40,159 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_NamespaceDatabaseList?namespace_uuid=0a45218b-67d6-4d47-9005-e9b7d0cae965 2024-09-18 00:27:40,164 - INFO - Namespace ctest-new-default-51013264 with uuid 0a45218b-67d6-4d47-9005-e9b7d0cae965 found in kube manager 2024-09-18 00:27:40,164 - INFO - Namespace ctest-new-default-51013264 verification passed 2024-09-18 00:27:40,426 - INFO - Project default-domain:k8s-ctest-non-default-29630681 for Namespace ctest-non-default-29630681 is seen in contrail-api 2024-09-18 00:27:40,426 - DEBUG - Project uuid in Contrail is 2369187d-b761-4f2c-8a29-9ad214d06dc6 2024-09-18 00:27:40,426 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_NamespaceDatabaseList?namespace_uuid=7faa7ee8-1fd7-45c6-8f96-cccc3c263cb6 2024-09-18 00:27:40,431 - INFO - Namespace ctest-non-default-29630681 with uuid 7faa7ee8-1fd7-45c6-8f96-cccc3c263cb6 found in kube manager 2024-09-18 00:27:40,431 - INFO - Namespace ctest-non-default-29630681 verification passed 2024-09-18 00:27:40,437 - DEBUG - Pod ctest-pod-89057150 not in running state.Currently in Pending 2024-09-18 00:27:45,446 - DEBUG - Pod ctest-pod-89057150 not in running state.Currently in Pending 2024-09-18 00:27:50,458 - DEBUG - Pod ctest-pod-89057150 not in running state.Currently in Pending 2024-09-18 00:27:55,465 - INFO - Pod ctest-pod-89057150 is in running state.Got IP 10.47.255.251 2024-09-18 00:27:55,524 - DEBUG - Pod ctest-pod-89057150 has vmi d0fd79b6-7554-11ef-9794-fa163eb4d31d 2024-09-18 00:27:55,524 - INFO - Verified pod ctest-pod-89057150 in contrail-api 2024-09-18 00:27:55,538 - DEBUG - VMI d0fd79b6-7554-11ef-9794-fa163eb4d31d is active in agent 10.0.0.24 2024-09-18 00:27:55,538 - INFO - Verified Pod ctest-pod-89057150 in agent 10.0.0.24 2024-09-18 00:27:55,538 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_VirtualMachineDatabaseList?x=9f1c7fe1-0a42-4adf-9b61-124cf0bf653c 2024-09-18 00:27:55,542 - INFO - Pod ctest-pod-89057150 with uuid 9f1c7fe1-0a42-4adf-9b61-124cf0bf653c found in kube manager 2024-09-18 00:27:55,543 - INFO - Pod ctest-pod-89057150 verification passed 2024-09-18 00:27:55,548 - INFO - Pod ctest-pod-55348754 is in running state.Got IP 10.47.255.250 2024-09-18 00:27:55,567 - DEBUG - Pod ctest-pod-55348754 has vmi d16bf210-7554-11ef-9794-fa163eb4d31d 2024-09-18 00:27:55,567 - INFO - Verified pod ctest-pod-55348754 in contrail-api 2024-09-18 00:27:55,580 - DEBUG - VMI d16bf210-7554-11ef-9794-fa163eb4d31d is active in agent 10.0.0.24 2024-09-18 00:27:55,580 - INFO - Verified Pod ctest-pod-55348754 in agent 10.0.0.24 2024-09-18 00:27:55,580 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_VirtualMachineDatabaseList?x=54652f87-07c8-463c-a2ee-72a819f8b07d 2024-09-18 00:27:55,585 - INFO - Pod ctest-pod-55348754 with uuid 54652f87-07c8-463c-a2ee-72a819f8b07d found in kube manager 2024-09-18 00:27:55,585 - INFO - Pod ctest-pod-55348754 verification passed 2024-09-18 00:27:55,590 - INFO - Pod ctest-pod-93908669 is in running state.Got IP 10.47.255.249 2024-09-18 00:27:55,652 - DEBUG - Pod ctest-pod-93908669 has vmi d21b5d7c-7554-11ef-9794-fa163eb4d31d 2024-09-18 00:27:55,652 - INFO - Verified pod ctest-pod-93908669 in contrail-api 2024-09-18 00:27:55,665 - DEBUG - VMI d21b5d7c-7554-11ef-9794-fa163eb4d31d is active in agent 10.0.0.24 2024-09-18 00:27:55,666 - INFO - Verified Pod ctest-pod-93908669 in agent 10.0.0.24 2024-09-18 00:27:55,666 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_VirtualMachineDatabaseList?x=4c6f8ff7-8e2a-47e2-ae8b-21bc8a287d8a 2024-09-18 00:27:55,670 - INFO - Pod ctest-pod-93908669 with uuid 4c6f8ff7-8e2a-47e2-ae8b-21bc8a287d8a found in kube manager 2024-09-18 00:27:55,670 - INFO - Pod ctest-pod-93908669 verification passed 2024-09-18 00:27:55,675 - INFO - Pod ctest-pod-84931580 is in running state.Got IP 10.47.255.248 2024-09-18 00:27:55,736 - DEBUG - Pod ctest-pod-84931580 has vmi d2a96e5a-7554-11ef-9794-fa163eb4d31d 2024-09-18 00:27:55,736 - INFO - Verified pod ctest-pod-84931580 in contrail-api 2024-09-18 00:27:55,748 - DEBUG - VMI d2a96e5a-7554-11ef-9794-fa163eb4d31d is active in agent 10.0.0.24 2024-09-18 00:27:55,748 - INFO - Verified Pod ctest-pod-84931580 in agent 10.0.0.24 2024-09-18 00:27:55,749 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_VirtualMachineDatabaseList?x=bdbca4fa-1f21-4b7f-ade0-75a5325bf762 2024-09-18 00:27:55,753 - INFO - Pod ctest-pod-84931580 with uuid bdbca4fa-1f21-4b7f-ade0-75a5325bf762 found in kube manager 2024-09-18 00:27:55,753 - INFO - Pod ctest-pod-84931580 verification passed 2024-09-18 00:27:55,758 - DEBUG - Pod ctest-pod-77456041 not in running state.Currently in Pending 2024-09-18 00:28:00,765 - INFO - Pod ctest-pod-77456041 is in running state.Got IP 10.47.255.247 2024-09-18 00:28:00,795 - DEBUG - Pod ctest-pod-77456041 has vmi d341afda-7554-11ef-9794-fa163eb4d31d 2024-09-18 00:28:00,795 - INFO - Verified pod ctest-pod-77456041 in contrail-api 2024-09-18 00:28:00,807 - DEBUG - VMI d341afda-7554-11ef-9794-fa163eb4d31d is active in agent 10.0.0.24 2024-09-18 00:28:00,808 - INFO - Verified Pod ctest-pod-77456041 in agent 10.0.0.24 2024-09-18 00:28:00,808 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_VirtualMachineDatabaseList?x=4c6ed4e0-b9c2-4228-b6ef-b6f187cb0148 2024-09-18 00:28:00,812 - INFO - Pod ctest-pod-77456041 with uuid 4c6ed4e0-b9c2-4228-b6ef-b6f187cb0148 found in kube manager 2024-09-18 00:28:00,812 - INFO - Pod ctest-pod-77456041 verification passed 2024-09-18 00:28:00,817 - INFO - Pod ctest-pod-42489245 is in running state.Got IP 10.47.255.245 2024-09-18 00:28:00,892 - DEBUG - Pod ctest-pod-42489245 has vmi d4366ab6-7554-11ef-9794-fa163eb4d31d 2024-09-18 00:28:00,892 - INFO - Verified pod ctest-pod-42489245 in contrail-api 2024-09-18 00:28:00,906 - DEBUG - VMI d4366ab6-7554-11ef-9794-fa163eb4d31d is active in agent 10.0.0.24 2024-09-18 00:28:00,906 - INFO - Verified Pod ctest-pod-42489245 in agent 10.0.0.24 2024-09-18 00:28:00,906 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_VirtualMachineDatabaseList?x=5f4900bb-6b01-4ae9-a5b6-ba7a7f3aeafa 2024-09-18 00:28:00,911 - INFO - Pod ctest-pod-42489245 with uuid 5f4900bb-6b01-4ae9-a5b6-ba7a7f3aeafa found in kube manager 2024-09-18 00:28:00,911 - INFO - Pod ctest-pod-42489245 verification passed 2024-09-18 00:28:00,917 - INFO - Pod ctest-pod-65952240 is in running state.Got IP 10.47.255.246 2024-09-18 00:28:00,945 - DEBUG - Pod ctest-pod-65952240 has vmi d3bfc820-7554-11ef-9794-fa163eb4d31d 2024-09-18 00:28:00,945 - INFO - Verified pod ctest-pod-65952240 in contrail-api 2024-09-18 00:28:00,959 - DEBUG - VMI d3bfc820-7554-11ef-9794-fa163eb4d31d is active in agent 10.0.0.24 2024-09-18 00:28:00,959 - INFO - Verified Pod ctest-pod-65952240 in agent 10.0.0.24 2024-09-18 00:28:00,959 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_VirtualMachineDatabaseList?x=e4549221-49c4-4eb8-b811-10a06f0a7f63 2024-09-18 00:28:00,964 - INFO - Pod ctest-pod-65952240 with uuid e4549221-49c4-4eb8-b811-10a06f0a7f63 found in kube manager 2024-09-18 00:28:00,964 - INFO - Pod ctest-pod-65952240 verification passed 2024-09-18 00:28:00,970 - INFO - Pod ctest-pod-89430591 is in running state.Got IP 10.47.255.244 2024-09-18 00:28:01,031 - DEBUG - Pod ctest-pod-89430591 has vmi d4af4602-7554-11ef-9794-fa163eb4d31d 2024-09-18 00:28:01,032 - INFO - Verified pod ctest-pod-89430591 in contrail-api 2024-09-18 00:28:01,043 - DEBUG - VMI d4af4602-7554-11ef-9794-fa163eb4d31d is active in agent 10.0.0.24 2024-09-18 00:28:01,044 - INFO - Verified Pod ctest-pod-89430591 in agent 10.0.0.24 2024-09-18 00:28:01,044 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_VirtualMachineDatabaseList?x=835391c6-1ebe-4d2d-8d6f-71b2c2b4ebc7 2024-09-18 00:28:01,049 - INFO - Pod ctest-pod-89430591 with uuid 835391c6-1ebe-4d2d-8d6f-71b2c2b4ebc7 found in kube manager 2024-09-18 00:28:01,049 - INFO - Pod ctest-pod-89430591 verification passed 2024-09-18 00:28:01,049 - INFO - ================================================================================ 2024-09-18 00:28:01,049 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-09-18 00:28:01,049 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-09-18 00:28:01,281 - DEBUG - Nothing to compare xmpp stats {'10.0.0.24': {'10.0.0.34': '0'}} with 2024-09-18 00:28:01,281 - INFO - Initial checks done. Running the testcase now 2024-09-18 00:28:01,281 - INFO - 2024-09-18 00:28:01,332 - DEBUG - [Pod ctest-pod-89057150] Cmd: echo ctest-pod-89057150 > /usr/share/nginx/html/index.html, Output: 2024-09-18 00:28:01,437 - DEBUG - [Pod ctest-pod-55348754] Cmd: echo ctest-pod-55348754 > /usr/share/nginx/html/index.html, Output: 2024-09-18 00:28:01,504 - DEBUG - [Pod ctest-pod-93908669] Cmd: echo ctest-pod-93908669 > /usr/share/nginx/html/index.html, Output: 2024-09-18 00:28:01,572 - DEBUG - [Pod ctest-pod-84931580] Cmd: echo ctest-pod-84931580 > /usr/share/nginx/html/index.html, Output: 2024-09-18 00:28:01,574 - DEBUG - Service ctest-nginx-svc-77607619 not present 2024-09-18 00:28:01,575 - INFO - Creating service ctest-nginx-svc-77607619 2024-09-18 00:28:01,594 - INFO - Created Service ctest-nginx-svc-77607619 2024-09-18 00:28:01,603 - WARNING - Service UUID e608f12f-7c53-4566-8e15-ed1d3eabda37 not yet found in contrail-api 2024-09-18 00:28:02,692 - INFO - Validated that Service ctest-nginx-svc-77607619 is seen in contrail-api 2024-09-18 00:28:02,693 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_LoadbalancerDatabaseList?x=e608f12f-7c53-4566-8e15-ed1d3eabda37 2024-09-18 00:28:02,697 - INFO - Service ctest-nginx-svc-77607619 with uuid e608f12f-7c53-4566-8e15-ed1d3eabda37 found in kube manager 2024-09-18 00:28:02,697 - INFO - Service ctest-nginx-svc-77607619 verification passed 2024-09-18 00:28:03,814 - DEBUG - [Pod ctest-pod-77456041] Cmd: wget http://10.97.191.187:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.191.187:80 (10.97.191.187:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-89057150 2024-09-18 00:28:03,814 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd wget http://10.97.191.187:80/ -O - -T 5 -t 1 passed 2024-09-18 00:28:03,814 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd output: Connecting to 10.97.191.187:80 (10.97.191.187:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-89057150 2024-09-18 00:28:03,885 - DEBUG - [Pod ctest-pod-77456041] Cmd: wget http://10.97.191.187:80/ -O - -T 5 -t 1 , Output: ctest-pod-55348754 Connecting to 10.97.191.187:80 (10.97.191.187:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 00:28:03,885 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd wget http://10.97.191.187:80/ -O - -T 5 -t 1 passed 2024-09-18 00:28:03,885 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd output: ctest-pod-55348754 Connecting to 10.97.191.187:80 (10.97.191.187:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 00:28:03,885 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-89057150': 1, 'ctest-pod-55348754': 1} 2024-09-18 00:28:03,953 - DEBUG - [Pod ctest-pod-42489245] Cmd: wget http://10.97.191.187:80/ -O - -T 5 -t 1 , Output: ctest-pod-55348754 Connecting to 10.97.191.187:80 (10.97.191.187:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 00:28:03,953 - DEBUG - [Pod Pod ctest-pod-42489245] Cmd wget http://10.97.191.187:80/ -O - -T 5 -t 1 passed 2024-09-18 00:28:03,954 - DEBUG - [Pod Pod ctest-pod-42489245] Cmd output: ctest-pod-55348754 Connecting to 10.97.191.187:80 (10.97.191.187:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 00:28:04,012 - DEBUG - [Pod ctest-pod-42489245] Cmd: wget http://10.97.191.187:80/ -O - -T 5 -t 1 , Output: ctest-pod-55348754 Connecting to 10.97.191.187:80 (10.97.191.187:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 00:28:04,013 - DEBUG - [Pod Pod ctest-pod-42489245] Cmd wget http://10.97.191.187:80/ -O - -T 5 -t 1 passed 2024-09-18 00:28:04,013 - DEBUG - [Pod Pod ctest-pod-42489245] Cmd output: ctest-pod-55348754 Connecting to 10.97.191.187:80 (10.97.191.187:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 00:28:04,075 - DEBUG - [Pod ctest-pod-42489245] Cmd: wget http://10.97.191.187:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.191.187:80 (10.97.191.187:80) ctest-pod-89057150 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 00:28:04,076 - DEBUG - [Pod Pod ctest-pod-42489245] Cmd wget http://10.97.191.187:80/ -O - -T 5 -t 1 passed 2024-09-18 00:28:04,076 - DEBUG - [Pod Pod ctest-pod-42489245] Cmd output: Connecting to 10.97.191.187:80 (10.97.191.187:80) ctest-pod-89057150 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 00:28:04,076 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-89057150': 1, 'ctest-pod-55348754': 2} 2024-09-18 00:28:04,080 - DEBUG - Network policy ingress-on-service not present 2024-09-18 00:28:04,080 - INFO - Creating Network Policy ingress-on-service 2024-09-18 00:28:04,097 - INFO - Network policy found in k8s 2024-09-18 00:28:04,098 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=45aa8656-f194-4246-86a1-3f9966c5043d 2024-09-18 00:28:04,103 - INFO - Network Policy ingress-on-service with uuid 45aa8656-f194-4246-86a1-3f9966c5043d found in kube manager 2024-09-18 00:28:04,155 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-09-18 00:28:04,156 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-09-18 00:28:04,156 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=45aa8656-f194-4246-86a1-3f9966c5043d 2024-09-18 00:28:04,186 - WARNING - Network policy with name ingress-on-service not found in agent 2024-09-18 00:28:06,187 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=45aa8656-f194-4246-86a1-3f9966c5043d 2024-09-18 00:28:06,216 - INFO - Network policy with name ingress-on-service found in agent 2024-09-18 00:28:06,217 - INFO - Network Policy ingress-on-service verification passed 2024-09-18 00:28:11,286 - DEBUG - [Pod ctest-pod-77456041] Cmd: wget http://10.97.191.187:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:28:11,286 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd wget http://10.97.191.187:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:28:11,286 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:28:16,341 - DEBUG - [Pod ctest-pod-77456041] Cmd: wget http://10.97.191.187:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:28:16,341 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd wget http://10.97.191.187:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:28:16,342 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:28:21,400 - DEBUG - [Pod ctest-pod-77456041] Cmd: wget http://10.97.191.187:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:28:21,401 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd wget http://10.97.191.187:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:28:21,401 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:28:26,467 - DEBUG - [Pod ctest-pod-77456041] Cmd: wget http://10.97.191.187:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:28:26,467 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd wget http://10.97.191.187:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:28:26,467 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:28:31,522 - DEBUG - [Pod ctest-pod-77456041] Cmd: wget http://10.97.191.187:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:28:31,522 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd wget http://10.97.191.187:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:28:31,522 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:28:36,592 - DEBUG - [Pod ctest-pod-77456041] Cmd: wget http://10.97.191.187:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:28:36,592 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd wget http://10.97.191.187:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:28:36,592 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:28:41,664 - DEBUG - [Pod ctest-pod-77456041] Cmd: wget http://10.97.191.187:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:28:41,664 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd wget http://10.97.191.187:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:28:41,664 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:28:46,726 - DEBUG - [Pod ctest-pod-77456041] Cmd: wget http://10.97.191.187:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:28:46,726 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd wget http://10.97.191.187:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:28:46,726 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:28:51,782 - DEBUG - [Pod ctest-pod-77456041] Cmd: wget http://10.97.191.187:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:28:51,782 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd wget http://10.97.191.187:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:28:51,782 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:28:56,852 - DEBUG - [Pod ctest-pod-77456041] Cmd: wget http://10.97.191.187:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:28:56,852 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd wget http://10.97.191.187:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:28:56,852 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:28:56,852 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-89057150': 0, 'ctest-pod-55348754': 0} 2024-09-18 00:28:56,920 - DEBUG - [Pod ctest-pod-65952240] Cmd: wget http://10.97.191.187:80/ -O - -T 5 -t 1 , Output: ctest-pod-55348754 Connecting to 10.97.191.187:80 (10.97.191.187:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 00:28:56,920 - DEBUG - [Pod Pod ctest-pod-65952240] Cmd wget http://10.97.191.187:80/ -O - -T 5 -t 1 passed 2024-09-18 00:28:56,920 - DEBUG - [Pod Pod ctest-pod-65952240] Cmd output: ctest-pod-55348754 Connecting to 10.97.191.187:80 (10.97.191.187:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 00:28:56,983 - DEBUG - [Pod ctest-pod-65952240] Cmd: wget http://10.97.191.187:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.191.187:80 (10.97.191.187:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-55348754 2024-09-18 00:28:56,983 - DEBUG - [Pod Pod ctest-pod-65952240] Cmd wget http://10.97.191.187:80/ -O - -T 5 -t 1 passed 2024-09-18 00:28:56,983 - DEBUG - [Pod Pod ctest-pod-65952240] Cmd output: Connecting to 10.97.191.187:80 (10.97.191.187:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-55348754 2024-09-18 00:28:57,046 - DEBUG - [Pod ctest-pod-65952240] Cmd: wget http://10.97.191.187:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.191.187:80 (10.97.191.187:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-89057150 2024-09-18 00:28:57,047 - DEBUG - [Pod Pod ctest-pod-65952240] Cmd wget http://10.97.191.187:80/ -O - -T 5 -t 1 passed 2024-09-18 00:28:57,047 - DEBUG - [Pod Pod ctest-pod-65952240] Cmd output: Connecting to 10.97.191.187:80 (10.97.191.187:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-89057150 2024-09-18 00:28:57,047 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-89057150': 1, 'ctest-pod-55348754': 2} 2024-09-18 00:29:02,097 - DEBUG - [Pod ctest-pod-42489245] Cmd: wget http://10.97.191.187:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:29:02,097 - DEBUG - [Pod Pod ctest-pod-42489245] Cmd wget http://10.97.191.187:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:29:02,097 - DEBUG - [Pod Pod ctest-pod-42489245] Cmd output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:29:07,150 - DEBUG - [Pod ctest-pod-42489245] Cmd: wget http://10.97.191.187:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:29:07,150 - DEBUG - [Pod Pod ctest-pod-42489245] Cmd wget http://10.97.191.187:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:29:07,150 - DEBUG - [Pod Pod ctest-pod-42489245] Cmd output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:29:12,209 - DEBUG - [Pod ctest-pod-42489245] Cmd: wget http://10.97.191.187:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:29:12,209 - DEBUG - [Pod Pod ctest-pod-42489245] Cmd wget http://10.97.191.187:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:29:12,209 - DEBUG - [Pod Pod ctest-pod-42489245] Cmd output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:29:17,272 - DEBUG - [Pod ctest-pod-42489245] Cmd: wget http://10.97.191.187:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:29:17,272 - DEBUG - [Pod Pod ctest-pod-42489245] Cmd wget http://10.97.191.187:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:29:17,272 - DEBUG - [Pod Pod ctest-pod-42489245] Cmd output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:29:22,326 - DEBUG - [Pod ctest-pod-42489245] Cmd: wget http://10.97.191.187:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:29:22,326 - DEBUG - [Pod Pod ctest-pod-42489245] Cmd wget http://10.97.191.187:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:29:22,326 - DEBUG - [Pod Pod ctest-pod-42489245] Cmd output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:29:27,392 - DEBUG - [Pod ctest-pod-42489245] Cmd: wget http://10.97.191.187:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:29:27,393 - DEBUG - [Pod Pod ctest-pod-42489245] Cmd wget http://10.97.191.187:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:29:27,393 - DEBUG - [Pod Pod ctest-pod-42489245] Cmd output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:29:32,446 - DEBUG - [Pod ctest-pod-42489245] Cmd: wget http://10.97.191.187:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:29:32,446 - DEBUG - [Pod Pod ctest-pod-42489245] Cmd wget http://10.97.191.187:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:29:32,446 - DEBUG - [Pod Pod ctest-pod-42489245] Cmd output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:29:37,506 - DEBUG - [Pod ctest-pod-42489245] Cmd: wget http://10.97.191.187:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:29:37,506 - DEBUG - [Pod Pod ctest-pod-42489245] Cmd wget http://10.97.191.187:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:29:37,507 - DEBUG - [Pod Pod ctest-pod-42489245] Cmd output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:29:42,576 - DEBUG - [Pod ctest-pod-42489245] Cmd: wget http://10.97.191.187:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:29:42,576 - DEBUG - [Pod Pod ctest-pod-42489245] Cmd wget http://10.97.191.187:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:29:42,576 - DEBUG - [Pod Pod ctest-pod-42489245] Cmd output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:29:47,635 - DEBUG - [Pod ctest-pod-42489245] Cmd: wget http://10.97.191.187:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:29:47,635 - DEBUG - [Pod Pod ctest-pod-42489245] Cmd wget http://10.97.191.187:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:29:47,635 - DEBUG - [Pod Pod ctest-pod-42489245] Cmd output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:29:47,635 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-89057150': 0, 'ctest-pod-55348754': 0} 2024-09-18 00:29:49,703 - DEBUG - [Pod ctest-pod-65952240] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.887 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.065 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.107 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.065/0.353/0.887 ms 2024-09-18 00:29:49,703 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-65952240 with expectation True passed 2024-09-18 00:29:51,763 - DEBUG - [Pod ctest-pod-77456041] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.424 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.091 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.073 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.073/0.196/0.424 ms 2024-09-18 00:29:51,763 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-77456041 with expectation True passed 2024-09-18 00:29:53,822 - DEBUG - [Pod ctest-pod-42489245] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.897 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.067 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.072 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.067/0.345/0.897 ms 2024-09-18 00:29:53,822 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-42489245 with expectation True passed 2024-09-18 00:29:53,884 - DEBUG - [Pod ctest-pod-65952240] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 00:29:53,884 - DEBUG - [Pod Pod ctest-pod-65952240] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-18 00:29:53,884 - DEBUG - [Pod Pod ctest-pod-65952240] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 00:29:53,884 - INFO - wget check of of http://10.47.255.251 from ctest-pod-65952240 passed 2024-09-18 00:29:53,941 - DEBUG - [Pod ctest-pod-65952240] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 00:29:53,942 - DEBUG - [Pod Pod ctest-pod-65952240] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-09-18 00:29:53,942 - DEBUG - [Pod Pod ctest-pod-65952240] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 00:29:53,942 - INFO - wget check of of http://10.47.255.250 from ctest-pod-65952240 passed 2024-09-18 00:29:59,003 - DEBUG - [Pod ctest-pod-77456041] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-18 00:29:59,003 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-18 00:29:59,003 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-18 00:29:59,003 - INFO - wget check of of http://10.47.255.250 from ctest-pod-77456041 passed 2024-09-18 00:30:04,055 - DEBUG - [Pod ctest-pod-89430591] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-18 00:30:04,055 - DEBUG - [Pod Pod ctest-pod-89430591] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-18 00:30:04,055 - DEBUG - [Pod Pod ctest-pod-89430591] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-18 00:30:04,055 - INFO - wget check of of http://10.47.255.251 from ctest-pod-89430591 passed 2024-09-18 00:30:04,064 - INFO - Updating Network Policy ingress-on-service 2024-09-18 00:30:09,150 - DEBUG - [Pod ctest-pod-77456041] Cmd: wget http://10.97.191.187:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:30:09,150 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd wget http://10.97.191.187:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:30:09,150 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:30:14,217 - DEBUG - [Pod ctest-pod-77456041] Cmd: wget http://10.97.191.187:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:30:14,217 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd wget http://10.97.191.187:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:30:14,218 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:30:19,270 - DEBUG - [Pod ctest-pod-77456041] Cmd: wget http://10.97.191.187:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:30:19,270 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd wget http://10.97.191.187:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:30:19,270 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:30:24,339 - DEBUG - [Pod ctest-pod-77456041] Cmd: wget http://10.97.191.187:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:30:24,339 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd wget http://10.97.191.187:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:30:24,339 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:30:29,402 - DEBUG - [Pod ctest-pod-77456041] Cmd: wget http://10.97.191.187:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:30:29,402 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd wget http://10.97.191.187:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:30:29,402 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:30:34,464 - DEBUG - [Pod ctest-pod-77456041] Cmd: wget http://10.97.191.187:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:30:34,464 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd wget http://10.97.191.187:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:30:34,464 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:30:39,540 - DEBUG - [Pod ctest-pod-77456041] Cmd: wget http://10.97.191.187:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:30:39,540 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd wget http://10.97.191.187:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:30:39,540 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:30:44,698 - DEBUG - [Pod ctest-pod-77456041] Cmd: wget http://10.97.191.187:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:30:44,698 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd wget http://10.97.191.187:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:30:44,698 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:30:49,774 - DEBUG - [Pod ctest-pod-77456041] Cmd: wget http://10.97.191.187:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:30:49,774 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd wget http://10.97.191.187:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:30:49,774 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:30:54,839 - DEBUG - [Pod ctest-pod-77456041] Cmd: wget http://10.97.191.187:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:30:54,839 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd wget http://10.97.191.187:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:30:54,840 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd output: Connecting to 10.97.191.187:80 (10.97.191.187:80) wget: download timed out 2024-09-18 00:30:54,840 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-89057150': 0, 'ctest-pod-55348754': 0} 2024-09-18 00:30:54,920 - DEBUG - [Pod ctest-pod-65952240] Cmd: wget http://10.97.191.187:80/ -O - -T 5 -t 1 , Output: ctest-pod-55348754 Connecting to 10.97.191.187:80 (10.97.191.187:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 00:30:54,920 - DEBUG - [Pod Pod ctest-pod-65952240] Cmd wget http://10.97.191.187:80/ -O - -T 5 -t 1 passed 2024-09-18 00:30:54,920 - DEBUG - [Pod Pod ctest-pod-65952240] Cmd output: ctest-pod-55348754 Connecting to 10.97.191.187:80 (10.97.191.187:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 00:30:54,985 - DEBUG - [Pod ctest-pod-65952240] Cmd: wget http://10.97.191.187:80/ -O - -T 5 -t 1 , Output: ctest-pod-55348754 Connecting to 10.97.191.187:80 (10.97.191.187:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 00:30:54,985 - DEBUG - [Pod Pod ctest-pod-65952240] Cmd wget http://10.97.191.187:80/ -O - -T 5 -t 1 passed 2024-09-18 00:30:54,985 - DEBUG - [Pod Pod ctest-pod-65952240] Cmd output: ctest-pod-55348754 Connecting to 10.97.191.187:80 (10.97.191.187:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 00:30:55,058 - DEBUG - [Pod ctest-pod-65952240] Cmd: wget http://10.97.191.187:80/ -O - -T 5 -t 1 , Output: ctest-pod-89057150 Connecting to 10.97.191.187:80 (10.97.191.187:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 00:30:55,058 - DEBUG - [Pod Pod ctest-pod-65952240] Cmd wget http://10.97.191.187:80/ -O - -T 5 -t 1 passed 2024-09-18 00:30:55,058 - DEBUG - [Pod Pod ctest-pod-65952240] Cmd output: ctest-pod-89057150 Connecting to 10.97.191.187:80 (10.97.191.187:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 00:30:55,058 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-89057150': 1, 'ctest-pod-55348754': 2} 2024-09-18 00:30:55,140 - DEBUG - [Pod ctest-pod-42489245] Cmd: wget http://10.97.191.187:80/ -O - -T 5 -t 1 , Output: ctest-pod-55348754 Connecting to 10.97.191.187:80 (10.97.191.187:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 00:30:55,140 - DEBUG - [Pod Pod ctest-pod-42489245] Cmd wget http://10.97.191.187:80/ -O - -T 5 -t 1 passed 2024-09-18 00:30:55,140 - DEBUG - [Pod Pod ctest-pod-42489245] Cmd output: ctest-pod-55348754 Connecting to 10.97.191.187:80 (10.97.191.187:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 00:30:55,204 - DEBUG - [Pod ctest-pod-42489245] Cmd: wget http://10.97.191.187:80/ -O - -T 5 -t 1 , Output: ctest-pod-55348754 Connecting to 10.97.191.187:80 (10.97.191.187:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 00:30:55,204 - DEBUG - [Pod Pod ctest-pod-42489245] Cmd wget http://10.97.191.187:80/ -O - -T 5 -t 1 passed 2024-09-18 00:30:55,204 - DEBUG - [Pod Pod ctest-pod-42489245] Cmd output: ctest-pod-55348754 Connecting to 10.97.191.187:80 (10.97.191.187:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 00:30:55,268 - DEBUG - [Pod ctest-pod-42489245] Cmd: wget http://10.97.191.187:80/ -O - -T 5 -t 1 , Output: ctest-pod-89057150 Connecting to 10.97.191.187:80 (10.97.191.187:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 00:30:55,268 - DEBUG - [Pod Pod ctest-pod-42489245] Cmd wget http://10.97.191.187:80/ -O - -T 5 -t 1 passed 2024-09-18 00:30:55,268 - DEBUG - [Pod Pod ctest-pod-42489245] Cmd output: ctest-pod-89057150 Connecting to 10.97.191.187:80 (10.97.191.187:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 00:30:55,268 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-89057150': 1, 'ctest-pod-55348754': 2} 2024-09-18 00:30:57,323 - DEBUG - [Pod ctest-pod-65952240] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.033 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.066 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.081 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.066/0.393/1.033 ms 2024-09-18 00:30:57,323 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-65952240 with expectation True passed 2024-09-18 00:30:59,721 - DEBUG - [Pod ctest-pod-77456041] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.818 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.069 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.058 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.058/0.315/0.818 ms 2024-09-18 00:30:59,721 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-77456041 with expectation True passed 2024-09-18 00:31:01,791 - DEBUG - [Pod ctest-pod-42489245] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.393 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.072 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.074 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.072/0.179/0.393 ms 2024-09-18 00:31:01,791 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-42489245 with expectation True passed 2024-09-18 00:31:01,845 - DEBUG - [Pod ctest-pod-65952240] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 00:31:01,846 - DEBUG - [Pod Pod ctest-pod-65952240] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-18 00:31:01,846 - DEBUG - [Pod Pod ctest-pod-65952240] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 00:31:01,846 - INFO - wget check of of http://10.47.255.251 from ctest-pod-65952240 passed 2024-09-18 00:31:01,897 - DEBUG - [Pod ctest-pod-65952240] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 00:31:01,897 - DEBUG - [Pod Pod ctest-pod-65952240] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-09-18 00:31:01,897 - DEBUG - [Pod Pod ctest-pod-65952240] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 00:31:01,897 - INFO - wget check of of http://10.47.255.250 from ctest-pod-65952240 passed 2024-09-18 00:31:06,963 - DEBUG - [Pod ctest-pod-77456041] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-18 00:31:06,963 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-18 00:31:06,963 - DEBUG - [Pod Pod ctest-pod-77456041] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-18 00:31:06,963 - INFO - wget check of of http://10.47.255.250 from ctest-pod-77456041 passed 2024-09-18 00:31:07,020 - DEBUG - [Pod ctest-pod-89430591] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 00:31:07,020 - DEBUG - [Pod Pod ctest-pod-89430591] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-18 00:31:07,020 - DEBUG - [Pod Pod ctest-pod-89430591] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 00:31:07,020 - INFO - wget check of of http://10.47.255.251 from ctest-pod-89430591 passed 2024-09-18 00:31:07,020 - INFO - Deleting Network Policy : ingress-on-service 2024-09-18 00:31:07,021 - INFO - Deleting service : ctest-nginx-svc-77607619 2024-09-18 00:31:07,205 - DEBUG - No XMPP flaps were noticed during the test 2024-09-18 00:31:07,205 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:06] 2024-09-18 00:31:07,205 - INFO - -------------------------------------------------------------------------------- 2024-09-18 00:31:07,211 - INFO - Deleting pod ctest-new-default-51013264:ctest-pod-89057150 2024-09-18 00:31:07,211 - INFO - Deleting pod ctest-new-default-51013264:ctest-pod-55348754 2024-09-18 00:31:07,212 - INFO - Deleting pod ctest-non-default-29630681:ctest-pod-93908669 2024-09-18 00:31:07,212 - INFO - Deleting pod ctest-non-default-29630681:ctest-pod-84931580 2024-09-18 00:31:07,213 - INFO - Deleting pod ctest-new-default-51013264:ctest-pod-77456041 2024-09-18 00:31:07,213 - INFO - Deleting pod ctest-new-default-51013264:ctest-pod-65952240 2024-09-18 00:31:07,213 - INFO - Deleting pod ctest-non-default-29630681:ctest-pod-42489245 2024-09-18 00:31:07,214 - INFO - Deleting pod ctest-non-default-29630681:ctest-pod-89430591 2024-09-18 00:31:07,416 - WARNING - Pod uuid 4c6f8ff7-8e2a-47e2-ae8b-21bc8a287d8a is still seen in agent 10.0.0.24 VM list 2024-09-18 00:31:07,416 - WARNING - Pod uuid 54652f87-07c8-463c-a2ee-72a819f8b07d is still seen in agent 10.0.0.24 VM list 2024-09-18 00:31:07,417 - WARNING - Pod uuid 9f1c7fe1-0a42-4adf-9b61-124cf0bf653c is still seen in agent 10.0.0.24 VM list 2024-09-18 00:31:07,418 - WARNING - Pod uuid bdbca4fa-1f21-4b7f-ade0-75a5325bf762 is still seen in agent 10.0.0.24 VM list 2024-09-18 00:31:07,418 - WARNING - Pod uuid 4c6ed4e0-b9c2-4228-b6ef-b6f187cb0148 is still seen in agent 10.0.0.24 VM list 2024-09-18 00:31:07,418 - WARNING - Pod uuid 5f4900bb-6b01-4ae9-a5b6-ba7a7f3aeafa is still seen in agent 10.0.0.24 VM list 2024-09-18 00:31:07,419 - WARNING - Pod uuid e4549221-49c4-4eb8-b811-10a06f0a7f63 is still seen in agent 10.0.0.24 VM list 2024-09-18 00:31:07,419 - WARNING - Pod uuid 835391c6-1ebe-4d2d-8d6f-71b2c2b4ebc7 is still seen in agent 10.0.0.24 VM list 2024-09-18 00:31:12,456 - WARNING - Pod uuid e4549221-49c4-4eb8-b811-10a06f0a7f63 is still seen in agent 10.0.0.24 VM list 2024-09-18 00:31:12,456 - DEBUG - Pod 54652f87-07c8-463c-a2ee-72a819f8b07d is not in agent 10.0.0.24 VM list 2024-09-18 00:31:12,458 - DEBUG - Pod 4c6f8ff7-8e2a-47e2-ae8b-21bc8a287d8a is not in agent 10.0.0.24 VM list 2024-09-18 00:31:12,459 - DEBUG - Pod bdbca4fa-1f21-4b7f-ade0-75a5325bf762 is not in agent 10.0.0.24 VM list 2024-09-18 00:31:12,460 - DEBUG - Pod 9f1c7fe1-0a42-4adf-9b61-124cf0bf653c is not in agent 10.0.0.24 VM list 2024-09-18 00:31:12,462 - WARNING - Pod uuid 835391c6-1ebe-4d2d-8d6f-71b2c2b4ebc7 is still seen in agent 10.0.0.24 VM list 2024-09-18 00:31:12,465 - WARNING - Pod uuid 5f4900bb-6b01-4ae9-a5b6-ba7a7f3aeafa is still seen in agent 10.0.0.24 VM list 2024-09-18 00:31:12,466 - WARNING - Pod uuid 4c6ed4e0-b9c2-4228-b6ef-b6f187cb0148 is still seen in agent 10.0.0.24 VM list 2024-09-18 00:31:12,485 - DEBUG - VMI d0fd79b6-7554-11ef-9794-fa163eb4d31d is removed from agent 10.0.0.24 2024-09-18 00:31:12,485 - INFO - Verified that pod ctest-pod-89057150 is removed in agent 2024-09-18 00:31:12,486 - DEBUG - VMI d16bf210-7554-11ef-9794-fa163eb4d31d is removed from agent 10.0.0.24 2024-09-18 00:31:12,486 - INFO - Verified that pod ctest-pod-55348754 is removed in agent 2024-09-18 00:31:12,487 - DEBUG - VMI d2a96e5a-7554-11ef-9794-fa163eb4d31d is removed from agent 10.0.0.24 2024-09-18 00:31:12,487 - INFO - Verified that pod ctest-pod-84931580 is removed in agent 2024-09-18 00:31:12,488 - DEBUG - VMI d21b5d7c-7554-11ef-9794-fa163eb4d31d is removed from agent 10.0.0.24 2024-09-18 00:31:12,488 - INFO - Verified that pod ctest-pod-93908669 is removed in agent 2024-09-18 00:31:17,465 - WARNING - Pod uuid e4549221-49c4-4eb8-b811-10a06f0a7f63 is still seen in agent 10.0.0.24 VM list 2024-09-18 00:31:17,470 - WARNING - Pod uuid 835391c6-1ebe-4d2d-8d6f-71b2c2b4ebc7 is still seen in agent 10.0.0.24 VM list 2024-09-18 00:31:17,479 - WARNING - Pod uuid 5f4900bb-6b01-4ae9-a5b6-ba7a7f3aeafa is still seen in agent 10.0.0.24 VM list 2024-09-18 00:31:17,479 - WARNING - Pod uuid 4c6ed4e0-b9c2-4228-b6ef-b6f187cb0148 is still seen in agent 10.0.0.24 VM list 2024-09-18 00:31:22,473 - WARNING - Pod uuid e4549221-49c4-4eb8-b811-10a06f0a7f63 is still seen in agent 10.0.0.24 VM list 2024-09-18 00:31:22,477 - WARNING - Pod uuid 835391c6-1ebe-4d2d-8d6f-71b2c2b4ebc7 is still seen in agent 10.0.0.24 VM list 2024-09-18 00:31:22,496 - WARNING - Pod uuid 5f4900bb-6b01-4ae9-a5b6-ba7a7f3aeafa is still seen in agent 10.0.0.24 VM list 2024-09-18 00:31:22,497 - WARNING - Pod uuid 4c6ed4e0-b9c2-4228-b6ef-b6f187cb0148 is still seen in agent 10.0.0.24 VM list 2024-09-18 00:31:27,484 - WARNING - Pod uuid e4549221-49c4-4eb8-b811-10a06f0a7f63 is still seen in agent 10.0.0.24 VM list 2024-09-18 00:31:27,485 - WARNING - Pod uuid 835391c6-1ebe-4d2d-8d6f-71b2c2b4ebc7 is still seen in agent 10.0.0.24 VM list 2024-09-18 00:31:27,507 - WARNING - Pod uuid 5f4900bb-6b01-4ae9-a5b6-ba7a7f3aeafa is still seen in agent 10.0.0.24 VM list 2024-09-18 00:31:27,508 - WARNING - Pod uuid 4c6ed4e0-b9c2-4228-b6ef-b6f187cb0148 is still seen in agent 10.0.0.24 VM list 2024-09-18 00:31:32,496 - WARNING - Pod uuid 835391c6-1ebe-4d2d-8d6f-71b2c2b4ebc7 is still seen in agent 10.0.0.24 VM list 2024-09-18 00:31:32,496 - WARNING - Pod uuid e4549221-49c4-4eb8-b811-10a06f0a7f63 is still seen in agent 10.0.0.24 VM list 2024-09-18 00:31:32,518 - WARNING - Pod uuid 5f4900bb-6b01-4ae9-a5b6-ba7a7f3aeafa is still seen in agent 10.0.0.24 VM list 2024-09-18 00:31:32,518 - WARNING - Pod uuid 4c6ed4e0-b9c2-4228-b6ef-b6f187cb0148 is still seen in agent 10.0.0.24 VM list 2024-09-18 00:31:37,602 - WARNING - Pod uuid e4549221-49c4-4eb8-b811-10a06f0a7f63 is still seen in agent 10.0.0.24 VM list 2024-09-18 00:31:37,604 - WARNING - Pod uuid 4c6ed4e0-b9c2-4228-b6ef-b6f187cb0148 is still seen in agent 10.0.0.24 VM list 2024-09-18 00:31:37,604 - WARNING - Pod uuid 835391c6-1ebe-4d2d-8d6f-71b2c2b4ebc7 is still seen in agent 10.0.0.24 VM list 2024-09-18 00:31:37,604 - WARNING - Pod uuid 5f4900bb-6b01-4ae9-a5b6-ba7a7f3aeafa is still seen in agent 10.0.0.24 VM list 2024-09-18 00:31:42,623 - DEBUG - Pod e4549221-49c4-4eb8-b811-10a06f0a7f63 is not in agent 10.0.0.24 VM list 2024-09-18 00:31:42,627 - DEBUG - Pod 5f4900bb-6b01-4ae9-a5b6-ba7a7f3aeafa is not in agent 10.0.0.24 VM list 2024-09-18 00:31:42,628 - DEBUG - Pod 4c6ed4e0-b9c2-4228-b6ef-b6f187cb0148 is not in agent 10.0.0.24 VM list 2024-09-18 00:31:42,630 - DEBUG - Pod 835391c6-1ebe-4d2d-8d6f-71b2c2b4ebc7 is not in agent 10.0.0.24 VM list 2024-09-18 00:31:42,646 - DEBUG - VMI d4af4602-7554-11ef-9794-fa163eb4d31d is removed from agent 10.0.0.24 2024-09-18 00:31:42,646 - INFO - Verified that pod ctest-pod-89430591 is removed in agent 2024-09-18 00:31:42,648 - DEBUG - VMI d341afda-7554-11ef-9794-fa163eb4d31d is removed from agent 10.0.0.24 2024-09-18 00:31:42,648 - INFO - Verified that pod ctest-pod-77456041 is removed in agent 2024-09-18 00:31:42,648 - DEBUG - VMI d4366ab6-7554-11ef-9794-fa163eb4d31d is removed from agent 10.0.0.24 2024-09-18 00:31:42,648 - INFO - Verified that pod ctest-pod-42489245 is removed in agent 2024-09-18 00:31:42,648 - DEBUG - VMI d3bfc820-7554-11ef-9794-fa163eb4d31d is removed from agent 10.0.0.24 2024-09-18 00:31:42,648 - INFO - Verified that pod ctest-pod-65952240 is removed in agent 2024-09-18 00:31:42,649 - INFO - Deleting namespace ctest-non-default-29630681 2024-09-18 00:31:42,669 - DEBUG - Namespace ctest-non-default-29630681 still in k8s 2024-09-18 00:31:44,675 - DEBUG - Namespace ctest-non-default-29630681 still in k8s 2024-09-18 00:31:46,679 - DEBUG - Namespace ctest-non-default-29630681 still in k8s 2024-09-18 00:31:48,682 - DEBUG - Namespace ctest-non-default-29630681 is not in k8s 2024-09-18 00:31:48,683 - DEBUG - No need to check project deletion in contrail-api 2024-09-18 00:31:48,683 - INFO - Deleting namespace ctest-new-default-51013264 2024-09-18 00:31:48,695 - DEBUG - Namespace ctest-new-default-51013264 still in k8s 2024-09-18 00:31:50,700 - DEBUG - Namespace ctest-new-default-51013264 still in k8s 2024-09-18 00:31:52,704 - DEBUG - Namespace ctest-new-default-51013264 still in k8s 2024-09-18 00:31:54,707 - DEBUG - Namespace ctest-new-default-51013264 is not in k8s 2024-09-18 00:31:54,707 - DEBUG - No need to check project deletion in contrail-api