2024-11-14 22:36:47,479 - INFO - Using existing project ['default-domain', 'k8s-default'](7439accb-db5e-4680-ba9c-d6c84f452984) 2024-11-14 22:36:47,501 - DEBUG - Namespace ctest-new-default-03020182 not present 2024-11-14 22:36:47,510 - INFO - Created namespace ctest-new-default-03020182 2024-11-14 22:36:50,515 - DEBUG - Namespace ctest-non-default-33208457 not present 2024-11-14 22:36:50,522 - INFO - Created namespace ctest-non-default-33208457 2024-11-14 22:36:53,538 - DEBUG - Pod ctest-pod-34215170 not present 2024-11-14 22:36:53,539 - INFO - Creating Pod ctest-pod-34215170 2024-11-14 22:36:53,563 - DEBUG - Pod : ctest-pod-34215170 UUID is a2954613-9c3a-4eee-88fa-2c3e22938596 2024-11-14 22:36:53,570 - DEBUG - Pod ctest-pod-39706584 not present 2024-11-14 22:36:53,570 - INFO - Creating Pod ctest-pod-39706584 2024-11-14 22:36:53,608 - DEBUG - Pod : ctest-pod-39706584 UUID is dd272af5-8de7-437c-9a7c-35f9196179bd 2024-11-14 22:36:53,611 - DEBUG - Pod ctest-pod-05862742 not present 2024-11-14 22:36:53,611 - INFO - Creating Pod ctest-pod-05862742 2024-11-14 22:36:53,670 - DEBUG - Pod : ctest-pod-05862742 UUID is 2573e22a-c49b-4a78-a8f4-6f6aaef4db42 2024-11-14 22:36:53,678 - DEBUG - Pod ctest-pod-47883358 not present 2024-11-14 22:36:53,679 - INFO - Creating Pod ctest-pod-47883358 2024-11-14 22:36:53,719 - DEBUG - Pod : ctest-pod-47883358 UUID is 94ff5941-f631-44b2-9b14-8d56333a5247 2024-11-14 22:36:53,725 - DEBUG - Pod ctest-pod-35545312 not present 2024-11-14 22:36:53,725 - INFO - Creating Pod ctest-pod-35545312 2024-11-14 22:36:53,743 - DEBUG - Pod : ctest-pod-35545312 UUID is 29f57fe8-7002-4bd6-a449-0ac7f642624b 2024-11-14 22:36:53,746 - DEBUG - Pod ctest-pod-63006165 not present 2024-11-14 22:36:53,746 - INFO - Creating Pod ctest-pod-63006165 2024-11-14 22:36:53,772 - DEBUG - Pod : ctest-pod-63006165 UUID is d536da0e-43a6-4469-87f7-944c644543a9 2024-11-14 22:36:53,777 - DEBUG - Pod ctest-pod-39928722 not present 2024-11-14 22:36:53,778 - INFO - Creating Pod ctest-pod-39928722 2024-11-14 22:36:53,797 - DEBUG - Pod : ctest-pod-39928722 UUID is 9850729a-10ad-4e1b-85e7-4ea522ae042b 2024-11-14 22:36:53,802 - DEBUG - Pod ctest-pod-76692773 not present 2024-11-14 22:36:53,802 - INFO - Creating Pod ctest-pod-76692773 2024-11-14 22:36:53,821 - DEBUG - Pod : ctest-pod-76692773 UUID is f35d0e8e-7e8f-4a42-a4be-e186d0eebf84 2024-11-14 22:36:54,004 - INFO - Project default-domain:k8s-ctest-new-default-03020182 for Namespace ctest-new-default-03020182 is seen in contrail-api 2024-11-14 22:36:54,004 - DEBUG - Project uuid in Contrail is d3a25879-b9f3-4ded-8fbc-870dfd76d4da 2024-11-14 22:36:54,132 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_NamespaceDatabaseList?namespace_uuid=e2022664-bf26-4285-a2b9-fda320eee5b8 2024-11-14 22:36:54,137 - INFO - Namespace ctest-new-default-03020182 with uuid e2022664-bf26-4285-a2b9-fda320eee5b8 found in kube manager 2024-11-14 22:36:54,137 - INFO - Namespace ctest-new-default-03020182 verification passed 2024-11-14 22:36:54,388 - INFO - Project default-domain:k8s-ctest-non-default-33208457 for Namespace ctest-non-default-33208457 is seen in contrail-api 2024-11-14 22:36:54,388 - DEBUG - Project uuid in Contrail is 40165261-9217-48af-80ad-e40b9df60b08 2024-11-14 22:36:54,389 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_NamespaceDatabaseList?namespace_uuid=a017e293-74e3-4899-93ee-9f14182fcd92 2024-11-14 22:36:54,393 - INFO - Namespace ctest-non-default-33208457 with uuid a017e293-74e3-4899-93ee-9f14182fcd92 found in kube manager 2024-11-14 22:36:54,393 - INFO - Namespace ctest-non-default-33208457 verification passed 2024-11-14 22:36:54,399 - DEBUG - Pod ctest-pod-34215170 not in running state.Currently in Pending 2024-11-14 22:36:59,406 - DEBUG - Pod ctest-pod-34215170 not in running state.Currently in Pending 2024-11-14 22:37:04,413 - INFO - Pod ctest-pod-34215170 is in running state.Got IP 10.47.255.251 2024-11-14 22:37:04,473 - DEBUG - Pod ctest-pod-34215170 has vmi f39c08a0-a2d8-11ef-95e5-fa163e7ec7f4 2024-11-14 22:37:04,473 - INFO - Verified pod ctest-pod-34215170 in contrail-api 2024-11-14 22:37:04,487 - DEBUG - VMI f39c08a0-a2d8-11ef-95e5-fa163e7ec7f4 is active in agent 10.0.0.42 2024-11-14 22:37:04,487 - INFO - Verified Pod ctest-pod-34215170 in agent 10.0.0.42 2024-11-14 22:37:04,487 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_VirtualMachineDatabaseList?x=a2954613-9c3a-4eee-88fa-2c3e22938596 2024-11-14 22:37:04,492 - INFO - Pod ctest-pod-34215170 with uuid a2954613-9c3a-4eee-88fa-2c3e22938596 found in kube manager 2024-11-14 22:37:04,492 - INFO - Pod ctest-pod-34215170 verification passed 2024-11-14 22:37:04,497 - DEBUG - Pod ctest-pod-39706584 not in running state.Currently in Pending 2024-11-14 22:37:09,504 - INFO - Pod ctest-pod-39706584 is in running state.Got IP 10.47.255.250 2024-11-14 22:37:09,523 - DEBUG - Pod ctest-pod-39706584 has vmi f421fa6e-a2d8-11ef-95e5-fa163e7ec7f4 2024-11-14 22:37:09,523 - INFO - Verified pod ctest-pod-39706584 in contrail-api 2024-11-14 22:37:09,539 - DEBUG - VMI f421fa6e-a2d8-11ef-95e5-fa163e7ec7f4 is active in agent 10.0.0.42 2024-11-14 22:37:09,539 - INFO - Verified Pod ctest-pod-39706584 in agent 10.0.0.42 2024-11-14 22:37:09,539 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_VirtualMachineDatabaseList?x=dd272af5-8de7-437c-9a7c-35f9196179bd 2024-11-14 22:37:09,544 - INFO - Pod ctest-pod-39706584 with uuid dd272af5-8de7-437c-9a7c-35f9196179bd found in kube manager 2024-11-14 22:37:09,544 - INFO - Pod ctest-pod-39706584 verification passed 2024-11-14 22:37:09,551 - INFO - Pod ctest-pod-05862742 is in running state.Got IP 10.47.255.249 2024-11-14 22:37:09,613 - DEBUG - Pod ctest-pod-05862742 has vmi f4d5420e-a2d8-11ef-95e5-fa163e7ec7f4 2024-11-14 22:37:09,613 - INFO - Verified pod ctest-pod-05862742 in contrail-api 2024-11-14 22:37:09,629 - DEBUG - VMI f4d5420e-a2d8-11ef-95e5-fa163e7ec7f4 is active in agent 10.0.0.42 2024-11-14 22:37:09,629 - INFO - Verified Pod ctest-pod-05862742 in agent 10.0.0.42 2024-11-14 22:37:09,630 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_VirtualMachineDatabaseList?x=2573e22a-c49b-4a78-a8f4-6f6aaef4db42 2024-11-14 22:37:09,634 - INFO - Pod ctest-pod-05862742 with uuid 2573e22a-c49b-4a78-a8f4-6f6aaef4db42 found in kube manager 2024-11-14 22:37:09,634 - INFO - Pod ctest-pod-05862742 verification passed 2024-11-14 22:37:09,641 - INFO - Pod ctest-pod-47883358 is in running state.Got IP 10.47.255.248 2024-11-14 22:37:09,659 - DEBUG - Pod ctest-pod-47883358 has vmi f567914a-a2d8-11ef-95e5-fa163e7ec7f4 2024-11-14 22:37:09,659 - INFO - Verified pod ctest-pod-47883358 in contrail-api 2024-11-14 22:37:09,674 - DEBUG - VMI f567914a-a2d8-11ef-95e5-fa163e7ec7f4 is active in agent 10.0.0.42 2024-11-14 22:37:09,675 - INFO - Verified Pod ctest-pod-47883358 in agent 10.0.0.42 2024-11-14 22:37:09,675 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_VirtualMachineDatabaseList?x=94ff5941-f631-44b2-9b14-8d56333a5247 2024-11-14 22:37:09,679 - INFO - Pod ctest-pod-47883358 with uuid 94ff5941-f631-44b2-9b14-8d56333a5247 found in kube manager 2024-11-14 22:37:09,679 - INFO - Pod ctest-pod-47883358 verification passed 2024-11-14 22:37:09,684 - DEBUG - Pod ctest-pod-35545312 not in running state.Currently in Pending 2024-11-14 22:37:14,690 - INFO - Pod ctest-pod-35545312 is in running state.Got IP 10.47.255.247 2024-11-14 22:37:14,749 - DEBUG - Pod ctest-pod-35545312 has vmi f60220e8-a2d8-11ef-95e5-fa163e7ec7f4 2024-11-14 22:37:14,749 - INFO - Verified pod ctest-pod-35545312 in contrail-api 2024-11-14 22:37:14,764 - DEBUG - VMI f60220e8-a2d8-11ef-95e5-fa163e7ec7f4 is active in agent 10.0.0.42 2024-11-14 22:37:14,765 - INFO - Verified Pod ctest-pod-35545312 in agent 10.0.0.42 2024-11-14 22:37:14,765 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_VirtualMachineDatabaseList?x=29f57fe8-7002-4bd6-a449-0ac7f642624b 2024-11-14 22:37:14,769 - INFO - Pod ctest-pod-35545312 with uuid 29f57fe8-7002-4bd6-a449-0ac7f642624b found in kube manager 2024-11-14 22:37:14,770 - INFO - Pod ctest-pod-35545312 verification passed 2024-11-14 22:37:14,775 - INFO - Pod ctest-pod-39928722 is in running state.Got IP 10.47.255.245 2024-11-14 22:37:14,794 - DEBUG - Pod ctest-pod-39928722 has vmi f6fe31f8-a2d8-11ef-95e5-fa163e7ec7f4 2024-11-14 22:37:14,794 - INFO - Verified pod ctest-pod-39928722 in contrail-api 2024-11-14 22:37:14,809 - DEBUG - VMI f6fe31f8-a2d8-11ef-95e5-fa163e7ec7f4 is active in agent 10.0.0.42 2024-11-14 22:37:14,810 - INFO - Verified Pod ctest-pod-39928722 in agent 10.0.0.42 2024-11-14 22:37:14,810 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_VirtualMachineDatabaseList?x=9850729a-10ad-4e1b-85e7-4ea522ae042b 2024-11-14 22:37:14,814 - INFO - Pod ctest-pod-39928722 with uuid 9850729a-10ad-4e1b-85e7-4ea522ae042b found in kube manager 2024-11-14 22:37:14,814 - INFO - Pod ctest-pod-39928722 verification passed 2024-11-14 22:37:14,820 - INFO - Pod ctest-pod-63006165 is in running state.Got IP 10.47.255.246 2024-11-14 22:37:14,880 - DEBUG - Pod ctest-pod-63006165 has vmi f67cbd30-a2d8-11ef-95e5-fa163e7ec7f4 2024-11-14 22:37:14,880 - INFO - Verified pod ctest-pod-63006165 in contrail-api 2024-11-14 22:37:14,896 - DEBUG - VMI f67cbd30-a2d8-11ef-95e5-fa163e7ec7f4 is active in agent 10.0.0.42 2024-11-14 22:37:14,896 - INFO - Verified Pod ctest-pod-63006165 in agent 10.0.0.42 2024-11-14 22:37:14,896 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_VirtualMachineDatabaseList?x=d536da0e-43a6-4469-87f7-944c644543a9 2024-11-14 22:37:14,901 - INFO - Pod ctest-pod-63006165 with uuid d536da0e-43a6-4469-87f7-944c644543a9 found in kube manager 2024-11-14 22:37:14,901 - INFO - Pod ctest-pod-63006165 verification passed 2024-11-14 22:37:14,910 - INFO - Pod ctest-pod-76692773 is in running state.Got IP 10.47.255.244 2024-11-14 22:37:14,981 - DEBUG - Pod ctest-pod-76692773 has vmi f77db59a-a2d8-11ef-95e5-fa163e7ec7f4 2024-11-14 22:37:14,981 - INFO - Verified pod ctest-pod-76692773 in contrail-api 2024-11-14 22:37:14,996 - DEBUG - VMI f77db59a-a2d8-11ef-95e5-fa163e7ec7f4 is active in agent 10.0.0.42 2024-11-14 22:37:14,997 - INFO - Verified Pod ctest-pod-76692773 in agent 10.0.0.42 2024-11-14 22:37:14,997 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_VirtualMachineDatabaseList?x=f35d0e8e-7e8f-4a42-a4be-e186d0eebf84 2024-11-14 22:37:15,002 - INFO - Pod ctest-pod-76692773 with uuid f35d0e8e-7e8f-4a42-a4be-e186d0eebf84 found in kube manager 2024-11-14 22:37:15,002 - INFO - Pod ctest-pod-76692773 verification passed 2024-11-14 22:37:15,002 - INFO - ================================================================================ 2024-11-14 22:37:15,002 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-11-14 22:37:15,002 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-11-14 22:37:15,280 - DEBUG - Nothing to compare xmpp stats {'10.0.0.42': {'10.0.0.17': '0'}} with 2024-11-14 22:37:15,280 - INFO - Initial checks done. Running the testcase now 2024-11-14 22:37:15,280 - INFO - 2024-11-14 22:37:15,354 - DEBUG - [Pod ctest-pod-34215170] Cmd: echo ctest-pod-34215170 > /usr/share/nginx/html/index.html, Output: 2024-11-14 22:37:15,429 - DEBUG - [Pod ctest-pod-39706584] Cmd: echo ctest-pod-39706584 > /usr/share/nginx/html/index.html, Output: 2024-11-14 22:37:15,501 - DEBUG - [Pod ctest-pod-05862742] Cmd: echo ctest-pod-05862742 > /usr/share/nginx/html/index.html, Output: 2024-11-14 22:37:15,567 - DEBUG - [Pod ctest-pod-47883358] Cmd: echo ctest-pod-47883358 > /usr/share/nginx/html/index.html, Output: 2024-11-14 22:37:15,570 - DEBUG - Service ctest-nginx-svc-03279958 not present 2024-11-14 22:37:15,571 - INFO - Creating service ctest-nginx-svc-03279958 2024-11-14 22:37:15,616 - INFO - Created Service ctest-nginx-svc-03279958 2024-11-14 22:37:15,628 - WARNING - Service UUID 6cc656be-935a-4c03-ad9c-800d85769089 not yet found in contrail-api 2024-11-14 22:37:16,644 - INFO - Validated that Service ctest-nginx-svc-03279958 is seen in contrail-api 2024-11-14 22:37:16,644 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_LoadbalancerDatabaseList?x=6cc656be-935a-4c03-ad9c-800d85769089 2024-11-14 22:37:16,651 - INFO - Service ctest-nginx-svc-03279958 with uuid 6cc656be-935a-4c03-ad9c-800d85769089 found in kube manager 2024-11-14 22:37:16,652 - INFO - Service ctest-nginx-svc-03279958 verification passed 2024-11-14 22:37:17,744 - DEBUG - [Pod ctest-pod-35545312] Cmd: wget http://10.99.255.27:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.255.27:80 (10.99.255.27:80) ctest-pod-39706584 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-14 22:37:17,744 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd wget http://10.99.255.27:80/ -O - -T 5 -t 1 passed 2024-11-14 22:37:17,744 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd output: Connecting to 10.99.255.27:80 (10.99.255.27:80) ctest-pod-39706584 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-14 22:37:17,815 - DEBUG - [Pod ctest-pod-35545312] Cmd: wget http://10.99.255.27:80/ -O - -T 5 -t 1 , Output: ctest-pod-34215170 Connecting to 10.99.255.27:80 (10.99.255.27:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-14 22:37:17,815 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd wget http://10.99.255.27:80/ -O - -T 5 -t 1 passed 2024-11-14 22:37:17,815 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd output: ctest-pod-34215170 Connecting to 10.99.255.27:80 (10.99.255.27:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-14 22:37:17,815 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-34215170': 1, 'ctest-pod-39706584': 1} 2024-11-14 22:37:17,885 - DEBUG - [Pod ctest-pod-39928722] Cmd: wget http://10.99.255.27:80/ -O - -T 5 -t 1 , Output: ctest-pod-34215170 Connecting to 10.99.255.27:80 (10.99.255.27:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-14 22:37:17,885 - DEBUG - [Pod Pod ctest-pod-39928722] Cmd wget http://10.99.255.27:80/ -O - -T 5 -t 1 passed 2024-11-14 22:37:17,885 - DEBUG - [Pod Pod ctest-pod-39928722] Cmd output: ctest-pod-34215170 Connecting to 10.99.255.27:80 (10.99.255.27:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-14 22:37:17,943 - DEBUG - [Pod ctest-pod-39928722] Cmd: wget http://10.99.255.27:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.255.27:80 (10.99.255.27:80) ctest-pod-39706584 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-14 22:37:17,943 - DEBUG - [Pod Pod ctest-pod-39928722] Cmd wget http://10.99.255.27:80/ -O - -T 5 -t 1 passed 2024-11-14 22:37:17,943 - DEBUG - [Pod Pod ctest-pod-39928722] Cmd output: Connecting to 10.99.255.27:80 (10.99.255.27:80) ctest-pod-39706584 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-14 22:37:17,943 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-34215170': 1, 'ctest-pod-39706584': 1} 2024-11-14 22:37:17,946 - DEBUG - Network policy ingress-on-service not present 2024-11-14 22:37:17,948 - INFO - Creating Network Policy ingress-on-service 2024-11-14 22:37:17,959 - INFO - Network policy found in k8s 2024-11-14 22:37:17,959 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=fc6a33b3-d4bc-4a13-91cb-11d6a8d93af2 2024-11-14 22:37:17,965 - INFO - Network Policy ingress-on-service with uuid fc6a33b3-d4bc-4a13-91cb-11d6a8d93af2 found in kube manager 2024-11-14 22:37:18,000 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-11-14 22:37:18,001 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-11-14 22:37:18,001 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=fc6a33b3-d4bc-4a13-91cb-11d6a8d93af2 2024-11-14 22:37:18,053 - WARNING - Network policy with name ingress-on-service not found in agent 2024-11-14 22:37:20,054 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=fc6a33b3-d4bc-4a13-91cb-11d6a8d93af2 2024-11-14 22:37:20,094 - INFO - Network policy with name ingress-on-service found in agent 2024-11-14 22:37:20,095 - INFO - Network Policy ingress-on-service verification passed 2024-11-14 22:37:25,171 - DEBUG - [Pod ctest-pod-35545312] Cmd: wget http://10.99.255.27:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:37:25,171 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd wget http://10.99.255.27:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:37:25,171 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:37:30,237 - DEBUG - [Pod ctest-pod-35545312] Cmd: wget http://10.99.255.27:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:37:30,237 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd wget http://10.99.255.27:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:37:30,237 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:37:35,297 - DEBUG - [Pod ctest-pod-35545312] Cmd: wget http://10.99.255.27:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:37:35,297 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd wget http://10.99.255.27:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:37:35,297 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:37:40,360 - DEBUG - [Pod ctest-pod-35545312] Cmd: wget http://10.99.255.27:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:37:40,360 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd wget http://10.99.255.27:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:37:40,360 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:37:45,426 - DEBUG - [Pod ctest-pod-35545312] Cmd: wget http://10.99.255.27:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:37:45,426 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd wget http://10.99.255.27:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:37:45,426 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:37:50,497 - DEBUG - [Pod ctest-pod-35545312] Cmd: wget http://10.99.255.27:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:37:50,497 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd wget http://10.99.255.27:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:37:50,497 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:37:55,561 - DEBUG - [Pod ctest-pod-35545312] Cmd: wget http://10.99.255.27:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:37:55,561 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd wget http://10.99.255.27:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:37:55,561 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:38:00,616 - DEBUG - [Pod ctest-pod-35545312] Cmd: wget http://10.99.255.27:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:38:00,616 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd wget http://10.99.255.27:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:38:00,616 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:38:05,680 - DEBUG - [Pod ctest-pod-35545312] Cmd: wget http://10.99.255.27:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:38:05,681 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd wget http://10.99.255.27:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:38:05,681 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:38:10,737 - DEBUG - [Pod ctest-pod-35545312] Cmd: wget http://10.99.255.27:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:38:10,738 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd wget http://10.99.255.27:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:38:10,738 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:38:10,738 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-34215170': 0, 'ctest-pod-39706584': 0} 2024-11-14 22:38:10,801 - DEBUG - [Pod ctest-pod-63006165] Cmd: wget http://10.99.255.27:80/ -O - -T 5 -t 1 , Output: ctest-pod-34215170 Connecting to 10.99.255.27:80 (10.99.255.27:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-14 22:38:10,802 - DEBUG - [Pod Pod ctest-pod-63006165] Cmd wget http://10.99.255.27:80/ -O - -T 5 -t 1 passed 2024-11-14 22:38:10,802 - DEBUG - [Pod Pod ctest-pod-63006165] Cmd output: ctest-pod-34215170 Connecting to 10.99.255.27:80 (10.99.255.27:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-14 22:38:10,877 - DEBUG - [Pod ctest-pod-63006165] Cmd: wget http://10.99.255.27:80/ -O - -T 5 -t 1 , Output: ctest-pod-34215170 Connecting to 10.99.255.27:80 (10.99.255.27:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-14 22:38:10,878 - DEBUG - [Pod Pod ctest-pod-63006165] Cmd wget http://10.99.255.27:80/ -O - -T 5 -t 1 passed 2024-11-14 22:38:10,878 - DEBUG - [Pod Pod ctest-pod-63006165] Cmd output: ctest-pod-34215170 Connecting to 10.99.255.27:80 (10.99.255.27:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-14 22:38:10,938 - DEBUG - [Pod ctest-pod-63006165] Cmd: wget http://10.99.255.27:80/ -O - -T 5 -t 1 , Output: ctest-pod-39706584 Connecting to 10.99.255.27:80 (10.99.255.27:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-14 22:38:10,938 - DEBUG - [Pod Pod ctest-pod-63006165] Cmd wget http://10.99.255.27:80/ -O - -T 5 -t 1 passed 2024-11-14 22:38:10,938 - DEBUG - [Pod Pod ctest-pod-63006165] Cmd output: ctest-pod-39706584 Connecting to 10.99.255.27:80 (10.99.255.27:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-14 22:38:10,939 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-34215170': 2, 'ctest-pod-39706584': 1} 2024-11-14 22:38:16,007 - DEBUG - [Pod ctest-pod-39928722] Cmd: wget http://10.99.255.27:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:38:16,008 - DEBUG - [Pod Pod ctest-pod-39928722] Cmd wget http://10.99.255.27:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:38:16,008 - DEBUG - [Pod Pod ctest-pod-39928722] Cmd output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:38:21,080 - DEBUG - [Pod ctest-pod-39928722] Cmd: wget http://10.99.255.27:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:38:21,080 - DEBUG - [Pod Pod ctest-pod-39928722] Cmd wget http://10.99.255.27:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:38:21,080 - DEBUG - [Pod Pod ctest-pod-39928722] Cmd output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:38:26,140 - DEBUG - [Pod ctest-pod-39928722] Cmd: wget http://10.99.255.27:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:38:26,140 - DEBUG - [Pod Pod ctest-pod-39928722] Cmd wget http://10.99.255.27:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:38:26,140 - DEBUG - [Pod Pod ctest-pod-39928722] Cmd output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:38:31,197 - DEBUG - [Pod ctest-pod-39928722] Cmd: wget http://10.99.255.27:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:38:31,197 - DEBUG - [Pod Pod ctest-pod-39928722] Cmd wget http://10.99.255.27:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:38:31,197 - DEBUG - [Pod Pod ctest-pod-39928722] Cmd output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:38:36,265 - DEBUG - [Pod ctest-pod-39928722] Cmd: wget http://10.99.255.27:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:38:36,265 - DEBUG - [Pod Pod ctest-pod-39928722] Cmd wget http://10.99.255.27:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:38:36,265 - DEBUG - [Pod Pod ctest-pod-39928722] Cmd output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:38:41,340 - DEBUG - [Pod ctest-pod-39928722] Cmd: wget http://10.99.255.27:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:38:41,340 - DEBUG - [Pod Pod ctest-pod-39928722] Cmd wget http://10.99.255.27:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:38:41,340 - DEBUG - [Pod Pod ctest-pod-39928722] Cmd output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:38:46,413 - DEBUG - [Pod ctest-pod-39928722] Cmd: wget http://10.99.255.27:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:38:46,413 - DEBUG - [Pod Pod ctest-pod-39928722] Cmd wget http://10.99.255.27:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:38:46,413 - DEBUG - [Pod Pod ctest-pod-39928722] Cmd output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:38:51,472 - DEBUG - [Pod ctest-pod-39928722] Cmd: wget http://10.99.255.27:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:38:51,473 - DEBUG - [Pod Pod ctest-pod-39928722] Cmd wget http://10.99.255.27:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:38:51,473 - DEBUG - [Pod Pod ctest-pod-39928722] Cmd output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:38:56,540 - DEBUG - [Pod ctest-pod-39928722] Cmd: wget http://10.99.255.27:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:38:56,540 - DEBUG - [Pod Pod ctest-pod-39928722] Cmd wget http://10.99.255.27:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:38:56,541 - DEBUG - [Pod Pod ctest-pod-39928722] Cmd output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:39:01,608 - DEBUG - [Pod ctest-pod-39928722] Cmd: wget http://10.99.255.27:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:39:01,608 - DEBUG - [Pod Pod ctest-pod-39928722] Cmd wget http://10.99.255.27:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:39:01,608 - DEBUG - [Pod Pod ctest-pod-39928722] Cmd output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:39:01,608 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-34215170': 0, 'ctest-pod-39706584': 0} 2024-11-14 22:39:03,678 - DEBUG - [Pod ctest-pod-63006165] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.727 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.066 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.091 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.066/0.294/0.727 ms 2024-11-14 22:39:03,678 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-63006165 with expectation True passed 2024-11-14 22:39:05,746 - DEBUG - [Pod ctest-pod-35545312] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.331 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.069 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.089 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.069/0.163/0.331 ms 2024-11-14 22:39:05,746 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-35545312 with expectation True passed 2024-11-14 22:39:07,812 - DEBUG - [Pod ctest-pod-39928722] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.865 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.076 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.337/0.865 ms 2024-11-14 22:39:07,812 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-39928722 with expectation True passed 2024-11-14 22:39:07,884 - DEBUG - [Pod ctest-pod-63006165] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-14 22:39:07,884 - DEBUG - [Pod Pod ctest-pod-63006165] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-11-14 22:39:07,884 - DEBUG - [Pod Pod ctest-pod-63006165] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-14 22:39:07,884 - INFO - wget check of of http://10.47.255.251 from ctest-pod-63006165 passed 2024-11-14 22:39:07,958 - DEBUG - [Pod ctest-pod-63006165] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-14 22:39:07,958 - DEBUG - [Pod Pod ctest-pod-63006165] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-11-14 22:39:07,958 - DEBUG - [Pod Pod ctest-pod-63006165] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-14 22:39:07,958 - INFO - wget check of of http://10.47.255.250 from ctest-pod-63006165 passed 2024-11-14 22:39:13,025 - DEBUG - [Pod ctest-pod-35545312] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-14 22:39:13,025 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-14 22:39:13,025 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-14 22:39:13,025 - INFO - wget check of of http://10.47.255.250 from ctest-pod-35545312 passed 2024-11-14 22:39:18,088 - DEBUG - [Pod ctest-pod-76692773] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-11-14 22:39:18,089 - DEBUG - [Pod Pod ctest-pod-76692773] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-11-14 22:39:18,089 - DEBUG - [Pod Pod ctest-pod-76692773] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-11-14 22:39:18,089 - INFO - wget check of of http://10.47.255.251 from ctest-pod-76692773 passed 2024-11-14 22:39:18,097 - INFO - Updating Network Policy ingress-on-service 2024-11-14 22:39:23,164 - DEBUG - [Pod ctest-pod-35545312] Cmd: wget http://10.99.255.27:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:39:23,165 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd wget http://10.99.255.27:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:39:23,165 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:39:28,234 - DEBUG - [Pod ctest-pod-35545312] Cmd: wget http://10.99.255.27:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:39:28,234 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd wget http://10.99.255.27:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:39:28,234 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:39:33,306 - DEBUG - [Pod ctest-pod-35545312] Cmd: wget http://10.99.255.27:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:39:33,307 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd wget http://10.99.255.27:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:39:33,307 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:39:38,356 - DEBUG - [Pod ctest-pod-35545312] Cmd: wget http://10.99.255.27:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:39:38,356 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd wget http://10.99.255.27:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:39:38,356 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:39:43,413 - DEBUG - [Pod ctest-pod-35545312] Cmd: wget http://10.99.255.27:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:39:43,413 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd wget http://10.99.255.27:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:39:43,413 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:39:48,485 - DEBUG - [Pod ctest-pod-35545312] Cmd: wget http://10.99.255.27:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:39:48,485 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd wget http://10.99.255.27:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:39:48,485 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:39:53,543 - DEBUG - [Pod ctest-pod-35545312] Cmd: wget http://10.99.255.27:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:39:53,543 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd wget http://10.99.255.27:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:39:53,543 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:39:58,594 - DEBUG - [Pod ctest-pod-35545312] Cmd: wget http://10.99.255.27:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:39:58,595 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd wget http://10.99.255.27:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:39:58,595 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:40:03,661 - DEBUG - [Pod ctest-pod-35545312] Cmd: wget http://10.99.255.27:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:40:03,662 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd wget http://10.99.255.27:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:40:03,662 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:40:08,724 - DEBUG - [Pod ctest-pod-35545312] Cmd: wget http://10.99.255.27:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:40:08,724 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd wget http://10.99.255.27:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:40:08,724 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd output: Connecting to 10.99.255.27:80 (10.99.255.27:80) wget: download timed out 2024-11-14 22:40:08,725 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-34215170': 0, 'ctest-pod-39706584': 0} 2024-11-14 22:40:08,783 - DEBUG - [Pod ctest-pod-63006165] Cmd: wget http://10.99.255.27:80/ -O - -T 5 -t 1 , Output: ctest-pod-34215170 Connecting to 10.99.255.27:80 (10.99.255.27:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-14 22:40:08,783 - DEBUG - [Pod Pod ctest-pod-63006165] Cmd wget http://10.99.255.27:80/ -O - -T 5 -t 1 passed 2024-11-14 22:40:08,783 - DEBUG - [Pod Pod ctest-pod-63006165] Cmd output: ctest-pod-34215170 Connecting to 10.99.255.27:80 (10.99.255.27:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-14 22:40:08,838 - DEBUG - [Pod ctest-pod-63006165] Cmd: wget http://10.99.255.27:80/ -O - -T 5 -t 1 , Output: ctest-pod-39706584 Connecting to 10.99.255.27:80 (10.99.255.27:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-14 22:40:08,838 - DEBUG - [Pod Pod ctest-pod-63006165] Cmd wget http://10.99.255.27:80/ -O - -T 5 -t 1 passed 2024-11-14 22:40:08,838 - DEBUG - [Pod Pod ctest-pod-63006165] Cmd output: ctest-pod-39706584 Connecting to 10.99.255.27:80 (10.99.255.27:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-14 22:40:08,838 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-34215170': 1, 'ctest-pod-39706584': 1} 2024-11-14 22:40:08,897 - DEBUG - [Pod ctest-pod-39928722] Cmd: wget http://10.99.255.27:80/ -O - -T 5 -t 1 , Output: ctest-pod-39706584 Connecting to 10.99.255.27:80 (10.99.255.27:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-14 22:40:08,897 - DEBUG - [Pod Pod ctest-pod-39928722] Cmd wget http://10.99.255.27:80/ -O - -T 5 -t 1 passed 2024-11-14 22:40:08,897 - DEBUG - [Pod Pod ctest-pod-39928722] Cmd output: ctest-pod-39706584 Connecting to 10.99.255.27:80 (10.99.255.27:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-14 22:40:08,950 - DEBUG - [Pod ctest-pod-39928722] Cmd: wget http://10.99.255.27:80/ -O - -T 5 -t 1 , Output: ctest-pod-39706584 Connecting to 10.99.255.27:80 (10.99.255.27:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-14 22:40:08,951 - DEBUG - [Pod Pod ctest-pod-39928722] Cmd wget http://10.99.255.27:80/ -O - -T 5 -t 1 passed 2024-11-14 22:40:08,951 - DEBUG - [Pod Pod ctest-pod-39928722] Cmd output: ctest-pod-39706584 Connecting to 10.99.255.27:80 (10.99.255.27:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-14 22:40:09,016 - DEBUG - [Pod ctest-pod-39928722] Cmd: wget http://10.99.255.27:80/ -O - -T 5 -t 1 , Output: ctest-pod-34215170 Connecting to 10.99.255.27:80 (10.99.255.27:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-14 22:40:09,016 - DEBUG - [Pod Pod ctest-pod-39928722] Cmd wget http://10.99.255.27:80/ -O - -T 5 -t 1 passed 2024-11-14 22:40:09,016 - DEBUG - [Pod Pod ctest-pod-39928722] Cmd output: ctest-pod-34215170 Connecting to 10.99.255.27:80 (10.99.255.27:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-14 22:40:09,016 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-34215170': 1, 'ctest-pod-39706584': 2} 2024-11-14 22:40:11,076 - DEBUG - [Pod ctest-pod-63006165] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.527 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.083 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.109 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.083/0.239/0.527 ms 2024-11-14 22:40:11,076 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-63006165 with expectation True passed 2024-11-14 22:40:13,149 - DEBUG - [Pod ctest-pod-35545312] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.580 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.081 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.080 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.080/0.247/0.580 ms 2024-11-14 22:40:13,149 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-35545312 with expectation True passed 2024-11-14 22:40:15,207 - DEBUG - [Pod ctest-pod-39928722] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.218 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.077 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.083 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.077/0.459/1.218 ms 2024-11-14 22:40:15,207 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-39928722 with expectation True passed 2024-11-14 22:40:15,273 - DEBUG - [Pod ctest-pod-63006165] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-14 22:40:15,273 - DEBUG - [Pod Pod ctest-pod-63006165] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-11-14 22:40:15,273 - DEBUG - [Pod Pod ctest-pod-63006165] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-14 22:40:15,273 - INFO - wget check of of http://10.47.255.251 from ctest-pod-63006165 passed 2024-11-14 22:40:15,334 - DEBUG - [Pod ctest-pod-63006165] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-14 22:40:15,334 - DEBUG - [Pod Pod ctest-pod-63006165] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-11-14 22:40:15,334 - DEBUG - [Pod Pod ctest-pod-63006165] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-14 22:40:15,334 - INFO - wget check of of http://10.47.255.250 from ctest-pod-63006165 passed 2024-11-14 22:40:20,396 - DEBUG - [Pod ctest-pod-35545312] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-14 22:40:20,396 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-14 22:40:20,396 - DEBUG - [Pod Pod ctest-pod-35545312] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-14 22:40:20,396 - INFO - wget check of of http://10.47.255.250 from ctest-pod-35545312 passed 2024-11-14 22:40:20,459 - DEBUG - [Pod ctest-pod-76692773] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-14 22:40:20,459 - DEBUG - [Pod Pod ctest-pod-76692773] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-11-14 22:40:20,459 - DEBUG - [Pod Pod ctest-pod-76692773] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-14 22:40:20,459 - INFO - wget check of of http://10.47.255.251 from ctest-pod-76692773 passed 2024-11-14 22:40:20,459 - INFO - Deleting Network Policy : ingress-on-service 2024-11-14 22:40:20,460 - INFO - Deleting service : ctest-nginx-svc-03279958 2024-11-14 22:40:20,666 - DEBUG - No XMPP flaps were noticed during the test
2024-11-14 22:40:20,667 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:05]
2024-11-14 22:40:20,667 - INFO - -------------------------------------------------------------------------------- 2024-11-14 22:40:20,673 - INFO - Deleting pod ctest-new-default-03020182:ctest-pod-34215170 2024-11-14 22:40:20,673 - INFO - Deleting pod ctest-new-default-03020182:ctest-pod-39706584 2024-11-14 22:40:20,673 - INFO - Deleting pod ctest-non-default-33208457:ctest-pod-05862742 2024-11-14 22:40:20,674 - INFO - Deleting pod ctest-non-default-33208457:ctest-pod-47883358 2024-11-14 22:40:20,674 - INFO - Deleting pod ctest-new-default-03020182:ctest-pod-35545312 2024-11-14 22:40:20,674 - INFO - Deleting pod ctest-new-default-03020182:ctest-pod-63006165 2024-11-14 22:40:20,675 - INFO - Deleting pod ctest-non-default-33208457:ctest-pod-39928722 2024-11-14 22:40:20,675 - INFO - Deleting pod ctest-non-default-33208457:ctest-pod-76692773 2024-11-14 22:40:20,710 - WARNING - Pod uuid a2954613-9c3a-4eee-88fa-2c3e22938596 is still seen in agent 10.0.0.42 VM list 2024-11-14 22:40:20,839 - WARNING - Pod uuid f35d0e8e-7e8f-4a42-a4be-e186d0eebf84 is still seen in agent 10.0.0.42 VM list 2024-11-14 22:40:20,840 - WARNING - Pod uuid d536da0e-43a6-4469-87f7-944c644543a9 is still seen in agent 10.0.0.42 VM list 2024-11-14 22:40:20,842 - WARNING - Pod uuid 29f57fe8-7002-4bd6-a449-0ac7f642624b is still seen in agent 10.0.0.42 VM list 2024-11-14 22:40:20,845 - WARNING - Pod uuid 9850729a-10ad-4e1b-85e7-4ea522ae042b is still seen in agent 10.0.0.42 VM list 2024-11-14 22:40:20,845 - WARNING - Pod uuid 94ff5941-f631-44b2-9b14-8d56333a5247 is still seen in agent 10.0.0.42 VM list 2024-11-14 22:40:20,845 - WARNING - Pod uuid 2573e22a-c49b-4a78-a8f4-6f6aaef4db42 is still seen in agent 10.0.0.42 VM list 2024-11-14 22:40:20,846 - WARNING - Pod uuid dd272af5-8de7-437c-9a7c-35f9196179bd is still seen in agent 10.0.0.42 VM list 2024-11-14 22:40:25,718 - DEBUG - Pod a2954613-9c3a-4eee-88fa-2c3e22938596 is not in agent 10.0.0.42 VM list 2024-11-14 22:40:25,725 - DEBUG - VMI f39c08a0-a2d8-11ef-95e5-fa163e7ec7f4 is removed from agent 10.0.0.42 2024-11-14 22:40:25,726 - INFO - Verified that pod ctest-pod-34215170 is removed in agent 2024-11-14 22:40:25,871 - WARNING - Pod uuid 9850729a-10ad-4e1b-85e7-4ea522ae042b is still seen in agent 10.0.0.42 VM list 2024-11-14 22:40:25,873 - DEBUG - Pod 2573e22a-c49b-4a78-a8f4-6f6aaef4db42 is not in agent 10.0.0.42 VM list 2024-11-14 22:40:25,875 - DEBUG - Pod 94ff5941-f631-44b2-9b14-8d56333a5247 is not in agent 10.0.0.42 VM list 2024-11-14 22:40:25,876 - DEBUG - Pod dd272af5-8de7-437c-9a7c-35f9196179bd is not in agent 10.0.0.42 VM list 2024-11-14 22:40:25,878 - WARNING - Pod uuid 29f57fe8-7002-4bd6-a449-0ac7f642624b is still seen in agent 10.0.0.42 VM list 2024-11-14 22:40:25,878 - WARNING - Pod uuid f35d0e8e-7e8f-4a42-a4be-e186d0eebf84 is still seen in agent 10.0.0.42 VM list 2024-11-14 22:40:25,878 - WARNING - Pod uuid d536da0e-43a6-4469-87f7-944c644543a9 is still seen in agent 10.0.0.42 VM list 2024-11-14 22:40:25,891 - DEBUG - VMI f4d5420e-a2d8-11ef-95e5-fa163e7ec7f4 is removed from agent 10.0.0.42 2024-11-14 22:40:25,891 - INFO - Verified that pod ctest-pod-05862742 is removed in agent 2024-11-14 22:40:25,893 - DEBUG - VMI f567914a-a2d8-11ef-95e5-fa163e7ec7f4 is removed from agent 10.0.0.42 2024-11-14 22:40:25,893 - INFO - Verified that pod ctest-pod-47883358 is removed in agent 2024-11-14 22:40:25,893 - DEBUG - VMI f421fa6e-a2d8-11ef-95e5-fa163e7ec7f4 is removed from agent 10.0.0.42 2024-11-14 22:40:25,893 - INFO - Verified that pod ctest-pod-39706584 is removed in agent 2024-11-14 22:40:30,883 - WARNING - Pod uuid 9850729a-10ad-4e1b-85e7-4ea522ae042b is still seen in agent 10.0.0.42 VM list 2024-11-14 22:40:30,893 - WARNING - Pod uuid 29f57fe8-7002-4bd6-a449-0ac7f642624b is still seen in agent 10.0.0.42 VM list 2024-11-14 22:40:30,895 - WARNING - Pod uuid f35d0e8e-7e8f-4a42-a4be-e186d0eebf84 is still seen in agent 10.0.0.42 VM list 2024-11-14 22:40:30,896 - WARNING - Pod uuid d536da0e-43a6-4469-87f7-944c644543a9 is still seen in agent 10.0.0.42 VM list 2024-11-14 22:40:35,891 - WARNING - Pod uuid 9850729a-10ad-4e1b-85e7-4ea522ae042b is still seen in agent 10.0.0.42 VM list 2024-11-14 22:40:35,911 - WARNING - Pod uuid 29f57fe8-7002-4bd6-a449-0ac7f642624b is still seen in agent 10.0.0.42 VM list 2024-11-14 22:40:35,913 - WARNING - Pod uuid d536da0e-43a6-4469-87f7-944c644543a9 is still seen in agent 10.0.0.42 VM list 2024-11-14 22:40:35,913 - WARNING - Pod uuid f35d0e8e-7e8f-4a42-a4be-e186d0eebf84 is still seen in agent 10.0.0.42 VM list 2024-11-14 22:40:40,900 - WARNING - Pod uuid 9850729a-10ad-4e1b-85e7-4ea522ae042b is still seen in agent 10.0.0.42 VM list 2024-11-14 22:40:40,926 - WARNING - Pod uuid 29f57fe8-7002-4bd6-a449-0ac7f642624b is still seen in agent 10.0.0.42 VM list 2024-11-14 22:40:40,927 - WARNING - Pod uuid f35d0e8e-7e8f-4a42-a4be-e186d0eebf84 is still seen in agent 10.0.0.42 VM list 2024-11-14 22:40:40,927 - WARNING - Pod uuid d536da0e-43a6-4469-87f7-944c644543a9 is still seen in agent 10.0.0.42 VM list 2024-11-14 22:40:45,916 - WARNING - Pod uuid 9850729a-10ad-4e1b-85e7-4ea522ae042b is still seen in agent 10.0.0.42 VM list 2024-11-14 22:40:45,941 - WARNING - Pod uuid 29f57fe8-7002-4bd6-a449-0ac7f642624b is still seen in agent 10.0.0.42 VM list 2024-11-14 22:40:45,943 - WARNING - Pod uuid d536da0e-43a6-4469-87f7-944c644543a9 is still seen in agent 10.0.0.42 VM list 2024-11-14 22:40:45,943 - WARNING - Pod uuid f35d0e8e-7e8f-4a42-a4be-e186d0eebf84 is still seen in agent 10.0.0.42 VM list 2024-11-14 22:40:50,928 - WARNING - Pod uuid 9850729a-10ad-4e1b-85e7-4ea522ae042b is still seen in agent 10.0.0.42 VM list 2024-11-14 22:40:50,957 - WARNING - Pod uuid f35d0e8e-7e8f-4a42-a4be-e186d0eebf84 is still seen in agent 10.0.0.42 VM list 2024-11-14 22:40:50,958 - WARNING - Pod uuid d536da0e-43a6-4469-87f7-944c644543a9 is still seen in agent 10.0.0.42 VM list 2024-11-14 22:40:50,959 - WARNING - Pod uuid 29f57fe8-7002-4bd6-a449-0ac7f642624b is still seen in agent 10.0.0.42 VM list 2024-11-14 22:40:55,936 - DEBUG - Pod 9850729a-10ad-4e1b-85e7-4ea522ae042b is not in agent 10.0.0.42 VM list 2024-11-14 22:40:55,943 - DEBUG - VMI f6fe31f8-a2d8-11ef-95e5-fa163e7ec7f4 is removed from agent 10.0.0.42 2024-11-14 22:40:55,943 - INFO - Verified that pod ctest-pod-39928722 is removed in agent 2024-11-14 22:40:55,971 - DEBUG - Pod f35d0e8e-7e8f-4a42-a4be-e186d0eebf84 is not in agent 10.0.0.42 VM list 2024-11-14 22:40:55,974 - DEBUG - Pod d536da0e-43a6-4469-87f7-944c644543a9 is not in agent 10.0.0.42 VM list 2024-11-14 22:40:55,976 - DEBUG - Pod 29f57fe8-7002-4bd6-a449-0ac7f642624b is not in agent 10.0.0.42 VM list 2024-11-14 22:40:55,987 - DEBUG - VMI f77db59a-a2d8-11ef-95e5-fa163e7ec7f4 is removed from agent 10.0.0.42 2024-11-14 22:40:55,988 - INFO - Verified that pod ctest-pod-76692773 is removed in agent 2024-11-14 22:40:55,990 - DEBUG - VMI f67cbd30-a2d8-11ef-95e5-fa163e7ec7f4 is removed from agent 10.0.0.42 2024-11-14 22:40:55,990 - INFO - Verified that pod ctest-pod-63006165 is removed in agent 2024-11-14 22:40:55,991 - DEBUG - VMI f60220e8-a2d8-11ef-95e5-fa163e7ec7f4 is removed from agent 10.0.0.42 2024-11-14 22:40:55,991 - INFO - Verified that pod ctest-pod-35545312 is removed in agent 2024-11-14 22:40:55,991 - INFO - Deleting namespace ctest-non-default-33208457 2024-11-14 22:40:56,022 - DEBUG - Namespace ctest-non-default-33208457 still in k8s 2024-11-14 22:40:58,027 - DEBUG - Namespace ctest-non-default-33208457 still in k8s 2024-11-14 22:41:00,031 - DEBUG - Namespace ctest-non-default-33208457 still in k8s 2024-11-14 22:41:02,036 - DEBUG - Namespace ctest-non-default-33208457 is not in k8s 2024-11-14 22:41:02,037 - DEBUG - No need to check project deletion in contrail-api 2024-11-14 22:41:02,037 - INFO - Deleting namespace ctest-new-default-03020182 2024-11-14 22:41:02,047 - DEBUG - Namespace ctest-new-default-03020182 still in k8s 2024-11-14 22:41:04,052 - DEBUG - Namespace ctest-new-default-03020182 still in k8s 2024-11-14 22:41:06,057 - DEBUG - Namespace ctest-new-default-03020182 still in k8s 2024-11-14 22:41:08,062 - DEBUG - Namespace ctest-new-default-03020182 is not in k8s 2024-11-14 22:41:08,062 - DEBUG - No need to check project deletion in contrail-api