2024-08-26 18:24:42,977 - INFO - Using existing project ['default-domain', 'k8s-default'](13ccf7a1-ccd7-46b6-a0e6-10255441a6b0) 2024-08-26 18:24:42,998 - DEBUG - Namespace ctest-new-default-52523801 not present 2024-08-26 18:24:43,009 - INFO - Created namespace ctest-new-default-52523801 2024-08-26 18:24:46,013 - DEBUG - Namespace ctest-non-default-57568270 not present 2024-08-26 18:24:46,032 - INFO - Created namespace ctest-non-default-57568270 2024-08-26 18:24:49,050 - DEBUG - Pod ctest-pod-96824332 not present 2024-08-26 18:24:49,050 - INFO - Creating Pod ctest-pod-96824332 2024-08-26 18:24:49,082 - DEBUG - Pod : ctest-pod-96824332 UUID is 0175ecb0-d55f-445e-a5aa-2f9d4169b3b3 2024-08-26 18:24:49,085 - DEBUG - Pod ctest-pod-41507255 not present 2024-08-26 18:24:49,085 - INFO - Creating Pod ctest-pod-41507255 2024-08-26 18:24:49,129 - DEBUG - Pod : ctest-pod-41507255 UUID is 1106d962-5b73-4b1b-adc3-22119d58f9db 2024-08-26 18:24:49,132 - DEBUG - Pod ctest-pod-85760854 not present 2024-08-26 18:24:49,133 - INFO - Creating Pod ctest-pod-85760854 2024-08-26 18:24:49,169 - DEBUG - Pod : ctest-pod-85760854 UUID is 04195f7c-592b-407a-a87c-d5686480625a 2024-08-26 18:24:49,172 - DEBUG - Pod ctest-pod-39467445 not present 2024-08-26 18:24:49,172 - INFO - Creating Pod ctest-pod-39467445 2024-08-26 18:24:49,197 - DEBUG - Pod : ctest-pod-39467445 UUID is 68fcf69f-dc16-4a04-a80a-3b8421aeb119 2024-08-26 18:24:49,200 - DEBUG - Pod ctest-pod-11161580 not present 2024-08-26 18:24:49,200 - INFO - Creating Pod ctest-pod-11161580 2024-08-26 18:24:49,215 - DEBUG - Pod : ctest-pod-11161580 UUID is efbcf20e-954d-4d82-bc0b-220344a89507 2024-08-26 18:24:49,218 - DEBUG - Pod ctest-pod-76503897 not present 2024-08-26 18:24:49,218 - INFO - Creating Pod ctest-pod-76503897 2024-08-26 18:24:49,234 - DEBUG - Pod : ctest-pod-76503897 UUID is ede303ac-0b2d-43ec-9ac5-1a067cc766e3 2024-08-26 18:24:49,237 - DEBUG - Pod ctest-pod-69606222 not present 2024-08-26 18:24:49,237 - INFO - Creating Pod ctest-pod-69606222 2024-08-26 18:24:49,257 - DEBUG - Pod : ctest-pod-69606222 UUID is 255f6d65-9ce7-4ee2-bceb-6b935563d776 2024-08-26 18:24:49,259 - DEBUG - Pod ctest-pod-73224079 not present 2024-08-26 18:24:49,259 - INFO - Creating Pod ctest-pod-73224079 2024-08-26 18:24:49,285 - DEBUG - Pod : ctest-pod-73224079 UUID is fec59144-a49a-48f9-a9b5-ef7669135efd 2024-08-26 18:24:49,444 - INFO - Project default-domain:k8s-ctest-new-default-52523801 for Namespace ctest-new-default-52523801 is seen in contrail-api 2024-08-26 18:24:49,444 - DEBUG - Project uuid in Contrail is 556ad13c-5d8b-4b50-8db5-38a6c1a232d0 2024-08-26 18:24:49,572 - DEBUG - Requesting: http://10.0.0.53:8108/Snh_NamespaceDatabaseList?namespace_uuid=5002368b-ddcd-4de3-9e3a-945f9d7e3fa7 2024-08-26 18:24:49,577 - INFO - Namespace ctest-new-default-52523801 with uuid 5002368b-ddcd-4de3-9e3a-945f9d7e3fa7 found in kube manager 2024-08-26 18:24:49,577 - INFO - Namespace ctest-new-default-52523801 verification passed 2024-08-26 18:24:49,729 - INFO - Project default-domain:k8s-ctest-non-default-57568270 for Namespace ctest-non-default-57568270 is seen in contrail-api 2024-08-26 18:24:49,730 - DEBUG - Project uuid in Contrail is b22ab2cb-0297-4854-942c-5651e50f09c9 2024-08-26 18:24:49,730 - DEBUG - Requesting: http://10.0.0.53:8108/Snh_NamespaceDatabaseList?namespace_uuid=a41bda96-63ef-4e43-908b-7d410db6918f 2024-08-26 18:24:49,737 - INFO - Namespace ctest-non-default-57568270 with uuid a41bda96-63ef-4e43-908b-7d410db6918f found in kube manager 2024-08-26 18:24:49,737 - INFO - Namespace ctest-non-default-57568270 verification passed 2024-08-26 18:24:50,374 - DEBUG - Pod ctest-pod-96824332 not in running state.Currently in Pending 2024-08-26 18:24:55,394 - DEBUG - Pod ctest-pod-96824332 not in running state.Currently in Pending 2024-08-26 18:25:00,519 - DEBUG - Pod ctest-pod-96824332 not in running state.Currently in Pending 2024-08-26 18:25:05,528 - INFO - Pod ctest-pod-96824332 is in running state.Got IP 10.47.255.251 2024-08-26 18:25:05,583 - DEBUG - Pod ctest-pod-96824332 has vmi 7bd5c7aa-63d8-11ef-b2c1-fa163e03482c 2024-08-26 18:25:05,583 - INFO - Verified pod ctest-pod-96824332 in contrail-api 2024-08-26 18:25:05,615 - DEBUG - VMI 7bd5c7aa-63d8-11ef-b2c1-fa163e03482c is active in agent 10.0.0.22 2024-08-26 18:25:05,615 - INFO - Verified Pod ctest-pod-96824332 in agent 10.0.0.22 2024-08-26 18:25:05,615 - DEBUG - Requesting: http://10.0.0.53:8108/Snh_VirtualMachineDatabaseList?x=0175ecb0-d55f-445e-a5aa-2f9d4169b3b3 2024-08-26 18:25:05,621 - INFO - Pod ctest-pod-96824332 with uuid 0175ecb0-d55f-445e-a5aa-2f9d4169b3b3 found in kube manager 2024-08-26 18:25:05,622 - INFO - Pod ctest-pod-96824332 verification passed 2024-08-26 18:25:05,628 - INFO - Pod ctest-pod-41507255 is in running state.Got IP 10.47.255.250 2024-08-26 18:25:05,639 - DEBUG - Pod ctest-pod-41507255 has vmi 7c52171a-63d8-11ef-b2c1-fa163e03482c 2024-08-26 18:25:05,639 - INFO - Verified pod ctest-pod-41507255 in contrail-api 2024-08-26 18:25:05,684 - DEBUG - VMI 7c52171a-63d8-11ef-b2c1-fa163e03482c is active in agent 10.0.0.22 2024-08-26 18:25:05,684 - INFO - Verified Pod ctest-pod-41507255 in agent 10.0.0.22 2024-08-26 18:25:05,684 - DEBUG - Requesting: http://10.0.0.53:8108/Snh_VirtualMachineDatabaseList?x=1106d962-5b73-4b1b-adc3-22119d58f9db 2024-08-26 18:25:05,689 - INFO - Pod ctest-pod-41507255 with uuid 1106d962-5b73-4b1b-adc3-22119d58f9db found in kube manager 2024-08-26 18:25:05,689 - INFO - Pod ctest-pod-41507255 verification passed 2024-08-26 18:25:05,695 - INFO - Pod ctest-pod-85760854 is in running state.Got IP 10.47.255.249 2024-08-26 18:25:05,705 - DEBUG - Pod ctest-pod-85760854 has vmi 7d359274-63d8-11ef-b2c1-fa163e03482c 2024-08-26 18:25:05,705 - INFO - Verified pod ctest-pod-85760854 in contrail-api 2024-08-26 18:25:05,790 - DEBUG - VMI 7d359274-63d8-11ef-b2c1-fa163e03482c is active in agent 10.0.0.22 2024-08-26 18:25:05,790 - INFO - Verified Pod ctest-pod-85760854 in agent 10.0.0.22 2024-08-26 18:25:05,790 - DEBUG - Requesting: http://10.0.0.53:8108/Snh_VirtualMachineDatabaseList?x=04195f7c-592b-407a-a87c-d5686480625a 2024-08-26 18:25:05,795 - INFO - Pod ctest-pod-85760854 with uuid 04195f7c-592b-407a-a87c-d5686480625a found in kube manager 2024-08-26 18:25:05,795 - INFO - Pod ctest-pod-85760854 verification passed 2024-08-26 18:25:05,800 - INFO - Pod ctest-pod-39467445 is in running state.Got IP 10.47.255.248 2024-08-26 18:25:05,850 - DEBUG - Pod ctest-pod-39467445 has vmi 7da7bd04-63d8-11ef-b2c1-fa163e03482c 2024-08-26 18:25:05,851 - INFO - Verified pod ctest-pod-39467445 in contrail-api 2024-08-26 18:25:05,911 - DEBUG - VMI 7da7bd04-63d8-11ef-b2c1-fa163e03482c is active in agent 10.0.0.22 2024-08-26 18:25:05,911 - INFO - Verified Pod ctest-pod-39467445 in agent 10.0.0.22 2024-08-26 18:25:05,911 - DEBUG - Requesting: http://10.0.0.53:8108/Snh_VirtualMachineDatabaseList?x=68fcf69f-dc16-4a04-a80a-3b8421aeb119 2024-08-26 18:25:05,916 - INFO - Pod ctest-pod-39467445 with uuid 68fcf69f-dc16-4a04-a80a-3b8421aeb119 found in kube manager 2024-08-26 18:25:05,916 - INFO - Pod ctest-pod-39467445 verification passed 2024-08-26 18:25:05,921 - DEBUG - Pod ctest-pod-11161580 not in running state.Currently in Pending 2024-08-26 18:25:10,930 - INFO - Pod ctest-pod-11161580 is in running state.Got IP 10.47.255.247 2024-08-26 18:25:10,942 - DEBUG - Pod ctest-pod-11161580 has vmi 7e291764-63d8-11ef-b2c1-fa163e03482c 2024-08-26 18:25:10,942 - INFO - Verified pod ctest-pod-11161580 in contrail-api 2024-08-26 18:25:10,961 - DEBUG - VMI 7e291764-63d8-11ef-b2c1-fa163e03482c is active in agent 10.0.0.22 2024-08-26 18:25:10,961 - INFO - Verified Pod ctest-pod-11161580 in agent 10.0.0.22 2024-08-26 18:25:10,961 - DEBUG - Requesting: http://10.0.0.53:8108/Snh_VirtualMachineDatabaseList?x=efbcf20e-954d-4d82-bc0b-220344a89507 2024-08-26 18:25:10,966 - INFO - Pod ctest-pod-11161580 with uuid efbcf20e-954d-4d82-bc0b-220344a89507 found in kube manager 2024-08-26 18:25:10,966 - INFO - Pod ctest-pod-11161580 verification passed 2024-08-26 18:25:10,971 - INFO - Pod ctest-pod-69606222 is in running state.Got IP 10.47.255.245 2024-08-26 18:25:11,026 - DEBUG - Pod ctest-pod-69606222 has vmi 7f01c190-63d8-11ef-b2c1-fa163e03482c 2024-08-26 18:25:11,027 - INFO - Verified pod ctest-pod-69606222 in contrail-api 2024-08-26 18:25:11,047 - DEBUG - VMI 7f01c190-63d8-11ef-b2c1-fa163e03482c is active in agent 10.0.0.22 2024-08-26 18:25:11,047 - INFO - Verified Pod ctest-pod-69606222 in agent 10.0.0.22 2024-08-26 18:25:11,048 - DEBUG - Requesting: http://10.0.0.53:8108/Snh_VirtualMachineDatabaseList?x=255f6d65-9ce7-4ee2-bceb-6b935563d776 2024-08-26 18:25:11,052 - INFO - Pod ctest-pod-69606222 with uuid 255f6d65-9ce7-4ee2-bceb-6b935563d776 found in kube manager 2024-08-26 18:25:11,052 - INFO - Pod ctest-pod-69606222 verification passed 2024-08-26 18:25:11,057 - INFO - Pod ctest-pod-76503897 is in running state.Got IP 10.47.255.246 2024-08-26 18:25:11,070 - DEBUG - Pod ctest-pod-76503897 has vmi 7e941686-63d8-11ef-b2c1-fa163e03482c 2024-08-26 18:25:11,070 - INFO - Verified pod ctest-pod-76503897 in contrail-api 2024-08-26 18:25:11,084 - DEBUG - VMI 7e941686-63d8-11ef-b2c1-fa163e03482c is active in agent 10.0.0.22 2024-08-26 18:25:11,084 - INFO - Verified Pod ctest-pod-76503897 in agent 10.0.0.22 2024-08-26 18:25:11,084 - DEBUG - Requesting: http://10.0.0.53:8108/Snh_VirtualMachineDatabaseList?x=ede303ac-0b2d-43ec-9ac5-1a067cc766e3 2024-08-26 18:25:11,088 - INFO - Pod ctest-pod-76503897 with uuid ede303ac-0b2d-43ec-9ac5-1a067cc766e3 found in kube manager 2024-08-26 18:25:11,089 - INFO - Pod ctest-pod-76503897 verification passed 2024-08-26 18:25:11,094 - INFO - Pod ctest-pod-73224079 is in running state.Got IP 10.47.255.244 2024-08-26 18:25:11,150 - DEBUG - Pod ctest-pod-73224079 has vmi 7f681d6e-63d8-11ef-b2c1-fa163e03482c 2024-08-26 18:25:11,150 - INFO - Verified pod ctest-pod-73224079 in contrail-api 2024-08-26 18:25:11,171 - DEBUG - VMI 7f681d6e-63d8-11ef-b2c1-fa163e03482c is active in agent 10.0.0.22 2024-08-26 18:25:11,171 - INFO - Verified Pod ctest-pod-73224079 in agent 10.0.0.22 2024-08-26 18:25:11,171 - DEBUG - Requesting: http://10.0.0.53:8108/Snh_VirtualMachineDatabaseList?x=fec59144-a49a-48f9-a9b5-ef7669135efd 2024-08-26 18:25:11,176 - INFO - Pod ctest-pod-73224079 with uuid fec59144-a49a-48f9-a9b5-ef7669135efd found in kube manager 2024-08-26 18:25:11,176 - INFO - Pod ctest-pod-73224079 verification passed 2024-08-26 18:25:11,176 - INFO - ================================================================================ 2024-08-26 18:25:11,176 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-08-26 18:25:11,176 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-08-26 18:25:11,414 - DEBUG - Nothing to compare xmpp stats {'10.0.0.22': {'10.0.0.53': '0'}} with 2024-08-26 18:25:11,414 - INFO - Initial checks done. Running the testcase now 2024-08-26 18:25:11,414 - INFO - 2024-08-26 18:25:11,505 - DEBUG - [Pod ctest-pod-96824332] Cmd: echo ctest-pod-96824332 > /usr/share/nginx/html/index.html, Output: 2024-08-26 18:25:12,160 - DEBUG - [Pod ctest-pod-41507255] Cmd: echo ctest-pod-41507255 > /usr/share/nginx/html/index.html, Output: 2024-08-26 18:25:12,279 - DEBUG - [Pod ctest-pod-85760854] Cmd: echo ctest-pod-85760854 > /usr/share/nginx/html/index.html, Output: 2024-08-26 18:25:12,348 - DEBUG - [Pod ctest-pod-39467445] Cmd: echo ctest-pod-39467445 > /usr/share/nginx/html/index.html, Output: 2024-08-26 18:25:12,351 - DEBUG - Service ctest-nginx-svc-63328746 not present 2024-08-26 18:25:12,351 - INFO - Creating service ctest-nginx-svc-63328746 2024-08-26 18:25:12,375 - INFO - Created Service ctest-nginx-svc-63328746 2024-08-26 18:25:12,388 - WARNING - Service UUID 4718a435-10dc-4206-b567-05ae453b9c6d not yet found in contrail-api 2024-08-26 18:25:13,395 - INFO - Validated that Service ctest-nginx-svc-63328746 is seen in contrail-api 2024-08-26 18:25:13,395 - DEBUG - Requesting: http://10.0.0.53:8108/Snh_LoadbalancerDatabaseList?x=4718a435-10dc-4206-b567-05ae453b9c6d 2024-08-26 18:25:13,400 - INFO - Service ctest-nginx-svc-63328746 with uuid 4718a435-10dc-4206-b567-05ae453b9c6d found in kube manager 2024-08-26 18:25:13,400 - INFO - Service ctest-nginx-svc-63328746 verification passed 2024-08-26 18:25:14,482 - DEBUG - [Pod ctest-pod-11161580] Cmd: wget http://10.110.118.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.118.148:80 (10.110.118.148:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-96824332 2024-08-26 18:25:14,482 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd wget http://10.110.118.148:80/ -O - -T 5 -t 1 passed 2024-08-26 18:25:14,482 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd output: Connecting to 10.110.118.148:80 (10.110.118.148:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-96824332 2024-08-26 18:25:14,540 - DEBUG - [Pod ctest-pod-11161580] Cmd: wget http://10.110.118.148:80/ -O - -T 5 -t 1 , Output: ctest-pod-96824332 Connecting to 10.110.118.148:80 (10.110.118.148:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 18:25:14,540 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd wget http://10.110.118.148:80/ -O - -T 5 -t 1 passed 2024-08-26 18:25:14,540 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd output: ctest-pod-96824332 Connecting to 10.110.118.148:80 (10.110.118.148:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 18:25:14,606 - DEBUG - [Pod ctest-pod-11161580] Cmd: wget http://10.110.118.148:80/ -O - -T 5 -t 1 , Output: ctest-pod-41507255 Connecting to 10.110.118.148:80 (10.110.118.148:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 18:25:14,606 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd wget http://10.110.118.148:80/ -O - -T 5 -t 1 passed 2024-08-26 18:25:14,606 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd output: ctest-pod-41507255 Connecting to 10.110.118.148:80 (10.110.118.148:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 18:25:14,606 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-96824332': 2, 'ctest-pod-41507255': 1} 2024-08-26 18:25:14,652 - DEBUG - [Pod ctest-pod-69606222] Cmd: wget http://10.110.118.148:80/ -O - -T 5 -t 1 , Output: ctest-pod-41507255 Connecting to 10.110.118.148:80 (10.110.118.148:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 18:25:14,652 - DEBUG - [Pod Pod ctest-pod-69606222] Cmd wget http://10.110.118.148:80/ -O - -T 5 -t 1 passed 2024-08-26 18:25:14,652 - DEBUG - [Pod Pod ctest-pod-69606222] Cmd output: ctest-pod-41507255 Connecting to 10.110.118.148:80 (10.110.118.148:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 18:25:14,729 - DEBUG - [Pod ctest-pod-69606222] Cmd: wget http://10.110.118.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.118.148:80 (10.110.118.148:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-41507255 2024-08-26 18:25:14,729 - DEBUG - [Pod Pod ctest-pod-69606222] Cmd wget http://10.110.118.148:80/ -O - -T 5 -t 1 passed 2024-08-26 18:25:14,729 - DEBUG - [Pod Pod ctest-pod-69606222] Cmd output: Connecting to 10.110.118.148:80 (10.110.118.148:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-41507255 2024-08-26 18:25:14,776 - DEBUG - [Pod ctest-pod-69606222] Cmd: wget http://10.110.118.148:80/ -O - -T 5 -t 1 , Output: ctest-pod-96824332 Connecting to 10.110.118.148:80 (10.110.118.148:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 18:25:14,777 - DEBUG - [Pod Pod ctest-pod-69606222] Cmd wget http://10.110.118.148:80/ -O - -T 5 -t 1 passed 2024-08-26 18:25:14,777 - DEBUG - [Pod Pod ctest-pod-69606222] Cmd output: ctest-pod-96824332 Connecting to 10.110.118.148:80 (10.110.118.148:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 18:25:14,777 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-96824332': 1, 'ctest-pod-41507255': 2} 2024-08-26 18:25:14,781 - DEBUG - Network policy ingress-on-service not present 2024-08-26 18:25:14,781 - INFO - Creating Network Policy ingress-on-service 2024-08-26 18:25:14,808 - INFO - Network policy found in k8s 2024-08-26 18:25:14,808 - DEBUG - Requesting: http://10.0.0.53:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=9d89410c-5d38-4b84-9231-1f8c4b63dc5a 2024-08-26 18:25:14,817 - INFO - Network Policy ingress-on-service with uuid 9d89410c-5d38-4b84-9231-1f8c4b63dc5a found in kube manager 2024-08-26 18:25:14,870 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-08-26 18:25:14,871 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-08-26 18:25:14,871 - DEBUG - Requesting: http://10.0.0.53:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=9d89410c-5d38-4b84-9231-1f8c4b63dc5a 2024-08-26 18:25:14,907 - WARNING - Network policy with name ingress-on-service not found in agent 2024-08-26 18:25:16,908 - DEBUG - Requesting: http://10.0.0.53:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=9d89410c-5d38-4b84-9231-1f8c4b63dc5a 2024-08-26 18:25:16,942 - INFO - Network policy with name ingress-on-service found in agent 2024-08-26 18:25:16,942 - INFO - Network Policy ingress-on-service verification passed 2024-08-26 18:25:22,007 - DEBUG - [Pod ctest-pod-11161580] Cmd: wget http://10.110.118.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:25:22,007 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd wget http://10.110.118.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:25:22,007 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:25:27,082 - DEBUG - [Pod ctest-pod-11161580] Cmd: wget http://10.110.118.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:25:27,082 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd wget http://10.110.118.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:25:27,082 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:25:32,263 - DEBUG - [Pod ctest-pod-11161580] Cmd: wget http://10.110.118.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:25:32,263 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd wget http://10.110.118.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:25:32,263 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:25:37,458 - DEBUG - [Pod ctest-pod-11161580] Cmd: wget http://10.110.118.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:25:37,458 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd wget http://10.110.118.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:25:37,458 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:25:42,534 - DEBUG - [Pod ctest-pod-11161580] Cmd: wget http://10.110.118.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:25:42,534 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd wget http://10.110.118.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:25:42,534 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:25:47,634 - DEBUG - [Pod ctest-pod-11161580] Cmd: wget http://10.110.118.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:25:47,635 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd wget http://10.110.118.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:25:47,635 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:25:52,708 - DEBUG - [Pod ctest-pod-11161580] Cmd: wget http://10.110.118.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:25:52,708 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd wget http://10.110.118.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:25:52,708 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:25:57,771 - DEBUG - [Pod ctest-pod-11161580] Cmd: wget http://10.110.118.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:25:57,771 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd wget http://10.110.118.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:25:57,771 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:26:02,849 - DEBUG - [Pod ctest-pod-11161580] Cmd: wget http://10.110.118.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:26:02,849 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd wget http://10.110.118.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:26:02,849 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:26:07,904 - DEBUG - [Pod ctest-pod-11161580] Cmd: wget http://10.110.118.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:26:07,904 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd wget http://10.110.118.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:26:07,904 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:26:07,904 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-96824332': 0, 'ctest-pod-41507255': 0} 2024-08-26 18:26:07,954 - DEBUG - [Pod ctest-pod-76503897] Cmd: wget http://10.110.118.148:80/ -O - -T 5 -t 1 , Output: ctest-pod-96824332 Connecting to 10.110.118.148:80 (10.110.118.148:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 18:26:07,955 - DEBUG - [Pod Pod ctest-pod-76503897] Cmd wget http://10.110.118.148:80/ -O - -T 5 -t 1 passed 2024-08-26 18:26:07,955 - DEBUG - [Pod Pod ctest-pod-76503897] Cmd output: ctest-pod-96824332 Connecting to 10.110.118.148:80 (10.110.118.148:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 18:26:08,016 - DEBUG - [Pod ctest-pod-76503897] Cmd: wget http://10.110.118.148:80/ -O - -T 5 -t 1 , Output: ctest-pod-41507255 Connecting to 10.110.118.148:80 (10.110.118.148:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 18:26:08,016 - DEBUG - [Pod Pod ctest-pod-76503897] Cmd wget http://10.110.118.148:80/ -O - -T 5 -t 1 passed 2024-08-26 18:26:08,017 - DEBUG - [Pod Pod ctest-pod-76503897] Cmd output: ctest-pod-41507255 Connecting to 10.110.118.148:80 (10.110.118.148:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 18:26:08,017 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-96824332': 1, 'ctest-pod-41507255': 1} 2024-08-26 18:26:13,061 - DEBUG - [Pod ctest-pod-69606222] Cmd: wget http://10.110.118.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:26:13,062 - DEBUG - [Pod Pod ctest-pod-69606222] Cmd wget http://10.110.118.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:26:13,062 - DEBUG - [Pod Pod ctest-pod-69606222] Cmd output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:26:18,215 - DEBUG - [Pod ctest-pod-69606222] Cmd: wget http://10.110.118.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:26:18,216 - DEBUG - [Pod Pod ctest-pod-69606222] Cmd wget http://10.110.118.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:26:18,216 - DEBUG - [Pod Pod ctest-pod-69606222] Cmd output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:26:23,286 - DEBUG - [Pod ctest-pod-69606222] Cmd: wget http://10.110.118.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:26:23,286 - DEBUG - [Pod Pod ctest-pod-69606222] Cmd wget http://10.110.118.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:26:23,286 - DEBUG - [Pod Pod ctest-pod-69606222] Cmd output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:26:28,350 - DEBUG - [Pod ctest-pod-69606222] Cmd: wget http://10.110.118.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:26:28,350 - DEBUG - [Pod Pod ctest-pod-69606222] Cmd wget http://10.110.118.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:26:28,350 - DEBUG - [Pod Pod ctest-pod-69606222] Cmd output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:26:34,973 - DEBUG - [Pod ctest-pod-69606222] Cmd: wget http://10.110.118.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:26:34,973 - DEBUG - [Pod Pod ctest-pod-69606222] Cmd wget http://10.110.118.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:26:34,973 - DEBUG - [Pod Pod ctest-pod-69606222] Cmd output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:26:40,041 - DEBUG - [Pod ctest-pod-69606222] Cmd: wget http://10.110.118.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:26:40,041 - DEBUG - [Pod Pod ctest-pod-69606222] Cmd wget http://10.110.118.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:26:40,041 - DEBUG - [Pod Pod ctest-pod-69606222] Cmd output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:26:45,101 - DEBUG - [Pod ctest-pod-69606222] Cmd: wget http://10.110.118.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:26:45,101 - DEBUG - [Pod Pod ctest-pod-69606222] Cmd wget http://10.110.118.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:26:45,101 - DEBUG - [Pod Pod ctest-pod-69606222] Cmd output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:26:50,164 - DEBUG - [Pod ctest-pod-69606222] Cmd: wget http://10.110.118.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:26:50,164 - DEBUG - [Pod Pod ctest-pod-69606222] Cmd wget http://10.110.118.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:26:50,164 - DEBUG - [Pod Pod ctest-pod-69606222] Cmd output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:26:55,240 - DEBUG - [Pod ctest-pod-69606222] Cmd: wget http://10.110.118.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:26:55,240 - DEBUG - [Pod Pod ctest-pod-69606222] Cmd wget http://10.110.118.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:26:55,240 - DEBUG - [Pod Pod ctest-pod-69606222] Cmd output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:27:00,294 - DEBUG - [Pod ctest-pod-69606222] Cmd: wget http://10.110.118.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:27:00,295 - DEBUG - [Pod Pod ctest-pod-69606222] Cmd wget http://10.110.118.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:27:00,295 - DEBUG - [Pod Pod ctest-pod-69606222] Cmd output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:27:00,295 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-96824332': 0, 'ctest-pod-41507255': 0} 2024-08-26 18:27:02,374 - DEBUG - [Pod ctest-pod-76503897] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.473 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.065 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.094 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.065/0.210/0.473 ms 2024-08-26 18:27:02,374 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-76503897 with expectation True passed 2024-08-26 18:27:04,434 - DEBUG - [Pod ctest-pod-11161580] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.585 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.068 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.077 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.068/0.243/0.585 ms 2024-08-26 18:27:04,434 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-11161580 with expectation True passed 2024-08-26 18:27:06,558 - DEBUG - [Pod ctest-pod-69606222] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.357 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.075 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.075 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.075/0.169/0.357 ms 2024-08-26 18:27:06,558 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-69606222 with expectation True passed 2024-08-26 18:27:06,728 - DEBUG - [Pod ctest-pod-76503897] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-26 18:27:06,729 - DEBUG - [Pod Pod ctest-pod-76503897] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-08-26 18:27:06,729 - DEBUG - [Pod Pod ctest-pod-76503897] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-26 18:27:06,729 - INFO - wget check of of http://10.47.255.251 from ctest-pod-76503897 passed 2024-08-26 18:27:06,888 - DEBUG - [Pod ctest-pod-76503897] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-26 18:27:06,888 - DEBUG - [Pod Pod ctest-pod-76503897] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-08-26 18:27:06,888 - DEBUG - [Pod Pod ctest-pod-76503897] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-26 18:27:06,888 - INFO - wget check of of http://10.47.255.250 from ctest-pod-76503897 passed 2024-08-26 18:27:11,977 - DEBUG - [Pod ctest-pod-11161580] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-26 18:27:11,978 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-26 18:27:11,978 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-26 18:27:11,978 - INFO - wget check of of http://10.47.255.250 from ctest-pod-11161580 passed 2024-08-26 18:27:17,069 - DEBUG - [Pod ctest-pod-73224079] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-08-26 18:27:17,069 - DEBUG - [Pod Pod ctest-pod-73224079] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-08-26 18:27:17,069 - DEBUG - [Pod Pod ctest-pod-73224079] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-08-26 18:27:17,069 - INFO - wget check of of http://10.47.255.251 from ctest-pod-73224079 passed 2024-08-26 18:27:17,079 - INFO - Updating Network Policy ingress-on-service 2024-08-26 18:27:22,140 - DEBUG - [Pod ctest-pod-11161580] Cmd: wget http://10.110.118.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:27:22,141 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd wget http://10.110.118.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:27:22,141 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:27:27,217 - DEBUG - [Pod ctest-pod-11161580] Cmd: wget http://10.110.118.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:27:27,217 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd wget http://10.110.118.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:27:27,217 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:27:32,281 - DEBUG - [Pod ctest-pod-11161580] Cmd: wget http://10.110.118.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:27:32,281 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd wget http://10.110.118.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:27:32,281 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:27:37,353 - DEBUG - [Pod ctest-pod-11161580] Cmd: wget http://10.110.118.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:27:37,353 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd wget http://10.110.118.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:27:37,353 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:27:42,409 - DEBUG - [Pod ctest-pod-11161580] Cmd: wget http://10.110.118.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:27:42,409 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd wget http://10.110.118.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:27:42,409 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:27:47,467 - DEBUG - [Pod ctest-pod-11161580] Cmd: wget http://10.110.118.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:27:47,467 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd wget http://10.110.118.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:27:47,467 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:27:52,514 - DEBUG - [Pod ctest-pod-11161580] Cmd: wget http://10.110.118.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:27:52,514 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd wget http://10.110.118.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:27:52,514 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:27:57,565 - DEBUG - [Pod ctest-pod-11161580] Cmd: wget http://10.110.118.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:27:57,565 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd wget http://10.110.118.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:27:57,565 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:28:02,626 - DEBUG - [Pod ctest-pod-11161580] Cmd: wget http://10.110.118.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:28:02,626 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd wget http://10.110.118.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:28:02,626 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:28:07,693 - DEBUG - [Pod ctest-pod-11161580] Cmd: wget http://10.110.118.148:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:28:07,693 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd wget http://10.110.118.148:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:28:07,693 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd output: Connecting to 10.110.118.148:80 (10.110.118.148:80) wget: download timed out 2024-08-26 18:28:07,693 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-96824332': 0, 'ctest-pod-41507255': 0} 2024-08-26 18:28:07,742 - DEBUG - [Pod ctest-pod-76503897] Cmd: wget http://10.110.118.148:80/ -O - -T 5 -t 1 , Output: ctest-pod-41507255 Connecting to 10.110.118.148:80 (10.110.118.148:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 18:28:07,742 - DEBUG - [Pod Pod ctest-pod-76503897] Cmd wget http://10.110.118.148:80/ -O - -T 5 -t 1 passed 2024-08-26 18:28:07,742 - DEBUG - [Pod Pod ctest-pod-76503897] Cmd output: ctest-pod-41507255 Connecting to 10.110.118.148:80 (10.110.118.148:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 18:28:07,795 - DEBUG - [Pod ctest-pod-76503897] Cmd: wget http://10.110.118.148:80/ -O - -T 5 -t 1 , Output: ctest-pod-41507255 Connecting to 10.110.118.148:80 (10.110.118.148:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 18:28:07,795 - DEBUG - [Pod Pod ctest-pod-76503897] Cmd wget http://10.110.118.148:80/ -O - -T 5 -t 1 passed 2024-08-26 18:28:07,795 - DEBUG - [Pod Pod ctest-pod-76503897] Cmd output: ctest-pod-41507255 Connecting to 10.110.118.148:80 (10.110.118.148:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 18:28:07,868 - DEBUG - [Pod ctest-pod-76503897] Cmd: wget http://10.110.118.148:80/ -O - -T 5 -t 1 , Output: ctest-pod-41507255 Connecting to 10.110.118.148:80 (10.110.118.148:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 18:28:07,869 - DEBUG - [Pod Pod ctest-pod-76503897] Cmd wget http://10.110.118.148:80/ -O - -T 5 -t 1 passed 2024-08-26 18:28:07,869 - DEBUG - [Pod Pod ctest-pod-76503897] Cmd output: ctest-pod-41507255 Connecting to 10.110.118.148:80 (10.110.118.148:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 18:28:07,932 - DEBUG - [Pod ctest-pod-76503897] Cmd: wget http://10.110.118.148:80/ -O - -T 5 -t 1 , Output: ctest-pod-96824332 Connecting to 10.110.118.148:80 (10.110.118.148:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 18:28:07,932 - DEBUG - [Pod Pod ctest-pod-76503897] Cmd wget http://10.110.118.148:80/ -O - -T 5 -t 1 passed 2024-08-26 18:28:07,932 - DEBUG - [Pod Pod ctest-pod-76503897] Cmd output: ctest-pod-96824332 Connecting to 10.110.118.148:80 (10.110.118.148:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 18:28:07,932 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-96824332': 1, 'ctest-pod-41507255': 3} 2024-08-26 18:28:07,996 - DEBUG - [Pod ctest-pod-69606222] Cmd: wget http://10.110.118.148:80/ -O - -T 5 -t 1 , Output: ctest-pod-41507255 Connecting to 10.110.118.148:80 (10.110.118.148:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 18:28:07,996 - DEBUG - [Pod Pod ctest-pod-69606222] Cmd wget http://10.110.118.148:80/ -O - -T 5 -t 1 passed 2024-08-26 18:28:07,996 - DEBUG - [Pod Pod ctest-pod-69606222] Cmd output: ctest-pod-41507255 Connecting to 10.110.118.148:80 (10.110.118.148:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 18:28:08,059 - DEBUG - [Pod ctest-pod-69606222] Cmd: wget http://10.110.118.148:80/ -O - -T 5 -t 1 , Output: ctest-pod-96824332 Connecting to 10.110.118.148:80 (10.110.118.148:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 18:28:08,059 - DEBUG - [Pod Pod ctest-pod-69606222] Cmd wget http://10.110.118.148:80/ -O - -T 5 -t 1 passed 2024-08-26 18:28:08,060 - DEBUG - [Pod Pod ctest-pod-69606222] Cmd output: ctest-pod-96824332 Connecting to 10.110.118.148:80 (10.110.118.148:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 18:28:08,060 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-96824332': 1, 'ctest-pod-41507255': 1} 2024-08-26 18:28:10,124 - DEBUG - [Pod ctest-pod-76503897] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.377 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.088 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.084 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.084/0.183/0.377 ms 2024-08-26 18:28:10,125 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-76503897 with expectation True passed 2024-08-26 18:28:12,196 - DEBUG - [Pod ctest-pod-11161580] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.674 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.072 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.076 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.072/0.607/1.674 ms 2024-08-26 18:28:12,196 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-11161580 with expectation True passed 2024-08-26 18:28:14,311 - DEBUG - [Pod ctest-pod-69606222] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.372 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.069 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.100 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.069/0.180/0.372 ms 2024-08-26 18:28:14,311 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-69606222 with expectation True passed 2024-08-26 18:28:14,437 - DEBUG - [Pod ctest-pod-76503897] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-26 18:28:14,437 - DEBUG - [Pod Pod ctest-pod-76503897] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-08-26 18:28:14,437 - DEBUG - [Pod Pod ctest-pod-76503897] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-26 18:28:14,437 - INFO - wget check of of http://10.47.255.251 from ctest-pod-76503897 passed 2024-08-26 18:28:14,533 - DEBUG - [Pod ctest-pod-76503897] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-26 18:28:14,533 - DEBUG - [Pod Pod ctest-pod-76503897] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-08-26 18:28:14,533 - DEBUG - [Pod Pod ctest-pod-76503897] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-26 18:28:14,533 - INFO - wget check of of http://10.47.255.250 from ctest-pod-76503897 passed 2024-08-26 18:28:19,605 - DEBUG - [Pod ctest-pod-11161580] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-26 18:28:19,606 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-26 18:28:19,606 - DEBUG - [Pod Pod ctest-pod-11161580] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-26 18:28:19,606 - INFO - wget check of of http://10.47.255.250 from ctest-pod-11161580 passed 2024-08-26 18:28:20,038 - DEBUG - [Pod ctest-pod-73224079] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-26 18:28:20,038 - DEBUG - [Pod Pod ctest-pod-73224079] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-08-26 18:28:20,038 - DEBUG - [Pod Pod ctest-pod-73224079] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-26 18:28:20,038 - INFO - wget check of of http://10.47.255.251 from ctest-pod-73224079 passed 2024-08-26 18:28:20,038 - INFO - Deleting Network Policy : ingress-on-service 2024-08-26 18:28:20,039 - INFO - Deleting service : ctest-nginx-svc-63328746 2024-08-26 18:28:20,326 - DEBUG - No XMPP flaps were noticed during the test 2024-08-26 18:28:20,326 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:09] 2024-08-26 18:28:20,326 - INFO - -------------------------------------------------------------------------------- 2024-08-26 18:28:20,331 - INFO - Deleting pod ctest-new-default-52523801:ctest-pod-96824332 2024-08-26 18:28:20,332 - INFO - Deleting pod ctest-new-default-52523801:ctest-pod-41507255 2024-08-26 18:28:20,332 - INFO - Deleting pod ctest-non-default-57568270:ctest-pod-85760854 2024-08-26 18:28:20,332 - INFO - Deleting pod ctest-non-default-57568270:ctest-pod-39467445 2024-08-26 18:28:20,333 - INFO - Deleting pod ctest-new-default-52523801:ctest-pod-11161580 2024-08-26 18:28:20,333 - INFO - Deleting pod ctest-new-default-52523801:ctest-pod-76503897 2024-08-26 18:28:20,333 - INFO - Deleting pod ctest-non-default-57568270:ctest-pod-69606222 2024-08-26 18:28:20,334 - INFO - Deleting pod ctest-non-default-57568270:ctest-pod-73224079 2024-08-26 18:28:20,468 - WARNING - Pod uuid 255f6d65-9ce7-4ee2-bceb-6b935563d776 is still seen in agent 10.0.0.22 VM list 2024-08-26 18:28:20,470 - WARNING - Pod uuid ede303ac-0b2d-43ec-9ac5-1a067cc766e3 is still seen in agent 10.0.0.22 VM list 2024-08-26 18:28:20,470 - WARNING - Pod uuid 04195f7c-592b-407a-a87c-d5686480625a is still seen in agent 10.0.0.22 VM list 2024-08-26 18:28:20,471 - WARNING - Pod uuid 68fcf69f-dc16-4a04-a80a-3b8421aeb119 is still seen in agent 10.0.0.22 VM list 2024-08-26 18:28:20,471 - WARNING - Pod uuid 0175ecb0-d55f-445e-a5aa-2f9d4169b3b3 is still seen in agent 10.0.0.22 VM list 2024-08-26 18:28:20,471 - WARNING - Pod uuid fec59144-a49a-48f9-a9b5-ef7669135efd is still seen in agent 10.0.0.22 VM list 2024-08-26 18:28:20,472 - WARNING - Pod uuid efbcf20e-954d-4d82-bc0b-220344a89507 is still seen in agent 10.0.0.22 VM list 2024-08-26 18:28:20,472 - WARNING - Pod uuid 1106d962-5b73-4b1b-adc3-22119d58f9db is still seen in agent 10.0.0.22 VM list 2024-08-26 18:28:25,528 - WARNING - Pod uuid 255f6d65-9ce7-4ee2-bceb-6b935563d776 is still seen in agent 10.0.0.22 VM list 2024-08-26 18:28:25,530 - DEBUG - Pod 68fcf69f-dc16-4a04-a80a-3b8421aeb119 is not in agent 10.0.0.22 VM list 2024-08-26 18:28:25,531 - WARNING - Pod uuid ede303ac-0b2d-43ec-9ac5-1a067cc766e3 is still seen in agent 10.0.0.22 VM list 2024-08-26 18:28:25,532 - DEBUG - Pod 0175ecb0-d55f-445e-a5aa-2f9d4169b3b3 is not in agent 10.0.0.22 VM list 2024-08-26 18:28:25,533 - WARNING - Pod uuid fec59144-a49a-48f9-a9b5-ef7669135efd is still seen in agent 10.0.0.22 VM list 2024-08-26 18:28:25,533 - DEBUG - Pod 1106d962-5b73-4b1b-adc3-22119d58f9db is not in agent 10.0.0.22 VM list 2024-08-26 18:28:25,535 - WARNING - Pod uuid efbcf20e-954d-4d82-bc0b-220344a89507 is still seen in agent 10.0.0.22 VM list 2024-08-26 18:28:25,535 - DEBUG - Pod 04195f7c-592b-407a-a87c-d5686480625a is not in agent 10.0.0.22 VM list 2024-08-26 18:28:25,560 - DEBUG - VMI 7bd5c7aa-63d8-11ef-b2c1-fa163e03482c is removed from agent 10.0.0.22 2024-08-26 18:28:25,560 - INFO - Verified that pod ctest-pod-96824332 is removed in agent 2024-08-26 18:28:25,563 - DEBUG - VMI 7d359274-63d8-11ef-b2c1-fa163e03482c is removed from agent 10.0.0.22 2024-08-26 18:28:25,563 - INFO - Verified that pod ctest-pod-85760854 is removed in agent 2024-08-26 18:28:25,564 - DEBUG - VMI 7da7bd04-63d8-11ef-b2c1-fa163e03482c is removed from agent 10.0.0.22 2024-08-26 18:28:25,564 - INFO - Verified that pod ctest-pod-39467445 is removed in agent 2024-08-26 18:28:25,564 - DEBUG - VMI 7c52171a-63d8-11ef-b2c1-fa163e03482c is removed from agent 10.0.0.22 2024-08-26 18:28:25,564 - INFO - Verified that pod ctest-pod-41507255 is removed in agent 2024-08-26 18:28:30,537 - WARNING - Pod uuid 255f6d65-9ce7-4ee2-bceb-6b935563d776 is still seen in agent 10.0.0.22 VM list 2024-08-26 18:28:30,548 - WARNING - Pod uuid ede303ac-0b2d-43ec-9ac5-1a067cc766e3 is still seen in agent 10.0.0.22 VM list 2024-08-26 18:28:30,549 - WARNING - Pod uuid efbcf20e-954d-4d82-bc0b-220344a89507 is still seen in agent 10.0.0.22 VM list 2024-08-26 18:28:30,549 - WARNING - Pod uuid fec59144-a49a-48f9-a9b5-ef7669135efd is still seen in agent 10.0.0.22 VM list 2024-08-26 18:28:35,563 - WARNING - Pod uuid 255f6d65-9ce7-4ee2-bceb-6b935563d776 is still seen in agent 10.0.0.22 VM list 2024-08-26 18:28:35,621 - WARNING - Pod uuid efbcf20e-954d-4d82-bc0b-220344a89507 is still seen in agent 10.0.0.22 VM list 2024-08-26 18:28:35,622 - WARNING - Pod uuid ede303ac-0b2d-43ec-9ac5-1a067cc766e3 is still seen in agent 10.0.0.22 VM list 2024-08-26 18:28:35,623 - WARNING - Pod uuid fec59144-a49a-48f9-a9b5-ef7669135efd is still seen in agent 10.0.0.22 VM list 2024-08-26 18:28:40,572 - WARNING - Pod uuid 255f6d65-9ce7-4ee2-bceb-6b935563d776 is still seen in agent 10.0.0.22 VM list 2024-08-26 18:28:40,636 - WARNING - Pod uuid efbcf20e-954d-4d82-bc0b-220344a89507 is still seen in agent 10.0.0.22 VM list 2024-08-26 18:28:40,638 - WARNING - Pod uuid fec59144-a49a-48f9-a9b5-ef7669135efd is still seen in agent 10.0.0.22 VM list 2024-08-26 18:28:40,639 - WARNING - Pod uuid ede303ac-0b2d-43ec-9ac5-1a067cc766e3 is still seen in agent 10.0.0.22 VM list 2024-08-26 18:28:45,580 - WARNING - Pod uuid 255f6d65-9ce7-4ee2-bceb-6b935563d776 is still seen in agent 10.0.0.22 VM list 2024-08-26 18:28:45,653 - WARNING - Pod uuid efbcf20e-954d-4d82-bc0b-220344a89507 is still seen in agent 10.0.0.22 VM list 2024-08-26 18:28:45,655 - WARNING - Pod uuid fec59144-a49a-48f9-a9b5-ef7669135efd is still seen in agent 10.0.0.22 VM list 2024-08-26 18:28:45,655 - WARNING - Pod uuid ede303ac-0b2d-43ec-9ac5-1a067cc766e3 is still seen in agent 10.0.0.22 VM list 2024-08-26 18:28:50,587 - WARNING - Pod uuid 255f6d65-9ce7-4ee2-bceb-6b935563d776 is still seen in agent 10.0.0.22 VM list 2024-08-26 18:28:50,674 - WARNING - Pod uuid fec59144-a49a-48f9-a9b5-ef7669135efd is still seen in agent 10.0.0.22 VM list 2024-08-26 18:28:50,676 - WARNING - Pod uuid efbcf20e-954d-4d82-bc0b-220344a89507 is still seen in agent 10.0.0.22 VM list 2024-08-26 18:28:50,677 - WARNING - Pod uuid ede303ac-0b2d-43ec-9ac5-1a067cc766e3 is still seen in agent 10.0.0.22 VM list 2024-08-26 18:28:55,597 - DEBUG - Pod 255f6d65-9ce7-4ee2-bceb-6b935563d776 is not in agent 10.0.0.22 VM list 2024-08-26 18:28:55,606 - DEBUG - VMI 7f01c190-63d8-11ef-b2c1-fa163e03482c is removed from agent 10.0.0.22 2024-08-26 18:28:55,606 - INFO - Verified that pod ctest-pod-69606222 is removed in agent 2024-08-26 18:28:55,695 - DEBUG - Pod fec59144-a49a-48f9-a9b5-ef7669135efd is not in agent 10.0.0.22 VM list 2024-08-26 18:28:55,696 - DEBUG - Pod ede303ac-0b2d-43ec-9ac5-1a067cc766e3 is not in agent 10.0.0.22 VM list 2024-08-26 18:28:55,699 - DEBUG - Pod efbcf20e-954d-4d82-bc0b-220344a89507 is not in agent 10.0.0.22 VM list 2024-08-26 18:28:55,714 - DEBUG - VMI 7f681d6e-63d8-11ef-b2c1-fa163e03482c is removed from agent 10.0.0.22 2024-08-26 18:28:55,714 - INFO - Verified that pod ctest-pod-73224079 is removed in agent 2024-08-26 18:28:55,716 - DEBUG - VMI 7e941686-63d8-11ef-b2c1-fa163e03482c is removed from agent 10.0.0.22 2024-08-26 18:28:55,716 - INFO - Verified that pod ctest-pod-76503897 is removed in agent 2024-08-26 18:28:55,717 - DEBUG - VMI 7e291764-63d8-11ef-b2c1-fa163e03482c is removed from agent 10.0.0.22 2024-08-26 18:28:55,717 - INFO - Verified that pod ctest-pod-11161580 is removed in agent 2024-08-26 18:28:55,717 - INFO - Deleting namespace ctest-non-default-57568270 2024-08-26 18:28:55,740 - DEBUG - Namespace ctest-non-default-57568270 still in k8s 2024-08-26 18:28:57,819 - DEBUG - Namespace ctest-non-default-57568270 still in k8s 2024-08-26 18:28:59,828 - DEBUG - Namespace ctest-non-default-57568270 still in k8s 2024-08-26 18:29:01,833 - DEBUG - Namespace ctest-non-default-57568270 is not in k8s 2024-08-26 18:29:01,833 - DEBUG - No need to check project deletion in contrail-api 2024-08-26 18:29:01,834 - INFO - Deleting namespace ctest-new-default-52523801 2024-08-26 18:29:01,849 - DEBUG - Namespace ctest-new-default-52523801 still in k8s 2024-08-26 18:29:03,861 - DEBUG - Namespace ctest-new-default-52523801 still in k8s 2024-08-26 18:29:05,875 - DEBUG - Namespace ctest-new-default-52523801 still in k8s 2024-08-26 18:29:07,878 - DEBUG - Namespace ctest-new-default-52523801 is not in k8s 2024-08-26 18:29:07,878 - DEBUG - No need to check project deletion in contrail-api