2024-09-05 02:06:09,216 - INFO - Using existing project ['default-domain', 'k8s-default'](a0e4bf3d-27f8-40eb-bf05-cfd58f60631a) 2024-09-05 02:06:09,248 - DEBUG - Namespace ctest-new-default-43514173 not present 2024-09-05 02:06:09,265 - INFO - Created namespace ctest-new-default-43514173 2024-09-05 02:06:12,270 - DEBUG - Namespace ctest-non-default-06901807 not present 2024-09-05 02:06:12,297 - INFO - Created namespace ctest-non-default-06901807 2024-09-05 02:06:15,324 - DEBUG - Pod ctest-pod-04448141 not present 2024-09-05 02:06:15,324 - INFO - Creating Pod ctest-pod-04448141 2024-09-05 02:06:15,358 - DEBUG - Pod : ctest-pod-04448141 UUID is 10d1d686-bc95-4ce4-b7b7-a1b5ca4a1246 2024-09-05 02:06:15,371 - DEBUG - Pod ctest-pod-14860522 not present 2024-09-05 02:06:15,371 - INFO - Creating Pod ctest-pod-14860522 2024-09-05 02:06:15,392 - DEBUG - Pod : ctest-pod-14860522 UUID is 1591cfe0-6923-4e88-812a-d0d2a98d6d27 2024-09-05 02:06:15,400 - DEBUG - Pod ctest-pod-94752766 not present 2024-09-05 02:06:15,400 - INFO - Creating Pod ctest-pod-94752766 2024-09-05 02:06:15,426 - DEBUG - Pod : ctest-pod-94752766 UUID is 7f5c302c-6d5b-4c98-91ef-a02b305f4e02 2024-09-05 02:06:15,430 - DEBUG - Pod ctest-pod-95273448 not present 2024-09-05 02:06:15,430 - INFO - Creating Pod ctest-pod-95273448 2024-09-05 02:06:15,464 - DEBUG - Pod : ctest-pod-95273448 UUID is 6ae4fb3d-4b65-4095-b23e-03b5b35f19c6 2024-09-05 02:06:15,482 - DEBUG - Pod ctest-pod-17612217 not present 2024-09-05 02:06:15,483 - INFO - Creating Pod ctest-pod-17612217 2024-09-05 02:06:15,508 - DEBUG - Pod : ctest-pod-17612217 UUID is 2a7c90c3-7097-4f51-875c-b2289c22ab5f 2024-09-05 02:06:15,512 - DEBUG - Pod ctest-pod-16835317 not present 2024-09-05 02:06:15,512 - INFO - Creating Pod ctest-pod-16835317 2024-09-05 02:06:15,543 - DEBUG - Pod : ctest-pod-16835317 UUID is 44a31100-0045-41b6-bc5f-779ed9dbef87 2024-09-05 02:06:15,549 - DEBUG - Pod ctest-pod-29350020 not present 2024-09-05 02:06:15,549 - INFO - Creating Pod ctest-pod-29350020 2024-09-05 02:06:15,573 - DEBUG - Pod : ctest-pod-29350020 UUID is 0b61a478-9dab-4ac6-9858-76bef1e1733e 2024-09-05 02:06:15,576 - DEBUG - Pod ctest-pod-26055894 not present 2024-09-05 02:06:15,576 - INFO - Creating Pod ctest-pod-26055894 2024-09-05 02:06:15,614 - DEBUG - Pod : ctest-pod-26055894 UUID is 413a2543-946e-4eb3-8ad6-32f19befe7e4 2024-09-05 02:06:16,075 - INFO - Project default-domain:k8s-ctest-new-default-43514173 for Namespace ctest-new-default-43514173 is seen in contrail-api 2024-09-05 02:06:16,075 - DEBUG - Project uuid in Contrail is 2ec56946-74d6-4071-bd02-3b33018a7386 2024-09-05 02:06:16,583 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_NamespaceDatabaseList?namespace_uuid=e1f4dd92-7e8c-44da-846b-146cf71609e6 2024-09-05 02:06:16,592 - INFO - Namespace ctest-new-default-43514173 with uuid e1f4dd92-7e8c-44da-846b-146cf71609e6 found in kube manager 2024-09-05 02:06:16,592 - INFO - Namespace ctest-new-default-43514173 verification passed 2024-09-05 02:06:17,042 - INFO - Project default-domain:k8s-ctest-non-default-06901807 for Namespace ctest-non-default-06901807 is seen in contrail-api 2024-09-05 02:06:17,042 - DEBUG - Project uuid in Contrail is 4b2763a7-f25f-4877-a66b-354545717c30 2024-09-05 02:06:17,042 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_NamespaceDatabaseList?namespace_uuid=419ad512-7055-4dc6-8006-b0894c780b96 2024-09-05 02:06:17,048 - INFO - Namespace ctest-non-default-06901807 with uuid 419ad512-7055-4dc6-8006-b0894c780b96 found in kube manager 2024-09-05 02:06:17,049 - INFO - Namespace ctest-non-default-06901807 verification passed 2024-09-05 02:06:17,058 - DEBUG - Pod ctest-pod-04448141 not in running state.Currently in Pending 2024-09-05 02:06:22,072 - DEBUG - Pod ctest-pod-04448141 not in running state.Currently in Pending 2024-09-05 02:06:27,081 - INFO - Pod ctest-pod-04448141 is in running state.Got IP 10.47.255.250 2024-09-05 02:06:27,136 - DEBUG - Pod ctest-pod-04448141 has vmi 708dd450-6b2b-11ef-9024-0242efb382f1 2024-09-05 02:06:27,136 - INFO - Verified pod ctest-pod-04448141 in contrail-api 2024-09-05 02:06:27,154 - DEBUG - VMI 708dd450-6b2b-11ef-9024-0242efb382f1 is active in agent 10.0.0.28 2024-09-05 02:06:27,154 - INFO - Verified Pod ctest-pod-04448141 in agent 10.0.0.28 2024-09-05 02:06:27,154 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_VirtualMachineDatabaseList?x=10d1d686-bc95-4ce4-b7b7-a1b5ca4a1246 2024-09-05 02:06:27,160 - INFO - Pod ctest-pod-04448141 with uuid 10d1d686-bc95-4ce4-b7b7-a1b5ca4a1246 found in kube manager 2024-09-05 02:06:27,160 - INFO - Pod ctest-pod-04448141 verification passed 2024-09-05 02:06:27,167 - INFO - Pod ctest-pod-14860522 is in running state.Got IP 10.47.255.249 2024-09-05 02:06:27,275 - DEBUG - Pod ctest-pod-14860522 has vmi 715d0126-6b2b-11ef-9024-0242efb382f1 2024-09-05 02:06:27,275 - INFO - Verified pod ctest-pod-14860522 in contrail-api 2024-09-05 02:06:27,290 - DEBUG - VMI 715d0126-6b2b-11ef-9024-0242efb382f1 is active in agent 10.0.0.28 2024-09-05 02:06:27,290 - INFO - Verified Pod ctest-pod-14860522 in agent 10.0.0.28 2024-09-05 02:06:27,292 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_VirtualMachineDatabaseList?x=1591cfe0-6923-4e88-812a-d0d2a98d6d27 2024-09-05 02:06:27,298 - INFO - Pod ctest-pod-14860522 with uuid 1591cfe0-6923-4e88-812a-d0d2a98d6d27 found in kube manager 2024-09-05 02:06:27,298 - INFO - Pod ctest-pod-14860522 verification passed 2024-09-05 02:06:27,306 - DEBUG - Pod ctest-pod-94752766 not in running state.Currently in Pending 2024-09-05 02:06:32,315 - DEBUG - Pod ctest-pod-94752766 not in running state.Currently in Pending 2024-09-05 02:06:37,396 - INFO - Pod ctest-pod-94752766 is in running state.Got IP 10.47.255.248 2024-09-05 02:06:37,469 - DEBUG - Pod ctest-pod-94752766 has vmi 7265f6ea-6b2b-11ef-9024-0242efb382f1 2024-09-05 02:06:37,469 - INFO - Verified pod ctest-pod-94752766 in contrail-api 2024-09-05 02:06:37,491 - DEBUG - VMI 7265f6ea-6b2b-11ef-9024-0242efb382f1 is active in agent 10.0.0.28 2024-09-05 02:06:37,492 - INFO - Verified Pod ctest-pod-94752766 in agent 10.0.0.28 2024-09-05 02:06:37,492 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_VirtualMachineDatabaseList?x=7f5c302c-6d5b-4c98-91ef-a02b305f4e02 2024-09-05 02:06:37,502 - INFO - Pod ctest-pod-94752766 with uuid 7f5c302c-6d5b-4c98-91ef-a02b305f4e02 found in kube manager 2024-09-05 02:06:37,502 - INFO - Pod ctest-pod-94752766 verification passed 2024-09-05 02:06:37,509 - INFO - Pod ctest-pod-95273448 is in running state.Got IP 10.47.255.247 2024-09-05 02:06:37,568 - DEBUG - Pod ctest-pod-95273448 has vmi 7339be1c-6b2b-11ef-9024-0242efb382f1 2024-09-05 02:06:37,568 - INFO - Verified pod ctest-pod-95273448 in contrail-api 2024-09-05 02:06:37,586 - DEBUG - VMI 7339be1c-6b2b-11ef-9024-0242efb382f1 is active in agent 10.0.0.28 2024-09-05 02:06:37,586 - INFO - Verified Pod ctest-pod-95273448 in agent 10.0.0.28 2024-09-05 02:06:37,586 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_VirtualMachineDatabaseList?x=6ae4fb3d-4b65-4095-b23e-03b5b35f19c6 2024-09-05 02:06:37,593 - INFO - Pod ctest-pod-95273448 with uuid 6ae4fb3d-4b65-4095-b23e-03b5b35f19c6 found in kube manager 2024-09-05 02:06:37,593 - INFO - Pod ctest-pod-95273448 verification passed 2024-09-05 02:06:37,601 - INFO - Pod ctest-pod-17612217 is in running state.Got IP 10.47.255.246 2024-09-05 02:06:37,695 - DEBUG - Pod ctest-pod-17612217 has vmi 740f6756-6b2b-11ef-9024-0242efb382f1 2024-09-05 02:06:37,695 - INFO - Verified pod ctest-pod-17612217 in contrail-api 2024-09-05 02:06:37,709 - DEBUG - VMI 740f6756-6b2b-11ef-9024-0242efb382f1 is active in agent 10.0.0.28 2024-09-05 02:06:37,709 - INFO - Verified Pod ctest-pod-17612217 in agent 10.0.0.28 2024-09-05 02:06:37,709 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_VirtualMachineDatabaseList?x=2a7c90c3-7097-4f51-875c-b2289c22ab5f 2024-09-05 02:06:37,716 - INFO - Pod ctest-pod-17612217 with uuid 2a7c90c3-7097-4f51-875c-b2289c22ab5f found in kube manager 2024-09-05 02:06:37,716 - INFO - Pod ctest-pod-17612217 verification passed 2024-09-05 02:06:37,723 - DEBUG - Pod ctest-pod-29350020 not in running state.Currently in Pending 2024-09-05 02:06:42,730 - INFO - Pod ctest-pod-29350020 is in running state.Got IP 10.47.255.244 2024-09-05 02:06:42,783 - DEBUG - Pod ctest-pod-29350020 has vmi 75a7651e-6b2b-11ef-9024-0242efb382f1 2024-09-05 02:06:42,783 - INFO - Verified pod ctest-pod-29350020 in contrail-api 2024-09-05 02:06:42,798 - DEBUG - VMI 75a7651e-6b2b-11ef-9024-0242efb382f1 is active in agent 10.0.0.28 2024-09-05 02:06:42,798 - INFO - Verified Pod ctest-pod-29350020 in agent 10.0.0.28 2024-09-05 02:06:42,798 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_VirtualMachineDatabaseList?x=0b61a478-9dab-4ac6-9858-76bef1e1733e 2024-09-05 02:06:42,804 - INFO - Pod ctest-pod-29350020 with uuid 0b61a478-9dab-4ac6-9858-76bef1e1733e found in kube manager 2024-09-05 02:06:42,805 - INFO - Pod ctest-pod-29350020 verification passed 2024-09-05 02:06:42,812 - INFO - Pod ctest-pod-16835317 is in running state.Got IP 10.47.255.245 2024-09-05 02:06:42,906 - DEBUG - Pod ctest-pod-16835317 has vmi 74d87cd6-6b2b-11ef-9024-0242efb382f1 2024-09-05 02:06:42,906 - INFO - Verified pod ctest-pod-16835317 in contrail-api 2024-09-05 02:06:42,931 - DEBUG - VMI 74d87cd6-6b2b-11ef-9024-0242efb382f1 is active in agent 10.0.0.28 2024-09-05 02:06:42,932 - INFO - Verified Pod ctest-pod-16835317 in agent 10.0.0.28 2024-09-05 02:06:42,932 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_VirtualMachineDatabaseList?x=44a31100-0045-41b6-bc5f-779ed9dbef87 2024-09-05 02:06:42,940 - INFO - Pod ctest-pod-16835317 with uuid 44a31100-0045-41b6-bc5f-779ed9dbef87 found in kube manager 2024-09-05 02:06:42,940 - INFO - Pod ctest-pod-16835317 verification passed 2024-09-05 02:06:42,948 - INFO - Pod ctest-pod-26055894 is in running state.Got IP 10.47.255.243 2024-09-05 02:06:43,002 - DEBUG - Pod ctest-pod-26055894 has vmi 7677f454-6b2b-11ef-9024-0242efb382f1 2024-09-05 02:06:43,003 - INFO - Verified pod ctest-pod-26055894 in contrail-api 2024-09-05 02:06:43,019 - DEBUG - VMI 7677f454-6b2b-11ef-9024-0242efb382f1 is active in agent 10.0.0.28 2024-09-05 02:06:43,019 - INFO - Verified Pod ctest-pod-26055894 in agent 10.0.0.28 2024-09-05 02:06:43,019 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_VirtualMachineDatabaseList?x=413a2543-946e-4eb3-8ad6-32f19befe7e4 2024-09-05 02:06:43,026 - INFO - Pod ctest-pod-26055894 with uuid 413a2543-946e-4eb3-8ad6-32f19befe7e4 found in kube manager 2024-09-05 02:06:43,026 - INFO - Pod ctest-pod-26055894 verification passed 2024-09-05 02:06:43,026 - INFO - ================================================================================ 2024-09-05 02:06:43,026 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-09-05 02:06:43,027 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-09-05 02:06:43,313 - DEBUG - Nothing to compare xmpp stats {'10.0.0.28': {'10.0.0.28': '2'}} with 2024-09-05 02:06:43,313 - INFO - Initial checks done. Running the testcase now 2024-09-05 02:06:43,313 - INFO - 2024-09-05 02:06:43,404 - DEBUG - [Pod ctest-pod-04448141] Cmd: echo ctest-pod-04448141 > /usr/share/nginx/html/index.html, Output: 2024-09-05 02:06:43,484 - DEBUG - [Pod ctest-pod-14860522] Cmd: echo ctest-pod-14860522 > /usr/share/nginx/html/index.html, Output: 2024-09-05 02:06:43,561 - DEBUG - [Pod ctest-pod-94752766] Cmd: echo ctest-pod-94752766 > /usr/share/nginx/html/index.html, Output: 2024-09-05 02:06:43,639 - DEBUG - [Pod ctest-pod-95273448] Cmd: echo ctest-pod-95273448 > /usr/share/nginx/html/index.html, Output: 2024-09-05 02:06:43,643 - DEBUG - Service ctest-nginx-svc-95335518 not present 2024-09-05 02:06:43,643 - INFO - Creating service ctest-nginx-svc-95335518 2024-09-05 02:06:43,661 - INFO - Created Service ctest-nginx-svc-95335518 2024-09-05 02:06:43,668 - WARNING - Service UUID 370f3566-2c2d-48d2-a4c5-2118aaffe195 not yet found in contrail-api 2024-09-05 02:06:44,675 - INFO - Validated that Service ctest-nginx-svc-95335518 is seen in contrail-api 2024-09-05 02:06:44,675 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_LoadbalancerDatabaseList?x=370f3566-2c2d-48d2-a4c5-2118aaffe195 2024-09-05 02:06:44,683 - INFO - Service ctest-nginx-svc-95335518 with uuid 370f3566-2c2d-48d2-a4c5-2118aaffe195 found in kube manager 2024-09-05 02:06:44,683 - INFO - Service ctest-nginx-svc-95335518 verification passed 2024-09-05 02:06:45,839 - DEBUG - [Pod ctest-pod-17612217] Cmd: wget http://10.98.4.191:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.4.191:80 (10.98.4.191:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-14860522 2024-09-05 02:06:45,840 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd wget http://10.98.4.191:80/ -O - -T 5 -t 1 passed 2024-09-05 02:06:45,840 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd output: Connecting to 10.98.4.191:80 (10.98.4.191:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-14860522 2024-09-05 02:06:45,938 - DEBUG - [Pod ctest-pod-17612217] Cmd: wget http://10.98.4.191:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.4.191:80 (10.98.4.191:80) writing to stdout ctest-pod-04448141 - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 02:06:45,938 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd wget http://10.98.4.191:80/ -O - -T 5 -t 1 passed 2024-09-05 02:06:45,938 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd output: Connecting to 10.98.4.191:80 (10.98.4.191:80) writing to stdout ctest-pod-04448141 - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 02:06:45,938 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-04448141': 1, 'ctest-pod-14860522': 1} 2024-09-05 02:06:46,031 - DEBUG - [Pod ctest-pod-29350020] Cmd: wget http://10.98.4.191:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.4.191:80 (10.98.4.191:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-14860522 2024-09-05 02:06:46,031 - DEBUG - [Pod Pod ctest-pod-29350020] Cmd wget http://10.98.4.191:80/ -O - -T 5 -t 1 passed 2024-09-05 02:06:46,031 - DEBUG - [Pod Pod ctest-pod-29350020] Cmd output: Connecting to 10.98.4.191:80 (10.98.4.191:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-14860522 2024-09-05 02:06:46,111 - DEBUG - [Pod ctest-pod-29350020] Cmd: wget http://10.98.4.191:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.4.191:80 (10.98.4.191:80) ctest-pod-04448141 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 02:06:46,111 - DEBUG - [Pod Pod ctest-pod-29350020] Cmd wget http://10.98.4.191:80/ -O - -T 5 -t 1 passed 2024-09-05 02:06:46,111 - DEBUG - [Pod Pod ctest-pod-29350020] Cmd output: Connecting to 10.98.4.191:80 (10.98.4.191:80) ctest-pod-04448141 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 02:06:46,111 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-04448141': 1, 'ctest-pod-14860522': 1} 2024-09-05 02:06:46,115 - DEBUG - Network policy ingress-on-service not present 2024-09-05 02:06:46,116 - INFO - Creating Network Policy ingress-on-service 2024-09-05 02:06:46,132 - INFO - Network policy found in k8s 2024-09-05 02:06:46,132 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=83f36b9c-aef2-4a14-8bc2-0852064f554e 2024-09-05 02:06:46,139 - INFO - Network Policy ingress-on-service with uuid 83f36b9c-aef2-4a14-8bc2-0852064f554e found in kube manager 2024-09-05 02:06:46,169 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-09-05 02:06:46,170 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-09-05 02:06:46,170 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=83f36b9c-aef2-4a14-8bc2-0852064f554e 2024-09-05 02:06:46,199 - WARNING - Network policy with name ingress-on-service not found in agent 2024-09-05 02:06:48,199 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=83f36b9c-aef2-4a14-8bc2-0852064f554e 2024-09-05 02:06:48,232 - WARNING - Network policy with name ingress-on-service not found in agent 2024-09-05 02:06:50,236 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=83f36b9c-aef2-4a14-8bc2-0852064f554e 2024-09-05 02:06:50,278 - INFO - Network policy with name ingress-on-service found in agent 2024-09-05 02:06:50,279 - INFO - Network Policy ingress-on-service verification passed 2024-09-05 02:06:55,391 - DEBUG - [Pod ctest-pod-17612217] Cmd: wget http://10.98.4.191:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:06:55,391 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd wget http://10.98.4.191:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:06:55,391 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:07:00,480 - DEBUG - [Pod ctest-pod-17612217] Cmd: wget http://10.98.4.191:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:07:00,480 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd wget http://10.98.4.191:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:07:00,480 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:07:05,577 - DEBUG - [Pod ctest-pod-17612217] Cmd: wget http://10.98.4.191:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:07:05,577 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd wget http://10.98.4.191:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:07:05,577 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:07:10,672 - DEBUG - [Pod ctest-pod-17612217] Cmd: wget http://10.98.4.191:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:07:10,672 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd wget http://10.98.4.191:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:07:10,672 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:07:15,782 - DEBUG - [Pod ctest-pod-17612217] Cmd: wget http://10.98.4.191:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:07:15,782 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd wget http://10.98.4.191:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:07:15,783 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:07:20,877 - DEBUG - [Pod ctest-pod-17612217] Cmd: wget http://10.98.4.191:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:07:20,877 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd wget http://10.98.4.191:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:07:20,877 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:07:25,975 - DEBUG - [Pod ctest-pod-17612217] Cmd: wget http://10.98.4.191:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:07:25,975 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd wget http://10.98.4.191:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:07:25,975 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:07:31,059 - DEBUG - [Pod ctest-pod-17612217] Cmd: wget http://10.98.4.191:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:07:31,059 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd wget http://10.98.4.191:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:07:31,059 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:07:36,148 - DEBUG - [Pod ctest-pod-17612217] Cmd: wget http://10.98.4.191:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:07:36,148 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd wget http://10.98.4.191:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:07:36,148 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:07:41,233 - DEBUG - [Pod ctest-pod-17612217] Cmd: wget http://10.98.4.191:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:07:41,233 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd wget http://10.98.4.191:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:07:41,233 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:07:41,233 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-04448141': 0, 'ctest-pod-14860522': 0} 2024-09-05 02:07:41,309 - DEBUG - [Pod ctest-pod-16835317] Cmd: wget http://10.98.4.191:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.4.191:80 (10.98.4.191:80) ctest-pod-04448141 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 02:07:41,309 - DEBUG - [Pod Pod ctest-pod-16835317] Cmd wget http://10.98.4.191:80/ -O - -T 5 -t 1 passed 2024-09-05 02:07:41,309 - DEBUG - [Pod Pod ctest-pod-16835317] Cmd output: Connecting to 10.98.4.191:80 (10.98.4.191:80) ctest-pod-04448141 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 02:07:41,390 - DEBUG - [Pod ctest-pod-16835317] Cmd: wget http://10.98.4.191:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.4.191:80 (10.98.4.191:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-04448141 2024-09-05 02:07:41,390 - DEBUG - [Pod Pod ctest-pod-16835317] Cmd wget http://10.98.4.191:80/ -O - -T 5 -t 1 passed 2024-09-05 02:07:41,390 - DEBUG - [Pod Pod ctest-pod-16835317] Cmd output: Connecting to 10.98.4.191:80 (10.98.4.191:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-04448141 2024-09-05 02:07:41,467 - DEBUG - [Pod ctest-pod-16835317] Cmd: wget http://10.98.4.191:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.4.191:80 (10.98.4.191:80) ctest-pod-14860522 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 02:07:41,468 - DEBUG - [Pod Pod ctest-pod-16835317] Cmd wget http://10.98.4.191:80/ -O - -T 5 -t 1 passed 2024-09-05 02:07:41,468 - DEBUG - [Pod Pod ctest-pod-16835317] Cmd output: Connecting to 10.98.4.191:80 (10.98.4.191:80) ctest-pod-14860522 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 02:07:41,468 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-04448141': 2, 'ctest-pod-14860522': 1} 2024-09-05 02:07:46,543 - DEBUG - [Pod ctest-pod-29350020] Cmd: wget http://10.98.4.191:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:07:46,544 - DEBUG - [Pod Pod ctest-pod-29350020] Cmd wget http://10.98.4.191:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:07:46,544 - DEBUG - [Pod Pod ctest-pod-29350020] Cmd output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:07:51,641 - DEBUG - [Pod ctest-pod-29350020] Cmd: wget http://10.98.4.191:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:07:51,641 - DEBUG - [Pod Pod ctest-pod-29350020] Cmd wget http://10.98.4.191:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:07:51,641 - DEBUG - [Pod Pod ctest-pod-29350020] Cmd output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:07:56,720 - DEBUG - [Pod ctest-pod-29350020] Cmd: wget http://10.98.4.191:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:07:56,720 - DEBUG - [Pod Pod ctest-pod-29350020] Cmd wget http://10.98.4.191:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:07:56,720 - DEBUG - [Pod Pod ctest-pod-29350020] Cmd output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:08:01,807 - DEBUG - [Pod ctest-pod-29350020] Cmd: wget http://10.98.4.191:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:08:01,807 - DEBUG - [Pod Pod ctest-pod-29350020] Cmd wget http://10.98.4.191:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:08:01,807 - DEBUG - [Pod Pod ctest-pod-29350020] Cmd output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:08:06,903 - DEBUG - [Pod ctest-pod-29350020] Cmd: wget http://10.98.4.191:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:08:06,903 - DEBUG - [Pod Pod ctest-pod-29350020] Cmd wget http://10.98.4.191:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:08:06,903 - DEBUG - [Pod Pod ctest-pod-29350020] Cmd output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:08:12,004 - DEBUG - [Pod ctest-pod-29350020] Cmd: wget http://10.98.4.191:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:08:12,004 - DEBUG - [Pod Pod ctest-pod-29350020] Cmd wget http://10.98.4.191:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:08:12,005 - DEBUG - [Pod Pod ctest-pod-29350020] Cmd output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:08:17,091 - DEBUG - [Pod ctest-pod-29350020] Cmd: wget http://10.98.4.191:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:08:17,091 - DEBUG - [Pod Pod ctest-pod-29350020] Cmd wget http://10.98.4.191:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:08:17,091 - DEBUG - [Pod Pod ctest-pod-29350020] Cmd output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:08:22,191 - DEBUG - [Pod ctest-pod-29350020] Cmd: wget http://10.98.4.191:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:08:22,191 - DEBUG - [Pod Pod ctest-pod-29350020] Cmd wget http://10.98.4.191:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:08:22,191 - DEBUG - [Pod Pod ctest-pod-29350020] Cmd output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:08:27,271 - DEBUG - [Pod ctest-pod-29350020] Cmd: wget http://10.98.4.191:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:08:27,272 - DEBUG - [Pod Pod ctest-pod-29350020] Cmd wget http://10.98.4.191:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:08:27,272 - DEBUG - [Pod Pod ctest-pod-29350020] Cmd output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:08:32,381 - DEBUG - [Pod ctest-pod-29350020] Cmd: wget http://10.98.4.191:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:08:32,381 - DEBUG - [Pod Pod ctest-pod-29350020] Cmd wget http://10.98.4.191:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:08:32,381 - DEBUG - [Pod Pod ctest-pod-29350020] Cmd output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:08:32,381 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-04448141': 0, 'ctest-pod-14860522': 0} 2024-09-05 02:08:34,476 - DEBUG - [Pod ctest-pod-16835317] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=4.112 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.078 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.122 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.078/1.437/4.112 ms 2024-09-05 02:08:34,477 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-16835317 with expectation True passed 2024-09-05 02:08:36,566 - DEBUG - [Pod ctest-pod-17612217] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.824 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.063 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.074 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.063/0.320/0.824 ms 2024-09-05 02:08:36,567 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-17612217 with expectation True passed 2024-09-05 02:08:38,644 - DEBUG - [Pod ctest-pod-29350020] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=2.840 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.077 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.082 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.077/0.999/2.840 ms 2024-09-05 02:08:38,645 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-29350020 with expectation True passed 2024-09-05 02:08:38,730 - DEBUG - [Pod ctest-pod-16835317] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-05 02:08:38,730 - DEBUG - [Pod Pod ctest-pod-16835317] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-09-05 02:08:38,730 - DEBUG - [Pod Pod ctest-pod-16835317] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-05 02:08:38,730 - INFO - wget check of of http://10.47.255.250 from ctest-pod-16835317 passed 2024-09-05 02:08:38,819 - DEBUG - [Pod ctest-pod-16835317] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-05 02:08:38,819 - DEBUG - [Pod Pod ctest-pod-16835317] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 passed 2024-09-05 02:08:38,819 - DEBUG - [Pod Pod ctest-pod-16835317] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-05 02:08:38,819 - INFO - wget check of of http://10.47.255.249 from ctest-pod-16835317 passed 2024-09-05 02:08:43,902 - DEBUG - [Pod ctest-pod-17612217] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2024-09-05 02:08:43,902 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2024-09-05 02:08:43,902 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2024-09-05 02:08:43,902 - INFO - wget check of of http://10.47.255.249 from ctest-pod-17612217 passed 2024-09-05 02:08:49,005 - DEBUG - [Pod ctest-pod-26055894] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-05 02:08:49,005 - DEBUG - [Pod Pod ctest-pod-26055894] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-05 02:08:49,005 - DEBUG - [Pod Pod ctest-pod-26055894] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-05 02:08:49,005 - INFO - wget check of of http://10.47.255.250 from ctest-pod-26055894 passed 2024-09-05 02:08:49,016 - INFO - Updating Network Policy ingress-on-service 2024-09-05 02:08:54,103 - DEBUG - [Pod ctest-pod-17612217] Cmd: wget http://10.98.4.191:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:08:54,103 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd wget http://10.98.4.191:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:08:54,103 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:08:59,181 - DEBUG - [Pod ctest-pod-17612217] Cmd: wget http://10.98.4.191:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:08:59,181 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd wget http://10.98.4.191:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:08:59,181 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:09:04,271 - DEBUG - [Pod ctest-pod-17612217] Cmd: wget http://10.98.4.191:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:09:04,271 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd wget http://10.98.4.191:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:09:04,271 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:09:09,359 - DEBUG - [Pod ctest-pod-17612217] Cmd: wget http://10.98.4.191:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:09:09,359 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd wget http://10.98.4.191:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:09:09,359 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:09:14,458 - DEBUG - [Pod ctest-pod-17612217] Cmd: wget http://10.98.4.191:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:09:14,458 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd wget http://10.98.4.191:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:09:14,458 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:09:19,548 - DEBUG - [Pod ctest-pod-17612217] Cmd: wget http://10.98.4.191:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:09:19,548 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd wget http://10.98.4.191:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:09:19,548 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:09:24,628 - DEBUG - [Pod ctest-pod-17612217] Cmd: wget http://10.98.4.191:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:09:24,628 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd wget http://10.98.4.191:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:09:24,628 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:09:29,703 - DEBUG - [Pod ctest-pod-17612217] Cmd: wget http://10.98.4.191:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:09:29,703 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd wget http://10.98.4.191:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:09:29,703 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:09:34,793 - DEBUG - [Pod ctest-pod-17612217] Cmd: wget http://10.98.4.191:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:09:34,793 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd wget http://10.98.4.191:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:09:34,793 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:09:39,918 - DEBUG - [Pod ctest-pod-17612217] Cmd: wget http://10.98.4.191:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:09:39,918 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd wget http://10.98.4.191:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:09:39,919 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd output: Connecting to 10.98.4.191:80 (10.98.4.191:80) wget: download timed out 2024-09-05 02:09:39,919 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-04448141': 0, 'ctest-pod-14860522': 0} 2024-09-05 02:09:40,003 - DEBUG - [Pod ctest-pod-16835317] Cmd: wget http://10.98.4.191:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.4.191:80 (10.98.4.191:80) ctest-pod-14860522 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 02:09:40,004 - DEBUG - [Pod Pod ctest-pod-16835317] Cmd wget http://10.98.4.191:80/ -O - -T 5 -t 1 passed 2024-09-05 02:09:40,004 - DEBUG - [Pod Pod ctest-pod-16835317] Cmd output: Connecting to 10.98.4.191:80 (10.98.4.191:80) ctest-pod-14860522 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 02:09:40,085 - DEBUG - [Pod ctest-pod-16835317] Cmd: wget http://10.98.4.191:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.4.191:80 (10.98.4.191:80) ctest-pod-04448141 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 02:09:40,085 - DEBUG - [Pod Pod ctest-pod-16835317] Cmd wget http://10.98.4.191:80/ -O - -T 5 -t 1 passed 2024-09-05 02:09:40,085 - DEBUG - [Pod Pod ctest-pod-16835317] Cmd output: Connecting to 10.98.4.191:80 (10.98.4.191:80) ctest-pod-04448141 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 02:09:40,085 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-04448141': 1, 'ctest-pod-14860522': 1} 2024-09-05 02:09:40,181 - DEBUG - [Pod ctest-pod-29350020] Cmd: wget http://10.98.4.191:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.4.191:80 (10.98.4.191:80) ctest-pod-04448141 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 02:09:40,181 - DEBUG - [Pod Pod ctest-pod-29350020] Cmd wget http://10.98.4.191:80/ -O - -T 5 -t 1 passed 2024-09-05 02:09:40,181 - DEBUG - [Pod Pod ctest-pod-29350020] Cmd output: Connecting to 10.98.4.191:80 (10.98.4.191:80) ctest-pod-04448141 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 02:09:40,263 - DEBUG - [Pod ctest-pod-29350020] Cmd: wget http://10.98.4.191:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.4.191:80 (10.98.4.191:80) ctest-pod-14860522 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 02:09:40,263 - DEBUG - [Pod Pod ctest-pod-29350020] Cmd wget http://10.98.4.191:80/ -O - -T 5 -t 1 passed 2024-09-05 02:09:40,263 - DEBUG - [Pod Pod ctest-pod-29350020] Cmd output: Connecting to 10.98.4.191:80 (10.98.4.191:80) ctest-pod-14860522 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-05 02:09:40,263 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-04448141': 1, 'ctest-pod-14860522': 1} 2024-09-05 02:09:42,343 - DEBUG - [Pod ctest-pod-16835317] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.377 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.076 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.100 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.076/0.184/0.377 ms 2024-09-05 02:09:42,343 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-16835317 with expectation True passed 2024-09-05 02:09:44,441 - DEBUG - [Pod ctest-pod-17612217] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.468 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.075 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.077 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.075/0.206/0.468 ms 2024-09-05 02:09:44,441 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-17612217 with expectation True passed 2024-09-05 02:09:46,523 - DEBUG - [Pod ctest-pod-29350020] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.452 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.090 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.068 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.068/0.203/0.452 ms 2024-09-05 02:09:46,523 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-29350020 with expectation True passed 2024-09-05 02:09:46,611 - DEBUG - [Pod ctest-pod-16835317] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-05 02:09:46,611 - DEBUG - [Pod Pod ctest-pod-16835317] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-09-05 02:09:46,611 - DEBUG - [Pod Pod ctest-pod-16835317] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-05 02:09:46,611 - INFO - wget check of of http://10.47.255.250 from ctest-pod-16835317 passed 2024-09-05 02:09:46,722 - DEBUG - [Pod ctest-pod-16835317] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-05 02:09:46,723 - DEBUG - [Pod Pod ctest-pod-16835317] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 passed 2024-09-05 02:09:46,723 - DEBUG - [Pod Pod ctest-pod-16835317] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-05 02:09:46,723 - INFO - wget check of of http://10.47.255.249 from ctest-pod-16835317 passed 2024-09-05 02:09:51,801 - DEBUG - [Pod ctest-pod-17612217] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2024-09-05 02:09:51,801 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2024-09-05 02:09:51,801 - DEBUG - [Pod Pod ctest-pod-17612217] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2024-09-05 02:09:51,801 - INFO - wget check of of http://10.47.255.249 from ctest-pod-17612217 passed 2024-09-05 02:09:51,903 - DEBUG - [Pod ctest-pod-26055894] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-05 02:09:51,903 - DEBUG - [Pod Pod ctest-pod-26055894] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-09-05 02:09:51,903 - DEBUG - [Pod Pod ctest-pod-26055894] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-05 02:09:51,903 - INFO - wget check of of http://10.47.255.250 from ctest-pod-26055894 passed 2024-09-05 02:09:51,903 - INFO - Deleting Network Policy : ingress-on-service 2024-09-05 02:09:51,904 - INFO - Deleting service : ctest-nginx-svc-95335518 2024-09-05 02:09:52,489 - DEBUG - No XMPP flaps were noticed during the test 2024-09-05 02:09:52,489 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:09] 2024-09-05 02:09:52,489 - INFO - -------------------------------------------------------------------------------- 2024-09-05 02:09:52,495 - INFO - Deleting pod ctest-new-default-43514173:ctest-pod-04448141 2024-09-05 02:09:52,495 - INFO - Deleting pod ctest-new-default-43514173:ctest-pod-14860522 2024-09-05 02:09:52,496 - INFO - Deleting pod ctest-non-default-06901807:ctest-pod-94752766 2024-09-05 02:09:52,496 - INFO - Deleting pod ctest-non-default-06901807:ctest-pod-95273448 2024-09-05 02:09:52,496 - INFO - Deleting pod ctest-new-default-43514173:ctest-pod-17612217 2024-09-05 02:09:52,497 - INFO - Deleting pod ctest-new-default-43514173:ctest-pod-16835317 2024-09-05 02:09:52,497 - INFO - Deleting pod ctest-non-default-06901807:ctest-pod-29350020 2024-09-05 02:09:52,497 - INFO - Deleting pod ctest-non-default-06901807:ctest-pod-26055894 2024-09-05 02:09:52,613 - WARNING - Pod uuid 0b61a478-9dab-4ac6-9858-76bef1e1733e is still seen in agent 10.0.0.28 VM list 2024-09-05 02:09:52,617 - WARNING - Pod uuid 10d1d686-bc95-4ce4-b7b7-a1b5ca4a1246 is still seen in agent 10.0.0.28 VM list 2024-09-05 02:09:52,618 - WARNING - Pod uuid 2a7c90c3-7097-4f51-875c-b2289c22ab5f is still seen in agent 10.0.0.28 VM list 2024-09-05 02:09:52,645 - WARNING - Pod uuid 44a31100-0045-41b6-bc5f-779ed9dbef87 is still seen in agent 10.0.0.28 VM list 2024-09-05 02:09:52,646 - WARNING - Pod uuid 413a2543-946e-4eb3-8ad6-32f19befe7e4 is still seen in agent 10.0.0.28 VM list 2024-09-05 02:09:52,646 - WARNING - Pod uuid 6ae4fb3d-4b65-4095-b23e-03b5b35f19c6 is still seen in agent 10.0.0.28 VM list 2024-09-05 02:09:52,648 - WARNING - Pod uuid 1591cfe0-6923-4e88-812a-d0d2a98d6d27 is still seen in agent 10.0.0.28 VM list 2024-09-05 02:09:52,649 - WARNING - Pod uuid 7f5c302c-6d5b-4c98-91ef-a02b305f4e02 is still seen in agent 10.0.0.28 VM list 2024-09-05 02:09:57,635 - WARNING - Pod uuid 0b61a478-9dab-4ac6-9858-76bef1e1733e is still seen in agent 10.0.0.28 VM list 2024-09-05 02:09:57,637 - WARNING - Pod uuid 2a7c90c3-7097-4f51-875c-b2289c22ab5f is still seen in agent 10.0.0.28 VM list 2024-09-05 02:09:57,637 - DEBUG - Pod 10d1d686-bc95-4ce4-b7b7-a1b5ca4a1246 is not in agent 10.0.0.28 VM list 2024-09-05 02:09:57,643 - DEBUG - VMI 708dd450-6b2b-11ef-9024-0242efb382f1 is removed from agent 10.0.0.28 2024-09-05 02:09:57,643 - INFO - Verified that pod ctest-pod-04448141 is removed in agent 2024-09-05 02:09:57,667 - WARNING - Pod uuid 413a2543-946e-4eb3-8ad6-32f19befe7e4 is still seen in agent 10.0.0.28 VM list 2024-09-05 02:09:57,668 - WARNING - Pod uuid 44a31100-0045-41b6-bc5f-779ed9dbef87 is still seen in agent 10.0.0.28 VM list 2024-09-05 02:09:57,670 - DEBUG - Pod 7f5c302c-6d5b-4c98-91ef-a02b305f4e02 is not in agent 10.0.0.28 VM list 2024-09-05 02:09:57,672 - DEBUG - Pod 6ae4fb3d-4b65-4095-b23e-03b5b35f19c6 is not in agent 10.0.0.28 VM list 2024-09-05 02:09:57,674 - DEBUG - Pod 1591cfe0-6923-4e88-812a-d0d2a98d6d27 is not in agent 10.0.0.28 VM list 2024-09-05 02:09:57,686 - DEBUG - VMI 7339be1c-6b2b-11ef-9024-0242efb382f1 is removed from agent 10.0.0.28 2024-09-05 02:09:57,686 - INFO - Verified that pod ctest-pod-95273448 is removed in agent 2024-09-05 02:09:57,688 - DEBUG - VMI 715d0126-6b2b-11ef-9024-0242efb382f1 is removed from agent 10.0.0.28 2024-09-05 02:09:57,688 - INFO - Verified that pod ctest-pod-14860522 is removed in agent 2024-09-05 02:09:57,689 - DEBUG - VMI 7265f6ea-6b2b-11ef-9024-0242efb382f1 is removed from agent 10.0.0.28 2024-09-05 02:09:57,689 - INFO - Verified that pod ctest-pod-94752766 is removed in agent 2024-09-05 02:10:02,647 - WARNING - Pod uuid 2a7c90c3-7097-4f51-875c-b2289c22ab5f is still seen in agent 10.0.0.28 VM list 2024-09-05 02:10:02,648 - WARNING - Pod uuid 0b61a478-9dab-4ac6-9858-76bef1e1733e is still seen in agent 10.0.0.28 VM list 2024-09-05 02:10:02,678 - WARNING - Pod uuid 44a31100-0045-41b6-bc5f-779ed9dbef87 is still seen in agent 10.0.0.28 VM list 2024-09-05 02:10:02,679 - WARNING - Pod uuid 413a2543-946e-4eb3-8ad6-32f19befe7e4 is still seen in agent 10.0.0.28 VM list 2024-09-05 02:10:07,662 - WARNING - Pod uuid 0b61a478-9dab-4ac6-9858-76bef1e1733e is still seen in agent 10.0.0.28 VM list 2024-09-05 02:10:07,662 - WARNING - Pod uuid 2a7c90c3-7097-4f51-875c-b2289c22ab5f is still seen in agent 10.0.0.28 VM list 2024-09-05 02:10:07,695 - WARNING - Pod uuid 413a2543-946e-4eb3-8ad6-32f19befe7e4 is still seen in agent 10.0.0.28 VM list 2024-09-05 02:10:07,696 - WARNING - Pod uuid 44a31100-0045-41b6-bc5f-779ed9dbef87 is still seen in agent 10.0.0.28 VM list 2024-09-05 02:10:12,673 - WARNING - Pod uuid 0b61a478-9dab-4ac6-9858-76bef1e1733e is still seen in agent 10.0.0.28 VM list 2024-09-05 02:10:12,675 - WARNING - Pod uuid 2a7c90c3-7097-4f51-875c-b2289c22ab5f is still seen in agent 10.0.0.28 VM list 2024-09-05 02:10:12,708 - WARNING - Pod uuid 44a31100-0045-41b6-bc5f-779ed9dbef87 is still seen in agent 10.0.0.28 VM list 2024-09-05 02:10:12,709 - WARNING - Pod uuid 413a2543-946e-4eb3-8ad6-32f19befe7e4 is still seen in agent 10.0.0.28 VM list 2024-09-05 02:10:17,685 - WARNING - Pod uuid 2a7c90c3-7097-4f51-875c-b2289c22ab5f is still seen in agent 10.0.0.28 VM list 2024-09-05 02:10:17,687 - WARNING - Pod uuid 0b61a478-9dab-4ac6-9858-76bef1e1733e is still seen in agent 10.0.0.28 VM list 2024-09-05 02:10:17,721 - WARNING - Pod uuid 413a2543-946e-4eb3-8ad6-32f19befe7e4 is still seen in agent 10.0.0.28 VM list 2024-09-05 02:10:17,722 - WARNING - Pod uuid 44a31100-0045-41b6-bc5f-779ed9dbef87 is still seen in agent 10.0.0.28 VM list 2024-09-05 02:10:22,712 - WARNING - Pod uuid 0b61a478-9dab-4ac6-9858-76bef1e1733e is still seen in agent 10.0.0.28 VM list 2024-09-05 02:10:22,713 - WARNING - Pod uuid 2a7c90c3-7097-4f51-875c-b2289c22ab5f is still seen in agent 10.0.0.28 VM list 2024-09-05 02:10:22,772 - WARNING - Pod uuid 44a31100-0045-41b6-bc5f-779ed9dbef87 is still seen in agent 10.0.0.28 VM list 2024-09-05 02:10:22,774 - WARNING - Pod uuid 413a2543-946e-4eb3-8ad6-32f19befe7e4 is still seen in agent 10.0.0.28 VM list 2024-09-05 02:10:27,727 - DEBUG - Pod 0b61a478-9dab-4ac6-9858-76bef1e1733e is not in agent 10.0.0.28 VM list 2024-09-05 02:10:27,730 - DEBUG - Pod 2a7c90c3-7097-4f51-875c-b2289c22ab5f is not in agent 10.0.0.28 VM list 2024-09-05 02:10:27,740 - DEBUG - VMI 740f6756-6b2b-11ef-9024-0242efb382f1 is removed from agent 10.0.0.28 2024-09-05 02:10:27,740 - INFO - Verified that pod ctest-pod-17612217 is removed in agent 2024-09-05 02:10:27,741 - DEBUG - VMI 75a7651e-6b2b-11ef-9024-0242efb382f1 is removed from agent 10.0.0.28 2024-09-05 02:10:27,742 - INFO - Verified that pod ctest-pod-29350020 is removed in agent 2024-09-05 02:10:27,786 - DEBUG - Pod 44a31100-0045-41b6-bc5f-779ed9dbef87 is not in agent 10.0.0.28 VM list 2024-09-05 02:10:27,789 - DEBUG - Pod 413a2543-946e-4eb3-8ad6-32f19befe7e4 is not in agent 10.0.0.28 VM list 2024-09-05 02:10:27,798 - DEBUG - VMI 7677f454-6b2b-11ef-9024-0242efb382f1 is removed from agent 10.0.0.28 2024-09-05 02:10:27,798 - INFO - Verified that pod ctest-pod-26055894 is removed in agent 2024-09-05 02:10:27,799 - DEBUG - VMI 74d87cd6-6b2b-11ef-9024-0242efb382f1 is removed from agent 10.0.0.28 2024-09-05 02:10:27,799 - INFO - Verified that pod ctest-pod-16835317 is removed in agent 2024-09-05 02:10:27,800 - INFO - Deleting namespace ctest-non-default-06901807 2024-09-05 02:10:27,812 - DEBUG - Namespace ctest-non-default-06901807 still in k8s 2024-09-05 02:10:29,818 - DEBUG - Namespace ctest-non-default-06901807 still in k8s 2024-09-05 02:10:31,824 - DEBUG - Namespace ctest-non-default-06901807 still in k8s 2024-09-05 02:10:33,833 - DEBUG - Namespace ctest-non-default-06901807 is not in k8s 2024-09-05 02:10:33,833 - DEBUG - No need to check project deletion in contrail-api 2024-09-05 02:10:33,833 - INFO - Deleting namespace ctest-new-default-43514173 2024-09-05 02:10:33,854 - DEBUG - Namespace ctest-new-default-43514173 still in k8s 2024-09-05 02:10:35,859 - DEBUG - Namespace ctest-new-default-43514173 still in k8s 2024-09-05 02:10:37,864 - DEBUG - Namespace ctest-new-default-43514173 still in k8s 2024-09-05 02:10:39,870 - DEBUG - Namespace ctest-new-default-43514173 is not in k8s 2024-09-05 02:10:39,870 - DEBUG - No need to check project deletion in contrail-api