2025-01-09 02:31:47,144 - INFO - Using existing project ['default-domain', 'k8s-default'](5ad342c3-9eff-48fe-a57e-a4616d95f006) 2025-01-09 02:31:47,161 - DEBUG - Namespace ctest-new-default-61180475 not present 2025-01-09 02:31:47,176 - INFO - Created namespace ctest-new-default-61180475 2025-01-09 02:31:50,182 - DEBUG - Namespace ctest-non-default-63817872 not present 2025-01-09 02:31:50,194 - INFO - Created namespace ctest-non-default-63817872 2025-01-09 02:31:53,218 - DEBUG - Pod ctest-pod-59989089 not present 2025-01-09 02:31:53,219 - INFO - Creating Pod ctest-pod-59989089 2025-01-09 02:31:53,243 - DEBUG - Pod : ctest-pod-59989089 UUID is 2c8ee476-3070-4108-a8e1-830f86355d5e 2025-01-09 02:31:53,245 - DEBUG - Pod ctest-pod-05325844 not present 2025-01-09 02:31:53,246 - INFO - Creating Pod ctest-pod-05325844 2025-01-09 02:31:53,290 - DEBUG - Pod : ctest-pod-05325844 UUID is 81c9ed55-72f6-4dc4-b1eb-8c40e6dd54e3 2025-01-09 02:31:53,293 - DEBUG - Pod ctest-pod-39706088 not present 2025-01-09 02:31:53,293 - INFO - Creating Pod ctest-pod-39706088 2025-01-09 02:31:53,344 - DEBUG - Pod : ctest-pod-39706088 UUID is 5e2e53fa-e248-48ba-91fa-d523a8680666 2025-01-09 02:31:53,350 - DEBUG - Pod ctest-pod-89764413 not present 2025-01-09 02:31:53,351 - INFO - Creating Pod ctest-pod-89764413 2025-01-09 02:31:53,370 - DEBUG - Pod : ctest-pod-89764413 UUID is f4ac9901-39aa-4cc2-88bc-0d9b7c5eb95f 2025-01-09 02:31:53,374 - DEBUG - Pod ctest-pod-62666746 not present 2025-01-09 02:31:53,374 - INFO - Creating Pod ctest-pod-62666746 2025-01-09 02:31:53,390 - DEBUG - Pod : ctest-pod-62666746 UUID is 11d773ff-bc97-456f-ba15-3a890c81a7e9 2025-01-09 02:31:53,392 - DEBUG - Pod ctest-pod-93112133 not present 2025-01-09 02:31:53,392 - INFO - Creating Pod ctest-pod-93112133 2025-01-09 02:31:53,413 - DEBUG - Pod : ctest-pod-93112133 UUID is 1818a806-4645-4e8f-8efc-9e6d8adbca23 2025-01-09 02:31:53,415 - DEBUG - Pod ctest-pod-83265947 not present 2025-01-09 02:31:53,415 - INFO - Creating Pod ctest-pod-83265947 2025-01-09 02:31:53,431 - DEBUG - Pod : ctest-pod-83265947 UUID is afa5cfe8-d31e-470b-810a-6a2b325a5dd1 2025-01-09 02:31:53,433 - DEBUG - Pod ctest-pod-45127452 not present 2025-01-09 02:31:53,433 - INFO - Creating Pod ctest-pod-45127452 2025-01-09 02:31:53,463 - DEBUG - Pod : ctest-pod-45127452 UUID is e8f87759-a451-4083-8b79-099388316917 2025-01-09 02:31:53,641 - INFO - Project default-domain:k8s-ctest-new-default-61180475 for Namespace ctest-new-default-61180475 is seen in contrail-api 2025-01-09 02:31:53,641 - DEBUG - Project uuid in Contrail is 1f070f4a-15ac-44ee-8e82-716565b50640 2025-01-09 02:31:53,794 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_NamespaceDatabaseList?namespace_uuid=d6411374-8cf4-44ac-8b42-3fd0c16c9d30 2025-01-09 02:31:53,809 - INFO - Namespace ctest-new-default-61180475 with uuid d6411374-8cf4-44ac-8b42-3fd0c16c9d30 found in kube manager 2025-01-09 02:31:53,809 - INFO - Namespace ctest-new-default-61180475 verification passed 2025-01-09 02:31:54,033 - INFO - Project default-domain:k8s-ctest-non-default-63817872 for Namespace ctest-non-default-63817872 is seen in contrail-api 2025-01-09 02:31:54,033 - DEBUG - Project uuid in Contrail is 3a3c0098-a1d8-4101-96c8-e5f704325531 2025-01-09 02:31:54,033 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_NamespaceDatabaseList?namespace_uuid=e08a4d53-bd31-464d-b6f2-d94fab7bd2f8 2025-01-09 02:31:54,038 - INFO - Namespace ctest-non-default-63817872 with uuid e08a4d53-bd31-464d-b6f2-d94fab7bd2f8 found in kube manager 2025-01-09 02:31:54,038 - INFO - Namespace ctest-non-default-63817872 verification passed 2025-01-09 02:31:54,043 - DEBUG - Pod ctest-pod-59989089 not in running state.Currently in Pending 2025-01-09 02:31:59,052 - DEBUG - Pod ctest-pod-59989089 not in running state.Currently in Pending 2025-01-09 02:32:04,058 - INFO - Pod ctest-pod-59989089 is in running state.Got IP 10.47.255.251 2025-01-09 02:32:04,071 - DEBUG - Pod ctest-pod-59989089 has vmi e4407498-ce31-11ef-b0b9-fa163e2bff8f 2025-01-09 02:32:04,071 - INFO - Verified pod ctest-pod-59989089 in contrail-api 2025-01-09 02:32:04,084 - DEBUG - VMI e4407498-ce31-11ef-b0b9-fa163e2bff8f is active in agent 10.0.0.35 2025-01-09 02:32:04,084 - INFO - Verified Pod ctest-pod-59989089 in agent 10.0.0.35 2025-01-09 02:32:04,084 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=2c8ee476-3070-4108-a8e1-830f86355d5e 2025-01-09 02:32:04,088 - INFO - Pod ctest-pod-59989089 with uuid 2c8ee476-3070-4108-a8e1-830f86355d5e found in kube manager 2025-01-09 02:32:04,089 - INFO - Pod ctest-pod-59989089 verification passed 2025-01-09 02:32:04,093 - INFO - Pod ctest-pod-05325844 is in running state.Got IP 10.47.255.250 2025-01-09 02:32:04,149 - DEBUG - Pod ctest-pod-05325844 has vmi e4b25248-ce31-11ef-b0b9-fa163e2bff8f 2025-01-09 02:32:04,149 - INFO - Verified pod ctest-pod-05325844 in contrail-api 2025-01-09 02:32:04,162 - DEBUG - VMI e4b25248-ce31-11ef-b0b9-fa163e2bff8f is active in agent 10.0.0.35 2025-01-09 02:32:04,163 - INFO - Verified Pod ctest-pod-05325844 in agent 10.0.0.35 2025-01-09 02:32:04,163 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=81c9ed55-72f6-4dc4-b1eb-8c40e6dd54e3 2025-01-09 02:32:04,167 - INFO - Pod ctest-pod-05325844 with uuid 81c9ed55-72f6-4dc4-b1eb-8c40e6dd54e3 found in kube manager 2025-01-09 02:32:04,167 - INFO - Pod ctest-pod-05325844 verification passed 2025-01-09 02:32:04,172 - DEBUG - Pod ctest-pod-39706088 not in running state.Currently in Pending 2025-01-09 02:32:09,178 - INFO - Pod ctest-pod-39706088 is in running state.Got IP 10.47.255.249 2025-01-09 02:32:09,192 - DEBUG - Pod ctest-pod-39706088 has vmi e560e24a-ce31-11ef-b0b9-fa163e2bff8f 2025-01-09 02:32:09,192 - INFO - Verified pod ctest-pod-39706088 in contrail-api 2025-01-09 02:32:09,206 - DEBUG - VMI e560e24a-ce31-11ef-b0b9-fa163e2bff8f is active in agent 10.0.0.35 2025-01-09 02:32:09,206 - INFO - Verified Pod ctest-pod-39706088 in agent 10.0.0.35 2025-01-09 02:32:09,206 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=5e2e53fa-e248-48ba-91fa-d523a8680666 2025-01-09 02:32:09,216 - INFO - Pod ctest-pod-39706088 with uuid 5e2e53fa-e248-48ba-91fa-d523a8680666 found in kube manager 2025-01-09 02:32:09,216 - INFO - Pod ctest-pod-39706088 verification passed 2025-01-09 02:32:09,222 - INFO - Pod ctest-pod-89764413 is in running state.Got IP 10.47.255.248 2025-01-09 02:32:09,281 - DEBUG - Pod ctest-pod-89764413 has vmi e5ddd584-ce31-11ef-b0b9-fa163e2bff8f 2025-01-09 02:32:09,281 - INFO - Verified pod ctest-pod-89764413 in contrail-api 2025-01-09 02:32:09,295 - DEBUG - VMI e5ddd584-ce31-11ef-b0b9-fa163e2bff8f is active in agent 10.0.0.35 2025-01-09 02:32:09,295 - INFO - Verified Pod ctest-pod-89764413 in agent 10.0.0.35 2025-01-09 02:32:09,296 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=f4ac9901-39aa-4cc2-88bc-0d9b7c5eb95f 2025-01-09 02:32:09,301 - INFO - Pod ctest-pod-89764413 with uuid f4ac9901-39aa-4cc2-88bc-0d9b7c5eb95f found in kube manager 2025-01-09 02:32:09,301 - INFO - Pod ctest-pod-89764413 verification passed 2025-01-09 02:32:09,306 - DEBUG - Pod ctest-pod-62666746 not in running state.Currently in Pending 2025-01-09 02:32:14,311 - INFO - Pod ctest-pod-62666746 is in running state.Got IP 10.47.255.247 2025-01-09 02:32:14,326 - DEBUG - Pod ctest-pod-62666746 has vmi e6703406-ce31-11ef-b0b9-fa163e2bff8f 2025-01-09 02:32:14,326 - INFO - Verified pod ctest-pod-62666746 in contrail-api 2025-01-09 02:32:14,341 - DEBUG - VMI e6703406-ce31-11ef-b0b9-fa163e2bff8f is active in agent 10.0.0.35 2025-01-09 02:32:14,341 - INFO - Verified Pod ctest-pod-62666746 in agent 10.0.0.35 2025-01-09 02:32:14,341 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=11d773ff-bc97-456f-ba15-3a890c81a7e9 2025-01-09 02:32:14,345 - INFO - Pod ctest-pod-62666746 with uuid 11d773ff-bc97-456f-ba15-3a890c81a7e9 found in kube manager 2025-01-09 02:32:14,346 - INFO - Pod ctest-pod-62666746 verification passed 2025-01-09 02:32:14,350 - INFO - Pod ctest-pod-83265947 is in running state.Got IP 10.47.255.245 2025-01-09 02:32:14,405 - DEBUG - Pod ctest-pod-83265947 has vmi e76ebfa8-ce31-11ef-b0b9-fa163e2bff8f 2025-01-09 02:32:14,405 - INFO - Verified pod ctest-pod-83265947 in contrail-api 2025-01-09 02:32:14,419 - DEBUG - VMI e76ebfa8-ce31-11ef-b0b9-fa163e2bff8f is active in agent 10.0.0.35 2025-01-09 02:32:14,419 - INFO - Verified Pod ctest-pod-83265947 in agent 10.0.0.35 2025-01-09 02:32:14,419 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=afa5cfe8-d31e-470b-810a-6a2b325a5dd1 2025-01-09 02:32:14,424 - INFO - Pod ctest-pod-83265947 with uuid afa5cfe8-d31e-470b-810a-6a2b325a5dd1 found in kube manager 2025-01-09 02:32:14,424 - INFO - Pod ctest-pod-83265947 verification passed 2025-01-09 02:32:14,492 - INFO - Pod ctest-pod-93112133 is in running state.Got IP 10.47.255.246 2025-01-09 02:32:14,506 - DEBUG - Pod ctest-pod-93112133 has vmi e6eab2b2-ce31-11ef-b0b9-fa163e2bff8f 2025-01-09 02:32:14,506 - INFO - Verified pod ctest-pod-93112133 in contrail-api 2025-01-09 02:32:14,521 - DEBUG - VMI e6eab2b2-ce31-11ef-b0b9-fa163e2bff8f is active in agent 10.0.0.35 2025-01-09 02:32:14,521 - INFO - Verified Pod ctest-pod-93112133 in agent 10.0.0.35 2025-01-09 02:32:14,521 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=1818a806-4645-4e8f-8efc-9e6d8adbca23 2025-01-09 02:32:14,526 - INFO - Pod ctest-pod-93112133 with uuid 1818a806-4645-4e8f-8efc-9e6d8adbca23 found in kube manager 2025-01-09 02:32:14,526 - INFO - Pod ctest-pod-93112133 verification passed 2025-01-09 02:32:14,530 - INFO - Pod ctest-pod-45127452 is in running state.Got IP 10.47.255.244 2025-01-09 02:32:14,585 - DEBUG - Pod ctest-pod-45127452 has vmi e7e14d7a-ce31-11ef-b0b9-fa163e2bff8f 2025-01-09 02:32:14,585 - INFO - Verified pod ctest-pod-45127452 in contrail-api 2025-01-09 02:32:14,599 - DEBUG - VMI e7e14d7a-ce31-11ef-b0b9-fa163e2bff8f is active in agent 10.0.0.35 2025-01-09 02:32:14,599 - INFO - Verified Pod ctest-pod-45127452 in agent 10.0.0.35 2025-01-09 02:32:14,599 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=e8f87759-a451-4083-8b79-099388316917 2025-01-09 02:32:14,603 - INFO - Pod ctest-pod-45127452 with uuid e8f87759-a451-4083-8b79-099388316917 found in kube manager 2025-01-09 02:32:14,603 - INFO - Pod ctest-pod-45127452 verification passed 2025-01-09 02:32:14,603 - INFO - ================================================================================ 2025-01-09 02:32:14,604 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-01-09 02:32:14,604 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-01-09 02:32:14,835 - DEBUG - Nothing to compare xmpp stats {'10.0.0.35': {'10.0.0.23': '0'}} with 2025-01-09 02:32:14,835 - INFO - Initial checks done. Running the testcase now 2025-01-09 02:32:14,835 - INFO - 2025-01-09 02:32:14,916 - DEBUG - [Pod ctest-pod-59989089] Cmd: echo ctest-pod-59989089 > /usr/share/nginx/html/index.html, Output: 2025-01-09 02:32:14,978 - DEBUG - [Pod ctest-pod-05325844] Cmd: echo ctest-pod-05325844 > /usr/share/nginx/html/index.html, Output: 2025-01-09 02:32:15,031 - DEBUG - [Pod ctest-pod-39706088] Cmd: echo ctest-pod-39706088 > /usr/share/nginx/html/index.html, Output: 2025-01-09 02:32:15,101 - DEBUG - [Pod ctest-pod-89764413] Cmd: echo ctest-pod-89764413 > /usr/share/nginx/html/index.html, Output: 2025-01-09 02:32:15,105 - DEBUG - Service ctest-nginx-svc-43441295 not present 2025-01-09 02:32:15,105 - INFO - Creating service ctest-nginx-svc-43441295 2025-01-09 02:32:15,121 - INFO - Created Service ctest-nginx-svc-43441295 2025-01-09 02:32:15,143 - WARNING - Service UUID c7561318-d403-48d6-9860-8fd90c734f4c not yet found in contrail-api 2025-01-09 02:32:16,151 - INFO - Validated that Service ctest-nginx-svc-43441295 is seen in contrail-api 2025-01-09 02:32:16,151 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_LoadbalancerDatabaseList?x=c7561318-d403-48d6-9860-8fd90c734f4c 2025-01-09 02:32:16,156 - INFO - Service ctest-nginx-svc-43441295 with uuid c7561318-d403-48d6-9860-8fd90c734f4c found in kube manager 2025-01-09 02:32:16,156 - INFO - Service ctest-nginx-svc-43441295 verification passed 2025-01-09 02:32:17,232 - DEBUG - [Pod ctest-pod-62666746] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.222.242:80 (10.100.222.242:80) ctest-pod-59989089 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 02:32:17,232 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 passed 2025-01-09 02:32:17,232 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd output: Connecting to 10.100.222.242:80 (10.100.222.242:80) ctest-pod-59989089 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 02:32:17,304 - DEBUG - [Pod ctest-pod-62666746] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: ctest-pod-59989089 Connecting to 10.100.222.242:80 (10.100.222.242:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 02:32:17,304 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 passed 2025-01-09 02:32:17,304 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd output: ctest-pod-59989089 Connecting to 10.100.222.242:80 (10.100.222.242:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 02:32:17,364 - DEBUG - [Pod ctest-pod-62666746] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: ctest-pod-05325844 Connecting to 10.100.222.242:80 (10.100.222.242:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 02:32:17,365 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 passed 2025-01-09 02:32:17,365 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd output: ctest-pod-05325844 Connecting to 10.100.222.242:80 (10.100.222.242:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 02:32:17,365 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-59989089': 2, 'ctest-pod-05325844': 1} 2025-01-09 02:32:17,434 - DEBUG - [Pod ctest-pod-83265947] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: ctest-pod-05325844 Connecting to 10.100.222.242:80 (10.100.222.242:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 02:32:17,434 - DEBUG - [Pod Pod ctest-pod-83265947] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 passed 2025-01-09 02:32:17,434 - DEBUG - [Pod Pod ctest-pod-83265947] Cmd output: ctest-pod-05325844 Connecting to 10.100.222.242:80 (10.100.222.242:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 02:32:17,504 - DEBUG - [Pod ctest-pod-83265947] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: ctest-pod-59989089 Connecting to 10.100.222.242:80 (10.100.222.242:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 02:32:17,504 - DEBUG - [Pod Pod ctest-pod-83265947] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 passed 2025-01-09 02:32:17,504 - DEBUG - [Pod Pod ctest-pod-83265947] Cmd output: ctest-pod-59989089 Connecting to 10.100.222.242:80 (10.100.222.242:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 02:32:17,505 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-59989089': 1, 'ctest-pod-05325844': 1} 2025-01-09 02:32:17,507 - DEBUG - Network policy ingress-on-service not present 2025-01-09 02:32:17,508 - INFO - Creating Network Policy ingress-on-service 2025-01-09 02:32:17,518 - INFO - Network policy found in k8s 2025-01-09 02:32:17,519 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=f606913f-b771-41c7-bba4-ae87502b1035 2025-01-09 02:32:17,523 - INFO - Network Policy ingress-on-service with uuid f606913f-b771-41c7-bba4-ae87502b1035 found in kube manager 2025-01-09 02:32:17,563 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-01-09 02:32:17,563 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-01-09 02:32:17,563 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=f606913f-b771-41c7-bba4-ae87502b1035 2025-01-09 02:32:17,598 - WARNING - Network policy with name ingress-on-service not found in agent 2025-01-09 02:32:19,599 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=f606913f-b771-41c7-bba4-ae87502b1035 2025-01-09 02:32:19,629 - INFO - Network policy with name ingress-on-service found in agent 2025-01-09 02:32:19,629 - INFO - Network Policy ingress-on-service verification passed 2025-01-09 02:32:24,686 - DEBUG - [Pod ctest-pod-62666746] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:32:24,686 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:32:24,686 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:32:29,749 - DEBUG - [Pod ctest-pod-62666746] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:32:29,750 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:32:29,750 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:32:34,816 - DEBUG - [Pod ctest-pod-62666746] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:32:34,817 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:32:34,817 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:32:39,869 - DEBUG - [Pod ctest-pod-62666746] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:32:39,870 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:32:39,870 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:32:44,921 - DEBUG - [Pod ctest-pod-62666746] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:32:44,922 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:32:44,922 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:32:49,986 - DEBUG - [Pod ctest-pod-62666746] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:32:49,986 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:32:49,986 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:32:55,063 - DEBUG - [Pod ctest-pod-62666746] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:32:55,063 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:32:55,063 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:33:00,122 - DEBUG - [Pod ctest-pod-62666746] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:33:00,122 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:33:00,122 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:33:05,194 - DEBUG - [Pod ctest-pod-62666746] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:33:05,194 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:33:05,194 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:33:10,274 - DEBUG - [Pod ctest-pod-62666746] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:33:10,274 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:33:10,274 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:33:10,274 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-59989089': 0, 'ctest-pod-05325844': 0} 2025-01-09 02:33:10,332 - DEBUG - [Pod ctest-pod-93112133] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: ctest-pod-05325844 Connecting to 10.100.222.242:80 (10.100.222.242:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 02:33:10,332 - DEBUG - [Pod Pod ctest-pod-93112133] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 passed 2025-01-09 02:33:10,332 - DEBUG - [Pod Pod ctest-pod-93112133] Cmd output: ctest-pod-05325844 Connecting to 10.100.222.242:80 (10.100.222.242:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 02:33:10,391 - DEBUG - [Pod ctest-pod-93112133] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: ctest-pod-05325844 Connecting to 10.100.222.242:80 (10.100.222.242:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 02:33:10,391 - DEBUG - [Pod Pod ctest-pod-93112133] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 passed 2025-01-09 02:33:10,391 - DEBUG - [Pod Pod ctest-pod-93112133] Cmd output: ctest-pod-05325844 Connecting to 10.100.222.242:80 (10.100.222.242:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 02:33:10,447 - DEBUG - [Pod ctest-pod-93112133] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: ctest-pod-05325844 Connecting to 10.100.222.242:80 (10.100.222.242:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 02:33:10,447 - DEBUG - [Pod Pod ctest-pod-93112133] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 passed 2025-01-09 02:33:10,448 - DEBUG - [Pod Pod ctest-pod-93112133] Cmd output: ctest-pod-05325844 Connecting to 10.100.222.242:80 (10.100.222.242:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 02:33:10,516 - DEBUG - [Pod ctest-pod-93112133] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: ctest-pod-59989089 Connecting to 10.100.222.242:80 (10.100.222.242:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 02:33:10,516 - DEBUG - [Pod Pod ctest-pod-93112133] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 passed 2025-01-09 02:33:10,516 - DEBUG - [Pod Pod ctest-pod-93112133] Cmd output: ctest-pod-59989089 Connecting to 10.100.222.242:80 (10.100.222.242:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 02:33:10,516 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-59989089': 1, 'ctest-pod-05325844': 3} 2025-01-09 02:33:15,574 - DEBUG - [Pod ctest-pod-83265947] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:33:15,574 - DEBUG - [Pod Pod ctest-pod-83265947] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:33:15,574 - DEBUG - [Pod Pod ctest-pod-83265947] Cmd output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:33:20,641 - DEBUG - [Pod ctest-pod-83265947] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:33:20,641 - DEBUG - [Pod Pod ctest-pod-83265947] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:33:20,642 - DEBUG - [Pod Pod ctest-pod-83265947] Cmd output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:33:25,694 - DEBUG - [Pod ctest-pod-83265947] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:33:25,695 - DEBUG - [Pod Pod ctest-pod-83265947] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:33:25,695 - DEBUG - [Pod Pod ctest-pod-83265947] Cmd output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:33:30,756 - DEBUG - [Pod ctest-pod-83265947] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:33:30,756 - DEBUG - [Pod Pod ctest-pod-83265947] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:33:30,756 - DEBUG - [Pod Pod ctest-pod-83265947] Cmd output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:33:35,816 - DEBUG - [Pod ctest-pod-83265947] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:33:35,816 - DEBUG - [Pod Pod ctest-pod-83265947] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:33:35,816 - DEBUG - [Pod Pod ctest-pod-83265947] Cmd output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:33:40,885 - DEBUG - [Pod ctest-pod-83265947] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:33:40,885 - DEBUG - [Pod Pod ctest-pod-83265947] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:33:40,885 - DEBUG - [Pod Pod ctest-pod-83265947] Cmd output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:33:45,948 - DEBUG - [Pod ctest-pod-83265947] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:33:45,948 - DEBUG - [Pod Pod ctest-pod-83265947] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:33:45,948 - DEBUG - [Pod Pod ctest-pod-83265947] Cmd output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:33:51,010 - DEBUG - [Pod ctest-pod-83265947] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:33:51,010 - DEBUG - [Pod Pod ctest-pod-83265947] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:33:51,010 - DEBUG - [Pod Pod ctest-pod-83265947] Cmd output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:33:56,069 - DEBUG - [Pod ctest-pod-83265947] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:33:56,069 - DEBUG - [Pod Pod ctest-pod-83265947] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:33:56,069 - DEBUG - [Pod Pod ctest-pod-83265947] Cmd output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:34:01,117 - DEBUG - [Pod ctest-pod-83265947] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:34:01,118 - DEBUG - [Pod Pod ctest-pod-83265947] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:34:01,118 - DEBUG - [Pod Pod ctest-pod-83265947] Cmd output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:34:01,118 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-59989089': 0, 'ctest-pod-05325844': 0} 2025-01-09 02:34:03,178 - DEBUG - [Pod ctest-pod-93112133] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.428 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.083 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.346 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.083/0.619/1.428 ms 2025-01-09 02:34:03,178 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-93112133 with expectation True passed 2025-01-09 02:34:05,239 - DEBUG - [Pod ctest-pod-62666746] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.089 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.066 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.105 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.066/0.420/1.089 ms 2025-01-09 02:34:05,239 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-62666746 with expectation True passed 2025-01-09 02:34:07,309 - DEBUG - [Pod ctest-pod-83265947] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.904 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.080 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.083 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.080/0.355/0.904 ms 2025-01-09 02:34:07,310 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-83265947 with expectation True passed 2025-01-09 02:34:07,362 - DEBUG - [Pod ctest-pod-93112133] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-09 02:34:07,363 - DEBUG - [Pod Pod ctest-pod-93112133] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-01-09 02:34:07,363 - DEBUG - [Pod Pod ctest-pod-93112133] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-09 02:34:07,363 - INFO - wget check of of http://10.47.255.251 from ctest-pod-93112133 passed 2025-01-09 02:34:07,425 - DEBUG - [Pod ctest-pod-93112133] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-09 02:34:07,425 - DEBUG - [Pod Pod ctest-pod-93112133] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-01-09 02:34:07,425 - DEBUG - [Pod Pod ctest-pod-93112133] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-09 02:34:07,425 - INFO - wget check of of http://10.47.255.250 from ctest-pod-93112133 passed 2025-01-09 02:34:12,497 - DEBUG - [Pod ctest-pod-62666746] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-09 02:34:12,498 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-09 02:34:12,498 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-09 02:34:12,498 - INFO - wget check of of http://10.47.255.250 from ctest-pod-62666746 passed 2025-01-09 02:34:17,571 - DEBUG - [Pod ctest-pod-45127452] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-01-09 02:34:17,587 - DEBUG - [Pod Pod ctest-pod-45127452] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-01-09 02:34:17,587 - DEBUG - [Pod Pod ctest-pod-45127452] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-01-09 02:34:17,587 - INFO - wget check of of http://10.47.255.251 from ctest-pod-45127452 passed 2025-01-09 02:34:17,626 - INFO - Updating Network Policy ingress-on-service 2025-01-09 02:34:22,744 - DEBUG - [Pod ctest-pod-62666746] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:34:22,744 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:34:22,744 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:34:27,810 - DEBUG - [Pod ctest-pod-62666746] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:34:27,810 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:34:27,810 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:34:32,876 - DEBUG - [Pod ctest-pod-62666746] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:34:32,876 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:34:32,877 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:34:37,940 - DEBUG - [Pod ctest-pod-62666746] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:34:37,940 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:34:37,940 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:34:43,005 - DEBUG - [Pod ctest-pod-62666746] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:34:43,005 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:34:43,005 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:34:48,064 - DEBUG - [Pod ctest-pod-62666746] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:34:48,064 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:34:48,064 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:34:53,124 - DEBUG - [Pod ctest-pod-62666746] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:34:53,124 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:34:53,124 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:34:58,199 - DEBUG - [Pod ctest-pod-62666746] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:34:58,199 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:34:58,199 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:35:03,258 - DEBUG - [Pod ctest-pod-62666746] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:35:03,258 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:35:03,258 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:35:08,317 - DEBUG - [Pod ctest-pod-62666746] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:35:08,318 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:35:08,318 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd output: Connecting to 10.100.222.242:80 (10.100.222.242:80) wget: download timed out 2025-01-09 02:35:08,318 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-59989089': 0, 'ctest-pod-05325844': 0} 2025-01-09 02:35:08,392 - DEBUG - [Pod ctest-pod-93112133] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: ctest-pod-05325844 Connecting to 10.100.222.242:80 (10.100.222.242:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 02:35:08,392 - DEBUG - [Pod Pod ctest-pod-93112133] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 passed 2025-01-09 02:35:08,392 - DEBUG - [Pod Pod ctest-pod-93112133] Cmd output: ctest-pod-05325844 Connecting to 10.100.222.242:80 (10.100.222.242:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 02:35:08,438 - DEBUG - [Pod ctest-pod-93112133] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: ctest-pod-05325844 Connecting to 10.100.222.242:80 (10.100.222.242:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 02:35:08,438 - DEBUG - [Pod Pod ctest-pod-93112133] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 passed 2025-01-09 02:35:08,438 - DEBUG - [Pod Pod ctest-pod-93112133] Cmd output: ctest-pod-05325844 Connecting to 10.100.222.242:80 (10.100.222.242:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 02:35:08,494 - DEBUG - [Pod ctest-pod-93112133] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: ctest-pod-59989089 Connecting to 10.100.222.242:80 (10.100.222.242:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 02:35:08,494 - DEBUG - [Pod Pod ctest-pod-93112133] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 passed 2025-01-09 02:35:08,494 - DEBUG - [Pod Pod ctest-pod-93112133] Cmd output: ctest-pod-59989089 Connecting to 10.100.222.242:80 (10.100.222.242:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 02:35:08,494 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-59989089': 1, 'ctest-pod-05325844': 2} 2025-01-09 02:35:08,560 - DEBUG - [Pod ctest-pod-83265947] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: ctest-pod-05325844 Connecting to 10.100.222.242:80 (10.100.222.242:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 02:35:08,560 - DEBUG - [Pod Pod ctest-pod-83265947] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 passed 2025-01-09 02:35:08,560 - DEBUG - [Pod Pod ctest-pod-83265947] Cmd output: ctest-pod-05325844 Connecting to 10.100.222.242:80 (10.100.222.242:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 02:35:08,639 - DEBUG - [Pod ctest-pod-83265947] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: ctest-pod-05325844 Connecting to 10.100.222.242:80 (10.100.222.242:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 02:35:08,639 - DEBUG - [Pod Pod ctest-pod-83265947] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 passed 2025-01-09 02:35:08,639 - DEBUG - [Pod Pod ctest-pod-83265947] Cmd output: ctest-pod-05325844 Connecting to 10.100.222.242:80 (10.100.222.242:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 02:35:08,706 - DEBUG - [Pod ctest-pod-83265947] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: ctest-pod-05325844 Connecting to 10.100.222.242:80 (10.100.222.242:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 02:35:08,706 - DEBUG - [Pod Pod ctest-pod-83265947] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 passed 2025-01-09 02:35:08,706 - DEBUG - [Pod Pod ctest-pod-83265947] Cmd output: ctest-pod-05325844 Connecting to 10.100.222.242:80 (10.100.222.242:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 02:35:08,765 - DEBUG - [Pod ctest-pod-83265947] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: ctest-pod-05325844 Connecting to 10.100.222.242:80 (10.100.222.242:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 02:35:08,765 - DEBUG - [Pod Pod ctest-pod-83265947] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 passed 2025-01-09 02:35:08,765 - DEBUG - [Pod Pod ctest-pod-83265947] Cmd output: ctest-pod-05325844 Connecting to 10.100.222.242:80 (10.100.222.242:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 02:35:08,822 - DEBUG - [Pod ctest-pod-83265947] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: ctest-pod-05325844 Connecting to 10.100.222.242:80 (10.100.222.242:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 02:35:08,822 - DEBUG - [Pod Pod ctest-pod-83265947] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 passed 2025-01-09 02:35:08,822 - DEBUG - [Pod Pod ctest-pod-83265947] Cmd output: ctest-pod-05325844 Connecting to 10.100.222.242:80 (10.100.222.242:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 02:35:08,897 - DEBUG - [Pod ctest-pod-83265947] Cmd: wget http://10.100.222.242:80/ -O - -T 5 -t 1 , Output: ctest-pod-59989089 Connecting to 10.100.222.242:80 (10.100.222.242:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 02:35:08,897 - DEBUG - [Pod Pod ctest-pod-83265947] Cmd wget http://10.100.222.242:80/ -O - -T 5 -t 1 passed 2025-01-09 02:35:08,897 - DEBUG - [Pod Pod ctest-pod-83265947] Cmd output: ctest-pod-59989089 Connecting to 10.100.222.242:80 (10.100.222.242:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 02:35:08,897 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-59989089': 1, 'ctest-pod-05325844': 5} 2025-01-09 02:35:10,959 - DEBUG - [Pod ctest-pod-93112133] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.875 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.082 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.087 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.082/0.348/0.875 ms 2025-01-09 02:35:10,959 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-93112133 with expectation True passed 2025-01-09 02:35:13,029 - DEBUG - [Pod ctest-pod-62666746] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.120 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.077 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.089 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.077/0.428/1.120 ms 2025-01-09 02:35:13,029 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-62666746 with expectation True passed 2025-01-09 02:35:15,095 - DEBUG - [Pod ctest-pod-83265947] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.658 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.079 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.098 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.079/0.278/0.658 ms 2025-01-09 02:35:15,095 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-83265947 with expectation True passed 2025-01-09 02:35:15,169 - DEBUG - [Pod ctest-pod-93112133] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-09 02:35:15,169 - DEBUG - [Pod Pod ctest-pod-93112133] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-01-09 02:35:15,169 - DEBUG - [Pod Pod ctest-pod-93112133] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-09 02:35:15,170 - INFO - wget check of of http://10.47.255.251 from ctest-pod-93112133 passed 2025-01-09 02:35:15,221 - DEBUG - [Pod ctest-pod-93112133] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-09 02:35:15,221 - DEBUG - [Pod Pod ctest-pod-93112133] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-01-09 02:35:15,221 - DEBUG - [Pod Pod ctest-pod-93112133] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-09 02:35:15,221 - INFO - wget check of of http://10.47.255.250 from ctest-pod-93112133 passed 2025-01-09 02:35:20,276 - DEBUG - [Pod ctest-pod-62666746] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-09 02:35:20,276 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-09 02:35:20,276 - DEBUG - [Pod Pod ctest-pod-62666746] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-09 02:35:20,276 - INFO - wget check of of http://10.47.255.250 from ctest-pod-62666746 passed 2025-01-09 02:35:20,326 - DEBUG - [Pod ctest-pod-45127452] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-09 02:35:20,326 - DEBUG - [Pod Pod ctest-pod-45127452] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-01-09 02:35:20,326 - DEBUG - [Pod Pod ctest-pod-45127452] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-09 02:35:20,326 - INFO - wget check of of http://10.47.255.251 from ctest-pod-45127452 passed 2025-01-09 02:35:20,326 - INFO - Deleting Network Policy : ingress-on-service 2025-01-09 02:35:20,327 - INFO - Deleting service : ctest-nginx-svc-43441295 2025-01-09 02:35:20,565 - DEBUG - No XMPP flaps were noticed during the test
2025-01-09 02:35:20,565 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:06]
2025-01-09 02:35:20,565 - INFO - -------------------------------------------------------------------------------- 2025-01-09 02:35:20,570 - INFO - Deleting pod ctest-new-default-61180475:ctest-pod-59989089 2025-01-09 02:35:20,570 - INFO - Deleting pod ctest-new-default-61180475:ctest-pod-05325844 2025-01-09 02:35:20,570 - INFO - Deleting pod ctest-non-default-63817872:ctest-pod-39706088 2025-01-09 02:35:20,571 - INFO - Deleting pod ctest-non-default-63817872:ctest-pod-89764413 2025-01-09 02:35:20,571 - INFO - Deleting pod ctest-new-default-61180475:ctest-pod-62666746 2025-01-09 02:35:20,571 - INFO - Deleting pod ctest-new-default-61180475:ctest-pod-93112133 2025-01-09 02:35:20,572 - INFO - Deleting pod ctest-non-default-63817872:ctest-pod-83265947 2025-01-09 02:35:20,572 - INFO - Deleting pod ctest-non-default-63817872:ctest-pod-45127452 2025-01-09 02:35:20,671 - WARNING - Pod uuid 11d773ff-bc97-456f-ba15-3a890c81a7e9 is still seen in agent 10.0.0.35 VM list 2025-01-09 02:35:20,672 - WARNING - Pod uuid 2c8ee476-3070-4108-a8e1-830f86355d5e is still seen in agent 10.0.0.35 VM list 2025-01-09 02:35:20,695 - WARNING - Pod uuid 81c9ed55-72f6-4dc4-b1eb-8c40e6dd54e3 is still seen in agent 10.0.0.35 VM list 2025-01-09 02:35:20,697 - WARNING - Pod uuid e8f87759-a451-4083-8b79-099388316917 is still seen in agent 10.0.0.35 VM list 2025-01-09 02:35:20,698 - WARNING - Pod uuid 5e2e53fa-e248-48ba-91fa-d523a8680666 is still seen in agent 10.0.0.35 VM list 2025-01-09 02:35:20,698 - WARNING - Pod uuid afa5cfe8-d31e-470b-810a-6a2b325a5dd1 is still seen in agent 10.0.0.35 VM list 2025-01-09 02:35:20,698 - WARNING - Pod uuid 1818a806-4645-4e8f-8efc-9e6d8adbca23 is still seen in agent 10.0.0.35 VM list 2025-01-09 02:35:20,699 - WARNING - Pod uuid f4ac9901-39aa-4cc2-88bc-0d9b7c5eb95f is still seen in agent 10.0.0.35 VM list 2025-01-09 02:35:25,683 - WARNING - Pod uuid 11d773ff-bc97-456f-ba15-3a890c81a7e9 is still seen in agent 10.0.0.35 VM list 2025-01-09 02:35:25,684 - DEBUG - Pod 2c8ee476-3070-4108-a8e1-830f86355d5e is not in agent 10.0.0.35 VM list 2025-01-09 02:35:25,689 - DEBUG - VMI e4407498-ce31-11ef-b0b9-fa163e2bff8f is removed from agent 10.0.0.35 2025-01-09 02:35:25,689 - INFO - Verified that pod ctest-pod-59989089 is removed in agent 2025-01-09 02:35:25,705 - DEBUG - Pod 81c9ed55-72f6-4dc4-b1eb-8c40e6dd54e3 is not in agent 10.0.0.35 VM list 2025-01-09 02:35:25,722 - DEBUG - Pod 5e2e53fa-e248-48ba-91fa-d523a8680666 is not in agent 10.0.0.35 VM list 2025-01-09 02:35:25,723 - WARNING - Pod uuid afa5cfe8-d31e-470b-810a-6a2b325a5dd1 is still seen in agent 10.0.0.35 VM list 2025-01-09 02:35:25,725 - DEBUG - VMI e4b25248-ce31-11ef-b0b9-fa163e2bff8f is removed from agent 10.0.0.35 2025-01-09 02:35:25,726 - INFO - Verified that pod ctest-pod-05325844 is removed in agent 2025-01-09 02:35:25,726 - WARNING - Pod uuid 1818a806-4645-4e8f-8efc-9e6d8adbca23 is still seen in agent 10.0.0.35 VM list 2025-01-09 02:35:25,726 - WARNING - Pod uuid e8f87759-a451-4083-8b79-099388316917 is still seen in agent 10.0.0.35 VM list 2025-01-09 02:35:25,726 - DEBUG - Pod f4ac9901-39aa-4cc2-88bc-0d9b7c5eb95f is not in agent 10.0.0.35 VM list 2025-01-09 02:35:25,735 - DEBUG - VMI e5ddd584-ce31-11ef-b0b9-fa163e2bff8f is removed from agent 10.0.0.35 2025-01-09 02:35:25,735 - INFO - Verified that pod ctest-pod-89764413 is removed in agent 2025-01-09 02:35:25,736 - DEBUG - VMI e560e24a-ce31-11ef-b0b9-fa163e2bff8f is removed from agent 10.0.0.35 2025-01-09 02:35:25,736 - INFO - Verified that pod ctest-pod-39706088 is removed in agent 2025-01-09 02:35:30,691 - WARNING - Pod uuid 11d773ff-bc97-456f-ba15-3a890c81a7e9 is still seen in agent 10.0.0.35 VM list 2025-01-09 02:35:30,738 - WARNING - Pod uuid e8f87759-a451-4083-8b79-099388316917 is still seen in agent 10.0.0.35 VM list 2025-01-09 02:35:30,740 - WARNING - Pod uuid afa5cfe8-d31e-470b-810a-6a2b325a5dd1 is still seen in agent 10.0.0.35 VM list 2025-01-09 02:35:30,740 - WARNING - Pod uuid 1818a806-4645-4e8f-8efc-9e6d8adbca23 is still seen in agent 10.0.0.35 VM list 2025-01-09 02:35:35,698 - WARNING - Pod uuid 11d773ff-bc97-456f-ba15-3a890c81a7e9 is still seen in agent 10.0.0.35 VM list 2025-01-09 02:35:35,754 - WARNING - Pod uuid e8f87759-a451-4083-8b79-099388316917 is still seen in agent 10.0.0.35 VM list 2025-01-09 02:35:35,756 - WARNING - Pod uuid 1818a806-4645-4e8f-8efc-9e6d8adbca23 is still seen in agent 10.0.0.35 VM list 2025-01-09 02:35:35,757 - WARNING - Pod uuid afa5cfe8-d31e-470b-810a-6a2b325a5dd1 is still seen in agent 10.0.0.35 VM list 2025-01-09 02:35:40,706 - WARNING - Pod uuid 11d773ff-bc97-456f-ba15-3a890c81a7e9 is still seen in agent 10.0.0.35 VM list 2025-01-09 02:35:40,768 - WARNING - Pod uuid e8f87759-a451-4083-8b79-099388316917 is still seen in agent 10.0.0.35 VM list 2025-01-09 02:35:40,770 - WARNING - Pod uuid afa5cfe8-d31e-470b-810a-6a2b325a5dd1 is still seen in agent 10.0.0.35 VM list 2025-01-09 02:35:40,770 - WARNING - Pod uuid 1818a806-4645-4e8f-8efc-9e6d8adbca23 is still seen in agent 10.0.0.35 VM list 2025-01-09 02:35:45,716 - WARNING - Pod uuid 11d773ff-bc97-456f-ba15-3a890c81a7e9 is still seen in agent 10.0.0.35 VM list 2025-01-09 02:35:45,783 - WARNING - Pod uuid e8f87759-a451-4083-8b79-099388316917 is still seen in agent 10.0.0.35 VM list 2025-01-09 02:35:45,784 - WARNING - Pod uuid 1818a806-4645-4e8f-8efc-9e6d8adbca23 is still seen in agent 10.0.0.35 VM list 2025-01-09 02:35:45,784 - WARNING - Pod uuid afa5cfe8-d31e-470b-810a-6a2b325a5dd1 is still seen in agent 10.0.0.35 VM list 2025-01-09 02:35:50,724 - WARNING - Pod uuid 11d773ff-bc97-456f-ba15-3a890c81a7e9 is still seen in agent 10.0.0.35 VM list 2025-01-09 02:35:50,798 - WARNING - Pod uuid afa5cfe8-d31e-470b-810a-6a2b325a5dd1 is still seen in agent 10.0.0.35 VM list 2025-01-09 02:35:50,799 - WARNING - Pod uuid 1818a806-4645-4e8f-8efc-9e6d8adbca23 is still seen in agent 10.0.0.35 VM list 2025-01-09 02:35:50,799 - WARNING - Pod uuid e8f87759-a451-4083-8b79-099388316917 is still seen in agent 10.0.0.35 VM list 2025-01-09 02:35:55,732 - DEBUG - Pod 11d773ff-bc97-456f-ba15-3a890c81a7e9 is not in agent 10.0.0.35 VM list 2025-01-09 02:35:55,737 - DEBUG - VMI e6703406-ce31-11ef-b0b9-fa163e2bff8f is removed from agent 10.0.0.35 2025-01-09 02:35:55,737 - INFO - Verified that pod ctest-pod-62666746 is removed in agent 2025-01-09 02:35:55,813 - DEBUG - Pod 1818a806-4645-4e8f-8efc-9e6d8adbca23 is not in agent 10.0.0.35 VM list 2025-01-09 02:35:55,815 - DEBUG - Pod afa5cfe8-d31e-470b-810a-6a2b325a5dd1 is not in agent 10.0.0.35 VM list 2025-01-09 02:35:55,816 - DEBUG - Pod e8f87759-a451-4083-8b79-099388316917 is not in agent 10.0.0.35 VM list 2025-01-09 02:35:55,826 - DEBUG - VMI e6eab2b2-ce31-11ef-b0b9-fa163e2bff8f is removed from agent 10.0.0.35 2025-01-09 02:35:55,826 - INFO - Verified that pod ctest-pod-93112133 is removed in agent 2025-01-09 02:35:55,827 - DEBUG - VMI e76ebfa8-ce31-11ef-b0b9-fa163e2bff8f is removed from agent 10.0.0.35 2025-01-09 02:35:55,828 - INFO - Verified that pod ctest-pod-83265947 is removed in agent 2025-01-09 02:35:55,828 - DEBUG - VMI e7e14d7a-ce31-11ef-b0b9-fa163e2bff8f is removed from agent 10.0.0.35 2025-01-09 02:35:55,828 - INFO - Verified that pod ctest-pod-45127452 is removed in agent 2025-01-09 02:35:55,828 - INFO - Deleting namespace ctest-non-default-63817872 2025-01-09 02:35:55,846 - DEBUG - Namespace ctest-non-default-63817872 still in k8s 2025-01-09 02:35:57,851 - DEBUG - Namespace ctest-non-default-63817872 still in k8s 2025-01-09 02:35:59,856 - DEBUG - Namespace ctest-non-default-63817872 still in k8s 2025-01-09 02:36:01,865 - DEBUG - Namespace ctest-non-default-63817872 is not in k8s 2025-01-09 02:36:01,872 - DEBUG - No need to check project deletion in contrail-api 2025-01-09 02:36:01,872 - INFO - Deleting namespace ctest-new-default-61180475 2025-01-09 02:36:01,883 - DEBUG - Namespace ctest-new-default-61180475 still in k8s 2025-01-09 02:36:03,887 - DEBUG - Namespace ctest-new-default-61180475 still in k8s 2025-01-09 02:36:05,892 - DEBUG - Namespace ctest-new-default-61180475 still in k8s 2025-01-09 02:36:07,896 - DEBUG - Namespace ctest-new-default-61180475 is not in k8s 2025-01-09 02:36:07,897 - DEBUG - No need to check project deletion in contrail-api