2025-06-25 07:28:48,422 - INFO - Using existing project ['default-domain', 'k8s-default'](ffe96933-739f-4c6c-ae37-504d5eb204e6) 2025-06-25 07:28:48,447 - DEBUG - Namespace ctest-new-default-92766129 not present 2025-06-25 07:28:48,456 - INFO - Created namespace ctest-new-default-92766129 2025-06-25 07:28:51,462 - DEBUG - Namespace ctest-non-default-47632952 not present 2025-06-25 07:28:51,477 - INFO - Created namespace ctest-non-default-47632952 2025-06-25 07:28:54,500 - DEBUG - Pod ctest-pod-19005985 not present 2025-06-25 07:28:54,500 - INFO - Creating Pod ctest-pod-19005985 2025-06-25 07:28:54,531 - DEBUG - Pod : ctest-pod-19005985 UUID is 9d6b0c75-ed79-4f0f-a342-133b3999b319 2025-06-25 07:28:54,537 - DEBUG - Pod ctest-pod-78307653 not present 2025-06-25 07:28:54,537 - INFO - Creating Pod ctest-pod-78307653 2025-06-25 07:28:54,569 - DEBUG - Pod : ctest-pod-78307653 UUID is 8ffaa3fb-7ef4-4855-99af-68532190761b 2025-06-25 07:28:54,572 - DEBUG - Pod ctest-pod-14211731 not present 2025-06-25 07:28:54,573 - INFO - Creating Pod ctest-pod-14211731 2025-06-25 07:28:54,621 - DEBUG - Pod : ctest-pod-14211731 UUID is 214963b7-9a96-455a-9c5f-a67a0b085959 2025-06-25 07:28:54,627 - DEBUG - Pod ctest-pod-37252338 not present 2025-06-25 07:28:54,628 - INFO - Creating Pod ctest-pod-37252338 2025-06-25 07:28:54,666 - DEBUG - Pod : ctest-pod-37252338 UUID is 04c3d3cd-50ac-4a3a-8c9b-226af85d5ef2 2025-06-25 07:28:54,669 - DEBUG - Pod ctest-pod-30677573 not present 2025-06-25 07:28:54,669 - INFO - Creating Pod ctest-pod-30677573 2025-06-25 07:28:54,699 - DEBUG - Pod : ctest-pod-30677573 UUID is c145b8d5-9480-4e7f-8d21-039ed65737dc 2025-06-25 07:28:54,701 - DEBUG - Pod ctest-pod-93506239 not present 2025-06-25 07:28:54,701 - INFO - Creating Pod ctest-pod-93506239 2025-06-25 07:28:54,733 - DEBUG - Pod : ctest-pod-93506239 UUID is f0212c61-6566-48f9-99ce-9a823d2d8919 2025-06-25 07:28:54,735 - DEBUG - Pod ctest-pod-91472541 not present 2025-06-25 07:28:54,736 - INFO - Creating Pod ctest-pod-91472541 2025-06-25 07:28:54,761 - DEBUG - Pod : ctest-pod-91472541 UUID is 61ed19fc-6325-4203-b5bd-61aa3da32c19 2025-06-25 07:28:54,769 - DEBUG - Pod ctest-pod-23917530 not present 2025-06-25 07:28:54,769 - INFO - Creating Pod ctest-pod-23917530 2025-06-25 07:28:54,790 - DEBUG - Pod : ctest-pod-23917530 UUID is 3dd4885f-f37d-4d1a-ba15-9c1911f55a3e 2025-06-25 07:28:55,012 - INFO - Project default-domain:k8s-ctest-new-default-92766129 for Namespace ctest-new-default-92766129 is seen in contrail-api 2025-06-25 07:28:55,012 - DEBUG - Project uuid in Contrail is e13b1e14-77ed-49c4-8b87-e34a63abcf0a 2025-06-25 07:28:55,186 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_NamespaceDatabaseList?namespace_uuid=15818b39-0b51-439c-acd1-d76803cf27e1 2025-06-25 07:28:55,191 - INFO - Namespace ctest-new-default-92766129 with uuid 15818b39-0b51-439c-acd1-d76803cf27e1 found in kube manager 2025-06-25 07:28:55,191 - INFO - Namespace ctest-new-default-92766129 verification passed 2025-06-25 07:28:55,350 - INFO - Project default-domain:k8s-ctest-non-default-47632952 for Namespace ctest-non-default-47632952 is seen in contrail-api 2025-06-25 07:28:55,351 - DEBUG - Project uuid in Contrail is bc135321-d3df-4a4e-8e48-6dd2a36c7aba 2025-06-25 07:28:55,351 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_NamespaceDatabaseList?namespace_uuid=f519e2f5-28b5-4ca3-81b8-2bc0d011f05a 2025-06-25 07:28:55,356 - INFO - Namespace ctest-non-default-47632952 with uuid f519e2f5-28b5-4ca3-81b8-2bc0d011f05a found in kube manager 2025-06-25 07:28:55,357 - INFO - Namespace ctest-non-default-47632952 verification passed 2025-06-25 07:28:55,364 - DEBUG - Pod ctest-pod-19005985 not in running state.Currently in Pending 2025-06-25 07:29:00,371 - DEBUG - Pod ctest-pod-19005985 not in running state.Currently in Pending 2025-06-25 07:29:05,381 - INFO - Pod ctest-pod-19005985 is in running state.Got IP 10.47.255.251 2025-06-25 07:29:05,397 - DEBUG - Pod ctest-pod-19005985 has vmi 0d9c9078-5196-11f0-9f16-fa163e045acf 2025-06-25 07:29:05,397 - INFO - Verified pod ctest-pod-19005985 in contrail-api 2025-06-25 07:29:05,410 - DEBUG - VMI 0d9c9078-5196-11f0-9f16-fa163e045acf is active in agent 10.0.0.241 2025-06-25 07:29:05,410 - INFO - Verified Pod ctest-pod-19005985 in agent 10.0.0.241 2025-06-25 07:29:05,411 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=9d6b0c75-ed79-4f0f-a342-133b3999b319 2025-06-25 07:29:05,415 - INFO - Pod ctest-pod-19005985 with uuid 9d6b0c75-ed79-4f0f-a342-133b3999b319 found in kube manager 2025-06-25 07:29:05,415 - INFO - Pod ctest-pod-19005985 verification passed 2025-06-25 07:29:05,422 - DEBUG - Pod ctest-pod-78307653 not in running state.Currently in Pending 2025-06-25 07:29:10,429 - INFO - Pod ctest-pod-78307653 is in running state.Got IP 10.47.255.250 2025-06-25 07:29:10,484 - DEBUG - Pod ctest-pod-78307653 has vmi 0e235702-5196-11f0-9f16-fa163e045acf 2025-06-25 07:29:10,484 - INFO - Verified pod ctest-pod-78307653 in contrail-api 2025-06-25 07:29:10,501 - DEBUG - VMI 0e235702-5196-11f0-9f16-fa163e045acf is active in agent 10.0.0.241 2025-06-25 07:29:10,501 - INFO - Verified Pod ctest-pod-78307653 in agent 10.0.0.241 2025-06-25 07:29:10,501 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=8ffaa3fb-7ef4-4855-99af-68532190761b 2025-06-25 07:29:10,507 - INFO - Pod ctest-pod-78307653 with uuid 8ffaa3fb-7ef4-4855-99af-68532190761b found in kube manager 2025-06-25 07:29:10,507 - INFO - Pod ctest-pod-78307653 verification passed 2025-06-25 07:29:10,515 - INFO - Pod ctest-pod-14211731 is in running state.Got IP 10.47.255.249 2025-06-25 07:29:10,532 - DEBUG - Pod ctest-pod-14211731 has vmi 0ece2a74-5196-11f0-9f16-fa163e045acf 2025-06-25 07:29:10,533 - INFO - Verified pod ctest-pod-14211731 in contrail-api 2025-06-25 07:29:10,555 - DEBUG - VMI 0ece2a74-5196-11f0-9f16-fa163e045acf is active in agent 10.0.0.241 2025-06-25 07:29:10,555 - INFO - Verified Pod ctest-pod-14211731 in agent 10.0.0.241 2025-06-25 07:29:10,555 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=214963b7-9a96-455a-9c5f-a67a0b085959 2025-06-25 07:29:10,562 - INFO - Pod ctest-pod-14211731 with uuid 214963b7-9a96-455a-9c5f-a67a0b085959 found in kube manager 2025-06-25 07:29:10,562 - INFO - Pod ctest-pod-14211731 verification passed 2025-06-25 07:29:10,570 - INFO - Pod ctest-pod-37252338 is in running state.Got IP 10.47.255.248 2025-06-25 07:29:10,648 - DEBUG - Pod ctest-pod-37252338 has vmi 0f49dfc0-5196-11f0-9f16-fa163e045acf 2025-06-25 07:29:10,649 - INFO - Verified pod ctest-pod-37252338 in contrail-api 2025-06-25 07:29:10,663 - DEBUG - VMI 0f49dfc0-5196-11f0-9f16-fa163e045acf is active in agent 10.0.0.241 2025-06-25 07:29:10,663 - INFO - Verified Pod ctest-pod-37252338 in agent 10.0.0.241 2025-06-25 07:29:10,663 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=04c3d3cd-50ac-4a3a-8c9b-226af85d5ef2 2025-06-25 07:29:10,672 - INFO - Pod ctest-pod-37252338 with uuid 04c3d3cd-50ac-4a3a-8c9b-226af85d5ef2 found in kube manager 2025-06-25 07:29:10,672 - INFO - Pod ctest-pod-37252338 verification passed 2025-06-25 07:29:10,677 - DEBUG - Pod ctest-pod-30677573 not in running state.Currently in Pending 2025-06-25 07:29:15,685 - INFO - Pod ctest-pod-30677573 is in running state.Got IP 10.47.255.247 2025-06-25 07:29:15,701 - DEBUG - Pod ctest-pod-30677573 has vmi 0fdb7476-5196-11f0-9f16-fa163e045acf 2025-06-25 07:29:15,701 - INFO - Verified pod ctest-pod-30677573 in contrail-api 2025-06-25 07:29:15,715 - DEBUG - VMI 0fdb7476-5196-11f0-9f16-fa163e045acf is active in agent 10.0.0.241 2025-06-25 07:29:15,715 - INFO - Verified Pod ctest-pod-30677573 in agent 10.0.0.241 2025-06-25 07:29:15,715 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=c145b8d5-9480-4e7f-8d21-039ed65737dc 2025-06-25 07:29:15,721 - INFO - Pod ctest-pod-30677573 with uuid c145b8d5-9480-4e7f-8d21-039ed65737dc found in kube manager 2025-06-25 07:29:15,721 - INFO - Pod ctest-pod-30677573 verification passed 2025-06-25 07:29:15,818 - INFO - Pod ctest-pod-91472541 is in running state.Got IP 10.47.255.245 2025-06-25 07:29:15,834 - DEBUG - Pod ctest-pod-91472541 has vmi 10cccc2c-5196-11f0-9f16-fa163e045acf 2025-06-25 07:29:15,834 - INFO - Verified pod ctest-pod-91472541 in contrail-api 2025-06-25 07:29:15,852 - DEBUG - VMI 10cccc2c-5196-11f0-9f16-fa163e045acf is active in agent 10.0.0.241 2025-06-25 07:29:15,853 - INFO - Verified Pod ctest-pod-91472541 in agent 10.0.0.241 2025-06-25 07:29:15,853 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=61ed19fc-6325-4203-b5bd-61aa3da32c19 2025-06-25 07:29:15,861 - INFO - Pod ctest-pod-91472541 with uuid 61ed19fc-6325-4203-b5bd-61aa3da32c19 found in kube manager 2025-06-25 07:29:15,862 - INFO - Pod ctest-pod-91472541 verification passed 2025-06-25 07:29:15,869 - INFO - Pod ctest-pod-93506239 is in running state.Got IP 10.47.255.246 2025-06-25 07:29:15,944 - DEBUG - Pod ctest-pod-93506239 has vmi 105987c6-5196-11f0-9f16-fa163e045acf 2025-06-25 07:29:15,944 - INFO - Verified pod ctest-pod-93506239 in contrail-api 2025-06-25 07:29:15,959 - DEBUG - VMI 105987c6-5196-11f0-9f16-fa163e045acf is active in agent 10.0.0.241 2025-06-25 07:29:15,959 - INFO - Verified Pod ctest-pod-93506239 in agent 10.0.0.241 2025-06-25 07:29:15,959 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=f0212c61-6566-48f9-99ce-9a823d2d8919 2025-06-25 07:29:15,964 - INFO - Pod ctest-pod-93506239 with uuid f0212c61-6566-48f9-99ce-9a823d2d8919 found in kube manager 2025-06-25 07:29:15,965 - INFO - Pod ctest-pod-93506239 verification passed 2025-06-25 07:29:15,971 - INFO - Pod ctest-pod-23917530 is in running state.Got IP 10.47.255.244 2025-06-25 07:29:15,988 - DEBUG - Pod ctest-pod-23917530 has vmi 114e4c5c-5196-11f0-9f16-fa163e045acf 2025-06-25 07:29:15,988 - INFO - Verified pod ctest-pod-23917530 in contrail-api 2025-06-25 07:29:16,006 - DEBUG - VMI 114e4c5c-5196-11f0-9f16-fa163e045acf is active in agent 10.0.0.241 2025-06-25 07:29:16,007 - INFO - Verified Pod ctest-pod-23917530 in agent 10.0.0.241 2025-06-25 07:29:16,007 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_VirtualMachineDatabaseList?x=3dd4885f-f37d-4d1a-ba15-9c1911f55a3e 2025-06-25 07:29:16,012 - INFO - Pod ctest-pod-23917530 with uuid 3dd4885f-f37d-4d1a-ba15-9c1911f55a3e found in kube manager 2025-06-25 07:29:16,012 - INFO - Pod ctest-pod-23917530 verification passed 2025-06-25 07:29:16,012 - INFO - ================================================================================ 2025-06-25 07:29:16,012 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-06-25 07:29:16,012 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-06-25 07:29:16,273 - DEBUG - Nothing to compare xmpp stats {'10.0.0.241': {'10.0.0.19': '0'}} with 2025-06-25 07:29:16,273 - INFO - Initial checks done. Running the testcase now 2025-06-25 07:29:16,274 - INFO - 2025-06-25 07:29:16,339 - DEBUG - [Pod ctest-pod-19005985] Cmd: echo ctest-pod-19005985 > /usr/share/nginx/html/index.html, Output: 2025-06-25 07:29:16,402 - DEBUG - [Pod ctest-pod-78307653] Cmd: echo ctest-pod-78307653 > /usr/share/nginx/html/index.html, Output: 2025-06-25 07:29:16,468 - DEBUG - [Pod ctest-pod-14211731] Cmd: echo ctest-pod-14211731 > /usr/share/nginx/html/index.html, Output: 2025-06-25 07:29:16,520 - DEBUG - [Pod ctest-pod-37252338] Cmd: echo ctest-pod-37252338 > /usr/share/nginx/html/index.html, Output: 2025-06-25 07:29:16,523 - DEBUG - Service ctest-nginx-svc-01113779 not present 2025-06-25 07:29:16,524 - INFO - Creating service ctest-nginx-svc-01113779 2025-06-25 07:29:16,544 - INFO - Created Service ctest-nginx-svc-01113779 2025-06-25 07:29:16,552 - WARNING - Service UUID 135916f8-9d7d-4b6f-b71e-bb826e758896 not yet found in contrail-api 2025-06-25 07:29:17,561 - INFO - Validated that Service ctest-nginx-svc-01113779 is seen in contrail-api 2025-06-25 07:29:17,561 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_LoadbalancerDatabaseList?x=135916f8-9d7d-4b6f-b71e-bb826e758896 2025-06-25 07:29:17,567 - INFO - Service ctest-nginx-svc-01113779 with uuid 135916f8-9d7d-4b6f-b71e-bb826e758896 found in kube manager 2025-06-25 07:29:17,567 - INFO - Service ctest-nginx-svc-01113779 verification passed 2025-06-25 07:29:18,640 - DEBUG - [Pod ctest-pod-30677573] Cmd: wget http://10.104.191.63:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.191.63:80 (10.104.191.63:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-78307653 2025-06-25 07:29:18,640 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd wget http://10.104.191.63:80/ -O - -T 5 -t 1 passed 2025-06-25 07:29:18,640 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd output: Connecting to 10.104.191.63:80 (10.104.191.63:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-78307653 2025-06-25 07:29:18,702 - DEBUG - [Pod ctest-pod-30677573] Cmd: wget http://10.104.191.63:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.191.63:80 (10.104.191.63:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-19005985 2025-06-25 07:29:18,702 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd wget http://10.104.191.63:80/ -O - -T 5 -t 1 passed 2025-06-25 07:29:18,702 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd output: Connecting to 10.104.191.63:80 (10.104.191.63:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-19005985 2025-06-25 07:29:18,702 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-19005985': 1, 'ctest-pod-78307653': 1} 2025-06-25 07:29:18,758 - DEBUG - [Pod ctest-pod-91472541] Cmd: wget http://10.104.191.63:80/ -O - -T 5 -t 1 , Output: ctest-pod-78307653 Connecting to 10.104.191.63:80 (10.104.191.63:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-25 07:29:18,758 - DEBUG - [Pod Pod ctest-pod-91472541] Cmd wget http://10.104.191.63:80/ -O - -T 5 -t 1 passed 2025-06-25 07:29:18,758 - DEBUG - [Pod Pod ctest-pod-91472541] Cmd output: ctest-pod-78307653 Connecting to 10.104.191.63:80 (10.104.191.63:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-25 07:29:18,827 - DEBUG - [Pod ctest-pod-91472541] Cmd: wget http://10.104.191.63:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.191.63:80 (10.104.191.63:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-19005985 2025-06-25 07:29:18,827 - DEBUG - [Pod Pod ctest-pod-91472541] Cmd wget http://10.104.191.63:80/ -O - -T 5 -t 1 passed 2025-06-25 07:29:18,827 - DEBUG - [Pod Pod ctest-pod-91472541] Cmd output: Connecting to 10.104.191.63:80 (10.104.191.63:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-19005985 2025-06-25 07:29:18,827 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-19005985': 1, 'ctest-pod-78307653': 1} 2025-06-25 07:29:18,830 - DEBUG - Network policy ingress-on-service not present 2025-06-25 07:29:18,831 - INFO - Creating Network Policy ingress-on-service 2025-06-25 07:29:18,852 - INFO - Network policy found in k8s 2025-06-25 07:29:18,852 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=eb64ff23-8081-419c-9d90-0a1cc199a611 2025-06-25 07:29:18,858 - INFO - Network Policy ingress-on-service with uuid eb64ff23-8081-419c-9d90-0a1cc199a611 found in kube manager 2025-06-25 07:29:18,892 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-06-25 07:29:18,892 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-06-25 07:29:18,893 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=eb64ff23-8081-419c-9d90-0a1cc199a611 2025-06-25 07:29:18,923 - WARNING - Network policy with name ingress-on-service not found in agent 2025-06-25 07:29:20,924 - DEBUG - Requesting: http://10.0.0.19:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=eb64ff23-8081-419c-9d90-0a1cc199a611 2025-06-25 07:29:20,956 - INFO - Network policy with name ingress-on-service found in agent 2025-06-25 07:29:20,957 - INFO - Network Policy ingress-on-service verification passed 2025-06-25 07:29:26,025 - DEBUG - [Pod ctest-pod-30677573] Cmd: wget http://10.104.191.63:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:29:26,026 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd wget http://10.104.191.63:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:29:26,026 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:29:31,081 - DEBUG - [Pod ctest-pod-30677573] Cmd: wget http://10.104.191.63:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:29:31,081 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd wget http://10.104.191.63:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:29:31,081 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:29:36,141 - DEBUG - [Pod ctest-pod-30677573] Cmd: wget http://10.104.191.63:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:29:36,141 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd wget http://10.104.191.63:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:29:36,142 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:29:41,229 - DEBUG - [Pod ctest-pod-30677573] Cmd: wget http://10.104.191.63:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:29:41,229 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd wget http://10.104.191.63:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:29:41,229 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:29:46,279 - DEBUG - [Pod ctest-pod-30677573] Cmd: wget http://10.104.191.63:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:29:46,280 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd wget http://10.104.191.63:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:29:46,280 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:29:51,332 - DEBUG - [Pod ctest-pod-30677573] Cmd: wget http://10.104.191.63:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:29:51,333 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd wget http://10.104.191.63:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:29:51,333 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:29:56,394 - DEBUG - [Pod ctest-pod-30677573] Cmd: wget http://10.104.191.63:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:29:56,394 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd wget http://10.104.191.63:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:29:56,394 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:30:01,446 - DEBUG - [Pod ctest-pod-30677573] Cmd: wget http://10.104.191.63:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:30:01,446 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd wget http://10.104.191.63:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:30:01,446 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:30:06,506 - DEBUG - [Pod ctest-pod-30677573] Cmd: wget http://10.104.191.63:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:30:06,506 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd wget http://10.104.191.63:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:30:06,506 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:30:11,560 - DEBUG - [Pod ctest-pod-30677573] Cmd: wget http://10.104.191.63:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:30:11,560 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd wget http://10.104.191.63:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:30:11,560 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:30:11,560 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-19005985': 0, 'ctest-pod-78307653': 0} 2025-06-25 07:30:11,614 - DEBUG - [Pod ctest-pod-93506239] Cmd: wget http://10.104.191.63:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.191.63:80 (10.104.191.63:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-78307653 2025-06-25 07:30:11,614 - DEBUG - [Pod Pod ctest-pod-93506239] Cmd wget http://10.104.191.63:80/ -O - -T 5 -t 1 passed 2025-06-25 07:30:11,614 - DEBUG - [Pod Pod ctest-pod-93506239] Cmd output: Connecting to 10.104.191.63:80 (10.104.191.63:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-78307653 2025-06-25 07:30:11,666 - DEBUG - [Pod ctest-pod-93506239] Cmd: wget http://10.104.191.63:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.191.63:80 (10.104.191.63:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-78307653 2025-06-25 07:30:11,667 - DEBUG - [Pod Pod ctest-pod-93506239] Cmd wget http://10.104.191.63:80/ -O - -T 5 -t 1 passed 2025-06-25 07:30:11,667 - DEBUG - [Pod Pod ctest-pod-93506239] Cmd output: Connecting to 10.104.191.63:80 (10.104.191.63:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-78307653 2025-06-25 07:30:11,726 - DEBUG - [Pod ctest-pod-93506239] Cmd: wget http://10.104.191.63:80/ -O - -T 5 -t 1 , Output: ctest-pod-78307653 Connecting to 10.104.191.63:80 (10.104.191.63:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-25 07:30:11,726 - DEBUG - [Pod Pod ctest-pod-93506239] Cmd wget http://10.104.191.63:80/ -O - -T 5 -t 1 passed 2025-06-25 07:30:11,726 - DEBUG - [Pod Pod ctest-pod-93506239] Cmd output: ctest-pod-78307653 Connecting to 10.104.191.63:80 (10.104.191.63:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-25 07:30:11,787 - DEBUG - [Pod ctest-pod-93506239] Cmd: wget http://10.104.191.63:80/ -O - -T 5 -t 1 , Output: ctest-pod-19005985 Connecting to 10.104.191.63:80 (10.104.191.63:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-25 07:30:11,788 - DEBUG - [Pod Pod ctest-pod-93506239] Cmd wget http://10.104.191.63:80/ -O - -T 5 -t 1 passed 2025-06-25 07:30:11,788 - DEBUG - [Pod Pod ctest-pod-93506239] Cmd output: ctest-pod-19005985 Connecting to 10.104.191.63:80 (10.104.191.63:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-25 07:30:11,788 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-19005985': 1, 'ctest-pod-78307653': 3} 2025-06-25 07:30:16,839 - DEBUG - [Pod ctest-pod-91472541] Cmd: wget http://10.104.191.63:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:30:16,839 - DEBUG - [Pod Pod ctest-pod-91472541] Cmd wget http://10.104.191.63:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:30:16,839 - DEBUG - [Pod Pod ctest-pod-91472541] Cmd output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:30:21,890 - DEBUG - [Pod ctest-pod-91472541] Cmd: wget http://10.104.191.63:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:30:21,891 - DEBUG - [Pod Pod ctest-pod-91472541] Cmd wget http://10.104.191.63:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:30:21,891 - DEBUG - [Pod Pod ctest-pod-91472541] Cmd output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:30:26,943 - DEBUG - [Pod ctest-pod-91472541] Cmd: wget http://10.104.191.63:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:30:26,943 - DEBUG - [Pod Pod ctest-pod-91472541] Cmd wget http://10.104.191.63:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:30:26,943 - DEBUG - [Pod Pod ctest-pod-91472541] Cmd output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:30:31,997 - DEBUG - [Pod ctest-pod-91472541] Cmd: wget http://10.104.191.63:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:30:31,998 - DEBUG - [Pod Pod ctest-pod-91472541] Cmd wget http://10.104.191.63:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:30:31,998 - DEBUG - [Pod Pod ctest-pod-91472541] Cmd output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:30:37,048 - DEBUG - [Pod ctest-pod-91472541] Cmd: wget http://10.104.191.63:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:30:37,048 - DEBUG - [Pod Pod ctest-pod-91472541] Cmd wget http://10.104.191.63:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:30:37,048 - DEBUG - [Pod Pod ctest-pod-91472541] Cmd output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:30:42,102 - DEBUG - [Pod ctest-pod-91472541] Cmd: wget http://10.104.191.63:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:30:42,102 - DEBUG - [Pod Pod ctest-pod-91472541] Cmd wget http://10.104.191.63:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:30:42,102 - DEBUG - [Pod Pod ctest-pod-91472541] Cmd output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:30:47,152 - DEBUG - [Pod ctest-pod-91472541] Cmd: wget http://10.104.191.63:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:30:47,152 - DEBUG - [Pod Pod ctest-pod-91472541] Cmd wget http://10.104.191.63:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:30:47,152 - DEBUG - [Pod Pod ctest-pod-91472541] Cmd output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:30:52,202 - DEBUG - [Pod ctest-pod-91472541] Cmd: wget http://10.104.191.63:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:30:52,202 - DEBUG - [Pod Pod ctest-pod-91472541] Cmd wget http://10.104.191.63:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:30:52,202 - DEBUG - [Pod Pod ctest-pod-91472541] Cmd output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:30:57,256 - DEBUG - [Pod ctest-pod-91472541] Cmd: wget http://10.104.191.63:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:30:57,256 - DEBUG - [Pod Pod ctest-pod-91472541] Cmd wget http://10.104.191.63:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:30:57,256 - DEBUG - [Pod Pod ctest-pod-91472541] Cmd output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:31:02,305 - DEBUG - [Pod ctest-pod-91472541] Cmd: wget http://10.104.191.63:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:31:02,305 - DEBUG - [Pod Pod ctest-pod-91472541] Cmd wget http://10.104.191.63:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:31:02,305 - DEBUG - [Pod Pod ctest-pod-91472541] Cmd output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:31:02,305 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-19005985': 0, 'ctest-pod-78307653': 0} 2025-06-25 07:31:04,361 - DEBUG - [Pod ctest-pod-93506239] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.341 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.096 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.084 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.084/0.507/1.341 ms 2025-06-25 07:31:04,361 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-93506239 with expectation True passed 2025-06-25 07:31:06,413 - DEBUG - [Pod ctest-pod-30677573] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.707 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.088 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.122 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.088/0.305/0.707 ms 2025-06-25 07:31:06,413 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-30677573 with expectation True passed 2025-06-25 07:31:08,466 - DEBUG - [Pod ctest-pod-91472541] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.005 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.106 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.122 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.106/0.411/1.005 ms 2025-06-25 07:31:08,466 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-91472541 with expectation True passed 2025-06-25 07:31:08,531 - DEBUG - [Pod ctest-pod-93506239] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-25 07:31:08,531 - DEBUG - [Pod Pod ctest-pod-93506239] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-06-25 07:31:08,531 - DEBUG - [Pod Pod ctest-pod-93506239] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-25 07:31:08,531 - INFO - wget check of of http://10.47.255.251 from ctest-pod-93506239 passed 2025-06-25 07:31:08,581 - DEBUG - [Pod ctest-pod-93506239] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-25 07:31:08,581 - DEBUG - [Pod Pod ctest-pod-93506239] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-06-25 07:31:08,581 - DEBUG - [Pod Pod ctest-pod-93506239] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-25 07:31:08,582 - INFO - wget check of of http://10.47.255.250 from ctest-pod-93506239 passed 2025-06-25 07:31:13,638 - DEBUG - [Pod ctest-pod-30677573] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-25 07:31:13,638 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-25 07:31:13,638 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-25 07:31:13,638 - INFO - wget check of of http://10.47.255.250 from ctest-pod-30677573 passed 2025-06-25 07:31:18,691 - DEBUG - [Pod ctest-pod-23917530] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-06-25 07:31:18,691 - DEBUG - [Pod Pod ctest-pod-23917530] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-06-25 07:31:18,691 - DEBUG - [Pod Pod ctest-pod-23917530] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-06-25 07:31:18,691 - INFO - wget check of of http://10.47.255.251 from ctest-pod-23917530 passed 2025-06-25 07:31:18,700 - INFO - Updating Network Policy ingress-on-service 2025-06-25 07:31:23,763 - DEBUG - [Pod ctest-pod-30677573] Cmd: wget http://10.104.191.63:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:31:23,764 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd wget http://10.104.191.63:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:31:23,764 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:31:28,836 - DEBUG - [Pod ctest-pod-30677573] Cmd: wget http://10.104.191.63:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:31:28,836 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd wget http://10.104.191.63:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:31:28,836 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:31:33,892 - DEBUG - [Pod ctest-pod-30677573] Cmd: wget http://10.104.191.63:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:31:33,893 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd wget http://10.104.191.63:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:31:33,893 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:31:38,945 - DEBUG - [Pod ctest-pod-30677573] Cmd: wget http://10.104.191.63:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:31:38,945 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd wget http://10.104.191.63:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:31:38,945 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:31:44,006 - DEBUG - [Pod ctest-pod-30677573] Cmd: wget http://10.104.191.63:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:31:44,007 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd wget http://10.104.191.63:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:31:44,007 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:31:49,077 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2025-06-25 07:31:59,156 - DEBUG - [Pod ctest-pod-30677573] Cmd: wget http://10.104.191.63:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:31:59,156 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd wget http://10.104.191.63:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:31:59,156 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:32:04,212 - DEBUG - [Pod ctest-pod-30677573] Cmd: wget http://10.104.191.63:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:32:04,213 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd wget http://10.104.191.63:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:32:04,213 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:32:09,266 - DEBUG - [Pod ctest-pod-30677573] Cmd: wget http://10.104.191.63:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:32:09,266 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd wget http://10.104.191.63:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:32:09,266 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:32:14,330 - DEBUG - [Pod ctest-pod-30677573] Cmd: wget http://10.104.191.63:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:32:14,331 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd wget http://10.104.191.63:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:32:14,331 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:32:19,403 - DEBUG - [Pod ctest-pod-30677573] Cmd: wget http://10.104.191.63:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:32:19,403 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd wget http://10.104.191.63:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:32:19,403 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd output: Connecting to 10.104.191.63:80 (10.104.191.63:80) wget: download timed out 2025-06-25 07:32:19,403 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-19005985': 0, 'ctest-pod-78307653': 0} 2025-06-25 07:32:19,457 - DEBUG - [Pod ctest-pod-93506239] Cmd: wget http://10.104.191.63:80/ -O - -T 5 -t 1 , Output: ctest-pod-19005985 Connecting to 10.104.191.63:80 (10.104.191.63:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-25 07:32:19,457 - DEBUG - [Pod Pod ctest-pod-93506239] Cmd wget http://10.104.191.63:80/ -O - -T 5 -t 1 passed 2025-06-25 07:32:19,457 - DEBUG - [Pod Pod ctest-pod-93506239] Cmd output: ctest-pod-19005985 Connecting to 10.104.191.63:80 (10.104.191.63:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-25 07:32:19,495 - DEBUG - [Pod ctest-pod-93506239] Cmd: wget http://10.104.191.63:80/ -O - -T 5 -t 1 , Output: ctest-pod-78307653 Connecting to 10.104.191.63:80 (10.104.191.63:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-25 07:32:19,495 - DEBUG - [Pod Pod ctest-pod-93506239] Cmd wget http://10.104.191.63:80/ -O - -T 5 -t 1 passed 2025-06-25 07:32:19,495 - DEBUG - [Pod Pod ctest-pod-93506239] Cmd output: ctest-pod-78307653 Connecting to 10.104.191.63:80 (10.104.191.63:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-25 07:32:19,495 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-19005985': 1, 'ctest-pod-78307653': 1} 2025-06-25 07:32:19,550 - DEBUG - [Pod ctest-pod-91472541] Cmd: wget http://10.104.191.63:80/ -O - -T 5 -t 1 , Output: ctest-pod-19005985 Connecting to 10.104.191.63:80 (10.104.191.63:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-25 07:32:19,550 - DEBUG - [Pod Pod ctest-pod-91472541] Cmd wget http://10.104.191.63:80/ -O - -T 5 -t 1 passed 2025-06-25 07:32:19,550 - DEBUG - [Pod Pod ctest-pod-91472541] Cmd output: ctest-pod-19005985 Connecting to 10.104.191.63:80 (10.104.191.63:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-25 07:32:19,602 - DEBUG - [Pod ctest-pod-91472541] Cmd: wget http://10.104.191.63:80/ -O - -T 5 -t 1 , Output: ctest-pod-78307653 Connecting to 10.104.191.63:80 (10.104.191.63:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-25 07:32:19,603 - DEBUG - [Pod Pod ctest-pod-91472541] Cmd wget http://10.104.191.63:80/ -O - -T 5 -t 1 passed 2025-06-25 07:32:19,603 - DEBUG - [Pod Pod ctest-pod-91472541] Cmd output: ctest-pod-78307653 Connecting to 10.104.191.63:80 (10.104.191.63:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-25 07:32:19,603 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-19005985': 1, 'ctest-pod-78307653': 1} 2025-06-25 07:32:21,653 - DEBUG - [Pod ctest-pod-93506239] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.466 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.107 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.119 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.107/0.564/1.466 ms 2025-06-25 07:32:21,653 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-93506239 with expectation True passed 2025-06-25 07:32:23,710 - DEBUG - [Pod ctest-pod-30677573] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.998 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.098 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.114 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.098/0.403/0.998 ms 2025-06-25 07:32:23,710 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-30677573 with expectation True passed 2025-06-25 07:32:25,760 - DEBUG - [Pod ctest-pod-91472541] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.575 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.077 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.092 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.077/0.248/0.575 ms 2025-06-25 07:32:25,760 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-91472541 with expectation True passed 2025-06-25 07:32:25,826 - DEBUG - [Pod ctest-pod-93506239] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-25 07:32:25,826 - DEBUG - [Pod Pod ctest-pod-93506239] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-06-25 07:32:25,826 - DEBUG - [Pod Pod ctest-pod-93506239] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-25 07:32:25,826 - INFO - wget check of of http://10.47.255.251 from ctest-pod-93506239 passed 2025-06-25 07:32:25,885 - DEBUG - [Pod ctest-pod-93506239] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-25 07:32:25,885 - DEBUG - [Pod Pod ctest-pod-93506239] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-06-25 07:32:25,885 - DEBUG - [Pod Pod ctest-pod-93506239] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-25 07:32:25,885 - INFO - wget check of of http://10.47.255.250 from ctest-pod-93506239 passed 2025-06-25 07:32:30,937 - DEBUG - [Pod ctest-pod-30677573] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-25 07:32:30,937 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-25 07:32:30,937 - DEBUG - [Pod Pod ctest-pod-30677573] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-25 07:32:30,937 - INFO - wget check of of http://10.47.255.250 from ctest-pod-30677573 passed 2025-06-25 07:32:30,998 - DEBUG - [Pod ctest-pod-23917530] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-25 07:32:30,998 - DEBUG - [Pod Pod ctest-pod-23917530] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-06-25 07:32:30,998 - DEBUG - [Pod Pod ctest-pod-23917530] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-25 07:32:30,998 - INFO - wget check of of http://10.47.255.251 from ctest-pod-23917530 passed 2025-06-25 07:32:30,998 - INFO - Deleting Network Policy : ingress-on-service 2025-06-25 07:32:30,999 - INFO - Deleting service : ctest-nginx-svc-01113779 2025-06-25 07:32:31,192 - DEBUG - No XMPP flaps were noticed during the test 2025-06-25 07:32:31,192 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:15] 2025-06-25 07:32:31,192 - INFO - -------------------------------------------------------------------------------- 2025-06-25 07:32:31,197 - INFO - Deleting pod ctest-new-default-92766129:ctest-pod-19005985 2025-06-25 07:32:31,198 - INFO - Deleting pod ctest-new-default-92766129:ctest-pod-78307653 2025-06-25 07:32:31,198 - INFO - Deleting pod ctest-non-default-47632952:ctest-pod-14211731 2025-06-25 07:32:31,198 - INFO - Deleting pod ctest-non-default-47632952:ctest-pod-37252338 2025-06-25 07:32:31,199 - INFO - Deleting pod ctest-new-default-92766129:ctest-pod-30677573 2025-06-25 07:32:31,199 - INFO - Deleting pod ctest-new-default-92766129:ctest-pod-93506239 2025-06-25 07:32:31,199 - INFO - Deleting pod ctest-non-default-47632952:ctest-pod-91472541 2025-06-25 07:32:31,199 - INFO - Deleting pod ctest-non-default-47632952:ctest-pod-23917530 2025-06-25 07:32:31,250 - WARNING - Pod uuid 9d6b0c75-ed79-4f0f-a342-133b3999b319 is still seen in agent 10.0.0.241 VM list 2025-06-25 07:32:31,364 - WARNING - Pod uuid 3dd4885f-f37d-4d1a-ba15-9c1911f55a3e is still seen in agent 10.0.0.241 VM list 2025-06-25 07:32:31,365 - WARNING - Pod uuid 8ffaa3fb-7ef4-4855-99af-68532190761b is still seen in agent 10.0.0.241 VM list 2025-06-25 07:32:31,366 - WARNING - Pod uuid 04c3d3cd-50ac-4a3a-8c9b-226af85d5ef2 is still seen in agent 10.0.0.241 VM list 2025-06-25 07:32:31,366 - WARNING - Pod uuid f0212c61-6566-48f9-99ce-9a823d2d8919 is still seen in agent 10.0.0.241 VM list 2025-06-25 07:32:31,367 - WARNING - Pod uuid 61ed19fc-6325-4203-b5bd-61aa3da32c19 is still seen in agent 10.0.0.241 VM list 2025-06-25 07:32:31,367 - WARNING - Pod uuid 214963b7-9a96-455a-9c5f-a67a0b085959 is still seen in agent 10.0.0.241 VM list 2025-06-25 07:32:31,368 - WARNING - Pod uuid c145b8d5-9480-4e7f-8d21-039ed65737dc is still seen in agent 10.0.0.241 VM list 2025-06-25 07:32:36,259 - DEBUG - Pod 9d6b0c75-ed79-4f0f-a342-133b3999b319 is not in agent 10.0.0.241 VM list 2025-06-25 07:32:36,266 - DEBUG - VMI 0d9c9078-5196-11f0-9f16-fa163e045acf is removed from agent 10.0.0.241 2025-06-25 07:32:36,266 - INFO - Verified that pod ctest-pod-19005985 is removed in agent 2025-06-25 07:32:36,402 - WARNING - Pod uuid 61ed19fc-6325-4203-b5bd-61aa3da32c19 is still seen in agent 10.0.0.241 VM list 2025-06-25 07:32:36,402 - WARNING - Pod uuid f0212c61-6566-48f9-99ce-9a823d2d8919 is still seen in agent 10.0.0.241 VM list 2025-06-25 07:32:36,403 - DEBUG - Pod 214963b7-9a96-455a-9c5f-a67a0b085959 is not in agent 10.0.0.241 VM list 2025-06-25 07:32:36,404 - WARNING - Pod uuid 3dd4885f-f37d-4d1a-ba15-9c1911f55a3e is still seen in agent 10.0.0.241 VM list 2025-06-25 07:32:36,405 - DEBUG - Pod 8ffaa3fb-7ef4-4855-99af-68532190761b is not in agent 10.0.0.241 VM list 2025-06-25 07:32:36,406 - DEBUG - Pod 04c3d3cd-50ac-4a3a-8c9b-226af85d5ef2 is not in agent 10.0.0.241 VM list 2025-06-25 07:32:36,412 - WARNING - Pod uuid c145b8d5-9480-4e7f-8d21-039ed65737dc is still seen in agent 10.0.0.241 VM list 2025-06-25 07:32:36,421 - DEBUG - VMI 0ece2a74-5196-11f0-9f16-fa163e045acf is removed from agent 10.0.0.241 2025-06-25 07:32:36,421 - INFO - Verified that pod ctest-pod-14211731 is removed in agent 2025-06-25 07:32:36,424 - DEBUG - VMI 0f49dfc0-5196-11f0-9f16-fa163e045acf is removed from agent 10.0.0.241 2025-06-25 07:32:36,425 - INFO - Verified that pod ctest-pod-37252338 is removed in agent 2025-06-25 07:32:36,425 - DEBUG - VMI 0e235702-5196-11f0-9f16-fa163e045acf is removed from agent 10.0.0.241 2025-06-25 07:32:36,425 - INFO - Verified that pod ctest-pod-78307653 is removed in agent 2025-06-25 07:32:41,419 - WARNING - Pod uuid 61ed19fc-6325-4203-b5bd-61aa3da32c19 is still seen in agent 10.0.0.241 VM list 2025-06-25 07:32:41,422 - WARNING - Pod uuid 3dd4885f-f37d-4d1a-ba15-9c1911f55a3e is still seen in agent 10.0.0.241 VM list 2025-06-25 07:32:41,423 - WARNING - Pod uuid c145b8d5-9480-4e7f-8d21-039ed65737dc is still seen in agent 10.0.0.241 VM list 2025-06-25 07:32:41,423 - WARNING - Pod uuid f0212c61-6566-48f9-99ce-9a823d2d8919 is still seen in agent 10.0.0.241 VM list 2025-06-25 07:32:46,440 - WARNING - Pod uuid 3dd4885f-f37d-4d1a-ba15-9c1911f55a3e is still seen in agent 10.0.0.241 VM list 2025-06-25 07:32:46,441 - WARNING - Pod uuid 61ed19fc-6325-4203-b5bd-61aa3da32c19 is still seen in agent 10.0.0.241 VM list 2025-06-25 07:32:46,442 - WARNING - Pod uuid f0212c61-6566-48f9-99ce-9a823d2d8919 is still seen in agent 10.0.0.241 VM list 2025-06-25 07:32:46,443 - WARNING - Pod uuid c145b8d5-9480-4e7f-8d21-039ed65737dc is still seen in agent 10.0.0.241 VM list 2025-06-25 07:32:51,461 - WARNING - Pod uuid 3dd4885f-f37d-4d1a-ba15-9c1911f55a3e is still seen in agent 10.0.0.241 VM list 2025-06-25 07:32:51,463 - WARNING - Pod uuid f0212c61-6566-48f9-99ce-9a823d2d8919 is still seen in agent 10.0.0.241 VM list 2025-06-25 07:32:51,463 - WARNING - Pod uuid c145b8d5-9480-4e7f-8d21-039ed65737dc is still seen in agent 10.0.0.241 VM list 2025-06-25 07:32:51,464 - WARNING - Pod uuid 61ed19fc-6325-4203-b5bd-61aa3da32c19 is still seen in agent 10.0.0.241 VM list 2025-06-25 07:32:56,482 - WARNING - Pod uuid f0212c61-6566-48f9-99ce-9a823d2d8919 is still seen in agent 10.0.0.241 VM list 2025-06-25 07:32:56,483 - WARNING - Pod uuid 3dd4885f-f37d-4d1a-ba15-9c1911f55a3e is still seen in agent 10.0.0.241 VM list 2025-06-25 07:32:56,484 - WARNING - Pod uuid c145b8d5-9480-4e7f-8d21-039ed65737dc is still seen in agent 10.0.0.241 VM list 2025-06-25 07:32:56,484 - WARNING - Pod uuid 61ed19fc-6325-4203-b5bd-61aa3da32c19 is still seen in agent 10.0.0.241 VM list 2025-06-25 07:33:01,514 - WARNING - Pod uuid 3dd4885f-f37d-4d1a-ba15-9c1911f55a3e is still seen in agent 10.0.0.241 VM list 2025-06-25 07:33:01,515 - WARNING - Pod uuid f0212c61-6566-48f9-99ce-9a823d2d8919 is still seen in agent 10.0.0.241 VM list 2025-06-25 07:33:01,516 - WARNING - Pod uuid c145b8d5-9480-4e7f-8d21-039ed65737dc is still seen in agent 10.0.0.241 VM list 2025-06-25 07:33:01,516 - WARNING - Pod uuid 61ed19fc-6325-4203-b5bd-61aa3da32c19 is still seen in agent 10.0.0.241 VM list 2025-06-25 07:33:06,539 - DEBUG - Pod f0212c61-6566-48f9-99ce-9a823d2d8919 is not in agent 10.0.0.241 VM list 2025-06-25 07:33:06,541 - DEBUG - Pod 3dd4885f-f37d-4d1a-ba15-9c1911f55a3e is not in agent 10.0.0.241 VM list 2025-06-25 07:33:06,544 - DEBUG - Pod c145b8d5-9480-4e7f-8d21-039ed65737dc is not in agent 10.0.0.241 VM list 2025-06-25 07:33:06,546 - DEBUG - Pod 61ed19fc-6325-4203-b5bd-61aa3da32c19 is not in agent 10.0.0.241 VM list 2025-06-25 07:33:06,564 - DEBUG - VMI 105987c6-5196-11f0-9f16-fa163e045acf is removed from agent 10.0.0.241 2025-06-25 07:33:06,564 - INFO - Verified that pod ctest-pod-93506239 is removed in agent 2025-06-25 07:33:06,565 - DEBUG - VMI 114e4c5c-5196-11f0-9f16-fa163e045acf is removed from agent 10.0.0.241 2025-06-25 07:33:06,565 - INFO - Verified that pod ctest-pod-23917530 is removed in agent 2025-06-25 07:33:06,567 - DEBUG - VMI 10cccc2c-5196-11f0-9f16-fa163e045acf is removed from agent 10.0.0.241 2025-06-25 07:33:06,567 - INFO - Verified that pod ctest-pod-91472541 is removed in agent 2025-06-25 07:33:06,568 - DEBUG - VMI 0fdb7476-5196-11f0-9f16-fa163e045acf is removed from agent 10.0.0.241 2025-06-25 07:33:06,568 - INFO - Verified that pod ctest-pod-30677573 is removed in agent 2025-06-25 07:33:06,568 - INFO - Deleting namespace ctest-non-default-47632952 2025-06-25 07:33:06,578 - DEBUG - Namespace ctest-non-default-47632952 still in k8s 2025-06-25 07:33:08,583 - DEBUG - Namespace ctest-non-default-47632952 still in k8s 2025-06-25 07:33:10,588 - DEBUG - Namespace ctest-non-default-47632952 still in k8s 2025-06-25 07:33:12,592 - DEBUG - Namespace ctest-non-default-47632952 is not in k8s 2025-06-25 07:33:12,592 - DEBUG - No need to check project deletion in contrail-api 2025-06-25 07:33:12,592 - INFO - Deleting namespace ctest-new-default-92766129 2025-06-25 07:33:12,602 - DEBUG - Namespace ctest-new-default-92766129 still in k8s 2025-06-25 07:33:14,606 - DEBUG - Namespace ctest-new-default-92766129 still in k8s 2025-06-25 07:33:16,611 - DEBUG - Namespace ctest-new-default-92766129 still in k8s 2025-06-25 07:33:18,614 - DEBUG - Namespace ctest-new-default-92766129 is not in k8s 2025-06-25 07:33:18,614 - DEBUG - No need to check project deletion in contrail-api