2025-05-08 02:22:21,940 - INFO - Using existing project ['default-domain', 'k8s-default'](61ec7bac-0bea-46f6-9912-06ddd2c367a6) 2025-05-08 02:22:21,960 - DEBUG - Namespace ctest-new-default-73673113 not present 2025-05-08 02:22:21,968 - INFO - Created namespace ctest-new-default-73673113 2025-05-08 02:22:24,972 - DEBUG - Namespace ctest-non-default-69567989 not present 2025-05-08 02:22:24,984 - INFO - Created namespace ctest-non-default-69567989 2025-05-08 02:22:28,019 - DEBUG - Pod ctest-pod-34548208 not present 2025-05-08 02:22:28,020 - INFO - Creating Pod ctest-pod-34548208 2025-05-08 02:22:28,187 - DEBUG - Pod : ctest-pod-34548208 UUID is 19236f62-eac4-4a98-bea9-4c718a8e67f9 2025-05-08 02:22:28,197 - DEBUG - Pod ctest-pod-87100117 not present 2025-05-08 02:22:28,197 - INFO - Creating Pod ctest-pod-87100117 2025-05-08 02:22:28,254 - DEBUG - Pod : ctest-pod-87100117 UUID is 2b6da040-a39e-4e34-ab2a-3bb7452f7d7f 2025-05-08 02:22:28,260 - DEBUG - Pod ctest-pod-87259560 not present 2025-05-08 02:22:28,261 - INFO - Creating Pod ctest-pod-87259560 2025-05-08 02:22:28,296 - DEBUG - Pod : ctest-pod-87259560 UUID is b9ff902b-daba-40c2-beb6-00480c28aacd 2025-05-08 02:22:28,299 - DEBUG - Pod ctest-pod-33999133 not present 2025-05-08 02:22:28,299 - INFO - Creating Pod ctest-pod-33999133 2025-05-08 02:22:28,326 - DEBUG - Pod : ctest-pod-33999133 UUID is a3109cd4-1f6e-4465-b370-7f2986cace56 2025-05-08 02:22:28,327 - DEBUG - Pod ctest-pod-12027178 not present 2025-05-08 02:22:28,328 - INFO - Creating Pod ctest-pod-12027178 2025-05-08 02:22:28,352 - DEBUG - Pod : ctest-pod-12027178 UUID is 4a2e3199-1bab-4fc1-a4c6-a18469e4e844 2025-05-08 02:22:28,356 - DEBUG - Pod ctest-pod-70699322 not present 2025-05-08 02:22:28,356 - INFO - Creating Pod ctest-pod-70699322 2025-05-08 02:22:28,386 - DEBUG - Pod : ctest-pod-70699322 UUID is 7b69a9dc-58ec-477f-bd27-fc4958732827 2025-05-08 02:22:28,389 - DEBUG - Pod ctest-pod-75700923 not present 2025-05-08 02:22:28,390 - INFO - Creating Pod ctest-pod-75700923 2025-05-08 02:22:28,452 - DEBUG - Pod : ctest-pod-75700923 UUID is 1196e024-e420-4dce-b79b-818614627c7e 2025-05-08 02:22:28,457 - DEBUG - Pod ctest-pod-98167490 not present 2025-05-08 02:22:28,458 - INFO - Creating Pod ctest-pod-98167490 2025-05-08 02:22:28,478 - DEBUG - Pod : ctest-pod-98167490 UUID is 5934c00b-e1b6-481e-9c2a-de42bbd00f42 2025-05-08 02:22:28,827 - INFO - Project default-domain:k8s-ctest-new-default-73673113 for Namespace ctest-new-default-73673113 is seen in contrail-api 2025-05-08 02:22:28,875 - DEBUG - Project uuid in Contrail is ca0714da-757d-4a6f-b005-e81a60b10f3c 2025-05-08 02:22:29,083 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NamespaceDatabaseList?namespace_uuid=e3566a11-aa2a-42ad-889a-98d8909fc94c 2025-05-08 02:22:29,089 - INFO - Namespace ctest-new-default-73673113 with uuid e3566a11-aa2a-42ad-889a-98d8909fc94c found in kube manager 2025-05-08 02:22:29,089 - INFO - Namespace ctest-new-default-73673113 verification passed 2025-05-08 02:22:29,333 - INFO - Project default-domain:k8s-ctest-non-default-69567989 for Namespace ctest-non-default-69567989 is seen in contrail-api 2025-05-08 02:22:29,333 - DEBUG - Project uuid in Contrail is fcde61af-2a23-4018-a4ac-3c8dd3e510b1 2025-05-08 02:22:29,333 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NamespaceDatabaseList?namespace_uuid=849becb6-a65b-4c05-86e9-dfb6c457e8e6 2025-05-08 02:22:29,343 - INFO - Namespace ctest-non-default-69567989 with uuid 849becb6-a65b-4c05-86e9-dfb6c457e8e6 found in kube manager 2025-05-08 02:22:29,343 - INFO - Namespace ctest-non-default-69567989 verification passed 2025-05-08 02:22:29,352 - DEBUG - Pod ctest-pod-34548208 not in running state.Currently in Pending 2025-05-08 02:22:34,358 - DEBUG - Pod ctest-pod-34548208 not in running state.Currently in Pending 2025-05-08 02:22:39,365 - INFO - Pod ctest-pod-34548208 is in running state.Got IP 10.47.255.251 2025-05-08 02:22:39,429 - DEBUG - Pod ctest-pod-34548208 has vmi 4ada938a-2bb3-11f0-a728-fa163eed29cb 2025-05-08 02:22:39,430 - INFO - Verified pod ctest-pod-34548208 in contrail-api 2025-05-08 02:22:39,457 - DEBUG - VMI 4ada938a-2bb3-11f0-a728-fa163eed29cb is active in agent 10.0.0.22 2025-05-08 02:22:39,457 - INFO - Verified Pod ctest-pod-34548208 in agent 10.0.0.22 2025-05-08 02:22:39,457 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=19236f62-eac4-4a98-bea9-4c718a8e67f9 2025-05-08 02:22:39,463 - INFO - Pod ctest-pod-34548208 with uuid 19236f62-eac4-4a98-bea9-4c718a8e67f9 found in kube manager 2025-05-08 02:22:39,463 - INFO - Pod ctest-pod-34548208 verification passed 2025-05-08 02:22:39,469 - DEBUG - Pod ctest-pod-87100117 not in running state.Currently in Pending 2025-05-08 02:22:44,475 - INFO - Pod ctest-pod-87100117 is in running state.Got IP 10.47.255.250 2025-05-08 02:22:44,489 - DEBUG - Pod ctest-pod-87100117 has vmi 4b6f88c8-2bb3-11f0-a728-fa163eed29cb 2025-05-08 02:22:44,489 - INFO - Verified pod ctest-pod-87100117 in contrail-api 2025-05-08 02:22:44,506 - DEBUG - VMI 4b6f88c8-2bb3-11f0-a728-fa163eed29cb is active in agent 10.0.0.22 2025-05-08 02:22:44,506 - INFO - Verified Pod ctest-pod-87100117 in agent 10.0.0.22 2025-05-08 02:22:44,506 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=2b6da040-a39e-4e34-ab2a-3bb7452f7d7f 2025-05-08 02:22:44,511 - INFO - Pod ctest-pod-87100117 with uuid 2b6da040-a39e-4e34-ab2a-3bb7452f7d7f found in kube manager 2025-05-08 02:22:44,511 - INFO - Pod ctest-pod-87100117 verification passed 2025-05-08 02:22:44,517 - INFO - Pod ctest-pod-87259560 is in running state.Got IP 10.47.255.249 2025-05-08 02:22:44,573 - DEBUG - Pod ctest-pod-87259560 has vmi 4c26efc2-2bb3-11f0-a728-fa163eed29cb 2025-05-08 02:22:44,573 - INFO - Verified pod ctest-pod-87259560 in contrail-api 2025-05-08 02:22:44,589 - DEBUG - VMI 4c26efc2-2bb3-11f0-a728-fa163eed29cb is active in agent 10.0.0.22 2025-05-08 02:22:44,589 - INFO - Verified Pod ctest-pod-87259560 in agent 10.0.0.22 2025-05-08 02:22:44,589 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=b9ff902b-daba-40c2-beb6-00480c28aacd 2025-05-08 02:22:44,593 - INFO - Pod ctest-pod-87259560 with uuid b9ff902b-daba-40c2-beb6-00480c28aacd found in kube manager 2025-05-08 02:22:44,594 - INFO - Pod ctest-pod-87259560 verification passed 2025-05-08 02:22:44,600 - DEBUG - Pod ctest-pod-33999133 not in running state.Currently in Pending 2025-05-08 02:22:49,606 - INFO - Pod ctest-pod-33999133 is in running state.Got IP 10.47.255.248 2025-05-08 02:22:49,620 - DEBUG - Pod ctest-pod-33999133 has vmi 4cbe85a8-2bb3-11f0-a728-fa163eed29cb 2025-05-08 02:22:49,621 - INFO - Verified pod ctest-pod-33999133 in contrail-api 2025-05-08 02:22:49,634 - DEBUG - VMI 4cbe85a8-2bb3-11f0-a728-fa163eed29cb is active in agent 10.0.0.22 2025-05-08 02:22:49,635 - INFO - Verified Pod ctest-pod-33999133 in agent 10.0.0.22 2025-05-08 02:22:49,635 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=a3109cd4-1f6e-4465-b370-7f2986cace56 2025-05-08 02:22:49,639 - INFO - Pod ctest-pod-33999133 with uuid a3109cd4-1f6e-4465-b370-7f2986cace56 found in kube manager 2025-05-08 02:22:49,639 - INFO - Pod ctest-pod-33999133 verification passed 2025-05-08 02:22:49,646 - INFO - Pod ctest-pod-12027178 is in running state.Got IP 10.47.255.247 2025-05-08 02:22:49,705 - DEBUG - Pod ctest-pod-12027178 has vmi 4d6fd8e4-2bb3-11f0-a728-fa163eed29cb 2025-05-08 02:22:49,706 - INFO - Verified pod ctest-pod-12027178 in contrail-api 2025-05-08 02:22:49,720 - DEBUG - VMI 4d6fd8e4-2bb3-11f0-a728-fa163eed29cb is active in agent 10.0.0.22 2025-05-08 02:22:49,720 - INFO - Verified Pod ctest-pod-12027178 in agent 10.0.0.22 2025-05-08 02:22:49,720 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=4a2e3199-1bab-4fc1-a4c6-a18469e4e844 2025-05-08 02:22:49,724 - INFO - Pod ctest-pod-12027178 with uuid 4a2e3199-1bab-4fc1-a4c6-a18469e4e844 found in kube manager 2025-05-08 02:22:49,724 - INFO - Pod ctest-pod-12027178 verification passed 2025-05-08 02:22:49,729 - INFO - Pod ctest-pod-75700923 is in running state.Got IP 10.47.255.245 2025-05-08 02:22:49,741 - DEBUG - Pod ctest-pod-75700923 has vmi 4e960b08-2bb3-11f0-a728-fa163eed29cb 2025-05-08 02:22:49,742 - INFO - Verified pod ctest-pod-75700923 in contrail-api 2025-05-08 02:22:49,754 - DEBUG - VMI 4e960b08-2bb3-11f0-a728-fa163eed29cb is active in agent 10.0.0.22 2025-05-08 02:22:49,755 - INFO - Verified Pod ctest-pod-75700923 in agent 10.0.0.22 2025-05-08 02:22:49,755 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=1196e024-e420-4dce-b79b-818614627c7e 2025-05-08 02:22:49,758 - INFO - Pod ctest-pod-75700923 with uuid 1196e024-e420-4dce-b79b-818614627c7e found in kube manager 2025-05-08 02:22:49,758 - INFO - Pod ctest-pod-75700923 verification passed 2025-05-08 02:22:49,834 - INFO - Pod ctest-pod-70699322 is in running state.Got IP 10.47.255.246 2025-05-08 02:22:49,890 - DEBUG - Pod ctest-pod-70699322 has vmi 4dfce720-2bb3-11f0-a728-fa163eed29cb 2025-05-08 02:22:49,890 - INFO - Verified pod ctest-pod-70699322 in contrail-api 2025-05-08 02:22:49,905 - DEBUG - VMI 4dfce720-2bb3-11f0-a728-fa163eed29cb is active in agent 10.0.0.22 2025-05-08 02:22:49,905 - INFO - Verified Pod ctest-pod-70699322 in agent 10.0.0.22 2025-05-08 02:22:49,906 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=7b69a9dc-58ec-477f-bd27-fc4958732827 2025-05-08 02:22:49,911 - INFO - Pod ctest-pod-70699322 with uuid 7b69a9dc-58ec-477f-bd27-fc4958732827 found in kube manager 2025-05-08 02:22:49,911 - INFO - Pod ctest-pod-70699322 verification passed 2025-05-08 02:22:49,917 - INFO - Pod ctest-pod-98167490 is in running state.Got IP 10.47.255.244 2025-05-08 02:22:49,930 - DEBUG - Pod ctest-pod-98167490 has vmi 4f11612c-2bb3-11f0-a728-fa163eed29cb 2025-05-08 02:22:49,930 - INFO - Verified pod ctest-pod-98167490 in contrail-api 2025-05-08 02:22:49,944 - DEBUG - VMI 4f11612c-2bb3-11f0-a728-fa163eed29cb is active in agent 10.0.0.22 2025-05-08 02:22:49,944 - INFO - Verified Pod ctest-pod-98167490 in agent 10.0.0.22 2025-05-08 02:22:49,944 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=5934c00b-e1b6-481e-9c2a-de42bbd00f42 2025-05-08 02:22:49,949 - INFO - Pod ctest-pod-98167490 with uuid 5934c00b-e1b6-481e-9c2a-de42bbd00f42 found in kube manager 2025-05-08 02:22:49,949 - INFO - Pod ctest-pod-98167490 verification passed 2025-05-08 02:22:49,949 - INFO - ================================================================================ 2025-05-08 02:22:49,949 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-05-08 02:22:49,950 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-05-08 02:22:50,177 - DEBUG - Nothing to compare xmpp stats {'10.0.0.22': {'10.0.0.50': '0'}} with 2025-05-08 02:22:50,177 - INFO - Initial checks done. Running the testcase now 2025-05-08 02:22:50,177 - INFO - 2025-05-08 02:22:50,229 - DEBUG - [Pod ctest-pod-34548208] Cmd: echo ctest-pod-34548208 > /usr/share/nginx/html/index.html, Output: 2025-05-08 02:22:50,282 - DEBUG - [Pod ctest-pod-87100117] Cmd: echo ctest-pod-87100117 > /usr/share/nginx/html/index.html, Output: 2025-05-08 02:22:50,344 - DEBUG - [Pod ctest-pod-87259560] Cmd: echo ctest-pod-87259560 > /usr/share/nginx/html/index.html, Output: 2025-05-08 02:22:50,401 - DEBUG - [Pod ctest-pod-33999133] Cmd: echo ctest-pod-33999133 > /usr/share/nginx/html/index.html, Output: 2025-05-08 02:22:50,404 - DEBUG - Service ctest-nginx-svc-55178599 not present 2025-05-08 02:22:50,404 - INFO - Creating service ctest-nginx-svc-55178599 2025-05-08 02:22:50,423 - INFO - Created Service ctest-nginx-svc-55178599 2025-05-08 02:22:50,429 - WARNING - Service UUID 85fbc71c-8b69-4d33-be83-3aea7abe55a3 not yet found in contrail-api 2025-05-08 02:22:51,437 - INFO - Validated that Service ctest-nginx-svc-55178599 is seen in contrail-api 2025-05-08 02:22:51,438 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_LoadbalancerDatabaseList?x=85fbc71c-8b69-4d33-be83-3aea7abe55a3 2025-05-08 02:22:51,443 - INFO - Service ctest-nginx-svc-55178599 with uuid 85fbc71c-8b69-4d33-be83-3aea7abe55a3 found in kube manager 2025-05-08 02:22:51,443 - INFO - Service ctest-nginx-svc-55178599 verification passed 2025-05-08 02:22:52,534 - DEBUG - [Pod ctest-pod-12027178] Cmd: wget http://10.98.197.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.197.165:80 (10.98.197.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-87100117 2025-05-08 02:22:52,534 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd wget http://10.98.197.165:80/ -O - -T 5 -t 1 passed 2025-05-08 02:22:52,534 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd output: Connecting to 10.98.197.165:80 (10.98.197.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-87100117 2025-05-08 02:22:52,584 - DEBUG - [Pod ctest-pod-12027178] Cmd: wget http://10.98.197.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.197.165:80 (10.98.197.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-34548208 2025-05-08 02:22:52,584 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd wget http://10.98.197.165:80/ -O - -T 5 -t 1 passed 2025-05-08 02:22:52,584 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd output: Connecting to 10.98.197.165:80 (10.98.197.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-34548208 2025-05-08 02:22:52,584 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-34548208': 1, 'ctest-pod-87100117': 1} 2025-05-08 02:22:52,644 - DEBUG - [Pod ctest-pod-75700923] Cmd: wget http://10.98.197.165:80/ -O - -T 5 -t 1 , Output: ctest-pod-87100117 Connecting to 10.98.197.165:80 (10.98.197.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-08 02:22:52,644 - DEBUG - [Pod Pod ctest-pod-75700923] Cmd wget http://10.98.197.165:80/ -O - -T 5 -t 1 passed 2025-05-08 02:22:52,644 - DEBUG - [Pod Pod ctest-pod-75700923] Cmd output: ctest-pod-87100117 Connecting to 10.98.197.165:80 (10.98.197.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-08 02:22:52,694 - DEBUG - [Pod ctest-pod-75700923] Cmd: wget http://10.98.197.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.197.165:80 (10.98.197.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-87100117 2025-05-08 02:22:52,695 - DEBUG - [Pod Pod ctest-pod-75700923] Cmd wget http://10.98.197.165:80/ -O - -T 5 -t 1 passed 2025-05-08 02:22:52,695 - DEBUG - [Pod Pod ctest-pod-75700923] Cmd output: Connecting to 10.98.197.165:80 (10.98.197.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-87100117 2025-05-08 02:22:52,747 - DEBUG - [Pod ctest-pod-75700923] Cmd: wget http://10.98.197.165:80/ -O - -T 5 -t 1 , Output: ctest-pod-34548208 Connecting to 10.98.197.165:80 (10.98.197.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-08 02:22:52,747 - DEBUG - [Pod Pod ctest-pod-75700923] Cmd wget http://10.98.197.165:80/ -O - -T 5 -t 1 passed 2025-05-08 02:22:52,747 - DEBUG - [Pod Pod ctest-pod-75700923] Cmd output: ctest-pod-34548208 Connecting to 10.98.197.165:80 (10.98.197.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-08 02:22:52,747 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-34548208': 1, 'ctest-pod-87100117': 2} 2025-05-08 02:22:52,750 - DEBUG - Network policy ingress-on-service not present 2025-05-08 02:22:52,750 - INFO - Creating Network Policy ingress-on-service 2025-05-08 02:22:52,764 - INFO - Network policy found in k8s 2025-05-08 02:22:52,764 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=471978a9-2103-4649-bda0-3e1df10dc216 2025-05-08 02:22:52,771 - INFO - Network Policy ingress-on-service with uuid 471978a9-2103-4649-bda0-3e1df10dc216 found in kube manager 2025-05-08 02:22:52,810 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-05-08 02:22:52,811 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-05-08 02:22:52,811 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=471978a9-2103-4649-bda0-3e1df10dc216 2025-05-08 02:22:52,837 - WARNING - Network policy with name ingress-on-service not found in agent 2025-05-08 02:22:54,838 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=471978a9-2103-4649-bda0-3e1df10dc216 2025-05-08 02:22:54,868 - INFO - Network policy with name ingress-on-service found in agent 2025-05-08 02:22:54,869 - INFO - Network Policy ingress-on-service verification passed 2025-05-08 02:22:59,914 - DEBUG - [Pod ctest-pod-12027178] Cmd: wget http://10.98.197.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:22:59,914 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd wget http://10.98.197.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:22:59,914 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:23:04,965 - DEBUG - [Pod ctest-pod-12027178] Cmd: wget http://10.98.197.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:23:04,966 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd wget http://10.98.197.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:23:04,966 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:23:10,019 - DEBUG - [Pod ctest-pod-12027178] Cmd: wget http://10.98.197.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:23:10,019 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd wget http://10.98.197.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:23:10,019 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:23:15,084 - DEBUG - [Pod ctest-pod-12027178] Cmd: wget http://10.98.197.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:23:15,084 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd wget http://10.98.197.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:23:15,084 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:23:20,141 - DEBUG - [Pod ctest-pod-12027178] Cmd: wget http://10.98.197.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:23:20,142 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd wget http://10.98.197.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:23:20,142 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:23:25,198 - DEBUG - [Pod ctest-pod-12027178] Cmd: wget http://10.98.197.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:23:25,198 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd wget http://10.98.197.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:23:25,198 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:23:30,254 - DEBUG - [Pod ctest-pod-12027178] Cmd: wget http://10.98.197.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:23:30,254 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd wget http://10.98.197.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:23:30,254 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:23:35,302 - DEBUG - [Pod ctest-pod-12027178] Cmd: wget http://10.98.197.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:23:35,302 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd wget http://10.98.197.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:23:35,302 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:23:40,367 - DEBUG - [Pod ctest-pod-12027178] Cmd: wget http://10.98.197.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:23:40,367 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd wget http://10.98.197.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:23:40,367 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:23:45,429 - DEBUG - [Pod ctest-pod-12027178] Cmd: wget http://10.98.197.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:23:45,430 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd wget http://10.98.197.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:23:45,430 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:23:45,430 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-34548208': 0, 'ctest-pod-87100117': 0} 2025-05-08 02:23:45,492 - DEBUG - [Pod ctest-pod-70699322] Cmd: wget http://10.98.197.165:80/ -O - -T 5 -t 1 , Output: ctest-pod-87100117 Connecting to 10.98.197.165:80 (10.98.197.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-08 02:23:45,492 - DEBUG - [Pod Pod ctest-pod-70699322] Cmd wget http://10.98.197.165:80/ -O - -T 5 -t 1 passed 2025-05-08 02:23:45,492 - DEBUG - [Pod Pod ctest-pod-70699322] Cmd output: ctest-pod-87100117 Connecting to 10.98.197.165:80 (10.98.197.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-08 02:23:45,560 - DEBUG - [Pod ctest-pod-70699322] Cmd: wget http://10.98.197.165:80/ -O - -T 5 -t 1 , Output: ctest-pod-34548208 Connecting to 10.98.197.165:80 (10.98.197.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-08 02:23:45,560 - DEBUG - [Pod Pod ctest-pod-70699322] Cmd wget http://10.98.197.165:80/ -O - -T 5 -t 1 passed 2025-05-08 02:23:45,560 - DEBUG - [Pod Pod ctest-pod-70699322] Cmd output: ctest-pod-34548208 Connecting to 10.98.197.165:80 (10.98.197.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-08 02:23:45,560 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-34548208': 1, 'ctest-pod-87100117': 1} 2025-05-08 02:23:50,614 - DEBUG - [Pod ctest-pod-75700923] Cmd: wget http://10.98.197.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:23:50,614 - DEBUG - [Pod Pod ctest-pod-75700923] Cmd wget http://10.98.197.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:23:50,614 - DEBUG - [Pod Pod ctest-pod-75700923] Cmd output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:23:55,667 - DEBUG - [Pod ctest-pod-75700923] Cmd: wget http://10.98.197.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:23:55,667 - DEBUG - [Pod Pod ctest-pod-75700923] Cmd wget http://10.98.197.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:23:55,667 - DEBUG - [Pod Pod ctest-pod-75700923] Cmd output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:24:00,734 - DEBUG - [Pod ctest-pod-75700923] Cmd: wget http://10.98.197.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:24:00,734 - DEBUG - [Pod Pod ctest-pod-75700923] Cmd wget http://10.98.197.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:24:00,734 - DEBUG - [Pod Pod ctest-pod-75700923] Cmd output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:24:05,786 - DEBUG - [Pod ctest-pod-75700923] Cmd: wget http://10.98.197.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:24:05,786 - DEBUG - [Pod Pod ctest-pod-75700923] Cmd wget http://10.98.197.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:24:05,786 - DEBUG - [Pod Pod ctest-pod-75700923] Cmd output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:24:10,837 - DEBUG - [Pod ctest-pod-75700923] Cmd: wget http://10.98.197.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:24:10,837 - DEBUG - [Pod Pod ctest-pod-75700923] Cmd wget http://10.98.197.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:24:10,838 - DEBUG - [Pod Pod ctest-pod-75700923] Cmd output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:24:15,894 - DEBUG - [Pod ctest-pod-75700923] Cmd: wget http://10.98.197.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:24:15,894 - DEBUG - [Pod Pod ctest-pod-75700923] Cmd wget http://10.98.197.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:24:15,894 - DEBUG - [Pod Pod ctest-pod-75700923] Cmd output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:24:20,946 - DEBUG - [Pod ctest-pod-75700923] Cmd: wget http://10.98.197.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:24:20,946 - DEBUG - [Pod Pod ctest-pod-75700923] Cmd wget http://10.98.197.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:24:20,946 - DEBUG - [Pod Pod ctest-pod-75700923] Cmd output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:24:26,002 - DEBUG - [Pod ctest-pod-75700923] Cmd: wget http://10.98.197.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:24:26,002 - DEBUG - [Pod Pod ctest-pod-75700923] Cmd wget http://10.98.197.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:24:26,002 - DEBUG - [Pod Pod ctest-pod-75700923] Cmd output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:24:31,062 - DEBUG - [Pod ctest-pod-75700923] Cmd: wget http://10.98.197.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:24:31,063 - DEBUG - [Pod Pod ctest-pod-75700923] Cmd wget http://10.98.197.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:24:31,063 - DEBUG - [Pod Pod ctest-pod-75700923] Cmd output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:24:36,119 - DEBUG - [Pod ctest-pod-75700923] Cmd: wget http://10.98.197.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:24:36,119 - DEBUG - [Pod Pod ctest-pod-75700923] Cmd wget http://10.98.197.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:24:36,119 - DEBUG - [Pod Pod ctest-pod-75700923] Cmd output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:24:36,119 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-34548208': 0, 'ctest-pod-87100117': 0} 2025-05-08 02:24:38,173 - DEBUG - [Pod ctest-pod-70699322] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.293 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.076 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.089 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.076/0.486/1.293 ms 2025-05-08 02:24:38,174 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-70699322 with expectation True passed 2025-05-08 02:24:40,227 - DEBUG - [Pod ctest-pod-12027178] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.500 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.102 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.086 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.086/0.229/0.500 ms 2025-05-08 02:24:40,227 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-12027178 with expectation True passed 2025-05-08 02:24:42,281 - DEBUG - [Pod ctest-pod-75700923] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.789 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.079 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.080 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.079/0.649/1.789 ms 2025-05-08 02:24:42,281 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-75700923 with expectation True passed 2025-05-08 02:24:42,336 - DEBUG - [Pod ctest-pod-70699322] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-08 02:24:42,336 - DEBUG - [Pod Pod ctest-pod-70699322] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-05-08 02:24:42,336 - DEBUG - [Pod Pod ctest-pod-70699322] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-08 02:24:42,336 - INFO - wget check of of http://10.47.255.251 from ctest-pod-70699322 passed 2025-05-08 02:24:42,395 - DEBUG - [Pod ctest-pod-70699322] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-08 02:24:42,395 - DEBUG - [Pod Pod ctest-pod-70699322] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-05-08 02:24:42,395 - DEBUG - [Pod Pod ctest-pod-70699322] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-08 02:24:42,395 - INFO - wget check of of http://10.47.255.250 from ctest-pod-70699322 passed 2025-05-08 02:24:47,451 - DEBUG - [Pod ctest-pod-12027178] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-05-08 02:24:47,451 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-05-08 02:24:47,451 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-05-08 02:24:47,451 - INFO - wget check of of http://10.47.255.250 from ctest-pod-12027178 passed 2025-05-08 02:24:52,507 - DEBUG - [Pod ctest-pod-98167490] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-05-08 02:24:52,507 - DEBUG - [Pod Pod ctest-pod-98167490] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-05-08 02:24:52,507 - DEBUG - [Pod Pod ctest-pod-98167490] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-05-08 02:24:52,507 - INFO - wget check of of http://10.47.255.251 from ctest-pod-98167490 passed 2025-05-08 02:24:52,516 - INFO - Updating Network Policy ingress-on-service 2025-05-08 02:24:57,570 - DEBUG - [Pod ctest-pod-12027178] Cmd: wget http://10.98.197.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:24:57,570 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd wget http://10.98.197.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:24:57,570 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:25:02,618 - DEBUG - [Pod ctest-pod-12027178] Cmd: wget http://10.98.197.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:25:02,618 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd wget http://10.98.197.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:25:02,618 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:25:07,675 - DEBUG - [Pod ctest-pod-12027178] Cmd: wget http://10.98.197.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:25:07,675 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd wget http://10.98.197.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:25:07,675 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:25:12,725 - DEBUG - [Pod ctest-pod-12027178] Cmd: wget http://10.98.197.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:25:12,725 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd wget http://10.98.197.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:25:12,725 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:25:17,781 - DEBUG - [Pod ctest-pod-12027178] Cmd: wget http://10.98.197.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:25:17,781 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd wget http://10.98.197.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:25:17,781 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:25:22,838 - DEBUG - [Pod ctest-pod-12027178] Cmd: wget http://10.98.197.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:25:22,838 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd wget http://10.98.197.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:25:22,838 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:25:27,892 - DEBUG - [Pod ctest-pod-12027178] Cmd: wget http://10.98.197.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:25:27,892 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd wget http://10.98.197.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:25:27,892 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:25:32,954 - DEBUG - [Pod ctest-pod-12027178] Cmd: wget http://10.98.197.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:25:32,954 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd wget http://10.98.197.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:25:32,954 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:25:38,011 - DEBUG - [Pod ctest-pod-12027178] Cmd: wget http://10.98.197.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:25:38,011 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd wget http://10.98.197.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:25:38,011 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:25:43,079 - DEBUG - [Pod ctest-pod-12027178] Cmd: wget http://10.98.197.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:25:43,079 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd wget http://10.98.197.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:25:43,079 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd output: Connecting to 10.98.197.165:80 (10.98.197.165:80) wget: download timed out 2025-05-08 02:25:43,079 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-34548208': 0, 'ctest-pod-87100117': 0} 2025-05-08 02:25:43,131 - DEBUG - [Pod ctest-pod-70699322] Cmd: wget http://10.98.197.165:80/ -O - -T 5 -t 1 , Output: ctest-pod-87100117 Connecting to 10.98.197.165:80 (10.98.197.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-08 02:25:43,131 - DEBUG - [Pod Pod ctest-pod-70699322] Cmd wget http://10.98.197.165:80/ -O - -T 5 -t 1 passed 2025-05-08 02:25:43,131 - DEBUG - [Pod Pod ctest-pod-70699322] Cmd output: ctest-pod-87100117 Connecting to 10.98.197.165:80 (10.98.197.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-08 02:25:43,184 - DEBUG - [Pod ctest-pod-70699322] Cmd: wget http://10.98.197.165:80/ -O - -T 5 -t 1 , Output: ctest-pod-34548208 Connecting to 10.98.197.165:80 (10.98.197.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-08 02:25:43,184 - DEBUG - [Pod Pod ctest-pod-70699322] Cmd wget http://10.98.197.165:80/ -O - -T 5 -t 1 passed 2025-05-08 02:25:43,184 - DEBUG - [Pod Pod ctest-pod-70699322] Cmd output: ctest-pod-34548208 Connecting to 10.98.197.165:80 (10.98.197.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-08 02:25:43,184 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-34548208': 1, 'ctest-pod-87100117': 1} 2025-05-08 02:25:43,231 - DEBUG - [Pod ctest-pod-75700923] Cmd: wget http://10.98.197.165:80/ -O - -T 5 -t 1 , Output: ctest-pod-34548208 Connecting to 10.98.197.165:80 (10.98.197.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-08 02:25:43,232 - DEBUG - [Pod Pod ctest-pod-75700923] Cmd wget http://10.98.197.165:80/ -O - -T 5 -t 1 passed 2025-05-08 02:25:43,232 - DEBUG - [Pod Pod ctest-pod-75700923] Cmd output: ctest-pod-34548208 Connecting to 10.98.197.165:80 (10.98.197.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-08 02:25:43,285 - DEBUG - [Pod ctest-pod-75700923] Cmd: wget http://10.98.197.165:80/ -O - -T 5 -t 1 , Output: ctest-pod-34548208 Connecting to 10.98.197.165:80 (10.98.197.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-08 02:25:43,285 - DEBUG - [Pod Pod ctest-pod-75700923] Cmd wget http://10.98.197.165:80/ -O - -T 5 -t 1 passed 2025-05-08 02:25:43,285 - DEBUG - [Pod Pod ctest-pod-75700923] Cmd output: ctest-pod-34548208 Connecting to 10.98.197.165:80 (10.98.197.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-08 02:25:43,336 - DEBUG - [Pod ctest-pod-75700923] Cmd: wget http://10.98.197.165:80/ -O - -T 5 -t 1 , Output: ctest-pod-87100117 Connecting to 10.98.197.165:80 (10.98.197.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-08 02:25:43,336 - DEBUG - [Pod Pod ctest-pod-75700923] Cmd wget http://10.98.197.165:80/ -O - -T 5 -t 1 passed 2025-05-08 02:25:43,336 - DEBUG - [Pod Pod ctest-pod-75700923] Cmd output: ctest-pod-87100117 Connecting to 10.98.197.165:80 (10.98.197.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-08 02:25:43,336 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-34548208': 2, 'ctest-pod-87100117': 1} 2025-05-08 02:25:45,386 - DEBUG - [Pod ctest-pod-70699322] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.689 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.084 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.091 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.084/0.288/0.689 ms 2025-05-08 02:25:45,386 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-70699322 with expectation True passed 2025-05-08 02:25:47,437 - DEBUG - [Pod ctest-pod-12027178] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.672 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.087 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.089 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.087/0.282/0.672 ms 2025-05-08 02:25:47,437 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-12027178 with expectation True passed 2025-05-08 02:25:49,486 - DEBUG - [Pod ctest-pod-75700923] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.657 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.089 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.069 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.069/0.271/0.657 ms 2025-05-08 02:25:49,486 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-75700923 with expectation True passed 2025-05-08 02:25:49,535 - DEBUG - [Pod ctest-pod-70699322] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-08 02:25:49,535 - DEBUG - [Pod Pod ctest-pod-70699322] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-05-08 02:25:49,535 - DEBUG - [Pod Pod ctest-pod-70699322] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-08 02:25:49,535 - INFO - wget check of of http://10.47.255.251 from ctest-pod-70699322 passed 2025-05-08 02:25:49,592 - DEBUG - [Pod ctest-pod-70699322] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-08 02:25:49,592 - DEBUG - [Pod Pod ctest-pod-70699322] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-05-08 02:25:49,592 - DEBUG - [Pod Pod ctest-pod-70699322] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-08 02:25:49,592 - INFO - wget check of of http://10.47.255.250 from ctest-pod-70699322 passed 2025-05-08 02:25:54,648 - DEBUG - [Pod ctest-pod-12027178] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-05-08 02:25:54,648 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-05-08 02:25:54,648 - DEBUG - [Pod Pod ctest-pod-12027178] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-05-08 02:25:54,648 - INFO - wget check of of http://10.47.255.250 from ctest-pod-12027178 passed 2025-05-08 02:25:54,701 - DEBUG - [Pod ctest-pod-98167490] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-08 02:25:54,701 - DEBUG - [Pod Pod ctest-pod-98167490] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-05-08 02:25:54,701 - DEBUG - [Pod Pod ctest-pod-98167490] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-08 02:25:54,701 - INFO - wget check of of http://10.47.255.251 from ctest-pod-98167490 passed 2025-05-08 02:25:54,701 - INFO - Deleting Network Policy : ingress-on-service 2025-05-08 02:25:54,702 - INFO - Deleting service : ctest-nginx-svc-55178599 2025-05-08 02:25:54,929 - DEBUG - No XMPP flaps were noticed during the test 2025-05-08 02:25:54,929 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:05] 2025-05-08 02:25:54,929 - INFO - -------------------------------------------------------------------------------- 2025-05-08 02:25:54,934 - INFO - Deleting pod ctest-new-default-73673113:ctest-pod-34548208 2025-05-08 02:25:54,934 - INFO - Deleting pod ctest-new-default-73673113:ctest-pod-87100117 2025-05-08 02:25:54,935 - INFO - Deleting pod ctest-non-default-69567989:ctest-pod-87259560 2025-05-08 02:25:54,935 - INFO - Deleting pod ctest-non-default-69567989:ctest-pod-33999133 2025-05-08 02:25:54,935 - INFO - Deleting pod ctest-new-default-73673113:ctest-pod-12027178 2025-05-08 02:25:54,935 - INFO - Deleting pod ctest-new-default-73673113:ctest-pod-70699322 2025-05-08 02:25:54,936 - INFO - Deleting pod ctest-non-default-69567989:ctest-pod-75700923 2025-05-08 02:25:54,936 - INFO - Deleting pod ctest-non-default-69567989:ctest-pod-98167490 2025-05-08 02:25:55,036 - WARNING - Pod uuid 19236f62-eac4-4a98-bea9-4c718a8e67f9 is still seen in agent 10.0.0.22 VM list 2025-05-08 02:25:55,073 - WARNING - Pod uuid b9ff902b-daba-40c2-beb6-00480c28aacd is still seen in agent 10.0.0.22 VM list 2025-05-08 02:25:55,075 - WARNING - Pod uuid a3109cd4-1f6e-4465-b370-7f2986cace56 is still seen in agent 10.0.0.22 VM list 2025-05-08 02:25:55,075 - WARNING - Pod uuid 5934c00b-e1b6-481e-9c2a-de42bbd00f42 is still seen in agent 10.0.0.22 VM list 2025-05-08 02:25:55,075 - WARNING - Pod uuid 7b69a9dc-58ec-477f-bd27-fc4958732827 is still seen in agent 10.0.0.22 VM list 2025-05-08 02:25:55,075 - WARNING - Pod uuid 2b6da040-a39e-4e34-ab2a-3bb7452f7d7f is still seen in agent 10.0.0.22 VM list 2025-05-08 02:25:55,076 - WARNING - Pod uuid 4a2e3199-1bab-4fc1-a4c6-a18469e4e844 is still seen in agent 10.0.0.22 VM list 2025-05-08 02:25:55,076 - WARNING - Pod uuid 1196e024-e420-4dce-b79b-818614627c7e is still seen in agent 10.0.0.22 VM list 2025-05-08 02:26:00,044 - DEBUG - Pod 19236f62-eac4-4a98-bea9-4c718a8e67f9 is not in agent 10.0.0.22 VM list 2025-05-08 02:26:00,051 - DEBUG - VMI 4ada938a-2bb3-11f0-a728-fa163eed29cb is removed from agent 10.0.0.22 2025-05-08 02:26:00,051 - INFO - Verified that pod ctest-pod-34548208 is removed in agent 2025-05-08 02:26:00,103 - WARNING - Pod uuid 7b69a9dc-58ec-477f-bd27-fc4958732827 is still seen in agent 10.0.0.22 VM list 2025-05-08 02:26:00,103 - DEBUG - Pod 2b6da040-a39e-4e34-ab2a-3bb7452f7d7f is not in agent 10.0.0.22 VM list 2025-05-08 02:26:00,104 - DEBUG - Pod b9ff902b-daba-40c2-beb6-00480c28aacd is not in agent 10.0.0.22 VM list 2025-05-08 02:26:00,106 - WARNING - Pod uuid 5934c00b-e1b6-481e-9c2a-de42bbd00f42 is still seen in agent 10.0.0.22 VM list 2025-05-08 02:26:00,108 - WARNING - Pod uuid 1196e024-e420-4dce-b79b-818614627c7e is still seen in agent 10.0.0.22 VM list 2025-05-08 02:26:00,108 - DEBUG - Pod a3109cd4-1f6e-4465-b370-7f2986cace56 is not in agent 10.0.0.22 VM list 2025-05-08 02:26:00,109 - WARNING - Pod uuid 4a2e3199-1bab-4fc1-a4c6-a18469e4e844 is still seen in agent 10.0.0.22 VM list 2025-05-08 02:26:00,120 - DEBUG - VMI 4b6f88c8-2bb3-11f0-a728-fa163eed29cb is removed from agent 10.0.0.22 2025-05-08 02:26:00,120 - INFO - Verified that pod ctest-pod-87100117 is removed in agent 2025-05-08 02:26:00,122 - DEBUG - VMI 4c26efc2-2bb3-11f0-a728-fa163eed29cb is removed from agent 10.0.0.22 2025-05-08 02:26:00,122 - INFO - Verified that pod ctest-pod-87259560 is removed in agent 2025-05-08 02:26:00,122 - DEBUG - VMI 4cbe85a8-2bb3-11f0-a728-fa163eed29cb is removed from agent 10.0.0.22 2025-05-08 02:26:00,122 - INFO - Verified that pod ctest-pod-33999133 is removed in agent 2025-05-08 02:26:05,112 - WARNING - Pod uuid 7b69a9dc-58ec-477f-bd27-fc4958732827 is still seen in agent 10.0.0.22 VM list 2025-05-08 02:26:05,121 - WARNING - Pod uuid 5934c00b-e1b6-481e-9c2a-de42bbd00f42 is still seen in agent 10.0.0.22 VM list 2025-05-08 02:26:05,122 - WARNING - Pod uuid 1196e024-e420-4dce-b79b-818614627c7e is still seen in agent 10.0.0.22 VM list 2025-05-08 02:26:05,123 - WARNING - Pod uuid 4a2e3199-1bab-4fc1-a4c6-a18469e4e844 is still seen in agent 10.0.0.22 VM list 2025-05-08 02:26:10,121 - WARNING - Pod uuid 7b69a9dc-58ec-477f-bd27-fc4958732827 is still seen in agent 10.0.0.22 VM list 2025-05-08 02:26:10,137 - WARNING - Pod uuid 5934c00b-e1b6-481e-9c2a-de42bbd00f42 is still seen in agent 10.0.0.22 VM list 2025-05-08 02:26:10,138 - WARNING - Pod uuid 1196e024-e420-4dce-b79b-818614627c7e is still seen in agent 10.0.0.22 VM list 2025-05-08 02:26:10,138 - WARNING - Pod uuid 4a2e3199-1bab-4fc1-a4c6-a18469e4e844 is still seen in agent 10.0.0.22 VM list 2025-05-08 02:26:15,130 - WARNING - Pod uuid 7b69a9dc-58ec-477f-bd27-fc4958732827 is still seen in agent 10.0.0.22 VM list 2025-05-08 02:26:15,151 - WARNING - Pod uuid 5934c00b-e1b6-481e-9c2a-de42bbd00f42 is still seen in agent 10.0.0.22 VM list 2025-05-08 02:26:15,152 - WARNING - Pod uuid 1196e024-e420-4dce-b79b-818614627c7e is still seen in agent 10.0.0.22 VM list 2025-05-08 02:26:15,153 - WARNING - Pod uuid 4a2e3199-1bab-4fc1-a4c6-a18469e4e844 is still seen in agent 10.0.0.22 VM list 2025-05-08 02:26:20,140 - WARNING - Pod uuid 7b69a9dc-58ec-477f-bd27-fc4958732827 is still seen in agent 10.0.0.22 VM list 2025-05-08 02:26:20,165 - WARNING - Pod uuid 5934c00b-e1b6-481e-9c2a-de42bbd00f42 is still seen in agent 10.0.0.22 VM list 2025-05-08 02:26:20,170 - WARNING - Pod uuid 1196e024-e420-4dce-b79b-818614627c7e is still seen in agent 10.0.0.22 VM list 2025-05-08 02:26:20,171 - WARNING - Pod uuid 4a2e3199-1bab-4fc1-a4c6-a18469e4e844 is still seen in agent 10.0.0.22 VM list 2025-05-08 02:26:25,165 - WARNING - Pod uuid 7b69a9dc-58ec-477f-bd27-fc4958732827 is still seen in agent 10.0.0.22 VM list 2025-05-08 02:26:25,174 - WARNING - Pod uuid 5934c00b-e1b6-481e-9c2a-de42bbd00f42 is still seen in agent 10.0.0.22 VM list 2025-05-08 02:26:25,185 - WARNING - Pod uuid 1196e024-e420-4dce-b79b-818614627c7e is still seen in agent 10.0.0.22 VM list 2025-05-08 02:26:25,189 - WARNING - Pod uuid 4a2e3199-1bab-4fc1-a4c6-a18469e4e844 is still seen in agent 10.0.0.22 VM list 2025-05-08 02:26:30,172 - DEBUG - Pod 7b69a9dc-58ec-477f-bd27-fc4958732827 is not in agent 10.0.0.22 VM list 2025-05-08 02:26:30,180 - DEBUG - VMI 4dfce720-2bb3-11f0-a728-fa163eed29cb is removed from agent 10.0.0.22 2025-05-08 02:26:30,180 - INFO - Verified that pod ctest-pod-70699322 is removed in agent 2025-05-08 02:26:30,181 - DEBUG - Pod 5934c00b-e1b6-481e-9c2a-de42bbd00f42 is not in agent 10.0.0.22 VM list 2025-05-08 02:26:30,186 - DEBUG - VMI 4f11612c-2bb3-11f0-a728-fa163eed29cb is removed from agent 10.0.0.22 2025-05-08 02:26:30,186 - INFO - Verified that pod ctest-pod-98167490 is removed in agent 2025-05-08 02:26:30,192 - DEBUG - Pod 1196e024-e420-4dce-b79b-818614627c7e is not in agent 10.0.0.22 VM list 2025-05-08 02:26:30,198 - DEBUG - Pod 4a2e3199-1bab-4fc1-a4c6-a18469e4e844 is not in agent 10.0.0.22 VM list 2025-05-08 02:26:30,199 - DEBUG - VMI 4e960b08-2bb3-11f0-a728-fa163eed29cb is removed from agent 10.0.0.22 2025-05-08 02:26:30,200 - INFO - Verified that pod ctest-pod-75700923 is removed in agent 2025-05-08 02:26:30,204 - DEBUG - VMI 4d6fd8e4-2bb3-11f0-a728-fa163eed29cb is removed from agent 10.0.0.22 2025-05-08 02:26:30,204 - INFO - Verified that pod ctest-pod-12027178 is removed in agent 2025-05-08 02:26:30,204 - INFO - Deleting namespace ctest-non-default-69567989 2025-05-08 02:26:30,224 - DEBUG - Namespace ctest-non-default-69567989 still in k8s 2025-05-08 02:26:32,229 - DEBUG - Namespace ctest-non-default-69567989 still in k8s 2025-05-08 02:26:34,234 - DEBUG - Namespace ctest-non-default-69567989 still in k8s 2025-05-08 02:26:36,238 - DEBUG - Namespace ctest-non-default-69567989 is not in k8s 2025-05-08 02:26:36,238 - DEBUG - No need to check project deletion in contrail-api 2025-05-08 02:26:36,238 - INFO - Deleting namespace ctest-new-default-73673113 2025-05-08 02:26:36,253 - DEBUG - Namespace ctest-new-default-73673113 still in k8s 2025-05-08 02:26:38,258 - DEBUG - Namespace ctest-new-default-73673113 still in k8s 2025-05-08 02:26:40,263 - DEBUG - Namespace ctest-new-default-73673113 still in k8s 2025-05-08 02:26:42,268 - DEBUG - Namespace ctest-new-default-73673113 is not in k8s 2025-05-08 02:26:42,268 - DEBUG - No need to check project deletion in contrail-api