2025-03-24 10:59:16,451 - INFO - Using existing project ['default-domain', 'k8s-default'](05c119d3-7a66-4f87-aa90-9abaf405170c) 2025-03-24 10:59:16,470 - DEBUG - Namespace ctest-new-default-36913717 not present 2025-03-24 10:59:16,481 - INFO - Created namespace ctest-new-default-36913717 2025-03-24 10:59:19,485 - DEBUG - Namespace ctest-non-default-64868896 not present 2025-03-24 10:59:19,492 - INFO - Created namespace ctest-non-default-64868896 2025-03-24 10:59:22,514 - DEBUG - Pod ctest-pod-34036116 not present 2025-03-24 10:59:22,515 - INFO - Creating Pod ctest-pod-34036116 2025-03-24 10:59:22,547 - DEBUG - Pod : ctest-pod-34036116 UUID is a8014643-f5de-4798-a056-ff325eaec340 2025-03-24 10:59:22,550 - DEBUG - Pod ctest-pod-60525682 not present 2025-03-24 10:59:22,550 - INFO - Creating Pod ctest-pod-60525682 2025-03-24 10:59:22,596 - DEBUG - Pod : ctest-pod-60525682 UUID is 2bf0a78a-d621-46eb-ab9b-070e97123141 2025-03-24 10:59:22,598 - DEBUG - Pod ctest-pod-16726607 not present 2025-03-24 10:59:22,599 - INFO - Creating Pod ctest-pod-16726607 2025-03-24 10:59:22,621 - DEBUG - Pod : ctest-pod-16726607 UUID is a98642f9-9299-4f85-bbec-d3624c5ad513 2025-03-24 10:59:22,624 - DEBUG - Pod ctest-pod-91034240 not present 2025-03-24 10:59:22,624 - INFO - Creating Pod ctest-pod-91034240 2025-03-24 10:59:22,672 - DEBUG - Pod : ctest-pod-91034240 UUID is f678b668-9a68-48a6-93cb-314a6bdbf85f 2025-03-24 10:59:22,675 - DEBUG - Pod ctest-pod-10237176 not present 2025-03-24 10:59:22,675 - INFO - Creating Pod ctest-pod-10237176 2025-03-24 10:59:22,700 - DEBUG - Pod : ctest-pod-10237176 UUID is f9c0df8a-0f31-4d58-b154-b946b8a92288 2025-03-24 10:59:22,703 - DEBUG - Pod ctest-pod-06507051 not present 2025-03-24 10:59:22,703 - INFO - Creating Pod ctest-pod-06507051 2025-03-24 10:59:22,728 - DEBUG - Pod : ctest-pod-06507051 UUID is e39c9c3a-2fc2-4f61-848d-6128bc6f27cf 2025-03-24 10:59:22,731 - DEBUG - Pod ctest-pod-31430092 not present 2025-03-24 10:59:22,731 - INFO - Creating Pod ctest-pod-31430092 2025-03-24 10:59:22,752 - DEBUG - Pod : ctest-pod-31430092 UUID is d052c2cf-1811-46c1-9012-ac5483e8a608 2025-03-24 10:59:22,754 - DEBUG - Pod ctest-pod-57323917 not present 2025-03-24 10:59:22,755 - INFO - Creating Pod ctest-pod-57323917 2025-03-24 10:59:22,776 - DEBUG - Pod : ctest-pod-57323917 UUID is 0947a92c-0a5b-4fa8-b212-c3501df12616 2025-03-24 10:59:22,954 - INFO - Project default-domain:k8s-ctest-new-default-36913717 for Namespace ctest-new-default-36913717 is seen in contrail-api 2025-03-24 10:59:22,954 - DEBUG - Project uuid in Contrail is 8e0d76d3-6a67-481e-a23f-6539f9d074d7 2025-03-24 10:59:23,166 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_NamespaceDatabaseList?namespace_uuid=a4440c50-11cf-4fbb-aba1-a048ce0c5012 2025-03-24 10:59:23,171 - INFO - Namespace ctest-new-default-36913717 with uuid a4440c50-11cf-4fbb-aba1-a048ce0c5012 found in kube manager 2025-03-24 10:59:23,171 - INFO - Namespace ctest-new-default-36913717 verification passed 2025-03-24 10:59:23,384 - INFO - Project default-domain:k8s-ctest-non-default-64868896 for Namespace ctest-non-default-64868896 is seen in contrail-api 2025-03-24 10:59:23,384 - DEBUG - Project uuid in Contrail is df4d99aa-248d-4c02-ba7d-290f0ac830c4 2025-03-24 10:59:23,384 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_NamespaceDatabaseList?namespace_uuid=081c5478-0b40-47fc-8764-c92f3ef7fe32 2025-03-24 10:59:23,390 - INFO - Namespace ctest-non-default-64868896 with uuid 081c5478-0b40-47fc-8764-c92f3ef7fe32 found in kube manager 2025-03-24 10:59:23,390 - INFO - Namespace ctest-non-default-64868896 verification passed 2025-03-24 10:59:23,395 - DEBUG - Pod ctest-pod-34036116 not in running state.Currently in Pending 2025-03-24 10:59:28,403 - DEBUG - Pod ctest-pod-34036116 not in running state.Currently in Pending 2025-03-24 10:59:33,409 - INFO - Pod ctest-pod-34036116 is in running state.Got IP 10.47.255.251 2025-03-24 10:59:33,425 - DEBUG - Pod ctest-pod-34036116 has vmi 0c231b8a-089f-11f0-8e15-fa163ea689a5 2025-03-24 10:59:33,425 - INFO - Verified pod ctest-pod-34036116 in contrail-api 2025-03-24 10:59:33,440 - DEBUG - VMI 0c231b8a-089f-11f0-8e15-fa163ea689a5 is active in agent 10.0.0.29 2025-03-24 10:59:33,440 - INFO - Verified Pod ctest-pod-34036116 in agent 10.0.0.29 2025-03-24 10:59:33,440 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=a8014643-f5de-4798-a056-ff325eaec340 2025-03-24 10:59:33,453 - INFO - Pod ctest-pod-34036116 with uuid a8014643-f5de-4798-a056-ff325eaec340 found in kube manager 2025-03-24 10:59:33,453 - INFO - Pod ctest-pod-34036116 verification passed 2025-03-24 10:59:33,458 - DEBUG - Pod ctest-pod-60525682 not in running state.Currently in Pending 2025-03-24 10:59:38,465 - INFO - Pod ctest-pod-60525682 is in running state.Got IP 10.47.255.250 2025-03-24 10:59:38,482 - DEBUG - Pod ctest-pod-60525682 has vmi 0cb0a6da-089f-11f0-8e15-fa163ea689a5 2025-03-24 10:59:38,482 - INFO - Verified pod ctest-pod-60525682 in contrail-api 2025-03-24 10:59:38,502 - DEBUG - VMI 0cb0a6da-089f-11f0-8e15-fa163ea689a5 is active in agent 10.0.0.29 2025-03-24 10:59:38,502 - INFO - Verified Pod ctest-pod-60525682 in agent 10.0.0.29 2025-03-24 10:59:38,503 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=2bf0a78a-d621-46eb-ab9b-070e97123141 2025-03-24 10:59:38,508 - INFO - Pod ctest-pod-60525682 with uuid 2bf0a78a-d621-46eb-ab9b-070e97123141 found in kube manager 2025-03-24 10:59:38,509 - INFO - Pod ctest-pod-60525682 verification passed 2025-03-24 10:59:38,516 - INFO - Pod ctest-pod-16726607 is in running state.Got IP 10.47.255.249 2025-03-24 10:59:38,574 - DEBUG - Pod ctest-pod-16726607 has vmi 0d59d4ee-089f-11f0-8e15-fa163ea689a5 2025-03-24 10:59:38,574 - INFO - Verified pod ctest-pod-16726607 in contrail-api 2025-03-24 10:59:38,590 - DEBUG - VMI 0d59d4ee-089f-11f0-8e15-fa163ea689a5 is active in agent 10.0.0.29 2025-03-24 10:59:38,590 - INFO - Verified Pod ctest-pod-16726607 in agent 10.0.0.29 2025-03-24 10:59:38,590 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=a98642f9-9299-4f85-bbec-d3624c5ad513 2025-03-24 10:59:38,597 - INFO - Pod ctest-pod-16726607 with uuid a98642f9-9299-4f85-bbec-d3624c5ad513 found in kube manager 2025-03-24 10:59:38,597 - INFO - Pod ctest-pod-16726607 verification passed 2025-03-24 10:59:38,606 - INFO - Pod ctest-pod-91034240 is in running state.Got IP 10.47.255.248 2025-03-24 10:59:38,668 - DEBUG - Pod ctest-pod-91034240 has vmi 0de10b9e-089f-11f0-8e15-fa163ea689a5 2025-03-24 10:59:38,668 - INFO - Verified pod ctest-pod-91034240 in contrail-api 2025-03-24 10:59:38,695 - DEBUG - VMI 0de10b9e-089f-11f0-8e15-fa163ea689a5 is active in agent 10.0.0.29 2025-03-24 10:59:38,696 - INFO - Verified Pod ctest-pod-91034240 in agent 10.0.0.29 2025-03-24 10:59:38,696 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=f678b668-9a68-48a6-93cb-314a6bdbf85f 2025-03-24 10:59:38,701 - INFO - Pod ctest-pod-91034240 with uuid f678b668-9a68-48a6-93cb-314a6bdbf85f found in kube manager 2025-03-24 10:59:38,701 - INFO - Pod ctest-pod-91034240 verification passed 2025-03-24 10:59:38,708 - DEBUG - Pod ctest-pod-10237176 not in running state.Currently in Pending 2025-03-24 10:59:43,715 - INFO - Pod ctest-pod-10237176 is in running state.Got IP 10.47.255.247 2025-03-24 10:59:43,735 - DEBUG - Pod ctest-pod-10237176 has vmi 0e752acc-089f-11f0-8e15-fa163ea689a5 2025-03-24 10:59:43,735 - INFO - Verified pod ctest-pod-10237176 in contrail-api 2025-03-24 10:59:43,754 - DEBUG - VMI 0e752acc-089f-11f0-8e15-fa163ea689a5 is active in agent 10.0.0.29 2025-03-24 10:59:43,755 - INFO - Verified Pod ctest-pod-10237176 in agent 10.0.0.29 2025-03-24 10:59:43,755 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=f9c0df8a-0f31-4d58-b154-b946b8a92288 2025-03-24 10:59:43,762 - INFO - Pod ctest-pod-10237176 with uuid f9c0df8a-0f31-4d58-b154-b946b8a92288 found in kube manager 2025-03-24 10:59:43,763 - INFO - Pod ctest-pod-10237176 verification passed 2025-03-24 10:59:43,771 - INFO - Pod ctest-pod-31430092 is in running state.Got IP 10.47.255.245 2025-03-24 10:59:43,788 - DEBUG - Pod ctest-pod-31430092 has vmi 0f7a0b7c-089f-11f0-8e15-fa163ea689a5 2025-03-24 10:59:43,788 - INFO - Verified pod ctest-pod-31430092 in contrail-api 2025-03-24 10:59:43,805 - DEBUG - VMI 0f7a0b7c-089f-11f0-8e15-fa163ea689a5 is active in agent 10.0.0.29 2025-03-24 10:59:43,805 - INFO - Verified Pod ctest-pod-31430092 in agent 10.0.0.29 2025-03-24 10:59:43,805 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=d052c2cf-1811-46c1-9012-ac5483e8a608 2025-03-24 10:59:43,810 - INFO - Pod ctest-pod-31430092 with uuid d052c2cf-1811-46c1-9012-ac5483e8a608 found in kube manager 2025-03-24 10:59:43,810 - INFO - Pod ctest-pod-31430092 verification passed 2025-03-24 10:59:43,816 - INFO - Pod ctest-pod-06507051 is in running state.Got IP 10.47.255.246 2025-03-24 10:59:43,875 - DEBUG - Pod ctest-pod-06507051 has vmi 0effc8da-089f-11f0-8e15-fa163ea689a5 2025-03-24 10:59:43,875 - INFO - Verified pod ctest-pod-06507051 in contrail-api 2025-03-24 10:59:43,891 - DEBUG - VMI 0effc8da-089f-11f0-8e15-fa163ea689a5 is active in agent 10.0.0.29 2025-03-24 10:59:43,891 - INFO - Verified Pod ctest-pod-06507051 in agent 10.0.0.29 2025-03-24 10:59:43,891 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=e39c9c3a-2fc2-4f61-848d-6128bc6f27cf 2025-03-24 10:59:43,897 - INFO - Pod ctest-pod-06507051 with uuid e39c9c3a-2fc2-4f61-848d-6128bc6f27cf found in kube manager 2025-03-24 10:59:43,897 - INFO - Pod ctest-pod-06507051 verification passed 2025-03-24 10:59:43,902 - INFO - Pod ctest-pod-57323917 is in running state.Got IP 10.47.255.244 2025-03-24 10:59:43,964 - DEBUG - Pod ctest-pod-57323917 has vmi 0ffb04ca-089f-11f0-8e15-fa163ea689a5 2025-03-24 10:59:43,964 - INFO - Verified pod ctest-pod-57323917 in contrail-api 2025-03-24 10:59:43,981 - DEBUG - VMI 0ffb04ca-089f-11f0-8e15-fa163ea689a5 is active in agent 10.0.0.29 2025-03-24 10:59:43,981 - INFO - Verified Pod ctest-pod-57323917 in agent 10.0.0.29 2025-03-24 10:59:43,981 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=0947a92c-0a5b-4fa8-b212-c3501df12616 2025-03-24 10:59:43,988 - INFO - Pod ctest-pod-57323917 with uuid 0947a92c-0a5b-4fa8-b212-c3501df12616 found in kube manager 2025-03-24 10:59:43,988 - INFO - Pod ctest-pod-57323917 verification passed 2025-03-24 10:59:43,989 - INFO - ================================================================================ 2025-03-24 10:59:43,989 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-03-24 10:59:43,989 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-03-24 10:59:44,249 - DEBUG - Nothing to compare xmpp stats {'10.0.0.29': {'10.0.0.41': '0'}} with 2025-03-24 10:59:44,249 - INFO - Initial checks done. Running the testcase now 2025-03-24 10:59:44,249 - INFO - 2025-03-24 10:59:44,324 - DEBUG - [Pod ctest-pod-34036116] Cmd: echo ctest-pod-34036116 > /usr/share/nginx/html/index.html, Output: 2025-03-24 10:59:44,395 - DEBUG - [Pod ctest-pod-60525682] Cmd: echo ctest-pod-60525682 > /usr/share/nginx/html/index.html, Output: 2025-03-24 10:59:44,471 - DEBUG - [Pod ctest-pod-16726607] Cmd: echo ctest-pod-16726607 > /usr/share/nginx/html/index.html, Output: 2025-03-24 10:59:44,533 - DEBUG - [Pod ctest-pod-91034240] Cmd: echo ctest-pod-91034240 > /usr/share/nginx/html/index.html, Output: 2025-03-24 10:59:44,536 - DEBUG - Service ctest-nginx-svc-44563322 not present 2025-03-24 10:59:44,536 - INFO - Creating service ctest-nginx-svc-44563322 2025-03-24 10:59:44,559 - INFO - Created Service ctest-nginx-svc-44563322 2025-03-24 10:59:44,579 - WARNING - Service UUID 9daf0bc3-37c5-47a0-a954-41dc428b4f44 not yet found in contrail-api 2025-03-24 10:59:45,612 - INFO - Validated that Service ctest-nginx-svc-44563322 is seen in contrail-api 2025-03-24 10:59:45,613 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_LoadbalancerDatabaseList?x=9daf0bc3-37c5-47a0-a954-41dc428b4f44 2025-03-24 10:59:45,626 - INFO - Service ctest-nginx-svc-44563322 with uuid 9daf0bc3-37c5-47a0-a954-41dc428b4f44 found in kube manager 2025-03-24 10:59:45,626 - INFO - Service ctest-nginx-svc-44563322 verification passed 2025-03-24 10:59:46,712 - DEBUG - [Pod ctest-pod-10237176] Cmd: wget http://10.110.13.12:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.13.12:80 (10.110.13.12:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-34036116 2025-03-24 10:59:46,713 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd wget http://10.110.13.12:80/ -O - -T 5 -t 1 passed 2025-03-24 10:59:46,713 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd output: Connecting to 10.110.13.12:80 (10.110.13.12:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-34036116 2025-03-24 10:59:46,792 - DEBUG - [Pod ctest-pod-10237176] Cmd: wget http://10.110.13.12:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.13.12:80 (10.110.13.12:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-34036116 2025-03-24 10:59:46,792 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd wget http://10.110.13.12:80/ -O - -T 5 -t 1 passed 2025-03-24 10:59:46,792 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd output: Connecting to 10.110.13.12:80 (10.110.13.12:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-34036116 2025-03-24 10:59:46,846 - DEBUG - [Pod ctest-pod-10237176] Cmd: wget http://10.110.13.12:80/ -O - -T 5 -t 1 , Output: ctest-pod-34036116 Connecting to 10.110.13.12:80 (10.110.13.12:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-24 10:59:46,847 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd wget http://10.110.13.12:80/ -O - -T 5 -t 1 passed 2025-03-24 10:59:46,847 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd output: ctest-pod-34036116 Connecting to 10.110.13.12:80 (10.110.13.12:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-24 10:59:46,919 - DEBUG - [Pod ctest-pod-10237176] Cmd: wget http://10.110.13.12:80/ -O - -T 5 -t 1 , Output: ctest-pod-60525682 Connecting to 10.110.13.12:80 (10.110.13.12:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-24 10:59:46,919 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd wget http://10.110.13.12:80/ -O - -T 5 -t 1 passed 2025-03-24 10:59:46,919 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd output: ctest-pod-60525682 Connecting to 10.110.13.12:80 (10.110.13.12:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-24 10:59:46,919 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-34036116': 3, 'ctest-pod-60525682': 1} 2025-03-24 10:59:46,992 - DEBUG - [Pod ctest-pod-31430092] Cmd: wget http://10.110.13.12:80/ -O - -T 5 -t 1 , Output: ctest-pod-60525682 Connecting to 10.110.13.12:80 (10.110.13.12:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-24 10:59:46,993 - DEBUG - [Pod Pod ctest-pod-31430092] Cmd wget http://10.110.13.12:80/ -O - -T 5 -t 1 passed 2025-03-24 10:59:46,993 - DEBUG - [Pod Pod ctest-pod-31430092] Cmd output: ctest-pod-60525682 Connecting to 10.110.13.12:80 (10.110.13.12:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-24 10:59:47,126 - DEBUG - [Pod ctest-pod-31430092] Cmd: wget http://10.110.13.12:80/ -O - -T 5 -t 1 , Output: ctest-pod-60525682 Connecting to 10.110.13.12:80 (10.110.13.12:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-24 10:59:47,127 - DEBUG - [Pod Pod ctest-pod-31430092] Cmd wget http://10.110.13.12:80/ -O - -T 5 -t 1 passed 2025-03-24 10:59:47,127 - DEBUG - [Pod Pod ctest-pod-31430092] Cmd output: ctest-pod-60525682 Connecting to 10.110.13.12:80 (10.110.13.12:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-24 10:59:47,193 - DEBUG - [Pod ctest-pod-31430092] Cmd: wget http://10.110.13.12:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.13.12:80 (10.110.13.12:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-60525682 2025-03-24 10:59:47,193 - DEBUG - [Pod Pod ctest-pod-31430092] Cmd wget http://10.110.13.12:80/ -O - -T 5 -t 1 passed 2025-03-24 10:59:47,193 - DEBUG - [Pod Pod ctest-pod-31430092] Cmd output: Connecting to 10.110.13.12:80 (10.110.13.12:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-60525682 2025-03-24 10:59:47,254 - DEBUG - [Pod ctest-pod-31430092] Cmd: wget http://10.110.13.12:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.13.12:80 (10.110.13.12:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-34036116 2025-03-24 10:59:47,254 - DEBUG - [Pod Pod ctest-pod-31430092] Cmd wget http://10.110.13.12:80/ -O - -T 5 -t 1 passed 2025-03-24 10:59:47,254 - DEBUG - [Pod Pod ctest-pod-31430092] Cmd output: Connecting to 10.110.13.12:80 (10.110.13.12:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-34036116 2025-03-24 10:59:47,254 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-34036116': 1, 'ctest-pod-60525682': 3} 2025-03-24 10:59:47,259 - DEBUG - Network policy ingress-on-service not present 2025-03-24 10:59:47,259 - INFO - Creating Network Policy ingress-on-service 2025-03-24 10:59:47,286 - INFO - Network policy found in k8s 2025-03-24 10:59:47,287 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=30393a37-c8bd-44ff-b4bc-18b49032f17b 2025-03-24 10:59:47,295 - INFO - Network Policy ingress-on-service with uuid 30393a37-c8bd-44ff-b4bc-18b49032f17b found in kube manager 2025-03-24 10:59:47,330 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-03-24 10:59:47,331 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-03-24 10:59:47,331 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=30393a37-c8bd-44ff-b4bc-18b49032f17b 2025-03-24 10:59:47,365 - WARNING - Network policy with name ingress-on-service not found in agent 2025-03-24 10:59:49,366 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=30393a37-c8bd-44ff-b4bc-18b49032f17b 2025-03-24 10:59:49,403 - INFO - Network policy with name ingress-on-service found in agent 2025-03-24 10:59:49,403 - INFO - Network Policy ingress-on-service verification passed 2025-03-24 10:59:54,464 - DEBUG - [Pod ctest-pod-10237176] Cmd: wget http://10.110.13.12:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 10:59:54,464 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd wget http://10.110.13.12:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 10:59:54,464 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 10:59:59,525 - DEBUG - [Pod ctest-pod-10237176] Cmd: wget http://10.110.13.12:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 10:59:59,525 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd wget http://10.110.13.12:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 10:59:59,525 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:00:04,598 - DEBUG - [Pod ctest-pod-10237176] Cmd: wget http://10.110.13.12:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:00:04,598 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd wget http://10.110.13.12:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:00:04,598 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:00:09,673 - DEBUG - [Pod ctest-pod-10237176] Cmd: wget http://10.110.13.12:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:00:09,673 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd wget http://10.110.13.12:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:00:09,673 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:00:14,746 - DEBUG - [Pod ctest-pod-10237176] Cmd: wget http://10.110.13.12:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:00:14,746 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd wget http://10.110.13.12:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:00:14,746 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:00:19,811 - DEBUG - [Pod ctest-pod-10237176] Cmd: wget http://10.110.13.12:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:00:19,811 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd wget http://10.110.13.12:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:00:19,812 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:00:24,898 - DEBUG - [Pod ctest-pod-10237176] Cmd: wget http://10.110.13.12:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:00:24,898 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd wget http://10.110.13.12:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:00:24,899 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:00:29,990 - DEBUG - [Pod ctest-pod-10237176] Cmd: wget http://10.110.13.12:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:00:29,990 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd wget http://10.110.13.12:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:00:29,990 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:00:35,047 - DEBUG - [Pod ctest-pod-10237176] Cmd: wget http://10.110.13.12:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:00:35,047 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd wget http://10.110.13.12:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:00:35,047 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:00:40,117 - DEBUG - [Pod ctest-pod-10237176] Cmd: wget http://10.110.13.12:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:00:40,118 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd wget http://10.110.13.12:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:00:40,118 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:00:40,118 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-34036116': 0, 'ctest-pod-60525682': 0} 2025-03-24 11:00:40,194 - DEBUG - [Pod ctest-pod-06507051] Cmd: wget http://10.110.13.12:80/ -O - -T 5 -t 1 , Output: ctest-pod-60525682 Connecting to 10.110.13.12:80 (10.110.13.12:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-24 11:00:40,194 - DEBUG - [Pod Pod ctest-pod-06507051] Cmd wget http://10.110.13.12:80/ -O - -T 5 -t 1 passed 2025-03-24 11:00:40,195 - DEBUG - [Pod Pod ctest-pod-06507051] Cmd output: ctest-pod-60525682 Connecting to 10.110.13.12:80 (10.110.13.12:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-24 11:00:40,252 - DEBUG - [Pod ctest-pod-06507051] Cmd: wget http://10.110.13.12:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.13.12:80 (10.110.13.12:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-60525682 2025-03-24 11:00:40,253 - DEBUG - [Pod Pod ctest-pod-06507051] Cmd wget http://10.110.13.12:80/ -O - -T 5 -t 1 passed 2025-03-24 11:00:40,253 - DEBUG - [Pod Pod ctest-pod-06507051] Cmd output: Connecting to 10.110.13.12:80 (10.110.13.12:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-60525682 2025-03-24 11:00:40,323 - DEBUG - [Pod ctest-pod-06507051] Cmd: wget http://10.110.13.12:80/ -O - -T 5 -t 1 , Output: ctest-pod-60525682 Connecting to 10.110.13.12:80 (10.110.13.12:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-24 11:00:40,323 - DEBUG - [Pod Pod ctest-pod-06507051] Cmd wget http://10.110.13.12:80/ -O - -T 5 -t 1 passed 2025-03-24 11:00:40,323 - DEBUG - [Pod Pod ctest-pod-06507051] Cmd output: ctest-pod-60525682 Connecting to 10.110.13.12:80 (10.110.13.12:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-24 11:00:40,404 - DEBUG - [Pod ctest-pod-06507051] Cmd: wget http://10.110.13.12:80/ -O - -T 5 -t 1 , Output: ctest-pod-34036116 Connecting to 10.110.13.12:80 (10.110.13.12:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-24 11:00:40,404 - DEBUG - [Pod Pod ctest-pod-06507051] Cmd wget http://10.110.13.12:80/ -O - -T 5 -t 1 passed 2025-03-24 11:00:40,404 - DEBUG - [Pod Pod ctest-pod-06507051] Cmd output: ctest-pod-34036116 Connecting to 10.110.13.12:80 (10.110.13.12:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-24 11:00:40,405 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-34036116': 1, 'ctest-pod-60525682': 3} 2025-03-24 11:00:45,480 - DEBUG - [Pod ctest-pod-31430092] Cmd: wget http://10.110.13.12:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:00:45,481 - DEBUG - [Pod Pod ctest-pod-31430092] Cmd wget http://10.110.13.12:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:00:45,481 - DEBUG - [Pod Pod ctest-pod-31430092] Cmd output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:00:50,560 - DEBUG - [Pod ctest-pod-31430092] Cmd: wget http://10.110.13.12:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:00:50,561 - DEBUG - [Pod Pod ctest-pod-31430092] Cmd wget http://10.110.13.12:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:00:50,561 - DEBUG - [Pod Pod ctest-pod-31430092] Cmd output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:00:55,626 - DEBUG - [Pod ctest-pod-31430092] Cmd: wget http://10.110.13.12:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:00:55,626 - DEBUG - [Pod Pod ctest-pod-31430092] Cmd wget http://10.110.13.12:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:00:55,626 - DEBUG - [Pod Pod ctest-pod-31430092] Cmd output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:01:00,693 - DEBUG - [Pod ctest-pod-31430092] Cmd: wget http://10.110.13.12:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:01:00,693 - DEBUG - [Pod Pod ctest-pod-31430092] Cmd wget http://10.110.13.12:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:01:00,693 - DEBUG - [Pod Pod ctest-pod-31430092] Cmd output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:01:05,751 - DEBUG - [Pod ctest-pod-31430092] Cmd: wget http://10.110.13.12:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:01:05,751 - DEBUG - [Pod Pod ctest-pod-31430092] Cmd wget http://10.110.13.12:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:01:05,751 - DEBUG - [Pod Pod ctest-pod-31430092] Cmd output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:01:10,830 - DEBUG - [Pod ctest-pod-31430092] Cmd: wget http://10.110.13.12:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:01:10,830 - DEBUG - [Pod Pod ctest-pod-31430092] Cmd wget http://10.110.13.12:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:01:10,830 - DEBUG - [Pod Pod ctest-pod-31430092] Cmd output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:01:15,897 - DEBUG - [Pod ctest-pod-31430092] Cmd: wget http://10.110.13.12:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:01:15,897 - DEBUG - [Pod Pod ctest-pod-31430092] Cmd wget http://10.110.13.12:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:01:15,897 - DEBUG - [Pod Pod ctest-pod-31430092] Cmd output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:01:20,972 - DEBUG - [Pod ctest-pod-31430092] Cmd: wget http://10.110.13.12:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:01:20,972 - DEBUG - [Pod Pod ctest-pod-31430092] Cmd wget http://10.110.13.12:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:01:20,972 - DEBUG - [Pod Pod ctest-pod-31430092] Cmd output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:01:26,053 - DEBUG - [Pod ctest-pod-31430092] Cmd: wget http://10.110.13.12:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:01:26,053 - DEBUG - [Pod Pod ctest-pod-31430092] Cmd wget http://10.110.13.12:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:01:26,053 - DEBUG - [Pod Pod ctest-pod-31430092] Cmd output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:01:31,119 - DEBUG - [Pod ctest-pod-31430092] Cmd: wget http://10.110.13.12:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:01:31,119 - DEBUG - [Pod Pod ctest-pod-31430092] Cmd wget http://10.110.13.12:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:01:31,119 - DEBUG - [Pod Pod ctest-pod-31430092] Cmd output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:01:31,119 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-34036116': 0, 'ctest-pod-60525682': 0} 2025-03-24 11:01:33,178 - DEBUG - [Pod ctest-pod-06507051] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.830 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.120 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.191 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.120/0.380/0.830 ms 2025-03-24 11:01:33,178 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-06507051 with expectation True passed 2025-03-24 11:01:35,270 - DEBUG - [Pod ctest-pod-10237176] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.760 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.091 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.111 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.091/0.654/1.760 ms 2025-03-24 11:01:35,270 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-10237176 with expectation True passed 2025-03-24 11:01:37,337 - DEBUG - [Pod ctest-pod-31430092] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.915 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.114 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.123 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.114/0.384/0.915 ms 2025-03-24 11:01:37,337 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-31430092 with expectation True passed 2025-03-24 11:01:37,416 - DEBUG - [Pod ctest-pod-06507051] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-24 11:01:37,416 - DEBUG - [Pod Pod ctest-pod-06507051] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-03-24 11:01:37,416 - DEBUG - [Pod Pod ctest-pod-06507051] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-24 11:01:37,417 - INFO - wget check of of http://10.47.255.251 from ctest-pod-06507051 passed 2025-03-24 11:01:37,500 - DEBUG - [Pod ctest-pod-06507051] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-24 11:01:37,501 - DEBUG - [Pod Pod ctest-pod-06507051] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-03-24 11:01:37,501 - DEBUG - [Pod Pod ctest-pod-06507051] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-24 11:01:37,501 - INFO - wget check of of http://10.47.255.250 from ctest-pod-06507051 passed 2025-03-24 11:01:42,559 - DEBUG - [Pod ctest-pod-10237176] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-24 11:01:42,559 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-24 11:01:42,559 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-24 11:01:42,559 - INFO - wget check of of http://10.47.255.250 from ctest-pod-10237176 passed 2025-03-24 11:01:47,626 - DEBUG - [Pod ctest-pod-57323917] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-03-24 11:01:47,626 - DEBUG - [Pod Pod ctest-pod-57323917] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-03-24 11:01:47,626 - DEBUG - [Pod Pod ctest-pod-57323917] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-03-24 11:01:47,626 - INFO - wget check of of http://10.47.255.251 from ctest-pod-57323917 passed 2025-03-24 11:01:47,635 - INFO - Updating Network Policy ingress-on-service 2025-03-24 11:01:52,728 - DEBUG - [Pod ctest-pod-10237176] Cmd: wget http://10.110.13.12:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:01:52,728 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd wget http://10.110.13.12:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:01:52,728 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:01:57,794 - DEBUG - [Pod ctest-pod-10237176] Cmd: wget http://10.110.13.12:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:01:57,794 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd wget http://10.110.13.12:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:01:57,794 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:02:02,868 - DEBUG - [Pod ctest-pod-10237176] Cmd: wget http://10.110.13.12:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:02:02,869 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd wget http://10.110.13.12:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:02:02,869 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:02:07,944 - DEBUG - [Pod ctest-pod-10237176] Cmd: wget http://10.110.13.12:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:02:07,944 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd wget http://10.110.13.12:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:02:07,944 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:02:13,024 - DEBUG - [Pod ctest-pod-10237176] Cmd: wget http://10.110.13.12:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:02:13,024 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd wget http://10.110.13.12:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:02:13,024 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:02:18,104 - DEBUG - [Pod ctest-pod-10237176] Cmd: wget http://10.110.13.12:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:02:18,104 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd wget http://10.110.13.12:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:02:18,105 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:02:23,172 - DEBUG - [Pod ctest-pod-10237176] Cmd: wget http://10.110.13.12:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:02:23,172 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd wget http://10.110.13.12:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:02:23,172 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:02:28,260 - DEBUG - [Pod ctest-pod-10237176] Cmd: wget http://10.110.13.12:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:02:28,260 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd wget http://10.110.13.12:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:02:28,260 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:02:33,343 - DEBUG - [Pod ctest-pod-10237176] Cmd: wget http://10.110.13.12:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:02:33,344 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd wget http://10.110.13.12:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:02:33,344 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:02:38,411 - DEBUG - [Pod ctest-pod-10237176] Cmd: wget http://10.110.13.12:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:02:38,411 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd wget http://10.110.13.12:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:02:38,411 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd output: Connecting to 10.110.13.12:80 (10.110.13.12:80) wget: download timed out 2025-03-24 11:02:38,411 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-34036116': 0, 'ctest-pod-60525682': 0} 2025-03-24 11:02:38,503 - DEBUG - [Pod ctest-pod-06507051] Cmd: wget http://10.110.13.12:80/ -O - -T 5 -t 1 , Output: ctest-pod-34036116 Connecting to 10.110.13.12:80 (10.110.13.12:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-24 11:02:38,503 - DEBUG - [Pod Pod ctest-pod-06507051] Cmd wget http://10.110.13.12:80/ -O - -T 5 -t 1 passed 2025-03-24 11:02:38,503 - DEBUG - [Pod Pod ctest-pod-06507051] Cmd output: ctest-pod-34036116 Connecting to 10.110.13.12:80 (10.110.13.12:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-24 11:02:38,577 - DEBUG - [Pod ctest-pod-06507051] Cmd: wget http://10.110.13.12:80/ -O - -T 5 -t 1 , Output: ctest-pod-34036116 Connecting to 10.110.13.12:80 (10.110.13.12:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-24 11:02:38,577 - DEBUG - [Pod Pod ctest-pod-06507051] Cmd wget http://10.110.13.12:80/ -O - -T 5 -t 1 passed 2025-03-24 11:02:38,577 - DEBUG - [Pod Pod ctest-pod-06507051] Cmd output: ctest-pod-34036116 Connecting to 10.110.13.12:80 (10.110.13.12:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-24 11:02:38,659 - DEBUG - [Pod ctest-pod-06507051] Cmd: wget http://10.110.13.12:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.13.12:80 (10.110.13.12:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-60525682 2025-03-24 11:02:38,659 - DEBUG - [Pod Pod ctest-pod-06507051] Cmd wget http://10.110.13.12:80/ -O - -T 5 -t 1 passed 2025-03-24 11:02:38,659 - DEBUG - [Pod Pod ctest-pod-06507051] Cmd output: Connecting to 10.110.13.12:80 (10.110.13.12:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-60525682 2025-03-24 11:02:38,659 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-34036116': 2, 'ctest-pod-60525682': 1} 2025-03-24 11:02:38,738 - DEBUG - [Pod ctest-pod-31430092] Cmd: wget http://10.110.13.12:80/ -O - -T 5 -t 1 , Output: ctest-pod-60525682 Connecting to 10.110.13.12:80 (10.110.13.12:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-24 11:02:38,738 - DEBUG - [Pod Pod ctest-pod-31430092] Cmd wget http://10.110.13.12:80/ -O - -T 5 -t 1 passed 2025-03-24 11:02:38,738 - DEBUG - [Pod Pod ctest-pod-31430092] Cmd output: ctest-pod-60525682 Connecting to 10.110.13.12:80 (10.110.13.12:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-24 11:02:38,820 - DEBUG - [Pod ctest-pod-31430092] Cmd: wget http://10.110.13.12:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.13.12:80 (10.110.13.12:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-34036116 2025-03-24 11:02:38,820 - DEBUG - [Pod Pod ctest-pod-31430092] Cmd wget http://10.110.13.12:80/ -O - -T 5 -t 1 passed 2025-03-24 11:02:38,820 - DEBUG - [Pod Pod ctest-pod-31430092] Cmd output: Connecting to 10.110.13.12:80 (10.110.13.12:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-34036116 2025-03-24 11:02:38,820 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-34036116': 1, 'ctest-pod-60525682': 1} 2025-03-24 11:02:40,893 - DEBUG - [Pod ctest-pod-06507051] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.803 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.089 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.157 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.089/0.349/0.803 ms 2025-03-24 11:02:40,893 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-06507051 with expectation True passed 2025-03-24 11:02:42,947 - DEBUG - [Pod ctest-pod-10237176] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.436 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.097 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.133 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.097/0.555/1.436 ms 2025-03-24 11:02:42,948 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-10237176 with expectation True passed 2025-03-24 11:02:45,011 - DEBUG - [Pod ctest-pod-31430092] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=3.497 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.103 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.101 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.101/1.233/3.497 ms 2025-03-24 11:02:45,011 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-31430092 with expectation True passed 2025-03-24 11:02:45,085 - DEBUG - [Pod ctest-pod-06507051] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-24 11:02:45,085 - DEBUG - [Pod Pod ctest-pod-06507051] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-03-24 11:02:45,085 - DEBUG - [Pod Pod ctest-pod-06507051] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-24 11:02:45,085 - INFO - wget check of of http://10.47.255.251 from ctest-pod-06507051 passed 2025-03-24 11:02:45,159 - DEBUG - [Pod ctest-pod-06507051] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-24 11:02:45,159 - DEBUG - [Pod Pod ctest-pod-06507051] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-03-24 11:02:45,159 - DEBUG - [Pod Pod ctest-pod-06507051] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-24 11:02:45,159 - INFO - wget check of of http://10.47.255.250 from ctest-pod-06507051 passed 2025-03-24 11:02:50,233 - DEBUG - [Pod ctest-pod-10237176] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-24 11:02:50,233 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-24 11:02:50,233 - DEBUG - [Pod Pod ctest-pod-10237176] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-24 11:02:50,233 - INFO - wget check of of http://10.47.255.250 from ctest-pod-10237176 passed 2025-03-24 11:02:50,304 - DEBUG - [Pod ctest-pod-57323917] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-24 11:02:50,304 - DEBUG - [Pod Pod ctest-pod-57323917] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-03-24 11:02:50,304 - DEBUG - [Pod Pod ctest-pod-57323917] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-24 11:02:50,304 - INFO - wget check of of http://10.47.255.251 from ctest-pod-57323917 passed 2025-03-24 11:02:50,305 - INFO - Deleting Network Policy : ingress-on-service 2025-03-24 11:02:50,306 - INFO - Deleting service : ctest-nginx-svc-44563322 2025-03-24 11:02:50,553 - DEBUG - No XMPP flaps were noticed during the test 2025-03-24 11:02:50,553 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:07] 2025-03-24 11:02:50,554 - INFO - -------------------------------------------------------------------------------- 2025-03-24 11:02:50,558 - INFO - Deleting pod ctest-new-default-36913717:ctest-pod-34036116 2025-03-24 11:02:50,559 - INFO - Deleting pod ctest-new-default-36913717:ctest-pod-60525682 2025-03-24 11:02:50,559 - INFO - Deleting pod ctest-non-default-64868896:ctest-pod-16726607 2025-03-24 11:02:50,560 - INFO - Deleting pod ctest-non-default-64868896:ctest-pod-91034240 2025-03-24 11:02:50,560 - INFO - Deleting pod ctest-new-default-36913717:ctest-pod-10237176 2025-03-24 11:02:50,560 - INFO - Deleting pod ctest-new-default-36913717:ctest-pod-06507051 2025-03-24 11:02:50,561 - INFO - Deleting pod ctest-non-default-64868896:ctest-pod-31430092 2025-03-24 11:02:50,561 - INFO - Deleting pod ctest-non-default-64868896:ctest-pod-57323917 2025-03-24 11:02:50,736 - WARNING - Pod uuid a8014643-f5de-4798-a056-ff325eaec340 is still seen in agent 10.0.0.29 VM list 2025-03-24 11:02:50,737 - WARNING - Pod uuid e39c9c3a-2fc2-4f61-848d-6128bc6f27cf is still seen in agent 10.0.0.29 VM list 2025-03-24 11:02:50,740 - WARNING - Pod uuid 0947a92c-0a5b-4fa8-b212-c3501df12616 is still seen in agent 10.0.0.29 VM list 2025-03-24 11:02:50,740 - WARNING - Pod uuid a98642f9-9299-4f85-bbec-d3624c5ad513 is still seen in agent 10.0.0.29 VM list 2025-03-24 11:02:50,740 - WARNING - Pod uuid f9c0df8a-0f31-4d58-b154-b946b8a92288 is still seen in agent 10.0.0.29 VM list 2025-03-24 11:02:50,741 - WARNING - Pod uuid 2bf0a78a-d621-46eb-ab9b-070e97123141 is still seen in agent 10.0.0.29 VM list 2025-03-24 11:02:50,741 - WARNING - Pod uuid d052c2cf-1811-46c1-9012-ac5483e8a608 is still seen in agent 10.0.0.29 VM list 2025-03-24 11:02:50,742 - WARNING - Pod uuid f678b668-9a68-48a6-93cb-314a6bdbf85f is still seen in agent 10.0.0.29 VM list 2025-03-24 11:02:55,775 - DEBUG - Pod 2bf0a78a-d621-46eb-ab9b-070e97123141 is not in agent 10.0.0.29 VM list 2025-03-24 11:02:55,777 - WARNING - Pod uuid e39c9c3a-2fc2-4f61-848d-6128bc6f27cf is still seen in agent 10.0.0.29 VM list 2025-03-24 11:02:55,778 - WARNING - Pod uuid f9c0df8a-0f31-4d58-b154-b946b8a92288 is still seen in agent 10.0.0.29 VM list 2025-03-24 11:02:55,779 - WARNING - Pod uuid 0947a92c-0a5b-4fa8-b212-c3501df12616 is still seen in agent 10.0.0.29 VM list 2025-03-24 11:02:55,779 - DEBUG - Pod a98642f9-9299-4f85-bbec-d3624c5ad513 is not in agent 10.0.0.29 VM list 2025-03-24 11:02:55,785 - WARNING - Pod uuid d052c2cf-1811-46c1-9012-ac5483e8a608 is still seen in agent 10.0.0.29 VM list 2025-03-24 11:02:55,786 - DEBUG - Pod a8014643-f5de-4798-a056-ff325eaec340 is not in agent 10.0.0.29 VM list 2025-03-24 11:02:55,788 - DEBUG - Pod f678b668-9a68-48a6-93cb-314a6bdbf85f is not in agent 10.0.0.29 VM list 2025-03-24 11:02:55,808 - DEBUG - VMI 0de10b9e-089f-11f0-8e15-fa163ea689a5 is removed from agent 10.0.0.29 2025-03-24 11:02:55,808 - INFO - Verified that pod ctest-pod-91034240 is removed in agent 2025-03-24 11:02:55,809 - DEBUG - VMI 0d59d4ee-089f-11f0-8e15-fa163ea689a5 is removed from agent 10.0.0.29 2025-03-24 11:02:55,809 - INFO - Verified that pod ctest-pod-16726607 is removed in agent 2025-03-24 11:02:55,809 - DEBUG - VMI 0cb0a6da-089f-11f0-8e15-fa163ea689a5 is removed from agent 10.0.0.29 2025-03-24 11:02:55,809 - INFO - Verified that pod ctest-pod-60525682 is removed in agent 2025-03-24 11:02:55,811 - DEBUG - VMI 0c231b8a-089f-11f0-8e15-fa163ea689a5 is removed from agent 10.0.0.29 2025-03-24 11:02:55,811 - INFO - Verified that pod ctest-pod-34036116 is removed in agent 2025-03-24 11:03:00,802 - WARNING - Pod uuid 0947a92c-0a5b-4fa8-b212-c3501df12616 is still seen in agent 10.0.0.29 VM list 2025-03-24 11:03:00,803 - WARNING - Pod uuid f9c0df8a-0f31-4d58-b154-b946b8a92288 is still seen in agent 10.0.0.29 VM list 2025-03-24 11:03:00,803 - WARNING - Pod uuid e39c9c3a-2fc2-4f61-848d-6128bc6f27cf is still seen in agent 10.0.0.29 VM list 2025-03-24 11:03:00,804 - WARNING - Pod uuid d052c2cf-1811-46c1-9012-ac5483e8a608 is still seen in agent 10.0.0.29 VM list 2025-03-24 11:03:05,821 - WARNING - Pod uuid 0947a92c-0a5b-4fa8-b212-c3501df12616 is still seen in agent 10.0.0.29 VM list 2025-03-24 11:03:05,823 - WARNING - Pod uuid e39c9c3a-2fc2-4f61-848d-6128bc6f27cf is still seen in agent 10.0.0.29 VM list 2025-03-24 11:03:05,824 - WARNING - Pod uuid f9c0df8a-0f31-4d58-b154-b946b8a92288 is still seen in agent 10.0.0.29 VM list 2025-03-24 11:03:05,824 - WARNING - Pod uuid d052c2cf-1811-46c1-9012-ac5483e8a608 is still seen in agent 10.0.0.29 VM list 2025-03-24 11:03:10,843 - WARNING - Pod uuid d052c2cf-1811-46c1-9012-ac5483e8a608 is still seen in agent 10.0.0.29 VM list 2025-03-24 11:03:10,844 - WARNING - Pod uuid 0947a92c-0a5b-4fa8-b212-c3501df12616 is still seen in agent 10.0.0.29 VM list 2025-03-24 11:03:10,845 - WARNING - Pod uuid f9c0df8a-0f31-4d58-b154-b946b8a92288 is still seen in agent 10.0.0.29 VM list 2025-03-24 11:03:10,846 - WARNING - Pod uuid e39c9c3a-2fc2-4f61-848d-6128bc6f27cf is still seen in agent 10.0.0.29 VM list 2025-03-24 11:03:15,869 - WARNING - Pod uuid e39c9c3a-2fc2-4f61-848d-6128bc6f27cf is still seen in agent 10.0.0.29 VM list 2025-03-24 11:03:15,869 - WARNING - Pod uuid f9c0df8a-0f31-4d58-b154-b946b8a92288 is still seen in agent 10.0.0.29 VM list 2025-03-24 11:03:15,869 - WARNING - Pod uuid 0947a92c-0a5b-4fa8-b212-c3501df12616 is still seen in agent 10.0.0.29 VM list 2025-03-24 11:03:15,870 - WARNING - Pod uuid d052c2cf-1811-46c1-9012-ac5483e8a608 is still seen in agent 10.0.0.29 VM list 2025-03-24 11:03:20,888 - WARNING - Pod uuid e39c9c3a-2fc2-4f61-848d-6128bc6f27cf is still seen in agent 10.0.0.29 VM list 2025-03-24 11:03:20,890 - WARNING - Pod uuid 0947a92c-0a5b-4fa8-b212-c3501df12616 is still seen in agent 10.0.0.29 VM list 2025-03-24 11:03:20,891 - WARNING - Pod uuid d052c2cf-1811-46c1-9012-ac5483e8a608 is still seen in agent 10.0.0.29 VM list 2025-03-24 11:03:20,891 - WARNING - Pod uuid f9c0df8a-0f31-4d58-b154-b946b8a92288 is still seen in agent 10.0.0.29 VM list 2025-03-24 11:03:25,909 - DEBUG - Pod 0947a92c-0a5b-4fa8-b212-c3501df12616 is not in agent 10.0.0.29 VM list 2025-03-24 11:03:25,911 - DEBUG - Pod e39c9c3a-2fc2-4f61-848d-6128bc6f27cf is not in agent 10.0.0.29 VM list 2025-03-24 11:03:25,915 - DEBUG - Pod f9c0df8a-0f31-4d58-b154-b946b8a92288 is not in agent 10.0.0.29 VM list 2025-03-24 11:03:25,916 - DEBUG - Pod d052c2cf-1811-46c1-9012-ac5483e8a608 is not in agent 10.0.0.29 VM list 2025-03-24 11:03:25,931 - DEBUG - VMI 0e752acc-089f-11f0-8e15-fa163ea689a5 is removed from agent 10.0.0.29 2025-03-24 11:03:25,931 - INFO - Verified that pod ctest-pod-10237176 is removed in agent 2025-03-24 11:03:25,935 - DEBUG - VMI 0ffb04ca-089f-11f0-8e15-fa163ea689a5 is removed from agent 10.0.0.29 2025-03-24 11:03:25,935 - INFO - Verified that pod ctest-pod-57323917 is removed in agent 2025-03-24 11:03:25,935 - DEBUG - VMI 0effc8da-089f-11f0-8e15-fa163ea689a5 is removed from agent 10.0.0.29 2025-03-24 11:03:25,935 - INFO - Verified that pod ctest-pod-06507051 is removed in agent 2025-03-24 11:03:25,937 - DEBUG - VMI 0f7a0b7c-089f-11f0-8e15-fa163ea689a5 is removed from agent 10.0.0.29 2025-03-24 11:03:25,937 - INFO - Verified that pod ctest-pod-31430092 is removed in agent 2025-03-24 11:03:25,937 - INFO - Deleting namespace ctest-non-default-64868896 2025-03-24 11:03:25,957 - DEBUG - Namespace ctest-non-default-64868896 still in k8s 2025-03-24 11:03:27,962 - DEBUG - Namespace ctest-non-default-64868896 still in k8s 2025-03-24 11:03:29,967 - DEBUG - Namespace ctest-non-default-64868896 still in k8s 2025-03-24 11:03:31,972 - DEBUG - Namespace ctest-non-default-64868896 is not in k8s 2025-03-24 11:03:31,972 - DEBUG - No need to check project deletion in contrail-api 2025-03-24 11:03:31,972 - INFO - Deleting namespace ctest-new-default-36913717 2025-03-24 11:03:31,982 - DEBUG - Namespace ctest-new-default-36913717 still in k8s 2025-03-24 11:03:33,992 - DEBUG - Namespace ctest-new-default-36913717 still in k8s 2025-03-24 11:03:35,997 - DEBUG - Namespace ctest-new-default-36913717 still in k8s 2025-03-24 11:03:38,004 - DEBUG - Namespace ctest-new-default-36913717 is not in k8s 2025-03-24 11:03:38,004 - DEBUG - No need to check project deletion in contrail-api