2025-06-24 12:14:02,709 - INFO - Using existing project ['default-domain', 'k8s-default'](5affe73f-14c1-40f9-a15e-32ccf2394a22) 2025-06-24 12:14:02,733 - DEBUG - Namespace ctest-new-default-32380279 not present 2025-06-24 12:14:02,741 - INFO - Created namespace ctest-new-default-32380279 2025-06-24 12:14:05,743 - DEBUG - Namespace ctest-non-default-97208383 not present 2025-06-24 12:14:05,749 - INFO - Created namespace ctest-non-default-97208383 2025-06-24 12:14:08,766 - DEBUG - Pod ctest-pod-88669454 not present 2025-06-24 12:14:08,767 - INFO - Creating Pod ctest-pod-88669454 2025-06-24 12:14:08,790 - DEBUG - Pod : ctest-pod-88669454 UUID is c990ad20-f77d-4802-a122-f10e457ea183 2025-06-24 12:14:08,793 - DEBUG - Pod ctest-pod-59766593 not present 2025-06-24 12:14:08,793 - INFO - Creating Pod ctest-pod-59766593 2025-06-24 12:14:08,821 - DEBUG - Pod : ctest-pod-59766593 UUID is 1e529616-fd15-45ff-9079-7562928974d1 2025-06-24 12:14:08,823 - DEBUG - Pod ctest-pod-39513317 not present 2025-06-24 12:14:08,824 - INFO - Creating Pod ctest-pod-39513317 2025-06-24 12:14:08,857 - DEBUG - Pod : ctest-pod-39513317 UUID is f918e65e-f38a-4446-bc27-2d44420b5a43 2025-06-24 12:14:08,861 - DEBUG - Pod ctest-pod-44750437 not present 2025-06-24 12:14:08,862 - INFO - Creating Pod ctest-pod-44750437 2025-06-24 12:14:08,882 - DEBUG - Pod : ctest-pod-44750437 UUID is 58d2f33c-07c0-470a-92bb-e35eb05b6afb 2025-06-24 12:14:08,885 - DEBUG - Pod ctest-pod-09652715 not present 2025-06-24 12:14:08,885 - INFO - Creating Pod ctest-pod-09652715 2025-06-24 12:14:08,909 - DEBUG - Pod : ctest-pod-09652715 UUID is 60aae571-49b6-4d43-b927-53a2ddddc6e4 2025-06-24 12:14:08,913 - DEBUG - Pod ctest-pod-18639910 not present 2025-06-24 12:14:08,913 - INFO - Creating Pod ctest-pod-18639910 2025-06-24 12:14:08,944 - DEBUG - Pod : ctest-pod-18639910 UUID is 74c7db40-df9f-4b46-bf5b-2430f3acaa27 2025-06-24 12:14:08,947 - DEBUG - Pod ctest-pod-99958020 not present 2025-06-24 12:14:08,947 - INFO - Creating Pod ctest-pod-99958020 2025-06-24 12:14:08,979 - DEBUG - Pod : ctest-pod-99958020 UUID is 88820773-ba2a-4cf8-a771-e172f8c3ecb0 2025-06-24 12:14:08,981 - DEBUG - Pod ctest-pod-35624164 not present 2025-06-24 12:14:08,981 - INFO - Creating Pod ctest-pod-35624164 2025-06-24 12:14:09,001 - DEBUG - Pod : ctest-pod-35624164 UUID is 7bb813f4-4325-4121-9c89-e58c3712a40e 2025-06-24 12:14:09,205 - INFO - Project default-domain:k8s-ctest-new-default-32380279 for Namespace ctest-new-default-32380279 is seen in contrail-api 2025-06-24 12:14:09,206 - DEBUG - Project uuid in Contrail is 51f2278a-de01-4553-8aeb-d8fde6ffb97a 2025-06-24 12:14:09,377 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_NamespaceDatabaseList?namespace_uuid=15e15a49-4220-4b87-9798-33c45d9ab0d7 2025-06-24 12:14:09,385 - INFO - Namespace ctest-new-default-32380279 with uuid 15e15a49-4220-4b87-9798-33c45d9ab0d7 found in kube manager 2025-06-24 12:14:09,386 - INFO - Namespace ctest-new-default-32380279 verification passed 2025-06-24 12:14:09,577 - INFO - Project default-domain:k8s-ctest-non-default-97208383 for Namespace ctest-non-default-97208383 is seen in contrail-api 2025-06-24 12:14:09,577 - DEBUG - Project uuid in Contrail is 3d636283-1b04-41de-a3b0-cf6c1b3c2d77 2025-06-24 12:14:09,577 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_NamespaceDatabaseList?namespace_uuid=4de1388f-6926-4b43-86fe-74e994b70571 2025-06-24 12:14:09,581 - INFO - Namespace ctest-non-default-97208383 with uuid 4de1388f-6926-4b43-86fe-74e994b70571 found in kube manager 2025-06-24 12:14:09,581 - INFO - Namespace ctest-non-default-97208383 verification passed 2025-06-24 12:14:09,588 - DEBUG - Pod ctest-pod-88669454 not in running state.Currently in Pending 2025-06-24 12:14:14,597 - DEBUG - Pod ctest-pod-88669454 not in running state.Currently in Pending 2025-06-24 12:14:19,603 - DEBUG - Pod ctest-pod-88669454 not in running state.Currently in Pending 2025-06-24 12:14:24,610 - INFO - Pod ctest-pod-88669454 is in running state.Got IP 10.47.255.251 2025-06-24 12:14:24,622 - DEBUG - Pod ctest-pod-88669454 has vmi bc086fc6-50f4-11f0-b799-fa163e5d700a 2025-06-24 12:14:24,622 - INFO - Verified pod ctest-pod-88669454 in contrail-api 2025-06-24 12:14:24,636 - DEBUG - VMI bc086fc6-50f4-11f0-b799-fa163e5d700a is active in agent 10.0.0.49 2025-06-24 12:14:24,636 - INFO - Verified Pod ctest-pod-88669454 in agent 10.0.0.49 2025-06-24 12:14:24,636 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=c990ad20-f77d-4802-a122-f10e457ea183 2025-06-24 12:14:24,640 - INFO - Pod ctest-pod-88669454 with uuid c990ad20-f77d-4802-a122-f10e457ea183 found in kube manager 2025-06-24 12:14:24,640 - INFO - Pod ctest-pod-88669454 verification passed 2025-06-24 12:14:24,644 - INFO - Pod ctest-pod-59766593 is in running state.Got IP 10.47.255.250 2025-06-24 12:14:24,701 - DEBUG - Pod ctest-pod-59766593 has vmi bc807db8-50f4-11f0-b799-fa163e5d700a 2025-06-24 12:14:24,701 - INFO - Verified pod ctest-pod-59766593 in contrail-api 2025-06-24 12:14:24,714 - DEBUG - VMI bc807db8-50f4-11f0-b799-fa163e5d700a is active in agent 10.0.0.49 2025-06-24 12:14:24,714 - INFO - Verified Pod ctest-pod-59766593 in agent 10.0.0.49 2025-06-24 12:14:24,714 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=1e529616-fd15-45ff-9079-7562928974d1 2025-06-24 12:14:24,718 - INFO - Pod ctest-pod-59766593 with uuid 1e529616-fd15-45ff-9079-7562928974d1 found in kube manager 2025-06-24 12:14:24,718 - INFO - Pod ctest-pod-59766593 verification passed 2025-06-24 12:14:24,723 - INFO - Pod ctest-pod-39513317 is in running state.Got IP 10.47.255.249 2025-06-24 12:14:24,778 - DEBUG - Pod ctest-pod-39513317 has vmi bd1f4eac-50f4-11f0-b799-fa163e5d700a 2025-06-24 12:14:24,778 - INFO - Verified pod ctest-pod-39513317 in contrail-api 2025-06-24 12:14:24,791 - DEBUG - VMI bd1f4eac-50f4-11f0-b799-fa163e5d700a is active in agent 10.0.0.49 2025-06-24 12:14:24,791 - INFO - Verified Pod ctest-pod-39513317 in agent 10.0.0.49 2025-06-24 12:14:24,791 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=f918e65e-f38a-4446-bc27-2d44420b5a43 2025-06-24 12:14:24,795 - INFO - Pod ctest-pod-39513317 with uuid f918e65e-f38a-4446-bc27-2d44420b5a43 found in kube manager 2025-06-24 12:14:24,795 - INFO - Pod ctest-pod-39513317 verification passed 2025-06-24 12:14:24,801 - INFO - Pod ctest-pod-44750437 is in running state.Got IP 10.47.255.248 2025-06-24 12:14:24,813 - DEBUG - Pod ctest-pod-44750437 has vmi bd9e6ef8-50f4-11f0-b799-fa163e5d700a 2025-06-24 12:14:24,813 - INFO - Verified pod ctest-pod-44750437 in contrail-api 2025-06-24 12:14:24,828 - DEBUG - VMI bd9e6ef8-50f4-11f0-b799-fa163e5d700a is active in agent 10.0.0.49 2025-06-24 12:14:24,828 - INFO - Verified Pod ctest-pod-44750437 in agent 10.0.0.49 2025-06-24 12:14:24,828 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=58d2f33c-07c0-470a-92bb-e35eb05b6afb 2025-06-24 12:14:24,832 - INFO - Pod ctest-pod-44750437 with uuid 58d2f33c-07c0-470a-92bb-e35eb05b6afb found in kube manager 2025-06-24 12:14:24,832 - INFO - Pod ctest-pod-44750437 verification passed 2025-06-24 12:14:24,837 - DEBUG - Pod ctest-pod-09652715 not in running state.Currently in Pending 2025-06-24 12:14:29,842 - INFO - Pod ctest-pod-09652715 is in running state.Got IP 10.47.255.247 2025-06-24 12:14:29,898 - DEBUG - Pod ctest-pod-09652715 has vmi be1b88b6-50f4-11f0-b799-fa163e5d700a 2025-06-24 12:14:29,898 - INFO - Verified pod ctest-pod-09652715 in contrail-api 2025-06-24 12:14:29,912 - DEBUG - VMI be1b88b6-50f4-11f0-b799-fa163e5d700a is active in agent 10.0.0.49 2025-06-24 12:14:29,913 - INFO - Verified Pod ctest-pod-09652715 in agent 10.0.0.49 2025-06-24 12:14:29,913 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=60aae571-49b6-4d43-b927-53a2ddddc6e4 2025-06-24 12:14:29,919 - INFO - Pod ctest-pod-09652715 with uuid 60aae571-49b6-4d43-b927-53a2ddddc6e4 found in kube manager 2025-06-24 12:14:29,919 - INFO - Pod ctest-pod-09652715 verification passed 2025-06-24 12:14:29,925 - INFO - Pod ctest-pod-99958020 is in running state.Got IP 10.47.255.245 2025-06-24 12:14:29,938 - DEBUG - Pod ctest-pod-99958020 has vmi bf0cf8a4-50f4-11f0-b799-fa163e5d700a 2025-06-24 12:14:29,938 - INFO - Verified pod ctest-pod-99958020 in contrail-api 2025-06-24 12:14:29,953 - DEBUG - VMI bf0cf8a4-50f4-11f0-b799-fa163e5d700a is active in agent 10.0.0.49 2025-06-24 12:14:29,953 - INFO - Verified Pod ctest-pod-99958020 in agent 10.0.0.49 2025-06-24 12:14:29,953 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=88820773-ba2a-4cf8-a771-e172f8c3ecb0 2025-06-24 12:14:29,958 - INFO - Pod ctest-pod-99958020 with uuid 88820773-ba2a-4cf8-a771-e172f8c3ecb0 found in kube manager 2025-06-24 12:14:29,958 - INFO - Pod ctest-pod-99958020 verification passed 2025-06-24 12:14:30,030 - INFO - Pod ctest-pod-18639910 is in running state.Got IP 10.47.255.246 2025-06-24 12:14:30,086 - DEBUG - Pod ctest-pod-18639910 has vmi be950a10-50f4-11f0-b799-fa163e5d700a 2025-06-24 12:14:30,086 - INFO - Verified pod ctest-pod-18639910 in contrail-api 2025-06-24 12:14:30,101 - DEBUG - VMI be950a10-50f4-11f0-b799-fa163e5d700a is active in agent 10.0.0.49 2025-06-24 12:14:30,101 - INFO - Verified Pod ctest-pod-18639910 in agent 10.0.0.49 2025-06-24 12:14:30,101 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=74c7db40-df9f-4b46-bf5b-2430f3acaa27 2025-06-24 12:14:30,106 - INFO - Pod ctest-pod-18639910 with uuid 74c7db40-df9f-4b46-bf5b-2430f3acaa27 found in kube manager 2025-06-24 12:14:30,106 - INFO - Pod ctest-pod-18639910 verification passed 2025-06-24 12:14:30,112 - INFO - Pod ctest-pod-35624164 is in running state.Got IP 10.47.255.244 2025-06-24 12:14:30,127 - DEBUG - Pod ctest-pod-35624164 has vmi bf9938aa-50f4-11f0-b799-fa163e5d700a 2025-06-24 12:14:30,127 - INFO - Verified pod ctest-pod-35624164 in contrail-api 2025-06-24 12:14:30,148 - DEBUG - VMI bf9938aa-50f4-11f0-b799-fa163e5d700a is active in agent 10.0.0.49 2025-06-24 12:14:30,148 - INFO - Verified Pod ctest-pod-35624164 in agent 10.0.0.49 2025-06-24 12:14:30,148 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=7bb813f4-4325-4121-9c89-e58c3712a40e 2025-06-24 12:14:30,154 - INFO - Pod ctest-pod-35624164 with uuid 7bb813f4-4325-4121-9c89-e58c3712a40e found in kube manager 2025-06-24 12:14:30,154 - INFO - Pod ctest-pod-35624164 verification passed 2025-06-24 12:14:30,154 - INFO - ================================================================================ 2025-06-24 12:14:30,154 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-06-24 12:14:30,154 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-06-24 12:14:30,359 - DEBUG - Nothing to compare xmpp stats {'10.0.0.49': {'10.0.0.249': '0'}} with 2025-06-24 12:14:30,359 - INFO - Initial checks done. Running the testcase now 2025-06-24 12:14:30,359 - INFO - 2025-06-24 12:14:30,412 - DEBUG - [Pod ctest-pod-88669454] Cmd: echo ctest-pod-88669454 > /usr/share/nginx/html/index.html, Output: 2025-06-24 12:14:30,464 - DEBUG - [Pod ctest-pod-59766593] Cmd: echo ctest-pod-59766593 > /usr/share/nginx/html/index.html, Output: 2025-06-24 12:14:30,520 - DEBUG - [Pod ctest-pod-39513317] Cmd: echo ctest-pod-39513317 > /usr/share/nginx/html/index.html, Output: 2025-06-24 12:14:30,576 - DEBUG - [Pod ctest-pod-44750437] Cmd: echo ctest-pod-44750437 > /usr/share/nginx/html/index.html, Output: 2025-06-24 12:14:30,579 - DEBUG - Service ctest-nginx-svc-98221552 not present 2025-06-24 12:14:30,579 - INFO - Creating service ctest-nginx-svc-98221552 2025-06-24 12:14:30,591 - INFO - Created Service ctest-nginx-svc-98221552 2025-06-24 12:14:30,606 - WARNING - Service UUID 24cd6caf-1711-455d-b496-18aea68e5bc2 not yet found in contrail-api 2025-06-24 12:14:31,616 - INFO - Validated that Service ctest-nginx-svc-98221552 is seen in contrail-api 2025-06-24 12:14:31,616 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_LoadbalancerDatabaseList?x=24cd6caf-1711-455d-b496-18aea68e5bc2 2025-06-24 12:14:31,622 - INFO - Service ctest-nginx-svc-98221552 with uuid 24cd6caf-1711-455d-b496-18aea68e5bc2 found in kube manager 2025-06-24 12:14:31,622 - INFO - Service ctest-nginx-svc-98221552 verification passed 2025-06-24 12:14:32,699 - DEBUG - [Pod ctest-pod-09652715] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.106.131:80 (10.106.106.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-88669454 2025-06-24 12:14:32,700 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 passed 2025-06-24 12:14:32,700 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd output: Connecting to 10.106.106.131:80 (10.106.106.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-88669454 2025-06-24 12:14:32,754 - DEBUG - [Pod ctest-pod-09652715] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: ctest-pod-88669454 Connecting to 10.106.106.131:80 (10.106.106.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 12:14:32,754 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 passed 2025-06-24 12:14:32,754 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd output: ctest-pod-88669454 Connecting to 10.106.106.131:80 (10.106.106.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 12:14:32,811 - DEBUG - [Pod ctest-pod-09652715] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: ctest-pod-88669454 Connecting to 10.106.106.131:80 (10.106.106.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 12:14:32,811 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 passed 2025-06-24 12:14:32,811 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd output: ctest-pod-88669454 Connecting to 10.106.106.131:80 (10.106.106.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 12:14:32,866 - DEBUG - [Pod ctest-pod-09652715] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: ctest-pod-88669454 Connecting to 10.106.106.131:80 (10.106.106.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 12:14:32,866 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 passed 2025-06-24 12:14:32,866 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd output: ctest-pod-88669454 Connecting to 10.106.106.131:80 (10.106.106.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 12:14:32,919 - DEBUG - [Pod ctest-pod-09652715] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: ctest-pod-88669454 Connecting to 10.106.106.131:80 (10.106.106.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 12:14:32,919 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 passed 2025-06-24 12:14:32,919 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd output: ctest-pod-88669454 Connecting to 10.106.106.131:80 (10.106.106.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 12:14:32,974 - DEBUG - [Pod ctest-pod-09652715] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: ctest-pod-59766593 Connecting to 10.106.106.131:80 (10.106.106.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 12:14:32,974 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 passed 2025-06-24 12:14:32,974 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd output: ctest-pod-59766593 Connecting to 10.106.106.131:80 (10.106.106.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 12:14:32,974 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-88669454': 5, 'ctest-pod-59766593': 1} 2025-06-24 12:14:33,036 - DEBUG - [Pod ctest-pod-99958020] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.106.131:80 (10.106.106.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-88669454 2025-06-24 12:14:33,036 - DEBUG - [Pod Pod ctest-pod-99958020] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 passed 2025-06-24 12:14:33,036 - DEBUG - [Pod Pod ctest-pod-99958020] Cmd output: Connecting to 10.106.106.131:80 (10.106.106.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-88669454 2025-06-24 12:14:33,096 - DEBUG - [Pod ctest-pod-99958020] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: ctest-pod-59766593 Connecting to 10.106.106.131:80 (10.106.106.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 12:14:33,096 - DEBUG - [Pod Pod ctest-pod-99958020] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 passed 2025-06-24 12:14:33,096 - DEBUG - [Pod Pod ctest-pod-99958020] Cmd output: ctest-pod-59766593 Connecting to 10.106.106.131:80 (10.106.106.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 12:14:33,096 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-88669454': 1, 'ctest-pod-59766593': 1} 2025-06-24 12:14:33,099 - DEBUG - Network policy ingress-on-service not present 2025-06-24 12:14:33,099 - INFO - Creating Network Policy ingress-on-service 2025-06-24 12:14:33,109 - INFO - Network policy found in k8s 2025-06-24 12:14:33,109 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=6e823fdd-e131-42f3-b328-f2ec411cad68 2025-06-24 12:14:33,113 - INFO - Network Policy ingress-on-service with uuid 6e823fdd-e131-42f3-b328-f2ec411cad68 found in kube manager 2025-06-24 12:14:33,145 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-06-24 12:14:33,145 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-06-24 12:14:33,146 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=6e823fdd-e131-42f3-b328-f2ec411cad68 2025-06-24 12:14:33,172 - WARNING - Network policy with name ingress-on-service not found in agent 2025-06-24 12:14:35,173 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=6e823fdd-e131-42f3-b328-f2ec411cad68 2025-06-24 12:14:35,205 - INFO - Network policy with name ingress-on-service found in agent 2025-06-24 12:14:35,205 - INFO - Network Policy ingress-on-service verification passed 2025-06-24 12:14:40,252 - DEBUG - [Pod ctest-pod-09652715] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:14:40,252 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:14:40,252 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:14:45,301 - DEBUG - [Pod ctest-pod-09652715] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:14:45,301 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:14:45,301 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:14:50,352 - DEBUG - [Pod ctest-pod-09652715] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:14:50,352 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:14:50,352 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:14:55,400 - DEBUG - [Pod ctest-pod-09652715] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:14:55,401 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:14:55,401 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:15:00,452 - DEBUG - [Pod ctest-pod-09652715] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:15:00,452 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:15:00,452 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:15:05,499 - DEBUG - [Pod ctest-pod-09652715] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:15:05,500 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:15:05,500 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:15:10,548 - DEBUG - [Pod ctest-pod-09652715] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:15:10,548 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:15:10,548 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:15:15,618 - DEBUG - [Pod ctest-pod-09652715] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:15:15,618 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:15:15,618 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:15:20,680 - DEBUG - [Pod ctest-pod-09652715] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:15:20,681 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:15:20,681 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:15:25,729 - DEBUG - [Pod ctest-pod-09652715] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:15:25,729 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:15:25,729 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:15:25,729 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-88669454': 0, 'ctest-pod-59766593': 0} 2025-06-24 12:15:25,783 - DEBUG - [Pod ctest-pod-18639910] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.106.131:80 (10.106.106.131:80) ctest-pod-59766593 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 12:15:25,784 - DEBUG - [Pod Pod ctest-pod-18639910] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 passed 2025-06-24 12:15:25,784 - DEBUG - [Pod Pod ctest-pod-18639910] Cmd output: Connecting to 10.106.106.131:80 (10.106.106.131:80) ctest-pod-59766593 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 12:15:25,843 - DEBUG - [Pod ctest-pod-18639910] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: ctest-pod-88669454 Connecting to 10.106.106.131:80 (10.106.106.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 12:15:25,843 - DEBUG - [Pod Pod ctest-pod-18639910] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 passed 2025-06-24 12:15:25,843 - DEBUG - [Pod Pod ctest-pod-18639910] Cmd output: ctest-pod-88669454 Connecting to 10.106.106.131:80 (10.106.106.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 12:15:25,843 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-88669454': 1, 'ctest-pod-59766593': 1} 2025-06-24 12:15:30,892 - DEBUG - [Pod ctest-pod-99958020] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:15:30,892 - DEBUG - [Pod Pod ctest-pod-99958020] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:15:30,892 - DEBUG - [Pod Pod ctest-pod-99958020] Cmd output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:15:35,937 - DEBUG - [Pod ctest-pod-99958020] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:15:35,937 - DEBUG - [Pod Pod ctest-pod-99958020] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:15:35,937 - DEBUG - [Pod Pod ctest-pod-99958020] Cmd output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:15:40,984 - DEBUG - [Pod ctest-pod-99958020] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:15:40,984 - DEBUG - [Pod Pod ctest-pod-99958020] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:15:40,984 - DEBUG - [Pod Pod ctest-pod-99958020] Cmd output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:15:46,032 - DEBUG - [Pod ctest-pod-99958020] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:15:46,032 - DEBUG - [Pod Pod ctest-pod-99958020] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:15:46,032 - DEBUG - [Pod Pod ctest-pod-99958020] Cmd output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:15:51,080 - DEBUG - [Pod ctest-pod-99958020] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:15:51,080 - DEBUG - [Pod Pod ctest-pod-99958020] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:15:51,080 - DEBUG - [Pod Pod ctest-pod-99958020] Cmd output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:15:56,132 - DEBUG - [Pod ctest-pod-99958020] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:15:56,132 - DEBUG - [Pod Pod ctest-pod-99958020] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:15:56,132 - DEBUG - [Pod Pod ctest-pod-99958020] Cmd output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:16:01,194 - DEBUG - [Pod ctest-pod-99958020] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:16:01,194 - DEBUG - [Pod Pod ctest-pod-99958020] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:16:01,194 - DEBUG - [Pod Pod ctest-pod-99958020] Cmd output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:16:06,246 - DEBUG - [Pod ctest-pod-99958020] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:16:06,246 - DEBUG - [Pod Pod ctest-pod-99958020] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:16:06,246 - DEBUG - [Pod Pod ctest-pod-99958020] Cmd output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:16:11,292 - DEBUG - [Pod ctest-pod-99958020] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:16:11,292 - DEBUG - [Pod Pod ctest-pod-99958020] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:16:11,293 - DEBUG - [Pod Pod ctest-pod-99958020] Cmd output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:16:16,349 - DEBUG - [Pod ctest-pod-99958020] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:16:16,349 - DEBUG - [Pod Pod ctest-pod-99958020] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:16:16,349 - DEBUG - [Pod Pod ctest-pod-99958020] Cmd output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:16:16,349 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-88669454': 0, 'ctest-pod-59766593': 0} 2025-06-24 12:16:18,407 - DEBUG - [Pod ctest-pod-18639910] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.704 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.072 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.101 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.072/0.625/1.704 ms 2025-06-24 12:16:18,407 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-18639910 with expectation True passed 2025-06-24 12:16:20,473 - DEBUG - [Pod ctest-pod-09652715] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.692 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.077 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.613/1.692 ms 2025-06-24 12:16:20,473 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-09652715 with expectation True passed 2025-06-24 12:16:22,546 - DEBUG - [Pod ctest-pod-99958020] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.549 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.076 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.072 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.072/0.565/1.549 ms 2025-06-24 12:16:22,546 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-99958020 with expectation True passed 2025-06-24 12:16:22,603 - DEBUG - [Pod ctest-pod-18639910] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-24 12:16:22,603 - DEBUG - [Pod Pod ctest-pod-18639910] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-06-24 12:16:22,603 - DEBUG - [Pod Pod ctest-pod-18639910] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-24 12:16:22,603 - INFO - wget check of of http://10.47.255.251 from ctest-pod-18639910 passed 2025-06-24 12:16:22,689 - DEBUG - [Pod ctest-pod-18639910] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-24 12:16:22,689 - DEBUG - [Pod Pod ctest-pod-18639910] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-06-24 12:16:22,689 - DEBUG - [Pod Pod ctest-pod-18639910] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-24 12:16:22,689 - INFO - wget check of of http://10.47.255.250 from ctest-pod-18639910 passed 2025-06-24 12:16:24,725 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2025-06-24 12:16:35,138 - DEBUG - [Pod ctest-pod-09652715] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-24 12:16:35,138 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-24 12:16:35,138 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-24 12:16:35,138 - INFO - wget check of of http://10.47.255.250 from ctest-pod-09652715 passed 2025-06-24 12:16:40,197 - DEBUG - [Pod ctest-pod-35624164] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-06-24 12:16:40,198 - DEBUG - [Pod Pod ctest-pod-35624164] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-06-24 12:16:40,198 - DEBUG - [Pod Pod ctest-pod-35624164] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-06-24 12:16:40,198 - INFO - wget check of of http://10.47.255.251 from ctest-pod-35624164 passed 2025-06-24 12:16:40,206 - INFO - Updating Network Policy ingress-on-service 2025-06-24 12:16:45,268 - DEBUG - [Pod ctest-pod-09652715] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:16:45,268 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:16:45,268 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:16:50,320 - DEBUG - [Pod ctest-pod-09652715] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:16:50,320 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:16:50,320 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:16:55,384 - DEBUG - [Pod ctest-pod-09652715] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:16:55,384 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:16:55,384 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:17:00,445 - DEBUG - [Pod ctest-pod-09652715] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:17:00,445 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:17:00,445 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:17:05,504 - DEBUG - [Pod ctest-pod-09652715] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:17:05,504 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:17:05,504 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:17:10,557 - DEBUG - [Pod ctest-pod-09652715] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:17:10,557 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:17:10,557 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:17:15,604 - DEBUG - [Pod ctest-pod-09652715] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:17:15,605 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:17:15,605 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:17:20,660 - DEBUG - [Pod ctest-pod-09652715] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:17:20,660 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:17:20,660 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:17:25,726 - DEBUG - [Pod ctest-pod-09652715] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:17:25,726 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:17:25,726 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:17:30,798 - DEBUG - [Pod ctest-pod-09652715] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:17:30,798 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:17:30,798 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd output: Connecting to 10.106.106.131:80 (10.106.106.131:80) wget: download timed out 2025-06-24 12:17:30,799 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-88669454': 0, 'ctest-pod-59766593': 0} 2025-06-24 12:17:30,854 - DEBUG - [Pod ctest-pod-18639910] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.106.131:80 (10.106.106.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-59766593 2025-06-24 12:17:30,854 - DEBUG - [Pod Pod ctest-pod-18639910] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 passed 2025-06-24 12:17:30,854 - DEBUG - [Pod Pod ctest-pod-18639910] Cmd output: Connecting to 10.106.106.131:80 (10.106.106.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-59766593 2025-06-24 12:17:30,910 - DEBUG - [Pod ctest-pod-18639910] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: ctest-pod-59766593 Connecting to 10.106.106.131:80 (10.106.106.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 12:17:30,910 - DEBUG - [Pod Pod ctest-pod-18639910] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 passed 2025-06-24 12:17:30,910 - DEBUG - [Pod Pod ctest-pod-18639910] Cmd output: ctest-pod-59766593 Connecting to 10.106.106.131:80 (10.106.106.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 12:17:30,946 - DEBUG - [Pod ctest-pod-18639910] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: ctest-pod-59766593 Connecting to 10.106.106.131:80 (10.106.106.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 12:17:30,947 - DEBUG - [Pod Pod ctest-pod-18639910] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 passed 2025-06-24 12:17:30,947 - DEBUG - [Pod Pod ctest-pod-18639910] Cmd output: ctest-pod-59766593 Connecting to 10.106.106.131:80 (10.106.106.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 12:17:30,997 - DEBUG - [Pod ctest-pod-18639910] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.106.131:80 (10.106.106.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-59766593 2025-06-24 12:17:30,997 - DEBUG - [Pod Pod ctest-pod-18639910] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 passed 2025-06-24 12:17:30,997 - DEBUG - [Pod Pod ctest-pod-18639910] Cmd output: Connecting to 10.106.106.131:80 (10.106.106.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-59766593 2025-06-24 12:17:31,051 - DEBUG - [Pod ctest-pod-18639910] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: ctest-pod-88669454 Connecting to 10.106.106.131:80 (10.106.106.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 12:17:31,052 - DEBUG - [Pod Pod ctest-pod-18639910] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 passed 2025-06-24 12:17:31,052 - DEBUG - [Pod Pod ctest-pod-18639910] Cmd output: ctest-pod-88669454 Connecting to 10.106.106.131:80 (10.106.106.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 12:17:31,052 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-88669454': 1, 'ctest-pod-59766593': 4} 2025-06-24 12:17:31,107 - DEBUG - [Pod ctest-pod-99958020] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: ctest-pod-59766593 Connecting to 10.106.106.131:80 (10.106.106.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 12:17:31,107 - DEBUG - [Pod Pod ctest-pod-99958020] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 passed 2025-06-24 12:17:31,107 - DEBUG - [Pod Pod ctest-pod-99958020] Cmd output: ctest-pod-59766593 Connecting to 10.106.106.131:80 (10.106.106.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 12:17:31,168 - DEBUG - [Pod ctest-pod-99958020] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: ctest-pod-59766593 Connecting to 10.106.106.131:80 (10.106.106.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 12:17:31,168 - DEBUG - [Pod Pod ctest-pod-99958020] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 passed 2025-06-24 12:17:31,168 - DEBUG - [Pod Pod ctest-pod-99958020] Cmd output: ctest-pod-59766593 Connecting to 10.106.106.131:80 (10.106.106.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 12:17:31,230 - DEBUG - [Pod ctest-pod-99958020] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: ctest-pod-59766593 Connecting to 10.106.106.131:80 (10.106.106.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 12:17:31,230 - DEBUG - [Pod Pod ctest-pod-99958020] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 passed 2025-06-24 12:17:31,230 - DEBUG - [Pod Pod ctest-pod-99958020] Cmd output: ctest-pod-59766593 Connecting to 10.106.106.131:80 (10.106.106.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 12:17:31,300 - DEBUG - [Pod ctest-pod-99958020] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: ctest-pod-59766593 Connecting to 10.106.106.131:80 (10.106.106.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 12:17:31,300 - DEBUG - [Pod Pod ctest-pod-99958020] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 passed 2025-06-24 12:17:31,300 - DEBUG - [Pod Pod ctest-pod-99958020] Cmd output: ctest-pod-59766593 Connecting to 10.106.106.131:80 (10.106.106.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 12:17:31,354 - DEBUG - [Pod ctest-pod-99958020] Cmd: wget http://10.106.106.131:80/ -O - -T 5 -t 1 , Output: ctest-pod-88669454 Connecting to 10.106.106.131:80 (10.106.106.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 12:17:31,354 - DEBUG - [Pod Pod ctest-pod-99958020] Cmd wget http://10.106.106.131:80/ -O - -T 5 -t 1 passed 2025-06-24 12:17:31,354 - DEBUG - [Pod Pod ctest-pod-99958020] Cmd output: ctest-pod-88669454 Connecting to 10.106.106.131:80 (10.106.106.131:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 12:17:31,354 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-88669454': 1, 'ctest-pod-59766593': 4} 2025-06-24 12:17:33,388 - DEBUG - [Pod ctest-pod-18639910] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.552 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.073 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.080 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.073/0.235/0.552 ms 2025-06-24 12:17:33,389 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-18639910 with expectation True passed 2025-06-24 12:17:35,437 - DEBUG - [Pod ctest-pod-09652715] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.124 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.081 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.079 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.079/0.428/1.124 ms 2025-06-24 12:17:35,437 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-09652715 with expectation True passed 2025-06-24 12:17:37,485 - DEBUG - [Pod ctest-pod-99958020] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.966 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.076 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.118 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.076/0.386/0.966 ms 2025-06-24 12:17:37,485 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-99958020 with expectation True passed 2025-06-24 12:17:37,538 - DEBUG - [Pod ctest-pod-18639910] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-24 12:17:37,539 - DEBUG - [Pod Pod ctest-pod-18639910] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-06-24 12:17:37,539 - DEBUG - [Pod Pod ctest-pod-18639910] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-24 12:17:37,539 - INFO - wget check of of http://10.47.255.251 from ctest-pod-18639910 passed 2025-06-24 12:17:37,598 - DEBUG - [Pod ctest-pod-18639910] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-24 12:17:37,598 - DEBUG - [Pod Pod ctest-pod-18639910] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-06-24 12:17:37,598 - DEBUG - [Pod Pod ctest-pod-18639910] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-24 12:17:37,598 - INFO - wget check of of http://10.47.255.250 from ctest-pod-18639910 passed 2025-06-24 12:17:42,644 - DEBUG - [Pod ctest-pod-09652715] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-24 12:17:42,644 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-24 12:17:42,644 - DEBUG - [Pod Pod ctest-pod-09652715] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-24 12:17:42,644 - INFO - wget check of of http://10.47.255.250 from ctest-pod-09652715 passed 2025-06-24 12:17:42,697 - DEBUG - [Pod ctest-pod-35624164] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-24 12:17:42,697 - DEBUG - [Pod Pod ctest-pod-35624164] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-06-24 12:17:42,697 - DEBUG - [Pod Pod ctest-pod-35624164] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-24 12:17:42,697 - INFO - wget check of of http://10.47.255.251 from ctest-pod-35624164 passed 2025-06-24 12:17:42,697 - INFO - Deleting Network Policy : ingress-on-service 2025-06-24 12:17:42,698 - INFO - Deleting service : ctest-nginx-svc-98221552 2025-06-24 12:17:42,928 - DEBUG - No XMPP flaps were noticed during the test 2025-06-24 12:17:42,928 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:12] 2025-06-24 12:17:42,928 - INFO - -------------------------------------------------------------------------------- 2025-06-24 12:17:42,933 - INFO - Deleting pod ctest-new-default-32380279:ctest-pod-88669454 2025-06-24 12:17:42,933 - INFO - Deleting pod ctest-new-default-32380279:ctest-pod-59766593 2025-06-24 12:17:42,934 - INFO - Deleting pod ctest-non-default-97208383:ctest-pod-39513317 2025-06-24 12:17:42,934 - INFO - Deleting pod ctest-non-default-97208383:ctest-pod-44750437 2025-06-24 12:17:42,934 - INFO - Deleting pod ctest-new-default-32380279:ctest-pod-09652715 2025-06-24 12:17:42,934 - INFO - Deleting pod ctest-new-default-32380279:ctest-pod-18639910 2025-06-24 12:17:42,935 - INFO - Deleting pod ctest-non-default-97208383:ctest-pod-99958020 2025-06-24 12:17:42,935 - INFO - Deleting pod ctest-non-default-97208383:ctest-pod-35624164 2025-06-24 12:17:43,085 - WARNING - Pod uuid 1e529616-fd15-45ff-9079-7562928974d1 is still seen in agent 10.0.0.49 VM list 2025-06-24 12:17:43,087 - WARNING - Pod uuid c990ad20-f77d-4802-a122-f10e457ea183 is still seen in agent 10.0.0.49 VM list 2025-06-24 12:17:43,088 - WARNING - Pod uuid 58d2f33c-07c0-470a-92bb-e35eb05b6afb is still seen in agent 10.0.0.49 VM list 2025-06-24 12:17:43,089 - WARNING - Pod uuid 60aae571-49b6-4d43-b927-53a2ddddc6e4 is still seen in agent 10.0.0.49 VM list 2025-06-24 12:17:43,090 - WARNING - Pod uuid 88820773-ba2a-4cf8-a771-e172f8c3ecb0 is still seen in agent 10.0.0.49 VM list 2025-06-24 12:17:43,093 - WARNING - Pod uuid 7bb813f4-4325-4121-9c89-e58c3712a40e is still seen in agent 10.0.0.49 VM list 2025-06-24 12:17:43,093 - WARNING - Pod uuid 74c7db40-df9f-4b46-bf5b-2430f3acaa27 is still seen in agent 10.0.0.49 VM list 2025-06-24 12:17:43,093 - WARNING - Pod uuid f918e65e-f38a-4446-bc27-2d44420b5a43 is still seen in agent 10.0.0.49 VM list 2025-06-24 12:17:48,101 - DEBUG - Pod 1e529616-fd15-45ff-9079-7562928974d1 is not in agent 10.0.0.49 VM list 2025-06-24 12:17:48,120 - DEBUG - Pod c990ad20-f77d-4802-a122-f10e457ea183 is not in agent 10.0.0.49 VM list 2025-06-24 12:17:48,124 - WARNING - Pod uuid 60aae571-49b6-4d43-b927-53a2ddddc6e4 is still seen in agent 10.0.0.49 VM list 2025-06-24 12:17:48,124 - DEBUG - Pod 58d2f33c-07c0-470a-92bb-e35eb05b6afb is not in agent 10.0.0.49 VM list 2025-06-24 12:17:48,125 - WARNING - Pod uuid 88820773-ba2a-4cf8-a771-e172f8c3ecb0 is still seen in agent 10.0.0.49 VM list 2025-06-24 12:17:48,126 - DEBUG - VMI bc807db8-50f4-11f0-b799-fa163e5d700a is removed from agent 10.0.0.49 2025-06-24 12:17:48,126 - INFO - Verified that pod ctest-pod-59766593 is removed in agent 2025-06-24 12:17:48,126 - DEBUG - Pod f918e65e-f38a-4446-bc27-2d44420b5a43 is not in agent 10.0.0.49 VM list 2025-06-24 12:17:48,127 - WARNING - Pod uuid 74c7db40-df9f-4b46-bf5b-2430f3acaa27 is still seen in agent 10.0.0.49 VM list 2025-06-24 12:17:48,128 - WARNING - Pod uuid 7bb813f4-4325-4121-9c89-e58c3712a40e is still seen in agent 10.0.0.49 VM list 2025-06-24 12:17:48,137 - DEBUG - VMI bd1f4eac-50f4-11f0-b799-fa163e5d700a is removed from agent 10.0.0.49 2025-06-24 12:17:48,137 - INFO - Verified that pod ctest-pod-39513317 is removed in agent 2025-06-24 12:17:48,138 - DEBUG - VMI bd9e6ef8-50f4-11f0-b799-fa163e5d700a is removed from agent 10.0.0.49 2025-06-24 12:17:48,138 - INFO - Verified that pod ctest-pod-44750437 is removed in agent 2025-06-24 12:17:48,140 - DEBUG - VMI bc086fc6-50f4-11f0-b799-fa163e5d700a is removed from agent 10.0.0.49 2025-06-24 12:17:48,140 - INFO - Verified that pod ctest-pod-88669454 is removed in agent 2025-06-24 12:17:53,142 - WARNING - Pod uuid 60aae571-49b6-4d43-b927-53a2ddddc6e4 is still seen in agent 10.0.0.49 VM list 2025-06-24 12:17:53,144 - WARNING - Pod uuid 7bb813f4-4325-4121-9c89-e58c3712a40e is still seen in agent 10.0.0.49 VM list 2025-06-24 12:17:53,144 - WARNING - Pod uuid 74c7db40-df9f-4b46-bf5b-2430f3acaa27 is still seen in agent 10.0.0.49 VM list 2025-06-24 12:17:53,144 - WARNING - Pod uuid 88820773-ba2a-4cf8-a771-e172f8c3ecb0 is still seen in agent 10.0.0.49 VM list 2025-06-24 12:17:58,161 - WARNING - Pod uuid 7bb813f4-4325-4121-9c89-e58c3712a40e is still seen in agent 10.0.0.49 VM list 2025-06-24 12:17:58,162 - WARNING - Pod uuid 60aae571-49b6-4d43-b927-53a2ddddc6e4 is still seen in agent 10.0.0.49 VM list 2025-06-24 12:17:58,163 - WARNING - Pod uuid 88820773-ba2a-4cf8-a771-e172f8c3ecb0 is still seen in agent 10.0.0.49 VM list 2025-06-24 12:17:58,163 - WARNING - Pod uuid 74c7db40-df9f-4b46-bf5b-2430f3acaa27 is still seen in agent 10.0.0.49 VM list 2025-06-24 12:18:03,181 - WARNING - Pod uuid 74c7db40-df9f-4b46-bf5b-2430f3acaa27 is still seen in agent 10.0.0.49 VM list 2025-06-24 12:18:03,182 - WARNING - Pod uuid 7bb813f4-4325-4121-9c89-e58c3712a40e is still seen in agent 10.0.0.49 VM list 2025-06-24 12:18:03,182 - WARNING - Pod uuid 60aae571-49b6-4d43-b927-53a2ddddc6e4 is still seen in agent 10.0.0.49 VM list 2025-06-24 12:18:03,183 - WARNING - Pod uuid 88820773-ba2a-4cf8-a771-e172f8c3ecb0 is still seen in agent 10.0.0.49 VM list 2025-06-24 12:18:08,200 - WARNING - Pod uuid 88820773-ba2a-4cf8-a771-e172f8c3ecb0 is still seen in agent 10.0.0.49 VM list 2025-06-24 12:18:08,201 - WARNING - Pod uuid 74c7db40-df9f-4b46-bf5b-2430f3acaa27 is still seen in agent 10.0.0.49 VM list 2025-06-24 12:18:08,202 - WARNING - Pod uuid 60aae571-49b6-4d43-b927-53a2ddddc6e4 is still seen in agent 10.0.0.49 VM list 2025-06-24 12:18:08,203 - WARNING - Pod uuid 7bb813f4-4325-4121-9c89-e58c3712a40e is still seen in agent 10.0.0.49 VM list 2025-06-24 12:18:13,236 - WARNING - Pod uuid 74c7db40-df9f-4b46-bf5b-2430f3acaa27 is still seen in agent 10.0.0.49 VM list 2025-06-24 12:18:13,237 - WARNING - Pod uuid 88820773-ba2a-4cf8-a771-e172f8c3ecb0 is still seen in agent 10.0.0.49 VM list 2025-06-24 12:18:13,238 - WARNING - Pod uuid 7bb813f4-4325-4121-9c89-e58c3712a40e is still seen in agent 10.0.0.49 VM list 2025-06-24 12:18:13,238 - WARNING - Pod uuid 60aae571-49b6-4d43-b927-53a2ddddc6e4 is still seen in agent 10.0.0.49 VM list 2025-06-24 12:18:18,259 - DEBUG - Pod 88820773-ba2a-4cf8-a771-e172f8c3ecb0 is not in agent 10.0.0.49 VM list 2025-06-24 12:18:18,260 - DEBUG - Pod 7bb813f4-4325-4121-9c89-e58c3712a40e is not in agent 10.0.0.49 VM list 2025-06-24 12:18:18,263 - DEBUG - Pod 60aae571-49b6-4d43-b927-53a2ddddc6e4 is not in agent 10.0.0.49 VM list 2025-06-24 12:18:18,265 - DEBUG - Pod 74c7db40-df9f-4b46-bf5b-2430f3acaa27 is not in agent 10.0.0.49 VM list 2025-06-24 12:18:18,278 - DEBUG - VMI bf9938aa-50f4-11f0-b799-fa163e5d700a is removed from agent 10.0.0.49 2025-06-24 12:18:18,278 - INFO - Verified that pod ctest-pod-35624164 is removed in agent 2025-06-24 12:18:18,282 - DEBUG - VMI be1b88b6-50f4-11f0-b799-fa163e5d700a is removed from agent 10.0.0.49 2025-06-24 12:18:18,282 - INFO - Verified that pod ctest-pod-09652715 is removed in agent 2025-06-24 12:18:18,282 - DEBUG - VMI be950a10-50f4-11f0-b799-fa163e5d700a is removed from agent 10.0.0.49 2025-06-24 12:18:18,283 - INFO - Verified that pod ctest-pod-18639910 is removed in agent 2025-06-24 12:18:18,283 - DEBUG - VMI bf0cf8a4-50f4-11f0-b799-fa163e5d700a is removed from agent 10.0.0.49 2025-06-24 12:18:18,283 - INFO - Verified that pod ctest-pod-99958020 is removed in agent 2025-06-24 12:18:18,284 - INFO - Deleting namespace ctest-non-default-97208383 2025-06-24 12:18:18,304 - DEBUG - Namespace ctest-non-default-97208383 still in k8s 2025-06-24 12:18:20,309 - DEBUG - Namespace ctest-non-default-97208383 still in k8s 2025-06-24 12:18:22,313 - DEBUG - Namespace ctest-non-default-97208383 still in k8s 2025-06-24 12:18:24,317 - DEBUG - Namespace ctest-non-default-97208383 is not in k8s 2025-06-24 12:18:24,317 - DEBUG - No need to check project deletion in contrail-api 2025-06-24 12:18:24,317 - INFO - Deleting namespace ctest-new-default-32380279 2025-06-24 12:18:24,327 - DEBUG - Namespace ctest-new-default-32380279 still in k8s 2025-06-24 12:18:26,331 - DEBUG - Namespace ctest-new-default-32380279 still in k8s 2025-06-24 12:18:28,336 - DEBUG - Namespace ctest-new-default-32380279 still in k8s 2025-06-24 12:18:30,341 - DEBUG - Namespace ctest-new-default-32380279 is not in k8s 2025-06-24 12:18:30,341 - DEBUG - No need to check project deletion in contrail-api