2025-06-30 02:08:36,152 - INFO - Using existing project ['default-domain', 'k8s-default'](106ac394-ba7d-43e6-8e26-a9af5df61cf2) 2025-06-30 02:08:36,174 - DEBUG - Namespace ctest-new-default-85987131 not present 2025-06-30 02:08:36,182 - INFO - Created namespace ctest-new-default-85987131 2025-06-30 02:08:39,186 - DEBUG - Namespace ctest-non-default-41594961 not present 2025-06-30 02:08:39,206 - INFO - Created namespace ctest-non-default-41594961 2025-06-30 02:08:42,234 - DEBUG - Pod ctest-pod-81821831 not present 2025-06-30 02:08:42,235 - INFO - Creating Pod ctest-pod-81821831 2025-06-30 02:08:42,271 - DEBUG - Pod : ctest-pod-81821831 UUID is f2ef6a42-af44-4ba5-9742-477734c02be8 2025-06-30 02:08:42,275 - DEBUG - Pod ctest-pod-88899583 not present 2025-06-30 02:08:42,277 - INFO - Creating Pod ctest-pod-88899583 2025-06-30 02:08:42,322 - DEBUG - Pod : ctest-pod-88899583 UUID is dcf6e0d9-7885-4235-96e2-d6e82efc7885 2025-06-30 02:08:42,325 - DEBUG - Pod ctest-pod-22725606 not present 2025-06-30 02:08:42,325 - INFO - Creating Pod ctest-pod-22725606 2025-06-30 02:08:42,391 - DEBUG - Pod : ctest-pod-22725606 UUID is 0ffbddee-aeff-4a97-ab81-3836cea23236 2025-06-30 02:08:42,400 - DEBUG - Pod ctest-pod-41447956 not present 2025-06-30 02:08:42,400 - INFO - Creating Pod ctest-pod-41447956 2025-06-30 02:08:42,436 - DEBUG - Pod : ctest-pod-41447956 UUID is b06d3166-e770-4978-a684-bd50863026fc 2025-06-30 02:08:42,439 - DEBUG - Pod ctest-pod-78394592 not present 2025-06-30 02:08:42,439 - INFO - Creating Pod ctest-pod-78394592 2025-06-30 02:08:42,529 - DEBUG - Pod : ctest-pod-78394592 UUID is faecec0f-957c-40f3-9d3b-7e7993ca3938 2025-06-30 02:08:42,619 - DEBUG - Pod ctest-pod-37463010 not present 2025-06-30 02:08:42,619 - INFO - Creating Pod ctest-pod-37463010 2025-06-30 02:08:42,690 - DEBUG - Pod : ctest-pod-37463010 UUID is e3a2b0c1-b158-4c2b-b096-4061b3d15c5e 2025-06-30 02:08:42,693 - DEBUG - Pod ctest-pod-23287468 not present 2025-06-30 02:08:42,693 - INFO - Creating Pod ctest-pod-23287468 2025-06-30 02:08:42,727 - DEBUG - Pod : ctest-pod-23287468 UUID is 88030fbd-ffe0-4983-b5de-c7ec41753424 2025-06-30 02:08:42,730 - DEBUG - Pod ctest-pod-89495921 not present 2025-06-30 02:08:42,730 - INFO - Creating Pod ctest-pod-89495921 2025-06-30 02:08:42,761 - DEBUG - Pod : ctest-pod-89495921 UUID is 39b6e23b-55cc-4872-a3fc-5da4da758675 2025-06-30 02:08:43,097 - INFO - Project default-domain:k8s-ctest-new-default-85987131 for Namespace ctest-new-default-85987131 is seen in contrail-api 2025-06-30 02:08:43,097 - DEBUG - Project uuid in Contrail is 61be3b33-4df1-4a2a-874c-10501e0fa193 2025-06-30 02:08:43,322 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_NamespaceDatabaseList?namespace_uuid=206cf0b8-5450-436b-9440-7421aa83fb00 2025-06-30 02:08:43,338 - INFO - Namespace ctest-new-default-85987131 with uuid 206cf0b8-5450-436b-9440-7421aa83fb00 found in kube manager 2025-06-30 02:08:43,338 - INFO - Namespace ctest-new-default-85987131 verification passed 2025-06-30 02:08:43,555 - INFO - Project default-domain:k8s-ctest-non-default-41594961 for Namespace ctest-non-default-41594961 is seen in contrail-api 2025-06-30 02:08:43,555 - DEBUG - Project uuid in Contrail is 9dadb13a-a266-4530-aaed-c8f745ab22cf 2025-06-30 02:08:43,555 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_NamespaceDatabaseList?namespace_uuid=f2cee71d-1607-4568-8d95-366983633b88 2025-06-30 02:08:43,562 - INFO - Namespace ctest-non-default-41594961 with uuid f2cee71d-1607-4568-8d95-366983633b88 found in kube manager 2025-06-30 02:08:43,563 - INFO - Namespace ctest-non-default-41594961 verification passed 2025-06-30 02:08:43,572 - DEBUG - Pod ctest-pod-81821831 not in running state.Currently in Pending 2025-06-30 02:08:48,578 - DEBUG - Pod ctest-pod-81821831 not in running state.Currently in Pending 2025-06-30 02:08:53,586 - DEBUG - Pod ctest-pod-81821831 not in running state.Currently in Pending 2025-06-30 02:08:58,593 - INFO - Pod ctest-pod-81821831 is in running state.Got IP 10.47.255.251 2025-06-30 02:08:58,648 - DEBUG - Pod ctest-pod-81821831 has vmi 26905ed8-5557-11f0-a992-fa163e9c9436 2025-06-30 02:08:58,648 - INFO - Verified pod ctest-pod-81821831 in contrail-api 2025-06-30 02:08:58,664 - DEBUG - VMI 26905ed8-5557-11f0-a992-fa163e9c9436 is active in agent 10.0.0.33 2025-06-30 02:08:58,664 - INFO - Verified Pod ctest-pod-81821831 in agent 10.0.0.33 2025-06-30 02:08:58,664 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=f2ef6a42-af44-4ba5-9742-477734c02be8 2025-06-30 02:08:58,669 - INFO - Pod ctest-pod-81821831 with uuid f2ef6a42-af44-4ba5-9742-477734c02be8 found in kube manager 2025-06-30 02:08:58,670 - INFO - Pod ctest-pod-81821831 verification passed 2025-06-30 02:08:58,675 - INFO - Pod ctest-pod-88899583 is in running state.Got IP 10.47.255.250 2025-06-30 02:08:58,695 - DEBUG - Pod ctest-pod-88899583 has vmi 2713294e-5557-11f0-a992-fa163e9c9436 2025-06-30 02:08:58,695 - INFO - Verified pod ctest-pod-88899583 in contrail-api 2025-06-30 02:08:58,710 - DEBUG - VMI 2713294e-5557-11f0-a992-fa163e9c9436 is active in agent 10.0.0.33 2025-06-30 02:08:58,711 - INFO - Verified Pod ctest-pod-88899583 in agent 10.0.0.33 2025-06-30 02:08:58,711 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=dcf6e0d9-7885-4235-96e2-d6e82efc7885 2025-06-30 02:08:58,716 - INFO - Pod ctest-pod-88899583 with uuid dcf6e0d9-7885-4235-96e2-d6e82efc7885 found in kube manager 2025-06-30 02:08:58,717 - INFO - Pod ctest-pod-88899583 verification passed 2025-06-30 02:08:58,723 - INFO - Pod ctest-pod-22725606 is in running state.Got IP 10.47.255.249 2025-06-30 02:08:58,780 - DEBUG - Pod ctest-pod-22725606 has vmi 27e3a434-5557-11f0-a992-fa163e9c9436 2025-06-30 02:08:58,781 - INFO - Verified pod ctest-pod-22725606 in contrail-api 2025-06-30 02:08:58,796 - DEBUG - VMI 27e3a434-5557-11f0-a992-fa163e9c9436 is active in agent 10.0.0.33 2025-06-30 02:08:58,796 - INFO - Verified Pod ctest-pod-22725606 in agent 10.0.0.33 2025-06-30 02:08:58,796 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=0ffbddee-aeff-4a97-ab81-3836cea23236 2025-06-30 02:08:58,802 - INFO - Pod ctest-pod-22725606 with uuid 0ffbddee-aeff-4a97-ab81-3836cea23236 found in kube manager 2025-06-30 02:08:58,802 - INFO - Pod ctest-pod-22725606 verification passed 2025-06-30 02:08:58,807 - INFO - Pod ctest-pod-41447956 is in running state.Got IP 10.47.255.248 2025-06-30 02:08:58,864 - DEBUG - Pod ctest-pod-41447956 has vmi 287198fc-5557-11f0-a992-fa163e9c9436 2025-06-30 02:08:58,864 - INFO - Verified pod ctest-pod-41447956 in contrail-api 2025-06-30 02:08:58,879 - DEBUG - VMI 287198fc-5557-11f0-a992-fa163e9c9436 is active in agent 10.0.0.33 2025-06-30 02:08:58,879 - INFO - Verified Pod ctest-pod-41447956 in agent 10.0.0.33 2025-06-30 02:08:58,880 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=b06d3166-e770-4978-a684-bd50863026fc 2025-06-30 02:08:58,885 - INFO - Pod ctest-pod-41447956 with uuid b06d3166-e770-4978-a684-bd50863026fc found in kube manager 2025-06-30 02:08:58,885 - INFO - Pod ctest-pod-41447956 verification passed 2025-06-30 02:08:58,890 - INFO - Pod ctest-pod-78394592 is in running state.Got IP 10.47.255.247 2025-06-30 02:08:58,905 - DEBUG - Pod ctest-pod-78394592 has vmi 290cd4b6-5557-11f0-a992-fa163e9c9436 2025-06-30 02:08:58,906 - INFO - Verified pod ctest-pod-78394592 in contrail-api 2025-06-30 02:08:58,919 - DEBUG - VMI 290cd4b6-5557-11f0-a992-fa163e9c9436 is active in agent 10.0.0.33 2025-06-30 02:08:58,919 - INFO - Verified Pod ctest-pod-78394592 in agent 10.0.0.33 2025-06-30 02:08:58,920 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=faecec0f-957c-40f3-9d3b-7e7993ca3938 2025-06-30 02:08:58,924 - INFO - Pod ctest-pod-78394592 with uuid faecec0f-957c-40f3-9d3b-7e7993ca3938 found in kube manager 2025-06-30 02:08:58,925 - INFO - Pod ctest-pod-78394592 verification passed 2025-06-30 02:08:58,931 - INFO - Pod ctest-pod-23287468 is in running state.Got IP 10.47.255.245 2025-06-30 02:08:58,988 - DEBUG - Pod ctest-pod-23287468 has vmi 29ffafd8-5557-11f0-a992-fa163e9c9436 2025-06-30 02:08:58,988 - INFO - Verified pod ctest-pod-23287468 in contrail-api 2025-06-30 02:08:59,001 - DEBUG - VMI 29ffafd8-5557-11f0-a992-fa163e9c9436 is active in agent 10.0.0.33 2025-06-30 02:08:59,002 - INFO - Verified Pod ctest-pod-23287468 in agent 10.0.0.33 2025-06-30 02:08:59,002 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=88030fbd-ffe0-4983-b5de-c7ec41753424 2025-06-30 02:08:59,008 - INFO - Pod ctest-pod-23287468 with uuid 88030fbd-ffe0-4983-b5de-c7ec41753424 found in kube manager 2025-06-30 02:08:59,008 - INFO - Pod ctest-pod-23287468 verification passed 2025-06-30 02:08:59,014 - INFO - Pod ctest-pod-37463010 is in running state.Got IP 10.47.255.246 2025-06-30 02:08:59,072 - DEBUG - Pod ctest-pod-37463010 has vmi 2984568a-5557-11f0-a992-fa163e9c9436 2025-06-30 02:08:59,072 - INFO - Verified pod ctest-pod-37463010 in contrail-api 2025-06-30 02:08:59,086 - DEBUG - VMI 2984568a-5557-11f0-a992-fa163e9c9436 is active in agent 10.0.0.33 2025-06-30 02:08:59,087 - INFO - Verified Pod ctest-pod-37463010 in agent 10.0.0.33 2025-06-30 02:08:59,087 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=e3a2b0c1-b158-4c2b-b096-4061b3d15c5e 2025-06-30 02:08:59,091 - INFO - Pod ctest-pod-37463010 with uuid e3a2b0c1-b158-4c2b-b096-4061b3d15c5e found in kube manager 2025-06-30 02:08:59,091 - INFO - Pod ctest-pod-37463010 verification passed 2025-06-30 02:08:59,096 - DEBUG - Pod ctest-pod-89495921 not in running state.Currently in Pending 2025-06-30 02:09:04,103 - INFO - Pod ctest-pod-89495921 is in running state.Got IP 10.47.255.244 2025-06-30 02:09:04,119 - DEBUG - Pod ctest-pod-89495921 has vmi 2a7a5c9c-5557-11f0-a992-fa163e9c9436 2025-06-30 02:09:04,119 - INFO - Verified pod ctest-pod-89495921 in contrail-api 2025-06-30 02:09:04,132 - DEBUG - VMI 2a7a5c9c-5557-11f0-a992-fa163e9c9436 is active in agent 10.0.0.33 2025-06-30 02:09:04,132 - INFO - Verified Pod ctest-pod-89495921 in agent 10.0.0.33 2025-06-30 02:09:04,132 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=39b6e23b-55cc-4872-a3fc-5da4da758675 2025-06-30 02:09:04,137 - INFO - Pod ctest-pod-89495921 with uuid 39b6e23b-55cc-4872-a3fc-5da4da758675 found in kube manager 2025-06-30 02:09:04,137 - INFO - Pod ctest-pod-89495921 verification passed 2025-06-30 02:09:04,137 - INFO - ================================================================================ 2025-06-30 02:09:04,137 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-06-30 02:09:04,137 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-06-30 02:09:04,359 - DEBUG - Nothing to compare xmpp stats {'10.0.0.33': {'10.0.0.57': '0'}} with 2025-06-30 02:09:04,359 - INFO - Initial checks done. Running the testcase now 2025-06-30 02:09:04,359 - INFO - 2025-06-30 02:09:04,415 - DEBUG - [Pod ctest-pod-81821831] Cmd: echo ctest-pod-81821831 > /usr/share/nginx/html/index.html, Output: 2025-06-30 02:09:04,471 - DEBUG - [Pod ctest-pod-88899583] Cmd: echo ctest-pod-88899583 > /usr/share/nginx/html/index.html, Output: 2025-06-30 02:09:04,526 - DEBUG - [Pod ctest-pod-22725606] Cmd: echo ctest-pod-22725606 > /usr/share/nginx/html/index.html, Output: 2025-06-30 02:09:04,587 - DEBUG - [Pod ctest-pod-41447956] Cmd: echo ctest-pod-41447956 > /usr/share/nginx/html/index.html, Output: 2025-06-30 02:09:04,590 - DEBUG - Service ctest-nginx-svc-74500518 not present 2025-06-30 02:09:04,591 - INFO - Creating service ctest-nginx-svc-74500518 2025-06-30 02:09:04,607 - INFO - Created Service ctest-nginx-svc-74500518 2025-06-30 02:09:04,624 - WARNING - Service UUID da9af362-b004-4538-9072-de7e7b66198a not yet found in contrail-api 2025-06-30 02:09:05,632 - INFO - Validated that Service ctest-nginx-svc-74500518 is seen in contrail-api 2025-06-30 02:09:05,632 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_LoadbalancerDatabaseList?x=da9af362-b004-4538-9072-de7e7b66198a 2025-06-30 02:09:05,639 - INFO - Service ctest-nginx-svc-74500518 with uuid da9af362-b004-4538-9072-de7e7b66198a found in kube manager 2025-06-30 02:09:05,639 - INFO - Service ctest-nginx-svc-74500518 verification passed 2025-06-30 02:09:06,707 - DEBUG - [Pod ctest-pod-78394592] Cmd: wget http://10.99.135.77:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.135.77:80 (10.99.135.77:80) ctest-pod-88899583 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 02:09:06,707 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd wget http://10.99.135.77:80/ -O - -T 5 -t 1 passed 2025-06-30 02:09:06,707 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd output: Connecting to 10.99.135.77:80 (10.99.135.77:80) ctest-pod-88899583 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 02:09:06,760 - DEBUG - [Pod ctest-pod-78394592] Cmd: wget http://10.99.135.77:80/ -O - -T 5 -t 1 , Output: ctest-pod-88899583 Connecting to 10.99.135.77:80 (10.99.135.77:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 02:09:06,760 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd wget http://10.99.135.77:80/ -O - -T 5 -t 1 passed 2025-06-30 02:09:06,760 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd output: ctest-pod-88899583 Connecting to 10.99.135.77:80 (10.99.135.77:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 02:09:06,810 - DEBUG - [Pod ctest-pod-78394592] Cmd: wget http://10.99.135.77:80/ -O - -T 5 -t 1 , Output: ctest-pod-81821831 Connecting to 10.99.135.77:80 (10.99.135.77:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 02:09:06,810 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd wget http://10.99.135.77:80/ -O - -T 5 -t 1 passed 2025-06-30 02:09:06,810 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd output: ctest-pod-81821831 Connecting to 10.99.135.77:80 (10.99.135.77:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 02:09:06,810 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-81821831': 1, 'ctest-pod-88899583': 2} 2025-06-30 02:09:06,873 - DEBUG - [Pod ctest-pod-23287468] Cmd: wget http://10.99.135.77:80/ -O - -T 5 -t 1 , Output: ctest-pod-81821831 Connecting to 10.99.135.77:80 (10.99.135.77:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 02:09:06,873 - DEBUG - [Pod Pod ctest-pod-23287468] Cmd wget http://10.99.135.77:80/ -O - -T 5 -t 1 passed 2025-06-30 02:09:06,873 - DEBUG - [Pod Pod ctest-pod-23287468] Cmd output: ctest-pod-81821831 Connecting to 10.99.135.77:80 (10.99.135.77:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 02:09:06,932 - DEBUG - [Pod ctest-pod-23287468] Cmd: wget http://10.99.135.77:80/ -O - -T 5 -t 1 , Output: ctest-pod-81821831 Connecting to 10.99.135.77:80 (10.99.135.77:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 02:09:06,932 - DEBUG - [Pod Pod ctest-pod-23287468] Cmd wget http://10.99.135.77:80/ -O - -T 5 -t 1 passed 2025-06-30 02:09:06,932 - DEBUG - [Pod Pod ctest-pod-23287468] Cmd output: ctest-pod-81821831 Connecting to 10.99.135.77:80 (10.99.135.77:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 02:09:07,060 - DEBUG - [Pod ctest-pod-23287468] Cmd: wget http://10.99.135.77:80/ -O - -T 5 -t 1 , Output: ctest-pod-88899583 Connecting to 10.99.135.77:80 (10.99.135.77:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 02:09:07,060 - DEBUG - [Pod Pod ctest-pod-23287468] Cmd wget http://10.99.135.77:80/ -O - -T 5 -t 1 passed 2025-06-30 02:09:07,060 - DEBUG - [Pod Pod ctest-pod-23287468] Cmd output: ctest-pod-88899583 Connecting to 10.99.135.77:80 (10.99.135.77:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 02:09:07,060 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-81821831': 2, 'ctest-pod-88899583': 1} 2025-06-30 02:09:07,064 - DEBUG - Network policy ingress-on-service not present 2025-06-30 02:09:07,064 - INFO - Creating Network Policy ingress-on-service 2025-06-30 02:09:07,081 - INFO - Network policy found in k8s 2025-06-30 02:09:07,081 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=7398fe5f-974f-4918-8744-73f63eaa60e9 2025-06-30 02:09:07,091 - INFO - Network Policy ingress-on-service with uuid 7398fe5f-974f-4918-8744-73f63eaa60e9 found in kube manager 2025-06-30 02:09:07,130 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-06-30 02:09:07,130 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-06-30 02:09:07,130 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=7398fe5f-974f-4918-8744-73f63eaa60e9 2025-06-30 02:09:07,170 - WARNING - Network policy with name ingress-on-service not found in agent 2025-06-30 02:09:09,172 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=7398fe5f-974f-4918-8744-73f63eaa60e9 2025-06-30 02:09:09,210 - INFO - Network policy with name ingress-on-service found in agent 2025-06-30 02:09:09,210 - INFO - Network Policy ingress-on-service verification passed 2025-06-30 02:09:14,271 - DEBUG - [Pod ctest-pod-78394592] Cmd: wget http://10.99.135.77:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:09:14,271 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd wget http://10.99.135.77:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:09:14,271 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:09:19,324 - DEBUG - [Pod ctest-pod-78394592] Cmd: wget http://10.99.135.77:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:09:19,324 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd wget http://10.99.135.77:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:09:19,324 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:09:24,375 - DEBUG - [Pod ctest-pod-78394592] Cmd: wget http://10.99.135.77:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:09:24,375 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd wget http://10.99.135.77:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:09:24,375 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:09:29,431 - DEBUG - [Pod ctest-pod-78394592] Cmd: wget http://10.99.135.77:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:09:29,431 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd wget http://10.99.135.77:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:09:29,431 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:09:34,489 - DEBUG - [Pod ctest-pod-78394592] Cmd: wget http://10.99.135.77:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:09:34,489 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd wget http://10.99.135.77:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:09:34,489 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:09:39,548 - DEBUG - [Pod ctest-pod-78394592] Cmd: wget http://10.99.135.77:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:09:39,548 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd wget http://10.99.135.77:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:09:39,548 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:09:44,600 - DEBUG - [Pod ctest-pod-78394592] Cmd: wget http://10.99.135.77:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:09:44,600 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd wget http://10.99.135.77:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:09:44,600 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:09:49,650 - DEBUG - [Pod ctest-pod-78394592] Cmd: wget http://10.99.135.77:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:09:49,651 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd wget http://10.99.135.77:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:09:49,651 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:09:54,711 - DEBUG - [Pod ctest-pod-78394592] Cmd: wget http://10.99.135.77:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:09:54,712 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd wget http://10.99.135.77:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:09:54,712 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:09:59,759 - DEBUG - [Pod ctest-pod-78394592] Cmd: wget http://10.99.135.77:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:09:59,759 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd wget http://10.99.135.77:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:09:59,759 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:09:59,759 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-81821831': 0, 'ctest-pod-88899583': 0} 2025-06-30 02:09:59,835 - DEBUG - [Pod ctest-pod-37463010] Cmd: wget http://10.99.135.77:80/ -O - -T 5 -t 1 , Output: ctest-pod-88899583 Connecting to 10.99.135.77:80 (10.99.135.77:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 02:09:59,836 - DEBUG - [Pod Pod ctest-pod-37463010] Cmd wget http://10.99.135.77:80/ -O - -T 5 -t 1 passed 2025-06-30 02:09:59,836 - DEBUG - [Pod Pod ctest-pod-37463010] Cmd output: ctest-pod-88899583 Connecting to 10.99.135.77:80 (10.99.135.77:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 02:09:59,900 - DEBUG - [Pod ctest-pod-37463010] Cmd: wget http://10.99.135.77:80/ -O - -T 5 -t 1 , Output: ctest-pod-88899583 Connecting to 10.99.135.77:80 (10.99.135.77:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 02:09:59,900 - DEBUG - [Pod Pod ctest-pod-37463010] Cmd wget http://10.99.135.77:80/ -O - -T 5 -t 1 passed 2025-06-30 02:09:59,900 - DEBUG - [Pod Pod ctest-pod-37463010] Cmd output: ctest-pod-88899583 Connecting to 10.99.135.77:80 (10.99.135.77:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 02:09:59,939 - WARNING - ApiException is caught (0) Reason: Handshake status 500 Internal Server Error . Retrying... 2025-06-30 02:10:05,011 - DEBUG - [Pod ctest-pod-37463010] Cmd: wget http://10.99.135.77:80/ -O - -T 5 -t 1 , Output: ctest-pod-88899583 Connecting to 10.99.135.77:80 (10.99.135.77:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 02:10:05,011 - DEBUG - [Pod Pod ctest-pod-37463010] Cmd wget http://10.99.135.77:80/ -O - -T 5 -t 1 passed 2025-06-30 02:10:05,011 - DEBUG - [Pod Pod ctest-pod-37463010] Cmd output: ctest-pod-88899583 Connecting to 10.99.135.77:80 (10.99.135.77:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 02:10:05,069 - DEBUG - [Pod ctest-pod-37463010] Cmd: wget http://10.99.135.77:80/ -O - -T 5 -t 1 , Output: ctest-pod-81821831 Connecting to 10.99.135.77:80 (10.99.135.77:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 02:10:05,069 - DEBUG - [Pod Pod ctest-pod-37463010] Cmd wget http://10.99.135.77:80/ -O - -T 5 -t 1 passed 2025-06-30 02:10:05,069 - DEBUG - [Pod Pod ctest-pod-37463010] Cmd output: ctest-pod-81821831 Connecting to 10.99.135.77:80 (10.99.135.77:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 02:10:05,069 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-81821831': 1, 'ctest-pod-88899583': 3} 2025-06-30 02:10:10,120 - DEBUG - [Pod ctest-pod-23287468] Cmd: wget http://10.99.135.77:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:10:10,120 - DEBUG - [Pod Pod ctest-pod-23287468] Cmd wget http://10.99.135.77:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:10:10,120 - DEBUG - [Pod Pod ctest-pod-23287468] Cmd output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:10:15,177 - DEBUG - [Pod ctest-pod-23287468] Cmd: wget http://10.99.135.77:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:10:15,177 - DEBUG - [Pod Pod ctest-pod-23287468] Cmd wget http://10.99.135.77:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:10:15,177 - DEBUG - [Pod Pod ctest-pod-23287468] Cmd output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:10:20,255 - DEBUG - [Pod ctest-pod-23287468] Cmd: wget http://10.99.135.77:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:10:20,255 - DEBUG - [Pod Pod ctest-pod-23287468] Cmd wget http://10.99.135.77:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:10:20,255 - DEBUG - [Pod Pod ctest-pod-23287468] Cmd output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:10:25,311 - DEBUG - [Pod ctest-pod-23287468] Cmd: wget http://10.99.135.77:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:10:25,312 - DEBUG - [Pod Pod ctest-pod-23287468] Cmd wget http://10.99.135.77:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:10:25,312 - DEBUG - [Pod Pod ctest-pod-23287468] Cmd output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:10:30,367 - DEBUG - [Pod ctest-pod-23287468] Cmd: wget http://10.99.135.77:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:10:30,367 - DEBUG - [Pod Pod ctest-pod-23287468] Cmd wget http://10.99.135.77:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:10:30,367 - DEBUG - [Pod Pod ctest-pod-23287468] Cmd output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:10:35,420 - DEBUG - [Pod ctest-pod-23287468] Cmd: wget http://10.99.135.77:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:10:35,420 - DEBUG - [Pod Pod ctest-pod-23287468] Cmd wget http://10.99.135.77:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:10:35,420 - DEBUG - [Pod Pod ctest-pod-23287468] Cmd output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:10:40,483 - DEBUG - [Pod ctest-pod-23287468] Cmd: wget http://10.99.135.77:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:10:40,483 - DEBUG - [Pod Pod ctest-pod-23287468] Cmd wget http://10.99.135.77:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:10:40,483 - DEBUG - [Pod Pod ctest-pod-23287468] Cmd output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:10:45,535 - DEBUG - [Pod ctest-pod-23287468] Cmd: wget http://10.99.135.77:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:10:45,535 - DEBUG - [Pod Pod ctest-pod-23287468] Cmd wget http://10.99.135.77:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:10:45,535 - DEBUG - [Pod Pod ctest-pod-23287468] Cmd output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:10:50,587 - DEBUG - [Pod ctest-pod-23287468] Cmd: wget http://10.99.135.77:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:10:50,587 - DEBUG - [Pod Pod ctest-pod-23287468] Cmd wget http://10.99.135.77:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:10:50,587 - DEBUG - [Pod Pod ctest-pod-23287468] Cmd output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:10:55,640 - DEBUG - [Pod ctest-pod-23287468] Cmd: wget http://10.99.135.77:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:10:55,640 - DEBUG - [Pod Pod ctest-pod-23287468] Cmd wget http://10.99.135.77:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:10:55,640 - DEBUG - [Pod Pod ctest-pod-23287468] Cmd output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:10:55,640 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-81821831': 0, 'ctest-pod-88899583': 0} 2025-06-30 02:10:57,692 - DEBUG - [Pod ctest-pod-37463010] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.420 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.099 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.085 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.085/0.201/0.420 ms 2025-06-30 02:10:57,693 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-37463010 with expectation True passed 2025-06-30 02:10:59,744 - DEBUG - [Pod ctest-pod-78394592] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.977 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.106 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.089 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.089/0.390/0.977 ms 2025-06-30 02:10:59,744 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-78394592 with expectation True passed 2025-06-30 02:11:01,796 - DEBUG - [Pod ctest-pod-23287468] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.025 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.100 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.101 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.100/0.408/1.025 ms 2025-06-30 02:11:01,796 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-23287468 with expectation True passed 2025-06-30 02:11:01,853 - DEBUG - [Pod ctest-pod-37463010] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-30 02:11:01,853 - DEBUG - [Pod Pod ctest-pod-37463010] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-06-30 02:11:01,853 - DEBUG - [Pod Pod ctest-pod-37463010] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-30 02:11:01,853 - INFO - wget check of of http://10.47.255.251 from ctest-pod-37463010 passed 2025-06-30 02:11:01,910 - DEBUG - [Pod ctest-pod-37463010] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-30 02:11:01,910 - DEBUG - [Pod Pod ctest-pod-37463010] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-06-30 02:11:01,910 - DEBUG - [Pod Pod ctest-pod-37463010] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-30 02:11:01,910 - INFO - wget check of of http://10.47.255.250 from ctest-pod-37463010 passed 2025-06-30 02:11:06,963 - DEBUG - [Pod ctest-pod-78394592] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-30 02:11:06,963 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-30 02:11:06,963 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-30 02:11:06,963 - INFO - wget check of of http://10.47.255.250 from ctest-pod-78394592 passed 2025-06-30 02:11:12,034 - DEBUG - [Pod ctest-pod-89495921] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-06-30 02:11:12,034 - DEBUG - [Pod Pod ctest-pod-89495921] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-06-30 02:11:12,034 - DEBUG - [Pod Pod ctest-pod-89495921] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-06-30 02:11:12,034 - INFO - wget check of of http://10.47.255.251 from ctest-pod-89495921 passed 2025-06-30 02:11:12,053 - INFO - Updating Network Policy ingress-on-service 2025-06-30 02:11:17,132 - DEBUG - [Pod ctest-pod-78394592] Cmd: wget http://10.99.135.77:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:11:17,132 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd wget http://10.99.135.77:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:11:17,132 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:11:22,200 - DEBUG - [Pod ctest-pod-78394592] Cmd: wget http://10.99.135.77:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:11:22,201 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd wget http://10.99.135.77:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:11:22,201 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:11:27,251 - DEBUG - [Pod ctest-pod-78394592] Cmd: wget http://10.99.135.77:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:11:27,251 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd wget http://10.99.135.77:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:11:27,251 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:11:32,303 - DEBUG - [Pod ctest-pod-78394592] Cmd: wget http://10.99.135.77:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:11:32,303 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd wget http://10.99.135.77:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:11:32,303 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:11:37,360 - DEBUG - [Pod ctest-pod-78394592] Cmd: wget http://10.99.135.77:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:11:37,360 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd wget http://10.99.135.77:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:11:37,360 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:11:42,415 - DEBUG - [Pod ctest-pod-78394592] Cmd: wget http://10.99.135.77:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:11:42,415 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd wget http://10.99.135.77:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:11:42,415 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:11:47,468 - DEBUG - [Pod ctest-pod-78394592] Cmd: wget http://10.99.135.77:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:11:47,468 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd wget http://10.99.135.77:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:11:47,468 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:11:52,527 - DEBUG - [Pod ctest-pod-78394592] Cmd: wget http://10.99.135.77:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:11:52,527 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd wget http://10.99.135.77:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:11:52,527 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:11:57,596 - DEBUG - [Pod ctest-pod-78394592] Cmd: wget http://10.99.135.77:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:11:57,596 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd wget http://10.99.135.77:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:11:57,596 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:12:02,647 - DEBUG - [Pod ctest-pod-78394592] Cmd: wget http://10.99.135.77:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:12:02,647 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd wget http://10.99.135.77:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:12:02,648 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd output: Connecting to 10.99.135.77:80 (10.99.135.77:80) wget: download timed out 2025-06-30 02:12:02,648 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-81821831': 0, 'ctest-pod-88899583': 0} 2025-06-30 02:12:02,709 - DEBUG - [Pod ctest-pod-37463010] Cmd: wget http://10.99.135.77:80/ -O - -T 5 -t 1 , Output: ctest-pod-88899583 Connecting to 10.99.135.77:80 (10.99.135.77:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 02:12:02,709 - DEBUG - [Pod Pod ctest-pod-37463010] Cmd wget http://10.99.135.77:80/ -O - -T 5 -t 1 passed 2025-06-30 02:12:02,709 - DEBUG - [Pod Pod ctest-pod-37463010] Cmd output: ctest-pod-88899583 Connecting to 10.99.135.77:80 (10.99.135.77:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 02:12:02,761 - DEBUG - [Pod ctest-pod-37463010] Cmd: wget http://10.99.135.77:80/ -O - -T 5 -t 1 , Output: ctest-pod-81821831 Connecting to 10.99.135.77:80 (10.99.135.77:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 02:12:02,761 - DEBUG - [Pod Pod ctest-pod-37463010] Cmd wget http://10.99.135.77:80/ -O - -T 5 -t 1 passed 2025-06-30 02:12:02,761 - DEBUG - [Pod Pod ctest-pod-37463010] Cmd output: ctest-pod-81821831 Connecting to 10.99.135.77:80 (10.99.135.77:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 02:12:02,762 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-81821831': 1, 'ctest-pod-88899583': 1} 2025-06-30 02:12:02,816 - DEBUG - [Pod ctest-pod-23287468] Cmd: wget http://10.99.135.77:80/ -O - -T 5 -t 1 , Output: ctest-pod-81821831 Connecting to 10.99.135.77:80 (10.99.135.77:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 02:12:02,816 - DEBUG - [Pod Pod ctest-pod-23287468] Cmd wget http://10.99.135.77:80/ -O - -T 5 -t 1 passed 2025-06-30 02:12:02,816 - DEBUG - [Pod Pod ctest-pod-23287468] Cmd output: ctest-pod-81821831 Connecting to 10.99.135.77:80 (10.99.135.77:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 02:12:02,871 - DEBUG - [Pod ctest-pod-23287468] Cmd: wget http://10.99.135.77:80/ -O - -T 5 -t 1 , Output: ctest-pod-81821831 Connecting to 10.99.135.77:80 (10.99.135.77:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 02:12:02,872 - DEBUG - [Pod Pod ctest-pod-23287468] Cmd wget http://10.99.135.77:80/ -O - -T 5 -t 1 passed 2025-06-30 02:12:02,872 - DEBUG - [Pod Pod ctest-pod-23287468] Cmd output: ctest-pod-81821831 Connecting to 10.99.135.77:80 (10.99.135.77:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 02:12:02,925 - DEBUG - [Pod ctest-pod-23287468] Cmd: wget http://10.99.135.77:80/ -O - -T 5 -t 1 , Output: ctest-pod-81821831 Connecting to 10.99.135.77:80 (10.99.135.77:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 02:12:02,925 - DEBUG - [Pod Pod ctest-pod-23287468] Cmd wget http://10.99.135.77:80/ -O - -T 5 -t 1 passed 2025-06-30 02:12:02,925 - DEBUG - [Pod Pod ctest-pod-23287468] Cmd output: ctest-pod-81821831 Connecting to 10.99.135.77:80 (10.99.135.77:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 02:12:02,981 - DEBUG - [Pod ctest-pod-23287468] Cmd: wget http://10.99.135.77:80/ -O - -T 5 -t 1 , Output: ctest-pod-88899583 Connecting to 10.99.135.77:80 (10.99.135.77:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 02:12:02,982 - DEBUG - [Pod Pod ctest-pod-23287468] Cmd wget http://10.99.135.77:80/ -O - -T 5 -t 1 passed 2025-06-30 02:12:02,982 - DEBUG - [Pod Pod ctest-pod-23287468] Cmd output: ctest-pod-88899583 Connecting to 10.99.135.77:80 (10.99.135.77:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-30 02:12:02,982 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-81821831': 3, 'ctest-pod-88899583': 1} 2025-06-30 02:12:05,032 - DEBUG - [Pod ctest-pod-37463010] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.500 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.081 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.100 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.081/0.560/1.500 ms 2025-06-30 02:12:05,032 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-37463010 with expectation True passed 2025-06-30 02:12:07,084 - DEBUG - [Pod ctest-pod-78394592] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.142 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.087 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.098 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.087/0.442/1.142 ms 2025-06-30 02:12:07,085 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-78394592 with expectation True passed 2025-06-30 02:12:09,139 - DEBUG - [Pod ctest-pod-23287468] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.558 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.100 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.102 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.100/0.253/0.558 ms 2025-06-30 02:12:09,140 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-23287468 with expectation True passed 2025-06-30 02:12:09,192 - DEBUG - [Pod ctest-pod-37463010] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-30 02:12:09,192 - DEBUG - [Pod Pod ctest-pod-37463010] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-06-30 02:12:09,192 - DEBUG - [Pod Pod ctest-pod-37463010] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-30 02:12:09,192 - INFO - wget check of of http://10.47.255.251 from ctest-pod-37463010 passed 2025-06-30 02:12:09,250 - DEBUG - [Pod ctest-pod-37463010] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-30 02:12:09,250 - DEBUG - [Pod Pod ctest-pod-37463010] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-06-30 02:12:09,250 - DEBUG - [Pod Pod ctest-pod-37463010] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-30 02:12:09,250 - INFO - wget check of of http://10.47.255.250 from ctest-pod-37463010 passed 2025-06-30 02:12:14,307 - DEBUG - [Pod ctest-pod-78394592] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-30 02:12:14,307 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-30 02:12:14,307 - DEBUG - [Pod Pod ctest-pod-78394592] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-30 02:12:14,307 - INFO - wget check of of http://10.47.255.250 from ctest-pod-78394592 passed 2025-06-30 02:12:14,377 - DEBUG - [Pod ctest-pod-89495921] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-30 02:12:14,377 - DEBUG - [Pod Pod ctest-pod-89495921] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-06-30 02:12:14,377 - DEBUG - [Pod Pod ctest-pod-89495921] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-30 02:12:14,377 - INFO - wget check of of http://10.47.255.251 from ctest-pod-89495921 passed 2025-06-30 02:12:14,377 - INFO - Deleting Network Policy : ingress-on-service 2025-06-30 02:12:14,378 - INFO - Deleting service : ctest-nginx-svc-74500518 2025-06-30 02:12:14,636 - DEBUG - No XMPP flaps were noticed during the test 2025-06-30 02:12:14,636 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:10] 2025-06-30 02:12:14,636 - INFO - -------------------------------------------------------------------------------- 2025-06-30 02:12:14,642 - INFO - Deleting pod ctest-new-default-85987131:ctest-pod-81821831 2025-06-30 02:12:14,643 - INFO - Deleting pod ctest-new-default-85987131:ctest-pod-88899583 2025-06-30 02:12:14,643 - INFO - Deleting pod ctest-non-default-41594961:ctest-pod-22725606 2025-06-30 02:12:14,644 - INFO - Deleting pod ctest-non-default-41594961:ctest-pod-41447956 2025-06-30 02:12:14,644 - INFO - Deleting pod ctest-new-default-85987131:ctest-pod-78394592 2025-06-30 02:12:14,644 - INFO - Deleting pod ctest-new-default-85987131:ctest-pod-37463010 2025-06-30 02:12:14,645 - INFO - Deleting pod ctest-non-default-41594961:ctest-pod-23287468 2025-06-30 02:12:14,645 - INFO - Deleting pod ctest-non-default-41594961:ctest-pod-89495921 2025-06-30 02:12:14,733 - WARNING - Pod uuid f2ef6a42-af44-4ba5-9742-477734c02be8 is still seen in agent 10.0.0.33 VM list 2025-06-30 02:12:14,737 - WARNING - Pod uuid e3a2b0c1-b158-4c2b-b096-4061b3d15c5e is still seen in agent 10.0.0.33 VM list 2025-06-30 02:12:14,781 - WARNING - Pod uuid b06d3166-e770-4978-a684-bd50863026fc is still seen in agent 10.0.0.33 VM list 2025-06-30 02:12:14,783 - WARNING - Pod uuid 88030fbd-ffe0-4983-b5de-c7ec41753424 is still seen in agent 10.0.0.33 VM list 2025-06-30 02:12:14,783 - WARNING - Pod uuid 0ffbddee-aeff-4a97-ab81-3836cea23236 is still seen in agent 10.0.0.33 VM list 2025-06-30 02:12:14,784 - WARNING - Pod uuid 39b6e23b-55cc-4872-a3fc-5da4da758675 is still seen in agent 10.0.0.33 VM list 2025-06-30 02:12:14,784 - WARNING - Pod uuid faecec0f-957c-40f3-9d3b-7e7993ca3938 is still seen in agent 10.0.0.33 VM list 2025-06-30 02:12:14,785 - WARNING - Pod uuid dcf6e0d9-7885-4235-96e2-d6e82efc7885 is still seen in agent 10.0.0.33 VM list 2025-06-30 02:12:19,744 - DEBUG - Pod f2ef6a42-af44-4ba5-9742-477734c02be8 is not in agent 10.0.0.33 VM list 2025-06-30 02:12:19,747 - WARNING - Pod uuid e3a2b0c1-b158-4c2b-b096-4061b3d15c5e is still seen in agent 10.0.0.33 VM list 2025-06-30 02:12:19,752 - DEBUG - VMI 26905ed8-5557-11f0-a992-fa163e9c9436 is removed from agent 10.0.0.33 2025-06-30 02:12:19,752 - INFO - Verified that pod ctest-pod-81821831 is removed in agent 2025-06-30 02:12:19,815 - DEBUG - Pod 0ffbddee-aeff-4a97-ab81-3836cea23236 is not in agent 10.0.0.33 VM list 2025-06-30 02:12:19,817 - WARNING - Pod uuid faecec0f-957c-40f3-9d3b-7e7993ca3938 is still seen in agent 10.0.0.33 VM list 2025-06-30 02:12:19,818 - DEBUG - Pod b06d3166-e770-4978-a684-bd50863026fc is not in agent 10.0.0.33 VM list 2025-06-30 02:12:19,821 - DEBUG - Pod dcf6e0d9-7885-4235-96e2-d6e82efc7885 is not in agent 10.0.0.33 VM list 2025-06-30 02:12:19,823 - WARNING - Pod uuid 88030fbd-ffe0-4983-b5de-c7ec41753424 is still seen in agent 10.0.0.33 VM list 2025-06-30 02:12:19,824 - WARNING - Pod uuid 39b6e23b-55cc-4872-a3fc-5da4da758675 is still seen in agent 10.0.0.33 VM list 2025-06-30 02:12:19,837 - DEBUG - VMI 287198fc-5557-11f0-a992-fa163e9c9436 is removed from agent 10.0.0.33 2025-06-30 02:12:19,837 - INFO - Verified that pod ctest-pod-41447956 is removed in agent 2025-06-30 02:12:19,838 - DEBUG - VMI 2713294e-5557-11f0-a992-fa163e9c9436 is removed from agent 10.0.0.33 2025-06-30 02:12:19,838 - INFO - Verified that pod ctest-pod-88899583 is removed in agent 2025-06-30 02:12:19,838 - DEBUG - VMI 27e3a434-5557-11f0-a992-fa163e9c9436 is removed from agent 10.0.0.33 2025-06-30 02:12:19,839 - INFO - Verified that pod ctest-pod-22725606 is removed in agent 2025-06-30 02:12:24,759 - WARNING - Pod uuid e3a2b0c1-b158-4c2b-b096-4061b3d15c5e is still seen in agent 10.0.0.33 VM list 2025-06-30 02:12:24,825 - WARNING - Pod uuid faecec0f-957c-40f3-9d3b-7e7993ca3938 is still seen in agent 10.0.0.33 VM list 2025-06-30 02:12:24,836 - WARNING - Pod uuid 39b6e23b-55cc-4872-a3fc-5da4da758675 is still seen in agent 10.0.0.33 VM list 2025-06-30 02:12:24,837 - WARNING - Pod uuid 88030fbd-ffe0-4983-b5de-c7ec41753424 is still seen in agent 10.0.0.33 VM list 2025-06-30 02:12:29,767 - WARNING - Pod uuid e3a2b0c1-b158-4c2b-b096-4061b3d15c5e is still seen in agent 10.0.0.33 VM list 2025-06-30 02:12:29,834 - WARNING - Pod uuid faecec0f-957c-40f3-9d3b-7e7993ca3938 is still seen in agent 10.0.0.33 VM list 2025-06-30 02:12:29,848 - WARNING - Pod uuid 88030fbd-ffe0-4983-b5de-c7ec41753424 is still seen in agent 10.0.0.33 VM list 2025-06-30 02:12:29,849 - WARNING - Pod uuid 39b6e23b-55cc-4872-a3fc-5da4da758675 is still seen in agent 10.0.0.33 VM list 2025-06-30 02:12:34,776 - WARNING - Pod uuid e3a2b0c1-b158-4c2b-b096-4061b3d15c5e is still seen in agent 10.0.0.33 VM list 2025-06-30 02:12:34,843 - WARNING - Pod uuid faecec0f-957c-40f3-9d3b-7e7993ca3938 is still seen in agent 10.0.0.33 VM list 2025-06-30 02:12:34,861 - WARNING - Pod uuid 88030fbd-ffe0-4983-b5de-c7ec41753424 is still seen in agent 10.0.0.33 VM list 2025-06-30 02:12:34,862 - WARNING - Pod uuid 39b6e23b-55cc-4872-a3fc-5da4da758675 is still seen in agent 10.0.0.33 VM list 2025-06-30 02:12:39,787 - WARNING - Pod uuid e3a2b0c1-b158-4c2b-b096-4061b3d15c5e is still seen in agent 10.0.0.33 VM list 2025-06-30 02:12:39,852 - WARNING - Pod uuid faecec0f-957c-40f3-9d3b-7e7993ca3938 is still seen in agent 10.0.0.33 VM list 2025-06-30 02:12:39,880 - WARNING - Pod uuid 39b6e23b-55cc-4872-a3fc-5da4da758675 is still seen in agent 10.0.0.33 VM list 2025-06-30 02:12:39,880 - WARNING - Pod uuid 88030fbd-ffe0-4983-b5de-c7ec41753424 is still seen in agent 10.0.0.33 VM list 2025-06-30 02:12:44,798 - WARNING - Pod uuid e3a2b0c1-b158-4c2b-b096-4061b3d15c5e is still seen in agent 10.0.0.33 VM list 2025-06-30 02:12:44,861 - WARNING - Pod uuid faecec0f-957c-40f3-9d3b-7e7993ca3938 is still seen in agent 10.0.0.33 VM list 2025-06-30 02:12:44,901 - WARNING - Pod uuid 88030fbd-ffe0-4983-b5de-c7ec41753424 is still seen in agent 10.0.0.33 VM list 2025-06-30 02:12:44,902 - WARNING - Pod uuid 39b6e23b-55cc-4872-a3fc-5da4da758675 is still seen in agent 10.0.0.33 VM list 2025-06-30 02:12:49,808 - DEBUG - Pod e3a2b0c1-b158-4c2b-b096-4061b3d15c5e is not in agent 10.0.0.33 VM list 2025-06-30 02:12:49,815 - DEBUG - VMI 2984568a-5557-11f0-a992-fa163e9c9436 is removed from agent 10.0.0.33 2025-06-30 02:12:49,815 - INFO - Verified that pod ctest-pod-37463010 is removed in agent 2025-06-30 02:12:49,871 - DEBUG - Pod faecec0f-957c-40f3-9d3b-7e7993ca3938 is not in agent 10.0.0.33 VM list 2025-06-30 02:12:49,877 - DEBUG - VMI 290cd4b6-5557-11f0-a992-fa163e9c9436 is removed from agent 10.0.0.33 2025-06-30 02:12:49,877 - INFO - Verified that pod ctest-pod-78394592 is removed in agent 2025-06-30 02:12:49,920 - DEBUG - Pod 88030fbd-ffe0-4983-b5de-c7ec41753424 is not in agent 10.0.0.33 VM list 2025-06-30 02:12:49,921 - DEBUG - Pod 39b6e23b-55cc-4872-a3fc-5da4da758675 is not in agent 10.0.0.33 VM list 2025-06-30 02:12:49,933 - DEBUG - VMI 2a7a5c9c-5557-11f0-a992-fa163e9c9436 is removed from agent 10.0.0.33 2025-06-30 02:12:49,933 - INFO - Verified that pod ctest-pod-89495921 is removed in agent 2025-06-30 02:12:49,934 - DEBUG - VMI 29ffafd8-5557-11f0-a992-fa163e9c9436 is removed from agent 10.0.0.33 2025-06-30 02:12:49,935 - INFO - Verified that pod ctest-pod-23287468 is removed in agent 2025-06-30 02:12:49,935 - INFO - Deleting namespace ctest-non-default-41594961 2025-06-30 02:12:49,947 - DEBUG - Namespace ctest-non-default-41594961 still in k8s 2025-06-30 02:12:51,952 - DEBUG - Namespace ctest-non-default-41594961 still in k8s 2025-06-30 02:12:53,958 - DEBUG - Namespace ctest-non-default-41594961 still in k8s 2025-06-30 02:12:55,963 - DEBUG - Namespace ctest-non-default-41594961 is not in k8s 2025-06-30 02:12:55,963 - DEBUG - No need to check project deletion in contrail-api 2025-06-30 02:12:55,963 - INFO - Deleting namespace ctest-new-default-85987131 2025-06-30 02:12:55,974 - DEBUG - Namespace ctest-new-default-85987131 still in k8s 2025-06-30 02:12:57,981 - DEBUG - Namespace ctest-new-default-85987131 still in k8s 2025-06-30 02:12:59,985 - DEBUG - Namespace ctest-new-default-85987131 still in k8s 2025-06-30 02:13:01,989 - DEBUG - Namespace ctest-new-default-85987131 is not in k8s 2025-06-30 02:13:01,989 - DEBUG - No need to check project deletion in contrail-api