2025-01-06 12:55:16,210 - INFO - Using existing project ['default-domain', 'k8s-default'](3cd1cb8d-0b9f-4778-bb1b-c24bc0431125) 2025-01-06 12:55:16,230 - DEBUG - Namespace ctest-new-default-65167860 not present 2025-01-06 12:55:16,671 - INFO - Created namespace ctest-new-default-65167860 2025-01-06 12:55:19,729 - DEBUG - Namespace ctest-non-default-82995284 not present 2025-01-06 12:55:19,740 - INFO - Created namespace ctest-non-default-82995284 2025-01-06 12:55:22,757 - DEBUG - Pod ctest-pod-61638307 not present 2025-01-06 12:55:22,757 - INFO - Creating Pod ctest-pod-61638307 2025-01-06 12:55:22,778 - DEBUG - Pod : ctest-pod-61638307 UUID is b1cc9b7b-3ce3-4824-b242-f711b381b66e 2025-01-06 12:55:22,780 - DEBUG - Pod ctest-pod-37898189 not present 2025-01-06 12:55:22,781 - INFO - Creating Pod ctest-pod-37898189 2025-01-06 12:55:22,813 - DEBUG - Pod : ctest-pod-37898189 UUID is d6e6631e-1144-4fa4-ab7d-b36dac40e0c9 2025-01-06 12:55:22,815 - DEBUG - Pod ctest-pod-07677356 not present 2025-01-06 12:55:22,815 - INFO - Creating Pod ctest-pod-07677356 2025-01-06 12:55:22,867 - DEBUG - Pod : ctest-pod-07677356 UUID is 74936337-792a-4f26-91b1-b789ad861153 2025-01-06 12:55:22,874 - DEBUG - Pod ctest-pod-40962250 not present 2025-01-06 12:55:22,874 - INFO - Creating Pod ctest-pod-40962250 2025-01-06 12:55:22,892 - DEBUG - Pod : ctest-pod-40962250 UUID is 400f5a0a-c41b-412f-9d64-cf83aa4f45e3 2025-01-06 12:55:22,895 - DEBUG - Pod ctest-pod-92802157 not present 2025-01-06 12:55:22,895 - INFO - Creating Pod ctest-pod-92802157 2025-01-06 12:55:22,910 - DEBUG - Pod : ctest-pod-92802157 UUID is 50496e8a-8abc-42b8-a567-a62ae9675b01 2025-01-06 12:55:22,912 - DEBUG - Pod ctest-pod-42684725 not present 2025-01-06 12:55:22,912 - INFO - Creating Pod ctest-pod-42684725 2025-01-06 12:55:22,926 - DEBUG - Pod : ctest-pod-42684725 UUID is c64416a8-579b-4245-9cff-cb5dad0b6ca3 2025-01-06 12:55:22,928 - DEBUG - Pod ctest-pod-41555095 not present 2025-01-06 12:55:22,928 - INFO - Creating Pod ctest-pod-41555095 2025-01-06 12:55:22,945 - DEBUG - Pod : ctest-pod-41555095 UUID is 02e627d0-e173-4fed-be87-f3a78ba4396c 2025-01-06 12:55:22,947 - DEBUG - Pod ctest-pod-11490393 not present 2025-01-06 12:55:22,947 - INFO - Creating Pod ctest-pod-11490393 2025-01-06 12:55:22,965 - DEBUG - Pod : ctest-pod-11490393 UUID is 79f21a6a-6e30-4c2a-9e91-c98cee92b9fa 2025-01-06 12:55:23,107 - INFO - Project default-domain:k8s-ctest-new-default-65167860 for Namespace ctest-new-default-65167860 is seen in contrail-api 2025-01-06 12:55:23,107 - DEBUG - Project uuid in Contrail is b3bedc77-5c86-47f1-b41f-a5f10c451b61 2025-01-06 12:55:23,288 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_NamespaceDatabaseList?namespace_uuid=5ec6c4d1-a3d9-4180-8197-db8994717139 2025-01-06 12:55:23,295 - INFO - Namespace ctest-new-default-65167860 with uuid 5ec6c4d1-a3d9-4180-8197-db8994717139 found in kube manager 2025-01-06 12:55:23,295 - INFO - Namespace ctest-new-default-65167860 verification passed 2025-01-06 12:55:23,496 - INFO - Project default-domain:k8s-ctest-non-default-82995284 for Namespace ctest-non-default-82995284 is seen in contrail-api 2025-01-06 12:55:23,496 - DEBUG - Project uuid in Contrail is d4e45fb5-76f7-4dbc-b507-648761db275d 2025-01-06 12:55:23,496 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_NamespaceDatabaseList?namespace_uuid=7cdedc52-6931-44fa-b55e-ade262958dc3 2025-01-06 12:55:23,504 - INFO - Namespace ctest-non-default-82995284 with uuid 7cdedc52-6931-44fa-b55e-ade262958dc3 found in kube manager 2025-01-06 12:55:23,504 - INFO - Namespace ctest-non-default-82995284 verification passed 2025-01-06 12:55:23,509 - DEBUG - Pod ctest-pod-61638307 not in running state.Currently in Pending 2025-01-06 12:55:28,515 - DEBUG - Pod ctest-pod-61638307 not in running state.Currently in Pending 2025-01-06 12:55:33,521 - DEBUG - Pod ctest-pod-61638307 not in running state.Currently in Pending 2025-01-06 12:55:38,529 - INFO - Pod ctest-pod-61638307 is in running state.Got IP 10.47.255.251 2025-01-06 12:55:38,541 - DEBUG - Pod ctest-pod-61638307 has vmi 7ecc801c-cc2d-11ef-b462-fa163e540bd1 2025-01-06 12:55:38,541 - INFO - Verified pod ctest-pod-61638307 in contrail-api 2025-01-06 12:55:38,555 - DEBUG - VMI 7ecc801c-cc2d-11ef-b462-fa163e540bd1 is active in agent 10.0.0.30 2025-01-06 12:55:38,555 - INFO - Verified Pod ctest-pod-61638307 in agent 10.0.0.30 2025-01-06 12:55:38,555 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=b1cc9b7b-3ce3-4824-b242-f711b381b66e 2025-01-06 12:55:38,559 - INFO - Pod ctest-pod-61638307 with uuid b1cc9b7b-3ce3-4824-b242-f711b381b66e found in kube manager 2025-01-06 12:55:38,560 - INFO - Pod ctest-pod-61638307 verification passed 2025-01-06 12:55:38,564 - INFO - Pod ctest-pod-37898189 is in running state.Got IP 10.47.255.250 2025-01-06 12:55:38,620 - DEBUG - Pod ctest-pod-37898189 has vmi 7f534908-cc2d-11ef-b462-fa163e540bd1 2025-01-06 12:55:38,620 - INFO - Verified pod ctest-pod-37898189 in contrail-api 2025-01-06 12:55:38,632 - DEBUG - VMI 7f534908-cc2d-11ef-b462-fa163e540bd1 is active in agent 10.0.0.30 2025-01-06 12:55:38,633 - INFO - Verified Pod ctest-pod-37898189 in agent 10.0.0.30 2025-01-06 12:55:38,633 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=d6e6631e-1144-4fa4-ab7d-b36dac40e0c9 2025-01-06 12:55:38,637 - INFO - Pod ctest-pod-37898189 with uuid d6e6631e-1144-4fa4-ab7d-b36dac40e0c9 found in kube manager 2025-01-06 12:55:38,637 - INFO - Pod ctest-pod-37898189 verification passed 2025-01-06 12:55:38,641 - INFO - Pod ctest-pod-07677356 is in running state.Got IP 10.47.255.249 2025-01-06 12:55:38,653 - DEBUG - Pod ctest-pod-07677356 has vmi 7ff611ec-cc2d-11ef-b462-fa163e540bd1 2025-01-06 12:55:38,653 - INFO - Verified pod ctest-pod-07677356 in contrail-api 2025-01-06 12:55:38,666 - DEBUG - VMI 7ff611ec-cc2d-11ef-b462-fa163e540bd1 is active in agent 10.0.0.30 2025-01-06 12:55:38,666 - INFO - Verified Pod ctest-pod-07677356 in agent 10.0.0.30 2025-01-06 12:55:38,666 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=74936337-792a-4f26-91b1-b789ad861153 2025-01-06 12:55:38,670 - INFO - Pod ctest-pod-07677356 with uuid 74936337-792a-4f26-91b1-b789ad861153 found in kube manager 2025-01-06 12:55:38,670 - INFO - Pod ctest-pod-07677356 verification passed 2025-01-06 12:55:38,676 - INFO - Pod ctest-pod-40962250 is in running state.Got IP 10.47.255.248 2025-01-06 12:55:38,732 - DEBUG - Pod ctest-pod-40962250 has vmi 80753828-cc2d-11ef-b462-fa163e540bd1 2025-01-06 12:55:38,732 - INFO - Verified pod ctest-pod-40962250 in contrail-api 2025-01-06 12:55:38,744 - DEBUG - VMI 80753828-cc2d-11ef-b462-fa163e540bd1 is active in agent 10.0.0.30 2025-01-06 12:55:38,744 - INFO - Verified Pod ctest-pod-40962250 in agent 10.0.0.30 2025-01-06 12:55:38,744 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=400f5a0a-c41b-412f-9d64-cf83aa4f45e3 2025-01-06 12:55:38,749 - INFO - Pod ctest-pod-40962250 with uuid 400f5a0a-c41b-412f-9d64-cf83aa4f45e3 found in kube manager 2025-01-06 12:55:38,749 - INFO - Pod ctest-pod-40962250 verification passed 2025-01-06 12:55:38,758 - INFO - Pod ctest-pod-92802157 is in running state.Got IP 10.47.255.247 2025-01-06 12:55:38,812 - DEBUG - Pod ctest-pod-92802157 has vmi 80f86d42-cc2d-11ef-b462-fa163e540bd1 2025-01-06 12:55:38,812 - INFO - Verified pod ctest-pod-92802157 in contrail-api 2025-01-06 12:55:38,826 - DEBUG - VMI 80f86d42-cc2d-11ef-b462-fa163e540bd1 is active in agent 10.0.0.30 2025-01-06 12:55:38,826 - INFO - Verified Pod ctest-pod-92802157 in agent 10.0.0.30 2025-01-06 12:55:38,826 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=50496e8a-8abc-42b8-a567-a62ae9675b01 2025-01-06 12:55:38,830 - INFO - Pod ctest-pod-92802157 with uuid 50496e8a-8abc-42b8-a567-a62ae9675b01 found in kube manager 2025-01-06 12:55:38,830 - INFO - Pod ctest-pod-92802157 verification passed 2025-01-06 12:55:38,835 - INFO - Pod ctest-pod-41555095 is in running state.Got IP 10.47.255.245 2025-01-06 12:55:38,849 - DEBUG - Pod ctest-pod-41555095 has vmi 81e41ef4-cc2d-11ef-b462-fa163e540bd1 2025-01-06 12:55:38,849 - INFO - Verified pod ctest-pod-41555095 in contrail-api 2025-01-06 12:55:38,862 - DEBUG - VMI 81e41ef4-cc2d-11ef-b462-fa163e540bd1 is active in agent 10.0.0.30 2025-01-06 12:55:38,862 - INFO - Verified Pod ctest-pod-41555095 in agent 10.0.0.30 2025-01-06 12:55:38,862 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=02e627d0-e173-4fed-be87-f3a78ba4396c 2025-01-06 12:55:38,867 - INFO - Pod ctest-pod-41555095 with uuid 02e627d0-e173-4fed-be87-f3a78ba4396c found in kube manager 2025-01-06 12:55:38,867 - INFO - Pod ctest-pod-41555095 verification passed 2025-01-06 12:55:38,872 - INFO - Pod ctest-pod-42684725 is in running state.Got IP 10.47.255.246 2025-01-06 12:55:38,928 - DEBUG - Pod ctest-pod-42684725 has vmi 81701c52-cc2d-11ef-b462-fa163e540bd1 2025-01-06 12:55:38,928 - INFO - Verified pod ctest-pod-42684725 in contrail-api 2025-01-06 12:55:38,940 - DEBUG - VMI 81701c52-cc2d-11ef-b462-fa163e540bd1 is active in agent 10.0.0.30 2025-01-06 12:55:38,941 - INFO - Verified Pod ctest-pod-42684725 in agent 10.0.0.30 2025-01-06 12:55:38,941 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=c64416a8-579b-4245-9cff-cb5dad0b6ca3 2025-01-06 12:55:38,945 - INFO - Pod ctest-pod-42684725 with uuid c64416a8-579b-4245-9cff-cb5dad0b6ca3 found in kube manager 2025-01-06 12:55:38,945 - INFO - Pod ctest-pod-42684725 verification passed 2025-01-06 12:55:38,949 - DEBUG - Pod ctest-pod-11490393 not in running state.Currently in Pending 2025-01-06 12:55:43,956 - INFO - Pod ctest-pod-11490393 is in running state.Got IP 10.47.255.244 2025-01-06 12:55:43,971 - DEBUG - Pod ctest-pod-11490393 has vmi 825ccf34-cc2d-11ef-b462-fa163e540bd1 2025-01-06 12:55:43,971 - INFO - Verified pod ctest-pod-11490393 in contrail-api 2025-01-06 12:55:43,983 - DEBUG - VMI 825ccf34-cc2d-11ef-b462-fa163e540bd1 is active in agent 10.0.0.30 2025-01-06 12:55:43,984 - INFO - Verified Pod ctest-pod-11490393 in agent 10.0.0.30 2025-01-06 12:55:43,984 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=79f21a6a-6e30-4c2a-9e91-c98cee92b9fa 2025-01-06 12:55:43,988 - INFO - Pod ctest-pod-11490393 with uuid 79f21a6a-6e30-4c2a-9e91-c98cee92b9fa found in kube manager 2025-01-06 12:55:43,988 - INFO - Pod ctest-pod-11490393 verification passed 2025-01-06 12:55:43,988 - INFO - ================================================================================ 2025-01-06 12:55:43,989 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-01-06 12:55:43,989 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-01-06 12:55:44,210 - DEBUG - Nothing to compare xmpp stats {'10.0.0.30': {'10.0.0.37': '0'}} with 2025-01-06 12:55:44,210 - INFO - Initial checks done. Running the testcase now 2025-01-06 12:55:44,210 - INFO - 2025-01-06 12:55:44,272 - DEBUG - [Pod ctest-pod-61638307] Cmd: echo ctest-pod-61638307 > /usr/share/nginx/html/index.html, Output: 2025-01-06 12:55:44,341 - DEBUG - [Pod ctest-pod-37898189] Cmd: echo ctest-pod-37898189 > /usr/share/nginx/html/index.html, Output: 2025-01-06 12:55:44,398 - DEBUG - [Pod ctest-pod-07677356] Cmd: echo ctest-pod-07677356 > /usr/share/nginx/html/index.html, Output: 2025-01-06 12:55:44,448 - DEBUG - [Pod ctest-pod-40962250] Cmd: echo ctest-pod-40962250 > /usr/share/nginx/html/index.html, Output: 2025-01-06 12:55:44,453 - DEBUG - Service ctest-nginx-svc-81078731 not present 2025-01-06 12:55:44,453 - INFO - Creating service ctest-nginx-svc-81078731 2025-01-06 12:55:44,471 - INFO - Created Service ctest-nginx-svc-81078731 2025-01-06 12:55:44,479 - WARNING - Service UUID 6d3fd593-c71a-48b2-9526-6773928aa83b not yet found in contrail-api 2025-01-06 12:55:45,488 - INFO - Validated that Service ctest-nginx-svc-81078731 is seen in contrail-api 2025-01-06 12:55:45,488 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_LoadbalancerDatabaseList?x=6d3fd593-c71a-48b2-9526-6773928aa83b 2025-01-06 12:55:45,492 - INFO - Service ctest-nginx-svc-81078731 with uuid 6d3fd593-c71a-48b2-9526-6773928aa83b found in kube manager 2025-01-06 12:55:45,492 - INFO - Service ctest-nginx-svc-81078731 verification passed 2025-01-06 12:55:46,558 - DEBUG - [Pod ctest-pod-92802157] Cmd: wget http://10.109.102.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.102.99:80 (10.109.102.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-37898189 2025-01-06 12:55:46,558 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd wget http://10.109.102.99:80/ -O - -T 5 -t 1 passed 2025-01-06 12:55:46,558 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd output: Connecting to 10.109.102.99:80 (10.109.102.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-37898189 2025-01-06 12:55:46,619 - DEBUG - [Pod ctest-pod-92802157] Cmd: wget http://10.109.102.99:80/ -O - -T 5 -t 1 , Output: ctest-pod-37898189 Connecting to 10.109.102.99:80 (10.109.102.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-06 12:55:46,619 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd wget http://10.109.102.99:80/ -O - -T 5 -t 1 passed 2025-01-06 12:55:46,619 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd output: ctest-pod-37898189 Connecting to 10.109.102.99:80 (10.109.102.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-06 12:55:46,683 - DEBUG - [Pod ctest-pod-92802157] Cmd: wget http://10.109.102.99:80/ -O - -T 5 -t 1 , Output: ctest-pod-37898189 Connecting to 10.109.102.99:80 (10.109.102.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-06 12:55:46,684 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd wget http://10.109.102.99:80/ -O - -T 5 -t 1 passed 2025-01-06 12:55:46,684 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd output: ctest-pod-37898189 Connecting to 10.109.102.99:80 (10.109.102.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-06 12:55:46,750 - DEBUG - [Pod ctest-pod-92802157] Cmd: wget http://10.109.102.99:80/ -O - -T 5 -t 1 , Output: ctest-pod-61638307 Connecting to 10.109.102.99:80 (10.109.102.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-06 12:55:46,750 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd wget http://10.109.102.99:80/ -O - -T 5 -t 1 passed 2025-01-06 12:55:46,750 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd output: ctest-pod-61638307 Connecting to 10.109.102.99:80 (10.109.102.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-06 12:55:46,750 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-61638307': 1, 'ctest-pod-37898189': 3} 2025-01-06 12:55:46,802 - DEBUG - [Pod ctest-pod-41555095] Cmd: wget http://10.109.102.99:80/ -O - -T 5 -t 1 , Output: ctest-pod-37898189 Connecting to 10.109.102.99:80 (10.109.102.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-06 12:55:46,803 - DEBUG - [Pod Pod ctest-pod-41555095] Cmd wget http://10.109.102.99:80/ -O - -T 5 -t 1 passed 2025-01-06 12:55:46,803 - DEBUG - [Pod Pod ctest-pod-41555095] Cmd output: ctest-pod-37898189 Connecting to 10.109.102.99:80 (10.109.102.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-06 12:55:46,869 - DEBUG - [Pod ctest-pod-41555095] Cmd: wget http://10.109.102.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.102.99:80 (10.109.102.99:80) ctest-pod-37898189 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-06 12:55:46,869 - DEBUG - [Pod Pod ctest-pod-41555095] Cmd wget http://10.109.102.99:80/ -O - -T 5 -t 1 passed 2025-01-06 12:55:46,869 - DEBUG - [Pod Pod ctest-pod-41555095] Cmd output: Connecting to 10.109.102.99:80 (10.109.102.99:80) ctest-pod-37898189 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-06 12:55:46,921 - DEBUG - [Pod ctest-pod-41555095] Cmd: wget http://10.109.102.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.102.99:80 (10.109.102.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-37898189 2025-01-06 12:55:46,921 - DEBUG - [Pod Pod ctest-pod-41555095] Cmd wget http://10.109.102.99:80/ -O - -T 5 -t 1 passed 2025-01-06 12:55:46,921 - DEBUG - [Pod Pod ctest-pod-41555095] Cmd output: Connecting to 10.109.102.99:80 (10.109.102.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-37898189 2025-01-06 12:55:46,981 - DEBUG - [Pod ctest-pod-41555095] Cmd: wget http://10.109.102.99:80/ -O - -T 5 -t 1 , Output: ctest-pod-61638307 Connecting to 10.109.102.99:80 (10.109.102.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-06 12:55:46,981 - DEBUG - [Pod Pod ctest-pod-41555095] Cmd wget http://10.109.102.99:80/ -O - -T 5 -t 1 passed 2025-01-06 12:55:46,981 - DEBUG - [Pod Pod ctest-pod-41555095] Cmd output: ctest-pod-61638307 Connecting to 10.109.102.99:80 (10.109.102.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-06 12:55:46,981 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-61638307': 1, 'ctest-pod-37898189': 3} 2025-01-06 12:55:46,984 - DEBUG - Network policy ingress-on-service not present 2025-01-06 12:55:46,985 - INFO - Creating Network Policy ingress-on-service 2025-01-06 12:55:46,996 - INFO - Network policy found in k8s 2025-01-06 12:55:46,996 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=f79e4583-2df8-469a-982a-ec3e623de55c 2025-01-06 12:55:47,001 - INFO - Network Policy ingress-on-service with uuid f79e4583-2df8-469a-982a-ec3e623de55c found in kube manager 2025-01-06 12:55:47,032 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-01-06 12:55:47,032 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-01-06 12:55:47,033 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=f79e4583-2df8-469a-982a-ec3e623de55c 2025-01-06 12:55:47,060 - WARNING - Network policy with name ingress-on-service not found in agent 2025-01-06 12:55:49,061 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=f79e4583-2df8-469a-982a-ec3e623de55c 2025-01-06 12:55:49,090 - INFO - Network policy with name ingress-on-service found in agent 2025-01-06 12:55:49,090 - INFO - Network Policy ingress-on-service verification passed 2025-01-06 12:55:54,232 - DEBUG - [Pod ctest-pod-92802157] Cmd: wget http://10.109.102.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:55:54,233 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd wget http://10.109.102.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:55:54,233 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:55:59,300 - DEBUG - [Pod ctest-pod-92802157] Cmd: wget http://10.109.102.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:55:59,301 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd wget http://10.109.102.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:55:59,301 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:56:04,369 - DEBUG - [Pod ctest-pod-92802157] Cmd: wget http://10.109.102.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:56:04,369 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd wget http://10.109.102.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:56:04,369 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:56:09,419 - DEBUG - [Pod ctest-pod-92802157] Cmd: wget http://10.109.102.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:56:09,419 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd wget http://10.109.102.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:56:09,419 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:56:14,487 - DEBUG - [Pod ctest-pod-92802157] Cmd: wget http://10.109.102.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:56:14,487 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd wget http://10.109.102.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:56:14,487 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:56:19,540 - DEBUG - [Pod ctest-pod-92802157] Cmd: wget http://10.109.102.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:56:19,540 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd wget http://10.109.102.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:56:19,540 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:56:24,608 - DEBUG - [Pod ctest-pod-92802157] Cmd: wget http://10.109.102.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:56:24,609 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd wget http://10.109.102.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:56:24,609 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:56:29,660 - DEBUG - [Pod ctest-pod-92802157] Cmd: wget http://10.109.102.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:56:29,660 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd wget http://10.109.102.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:56:29,660 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:56:34,713 - DEBUG - [Pod ctest-pod-92802157] Cmd: wget http://10.109.102.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:56:34,713 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd wget http://10.109.102.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:56:34,713 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:56:39,771 - DEBUG - [Pod ctest-pod-92802157] Cmd: wget http://10.109.102.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:56:39,771 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd wget http://10.109.102.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:56:39,771 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:56:39,771 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-61638307': 0, 'ctest-pod-37898189': 0} 2025-01-06 12:56:39,831 - DEBUG - [Pod ctest-pod-42684725] Cmd: wget http://10.109.102.99:80/ -O - -T 5 -t 1 , Output: ctest-pod-37898189 Connecting to 10.109.102.99:80 (10.109.102.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-06 12:56:39,832 - DEBUG - [Pod Pod ctest-pod-42684725] Cmd wget http://10.109.102.99:80/ -O - -T 5 -t 1 passed 2025-01-06 12:56:39,832 - DEBUG - [Pod Pod ctest-pod-42684725] Cmd output: ctest-pod-37898189 Connecting to 10.109.102.99:80 (10.109.102.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-06 12:56:39,898 - DEBUG - [Pod ctest-pod-42684725] Cmd: wget http://10.109.102.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.102.99:80 (10.109.102.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-61638307 2025-01-06 12:56:39,898 - DEBUG - [Pod Pod ctest-pod-42684725] Cmd wget http://10.109.102.99:80/ -O - -T 5 -t 1 passed 2025-01-06 12:56:39,898 - DEBUG - [Pod Pod ctest-pod-42684725] Cmd output: Connecting to 10.109.102.99:80 (10.109.102.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-61638307 2025-01-06 12:56:39,898 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-61638307': 1, 'ctest-pod-37898189': 1} 2025-01-06 12:56:44,960 - DEBUG - [Pod ctest-pod-41555095] Cmd: wget http://10.109.102.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:56:44,960 - DEBUG - [Pod Pod ctest-pod-41555095] Cmd wget http://10.109.102.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:56:44,960 - DEBUG - [Pod Pod ctest-pod-41555095] Cmd output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:56:50,027 - DEBUG - [Pod ctest-pod-41555095] Cmd: wget http://10.109.102.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:56:50,027 - DEBUG - [Pod Pod ctest-pod-41555095] Cmd wget http://10.109.102.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:56:50,028 - DEBUG - [Pod Pod ctest-pod-41555095] Cmd output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:56:55,091 - DEBUG - [Pod ctest-pod-41555095] Cmd: wget http://10.109.102.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:56:55,091 - DEBUG - [Pod Pod ctest-pod-41555095] Cmd wget http://10.109.102.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:56:55,091 - DEBUG - [Pod Pod ctest-pod-41555095] Cmd output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:57:00,164 - DEBUG - [Pod ctest-pod-41555095] Cmd: wget http://10.109.102.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:57:00,164 - DEBUG - [Pod Pod ctest-pod-41555095] Cmd wget http://10.109.102.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:57:00,164 - DEBUG - [Pod Pod ctest-pod-41555095] Cmd output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:57:05,228 - DEBUG - [Pod ctest-pod-41555095] Cmd: wget http://10.109.102.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:57:05,229 - DEBUG - [Pod Pod ctest-pod-41555095] Cmd wget http://10.109.102.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:57:05,229 - DEBUG - [Pod Pod ctest-pod-41555095] Cmd output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:57:10,298 - DEBUG - [Pod ctest-pod-41555095] Cmd: wget http://10.109.102.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:57:10,298 - DEBUG - [Pod Pod ctest-pod-41555095] Cmd wget http://10.109.102.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:57:10,298 - DEBUG - [Pod Pod ctest-pod-41555095] Cmd output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:57:15,354 - DEBUG - [Pod ctest-pod-41555095] Cmd: wget http://10.109.102.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:57:15,354 - DEBUG - [Pod Pod ctest-pod-41555095] Cmd wget http://10.109.102.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:57:15,354 - DEBUG - [Pod Pod ctest-pod-41555095] Cmd output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:57:20,410 - DEBUG - [Pod ctest-pod-41555095] Cmd: wget http://10.109.102.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:57:20,410 - DEBUG - [Pod Pod ctest-pod-41555095] Cmd wget http://10.109.102.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:57:20,410 - DEBUG - [Pod Pod ctest-pod-41555095] Cmd output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:57:25,544 - DEBUG - [Pod ctest-pod-41555095] Cmd: wget http://10.109.102.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:57:25,544 - DEBUG - [Pod Pod ctest-pod-41555095] Cmd wget http://10.109.102.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:57:25,544 - DEBUG - [Pod Pod ctest-pod-41555095] Cmd output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:57:30,604 - DEBUG - [Pod ctest-pod-41555095] Cmd: wget http://10.109.102.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:57:30,604 - DEBUG - [Pod Pod ctest-pod-41555095] Cmd wget http://10.109.102.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:57:30,604 - DEBUG - [Pod Pod ctest-pod-41555095] Cmd output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:57:30,604 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-61638307': 0, 'ctest-pod-37898189': 0} 2025-01-06 12:57:32,660 - DEBUG - [Pod ctest-pod-42684725] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.293 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.069 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.080 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.069/0.480/1.293 ms 2025-01-06 12:57:32,660 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-42684725 with expectation True passed 2025-01-06 12:57:34,720 - DEBUG - [Pod ctest-pod-92802157] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.839 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.069 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.083 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.069/0.330/0.839 ms 2025-01-06 12:57:34,721 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-92802157 with expectation True passed 2025-01-06 12:57:36,773 - DEBUG - [Pod ctest-pod-41555095] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.470 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.073 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.091 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.073/0.211/0.470 ms 2025-01-06 12:57:36,773 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-41555095 with expectation True passed 2025-01-06 12:57:36,840 - DEBUG - [Pod ctest-pod-42684725] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-06 12:57:36,840 - DEBUG - [Pod Pod ctest-pod-42684725] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-01-06 12:57:36,840 - DEBUG - [Pod Pod ctest-pod-42684725] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-06 12:57:36,840 - INFO - wget check of of http://10.47.255.251 from ctest-pod-42684725 passed 2025-01-06 12:57:36,896 - DEBUG - [Pod ctest-pod-42684725] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-06 12:57:36,896 - DEBUG - [Pod Pod ctest-pod-42684725] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-01-06 12:57:36,896 - DEBUG - [Pod Pod ctest-pod-42684725] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-06 12:57:36,896 - INFO - wget check of of http://10.47.255.250 from ctest-pod-42684725 passed 2025-01-06 12:57:41,955 - DEBUG - [Pod ctest-pod-92802157] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-06 12:57:41,955 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-06 12:57:41,955 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-06 12:57:41,955 - INFO - wget check of of http://10.47.255.250 from ctest-pod-92802157 passed 2025-01-06 12:57:47,019 - DEBUG - [Pod ctest-pod-11490393] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-01-06 12:57:47,020 - DEBUG - [Pod Pod ctest-pod-11490393] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-01-06 12:57:47,020 - DEBUG - [Pod Pod ctest-pod-11490393] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-01-06 12:57:47,020 - INFO - wget check of of http://10.47.255.251 from ctest-pod-11490393 passed 2025-01-06 12:57:47,027 - INFO - Updating Network Policy ingress-on-service 2025-01-06 12:57:52,096 - DEBUG - [Pod ctest-pod-92802157] Cmd: wget http://10.109.102.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:57:52,096 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd wget http://10.109.102.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:57:52,096 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:57:57,151 - DEBUG - [Pod ctest-pod-92802157] Cmd: wget http://10.109.102.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:57:57,151 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd wget http://10.109.102.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:57:57,151 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:58:02,212 - DEBUG - [Pod ctest-pod-92802157] Cmd: wget http://10.109.102.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:58:02,212 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd wget http://10.109.102.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:58:02,212 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:58:07,279 - DEBUG - [Pod ctest-pod-92802157] Cmd: wget http://10.109.102.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:58:07,279 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd wget http://10.109.102.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:58:07,279 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:58:12,340 - DEBUG - [Pod ctest-pod-92802157] Cmd: wget http://10.109.102.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:58:12,340 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd wget http://10.109.102.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:58:12,340 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:58:17,400 - DEBUG - [Pod ctest-pod-92802157] Cmd: wget http://10.109.102.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:58:17,400 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd wget http://10.109.102.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:58:17,400 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:58:22,467 - DEBUG - [Pod ctest-pod-92802157] Cmd: wget http://10.109.102.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:58:22,467 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd wget http://10.109.102.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:58:22,467 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:58:27,532 - DEBUG - [Pod ctest-pod-92802157] Cmd: wget http://10.109.102.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:58:27,532 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd wget http://10.109.102.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:58:27,532 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:58:32,608 - DEBUG - [Pod ctest-pod-92802157] Cmd: wget http://10.109.102.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:58:32,608 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd wget http://10.109.102.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:58:32,608 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:58:37,672 - DEBUG - [Pod ctest-pod-92802157] Cmd: wget http://10.109.102.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:58:37,672 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd wget http://10.109.102.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:58:37,672 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd output: Connecting to 10.109.102.99:80 (10.109.102.99:80) wget: download timed out 2025-01-06 12:58:37,672 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-61638307': 0, 'ctest-pod-37898189': 0} 2025-01-06 12:58:37,731 - DEBUG - [Pod ctest-pod-42684725] Cmd: wget http://10.109.102.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.102.99:80 (10.109.102.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-37898189 2025-01-06 12:58:37,731 - DEBUG - [Pod Pod ctest-pod-42684725] Cmd wget http://10.109.102.99:80/ -O - -T 5 -t 1 passed 2025-01-06 12:58:37,731 - DEBUG - [Pod Pod ctest-pod-42684725] Cmd output: Connecting to 10.109.102.99:80 (10.109.102.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-37898189 2025-01-06 12:58:37,800 - DEBUG - [Pod ctest-pod-42684725] Cmd: wget http://10.109.102.99:80/ -O - -T 5 -t 1 , Output: ctest-pod-61638307 Connecting to 10.109.102.99:80 (10.109.102.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-06 12:58:37,801 - DEBUG - [Pod Pod ctest-pod-42684725] Cmd wget http://10.109.102.99:80/ -O - -T 5 -t 1 passed 2025-01-06 12:58:37,801 - DEBUG - [Pod Pod ctest-pod-42684725] Cmd output: ctest-pod-61638307 Connecting to 10.109.102.99:80 (10.109.102.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-06 12:58:37,801 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-61638307': 1, 'ctest-pod-37898189': 1} 2025-01-06 12:58:37,862 - DEBUG - [Pod ctest-pod-41555095] Cmd: wget http://10.109.102.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.102.99:80 (10.109.102.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-37898189 2025-01-06 12:58:37,862 - DEBUG - [Pod Pod ctest-pod-41555095] Cmd wget http://10.109.102.99:80/ -O - -T 5 -t 1 passed 2025-01-06 12:58:37,862 - DEBUG - [Pod Pod ctest-pod-41555095] Cmd output: Connecting to 10.109.102.99:80 (10.109.102.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-37898189 2025-01-06 12:58:37,927 - DEBUG - [Pod ctest-pod-41555095] Cmd: wget http://10.109.102.99:80/ -O - -T 5 -t 1 , Output: ctest-pod-61638307 Connecting to 10.109.102.99:80 (10.109.102.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-06 12:58:37,927 - DEBUG - [Pod Pod ctest-pod-41555095] Cmd wget http://10.109.102.99:80/ -O - -T 5 -t 1 passed 2025-01-06 12:58:37,927 - DEBUG - [Pod Pod ctest-pod-41555095] Cmd output: ctest-pod-61638307 Connecting to 10.109.102.99:80 (10.109.102.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-06 12:58:37,927 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-61638307': 1, 'ctest-pod-37898189': 1} 2025-01-06 12:58:39,987 - DEBUG - [Pod ctest-pod-42684725] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.740 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.069 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.073 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.069/0.294/0.740 ms 2025-01-06 12:58:39,987 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-42684725 with expectation True passed 2025-01-06 12:58:42,055 - DEBUG - [Pod ctest-pod-92802157] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.790 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.105 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.322/0.790 ms 2025-01-06 12:58:42,056 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-92802157 with expectation True passed 2025-01-06 12:58:44,123 - DEBUG - [Pod ctest-pod-41555095] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.731 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.065 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.085 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.065/0.293/0.731 ms 2025-01-06 12:58:44,123 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-41555095 with expectation True passed 2025-01-06 12:58:44,188 - DEBUG - [Pod ctest-pod-42684725] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-06 12:58:44,188 - DEBUG - [Pod Pod ctest-pod-42684725] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-01-06 12:58:44,188 - DEBUG - [Pod Pod ctest-pod-42684725] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-06 12:58:44,188 - INFO - wget check of of http://10.47.255.251 from ctest-pod-42684725 passed 2025-01-06 12:58:44,247 - DEBUG - [Pod ctest-pod-42684725] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-06 12:58:44,248 - DEBUG - [Pod Pod ctest-pod-42684725] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-01-06 12:58:44,248 - DEBUG - [Pod Pod ctest-pod-42684725] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-06 12:58:44,248 - INFO - wget check of of http://10.47.255.250 from ctest-pod-42684725 passed 2025-01-06 12:58:49,304 - DEBUG - [Pod ctest-pod-92802157] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-06 12:58:49,304 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-06 12:58:49,304 - DEBUG - [Pod Pod ctest-pod-92802157] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-06 12:58:49,304 - INFO - wget check of of http://10.47.255.250 from ctest-pod-92802157 passed 2025-01-06 12:58:49,371 - DEBUG - [Pod ctest-pod-11490393] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-06 12:58:49,371 - DEBUG - [Pod Pod ctest-pod-11490393] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-01-06 12:58:49,371 - DEBUG - [Pod Pod ctest-pod-11490393] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-06 12:58:49,372 - INFO - wget check of of http://10.47.255.251 from ctest-pod-11490393 passed 2025-01-06 12:58:49,372 - INFO - Deleting Network Policy : ingress-on-service 2025-01-06 12:58:49,373 - INFO - Deleting service : ctest-nginx-svc-81078731 2025-01-06 12:58:49,611 - DEBUG - No XMPP flaps were noticed during the test 2025-01-06 12:58:49,611 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:06] 2025-01-06 12:58:49,611 - INFO - -------------------------------------------------------------------------------- 2025-01-06 12:58:49,617 - INFO - Deleting pod ctest-new-default-65167860:ctest-pod-61638307 2025-01-06 12:58:49,618 - INFO - Deleting pod ctest-new-default-65167860:ctest-pod-37898189 2025-01-06 12:58:49,618 - INFO - Deleting pod ctest-non-default-82995284:ctest-pod-07677356 2025-01-06 12:58:49,618 - INFO - Deleting pod ctest-non-default-82995284:ctest-pod-40962250 2025-01-06 12:58:49,619 - INFO - Deleting pod ctest-new-default-65167860:ctest-pod-92802157 2025-01-06 12:58:49,619 - INFO - Deleting pod ctest-new-default-65167860:ctest-pod-42684725 2025-01-06 12:58:49,619 - INFO - Deleting pod ctest-non-default-82995284:ctest-pod-41555095 2025-01-06 12:58:49,619 - INFO - Deleting pod ctest-non-default-82995284:ctest-pod-11490393 2025-01-06 12:58:49,723 - WARNING - Pod uuid b1cc9b7b-3ce3-4824-b242-f711b381b66e is still seen in agent 10.0.0.30 VM list 2025-01-06 12:58:49,726 - WARNING - Pod uuid 02e627d0-e173-4fed-be87-f3a78ba4396c is still seen in agent 10.0.0.30 VM list 2025-01-06 12:58:49,749 - WARNING - Pod uuid 74936337-792a-4f26-91b1-b789ad861153 is still seen in agent 10.0.0.30 VM list 2025-01-06 12:58:49,749 - WARNING - Pod uuid 400f5a0a-c41b-412f-9d64-cf83aa4f45e3 is still seen in agent 10.0.0.30 VM list 2025-01-06 12:58:49,750 - WARNING - Pod uuid 50496e8a-8abc-42b8-a567-a62ae9675b01 is still seen in agent 10.0.0.30 VM list 2025-01-06 12:58:49,750 - WARNING - Pod uuid c64416a8-579b-4245-9cff-cb5dad0b6ca3 is still seen in agent 10.0.0.30 VM list 2025-01-06 12:58:49,754 - WARNING - Pod uuid d6e6631e-1144-4fa4-ab7d-b36dac40e0c9 is still seen in agent 10.0.0.30 VM list 2025-01-06 12:58:49,754 - WARNING - Pod uuid 79f21a6a-6e30-4c2a-9e91-c98cee92b9fa is still seen in agent 10.0.0.30 VM list 2025-01-06 12:58:54,734 - DEBUG - Pod b1cc9b7b-3ce3-4824-b242-f711b381b66e is not in agent 10.0.0.30 VM list 2025-01-06 12:58:54,737 - WARNING - Pod uuid 02e627d0-e173-4fed-be87-f3a78ba4396c is still seen in agent 10.0.0.30 VM list 2025-01-06 12:58:54,741 - DEBUG - VMI 7ecc801c-cc2d-11ef-b462-fa163e540bd1 is removed from agent 10.0.0.30 2025-01-06 12:58:54,741 - INFO - Verified that pod ctest-pod-61638307 is removed in agent 2025-01-06 12:58:54,773 - WARNING - Pod uuid 50496e8a-8abc-42b8-a567-a62ae9675b01 is still seen in agent 10.0.0.30 VM list 2025-01-06 12:58:54,776 - DEBUG - Pod d6e6631e-1144-4fa4-ab7d-b36dac40e0c9 is not in agent 10.0.0.30 VM list 2025-01-06 12:58:54,777 - WARNING - Pod uuid 79f21a6a-6e30-4c2a-9e91-c98cee92b9fa is still seen in agent 10.0.0.30 VM list 2025-01-06 12:58:54,778 - WARNING - Pod uuid c64416a8-579b-4245-9cff-cb5dad0b6ca3 is still seen in agent 10.0.0.30 VM list 2025-01-06 12:58:54,778 - DEBUG - Pod 400f5a0a-c41b-412f-9d64-cf83aa4f45e3 is not in agent 10.0.0.30 VM list 2025-01-06 12:58:54,779 - DEBUG - Pod 74936337-792a-4f26-91b1-b789ad861153 is not in agent 10.0.0.30 VM list 2025-01-06 12:58:54,798 - DEBUG - VMI 80753828-cc2d-11ef-b462-fa163e540bd1 is removed from agent 10.0.0.30 2025-01-06 12:58:54,798 - INFO - Verified that pod ctest-pod-40962250 is removed in agent 2025-01-06 12:58:54,799 - DEBUG - VMI 7ff611ec-cc2d-11ef-b462-fa163e540bd1 is removed from agent 10.0.0.30 2025-01-06 12:58:54,799 - INFO - Verified that pod ctest-pod-07677356 is removed in agent 2025-01-06 12:58:54,800 - DEBUG - VMI 7f534908-cc2d-11ef-b462-fa163e540bd1 is removed from agent 10.0.0.30 2025-01-06 12:58:54,800 - INFO - Verified that pod ctest-pod-37898189 is removed in agent 2025-01-06 12:58:59,744 - WARNING - Pod uuid 02e627d0-e173-4fed-be87-f3a78ba4396c is still seen in agent 10.0.0.30 VM list 2025-01-06 12:58:59,790 - WARNING - Pod uuid 50496e8a-8abc-42b8-a567-a62ae9675b01 is still seen in agent 10.0.0.30 VM list 2025-01-06 12:58:59,791 - WARNING - Pod uuid 79f21a6a-6e30-4c2a-9e91-c98cee92b9fa is still seen in agent 10.0.0.30 VM list 2025-01-06 12:58:59,792 - WARNING - Pod uuid c64416a8-579b-4245-9cff-cb5dad0b6ca3 is still seen in agent 10.0.0.30 VM list 2025-01-06 12:59:04,752 - WARNING - Pod uuid 02e627d0-e173-4fed-be87-f3a78ba4396c is still seen in agent 10.0.0.30 VM list 2025-01-06 12:59:04,805 - WARNING - Pod uuid 50496e8a-8abc-42b8-a567-a62ae9675b01 is still seen in agent 10.0.0.30 VM list 2025-01-06 12:59:04,806 - WARNING - Pod uuid 79f21a6a-6e30-4c2a-9e91-c98cee92b9fa is still seen in agent 10.0.0.30 VM list 2025-01-06 12:59:04,807 - WARNING - Pod uuid c64416a8-579b-4245-9cff-cb5dad0b6ca3 is still seen in agent 10.0.0.30 VM list 2025-01-06 12:59:09,763 - WARNING - Pod uuid 02e627d0-e173-4fed-be87-f3a78ba4396c is still seen in agent 10.0.0.30 VM list 2025-01-06 12:59:09,822 - WARNING - Pod uuid 50496e8a-8abc-42b8-a567-a62ae9675b01 is still seen in agent 10.0.0.30 VM list 2025-01-06 12:59:09,823 - WARNING - Pod uuid 79f21a6a-6e30-4c2a-9e91-c98cee92b9fa is still seen in agent 10.0.0.30 VM list 2025-01-06 12:59:09,824 - WARNING - Pod uuid c64416a8-579b-4245-9cff-cb5dad0b6ca3 is still seen in agent 10.0.0.30 VM list 2025-01-06 12:59:14,774 - WARNING - Pod uuid 02e627d0-e173-4fed-be87-f3a78ba4396c is still seen in agent 10.0.0.30 VM list 2025-01-06 12:59:14,836 - WARNING - Pod uuid 50496e8a-8abc-42b8-a567-a62ae9675b01 is still seen in agent 10.0.0.30 VM list 2025-01-06 12:59:14,837 - WARNING - Pod uuid c64416a8-579b-4245-9cff-cb5dad0b6ca3 is still seen in agent 10.0.0.30 VM list 2025-01-06 12:59:14,838 - WARNING - Pod uuid 79f21a6a-6e30-4c2a-9e91-c98cee92b9fa is still seen in agent 10.0.0.30 VM list 2025-01-06 12:59:19,797 - WARNING - Pod uuid 02e627d0-e173-4fed-be87-f3a78ba4396c is still seen in agent 10.0.0.30 VM list 2025-01-06 12:59:19,851 - WARNING - Pod uuid 50496e8a-8abc-42b8-a567-a62ae9675b01 is still seen in agent 10.0.0.30 VM list 2025-01-06 12:59:19,853 - WARNING - Pod uuid 79f21a6a-6e30-4c2a-9e91-c98cee92b9fa is still seen in agent 10.0.0.30 VM list 2025-01-06 12:59:19,853 - WARNING - Pod uuid c64416a8-579b-4245-9cff-cb5dad0b6ca3 is still seen in agent 10.0.0.30 VM list 2025-01-06 12:59:24,806 - DEBUG - Pod 02e627d0-e173-4fed-be87-f3a78ba4396c is not in agent 10.0.0.30 VM list 2025-01-06 12:59:24,813 - DEBUG - VMI 81e41ef4-cc2d-11ef-b462-fa163e540bd1 is removed from agent 10.0.0.30 2025-01-06 12:59:24,813 - INFO - Verified that pod ctest-pod-41555095 is removed in agent 2025-01-06 12:59:24,865 - DEBUG - Pod 50496e8a-8abc-42b8-a567-a62ae9675b01 is not in agent 10.0.0.30 VM list 2025-01-06 12:59:24,869 - DEBUG - Pod c64416a8-579b-4245-9cff-cb5dad0b6ca3 is not in agent 10.0.0.30 VM list 2025-01-06 12:59:24,871 - DEBUG - Pod 79f21a6a-6e30-4c2a-9e91-c98cee92b9fa is not in agent 10.0.0.30 VM list 2025-01-06 12:59:24,882 - DEBUG - VMI 81701c52-cc2d-11ef-b462-fa163e540bd1 is removed from agent 10.0.0.30 2025-01-06 12:59:24,882 - INFO - Verified that pod ctest-pod-42684725 is removed in agent 2025-01-06 12:59:24,883 - DEBUG - VMI 80f86d42-cc2d-11ef-b462-fa163e540bd1 is removed from agent 10.0.0.30 2025-01-06 12:59:24,883 - INFO - Verified that pod ctest-pod-92802157 is removed in agent 2025-01-06 12:59:24,884 - DEBUG - VMI 825ccf34-cc2d-11ef-b462-fa163e540bd1 is removed from agent 10.0.0.30 2025-01-06 12:59:24,884 - INFO - Verified that pod ctest-pod-11490393 is removed in agent 2025-01-06 12:59:24,885 - INFO - Deleting namespace ctest-non-default-82995284 2025-01-06 12:59:24,897 - DEBUG - Namespace ctest-non-default-82995284 still in k8s 2025-01-06 12:59:26,902 - DEBUG - Namespace ctest-non-default-82995284 still in k8s 2025-01-06 12:59:28,907 - DEBUG - Namespace ctest-non-default-82995284 still in k8s 2025-01-06 12:59:30,911 - DEBUG - Namespace ctest-non-default-82995284 is not in k8s 2025-01-06 12:59:30,911 - DEBUG - No need to check project deletion in contrail-api 2025-01-06 12:59:30,911 - INFO - Deleting namespace ctest-new-default-65167860 2025-01-06 12:59:30,927 - DEBUG - Namespace ctest-new-default-65167860 still in k8s 2025-01-06 12:59:32,932 - DEBUG - Namespace ctest-new-default-65167860 still in k8s 2025-01-06 12:59:34,936 - DEBUG - Namespace ctest-new-default-65167860 still in k8s 2025-01-06 12:59:36,940 - DEBUG - Namespace ctest-new-default-65167860 is not in k8s 2025-01-06 12:59:36,940 - DEBUG - No need to check project deletion in contrail-api