2024-11-07 02:21:23,404 - INFO - Using existing project ['default-domain', 'k8s-default'](35e2ef82-ae16-472e-bf90-e4aeb4c025b5) 2024-11-07 02:21:23,432 - DEBUG - Namespace ctest-new-default-82584843 not present 2024-11-07 02:21:23,444 - INFO - Created namespace ctest-new-default-82584843 2024-11-07 02:21:26,450 - DEBUG - Namespace ctest-non-default-67912673 not present 2024-11-07 02:21:26,459 - INFO - Created namespace ctest-non-default-67912673 2024-11-07 02:21:30,697 - DEBUG - Pod ctest-pod-40150471 not present 2024-11-07 02:21:30,697 - INFO - Creating Pod ctest-pod-40150471 2024-11-07 02:21:30,753 - DEBUG - Pod : ctest-pod-40150471 UUID is 9a26ac1f-7924-494c-8a27-fe1bfde34f0a 2024-11-07 02:21:30,767 - DEBUG - Pod ctest-pod-88769690 not present 2024-11-07 02:21:30,768 - INFO - Creating Pod ctest-pod-88769690 2024-11-07 02:21:30,835 - DEBUG - Pod : ctest-pod-88769690 UUID is 3888524e-645a-42f0-874a-7865a5abc994 2024-11-07 02:21:30,842 - DEBUG - Pod ctest-pod-09172302 not present 2024-11-07 02:21:30,843 - INFO - Creating Pod ctest-pod-09172302 2024-11-07 02:21:30,888 - DEBUG - Pod : ctest-pod-09172302 UUID is d04e94ee-900a-4de2-b6b9-5925021c2c6b 2024-11-07 02:21:30,891 - DEBUG - Pod ctest-pod-40049244 not present 2024-11-07 02:21:30,892 - INFO - Creating Pod ctest-pod-40049244 2024-11-07 02:21:30,934 - DEBUG - Pod : ctest-pod-40049244 UUID is 3914dbdf-5066-4ec6-8de8-432b4d57b7ed 2024-11-07 02:21:30,941 - DEBUG - Pod ctest-pod-50698494 not present 2024-11-07 02:21:30,941 - INFO - Creating Pod ctest-pod-50698494 2024-11-07 02:21:30,972 - DEBUG - Pod : ctest-pod-50698494 UUID is 90973f4b-9b90-43d5-a34b-9ae516360c15 2024-11-07 02:21:30,974 - DEBUG - Pod ctest-pod-39622927 not present 2024-11-07 02:21:30,975 - INFO - Creating Pod ctest-pod-39622927 2024-11-07 02:21:31,025 - DEBUG - Pod : ctest-pod-39622927 UUID is f0a76023-6453-493a-9210-5a360522b04b 2024-11-07 02:21:31,028 - DEBUG - Pod ctest-pod-26363722 not present 2024-11-07 02:21:31,028 - INFO - Creating Pod ctest-pod-26363722 2024-11-07 02:21:31,048 - DEBUG - Pod : ctest-pod-26363722 UUID is 9d26ac27-d509-4931-b946-cd30100237e0 2024-11-07 02:21:31,051 - DEBUG - Pod ctest-pod-78120253 not present 2024-11-07 02:21:31,051 - INFO - Creating Pod ctest-pod-78120253 2024-11-07 02:21:31,081 - DEBUG - Pod : ctest-pod-78120253 UUID is ac4f6d3d-c11e-4967-ae97-5153cb1e53ee 2024-11-07 02:21:31,260 - INFO - Project default-domain:k8s-ctest-new-default-82584843 for Namespace ctest-new-default-82584843 is seen in contrail-api 2024-11-07 02:21:31,260 - DEBUG - Project uuid in Contrail is 2e108cf0-c747-41b7-baab-513b2bce6223 2024-11-07 02:21:31,423 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_NamespaceDatabaseList?namespace_uuid=37386906-d5a3-4296-a82d-7c5cd3d9eb5e 2024-11-07 02:21:31,429 - INFO - Namespace ctest-new-default-82584843 with uuid 37386906-d5a3-4296-a82d-7c5cd3d9eb5e found in kube manager 2024-11-07 02:21:31,430 - INFO - Namespace ctest-new-default-82584843 verification passed 2024-11-07 02:21:31,710 - INFO - Project default-domain:k8s-ctest-non-default-67912673 for Namespace ctest-non-default-67912673 is seen in contrail-api 2024-11-07 02:21:31,710 - DEBUG - Project uuid in Contrail is 0423c557-12f1-49f2-8c00-b25a5bbdccc7 2024-11-07 02:21:31,710 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_NamespaceDatabaseList?namespace_uuid=907ad805-3e4b-4dd4-817d-4cb18f7ec8f0 2024-11-07 02:21:31,715 - INFO - Namespace ctest-non-default-67912673 with uuid 907ad805-3e4b-4dd4-817d-4cb18f7ec8f0 found in kube manager 2024-11-07 02:21:31,715 - INFO - Namespace ctest-non-default-67912673 verification passed 2024-11-07 02:21:31,721 - DEBUG - Pod ctest-pod-40150471 not in running state.Currently in Pending 2024-11-07 02:21:37,023 - DEBUG - Pod ctest-pod-40150471 not in running state.Currently in Pending 2024-11-07 02:21:42,032 - DEBUG - Pod ctest-pod-40150471 not in running state.Currently in Pending 2024-11-07 02:21:47,042 - INFO - Pod ctest-pod-40150471 is in running state.Got IP 10.47.255.251 2024-11-07 02:21:47,065 - DEBUG - Pod ctest-pod-40150471 has vmi 02d87946-9caf-11ef-9be8-fa163e4efa88 2024-11-07 02:21:47,065 - INFO - Verified pod ctest-pod-40150471 in contrail-api 2024-11-07 02:21:48,620 - DEBUG - VMI 02d87946-9caf-11ef-9be8-fa163e4efa88 is active in agent 10.0.0.33 2024-11-07 02:21:48,620 - INFO - Verified Pod ctest-pod-40150471 in agent 10.0.0.33 2024-11-07 02:21:48,620 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=9a26ac1f-7924-494c-8a27-fe1bfde34f0a 2024-11-07 02:21:48,627 - INFO - Pod ctest-pod-40150471 with uuid 9a26ac1f-7924-494c-8a27-fe1bfde34f0a found in kube manager 2024-11-07 02:21:48,627 - INFO - Pod ctest-pod-40150471 verification passed 2024-11-07 02:21:48,635 - INFO - Pod ctest-pod-88769690 is in running state.Got IP 10.47.255.250 2024-11-07 02:21:48,659 - DEBUG - Pod ctest-pod-88769690 has vmi 0365ec72-9caf-11ef-9be8-fa163e4efa88 2024-11-07 02:21:48,659 - INFO - Verified pod ctest-pod-88769690 in contrail-api 2024-11-07 02:21:48,672 - DEBUG - VMI 0365ec72-9caf-11ef-9be8-fa163e4efa88 is active in agent 10.0.0.33 2024-11-07 02:21:48,672 - INFO - Verified Pod ctest-pod-88769690 in agent 10.0.0.33 2024-11-07 02:21:48,672 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=3888524e-645a-42f0-874a-7865a5abc994 2024-11-07 02:21:48,679 - INFO - Pod ctest-pod-88769690 with uuid 3888524e-645a-42f0-874a-7865a5abc994 found in kube manager 2024-11-07 02:21:48,679 - INFO - Pod ctest-pod-88769690 verification passed 2024-11-07 02:21:48,686 - DEBUG - Pod ctest-pod-09172302 not in running state.Currently in Pending 2024-11-07 02:21:53,699 - INFO - Pod ctest-pod-09172302 is in running state.Got IP 10.47.255.249 2024-11-07 02:21:53,765 - DEBUG - Pod ctest-pod-09172302 has vmi 048463b8-9caf-11ef-9be8-fa163e4efa88 2024-11-07 02:21:53,766 - INFO - Verified pod ctest-pod-09172302 in contrail-api 2024-11-07 02:21:53,779 - DEBUG - VMI 048463b8-9caf-11ef-9be8-fa163e4efa88 is active in agent 10.0.0.33 2024-11-07 02:21:53,779 - INFO - Verified Pod ctest-pod-09172302 in agent 10.0.0.33 2024-11-07 02:21:53,779 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=d04e94ee-900a-4de2-b6b9-5925021c2c6b 2024-11-07 02:21:53,784 - INFO - Pod ctest-pod-09172302 with uuid d04e94ee-900a-4de2-b6b9-5925021c2c6b found in kube manager 2024-11-07 02:21:53,784 - INFO - Pod ctest-pod-09172302 verification passed 2024-11-07 02:21:53,790 - INFO - Pod ctest-pod-40049244 is in running state.Got IP 10.47.255.248 2024-11-07 02:21:53,808 - DEBUG - Pod ctest-pod-40049244 has vmi 0519e9c4-9caf-11ef-9be8-fa163e4efa88 2024-11-07 02:21:53,808 - INFO - Verified pod ctest-pod-40049244 in contrail-api 2024-11-07 02:21:53,821 - DEBUG - VMI 0519e9c4-9caf-11ef-9be8-fa163e4efa88 is active in agent 10.0.0.33 2024-11-07 02:21:53,821 - INFO - Verified Pod ctest-pod-40049244 in agent 10.0.0.33 2024-11-07 02:21:53,822 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=3914dbdf-5066-4ec6-8de8-432b4d57b7ed 2024-11-07 02:21:53,826 - INFO - Pod ctest-pod-40049244 with uuid 3914dbdf-5066-4ec6-8de8-432b4d57b7ed found in kube manager 2024-11-07 02:21:53,826 - INFO - Pod ctest-pod-40049244 verification passed 2024-11-07 02:21:53,832 - INFO - Pod ctest-pod-50698494 is in running state.Got IP 10.47.255.247 2024-11-07 02:21:53,902 - DEBUG - Pod ctest-pod-50698494 has vmi 0639642e-9caf-11ef-9be8-fa163e4efa88 2024-11-07 02:21:53,902 - INFO - Verified pod ctest-pod-50698494 in contrail-api 2024-11-07 02:21:53,916 - DEBUG - VMI 0639642e-9caf-11ef-9be8-fa163e4efa88 is active in agent 10.0.0.33 2024-11-07 02:21:53,917 - INFO - Verified Pod ctest-pod-50698494 in agent 10.0.0.33 2024-11-07 02:21:53,917 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=90973f4b-9b90-43d5-a34b-9ae516360c15 2024-11-07 02:21:53,922 - INFO - Pod ctest-pod-50698494 with uuid 90973f4b-9b90-43d5-a34b-9ae516360c15 found in kube manager 2024-11-07 02:21:53,922 - INFO - Pod ctest-pod-50698494 verification passed 2024-11-07 02:21:53,930 - INFO - Pod ctest-pod-26363722 is in running state.Got IP 10.47.255.245 2024-11-07 02:21:53,994 - DEBUG - Pod ctest-pod-26363722 has vmi 078fa05e-9caf-11ef-9be8-fa163e4efa88 2024-11-07 02:21:53,994 - INFO - Verified pod ctest-pod-26363722 in contrail-api 2024-11-07 02:21:54,010 - DEBUG - VMI 078fa05e-9caf-11ef-9be8-fa163e4efa88 is active in agent 10.0.0.33 2024-11-07 02:21:54,011 - INFO - Verified Pod ctest-pod-26363722 in agent 10.0.0.33 2024-11-07 02:21:54,011 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=9d26ac27-d509-4931-b946-cd30100237e0 2024-11-07 02:21:54,015 - INFO - Pod ctest-pod-26363722 with uuid 9d26ac27-d509-4931-b946-cd30100237e0 found in kube manager 2024-11-07 02:21:54,015 - INFO - Pod ctest-pod-26363722 verification passed 2024-11-07 02:21:54,021 - INFO - Pod ctest-pod-39622927 is in running state.Got IP 10.47.255.246 2024-11-07 02:21:54,040 - DEBUG - Pod ctest-pod-39622927 has vmi 06c6e1a0-9caf-11ef-9be8-fa163e4efa88 2024-11-07 02:21:54,040 - INFO - Verified pod ctest-pod-39622927 in contrail-api 2024-11-07 02:21:54,056 - DEBUG - VMI 06c6e1a0-9caf-11ef-9be8-fa163e4efa88 is active in agent 10.0.0.33 2024-11-07 02:21:54,056 - INFO - Verified Pod ctest-pod-39622927 in agent 10.0.0.33 2024-11-07 02:21:54,057 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=f0a76023-6453-493a-9210-5a360522b04b 2024-11-07 02:21:54,062 - INFO - Pod ctest-pod-39622927 with uuid f0a76023-6453-493a-9210-5a360522b04b found in kube manager 2024-11-07 02:21:54,062 - INFO - Pod ctest-pod-39622927 verification passed 2024-11-07 02:21:54,067 - INFO - Pod ctest-pod-78120253 is in running state.Got IP 10.47.255.244 2024-11-07 02:21:54,145 - DEBUG - Pod ctest-pod-78120253 has vmi 084c49a2-9caf-11ef-9be8-fa163e4efa88 2024-11-07 02:21:54,145 - INFO - Verified pod ctest-pod-78120253 in contrail-api 2024-11-07 02:21:54,159 - DEBUG - VMI 084c49a2-9caf-11ef-9be8-fa163e4efa88 is active in agent 10.0.0.33 2024-11-07 02:21:54,160 - INFO - Verified Pod ctest-pod-78120253 in agent 10.0.0.33 2024-11-07 02:21:54,160 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=ac4f6d3d-c11e-4967-ae97-5153cb1e53ee 2024-11-07 02:21:54,166 - INFO - Pod ctest-pod-78120253 with uuid ac4f6d3d-c11e-4967-ae97-5153cb1e53ee found in kube manager 2024-11-07 02:21:54,166 - INFO - Pod ctest-pod-78120253 verification passed 2024-11-07 02:21:54,167 - INFO - ================================================================================ 2024-11-07 02:21:54,167 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-11-07 02:21:54,167 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-11-07 02:21:54,419 - DEBUG - Nothing to compare xmpp stats {'10.0.0.33': {'10.0.0.23': '0'}} with 2024-11-07 02:21:54,419 - INFO - Initial checks done. Running the testcase now 2024-11-07 02:21:54,419 - INFO - 2024-11-07 02:21:54,491 - DEBUG - [Pod ctest-pod-40150471] Cmd: echo ctest-pod-40150471 > /usr/share/nginx/html/index.html, Output: 2024-11-07 02:21:54,553 - DEBUG - [Pod ctest-pod-88769690] Cmd: echo ctest-pod-88769690 > /usr/share/nginx/html/index.html, Output: 2024-11-07 02:21:54,607 - DEBUG - [Pod ctest-pod-09172302] Cmd: echo ctest-pod-09172302 > /usr/share/nginx/html/index.html, Output: 2024-11-07 02:21:54,672 - DEBUG - [Pod ctest-pod-40049244] Cmd: echo ctest-pod-40049244 > /usr/share/nginx/html/index.html, Output: 2024-11-07 02:21:54,675 - DEBUG - Service ctest-nginx-svc-94396023 not present 2024-11-07 02:21:54,675 - INFO - Creating service ctest-nginx-svc-94396023 2024-11-07 02:21:54,692 - INFO - Created Service ctest-nginx-svc-94396023 2024-11-07 02:21:54,704 - WARNING - Service UUID 3650d86a-b7ec-4341-bef2-0b881edb8097 not yet found in contrail-api 2024-11-07 02:21:55,713 - INFO - Validated that Service ctest-nginx-svc-94396023 is seen in contrail-api 2024-11-07 02:21:55,713 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_LoadbalancerDatabaseList?x=3650d86a-b7ec-4341-bef2-0b881edb8097 2024-11-07 02:21:55,718 - INFO - Service ctest-nginx-svc-94396023 with uuid 3650d86a-b7ec-4341-bef2-0b881edb8097 found in kube manager 2024-11-07 02:21:55,718 - INFO - Service ctest-nginx-svc-94396023 verification passed 2024-11-07 02:21:56,789 - DEBUG - [Pod ctest-pod-50698494] Cmd: wget http://10.98.30.45:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.30.45:80 (10.98.30.45:80) ctest-pod-88769690 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-07 02:21:56,789 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd wget http://10.98.30.45:80/ -O - -T 5 -t 1 passed 2024-11-07 02:21:56,789 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd output: Connecting to 10.98.30.45:80 (10.98.30.45:80) ctest-pod-88769690 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-07 02:21:56,851 - DEBUG - [Pod ctest-pod-50698494] Cmd: wget http://10.98.30.45:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.30.45:80 (10.98.30.45:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-88769690 2024-11-07 02:21:56,851 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd wget http://10.98.30.45:80/ -O - -T 5 -t 1 passed 2024-11-07 02:21:56,851 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd output: Connecting to 10.98.30.45:80 (10.98.30.45:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-88769690 2024-11-07 02:21:58,324 - DEBUG - [Pod ctest-pod-50698494] Cmd: wget http://10.98.30.45:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.30.45:80 (10.98.30.45:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-88769690 2024-11-07 02:21:58,324 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd wget http://10.98.30.45:80/ -O - -T 5 -t 1 passed 2024-11-07 02:21:58,324 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd output: Connecting to 10.98.30.45:80 (10.98.30.45:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-88769690 2024-11-07 02:21:58,395 - DEBUG - [Pod ctest-pod-50698494] Cmd: wget http://10.98.30.45:80/ -O - -T 5 -t 1 , Output: ctest-pod-40150471 Connecting to 10.98.30.45:80 (10.98.30.45:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-07 02:21:58,395 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd wget http://10.98.30.45:80/ -O - -T 5 -t 1 passed 2024-11-07 02:21:58,395 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd output: ctest-pod-40150471 Connecting to 10.98.30.45:80 (10.98.30.45:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-07 02:21:58,395 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-40150471': 1, 'ctest-pod-88769690': 3} 2024-11-07 02:21:58,464 - DEBUG - [Pod ctest-pod-26363722] Cmd: wget http://10.98.30.45:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.30.45:80 (10.98.30.45:80) ctest-pod-40150471 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-07 02:21:58,464 - DEBUG - [Pod Pod ctest-pod-26363722] Cmd wget http://10.98.30.45:80/ -O - -T 5 -t 1 passed 2024-11-07 02:21:58,465 - DEBUG - [Pod Pod ctest-pod-26363722] Cmd output: Connecting to 10.98.30.45:80 (10.98.30.45:80) ctest-pod-40150471 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-07 02:21:58,524 - DEBUG - [Pod ctest-pod-26363722] Cmd: wget http://10.98.30.45:80/ -O - -T 5 -t 1 , Output: ctest-pod-40150471 Connecting to 10.98.30.45:80 (10.98.30.45:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-07 02:21:58,524 - DEBUG - [Pod Pod ctest-pod-26363722] Cmd wget http://10.98.30.45:80/ -O - -T 5 -t 1 passed 2024-11-07 02:21:58,524 - DEBUG - [Pod Pod ctest-pod-26363722] Cmd output: ctest-pod-40150471 Connecting to 10.98.30.45:80 (10.98.30.45:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-07 02:21:58,586 - DEBUG - [Pod ctest-pod-26363722] Cmd: wget http://10.98.30.45:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.30.45:80 (10.98.30.45:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-40150471 2024-11-07 02:21:58,586 - DEBUG - [Pod Pod ctest-pod-26363722] Cmd wget http://10.98.30.45:80/ -O - -T 5 -t 1 passed 2024-11-07 02:21:58,586 - DEBUG - [Pod Pod ctest-pod-26363722] Cmd output: Connecting to 10.98.30.45:80 (10.98.30.45:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-40150471 2024-11-07 02:21:58,646 - DEBUG - [Pod ctest-pod-26363722] Cmd: wget http://10.98.30.45:80/ -O - -T 5 -t 1 , Output: ctest-pod-40150471 Connecting to 10.98.30.45:80 (10.98.30.45:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-07 02:21:58,646 - DEBUG - [Pod Pod ctest-pod-26363722] Cmd wget http://10.98.30.45:80/ -O - -T 5 -t 1 passed 2024-11-07 02:21:58,646 - DEBUG - [Pod Pod ctest-pod-26363722] Cmd output: ctest-pod-40150471 Connecting to 10.98.30.45:80 (10.98.30.45:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-07 02:21:58,712 - DEBUG - [Pod ctest-pod-26363722] Cmd: wget http://10.98.30.45:80/ -O - -T 5 -t 1 , Output: ctest-pod-88769690 Connecting to 10.98.30.45:80 (10.98.30.45:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-07 02:21:58,713 - DEBUG - [Pod Pod ctest-pod-26363722] Cmd wget http://10.98.30.45:80/ -O - -T 5 -t 1 passed 2024-11-07 02:21:58,713 - DEBUG - [Pod Pod ctest-pod-26363722] Cmd output: ctest-pod-88769690 Connecting to 10.98.30.45:80 (10.98.30.45:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-07 02:21:58,713 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-40150471': 4, 'ctest-pod-88769690': 1} 2024-11-07 02:21:58,716 - DEBUG - Network policy ingress-on-service not present 2024-11-07 02:21:58,716 - INFO - Creating Network Policy ingress-on-service 2024-11-07 02:21:59,914 - INFO - Network policy found in k8s 2024-11-07 02:21:59,914 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=5644db45-69d3-4b2c-88d3-1e5b07ed9be1 2024-11-07 02:21:59,923 - INFO - Network Policy ingress-on-service with uuid 5644db45-69d3-4b2c-88d3-1e5b07ed9be1 found in kube manager 2024-11-07 02:22:00,003 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-11-07 02:22:00,003 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-11-07 02:22:00,007 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=5644db45-69d3-4b2c-88d3-1e5b07ed9be1 2024-11-07 02:22:00,056 - WARNING - Network policy with name ingress-on-service not found in agent 2024-11-07 02:22:02,057 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=5644db45-69d3-4b2c-88d3-1e5b07ed9be1 2024-11-07 02:22:02,097 - INFO - Network policy with name ingress-on-service found in agent 2024-11-07 02:22:02,098 - INFO - Network Policy ingress-on-service verification passed 2024-11-07 02:22:07,156 - DEBUG - [Pod ctest-pod-50698494] Cmd: wget http://10.98.30.45:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:22:07,157 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd wget http://10.98.30.45:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:22:07,157 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:22:12,217 - DEBUG - [Pod ctest-pod-50698494] Cmd: wget http://10.98.30.45:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:22:12,218 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd wget http://10.98.30.45:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:22:12,218 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:22:17,289 - DEBUG - [Pod ctest-pod-50698494] Cmd: wget http://10.98.30.45:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:22:17,289 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd wget http://10.98.30.45:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:22:17,289 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:22:22,356 - DEBUG - [Pod ctest-pod-50698494] Cmd: wget http://10.98.30.45:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:22:22,356 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd wget http://10.98.30.45:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:22:22,357 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:22:27,415 - DEBUG - [Pod ctest-pod-50698494] Cmd: wget http://10.98.30.45:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:22:27,415 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd wget http://10.98.30.45:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:22:27,415 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:22:32,474 - DEBUG - [Pod ctest-pod-50698494] Cmd: wget http://10.98.30.45:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:22:32,474 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd wget http://10.98.30.45:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:22:32,474 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:22:38,142 - DEBUG - [Pod ctest-pod-50698494] Cmd: wget http://10.98.30.45:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:22:38,142 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd wget http://10.98.30.45:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:22:38,142 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:22:43,203 - DEBUG - [Pod ctest-pod-50698494] Cmd: wget http://10.98.30.45:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:22:43,203 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd wget http://10.98.30.45:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:22:43,203 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:22:48,286 - DEBUG - [Pod ctest-pod-50698494] Cmd: wget http://10.98.30.45:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:22:48,287 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd wget http://10.98.30.45:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:22:48,287 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:22:53,649 - DEBUG - [Pod ctest-pod-50698494] Cmd: wget http://10.98.30.45:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:22:53,649 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd wget http://10.98.30.45:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:22:53,649 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:22:53,650 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-40150471': 0, 'ctest-pod-88769690': 0} 2024-11-07 02:22:53,719 - DEBUG - [Pod ctest-pod-39622927] Cmd: wget http://10.98.30.45:80/ -O - -T 5 -t 1 , Output: ctest-pod-88769690 Connecting to 10.98.30.45:80 (10.98.30.45:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-07 02:22:53,719 - DEBUG - [Pod Pod ctest-pod-39622927] Cmd wget http://10.98.30.45:80/ -O - -T 5 -t 1 passed 2024-11-07 02:22:53,719 - DEBUG - [Pod Pod ctest-pod-39622927] Cmd output: ctest-pod-88769690 Connecting to 10.98.30.45:80 (10.98.30.45:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-07 02:22:53,782 - DEBUG - [Pod ctest-pod-39622927] Cmd: wget http://10.98.30.45:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.30.45:80 (10.98.30.45:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-40150471 2024-11-07 02:22:53,782 - DEBUG - [Pod Pod ctest-pod-39622927] Cmd wget http://10.98.30.45:80/ -O - -T 5 -t 1 passed 2024-11-07 02:22:53,782 - DEBUG - [Pod Pod ctest-pod-39622927] Cmd output: Connecting to 10.98.30.45:80 (10.98.30.45:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-40150471 2024-11-07 02:22:53,782 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-40150471': 1, 'ctest-pod-88769690': 1} 2024-11-07 02:22:58,850 - DEBUG - [Pod ctest-pod-26363722] Cmd: wget http://10.98.30.45:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:22:58,850 - DEBUG - [Pod Pod ctest-pod-26363722] Cmd wget http://10.98.30.45:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:22:58,850 - DEBUG - [Pod Pod ctest-pod-26363722] Cmd output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:23:03,917 - DEBUG - [Pod ctest-pod-26363722] Cmd: wget http://10.98.30.45:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:23:03,917 - DEBUG - [Pod Pod ctest-pod-26363722] Cmd wget http://10.98.30.45:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:23:03,917 - DEBUG - [Pod Pod ctest-pod-26363722] Cmd output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:23:08,997 - DEBUG - [Pod ctest-pod-26363722] Cmd: wget http://10.98.30.45:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:23:08,997 - DEBUG - [Pod Pod ctest-pod-26363722] Cmd wget http://10.98.30.45:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:23:08,997 - DEBUG - [Pod Pod ctest-pod-26363722] Cmd output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:23:14,061 - DEBUG - [Pod ctest-pod-26363722] Cmd: wget http://10.98.30.45:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:23:14,061 - DEBUG - [Pod Pod ctest-pod-26363722] Cmd wget http://10.98.30.45:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:23:14,062 - DEBUG - [Pod Pod ctest-pod-26363722] Cmd output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:23:19,126 - DEBUG - [Pod ctest-pod-26363722] Cmd: wget http://10.98.30.45:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:23:19,126 - DEBUG - [Pod Pod ctest-pod-26363722] Cmd wget http://10.98.30.45:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:23:19,126 - DEBUG - [Pod Pod ctest-pod-26363722] Cmd output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:23:24,170 - DEBUG - [Pod ctest-pod-26363722] Cmd: wget http://10.98.30.45:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:23:24,171 - DEBUG - [Pod Pod ctest-pod-26363722] Cmd wget http://10.98.30.45:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:23:24,171 - DEBUG - [Pod Pod ctest-pod-26363722] Cmd output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:23:29,226 - DEBUG - [Pod ctest-pod-26363722] Cmd: wget http://10.98.30.45:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:23:29,226 - DEBUG - [Pod Pod ctest-pod-26363722] Cmd wget http://10.98.30.45:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:23:29,226 - DEBUG - [Pod Pod ctest-pod-26363722] Cmd output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:23:34,293 - DEBUG - [Pod ctest-pod-26363722] Cmd: wget http://10.98.30.45:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:23:34,294 - DEBUG - [Pod Pod ctest-pod-26363722] Cmd wget http://10.98.30.45:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:23:34,294 - DEBUG - [Pod Pod ctest-pod-26363722] Cmd output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:23:39,722 - DEBUG - [Pod ctest-pod-26363722] Cmd: wget http://10.98.30.45:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:23:39,722 - DEBUG - [Pod Pod ctest-pod-26363722] Cmd wget http://10.98.30.45:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:23:39,722 - DEBUG - [Pod Pod ctest-pod-26363722] Cmd output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:23:44,791 - DEBUG - [Pod ctest-pod-26363722] Cmd: wget http://10.98.30.45:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:23:44,791 - DEBUG - [Pod Pod ctest-pod-26363722] Cmd wget http://10.98.30.45:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:23:44,791 - DEBUG - [Pod Pod ctest-pod-26363722] Cmd output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:23:44,791 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-40150471': 0, 'ctest-pod-88769690': 0} 2024-11-07 02:23:46,894 - DEBUG - [Pod ctest-pod-39622927] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.075 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.081 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.099 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.081/0.418/1.075 ms 2024-11-07 02:23:46,894 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-39622927 with expectation True passed 2024-11-07 02:23:48,962 - DEBUG - [Pod ctest-pod-50698494] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.694 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.086 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.132 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.086/0.304/0.694 ms 2024-11-07 02:23:48,962 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-50698494 with expectation True passed 2024-11-07 02:23:51,058 - DEBUG - [Pod ctest-pod-26363722] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.311 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.079 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.105 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.079/0.498/1.311 ms 2024-11-07 02:23:51,058 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-26363722 with expectation True passed 2024-11-07 02:23:51,123 - DEBUG - [Pod ctest-pod-39622927] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-07 02:23:51,123 - DEBUG - [Pod Pod ctest-pod-39622927] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-11-07 02:23:51,123 - DEBUG - [Pod Pod ctest-pod-39622927] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-07 02:23:51,123 - INFO - wget check of of http://10.47.255.251 from ctest-pod-39622927 passed 2024-11-07 02:23:51,174 - DEBUG - [Pod ctest-pod-39622927] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-07 02:23:51,174 - DEBUG - [Pod Pod ctest-pod-39622927] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-11-07 02:23:51,174 - DEBUG - [Pod Pod ctest-pod-39622927] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-07 02:23:51,174 - INFO - wget check of of http://10.47.255.250 from ctest-pod-39622927 passed 2024-11-07 02:23:56,237 - DEBUG - [Pod ctest-pod-50698494] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-07 02:23:56,237 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-07 02:23:56,237 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-07 02:23:56,237 - INFO - wget check of of http://10.47.255.250 from ctest-pod-50698494 passed 2024-11-07 02:24:01,306 - DEBUG - [Pod ctest-pod-78120253] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-11-07 02:24:01,306 - DEBUG - [Pod Pod ctest-pod-78120253] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-11-07 02:24:01,306 - DEBUG - [Pod Pod ctest-pod-78120253] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-11-07 02:24:01,306 - INFO - wget check of of http://10.47.255.251 from ctest-pod-78120253 passed 2024-11-07 02:24:01,317 - INFO - Updating Network Policy ingress-on-service 2024-11-07 02:24:06,392 - DEBUG - [Pod ctest-pod-50698494] Cmd: wget http://10.98.30.45:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:24:06,393 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd wget http://10.98.30.45:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:24:06,393 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:24:11,463 - DEBUG - [Pod ctest-pod-50698494] Cmd: wget http://10.98.30.45:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:24:11,463 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd wget http://10.98.30.45:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:24:11,463 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:24:16,513 - DEBUG - [Pod ctest-pod-50698494] Cmd: wget http://10.98.30.45:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:24:16,513 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd wget http://10.98.30.45:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:24:16,513 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:24:21,571 - DEBUG - [Pod ctest-pod-50698494] Cmd: wget http://10.98.30.45:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:24:21,571 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd wget http://10.98.30.45:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:24:21,571 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:24:26,630 - DEBUG - [Pod ctest-pod-50698494] Cmd: wget http://10.98.30.45:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:24:26,630 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd wget http://10.98.30.45:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:24:26,630 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:24:31,689 - DEBUG - [Pod ctest-pod-50698494] Cmd: wget http://10.98.30.45:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:24:31,689 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd wget http://10.98.30.45:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:24:31,689 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:24:36,769 - DEBUG - [Pod ctest-pod-50698494] Cmd: wget http://10.98.30.45:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:24:36,770 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd wget http://10.98.30.45:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:24:36,770 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:24:41,854 - DEBUG - [Pod ctest-pod-50698494] Cmd: wget http://10.98.30.45:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:24:41,855 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd wget http://10.98.30.45:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:24:41,855 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:24:46,922 - DEBUG - [Pod ctest-pod-50698494] Cmd: wget http://10.98.30.45:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:24:46,923 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd wget http://10.98.30.45:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:24:46,923 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:24:51,997 - DEBUG - [Pod ctest-pod-50698494] Cmd: wget http://10.98.30.45:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:24:51,997 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd wget http://10.98.30.45:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:24:51,997 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd output: Connecting to 10.98.30.45:80 (10.98.30.45:80) wget: download timed out 2024-11-07 02:24:51,997 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-40150471': 0, 'ctest-pod-88769690': 0} 2024-11-07 02:24:52,075 - DEBUG - [Pod ctest-pod-39622927] Cmd: wget http://10.98.30.45:80/ -O - -T 5 -t 1 , Output: ctest-pod-88769690 Connecting to 10.98.30.45:80 (10.98.30.45:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-07 02:24:52,075 - DEBUG - [Pod Pod ctest-pod-39622927] Cmd wget http://10.98.30.45:80/ -O - -T 5 -t 1 passed 2024-11-07 02:24:52,075 - DEBUG - [Pod Pod ctest-pod-39622927] Cmd output: ctest-pod-88769690 Connecting to 10.98.30.45:80 (10.98.30.45:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-07 02:24:52,137 - DEBUG - [Pod ctest-pod-39622927] Cmd: wget http://10.98.30.45:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.30.45:80 (10.98.30.45:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-88769690 2024-11-07 02:24:52,138 - DEBUG - [Pod Pod ctest-pod-39622927] Cmd wget http://10.98.30.45:80/ -O - -T 5 -t 1 passed 2024-11-07 02:24:52,138 - DEBUG - [Pod Pod ctest-pod-39622927] Cmd output: Connecting to 10.98.30.45:80 (10.98.30.45:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-88769690 2024-11-07 02:24:52,203 - DEBUG - [Pod ctest-pod-39622927] Cmd: wget http://10.98.30.45:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.30.45:80 (10.98.30.45:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-88769690 2024-11-07 02:24:52,203 - DEBUG - [Pod Pod ctest-pod-39622927] Cmd wget http://10.98.30.45:80/ -O - -T 5 -t 1 passed 2024-11-07 02:24:52,203 - DEBUG - [Pod Pod ctest-pod-39622927] Cmd output: Connecting to 10.98.30.45:80 (10.98.30.45:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-88769690 2024-11-07 02:24:52,265 - DEBUG - [Pod ctest-pod-39622927] Cmd: wget http://10.98.30.45:80/ -O - -T 5 -t 1 , Output: ctest-pod-40150471 Connecting to 10.98.30.45:80 (10.98.30.45:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-07 02:24:52,265 - DEBUG - [Pod Pod ctest-pod-39622927] Cmd wget http://10.98.30.45:80/ -O - -T 5 -t 1 passed 2024-11-07 02:24:52,265 - DEBUG - [Pod Pod ctest-pod-39622927] Cmd output: ctest-pod-40150471 Connecting to 10.98.30.45:80 (10.98.30.45:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-07 02:24:52,265 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-40150471': 1, 'ctest-pod-88769690': 3} 2024-11-07 02:24:52,354 - DEBUG - [Pod ctest-pod-26363722] Cmd: wget http://10.98.30.45:80/ -O - -T 5 -t 1 , Output: ctest-pod-88769690 Connecting to 10.98.30.45:80 (10.98.30.45:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-07 02:24:52,354 - DEBUG - [Pod Pod ctest-pod-26363722] Cmd wget http://10.98.30.45:80/ -O - -T 5 -t 1 passed 2024-11-07 02:24:52,354 - DEBUG - [Pod Pod ctest-pod-26363722] Cmd output: ctest-pod-88769690 Connecting to 10.98.30.45:80 (10.98.30.45:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-07 02:24:52,419 - DEBUG - [Pod ctest-pod-26363722] Cmd: wget http://10.98.30.45:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.30.45:80 (10.98.30.45:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-40150471 2024-11-07 02:24:52,419 - DEBUG - [Pod Pod ctest-pod-26363722] Cmd wget http://10.98.30.45:80/ -O - -T 5 -t 1 passed 2024-11-07 02:24:52,419 - DEBUG - [Pod Pod ctest-pod-26363722] Cmd output: Connecting to 10.98.30.45:80 (10.98.30.45:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-40150471 2024-11-07 02:24:52,419 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-40150471': 1, 'ctest-pod-88769690': 1} 2024-11-07 02:24:54,474 - DEBUG - [Pod ctest-pod-39622927] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.425 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.095 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.093 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.093/0.204/0.425 ms 2024-11-07 02:24:54,474 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-39622927 with expectation True passed 2024-11-07 02:24:56,543 - DEBUG - [Pod ctest-pod-50698494] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.572 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.091 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.114 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.091/0.259/0.572 ms 2024-11-07 02:24:56,543 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-50698494 with expectation True passed 2024-11-07 02:24:58,606 - DEBUG - [Pod ctest-pod-26363722] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.659 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.086 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.146 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.086/0.630/1.659 ms 2024-11-07 02:24:58,606 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-26363722 with expectation True passed 2024-11-07 02:24:58,675 - DEBUG - [Pod ctest-pod-39622927] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-07 02:24:58,675 - DEBUG - [Pod Pod ctest-pod-39622927] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-11-07 02:24:58,675 - DEBUG - [Pod Pod ctest-pod-39622927] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-07 02:24:58,676 - INFO - wget check of of http://10.47.255.251 from ctest-pod-39622927 passed 2024-11-07 02:24:58,755 - DEBUG - [Pod ctest-pod-39622927] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-07 02:24:58,755 - DEBUG - [Pod Pod ctest-pod-39622927] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-11-07 02:24:58,755 - DEBUG - [Pod Pod ctest-pod-39622927] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-07 02:24:58,755 - INFO - wget check of of http://10.47.255.250 from ctest-pod-39622927 passed 2024-11-07 02:25:03,819 - DEBUG - [Pod ctest-pod-50698494] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-07 02:25:03,819 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-07 02:25:03,819 - DEBUG - [Pod Pod ctest-pod-50698494] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-07 02:25:03,819 - INFO - wget check of of http://10.47.255.250 from ctest-pod-50698494 passed 2024-11-07 02:25:03,885 - DEBUG - [Pod ctest-pod-78120253] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-07 02:25:03,886 - DEBUG - [Pod Pod ctest-pod-78120253] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-11-07 02:25:03,886 - DEBUG - [Pod Pod ctest-pod-78120253] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-07 02:25:03,886 - INFO - wget check of of http://10.47.255.251 from ctest-pod-78120253 passed 2024-11-07 02:25:03,886 - INFO - Deleting Network Policy : ingress-on-service 2024-11-07 02:25:03,887 - INFO - Deleting service : ctest-nginx-svc-94396023 2024-11-07 02:25:04,094 - DEBUG - No XMPP flaps were noticed during the test
2024-11-07 02:25:04,094 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:10]
2024-11-07 02:25:04,094 - INFO - -------------------------------------------------------------------------------- 2024-11-07 02:25:04,103 - INFO - Deleting pod ctest-new-default-82584843:ctest-pod-40150471 2024-11-07 02:25:04,105 - INFO - Deleting pod ctest-new-default-82584843:ctest-pod-88769690 2024-11-07 02:25:04,106 - INFO - Deleting pod ctest-non-default-67912673:ctest-pod-09172302 2024-11-07 02:25:04,107 - INFO - Deleting pod ctest-non-default-67912673:ctest-pod-40049244 2024-11-07 02:25:04,109 - INFO - Deleting pod ctest-new-default-82584843:ctest-pod-50698494 2024-11-07 02:25:04,111 - INFO - Deleting pod ctest-new-default-82584843:ctest-pod-39622927 2024-11-07 02:25:04,112 - INFO - Deleting pod ctest-non-default-67912673:ctest-pod-26363722 2024-11-07 02:25:04,112 - INFO - Deleting pod ctest-non-default-67912673:ctest-pod-78120253 2024-11-07 02:25:04,222 - WARNING - Pod uuid 9a26ac1f-7924-494c-8a27-fe1bfde34f0a is still seen in agent 10.0.0.33 VM list 2024-11-07 02:25:04,378 - WARNING - Pod uuid ac4f6d3d-c11e-4967-ae97-5153cb1e53ee is still seen in agent 10.0.0.33 VM list 2024-11-07 02:25:04,378 - WARNING - Pod uuid 3888524e-645a-42f0-874a-7865a5abc994 is still seen in agent 10.0.0.33 VM list 2024-11-07 02:25:04,379 - WARNING - Pod uuid d04e94ee-900a-4de2-b6b9-5925021c2c6b is still seen in agent 10.0.0.33 VM list 2024-11-07 02:25:04,380 - WARNING - Pod uuid 90973f4b-9b90-43d5-a34b-9ae516360c15 is still seen in agent 10.0.0.33 VM list 2024-11-07 02:25:04,380 - WARNING - Pod uuid 3914dbdf-5066-4ec6-8de8-432b4d57b7ed is still seen in agent 10.0.0.33 VM list 2024-11-07 02:25:04,381 - WARNING - Pod uuid f0a76023-6453-493a-9210-5a360522b04b is still seen in agent 10.0.0.33 VM list 2024-11-07 02:25:04,381 - WARNING - Pod uuid 9d26ac27-d509-4931-b946-cd30100237e0 is still seen in agent 10.0.0.33 VM list 2024-11-07 02:25:09,231 - DEBUG - Pod 9a26ac1f-7924-494c-8a27-fe1bfde34f0a is not in agent 10.0.0.33 VM list 2024-11-07 02:25:09,414 - WARNING - Pod uuid 9d26ac27-d509-4931-b946-cd30100237e0 is still seen in agent 10.0.0.33 VM list 2024-11-07 02:25:09,416 - DEBUG - Pod 3888524e-645a-42f0-874a-7865a5abc994 is not in agent 10.0.0.33 VM list 2024-11-07 02:25:09,418 - WARNING - Pod uuid ac4f6d3d-c11e-4967-ae97-5153cb1e53ee is still seen in agent 10.0.0.33 VM list 2024-11-07 02:25:09,419 - WARNING - Pod uuid 90973f4b-9b90-43d5-a34b-9ae516360c15 is still seen in agent 10.0.0.33 VM list 2024-11-07 02:25:09,423 - DEBUG - Pod 3914dbdf-5066-4ec6-8de8-432b4d57b7ed is not in agent 10.0.0.33 VM list 2024-11-07 02:25:09,429 - DEBUG - Pod d04e94ee-900a-4de2-b6b9-5925021c2c6b is not in agent 10.0.0.33 VM list 2024-11-07 02:25:09,433 - WARNING - Pod uuid f0a76023-6453-493a-9210-5a360522b04b is still seen in agent 10.0.0.33 VM list 2024-11-07 02:25:09,450 - DEBUG - VMI 048463b8-9caf-11ef-9be8-fa163e4efa88 is removed from agent 10.0.0.33 2024-11-07 02:25:09,450 - INFO - Verified that pod ctest-pod-09172302 is removed in agent 2024-11-07 02:25:09,451 - DEBUG - VMI 0519e9c4-9caf-11ef-9be8-fa163e4efa88 is removed from agent 10.0.0.33 2024-11-07 02:25:09,451 - INFO - Verified that pod ctest-pod-40049244 is removed in agent 2024-11-07 02:25:09,451 - DEBUG - VMI 0365ec72-9caf-11ef-9be8-fa163e4efa88 is removed from agent 10.0.0.33 2024-11-07 02:25:09,451 - INFO - Verified that pod ctest-pod-88769690 is removed in agent 2024-11-07 02:25:10,219 - DEBUG - VMI 02d87946-9caf-11ef-9be8-fa163e4efa88 is removed from agent 10.0.0.33 2024-11-07 02:25:10,219 - INFO - Verified that pod ctest-pod-40150471 is removed in agent 2024-11-07 02:25:14,423 - WARNING - Pod uuid 9d26ac27-d509-4931-b946-cd30100237e0 is still seen in agent 10.0.0.33 VM list 2024-11-07 02:25:14,431 - WARNING - Pod uuid ac4f6d3d-c11e-4967-ae97-5153cb1e53ee is still seen in agent 10.0.0.33 VM list 2024-11-07 02:25:14,431 - WARNING - Pod uuid 90973f4b-9b90-43d5-a34b-9ae516360c15 is still seen in agent 10.0.0.33 VM list 2024-11-07 02:25:14,441 - WARNING - Pod uuid f0a76023-6453-493a-9210-5a360522b04b is still seen in agent 10.0.0.33 VM list 2024-11-07 02:25:19,436 - WARNING - Pod uuid 9d26ac27-d509-4931-b946-cd30100237e0 is still seen in agent 10.0.0.33 VM list 2024-11-07 02:25:19,443 - WARNING - Pod uuid 90973f4b-9b90-43d5-a34b-9ae516360c15 is still seen in agent 10.0.0.33 VM list 2024-11-07 02:25:19,445 - WARNING - Pod uuid ac4f6d3d-c11e-4967-ae97-5153cb1e53ee is still seen in agent 10.0.0.33 VM list 2024-11-07 02:25:19,450 - WARNING - Pod uuid f0a76023-6453-493a-9210-5a360522b04b is still seen in agent 10.0.0.33 VM list 2024-11-07 02:25:24,448 - WARNING - Pod uuid 9d26ac27-d509-4931-b946-cd30100237e0 is still seen in agent 10.0.0.33 VM list 2024-11-07 02:25:24,461 - WARNING - Pod uuid ac4f6d3d-c11e-4967-ae97-5153cb1e53ee is still seen in agent 10.0.0.33 VM list 2024-11-07 02:25:24,461 - WARNING - Pod uuid f0a76023-6453-493a-9210-5a360522b04b is still seen in agent 10.0.0.33 VM list 2024-11-07 02:25:24,462 - WARNING - Pod uuid 90973f4b-9b90-43d5-a34b-9ae516360c15 is still seen in agent 10.0.0.33 VM list 2024-11-07 02:25:29,457 - WARNING - Pod uuid 9d26ac27-d509-4931-b946-cd30100237e0 is still seen in agent 10.0.0.33 VM list 2024-11-07 02:25:29,475 - WARNING - Pod uuid ac4f6d3d-c11e-4967-ae97-5153cb1e53ee is still seen in agent 10.0.0.33 VM list 2024-11-07 02:25:29,477 - WARNING - Pod uuid 90973f4b-9b90-43d5-a34b-9ae516360c15 is still seen in agent 10.0.0.33 VM list 2024-11-07 02:25:29,477 - WARNING - Pod uuid f0a76023-6453-493a-9210-5a360522b04b is still seen in agent 10.0.0.33 VM list 2024-11-07 02:25:34,465 - WARNING - Pod uuid 9d26ac27-d509-4931-b946-cd30100237e0 is still seen in agent 10.0.0.33 VM list 2024-11-07 02:25:34,487 - WARNING - Pod uuid ac4f6d3d-c11e-4967-ae97-5153cb1e53ee is still seen in agent 10.0.0.33 VM list 2024-11-07 02:25:34,488 - WARNING - Pod uuid 90973f4b-9b90-43d5-a34b-9ae516360c15 is still seen in agent 10.0.0.33 VM list 2024-11-07 02:25:34,489 - WARNING - Pod uuid f0a76023-6453-493a-9210-5a360522b04b is still seen in agent 10.0.0.33 VM list 2024-11-07 02:25:39,474 - DEBUG - Pod 9d26ac27-d509-4931-b946-cd30100237e0 is not in agent 10.0.0.33 VM list 2024-11-07 02:25:39,480 - DEBUG - VMI 078fa05e-9caf-11ef-9be8-fa163e4efa88 is removed from agent 10.0.0.33 2024-11-07 02:25:39,480 - INFO - Verified that pod ctest-pod-26363722 is removed in agent 2024-11-07 02:25:39,501 - DEBUG - Pod ac4f6d3d-c11e-4967-ae97-5153cb1e53ee is not in agent 10.0.0.33 VM list 2024-11-07 02:25:39,504 - DEBUG - Pod f0a76023-6453-493a-9210-5a360522b04b is not in agent 10.0.0.33 VM list 2024-11-07 02:25:39,506 - DEBUG - Pod 90973f4b-9b90-43d5-a34b-9ae516360c15 is not in agent 10.0.0.33 VM list 2024-11-07 02:25:39,516 - DEBUG - VMI 084c49a2-9caf-11ef-9be8-fa163e4efa88 is removed from agent 10.0.0.33 2024-11-07 02:25:39,516 - INFO - Verified that pod ctest-pod-78120253 is removed in agent 2024-11-07 02:25:39,518 - DEBUG - VMI 06c6e1a0-9caf-11ef-9be8-fa163e4efa88 is removed from agent 10.0.0.33 2024-11-07 02:25:39,518 - INFO - Verified that pod ctest-pod-39622927 is removed in agent 2024-11-07 02:25:39,518 - DEBUG - VMI 0639642e-9caf-11ef-9be8-fa163e4efa88 is removed from agent 10.0.0.33 2024-11-07 02:25:39,518 - INFO - Verified that pod ctest-pod-50698494 is removed in agent 2024-11-07 02:25:39,518 - INFO - Deleting namespace ctest-non-default-67912673 2024-11-07 02:25:39,536 - DEBUG - Namespace ctest-non-default-67912673 still in k8s 2024-11-07 02:25:41,540 - DEBUG - Namespace ctest-non-default-67912673 still in k8s 2024-11-07 02:25:43,545 - DEBUG - Namespace ctest-non-default-67912673 still in k8s 2024-11-07 02:25:45,555 - DEBUG - Namespace ctest-non-default-67912673 is not in k8s 2024-11-07 02:25:45,555 - DEBUG - No need to check project deletion in contrail-api 2024-11-07 02:25:45,555 - INFO - Deleting namespace ctest-new-default-82584843 2024-11-07 02:25:45,574 - DEBUG - Namespace ctest-new-default-82584843 still in k8s 2024-11-07 02:25:47,580 - DEBUG - Namespace ctest-new-default-82584843 still in k8s 2024-11-07 02:25:49,585 - DEBUG - Namespace ctest-new-default-82584843 still in k8s 2024-11-07 02:25:51,590 - DEBUG - Namespace ctest-new-default-82584843 is not in k8s 2024-11-07 02:25:51,590 - DEBUG - No need to check project deletion in contrail-api