2024-11-10 23:01:37,308 - INFO - Using existing project ['default-domain', 'k8s-default'](c238cba9-5edc-40b5-b545-e8da153e01ee) 2024-11-10 23:01:37,327 - DEBUG - Namespace ctest-new-default-06338857 not present 2024-11-10 23:01:37,340 - INFO - Created namespace ctest-new-default-06338857 2024-11-10 23:01:40,361 - DEBUG - Namespace ctest-non-default-81025637 not present 2024-11-10 23:01:40,378 - INFO - Created namespace ctest-non-default-81025637 2024-11-10 23:01:43,407 - DEBUG - Pod ctest-pod-05984563 not present 2024-11-10 23:01:43,407 - INFO - Creating Pod ctest-pod-05984563 2024-11-10 23:01:43,443 - DEBUG - Pod : ctest-pod-05984563 UUID is 0c32b679-24f2-48f0-affc-235363d58310 2024-11-10 23:01:43,445 - DEBUG - Pod ctest-pod-45067379 not present 2024-11-10 23:01:43,445 - INFO - Creating Pod ctest-pod-45067379 2024-11-10 23:01:43,472 - DEBUG - Pod : ctest-pod-45067379 UUID is 2c216b6d-81a5-4267-a650-622ed514d471 2024-11-10 23:01:43,477 - DEBUG - Pod ctest-pod-94026147 not present 2024-11-10 23:01:43,477 - INFO - Creating Pod ctest-pod-94026147 2024-11-10 23:01:43,496 - DEBUG - Pod : ctest-pod-94026147 UUID is 608d0773-4e21-4291-89b5-04d9e0cebb70 2024-11-10 23:01:43,500 - DEBUG - Pod ctest-pod-67259134 not present 2024-11-10 23:01:43,500 - INFO - Creating Pod ctest-pod-67259134 2024-11-10 23:01:43,517 - DEBUG - Pod : ctest-pod-67259134 UUID is d97aa51d-bd83-4b5a-8867-b23ac2d627e9 2024-11-10 23:01:43,524 - DEBUG - Pod ctest-pod-65282988 not present 2024-11-10 23:01:43,525 - INFO - Creating Pod ctest-pod-65282988 2024-11-10 23:01:43,552 - DEBUG - Pod : ctest-pod-65282988 UUID is 9cacae5d-3f12-434a-b06a-fd8c6434cd28 2024-11-10 23:01:43,558 - DEBUG - Pod ctest-pod-69590020 not present 2024-11-10 23:01:43,558 - INFO - Creating Pod ctest-pod-69590020 2024-11-10 23:01:43,576 - DEBUG - Pod : ctest-pod-69590020 UUID is f8ae6d11-e0f2-413f-8830-f83ea3c3a131 2024-11-10 23:01:43,580 - DEBUG - Pod ctest-pod-73330160 not present 2024-11-10 23:01:43,581 - INFO - Creating Pod ctest-pod-73330160 2024-11-10 23:01:43,597 - DEBUG - Pod : ctest-pod-73330160 UUID is 9f542e79-b7c7-44cb-b50b-0724128f117e 2024-11-10 23:01:43,599 - DEBUG - Pod ctest-pod-94453294 not present 2024-11-10 23:01:43,599 - INFO - Creating Pod ctest-pod-94453294 2024-11-10 23:01:43,612 - DEBUG - Pod : ctest-pod-94453294 UUID is 38e2cf56-5f47-409d-a60a-50b18f658db5 2024-11-10 23:01:43,781 - INFO - Project default-domain:k8s-ctest-new-default-06338857 for Namespace ctest-new-default-06338857 is seen in contrail-api 2024-11-10 23:01:43,781 - DEBUG - Project uuid in Contrail is 0e2bd6a8-c072-4ba4-9091-e3ee51671779 2024-11-10 23:01:43,925 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_NamespaceDatabaseList?namespace_uuid=4162ea9a-3d5d-4504-9bcb-c44a2e1628ca 2024-11-10 23:01:43,933 - INFO - Namespace ctest-new-default-06338857 with uuid 4162ea9a-3d5d-4504-9bcb-c44a2e1628ca found in kube manager 2024-11-10 23:01:43,933 - INFO - Namespace ctest-new-default-06338857 verification passed 2024-11-10 23:01:44,178 - INFO - Project default-domain:k8s-ctest-non-default-81025637 for Namespace ctest-non-default-81025637 is seen in contrail-api 2024-11-10 23:01:44,178 - DEBUG - Project uuid in Contrail is 9d5650f0-89fb-4140-87f6-c83375a77430 2024-11-10 23:01:44,178 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_NamespaceDatabaseList?namespace_uuid=470ff5b0-b816-4c01-8896-11d46242f2fe 2024-11-10 23:01:44,183 - INFO - Namespace ctest-non-default-81025637 with uuid 470ff5b0-b816-4c01-8896-11d46242f2fe found in kube manager 2024-11-10 23:01:44,183 - INFO - Namespace ctest-non-default-81025637 verification passed 2024-11-10 23:01:44,189 - DEBUG - Pod ctest-pod-05984563 not in running state.Currently in Pending 2024-11-10 23:01:49,196 - DEBUG - Pod ctest-pod-05984563 not in running state.Currently in Pending 2024-11-10 23:01:54,202 - INFO - Pod ctest-pod-05984563 is in running state.Got IP 10.47.255.251 2024-11-10 23:01:54,267 - DEBUG - Pod ctest-pod-05984563 has vmi c2076196-9fb7-11ef-9b49-fa163e0b84e2 2024-11-10 23:01:54,268 - INFO - Verified pod ctest-pod-05984563 in contrail-api 2024-11-10 23:01:54,296 - DEBUG - VMI c2076196-9fb7-11ef-9b49-fa163e0b84e2 is active in agent 10.0.0.30 2024-11-10 23:01:54,296 - INFO - Verified Pod ctest-pod-05984563 in agent 10.0.0.30 2024-11-10 23:01:54,297 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=0c32b679-24f2-48f0-affc-235363d58310 2024-11-10 23:01:54,301 - INFO - Pod ctest-pod-05984563 with uuid 0c32b679-24f2-48f0-affc-235363d58310 found in kube manager 2024-11-10 23:01:54,301 - INFO - Pod ctest-pod-05984563 verification passed 2024-11-10 23:01:54,306 - DEBUG - Pod ctest-pod-45067379 not in running state.Currently in Pending 2024-11-10 23:01:59,313 - INFO - Pod ctest-pod-45067379 is in running state.Got IP 10.47.255.250 2024-11-10 23:01:59,332 - DEBUG - Pod ctest-pod-45067379 has vmi c2a22fd2-9fb7-11ef-9b49-fa163e0b84e2 2024-11-10 23:01:59,332 - INFO - Verified pod ctest-pod-45067379 in contrail-api 2024-11-10 23:01:59,371 - DEBUG - VMI c2a22fd2-9fb7-11ef-9b49-fa163e0b84e2 is active in agent 10.0.0.30 2024-11-10 23:01:59,371 - INFO - Verified Pod ctest-pod-45067379 in agent 10.0.0.30 2024-11-10 23:01:59,372 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=2c216b6d-81a5-4267-a650-622ed514d471 2024-11-10 23:01:59,380 - INFO - Pod ctest-pod-45067379 with uuid 2c216b6d-81a5-4267-a650-622ed514d471 found in kube manager 2024-11-10 23:01:59,380 - INFO - Pod ctest-pod-45067379 verification passed 2024-11-10 23:01:59,385 - INFO - Pod ctest-pod-94026147 is in running state.Got IP 10.47.255.249 2024-11-10 23:01:59,403 - DEBUG - Pod ctest-pod-94026147 has vmi c345f950-9fb7-11ef-9b49-fa163e0b84e2 2024-11-10 23:01:59,403 - INFO - Verified pod ctest-pod-94026147 in contrail-api 2024-11-10 23:01:59,450 - DEBUG - VMI c345f950-9fb7-11ef-9b49-fa163e0b84e2 is active in agent 10.0.0.30 2024-11-10 23:01:59,450 - INFO - Verified Pod ctest-pod-94026147 in agent 10.0.0.30 2024-11-10 23:01:59,450 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=608d0773-4e21-4291-89b5-04d9e0cebb70 2024-11-10 23:01:59,455 - INFO - Pod ctest-pod-94026147 with uuid 608d0773-4e21-4291-89b5-04d9e0cebb70 found in kube manager 2024-11-10 23:01:59,455 - INFO - Pod ctest-pod-94026147 verification passed 2024-11-10 23:01:59,461 - INFO - Pod ctest-pod-67259134 is in running state.Got IP 10.47.255.248 2024-11-10 23:01:59,519 - DEBUG - Pod ctest-pod-67259134 has vmi c3d33acc-9fb7-11ef-9b49-fa163e0b84e2 2024-11-10 23:01:59,519 - INFO - Verified pod ctest-pod-67259134 in contrail-api 2024-11-10 23:01:59,542 - DEBUG - VMI c3d33acc-9fb7-11ef-9b49-fa163e0b84e2 is active in agent 10.0.0.30 2024-11-10 23:01:59,542 - INFO - Verified Pod ctest-pod-67259134 in agent 10.0.0.30 2024-11-10 23:01:59,542 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=d97aa51d-bd83-4b5a-8867-b23ac2d627e9 2024-11-10 23:01:59,546 - INFO - Pod ctest-pod-67259134 with uuid d97aa51d-bd83-4b5a-8867-b23ac2d627e9 found in kube manager 2024-11-10 23:01:59,547 - INFO - Pod ctest-pod-67259134 verification passed 2024-11-10 23:01:59,551 - DEBUG - Pod ctest-pod-65282988 not in running state.Currently in Pending 2024-11-10 23:02:04,557 - INFO - Pod ctest-pod-65282988 is in running state.Got IP 10.47.255.247 2024-11-10 23:02:04,576 - DEBUG - Pod ctest-pod-65282988 has vmi c46f59de-9fb7-11ef-9b49-fa163e0b84e2 2024-11-10 23:02:04,577 - INFO - Verified pod ctest-pod-65282988 in contrail-api 2024-11-10 23:02:04,608 - DEBUG - VMI c46f59de-9fb7-11ef-9b49-fa163e0b84e2 is active in agent 10.0.0.30 2024-11-10 23:02:04,608 - INFO - Verified Pod ctest-pod-65282988 in agent 10.0.0.30 2024-11-10 23:02:04,608 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=9cacae5d-3f12-434a-b06a-fd8c6434cd28 2024-11-10 23:02:04,613 - INFO - Pod ctest-pod-65282988 with uuid 9cacae5d-3f12-434a-b06a-fd8c6434cd28 found in kube manager 2024-11-10 23:02:04,613 - INFO - Pod ctest-pod-65282988 verification passed 2024-11-10 23:02:04,619 - INFO - Pod ctest-pod-73330160 is in running state.Got IP 10.47.255.245 2024-11-10 23:02:04,637 - DEBUG - Pod ctest-pod-73330160 has vmi c58a9b4e-9fb7-11ef-9b49-fa163e0b84e2 2024-11-10 23:02:04,637 - INFO - Verified pod ctest-pod-73330160 in contrail-api 2024-11-10 23:02:04,666 - DEBUG - VMI c58a9b4e-9fb7-11ef-9b49-fa163e0b84e2 is active in agent 10.0.0.30 2024-11-10 23:02:04,667 - INFO - Verified Pod ctest-pod-73330160 in agent 10.0.0.30 2024-11-10 23:02:04,667 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=9f542e79-b7c7-44cb-b50b-0724128f117e 2024-11-10 23:02:04,671 - INFO - Pod ctest-pod-73330160 with uuid 9f542e79-b7c7-44cb-b50b-0724128f117e found in kube manager 2024-11-10 23:02:04,671 - INFO - Pod ctest-pod-73330160 verification passed 2024-11-10 23:02:04,676 - INFO - Pod ctest-pod-69590020 is in running state.Got IP 10.47.255.246 2024-11-10 23:02:04,735 - DEBUG - Pod ctest-pod-69590020 has vmi c4fd1aee-9fb7-11ef-9b49-fa163e0b84e2 2024-11-10 23:02:04,736 - INFO - Verified pod ctest-pod-69590020 in contrail-api 2024-11-10 23:02:04,759 - DEBUG - VMI c4fd1aee-9fb7-11ef-9b49-fa163e0b84e2 is active in agent 10.0.0.30 2024-11-10 23:02:04,759 - INFO - Verified Pod ctest-pod-69590020 in agent 10.0.0.30 2024-11-10 23:02:04,760 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=f8ae6d11-e0f2-413f-8830-f83ea3c3a131 2024-11-10 23:02:04,764 - INFO - Pod ctest-pod-69590020 with uuid f8ae6d11-e0f2-413f-8830-f83ea3c3a131 found in kube manager 2024-11-10 23:02:04,764 - INFO - Pod ctest-pod-69590020 verification passed 2024-11-10 23:02:04,769 - INFO - Pod ctest-pod-94453294 is in running state.Got IP 10.47.255.244 2024-11-10 23:02:04,786 - DEBUG - Pod ctest-pod-94453294 has vmi c6086f60-9fb7-11ef-9b49-fa163e0b84e2 2024-11-10 23:02:04,786 - INFO - Verified pod ctest-pod-94453294 in contrail-api 2024-11-10 23:02:04,812 - DEBUG - VMI c6086f60-9fb7-11ef-9b49-fa163e0b84e2 is active in agent 10.0.0.30 2024-11-10 23:02:04,812 - INFO - Verified Pod ctest-pod-94453294 in agent 10.0.0.30 2024-11-10 23:02:04,813 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=38e2cf56-5f47-409d-a60a-50b18f658db5 2024-11-10 23:02:04,817 - INFO - Pod ctest-pod-94453294 with uuid 38e2cf56-5f47-409d-a60a-50b18f658db5 found in kube manager 2024-11-10 23:02:04,817 - INFO - Pod ctest-pod-94453294 verification passed 2024-11-10 23:02:04,817 - INFO - ================================================================================ 2024-11-10 23:02:04,817 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-11-10 23:02:04,817 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-11-10 23:02:05,094 - DEBUG - Nothing to compare xmpp stats {'10.0.0.30': {'10.0.0.37': '0'}} with 2024-11-10 23:02:05,094 - INFO - Initial checks done. Running the testcase now 2024-11-10 23:02:05,094 - INFO - 2024-11-10 23:02:05,191 - DEBUG - [Pod ctest-pod-05984563] Cmd: echo ctest-pod-05984563 > /usr/share/nginx/html/index.html, Output: 2024-11-10 23:02:05,276 - DEBUG - [Pod ctest-pod-45067379] Cmd: echo ctest-pod-45067379 > /usr/share/nginx/html/index.html, Output: 2024-11-10 23:02:05,356 - DEBUG - [Pod ctest-pod-94026147] Cmd: echo ctest-pod-94026147 > /usr/share/nginx/html/index.html, Output: 2024-11-10 23:02:05,418 - DEBUG - [Pod ctest-pod-67259134] Cmd: echo ctest-pod-67259134 > /usr/share/nginx/html/index.html, Output: 2024-11-10 23:02:05,422 - DEBUG - Service ctest-nginx-svc-81770621 not present 2024-11-10 23:02:05,422 - INFO - Creating service ctest-nginx-svc-81770621 2024-11-10 23:02:05,436 - INFO - Created Service ctest-nginx-svc-81770621 2024-11-10 23:02:05,447 - WARNING - Service UUID b55b5757-9833-4777-a8ca-777521754024 not yet found in contrail-api 2024-11-10 23:02:06,457 - INFO - Validated that Service ctest-nginx-svc-81770621 is seen in contrail-api 2024-11-10 23:02:06,457 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_LoadbalancerDatabaseList?x=b55b5757-9833-4777-a8ca-777521754024 2024-11-10 23:02:06,462 - INFO - Service ctest-nginx-svc-81770621 with uuid b55b5757-9833-4777-a8ca-777521754024 found in kube manager 2024-11-10 23:02:06,462 - INFO - Service ctest-nginx-svc-81770621 verification passed 2024-11-10 23:02:07,613 - DEBUG - [Pod ctest-pod-65282988] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.229.193:80 (10.97.229.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-05984563 2024-11-10 23:02:07,613 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 passed 2024-11-10 23:02:07,613 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd output: Connecting to 10.97.229.193:80 (10.97.229.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-05984563 2024-11-10 23:02:07,781 - DEBUG - [Pod ctest-pod-65282988] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.229.193:80 (10.97.229.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-05984563 2024-11-10 23:02:07,781 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 passed 2024-11-10 23:02:07,781 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd output: Connecting to 10.97.229.193:80 (10.97.229.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-05984563 2024-11-10 23:02:07,867 - DEBUG - [Pod ctest-pod-65282988] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: ctest-pod-05984563 Connecting to 10.97.229.193:80 (10.97.229.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 23:02:07,868 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 passed 2024-11-10 23:02:07,868 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd output: ctest-pod-05984563 Connecting to 10.97.229.193:80 (10.97.229.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 23:02:07,934 - DEBUG - [Pod ctest-pod-65282988] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: ctest-pod-45067379 Connecting to 10.97.229.193:80 (10.97.229.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 23:02:07,934 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 passed 2024-11-10 23:02:07,934 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd output: ctest-pod-45067379 Connecting to 10.97.229.193:80 (10.97.229.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 23:02:07,934 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-05984563': 3, 'ctest-pod-45067379': 1} 2024-11-10 23:02:07,994 - DEBUG - [Pod ctest-pod-73330160] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: ctest-pod-45067379 Connecting to 10.97.229.193:80 (10.97.229.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 23:02:07,994 - DEBUG - [Pod Pod ctest-pod-73330160] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 passed 2024-11-10 23:02:07,994 - DEBUG - [Pod Pod ctest-pod-73330160] Cmd output: ctest-pod-45067379 Connecting to 10.97.229.193:80 (10.97.229.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 23:02:08,068 - DEBUG - [Pod ctest-pod-73330160] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: ctest-pod-45067379 Connecting to 10.97.229.193:80 (10.97.229.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 23:02:08,068 - DEBUG - [Pod Pod ctest-pod-73330160] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 passed 2024-11-10 23:02:08,068 - DEBUG - [Pod Pod ctest-pod-73330160] Cmd output: ctest-pod-45067379 Connecting to 10.97.229.193:80 (10.97.229.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 23:02:08,135 - DEBUG - [Pod ctest-pod-73330160] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: ctest-pod-05984563 Connecting to 10.97.229.193:80 (10.97.229.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 23:02:08,135 - DEBUG - [Pod Pod ctest-pod-73330160] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 passed 2024-11-10 23:02:08,135 - DEBUG - [Pod Pod ctest-pod-73330160] Cmd output: ctest-pod-05984563 Connecting to 10.97.229.193:80 (10.97.229.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 23:02:08,135 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-05984563': 1, 'ctest-pod-45067379': 2} 2024-11-10 23:02:08,138 - DEBUG - Network policy ingress-on-service not present 2024-11-10 23:02:08,139 - INFO - Creating Network Policy ingress-on-service 2024-11-10 23:02:08,159 - INFO - Network policy found in k8s 2024-11-10 23:02:08,159 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=cc638cb6-45e9-4971-aea9-92d854cd6c57 2024-11-10 23:02:08,164 - INFO - Network Policy ingress-on-service with uuid cc638cb6-45e9-4971-aea9-92d854cd6c57 found in kube manager 2024-11-10 23:02:08,198 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-11-10 23:02:08,198 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-11-10 23:02:08,198 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=cc638cb6-45e9-4971-aea9-92d854cd6c57 2024-11-10 23:02:08,227 - WARNING - Network policy with name ingress-on-service not found in agent 2024-11-10 23:02:10,228 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=cc638cb6-45e9-4971-aea9-92d854cd6c57 2024-11-10 23:02:10,272 - INFO - Network policy with name ingress-on-service found in agent 2024-11-10 23:02:10,273 - INFO - Network Policy ingress-on-service verification passed 2024-11-10 23:02:15,392 - DEBUG - [Pod ctest-pod-65282988] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:02:15,392 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:02:15,393 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:02:20,476 - DEBUG - [Pod ctest-pod-65282988] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:02:20,476 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:02:20,476 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:02:25,585 - DEBUG - [Pod ctest-pod-65282988] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:02:25,585 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:02:25,585 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:02:30,694 - DEBUG - [Pod ctest-pod-65282988] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:02:30,694 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:02:30,694 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:02:35,772 - DEBUG - [Pod ctest-pod-65282988] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:02:35,772 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:02:35,773 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:02:40,891 - DEBUG - [Pod ctest-pod-65282988] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:02:40,891 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:02:40,891 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:02:46,023 - DEBUG - [Pod ctest-pod-65282988] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:02:46,023 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:02:46,023 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:02:51,107 - DEBUG - [Pod ctest-pod-65282988] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:02:51,107 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:02:51,107 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:02:56,200 - DEBUG - [Pod ctest-pod-65282988] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:02:56,200 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:02:56,200 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:03:01,300 - DEBUG - [Pod ctest-pod-65282988] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:03:01,300 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:03:01,300 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:03:01,300 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-05984563': 0, 'ctest-pod-45067379': 0} 2024-11-10 23:03:01,387 - DEBUG - [Pod ctest-pod-69590020] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: ctest-pod-05984563 Connecting to 10.97.229.193:80 (10.97.229.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 23:03:01,387 - DEBUG - [Pod Pod ctest-pod-69590020] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 passed 2024-11-10 23:03:01,387 - DEBUG - [Pod Pod ctest-pod-69590020] Cmd output: ctest-pod-05984563 Connecting to 10.97.229.193:80 (10.97.229.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 23:03:01,474 - DEBUG - [Pod ctest-pod-69590020] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: ctest-pod-05984563 Connecting to 10.97.229.193:80 (10.97.229.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 23:03:01,474 - DEBUG - [Pod Pod ctest-pod-69590020] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 passed 2024-11-10 23:03:01,474 - DEBUG - [Pod Pod ctest-pod-69590020] Cmd output: ctest-pod-05984563 Connecting to 10.97.229.193:80 (10.97.229.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 23:03:01,553 - DEBUG - [Pod ctest-pod-69590020] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: ctest-pod-45067379 Connecting to 10.97.229.193:80 (10.97.229.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 23:03:01,553 - DEBUG - [Pod Pod ctest-pod-69590020] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 passed 2024-11-10 23:03:01,553 - DEBUG - [Pod Pod ctest-pod-69590020] Cmd output: ctest-pod-45067379 Connecting to 10.97.229.193:80 (10.97.229.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 23:03:01,553 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-05984563': 2, 'ctest-pod-45067379': 1} 2024-11-10 23:03:06,617 - DEBUG - [Pod ctest-pod-73330160] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:03:06,618 - DEBUG - [Pod Pod ctest-pod-73330160] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:03:06,618 - DEBUG - [Pod Pod ctest-pod-73330160] Cmd output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:03:11,745 - DEBUG - [Pod ctest-pod-73330160] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:03:11,745 - DEBUG - [Pod Pod ctest-pod-73330160] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:03:11,745 - DEBUG - [Pod Pod ctest-pod-73330160] Cmd output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:03:16,853 - DEBUG - [Pod ctest-pod-73330160] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:03:16,853 - DEBUG - [Pod Pod ctest-pod-73330160] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:03:16,853 - DEBUG - [Pod Pod ctest-pod-73330160] Cmd output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:03:22,014 - DEBUG - [Pod ctest-pod-73330160] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:03:22,015 - DEBUG - [Pod Pod ctest-pod-73330160] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:03:22,015 - DEBUG - [Pod Pod ctest-pod-73330160] Cmd output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:03:27,154 - DEBUG - [Pod ctest-pod-73330160] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:03:27,154 - DEBUG - [Pod Pod ctest-pod-73330160] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:03:27,154 - DEBUG - [Pod Pod ctest-pod-73330160] Cmd output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:03:32,247 - DEBUG - [Pod ctest-pod-73330160] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:03:32,247 - DEBUG - [Pod Pod ctest-pod-73330160] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:03:32,247 - DEBUG - [Pod Pod ctest-pod-73330160] Cmd output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:03:37,374 - DEBUG - [Pod ctest-pod-73330160] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:03:37,374 - DEBUG - [Pod Pod ctest-pod-73330160] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:03:37,374 - DEBUG - [Pod Pod ctest-pod-73330160] Cmd output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:03:42,485 - DEBUG - [Pod ctest-pod-73330160] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:03:42,485 - DEBUG - [Pod Pod ctest-pod-73330160] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:03:42,485 - DEBUG - [Pod Pod ctest-pod-73330160] Cmd output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:03:47,612 - DEBUG - [Pod ctest-pod-73330160] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:03:47,612 - DEBUG - [Pod Pod ctest-pod-73330160] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:03:47,612 - DEBUG - [Pod Pod ctest-pod-73330160] Cmd output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:03:52,718 - DEBUG - [Pod ctest-pod-73330160] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:03:52,718 - DEBUG - [Pod Pod ctest-pod-73330160] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:03:52,718 - DEBUG - [Pod Pod ctest-pod-73330160] Cmd output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:03:52,718 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-05984563': 0, 'ctest-pod-45067379': 0} 2024-11-10 23:03:54,817 - DEBUG - [Pod ctest-pod-69590020] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.800 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.169 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.101 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.101/0.356/0.800 ms 2024-11-10 23:03:54,817 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-69590020 with expectation True passed 2024-11-10 23:03:56,896 - DEBUG - [Pod ctest-pod-65282988] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=2.112 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.125 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.187 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.125/0.808/2.112 ms 2024-11-10 23:03:56,896 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-65282988 with expectation True passed 2024-11-10 23:03:59,034 - DEBUG - [Pod ctest-pod-73330160] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=2.351 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.083 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.087 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.083/0.840/2.351 ms 2024-11-10 23:03:59,034 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-73330160 with expectation True passed 2024-11-10 23:03:59,132 - DEBUG - [Pod ctest-pod-69590020] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 23:03:59,132 - DEBUG - [Pod Pod ctest-pod-69590020] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-11-10 23:03:59,132 - DEBUG - [Pod Pod ctest-pod-69590020] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 23:03:59,133 - INFO - wget check of of http://10.47.255.251 from ctest-pod-69590020 passed 2024-11-10 23:03:59,220 - DEBUG - [Pod ctest-pod-69590020] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 23:03:59,220 - DEBUG - [Pod Pod ctest-pod-69590020] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-11-10 23:03:59,220 - DEBUG - [Pod Pod ctest-pod-69590020] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 23:03:59,221 - INFO - wget check of of http://10.47.255.250 from ctest-pod-69590020 passed 2024-11-10 23:04:04,279 - DEBUG - [Pod ctest-pod-65282988] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-10 23:04:04,280 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-10 23:04:04,280 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-10 23:04:04,280 - INFO - wget check of of http://10.47.255.250 from ctest-pod-65282988 passed 2024-11-10 23:04:09,404 - DEBUG - [Pod ctest-pod-94453294] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-11-10 23:04:09,404 - DEBUG - [Pod Pod ctest-pod-94453294] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-11-10 23:04:09,404 - DEBUG - [Pod Pod ctest-pod-94453294] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-11-10 23:04:09,404 - INFO - wget check of of http://10.47.255.251 from ctest-pod-94453294 passed 2024-11-10 23:04:09,412 - INFO - Updating Network Policy ingress-on-service 2024-11-10 23:04:14,543 - DEBUG - [Pod ctest-pod-65282988] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:04:14,544 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:04:14,544 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:04:19,660 - DEBUG - [Pod ctest-pod-65282988] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:04:19,660 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:04:19,660 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:04:24,772 - DEBUG - [Pod ctest-pod-65282988] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:04:24,772 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:04:24,772 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:04:29,902 - DEBUG - [Pod ctest-pod-65282988] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:04:29,902 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:04:29,902 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:04:35,017 - DEBUG - [Pod ctest-pod-65282988] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:04:35,017 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:04:35,017 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:04:40,159 - DEBUG - [Pod ctest-pod-65282988] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:04:40,160 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:04:40,160 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:04:45,274 - DEBUG - [Pod ctest-pod-65282988] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:04:45,274 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:04:45,274 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:04:50,408 - DEBUG - [Pod ctest-pod-65282988] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:04:50,408 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:04:50,408 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:04:55,534 - DEBUG - [Pod ctest-pod-65282988] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:04:55,535 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:04:55,535 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:05:00,629 - DEBUG - [Pod ctest-pod-65282988] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:05:00,629 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:05:00,629 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd output: Connecting to 10.97.229.193:80 (10.97.229.193:80) wget: download timed out 2024-11-10 23:05:00,629 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-05984563': 0, 'ctest-pod-45067379': 0} 2024-11-10 23:05:00,731 - DEBUG - [Pod ctest-pod-69590020] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.229.193:80 (10.97.229.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-05984563 2024-11-10 23:05:00,731 - DEBUG - [Pod Pod ctest-pod-69590020] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 passed 2024-11-10 23:05:00,731 - DEBUG - [Pod Pod ctest-pod-69590020] Cmd output: Connecting to 10.97.229.193:80 (10.97.229.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-05984563 2024-11-10 23:05:00,795 - DEBUG - [Pod ctest-pod-69590020] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: ctest-pod-05984563 Connecting to 10.97.229.193:80 (10.97.229.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 23:05:00,795 - DEBUG - [Pod Pod ctest-pod-69590020] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 passed 2024-11-10 23:05:00,795 - DEBUG - [Pod Pod ctest-pod-69590020] Cmd output: ctest-pod-05984563 Connecting to 10.97.229.193:80 (10.97.229.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 23:05:00,881 - DEBUG - [Pod ctest-pod-69590020] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.229.193:80 (10.97.229.193:80) ctest-pod-45067379 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 23:05:00,881 - DEBUG - [Pod Pod ctest-pod-69590020] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 passed 2024-11-10 23:05:00,881 - DEBUG - [Pod Pod ctest-pod-69590020] Cmd output: Connecting to 10.97.229.193:80 (10.97.229.193:80) ctest-pod-45067379 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 23:05:00,881 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-05984563': 2, 'ctest-pod-45067379': 1} 2024-11-10 23:05:00,953 - DEBUG - [Pod ctest-pod-73330160] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.229.193:80 (10.97.229.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-05984563 2024-11-10 23:05:00,953 - DEBUG - [Pod Pod ctest-pod-73330160] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 passed 2024-11-10 23:05:00,953 - DEBUG - [Pod Pod ctest-pod-73330160] Cmd output: Connecting to 10.97.229.193:80 (10.97.229.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-05984563 2024-11-10 23:05:01,005 - DEBUG - [Pod ctest-pod-73330160] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.229.193:80 (10.97.229.193:80) ctest-pod-05984563 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 23:05:01,006 - DEBUG - [Pod Pod ctest-pod-73330160] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 passed 2024-11-10 23:05:01,006 - DEBUG - [Pod Pod ctest-pod-73330160] Cmd output: Connecting to 10.97.229.193:80 (10.97.229.193:80) ctest-pod-05984563 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 23:05:01,059 - DEBUG - [Pod ctest-pod-73330160] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.229.193:80 (10.97.229.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-05984563 2024-11-10 23:05:01,059 - DEBUG - [Pod Pod ctest-pod-73330160] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 passed 2024-11-10 23:05:01,059 - DEBUG - [Pod Pod ctest-pod-73330160] Cmd output: Connecting to 10.97.229.193:80 (10.97.229.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-05984563 2024-11-10 23:05:01,128 - DEBUG - [Pod ctest-pod-73330160] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.229.193:80 (10.97.229.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-05984563 2024-11-10 23:05:01,128 - DEBUG - [Pod Pod ctest-pod-73330160] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 passed 2024-11-10 23:05:01,128 - DEBUG - [Pod Pod ctest-pod-73330160] Cmd output: Connecting to 10.97.229.193:80 (10.97.229.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-05984563 2024-11-10 23:05:01,187 - DEBUG - [Pod ctest-pod-73330160] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: ctest-pod-05984563 Connecting to 10.97.229.193:80 (10.97.229.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 23:05:01,187 - DEBUG - [Pod Pod ctest-pod-73330160] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 passed 2024-11-10 23:05:01,187 - DEBUG - [Pod Pod ctest-pod-73330160] Cmd output: ctest-pod-05984563 Connecting to 10.97.229.193:80 (10.97.229.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 23:05:01,237 - DEBUG - [Pod ctest-pod-73330160] Cmd: wget http://10.97.229.193:80/ -O - -T 5 -t 1 , Output: ctest-pod-45067379 Connecting to 10.97.229.193:80 (10.97.229.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 23:05:01,238 - DEBUG - [Pod Pod ctest-pod-73330160] Cmd wget http://10.97.229.193:80/ -O - -T 5 -t 1 passed 2024-11-10 23:05:01,238 - DEBUG - [Pod Pod ctest-pod-73330160] Cmd output: ctest-pod-45067379 Connecting to 10.97.229.193:80 (10.97.229.193:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 23:05:01,238 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-05984563': 5, 'ctest-pod-45067379': 1} 2024-11-10 23:05:03,305 - DEBUG - [Pod ctest-pod-69590020] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.028 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.134 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.162 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.134/0.441/1.028 ms 2024-11-10 23:05:03,305 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-69590020 with expectation True passed 2024-11-10 23:05:05,410 - DEBUG - [Pod ctest-pod-65282988] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.242 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.139 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.176 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.139/0.519/1.242 ms 2024-11-10 23:05:05,410 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-65282988 with expectation True passed 2024-11-10 23:05:07,516 - DEBUG - [Pod ctest-pod-73330160] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.702 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.140 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.159 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.140/0.667/1.702 ms 2024-11-10 23:05:07,516 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-73330160 with expectation True passed 2024-11-10 23:05:07,636 - DEBUG - [Pod ctest-pod-69590020] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 23:05:07,636 - DEBUG - [Pod Pod ctest-pod-69590020] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-11-10 23:05:07,636 - DEBUG - [Pod Pod ctest-pod-69590020] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 23:05:07,636 - INFO - wget check of of http://10.47.255.251 from ctest-pod-69590020 passed 2024-11-10 23:05:07,735 - DEBUG - [Pod ctest-pod-69590020] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 23:05:07,735 - DEBUG - [Pod Pod ctest-pod-69590020] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-11-10 23:05:07,735 - DEBUG - [Pod Pod ctest-pod-69590020] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 23:05:07,735 - INFO - wget check of of http://10.47.255.250 from ctest-pod-69590020 passed 2024-11-10 23:05:12,816 - DEBUG - [Pod ctest-pod-65282988] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-10 23:05:12,816 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-10 23:05:12,816 - DEBUG - [Pod Pod ctest-pod-65282988] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-10 23:05:12,816 - INFO - wget check of of http://10.47.255.250 from ctest-pod-65282988 passed 2024-11-10 23:05:12,910 - DEBUG - [Pod ctest-pod-94453294] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 23:05:12,911 - DEBUG - [Pod Pod ctest-pod-94453294] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-11-10 23:05:12,911 - DEBUG - [Pod Pod ctest-pod-94453294] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 23:05:12,911 - INFO - wget check of of http://10.47.255.251 from ctest-pod-94453294 passed 2024-11-10 23:05:12,911 - INFO - Deleting Network Policy : ingress-on-service 2024-11-10 23:05:12,911 - INFO - Deleting service : ctest-nginx-svc-81770621 2024-11-10 23:05:13,219 - DEBUG - No XMPP flaps were noticed during the test 2024-11-10 23:05:13,219 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:09] 2024-11-10 23:05:13,219 - INFO - -------------------------------------------------------------------------------- 2024-11-10 23:05:13,226 - INFO - Deleting pod ctest-new-default-06338857:ctest-pod-05984563 2024-11-10 23:05:13,227 - INFO - Deleting pod ctest-new-default-06338857:ctest-pod-45067379 2024-11-10 23:05:13,227 - INFO - Deleting pod ctest-non-default-81025637:ctest-pod-94026147 2024-11-10 23:05:13,228 - INFO - Deleting pod ctest-non-default-81025637:ctest-pod-67259134 2024-11-10 23:05:13,228 - INFO - Deleting pod ctest-new-default-06338857:ctest-pod-65282988 2024-11-10 23:05:13,229 - INFO - Deleting pod ctest-new-default-06338857:ctest-pod-69590020 2024-11-10 23:05:13,235 - INFO - Deleting pod ctest-non-default-81025637:ctest-pod-73330160 2024-11-10 23:05:13,235 - INFO - Deleting pod ctest-non-default-81025637:ctest-pod-94453294 2024-11-10 23:05:13,333 - WARNING - Pod uuid 0c32b679-24f2-48f0-affc-235363d58310 is still seen in agent 10.0.0.30 VM list 2024-11-10 23:05:13,356 - WARNING - Pod uuid 9f542e79-b7c7-44cb-b50b-0724128f117e is still seen in agent 10.0.0.30 VM list 2024-11-10 23:05:13,390 - WARNING - Pod uuid f8ae6d11-e0f2-413f-8830-f83ea3c3a131 is still seen in agent 10.0.0.30 VM list 2024-11-10 23:05:13,390 - WARNING - Pod uuid 2c216b6d-81a5-4267-a650-622ed514d471 is still seen in agent 10.0.0.30 VM list 2024-11-10 23:05:13,391 - WARNING - Pod uuid 38e2cf56-5f47-409d-a60a-50b18f658db5 is still seen in agent 10.0.0.30 VM list 2024-11-10 23:05:13,391 - WARNING - Pod uuid 9cacae5d-3f12-434a-b06a-fd8c6434cd28 is still seen in agent 10.0.0.30 VM list 2024-11-10 23:05:13,391 - WARNING - Pod uuid d97aa51d-bd83-4b5a-8867-b23ac2d627e9 is still seen in agent 10.0.0.30 VM list 2024-11-10 23:05:13,392 - WARNING - Pod uuid 608d0773-4e21-4291-89b5-04d9e0cebb70 is still seen in agent 10.0.0.30 VM list 2024-11-10 23:05:18,348 - DEBUG - Pod 0c32b679-24f2-48f0-affc-235363d58310 is not in agent 10.0.0.30 VM list 2024-11-10 23:05:18,376 - DEBUG - VMI c2076196-9fb7-11ef-9b49-fa163e0b84e2 is removed from agent 10.0.0.30 2024-11-10 23:05:18,376 - INFO - Verified that pod ctest-pod-05984563 is removed in agent 2024-11-10 23:05:18,377 - WARNING - Pod uuid 9f542e79-b7c7-44cb-b50b-0724128f117e is still seen in agent 10.0.0.30 VM list 2024-11-10 23:05:18,450 - DEBUG - Pod d97aa51d-bd83-4b5a-8867-b23ac2d627e9 is not in agent 10.0.0.30 VM list 2024-11-10 23:05:18,452 - DEBUG - Pod 608d0773-4e21-4291-89b5-04d9e0cebb70 is not in agent 10.0.0.30 VM list 2024-11-10 23:05:18,453 - WARNING - Pod uuid 38e2cf56-5f47-409d-a60a-50b18f658db5 is still seen in agent 10.0.0.30 VM list 2024-11-10 23:05:18,456 - WARNING - Pod uuid 9cacae5d-3f12-434a-b06a-fd8c6434cd28 is still seen in agent 10.0.0.30 VM list 2024-11-10 23:05:18,457 - DEBUG - Pod 2c216b6d-81a5-4267-a650-622ed514d471 is not in agent 10.0.0.30 VM list 2024-11-10 23:05:18,459 - WARNING - Pod uuid f8ae6d11-e0f2-413f-8830-f83ea3c3a131 is still seen in agent 10.0.0.30 VM list 2024-11-10 23:05:18,483 - DEBUG - VMI c3d33acc-9fb7-11ef-9b49-fa163e0b84e2 is removed from agent 10.0.0.30 2024-11-10 23:05:18,483 - INFO - Verified that pod ctest-pod-67259134 is removed in agent 2024-11-10 23:05:18,485 - DEBUG - VMI c345f950-9fb7-11ef-9b49-fa163e0b84e2 is removed from agent 10.0.0.30 2024-11-10 23:05:18,485 - INFO - Verified that pod ctest-pod-94026147 is removed in agent 2024-11-10 23:05:18,486 - DEBUG - VMI c2a22fd2-9fb7-11ef-9b49-fa163e0b84e2 is removed from agent 10.0.0.30 2024-11-10 23:05:18,486 - INFO - Verified that pod ctest-pod-45067379 is removed in agent 2024-11-10 23:05:23,393 - WARNING - Pod uuid 9f542e79-b7c7-44cb-b50b-0724128f117e is still seen in agent 10.0.0.30 VM list 2024-11-10 23:05:23,482 - WARNING - Pod uuid 38e2cf56-5f47-409d-a60a-50b18f658db5 is still seen in agent 10.0.0.30 VM list 2024-11-10 23:05:23,483 - WARNING - Pod uuid f8ae6d11-e0f2-413f-8830-f83ea3c3a131 is still seen in agent 10.0.0.30 VM list 2024-11-10 23:05:23,484 - WARNING - Pod uuid 9cacae5d-3f12-434a-b06a-fd8c6434cd28 is still seen in agent 10.0.0.30 VM list 2024-11-10 23:05:28,408 - WARNING - Pod uuid 9f542e79-b7c7-44cb-b50b-0724128f117e is still seen in agent 10.0.0.30 VM list 2024-11-10 23:05:28,516 - WARNING - Pod uuid 38e2cf56-5f47-409d-a60a-50b18f658db5 is still seen in agent 10.0.0.30 VM list 2024-11-10 23:05:28,517 - WARNING - Pod uuid 9cacae5d-3f12-434a-b06a-fd8c6434cd28 is still seen in agent 10.0.0.30 VM list 2024-11-10 23:05:28,517 - WARNING - Pod uuid f8ae6d11-e0f2-413f-8830-f83ea3c3a131 is still seen in agent 10.0.0.30 VM list 2024-11-10 23:05:33,422 - WARNING - Pod uuid 9f542e79-b7c7-44cb-b50b-0724128f117e is still seen in agent 10.0.0.30 VM list 2024-11-10 23:05:33,531 - WARNING - Pod uuid f8ae6d11-e0f2-413f-8830-f83ea3c3a131 is still seen in agent 10.0.0.30 VM list 2024-11-10 23:05:33,532 - WARNING - Pod uuid 9cacae5d-3f12-434a-b06a-fd8c6434cd28 is still seen in agent 10.0.0.30 VM list 2024-11-10 23:05:33,533 - WARNING - Pod uuid 38e2cf56-5f47-409d-a60a-50b18f658db5 is still seen in agent 10.0.0.30 VM list 2024-11-10 23:05:38,439 - WARNING - Pod uuid 9f542e79-b7c7-44cb-b50b-0724128f117e is still seen in agent 10.0.0.30 VM list 2024-11-10 23:05:38,548 - WARNING - Pod uuid 38e2cf56-5f47-409d-a60a-50b18f658db5 is still seen in agent 10.0.0.30 VM list 2024-11-10 23:05:38,549 - WARNING - Pod uuid f8ae6d11-e0f2-413f-8830-f83ea3c3a131 is still seen in agent 10.0.0.30 VM list 2024-11-10 23:05:38,550 - WARNING - Pod uuid 9cacae5d-3f12-434a-b06a-fd8c6434cd28 is still seen in agent 10.0.0.30 VM list 2024-11-10 23:05:43,450 - WARNING - Pod uuid 9f542e79-b7c7-44cb-b50b-0724128f117e is still seen in agent 10.0.0.30 VM list 2024-11-10 23:05:43,564 - WARNING - Pod uuid 38e2cf56-5f47-409d-a60a-50b18f658db5 is still seen in agent 10.0.0.30 VM list 2024-11-10 23:05:43,568 - WARNING - Pod uuid 9cacae5d-3f12-434a-b06a-fd8c6434cd28 is still seen in agent 10.0.0.30 VM list 2024-11-10 23:05:43,569 - WARNING - Pod uuid f8ae6d11-e0f2-413f-8830-f83ea3c3a131 is still seen in agent 10.0.0.30 VM list 2024-11-10 23:05:48,464 - DEBUG - Pod 9f542e79-b7c7-44cb-b50b-0724128f117e is not in agent 10.0.0.30 VM list 2024-11-10 23:05:48,476 - DEBUG - VMI c58a9b4e-9fb7-11ef-9b49-fa163e0b84e2 is removed from agent 10.0.0.30 2024-11-10 23:05:48,476 - INFO - Verified that pod ctest-pod-73330160 is removed in agent 2024-11-10 23:05:48,597 - DEBUG - Pod 38e2cf56-5f47-409d-a60a-50b18f658db5 is not in agent 10.0.0.30 VM list 2024-11-10 23:05:48,600 - DEBUG - Pod 9cacae5d-3f12-434a-b06a-fd8c6434cd28 is not in agent 10.0.0.30 VM list 2024-11-10 23:05:48,601 - DEBUG - Pod f8ae6d11-e0f2-413f-8830-f83ea3c3a131 is not in agent 10.0.0.30 VM list 2024-11-10 23:05:48,638 - DEBUG - VMI c4fd1aee-9fb7-11ef-9b49-fa163e0b84e2 is removed from agent 10.0.0.30 2024-11-10 23:05:48,638 - INFO - Verified that pod ctest-pod-69590020 is removed in agent 2024-11-10 23:05:48,639 - DEBUG - VMI c6086f60-9fb7-11ef-9b49-fa163e0b84e2 is removed from agent 10.0.0.30 2024-11-10 23:05:48,639 - INFO - Verified that pod ctest-pod-94453294 is removed in agent 2024-11-10 23:05:48,641 - DEBUG - VMI c46f59de-9fb7-11ef-9b49-fa163e0b84e2 is removed from agent 10.0.0.30 2024-11-10 23:05:48,641 - INFO - Verified that pod ctest-pod-65282988 is removed in agent 2024-11-10 23:05:48,641 - INFO - Deleting namespace ctest-non-default-81025637 2024-11-10 23:05:48,679 - DEBUG - Namespace ctest-non-default-81025637 still in k8s 2024-11-10 23:05:50,683 - DEBUG - Namespace ctest-non-default-81025637 still in k8s 2024-11-10 23:05:52,688 - DEBUG - Namespace ctest-non-default-81025637 still in k8s 2024-11-10 23:05:54,691 - DEBUG - Namespace ctest-non-default-81025637 is not in k8s 2024-11-10 23:05:54,691 - DEBUG - No need to check project deletion in contrail-api 2024-11-10 23:05:54,691 - INFO - Deleting namespace ctest-new-default-06338857 2024-11-10 23:05:54,702 - DEBUG - Namespace ctest-new-default-06338857 still in k8s 2024-11-10 23:05:56,707 - DEBUG - Namespace ctest-new-default-06338857 still in k8s 2024-11-10 23:05:58,711 - DEBUG - Namespace ctest-new-default-06338857 still in k8s 2024-11-10 23:06:00,716 - DEBUG - Namespace ctest-new-default-06338857 is not in k8s 2024-11-10 23:06:00,716 - DEBUG - No need to check project deletion in contrail-api