2024-08-24 15:45:35,383 - INFO - Using existing project ['default-domain', 'k8s-default'](16170937-9eaa-49bb-b60c-fd1447134134) 2024-08-24 15:45:35,436 - DEBUG - Namespace ctest-new-default-63220846 not present 2024-08-24 15:45:35,451 - INFO - Created namespace ctest-new-default-63220846 2024-08-24 15:45:38,459 - DEBUG - Namespace ctest-non-default-70765980 not present 2024-08-24 15:45:38,483 - INFO - Created namespace ctest-non-default-70765980 2024-08-24 15:45:41,532 - DEBUG - Pod ctest-pod-99301946 not present 2024-08-24 15:45:41,533 - INFO - Creating Pod ctest-pod-99301946 2024-08-24 15:45:41,596 - DEBUG - Pod : ctest-pod-99301946 UUID is 3ab1988e-d85d-4749-8086-542be0c2f484 2024-08-24 15:45:41,599 - DEBUG - Pod ctest-pod-81677645 not present 2024-08-24 15:45:41,599 - INFO - Creating Pod ctest-pod-81677645 2024-08-24 15:45:41,640 - DEBUG - Pod : ctest-pod-81677645 UUID is d62a33d9-95b8-4f2f-9490-71ce5f5166c7 2024-08-24 15:45:41,645 - DEBUG - Pod ctest-pod-84651564 not present 2024-08-24 15:45:41,645 - INFO - Creating Pod ctest-pod-84651564 2024-08-24 15:45:41,693 - DEBUG - Pod : ctest-pod-84651564 UUID is f03f4a66-11ce-4805-b0fb-3bed2af0bb4c 2024-08-24 15:45:41,697 - DEBUG - Pod ctest-pod-29163787 not present 2024-08-24 15:45:41,697 - INFO - Creating Pod ctest-pod-29163787 2024-08-24 15:45:41,868 - DEBUG - Pod : ctest-pod-29163787 UUID is b8bcb1bc-1ec5-4a77-bb76-504f55ef342e 2024-08-24 15:45:41,878 - DEBUG - Pod ctest-pod-62955558 not present 2024-08-24 15:45:41,878 - INFO - Creating Pod ctest-pod-62955558 2024-08-24 15:45:41,913 - DEBUG - Pod : ctest-pod-62955558 UUID is bd58ed0a-1484-4932-b27f-8c98772e53a2 2024-08-24 15:45:41,917 - DEBUG - Pod ctest-pod-05255210 not present 2024-08-24 15:45:41,917 - INFO - Creating Pod ctest-pod-05255210 2024-08-24 15:45:41,955 - DEBUG - Pod : ctest-pod-05255210 UUID is f3be4ec6-17a9-4099-a05b-a488f15cfad0 2024-08-24 15:45:41,958 - DEBUG - Pod ctest-pod-36216715 not present 2024-08-24 15:45:41,959 - INFO - Creating Pod ctest-pod-36216715 2024-08-24 15:45:41,978 - DEBUG - Pod : ctest-pod-36216715 UUID is 269822da-07ef-4a7e-8fbc-5a78e0053013 2024-08-24 15:45:41,984 - DEBUG - Pod ctest-pod-72427479 not present 2024-08-24 15:45:41,985 - INFO - Creating Pod ctest-pod-72427479 2024-08-24 15:45:42,003 - DEBUG - Pod : ctest-pod-72427479 UUID is a90d1612-ce80-4149-8405-89c9e4c243cd 2024-08-24 15:45:42,268 - INFO - Project default-domain:k8s-ctest-new-default-63220846 for Namespace ctest-new-default-63220846 is seen in contrail-api 2024-08-24 15:45:42,268 - DEBUG - Project uuid in Contrail is f3f3eccc-8bf4-4b1d-b538-ef5b55351f53 2024-08-24 15:45:42,447 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_NamespaceDatabaseList?namespace_uuid=3c5ddf4f-dc23-4eb7-8d81-8eb70a98227b 2024-08-24 15:45:42,451 - INFO - Namespace ctest-new-default-63220846 with uuid 3c5ddf4f-dc23-4eb7-8d81-8eb70a98227b found in kube manager 2024-08-24 15:45:42,451 - INFO - Namespace ctest-new-default-63220846 verification passed 2024-08-24 15:45:42,734 - INFO - Project default-domain:k8s-ctest-non-default-70765980 for Namespace ctest-non-default-70765980 is seen in contrail-api 2024-08-24 15:45:42,734 - DEBUG - Project uuid in Contrail is 26f71bbf-3823-4188-ab46-7f2967758acb 2024-08-24 15:45:42,734 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_NamespaceDatabaseList?namespace_uuid=f0ccf74e-8ff2-4f35-a1c0-ab6fe30fa135 2024-08-24 15:45:42,742 - INFO - Namespace ctest-non-default-70765980 with uuid f0ccf74e-8ff2-4f35-a1c0-ab6fe30fa135 found in kube manager 2024-08-24 15:45:42,742 - INFO - Namespace ctest-non-default-70765980 verification passed 2024-08-24 15:45:42,750 - DEBUG - Pod ctest-pod-99301946 not in running state.Currently in Pending 2024-08-24 15:45:47,759 - DEBUG - Pod ctest-pod-99301946 not in running state.Currently in Pending 2024-08-24 15:45:52,769 - DEBUG - Pod ctest-pod-99301946 not in running state.Currently in Pending 2024-08-24 15:45:57,776 - INFO - Pod ctest-pod-99301946 is in running state.Got IP 10.47.255.248 2024-08-24 15:45:57,828 - DEBUG - Pod ctest-pod-99301946 has vmi eca5a022-622f-11ef-9004-fa163e8f22e7 2024-08-24 15:45:57,828 - INFO - Verified pod ctest-pod-99301946 in contrail-api 2024-08-24 15:45:57,846 - DEBUG - VMI eca5a022-622f-11ef-9004-fa163e8f22e7 is active in agent 10.0.0.41 2024-08-24 15:45:57,846 - INFO - Verified Pod ctest-pod-99301946 in agent 10.0.0.41 2024-08-24 15:45:57,846 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=3ab1988e-d85d-4749-8086-542be0c2f484 2024-08-24 15:45:57,852 - INFO - Pod ctest-pod-99301946 with uuid 3ab1988e-d85d-4749-8086-542be0c2f484 found in kube manager 2024-08-24 15:45:57,852 - INFO - Pod ctest-pod-99301946 verification passed 2024-08-24 15:45:57,858 - INFO - Pod ctest-pod-81677645 is in running state.Got IP 10.47.255.247 2024-08-24 15:45:57,929 - DEBUG - Pod ctest-pod-81677645 has vmi ed69f634-622f-11ef-9004-fa163e8f22e7 2024-08-24 15:45:57,929 - INFO - Verified pod ctest-pod-81677645 in contrail-api 2024-08-24 15:45:57,952 - DEBUG - VMI ed69f634-622f-11ef-9004-fa163e8f22e7 is active in agent 10.0.0.41 2024-08-24 15:45:57,952 - INFO - Verified Pod ctest-pod-81677645 in agent 10.0.0.41 2024-08-24 15:45:57,952 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=d62a33d9-95b8-4f2f-9490-71ce5f5166c7 2024-08-24 15:45:57,958 - INFO - Pod ctest-pod-81677645 with uuid d62a33d9-95b8-4f2f-9490-71ce5f5166c7 found in kube manager 2024-08-24 15:45:57,958 - INFO - Pod ctest-pod-81677645 verification passed 2024-08-24 15:45:57,965 - DEBUG - Pod ctest-pod-84651564 not in running state.Currently in Pending 2024-08-24 15:46:02,973 - INFO - Pod ctest-pod-84651564 is in running state.Got IP 10.47.255.246 2024-08-24 15:46:03,028 - DEBUG - Pod ctest-pod-84651564 has vmi ee787f64-622f-11ef-9004-fa163e8f22e7 2024-08-24 15:46:03,028 - INFO - Verified pod ctest-pod-84651564 in contrail-api 2024-08-24 15:46:03,042 - DEBUG - VMI ee787f64-622f-11ef-9004-fa163e8f22e7 is active in agent 10.0.0.41 2024-08-24 15:46:03,042 - INFO - Verified Pod ctest-pod-84651564 in agent 10.0.0.41 2024-08-24 15:46:03,042 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=f03f4a66-11ce-4805-b0fb-3bed2af0bb4c 2024-08-24 15:46:03,049 - INFO - Pod ctest-pod-84651564 with uuid f03f4a66-11ce-4805-b0fb-3bed2af0bb4c found in kube manager 2024-08-24 15:46:03,049 - INFO - Pod ctest-pod-84651564 verification passed 2024-08-24 15:46:03,054 - DEBUG - Pod ctest-pod-29163787 not in running state.Currently in Pending 2024-08-24 15:46:08,079 - INFO - Pod ctest-pod-29163787 is in running state.Got IP 10.47.255.245 2024-08-24 15:46:08,144 - DEBUG - Pod ctest-pod-29163787 has vmi ef3b5f7a-622f-11ef-9004-fa163e8f22e7 2024-08-24 15:46:08,144 - INFO - Verified pod ctest-pod-29163787 in contrail-api 2024-08-24 15:46:08,184 - DEBUG - VMI ef3b5f7a-622f-11ef-9004-fa163e8f22e7 is active in agent 10.0.0.41 2024-08-24 15:46:08,185 - INFO - Verified Pod ctest-pod-29163787 in agent 10.0.0.41 2024-08-24 15:46:08,185 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=b8bcb1bc-1ec5-4a77-bb76-504f55ef342e 2024-08-24 15:46:08,197 - INFO - Pod ctest-pod-29163787 with uuid b8bcb1bc-1ec5-4a77-bb76-504f55ef342e found in kube manager 2024-08-24 15:46:08,198 - INFO - Pod ctest-pod-29163787 verification passed 2024-08-24 15:46:08,216 - INFO - Pod ctest-pod-62955558 is in running state.Got IP 10.47.255.244 2024-08-24 15:46:08,280 - DEBUG - Pod ctest-pod-62955558 has vmi eff737ae-622f-11ef-9004-fa163e8f22e7 2024-08-24 15:46:08,280 - INFO - Verified pod ctest-pod-62955558 in contrail-api 2024-08-24 15:46:08,324 - DEBUG - VMI eff737ae-622f-11ef-9004-fa163e8f22e7 is active in agent 10.0.0.41 2024-08-24 15:46:08,325 - INFO - Verified Pod ctest-pod-62955558 in agent 10.0.0.41 2024-08-24 15:46:08,325 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=bd58ed0a-1484-4932-b27f-8c98772e53a2 2024-08-24 15:46:08,346 - INFO - Pod ctest-pod-62955558 with uuid bd58ed0a-1484-4932-b27f-8c98772e53a2 found in kube manager 2024-08-24 15:46:08,346 - INFO - Pod ctest-pod-62955558 verification passed 2024-08-24 15:46:08,360 - INFO - Pod ctest-pod-36216715 is in running state.Got IP 10.47.255.242 2024-08-24 15:46:08,423 - DEBUG - Pod ctest-pod-36216715 has vmi f16387aa-622f-11ef-9004-fa163e8f22e7 2024-08-24 15:46:08,423 - INFO - Verified pod ctest-pod-36216715 in contrail-api 2024-08-24 15:46:08,444 - DEBUG - VMI f16387aa-622f-11ef-9004-fa163e8f22e7 is active in agent 10.0.0.41 2024-08-24 15:46:08,445 - INFO - Verified Pod ctest-pod-36216715 in agent 10.0.0.41 2024-08-24 15:46:08,447 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=269822da-07ef-4a7e-8fbc-5a78e0053013 2024-08-24 15:46:08,455 - INFO - Pod ctest-pod-36216715 with uuid 269822da-07ef-4a7e-8fbc-5a78e0053013 found in kube manager 2024-08-24 15:46:08,456 - INFO - Pod ctest-pod-36216715 verification passed 2024-08-24 15:46:08,466 - INFO - Pod ctest-pod-05255210 is in running state.Got IP 10.47.255.243 2024-08-24 15:46:08,520 - DEBUG - Pod ctest-pod-05255210 has vmi f0a5a924-622f-11ef-9004-fa163e8f22e7 2024-08-24 15:46:08,520 - INFO - Verified pod ctest-pod-05255210 in contrail-api 2024-08-24 15:46:08,542 - DEBUG - VMI f0a5a924-622f-11ef-9004-fa163e8f22e7 is active in agent 10.0.0.41 2024-08-24 15:46:08,543 - INFO - Verified Pod ctest-pod-05255210 in agent 10.0.0.41 2024-08-24 15:46:08,543 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=f3be4ec6-17a9-4099-a05b-a488f15cfad0 2024-08-24 15:46:08,549 - INFO - Pod ctest-pod-05255210 with uuid f3be4ec6-17a9-4099-a05b-a488f15cfad0 found in kube manager 2024-08-24 15:46:08,550 - INFO - Pod ctest-pod-05255210 verification passed 2024-08-24 15:46:08,556 - INFO - Pod ctest-pod-72427479 is in running state.Got IP 10.47.255.241 2024-08-24 15:46:08,648 - DEBUG - Pod ctest-pod-72427479 has vmi f2204f2a-622f-11ef-9004-fa163e8f22e7 2024-08-24 15:46:08,648 - INFO - Verified pod ctest-pod-72427479 in contrail-api 2024-08-24 15:46:08,664 - DEBUG - VMI f2204f2a-622f-11ef-9004-fa163e8f22e7 is active in agent 10.0.0.41 2024-08-24 15:46:08,665 - INFO - Verified Pod ctest-pod-72427479 in agent 10.0.0.41 2024-08-24 15:46:08,665 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=a90d1612-ce80-4149-8405-89c9e4c243cd 2024-08-24 15:46:08,670 - INFO - Pod ctest-pod-72427479 with uuid a90d1612-ce80-4149-8405-89c9e4c243cd found in kube manager 2024-08-24 15:46:08,670 - INFO - Pod ctest-pod-72427479 verification passed 2024-08-24 15:46:08,670 - INFO - ================================================================================ 2024-08-24 15:46:08,670 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-08-24 15:46:08,670 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-08-24 15:46:09,151 - DEBUG - Nothing to compare xmpp stats {'10.0.0.41': {'10.0.0.41': '0'}} with 2024-08-24 15:46:09,151 - INFO - Initial checks done. Running the testcase now 2024-08-24 15:46:09,151 - INFO - 2024-08-24 15:46:09,262 - DEBUG - [Pod ctest-pod-99301946] Cmd: echo ctest-pod-99301946 > /usr/share/nginx/html/index.html, Output: 2024-08-24 15:46:09,358 - DEBUG - [Pod ctest-pod-81677645] Cmd: echo ctest-pod-81677645 > /usr/share/nginx/html/index.html, Output: 2024-08-24 15:46:09,415 - DEBUG - [Pod ctest-pod-84651564] Cmd: echo ctest-pod-84651564 > /usr/share/nginx/html/index.html, Output: 2024-08-24 15:46:09,489 - DEBUG - [Pod ctest-pod-29163787] Cmd: echo ctest-pod-29163787 > /usr/share/nginx/html/index.html, Output: 2024-08-24 15:46:09,496 - DEBUG - Service ctest-nginx-svc-45909565 not present 2024-08-24 15:46:09,496 - INFO - Creating service ctest-nginx-svc-45909565 2024-08-24 15:46:09,529 - INFO - Created Service ctest-nginx-svc-45909565 2024-08-24 15:46:09,541 - WARNING - Service UUID 90568502-fc27-4b14-a6aa-fb14f85dfd04 not yet found in contrail-api 2024-08-24 15:46:10,551 - INFO - Validated that Service ctest-nginx-svc-45909565 is seen in contrail-api 2024-08-24 15:46:10,551 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_LoadbalancerDatabaseList?x=90568502-fc27-4b14-a6aa-fb14f85dfd04 2024-08-24 15:46:10,556 - INFO - Service ctest-nginx-svc-45909565 with uuid 90568502-fc27-4b14-a6aa-fb14f85dfd04 found in kube manager 2024-08-24 15:46:10,556 - INFO - Service ctest-nginx-svc-45909565 verification passed 2024-08-24 15:46:11,667 - DEBUG - [Pod ctest-pod-62955558] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.166.165:80 (10.96.166.165:80) ctest-pod-99301946 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-24 15:46:11,668 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 passed 2024-08-24 15:46:11,668 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd output: Connecting to 10.96.166.165:80 (10.96.166.165:80) ctest-pod-99301946 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-24 15:46:11,742 - DEBUG - [Pod ctest-pod-62955558] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.166.165:80 (10.96.166.165:80) ctest-pod-99301946 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-24 15:46:11,742 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 passed 2024-08-24 15:46:11,742 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd output: Connecting to 10.96.166.165:80 (10.96.166.165:80) ctest-pod-99301946 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-24 15:46:11,829 - DEBUG - [Pod ctest-pod-62955558] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.166.165:80 (10.96.166.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-99301946 2024-08-24 15:46:11,829 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 passed 2024-08-24 15:46:11,830 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd output: Connecting to 10.96.166.165:80 (10.96.166.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-99301946 2024-08-24 15:46:11,903 - DEBUG - [Pod ctest-pod-62955558] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.166.165:80 (10.96.166.165:80) ctest-pod-99301946 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-24 15:46:11,904 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 passed 2024-08-24 15:46:11,904 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd output: Connecting to 10.96.166.165:80 (10.96.166.165:80) ctest-pod-99301946 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-24 15:46:11,961 - DEBUG - [Pod ctest-pod-62955558] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.166.165:80 (10.96.166.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-99301946 2024-08-24 15:46:11,961 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 passed 2024-08-24 15:46:11,961 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd output: Connecting to 10.96.166.165:80 (10.96.166.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-99301946 2024-08-24 15:46:12,010 - DEBUG - [Pod ctest-pod-62955558] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.166.165:80 (10.96.166.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-81677645 2024-08-24 15:46:12,010 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 passed 2024-08-24 15:46:12,010 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd output: Connecting to 10.96.166.165:80 (10.96.166.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-81677645 2024-08-24 15:46:12,010 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-99301946': 5, 'ctest-pod-81677645': 1} 2024-08-24 15:46:12,057 - DEBUG - [Pod ctest-pod-36216715] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.166.165:80 (10.96.166.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-99301946 2024-08-24 15:46:12,057 - DEBUG - [Pod Pod ctest-pod-36216715] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 passed 2024-08-24 15:46:12,057 - DEBUG - [Pod Pod ctest-pod-36216715] Cmd output: Connecting to 10.96.166.165:80 (10.96.166.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-99301946 2024-08-24 15:46:12,099 - DEBUG - [Pod ctest-pod-36216715] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.166.165:80 (10.96.166.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-99301946 2024-08-24 15:46:12,099 - DEBUG - [Pod Pod ctest-pod-36216715] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 passed 2024-08-24 15:46:12,099 - DEBUG - [Pod Pod ctest-pod-36216715] Cmd output: Connecting to 10.96.166.165:80 (10.96.166.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-99301946 2024-08-24 15:46:12,147 - DEBUG - [Pod ctest-pod-36216715] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: ctest-pod-99301946 Connecting to 10.96.166.165:80 (10.96.166.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-24 15:46:12,148 - DEBUG - [Pod Pod ctest-pod-36216715] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 passed 2024-08-24 15:46:12,148 - DEBUG - [Pod Pod ctest-pod-36216715] Cmd output: ctest-pod-99301946 Connecting to 10.96.166.165:80 (10.96.166.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-24 15:46:12,203 - DEBUG - [Pod ctest-pod-36216715] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.166.165:80 (10.96.166.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-81677645 2024-08-24 15:46:12,203 - DEBUG - [Pod Pod ctest-pod-36216715] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 passed 2024-08-24 15:46:12,203 - DEBUG - [Pod Pod ctest-pod-36216715] Cmd output: Connecting to 10.96.166.165:80 (10.96.166.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-81677645 2024-08-24 15:46:12,203 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-99301946': 3, 'ctest-pod-81677645': 1} 2024-08-24 15:46:12,208 - DEBUG - Network policy ingress-on-service not present 2024-08-24 15:46:12,208 - INFO - Creating Network Policy ingress-on-service 2024-08-24 15:46:12,219 - INFO - Network policy found in k8s 2024-08-24 15:46:12,220 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=8e4b4202-bc61-491c-8b92-cc54825d6c2b 2024-08-24 15:46:12,226 - INFO - Network Policy ingress-on-service with uuid 8e4b4202-bc61-491c-8b92-cc54825d6c2b found in kube manager 2024-08-24 15:46:12,257 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-08-24 15:46:12,257 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-08-24 15:46:12,258 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=8e4b4202-bc61-491c-8b92-cc54825d6c2b 2024-08-24 15:46:12,289 - WARNING - Network policy with name ingress-on-service not found in agent 2024-08-24 15:46:14,291 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=8e4b4202-bc61-491c-8b92-cc54825d6c2b 2024-08-24 15:46:14,339 - WARNING - Network policy with name ingress-on-service not found in agent 2024-08-24 15:46:16,340 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=8e4b4202-bc61-491c-8b92-cc54825d6c2b 2024-08-24 15:46:16,426 - INFO - Network policy with name ingress-on-service found in agent 2024-08-24 15:46:16,427 - INFO - Network Policy ingress-on-service verification passed 2024-08-24 15:46:21,549 - DEBUG - [Pod ctest-pod-62955558] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:46:21,549 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:46:21,549 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:46:26,664 - DEBUG - [Pod ctest-pod-62955558] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:46:26,664 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:46:26,664 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:46:31,751 - DEBUG - [Pod ctest-pod-62955558] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:46:31,752 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:46:31,752 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:46:36,871 - DEBUG - [Pod ctest-pod-62955558] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:46:36,871 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:46:36,871 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:46:41,991 - DEBUG - [Pod ctest-pod-62955558] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:46:41,991 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:46:41,991 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:46:47,110 - DEBUG - [Pod ctest-pod-62955558] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:46:47,110 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:46:47,110 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:46:52,234 - DEBUG - [Pod ctest-pod-62955558] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:46:52,234 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:46:52,234 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:46:57,333 - DEBUG - [Pod ctest-pod-62955558] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:46:57,333 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:46:57,333 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:47:02,405 - DEBUG - [Pod ctest-pod-62955558] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:47:02,405 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:47:02,405 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:47:07,498 - DEBUG - [Pod ctest-pod-62955558] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:47:07,499 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:47:07,499 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:47:07,499 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-99301946': 0, 'ctest-pod-81677645': 0} 2024-08-24 15:47:07,618 - DEBUG - [Pod ctest-pod-05255210] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.166.165:80 (10.96.166.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-99301946 2024-08-24 15:47:07,618 - DEBUG - [Pod Pod ctest-pod-05255210] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 passed 2024-08-24 15:47:07,618 - DEBUG - [Pod Pod ctest-pod-05255210] Cmd output: Connecting to 10.96.166.165:80 (10.96.166.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-99301946 2024-08-24 15:47:07,698 - DEBUG - [Pod ctest-pod-05255210] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: ctest-pod-81677645 Connecting to 10.96.166.165:80 (10.96.166.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-24 15:47:07,698 - DEBUG - [Pod Pod ctest-pod-05255210] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 passed 2024-08-24 15:47:07,698 - DEBUG - [Pod Pod ctest-pod-05255210] Cmd output: ctest-pod-81677645 Connecting to 10.96.166.165:80 (10.96.166.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-24 15:47:07,698 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-99301946': 1, 'ctest-pod-81677645': 1} 2024-08-24 15:47:12,750 - DEBUG - [Pod ctest-pod-36216715] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:47:12,750 - DEBUG - [Pod Pod ctest-pod-36216715] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:47:12,750 - DEBUG - [Pod Pod ctest-pod-36216715] Cmd output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:47:17,843 - DEBUG - [Pod ctest-pod-36216715] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:47:17,843 - DEBUG - [Pod Pod ctest-pod-36216715] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:47:17,843 - DEBUG - [Pod Pod ctest-pod-36216715] Cmd output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:47:22,982 - DEBUG - [Pod ctest-pod-36216715] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:47:22,982 - DEBUG - [Pod Pod ctest-pod-36216715] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:47:22,982 - DEBUG - [Pod Pod ctest-pod-36216715] Cmd output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:47:28,075 - DEBUG - [Pod ctest-pod-36216715] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:47:28,075 - DEBUG - [Pod Pod ctest-pod-36216715] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:47:28,075 - DEBUG - [Pod Pod ctest-pod-36216715] Cmd output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:47:33,175 - DEBUG - [Pod ctest-pod-36216715] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:47:33,175 - DEBUG - [Pod Pod ctest-pod-36216715] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:47:33,176 - DEBUG - [Pod Pod ctest-pod-36216715] Cmd output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:47:38,281 - DEBUG - [Pod ctest-pod-36216715] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:47:38,281 - DEBUG - [Pod Pod ctest-pod-36216715] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:47:38,281 - DEBUG - [Pod Pod ctest-pod-36216715] Cmd output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:47:43,371 - DEBUG - [Pod ctest-pod-36216715] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:47:43,371 - DEBUG - [Pod Pod ctest-pod-36216715] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:47:43,372 - DEBUG - [Pod Pod ctest-pod-36216715] Cmd output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:47:48,486 - DEBUG - [Pod ctest-pod-36216715] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:47:48,487 - DEBUG - [Pod Pod ctest-pod-36216715] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:47:48,487 - DEBUG - [Pod Pod ctest-pod-36216715] Cmd output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:47:53,587 - DEBUG - [Pod ctest-pod-36216715] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:47:53,587 - DEBUG - [Pod Pod ctest-pod-36216715] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:47:53,587 - DEBUG - [Pod Pod ctest-pod-36216715] Cmd output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:47:58,694 - DEBUG - [Pod ctest-pod-36216715] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:47:58,694 - DEBUG - [Pod Pod ctest-pod-36216715] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:47:58,694 - DEBUG - [Pod Pod ctest-pod-36216715] Cmd output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:47:58,694 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-99301946': 0, 'ctest-pod-81677645': 0} 2024-08-24 15:48:00,779 - DEBUG - [Pod ctest-pod-05255210] Cmd: ping -c 3 10.47.255.244, Output: PING 10.47.255.244 (10.47.255.244): 56 data bytes 64 bytes from 10.47.255.244: seq=0 ttl=63 time=2.615 ms 64 bytes from 10.47.255.244: seq=1 ttl=63 time=0.091 ms 64 bytes from 10.47.255.244: seq=2 ttl=63 time=0.155 ms --- 10.47.255.244 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.091/0.953/2.615 ms 2024-08-24 15:48:00,779 - INFO - Ping check to IP 10.47.255.244 from pod ctest-pod-05255210 with expectation True passed 2024-08-24 15:48:02,859 - DEBUG - [Pod ctest-pod-62955558] Cmd: ping -c 3 10.47.255.243, Output: PING 10.47.255.243 (10.47.255.243): 56 data bytes 64 bytes from 10.47.255.243: seq=0 ttl=63 time=1.338 ms 64 bytes from 10.47.255.243: seq=1 ttl=63 time=0.068 ms 64 bytes from 10.47.255.243: seq=2 ttl=63 time=0.080 ms --- 10.47.255.243 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.068/0.495/1.338 ms 2024-08-24 15:48:02,859 - INFO - Ping check to IP 10.47.255.243 from pod ctest-pod-62955558 with expectation True passed 2024-08-24 15:48:04,956 - DEBUG - [Pod ctest-pod-36216715] Cmd: ping -c 3 10.47.255.243, Output: PING 10.47.255.243 (10.47.255.243): 56 data bytes 64 bytes from 10.47.255.243: seq=0 ttl=63 time=0.948 ms 64 bytes from 10.47.255.243: seq=1 ttl=63 time=0.167 ms 64 bytes from 10.47.255.243: seq=2 ttl=63 time=0.082 ms --- 10.47.255.243 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.082/0.399/0.948 ms 2024-08-24 15:48:04,957 - INFO - Ping check to IP 10.47.255.243 from pod ctest-pod-36216715 with expectation True passed 2024-08-24 15:48:05,044 - DEBUG - [Pod ctest-pod-05255210] Cmd: wget http://10.47.255.248 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.248 (10.47.255.248:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-24 15:48:05,044 - DEBUG - [Pod Pod ctest-pod-05255210] Cmd wget http://10.47.255.248 -O /dev/null -T 5 -t 1 passed 2024-08-24 15:48:05,044 - DEBUG - [Pod Pod ctest-pod-05255210] Cmd output: Connecting to 10.47.255.248 (10.47.255.248:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-24 15:48:05,044 - INFO - wget check of of http://10.47.255.248 from ctest-pod-05255210 passed 2024-08-24 15:48:05,110 - DEBUG - [Pod ctest-pod-05255210] Cmd: wget http://10.47.255.247 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.247 (10.47.255.247:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-24 15:48:05,110 - DEBUG - [Pod Pod ctest-pod-05255210] Cmd wget http://10.47.255.247 -O /dev/null -T 5 -t 1 passed 2024-08-24 15:48:05,110 - DEBUG - [Pod Pod ctest-pod-05255210] Cmd output: Connecting to 10.47.255.247 (10.47.255.247:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-24 15:48:05,110 - INFO - wget check of of http://10.47.255.247 from ctest-pod-05255210 passed 2024-08-24 15:48:10,166 - DEBUG - [Pod ctest-pod-62955558] Cmd: wget http://10.47.255.247 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.247 (10.47.255.247:80) wget: download timed out 2024-08-24 15:48:10,166 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd wget http://10.47.255.247 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.247 (10.47.255.247:80) wget: download timed out 2024-08-24 15:48:10,166 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd output: Connecting to 10.47.255.247 (10.47.255.247:80) wget: download timed out 2024-08-24 15:48:10,166 - INFO - wget check of of http://10.47.255.247 from ctest-pod-62955558 passed 2024-08-24 15:48:15,298 - DEBUG - [Pod ctest-pod-72427479] Cmd: wget http://10.47.255.248 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.248 (10.47.255.248:80) wget: download timed out 2024-08-24 15:48:15,298 - DEBUG - [Pod Pod ctest-pod-72427479] Cmd wget http://10.47.255.248 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.248 (10.47.255.248:80) wget: download timed out 2024-08-24 15:48:15,298 - DEBUG - [Pod Pod ctest-pod-72427479] Cmd output: Connecting to 10.47.255.248 (10.47.255.248:80) wget: download timed out 2024-08-24 15:48:15,298 - INFO - wget check of of http://10.47.255.248 from ctest-pod-72427479 passed 2024-08-24 15:48:15,321 - INFO - Updating Network Policy ingress-on-service 2024-08-24 15:48:20,411 - DEBUG - [Pod ctest-pod-62955558] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:48:20,411 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:48:20,412 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:48:25,564 - DEBUG - [Pod ctest-pod-62955558] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:48:25,567 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:48:25,567 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:48:30,639 - DEBUG - [Pod ctest-pod-62955558] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:48:30,639 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:48:30,639 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:48:35,749 - DEBUG - [Pod ctest-pod-62955558] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:48:35,749 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:48:35,750 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:48:40,859 - DEBUG - [Pod ctest-pod-62955558] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:48:40,860 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:48:40,860 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:48:45,949 - DEBUG - [Pod ctest-pod-62955558] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:48:45,949 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:48:45,950 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:48:51,055 - DEBUG - [Pod ctest-pod-62955558] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:48:51,055 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:48:51,055 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:48:56,143 - DEBUG - [Pod ctest-pod-62955558] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:48:56,144 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:48:56,144 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:49:01,194 - DEBUG - [Pod ctest-pod-62955558] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:49:01,194 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:49:01,194 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:49:06,307 - DEBUG - [Pod ctest-pod-62955558] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:49:06,308 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:49:06,308 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd output: Connecting to 10.96.166.165:80 (10.96.166.165:80) wget: download timed out 2024-08-24 15:49:06,308 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-99301946': 0, 'ctest-pod-81677645': 0} 2024-08-24 15:49:06,416 - DEBUG - [Pod ctest-pod-05255210] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.166.165:80 (10.96.166.165:80) ctest-pod-81677645 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-24 15:49:06,416 - DEBUG - [Pod Pod ctest-pod-05255210] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 passed 2024-08-24 15:49:06,416 - DEBUG - [Pod Pod ctest-pod-05255210] Cmd output: Connecting to 10.96.166.165:80 (10.96.166.165:80) ctest-pod-81677645 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-24 15:49:06,498 - DEBUG - [Pod ctest-pod-05255210] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: ctest-pod-81677645 Connecting to 10.96.166.165:80 (10.96.166.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-24 15:49:06,498 - DEBUG - [Pod Pod ctest-pod-05255210] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 passed 2024-08-24 15:49:06,498 - DEBUG - [Pod Pod ctest-pod-05255210] Cmd output: ctest-pod-81677645 Connecting to 10.96.166.165:80 (10.96.166.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-24 15:49:06,568 - DEBUG - [Pod ctest-pod-05255210] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: ctest-pod-99301946 Connecting to 10.96.166.165:80 (10.96.166.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-24 15:49:06,568 - DEBUG - [Pod Pod ctest-pod-05255210] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 passed 2024-08-24 15:49:06,568 - DEBUG - [Pod Pod ctest-pod-05255210] Cmd output: ctest-pod-99301946 Connecting to 10.96.166.165:80 (10.96.166.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-24 15:49:06,568 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-99301946': 1, 'ctest-pod-81677645': 2} 2024-08-24 15:49:06,644 - DEBUG - [Pod ctest-pod-36216715] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.166.165:80 (10.96.166.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-81677645 2024-08-24 15:49:06,644 - DEBUG - [Pod Pod ctest-pod-36216715] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 passed 2024-08-24 15:49:06,644 - DEBUG - [Pod Pod ctest-pod-36216715] Cmd output: Connecting to 10.96.166.165:80 (10.96.166.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-81677645 2024-08-24 15:49:06,702 - DEBUG - [Pod ctest-pod-36216715] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: ctest-pod-81677645 Connecting to 10.96.166.165:80 (10.96.166.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-24 15:49:06,703 - DEBUG - [Pod Pod ctest-pod-36216715] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 passed 2024-08-24 15:49:06,703 - DEBUG - [Pod Pod ctest-pod-36216715] Cmd output: ctest-pod-81677645 Connecting to 10.96.166.165:80 (10.96.166.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-24 15:49:06,768 - DEBUG - [Pod ctest-pod-36216715] Cmd: wget http://10.96.166.165:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.166.165:80 (10.96.166.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-99301946 2024-08-24 15:49:06,768 - DEBUG - [Pod Pod ctest-pod-36216715] Cmd wget http://10.96.166.165:80/ -O - -T 5 -t 1 passed 2024-08-24 15:49:06,768 - DEBUG - [Pod Pod ctest-pod-36216715] Cmd output: Connecting to 10.96.166.165:80 (10.96.166.165:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-99301946 2024-08-24 15:49:06,768 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-99301946': 1, 'ctest-pod-81677645': 2} 2024-08-24 15:49:08,835 - DEBUG - [Pod ctest-pod-05255210] Cmd: ping -c 3 10.47.255.244, Output: PING 10.47.255.244 (10.47.255.244): 56 data bytes 64 bytes from 10.47.255.244: seq=0 ttl=63 time=1.188 ms 64 bytes from 10.47.255.244: seq=1 ttl=63 time=0.168 ms 64 bytes from 10.47.255.244: seq=2 ttl=63 time=0.135 ms --- 10.47.255.244 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.135/0.497/1.188 ms 2024-08-24 15:49:08,836 - INFO - Ping check to IP 10.47.255.244 from pod ctest-pod-05255210 with expectation True passed 2024-08-24 15:49:10,977 - DEBUG - [Pod ctest-pod-62955558] Cmd: ping -c 3 10.47.255.243, Output: PING 10.47.255.243 (10.47.255.243): 56 data bytes 64 bytes from 10.47.255.243: seq=0 ttl=63 time=1.074 ms 64 bytes from 10.47.255.243: seq=1 ttl=63 time=0.128 ms 64 bytes from 10.47.255.243: seq=2 ttl=63 time=0.191 ms --- 10.47.255.243 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.128/0.464/1.074 ms 2024-08-24 15:49:10,978 - INFO - Ping check to IP 10.47.255.243 from pod ctest-pod-62955558 with expectation True passed 2024-08-24 15:49:13,119 - DEBUG - [Pod ctest-pod-36216715] Cmd: ping -c 3 10.47.255.243, Output: PING 10.47.255.243 (10.47.255.243): 56 data bytes 64 bytes from 10.47.255.243: seq=0 ttl=63 time=1.236 ms 64 bytes from 10.47.255.243: seq=1 ttl=63 time=0.153 ms 64 bytes from 10.47.255.243: seq=2 ttl=63 time=0.165 ms --- 10.47.255.243 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.153/0.518/1.236 ms 2024-08-24 15:49:13,119 - INFO - Ping check to IP 10.47.255.243 from pod ctest-pod-36216715 with expectation True passed 2024-08-24 15:49:13,208 - DEBUG - [Pod ctest-pod-05255210] Cmd: wget http://10.47.255.248 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.248 (10.47.255.248:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-24 15:49:13,208 - DEBUG - [Pod Pod ctest-pod-05255210] Cmd wget http://10.47.255.248 -O /dev/null -T 5 -t 1 passed 2024-08-24 15:49:13,208 - DEBUG - [Pod Pod ctest-pod-05255210] Cmd output: Connecting to 10.47.255.248 (10.47.255.248:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-24 15:49:13,208 - INFO - wget check of of http://10.47.255.248 from ctest-pod-05255210 passed 2024-08-24 15:49:13,271 - DEBUG - [Pod ctest-pod-05255210] Cmd: wget http://10.47.255.247 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.247 (10.47.255.247:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-24 15:49:13,271 - DEBUG - [Pod Pod ctest-pod-05255210] Cmd wget http://10.47.255.247 -O /dev/null -T 5 -t 1 passed 2024-08-24 15:49:13,271 - DEBUG - [Pod Pod ctest-pod-05255210] Cmd output: Connecting to 10.47.255.247 (10.47.255.247:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-24 15:49:13,271 - INFO - wget check of of http://10.47.255.247 from ctest-pod-05255210 passed 2024-08-24 15:49:18,340 - DEBUG - [Pod ctest-pod-62955558] Cmd: wget http://10.47.255.247 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.247 (10.47.255.247:80) wget: download timed out 2024-08-24 15:49:18,340 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd wget http://10.47.255.247 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.247 (10.47.255.247:80) wget: download timed out 2024-08-24 15:49:18,340 - DEBUG - [Pod Pod ctest-pod-62955558] Cmd output: Connecting to 10.47.255.247 (10.47.255.247:80) wget: download timed out 2024-08-24 15:49:18,341 - INFO - wget check of of http://10.47.255.247 from ctest-pod-62955558 passed 2024-08-24 15:49:18,440 - DEBUG - [Pod ctest-pod-72427479] Cmd: wget http://10.47.255.248 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.248 (10.47.255.248:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-24 15:49:18,440 - DEBUG - [Pod Pod ctest-pod-72427479] Cmd wget http://10.47.255.248 -O /dev/null -T 5 -t 1 passed 2024-08-24 15:49:18,440 - DEBUG - [Pod Pod ctest-pod-72427479] Cmd output: Connecting to 10.47.255.248 (10.47.255.248:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-24 15:49:18,440 - INFO - wget check of of http://10.47.255.248 from ctest-pod-72427479 passed 2024-08-24 15:49:18,441 - INFO - Deleting Network Policy : ingress-on-service 2024-08-24 15:49:18,442 - INFO - Deleting service : ctest-nginx-svc-45909565 2024-08-24 15:49:19,227 - DEBUG - No XMPP flaps were noticed during the test 2024-08-24 15:49:19,227 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:11] 2024-08-24 15:49:19,228 - INFO - -------------------------------------------------------------------------------- 2024-08-24 15:49:19,244 - INFO - Deleting pod ctest-new-default-63220846:ctest-pod-99301946 2024-08-24 15:49:19,245 - INFO - Deleting pod ctest-new-default-63220846:ctest-pod-81677645 2024-08-24 15:49:19,246 - INFO - Deleting pod ctest-non-default-70765980:ctest-pod-84651564 2024-08-24 15:49:19,247 - INFO - Deleting pod ctest-non-default-70765980:ctest-pod-29163787 2024-08-24 15:49:19,248 - INFO - Deleting pod ctest-new-default-63220846:ctest-pod-62955558 2024-08-24 15:49:19,249 - INFO - Deleting pod ctest-new-default-63220846:ctest-pod-05255210 2024-08-24 15:49:19,250 - INFO - Deleting pod ctest-non-default-70765980:ctest-pod-36216715 2024-08-24 15:49:19,251 - INFO - Deleting pod ctest-non-default-70765980:ctest-pod-72427479 2024-08-24 15:49:19,424 - WARNING - Pod uuid 3ab1988e-d85d-4749-8086-542be0c2f484 is still seen in agent 10.0.0.41 VM list 2024-08-24 15:49:19,472 - WARNING - Pod uuid a90d1612-ce80-4149-8405-89c9e4c243cd is still seen in agent 10.0.0.41 VM list 2024-08-24 15:49:19,473 - WARNING - Pod uuid 269822da-07ef-4a7e-8fbc-5a78e0053013 is still seen in agent 10.0.0.41 VM list 2024-08-24 15:49:19,477 - WARNING - Pod uuid f3be4ec6-17a9-4099-a05b-a488f15cfad0 is still seen in agent 10.0.0.41 VM list 2024-08-24 15:49:19,478 - WARNING - Pod uuid bd58ed0a-1484-4932-b27f-8c98772e53a2 is still seen in agent 10.0.0.41 VM list 2024-08-24 15:49:19,479 - WARNING - Pod uuid b8bcb1bc-1ec5-4a77-bb76-504f55ef342e is still seen in agent 10.0.0.41 VM list 2024-08-24 15:49:19,482 - WARNING - Pod uuid f03f4a66-11ce-4805-b0fb-3bed2af0bb4c is still seen in agent 10.0.0.41 VM list 2024-08-24 15:49:19,486 - WARNING - Pod uuid d62a33d9-95b8-4f2f-9490-71ce5f5166c7 is still seen in agent 10.0.0.41 VM list 2024-08-24 15:49:24,447 - DEBUG - Pod 3ab1988e-d85d-4749-8086-542be0c2f484 is not in agent 10.0.0.41 VM list 2024-08-24 15:49:24,468 - DEBUG - VMI eca5a022-622f-11ef-9004-fa163e8f22e7 is removed from agent 10.0.0.41 2024-08-24 15:49:24,468 - INFO - Verified that pod ctest-pod-99301946 is removed in agent 2024-08-24 15:49:24,559 - WARNING - Pod uuid bd58ed0a-1484-4932-b27f-8c98772e53a2 is still seen in agent 10.0.0.41 VM list 2024-08-24 15:49:24,561 - WARNING - Pod uuid 269822da-07ef-4a7e-8fbc-5a78e0053013 is still seen in agent 10.0.0.41 VM list 2024-08-24 15:49:24,562 - WARNING - Pod uuid a90d1612-ce80-4149-8405-89c9e4c243cd is still seen in agent 10.0.0.41 VM list 2024-08-24 15:49:24,564 - WARNING - Pod uuid f3be4ec6-17a9-4099-a05b-a488f15cfad0 is still seen in agent 10.0.0.41 VM list 2024-08-24 15:49:24,570 - DEBUG - Pod f03f4a66-11ce-4805-b0fb-3bed2af0bb4c is not in agent 10.0.0.41 VM list 2024-08-24 15:49:24,575 - DEBUG - Pod b8bcb1bc-1ec5-4a77-bb76-504f55ef342e is not in agent 10.0.0.41 VM list 2024-08-24 15:49:24,579 - DEBUG - Pod d62a33d9-95b8-4f2f-9490-71ce5f5166c7 is not in agent 10.0.0.41 VM list 2024-08-24 15:49:24,620 - DEBUG - VMI ed69f634-622f-11ef-9004-fa163e8f22e7 is removed from agent 10.0.0.41 2024-08-24 15:49:24,620 - INFO - Verified that pod ctest-pod-81677645 is removed in agent 2024-08-24 15:49:24,622 - DEBUG - VMI ef3b5f7a-622f-11ef-9004-fa163e8f22e7 is removed from agent 10.0.0.41 2024-08-24 15:49:24,622 - INFO - Verified that pod ctest-pod-29163787 is removed in agent 2024-08-24 15:49:24,624 - DEBUG - VMI ee787f64-622f-11ef-9004-fa163e8f22e7 is removed from agent 10.0.0.41 2024-08-24 15:49:24,624 - INFO - Verified that pod ctest-pod-84651564 is removed in agent 2024-08-24 15:49:29,620 - WARNING - Pod uuid bd58ed0a-1484-4932-b27f-8c98772e53a2 is still seen in agent 10.0.0.41 VM list 2024-08-24 15:49:29,628 - WARNING - Pod uuid a90d1612-ce80-4149-8405-89c9e4c243cd is still seen in agent 10.0.0.41 VM list 2024-08-24 15:49:29,630 - WARNING - Pod uuid 269822da-07ef-4a7e-8fbc-5a78e0053013 is still seen in agent 10.0.0.41 VM list 2024-08-24 15:49:29,631 - WARNING - Pod uuid f3be4ec6-17a9-4099-a05b-a488f15cfad0 is still seen in agent 10.0.0.41 VM list 2024-08-24 15:49:34,647 - WARNING - Pod uuid bd58ed0a-1484-4932-b27f-8c98772e53a2 is still seen in agent 10.0.0.41 VM list 2024-08-24 15:49:34,676 - WARNING - Pod uuid a90d1612-ce80-4149-8405-89c9e4c243cd is still seen in agent 10.0.0.41 VM list 2024-08-24 15:49:34,682 - WARNING - Pod uuid 269822da-07ef-4a7e-8fbc-5a78e0053013 is still seen in agent 10.0.0.41 VM list 2024-08-24 15:49:34,683 - WARNING - Pod uuid f3be4ec6-17a9-4099-a05b-a488f15cfad0 is still seen in agent 10.0.0.41 VM list 2024-08-24 15:49:39,661 - WARNING - Pod uuid bd58ed0a-1484-4932-b27f-8c98772e53a2 is still seen in agent 10.0.0.41 VM list 2024-08-24 15:49:39,696 - WARNING - Pod uuid a90d1612-ce80-4149-8405-89c9e4c243cd is still seen in agent 10.0.0.41 VM list 2024-08-24 15:49:39,715 - WARNING - Pod uuid 269822da-07ef-4a7e-8fbc-5a78e0053013 is still seen in agent 10.0.0.41 VM list 2024-08-24 15:49:39,719 - WARNING - Pod uuid f3be4ec6-17a9-4099-a05b-a488f15cfad0 is still seen in agent 10.0.0.41 VM list 2024-08-24 15:49:44,689 - WARNING - Pod uuid bd58ed0a-1484-4932-b27f-8c98772e53a2 is still seen in agent 10.0.0.41 VM list 2024-08-24 15:49:44,734 - WARNING - Pod uuid a90d1612-ce80-4149-8405-89c9e4c243cd is still seen in agent 10.0.0.41 VM list 2024-08-24 15:49:44,759 - WARNING - Pod uuid 269822da-07ef-4a7e-8fbc-5a78e0053013 is still seen in agent 10.0.0.41 VM list 2024-08-24 15:49:44,762 - WARNING - Pod uuid f3be4ec6-17a9-4099-a05b-a488f15cfad0 is still seen in agent 10.0.0.41 VM list 2024-08-24 15:49:49,703 - WARNING - Pod uuid bd58ed0a-1484-4932-b27f-8c98772e53a2 is still seen in agent 10.0.0.41 VM list 2024-08-24 15:49:49,743 - WARNING - Pod uuid a90d1612-ce80-4149-8405-89c9e4c243cd is still seen in agent 10.0.0.41 VM list 2024-08-24 15:49:49,768 - WARNING - Pod uuid 269822da-07ef-4a7e-8fbc-5a78e0053013 is still seen in agent 10.0.0.41 VM list 2024-08-24 15:49:49,773 - WARNING - Pod uuid f3be4ec6-17a9-4099-a05b-a488f15cfad0 is still seen in agent 10.0.0.41 VM list 2024-08-24 15:49:54,725 - DEBUG - Pod bd58ed0a-1484-4932-b27f-8c98772e53a2 is not in agent 10.0.0.41 VM list 2024-08-24 15:49:54,753 - DEBUG - VMI eff737ae-622f-11ef-9004-fa163e8f22e7 is removed from agent 10.0.0.41 2024-08-24 15:49:54,753 - INFO - Verified that pod ctest-pod-62955558 is removed in agent 2024-08-24 15:49:54,766 - DEBUG - Pod a90d1612-ce80-4149-8405-89c9e4c243cd is not in agent 10.0.0.41 VM list 2024-08-24 15:49:54,814 - DEBUG - VMI f2204f2a-622f-11ef-9004-fa163e8f22e7 is removed from agent 10.0.0.41 2024-08-24 15:49:54,814 - INFO - Verified that pod ctest-pod-72427479 is removed in agent 2024-08-24 15:49:54,819 - DEBUG - Pod 269822da-07ef-4a7e-8fbc-5a78e0053013 is not in agent 10.0.0.41 VM list 2024-08-24 15:49:54,823 - DEBUG - Pod f3be4ec6-17a9-4099-a05b-a488f15cfad0 is not in agent 10.0.0.41 VM list 2024-08-24 15:49:54,856 - DEBUG - VMI f0a5a924-622f-11ef-9004-fa163e8f22e7 is removed from agent 10.0.0.41 2024-08-24 15:49:54,856 - INFO - Verified that pod ctest-pod-05255210 is removed in agent 2024-08-24 15:49:54,860 - DEBUG - VMI f16387aa-622f-11ef-9004-fa163e8f22e7 is removed from agent 10.0.0.41 2024-08-24 15:49:54,860 - INFO - Verified that pod ctest-pod-36216715 is removed in agent 2024-08-24 15:49:54,860 - INFO - Deleting namespace ctest-non-default-70765980 2024-08-24 15:49:54,892 - DEBUG - Namespace ctest-non-default-70765980 still in k8s 2024-08-24 15:49:56,905 - DEBUG - Namespace ctest-non-default-70765980 still in k8s 2024-08-24 15:49:58,911 - DEBUG - Namespace ctest-non-default-70765980 still in k8s 2024-08-24 15:50:00,919 - DEBUG - Namespace ctest-non-default-70765980 is not in k8s 2024-08-24 15:50:00,919 - DEBUG - No need to check project deletion in contrail-api 2024-08-24 15:50:00,919 - INFO - Deleting namespace ctest-new-default-63220846 2024-08-24 15:50:00,936 - DEBUG - Namespace ctest-new-default-63220846 still in k8s 2024-08-24 15:50:02,942 - DEBUG - Namespace ctest-new-default-63220846 still in k8s 2024-08-24 15:50:04,956 - DEBUG - Namespace ctest-new-default-63220846 still in k8s 2024-08-24 15:50:06,962 - DEBUG - Namespace ctest-new-default-63220846 is not in k8s 2024-08-24 15:50:06,962 - DEBUG - No need to check project deletion in contrail-api