2024-09-19 02:11:53,528 - INFO - Using existing project ['default-domain', 'k8s-default'](b9c5c17d-e3cb-485d-ab11-da3032111fbb) 2024-09-19 02:11:53,553 - DEBUG - Namespace ctest-new-default-61788324 not present 2024-09-19 02:11:53,560 - INFO - Created namespace ctest-new-default-61788324 2024-09-19 02:11:56,565 - DEBUG - Namespace ctest-non-default-27406269 not present 2024-09-19 02:11:56,571 - INFO - Created namespace ctest-non-default-27406269 2024-09-19 02:11:59,588 - DEBUG - Pod ctest-pod-38961905 not present 2024-09-19 02:11:59,588 - INFO - Creating Pod ctest-pod-38961905 2024-09-19 02:11:59,608 - DEBUG - Pod : ctest-pod-38961905 UUID is 35099cb2-e29a-46ce-b4c0-542e806ae9fc 2024-09-19 02:11:59,612 - DEBUG - Pod ctest-pod-77165995 not present 2024-09-19 02:11:59,612 - INFO - Creating Pod ctest-pod-77165995 2024-09-19 02:11:59,630 - DEBUG - Pod : ctest-pod-77165995 UUID is f0542e05-1f52-4147-a386-a4f240633baf 2024-09-19 02:11:59,637 - DEBUG - Pod ctest-pod-95170536 not present 2024-09-19 02:11:59,637 - INFO - Creating Pod ctest-pod-95170536 2024-09-19 02:11:59,654 - DEBUG - Pod : ctest-pod-95170536 UUID is e1c775c9-8bfb-4b5a-adf7-615c09fc5277 2024-09-19 02:11:59,659 - DEBUG - Pod ctest-pod-14347803 not present 2024-09-19 02:11:59,659 - INFO - Creating Pod ctest-pod-14347803 2024-09-19 02:11:59,674 - DEBUG - Pod : ctest-pod-14347803 UUID is e433ca76-da68-48ee-b981-09bb21dd3967 2024-09-19 02:11:59,677 - DEBUG - Pod ctest-pod-07701039 not present 2024-09-19 02:11:59,677 - INFO - Creating Pod ctest-pod-07701039 2024-09-19 02:11:59,709 - DEBUG - Pod : ctest-pod-07701039 UUID is 567821ec-58e5-44b3-84d7-9282dd71a6f8 2024-09-19 02:11:59,712 - DEBUG - Pod ctest-pod-23663458 not present 2024-09-19 02:11:59,713 - INFO - Creating Pod ctest-pod-23663458 2024-09-19 02:11:59,726 - DEBUG - Pod : ctest-pod-23663458 UUID is 67bc4d77-5152-4630-9730-db3e167e4022 2024-09-19 02:11:59,730 - DEBUG - Pod ctest-pod-42424327 not present 2024-09-19 02:11:59,730 - INFO - Creating Pod ctest-pod-42424327 2024-09-19 02:11:59,760 - DEBUG - Pod : ctest-pod-42424327 UUID is d88f5030-e3bf-4961-8f9e-2e7110980942 2024-09-19 02:11:59,766 - DEBUG - Pod ctest-pod-14877529 not present 2024-09-19 02:11:59,767 - INFO - Creating Pod ctest-pod-14877529 2024-09-19 02:11:59,786 - DEBUG - Pod : ctest-pod-14877529 UUID is 3ad38ad6-d57d-4113-8cb5-b72f22de157d 2024-09-19 02:12:00,073 - INFO - Project default-domain:k8s-ctest-new-default-61788324 for Namespace ctest-new-default-61788324 is seen in contrail-api 2024-09-19 02:12:00,073 - DEBUG - Project uuid in Contrail is b348d2e3-bf97-48ed-b4ab-5fd04b194558 2024-09-19 02:12:00,366 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_NamespaceDatabaseList?namespace_uuid=7b246a19-ee3e-4687-834e-687d3b6bae9a 2024-09-19 02:12:00,376 - INFO - Namespace ctest-new-default-61788324 with uuid 7b246a19-ee3e-4687-834e-687d3b6bae9a found in kube manager 2024-09-19 02:12:00,376 - INFO - Namespace ctest-new-default-61788324 verification passed 2024-09-19 02:12:00,982 - INFO - Project default-domain:k8s-ctest-non-default-27406269 for Namespace ctest-non-default-27406269 is seen in contrail-api 2024-09-19 02:12:00,982 - DEBUG - Project uuid in Contrail is 2079184f-25ca-4aaa-9306-1e30b3e4cd5a 2024-09-19 02:12:00,982 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_NamespaceDatabaseList?namespace_uuid=33fb8e4a-df1f-49fe-a21a-cfc0ff41851a 2024-09-19 02:12:00,991 - INFO - Namespace ctest-non-default-27406269 with uuid 33fb8e4a-df1f-49fe-a21a-cfc0ff41851a found in kube manager 2024-09-19 02:12:00,991 - INFO - Namespace ctest-non-default-27406269 verification passed 2024-09-19 02:12:00,997 - DEBUG - Pod ctest-pod-38961905 not in running state.Currently in Pending 2024-09-19 02:12:06,003 - DEBUG - Pod ctest-pod-38961905 not in running state.Currently in Pending 2024-09-19 02:12:11,010 - DEBUG - Pod ctest-pod-38961905 not in running state.Currently in Pending 2024-09-19 02:12:16,019 - INFO - Pod ctest-pod-38961905 is in running state.Got IP 10.47.255.250 2024-09-19 02:12:16,078 - DEBUG - Pod ctest-pod-38961905 has vmi 8f869f34-762c-11ef-a6d4-02423c9327d1 2024-09-19 02:12:16,078 - INFO - Verified pod ctest-pod-38961905 in contrail-api 2024-09-19 02:12:16,103 - DEBUG - VMI 8f869f34-762c-11ef-a6d4-02423c9327d1 is active in agent 10.0.0.34 2024-09-19 02:12:16,104 - INFO - Verified Pod ctest-pod-38961905 in agent 10.0.0.34 2024-09-19 02:12:16,104 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_VirtualMachineDatabaseList?x=35099cb2-e29a-46ce-b4c0-542e806ae9fc 2024-09-19 02:12:16,111 - INFO - Pod ctest-pod-38961905 with uuid 35099cb2-e29a-46ce-b4c0-542e806ae9fc found in kube manager 2024-09-19 02:12:16,112 - INFO - Pod ctest-pod-38961905 verification passed 2024-09-19 02:12:16,119 - INFO - Pod ctest-pod-77165995 is in running state.Got IP 10.47.255.249 2024-09-19 02:12:16,176 - DEBUG - Pod ctest-pod-77165995 has vmi 903d2588-762c-11ef-a6d4-02423c9327d1 2024-09-19 02:12:16,176 - INFO - Verified pod ctest-pod-77165995 in contrail-api 2024-09-19 02:12:16,187 - DEBUG - VMI 903d2588-762c-11ef-a6d4-02423c9327d1 is active in agent 10.0.0.34 2024-09-19 02:12:16,187 - INFO - Verified Pod ctest-pod-77165995 in agent 10.0.0.34 2024-09-19 02:12:16,187 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_VirtualMachineDatabaseList?x=f0542e05-1f52-4147-a386-a4f240633baf 2024-09-19 02:12:16,192 - INFO - Pod ctest-pod-77165995 with uuid f0542e05-1f52-4147-a386-a4f240633baf found in kube manager 2024-09-19 02:12:16,192 - INFO - Pod ctest-pod-77165995 verification passed 2024-09-19 02:12:16,198 - DEBUG - Pod ctest-pod-95170536 not in running state.Currently in Pending 2024-09-19 02:12:21,205 - INFO - Pod ctest-pod-95170536 is in running state.Got IP 10.47.255.248 2024-09-19 02:12:21,262 - DEBUG - Pod ctest-pod-95170536 has vmi 9144de80-762c-11ef-a6d4-02423c9327d1 2024-09-19 02:12:21,262 - INFO - Verified pod ctest-pod-95170536 in contrail-api 2024-09-19 02:12:21,279 - DEBUG - VMI 9144de80-762c-11ef-a6d4-02423c9327d1 is active in agent 10.0.0.34 2024-09-19 02:12:21,279 - INFO - Verified Pod ctest-pod-95170536 in agent 10.0.0.34 2024-09-19 02:12:21,280 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_VirtualMachineDatabaseList?x=e1c775c9-8bfb-4b5a-adf7-615c09fc5277 2024-09-19 02:12:21,284 - INFO - Pod ctest-pod-95170536 with uuid e1c775c9-8bfb-4b5a-adf7-615c09fc5277 found in kube manager 2024-09-19 02:12:21,284 - INFO - Pod ctest-pod-95170536 verification passed 2024-09-19 02:12:21,292 - INFO - Pod ctest-pod-14347803 is in running state.Got IP 10.47.255.247 2024-09-19 02:12:21,392 - DEBUG - Pod ctest-pod-14347803 has vmi 9201034e-762c-11ef-a6d4-02423c9327d1 2024-09-19 02:12:21,392 - INFO - Verified pod ctest-pod-14347803 in contrail-api 2024-09-19 02:12:21,412 - DEBUG - VMI 9201034e-762c-11ef-a6d4-02423c9327d1 is active in agent 10.0.0.34 2024-09-19 02:12:21,412 - INFO - Verified Pod ctest-pod-14347803 in agent 10.0.0.34 2024-09-19 02:12:21,412 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_VirtualMachineDatabaseList?x=e433ca76-da68-48ee-b981-09bb21dd3967 2024-09-19 02:12:21,420 - INFO - Pod ctest-pod-14347803 with uuid e433ca76-da68-48ee-b981-09bb21dd3967 found in kube manager 2024-09-19 02:12:21,420 - INFO - Pod ctest-pod-14347803 verification passed 2024-09-19 02:12:21,429 - INFO - Pod ctest-pod-07701039 is in running state.Got IP 10.47.255.246 2024-09-19 02:12:21,495 - DEBUG - Pod ctest-pod-07701039 has vmi 92d3547a-762c-11ef-a6d4-02423c9327d1 2024-09-19 02:12:21,495 - INFO - Verified pod ctest-pod-07701039 in contrail-api 2024-09-19 02:12:21,510 - DEBUG - VMI 92d3547a-762c-11ef-a6d4-02423c9327d1 is active in agent 10.0.0.34 2024-09-19 02:12:21,510 - INFO - Verified Pod ctest-pod-07701039 in agent 10.0.0.34 2024-09-19 02:12:21,511 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_VirtualMachineDatabaseList?x=567821ec-58e5-44b3-84d7-9282dd71a6f8 2024-09-19 02:12:21,515 - INFO - Pod ctest-pod-07701039 with uuid 567821ec-58e5-44b3-84d7-9282dd71a6f8 found in kube manager 2024-09-19 02:12:21,515 - INFO - Pod ctest-pod-07701039 verification passed 2024-09-19 02:12:21,521 - DEBUG - Pod ctest-pod-42424327 not in running state.Currently in Pending 2024-09-19 02:12:26,529 - INFO - Pod ctest-pod-42424327 is in running state.Got IP 10.47.255.244 2024-09-19 02:12:26,587 - DEBUG - Pod ctest-pod-42424327 has vmi 946b0f4e-762c-11ef-a6d4-02423c9327d1 2024-09-19 02:12:26,587 - INFO - Verified pod ctest-pod-42424327 in contrail-api 2024-09-19 02:12:26,599 - DEBUG - VMI 946b0f4e-762c-11ef-a6d4-02423c9327d1 is active in agent 10.0.0.34 2024-09-19 02:12:26,599 - INFO - Verified Pod ctest-pod-42424327 in agent 10.0.0.34 2024-09-19 02:12:26,599 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_VirtualMachineDatabaseList?x=d88f5030-e3bf-4961-8f9e-2e7110980942 2024-09-19 02:12:26,604 - INFO - Pod ctest-pod-42424327 with uuid d88f5030-e3bf-4961-8f9e-2e7110980942 found in kube manager 2024-09-19 02:12:26,604 - INFO - Pod ctest-pod-42424327 verification passed 2024-09-19 02:12:26,609 - INFO - Pod ctest-pod-23663458 is in running state.Got IP 10.47.255.245 2024-09-19 02:12:26,708 - DEBUG - Pod ctest-pod-23663458 has vmi 939ed618-762c-11ef-a6d4-02423c9327d1 2024-09-19 02:12:26,708 - INFO - Verified pod ctest-pod-23663458 in contrail-api 2024-09-19 02:12:26,720 - DEBUG - VMI 939ed618-762c-11ef-a6d4-02423c9327d1 is active in agent 10.0.0.34 2024-09-19 02:12:26,720 - INFO - Verified Pod ctest-pod-23663458 in agent 10.0.0.34 2024-09-19 02:12:26,721 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_VirtualMachineDatabaseList?x=67bc4d77-5152-4630-9730-db3e167e4022 2024-09-19 02:12:26,725 - INFO - Pod ctest-pod-23663458 with uuid 67bc4d77-5152-4630-9730-db3e167e4022 found in kube manager 2024-09-19 02:12:26,725 - INFO - Pod ctest-pod-23663458 verification passed 2024-09-19 02:12:26,731 - INFO - Pod ctest-pod-14877529 is in running state.Got IP 10.47.255.243 2024-09-19 02:12:26,834 - DEBUG - Pod ctest-pod-14877529 has vmi 95394bd4-762c-11ef-a6d4-02423c9327d1 2024-09-19 02:12:26,834 - INFO - Verified pod ctest-pod-14877529 in contrail-api 2024-09-19 02:12:26,848 - DEBUG - VMI 95394bd4-762c-11ef-a6d4-02423c9327d1 is active in agent 10.0.0.34 2024-09-19 02:12:26,848 - INFO - Verified Pod ctest-pod-14877529 in agent 10.0.0.34 2024-09-19 02:12:26,849 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_VirtualMachineDatabaseList?x=3ad38ad6-d57d-4113-8cb5-b72f22de157d 2024-09-19 02:12:26,855 - INFO - Pod ctest-pod-14877529 with uuid 3ad38ad6-d57d-4113-8cb5-b72f22de157d found in kube manager 2024-09-19 02:12:26,855 - INFO - Pod ctest-pod-14877529 verification passed 2024-09-19 02:12:26,855 - INFO - ================================================================================ 2024-09-19 02:12:26,855 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-09-19 02:12:26,855 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-09-19 02:12:27,106 - DEBUG - Nothing to compare xmpp stats {'10.0.0.34': {'10.0.0.34': '2'}} with 2024-09-19 02:12:27,106 - INFO - Initial checks done. Running the testcase now 2024-09-19 02:12:27,106 - INFO - 2024-09-19 02:12:27,181 - DEBUG - [Pod ctest-pod-38961905] Cmd: echo ctest-pod-38961905 > /usr/share/nginx/html/index.html, Output: 2024-09-19 02:12:27,254 - DEBUG - [Pod ctest-pod-77165995] Cmd: echo ctest-pod-77165995 > /usr/share/nginx/html/index.html, Output: 2024-09-19 02:12:27,350 - DEBUG - [Pod ctest-pod-95170536] Cmd: echo ctest-pod-95170536 > /usr/share/nginx/html/index.html, Output: 2024-09-19 02:12:27,418 - DEBUG - [Pod ctest-pod-14347803] Cmd: echo ctest-pod-14347803 > /usr/share/nginx/html/index.html, Output: 2024-09-19 02:12:27,421 - DEBUG - Service ctest-nginx-svc-09555118 not present 2024-09-19 02:12:27,422 - INFO - Creating service ctest-nginx-svc-09555118 2024-09-19 02:12:27,435 - INFO - Created Service ctest-nginx-svc-09555118 2024-09-19 02:12:27,442 - WARNING - Service UUID 2120c255-4f99-46f6-a99e-86fcf51932c1 not yet found in contrail-api 2024-09-19 02:12:28,453 - INFO - Validated that Service ctest-nginx-svc-09555118 is seen in contrail-api 2024-09-19 02:12:28,454 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_LoadbalancerDatabaseList?x=2120c255-4f99-46f6-a99e-86fcf51932c1 2024-09-19 02:12:28,458 - INFO - Service ctest-nginx-svc-09555118 with uuid 2120c255-4f99-46f6-a99e-86fcf51932c1 found in kube manager 2024-09-19 02:12:28,458 - INFO - Service ctest-nginx-svc-09555118 verification passed 2024-09-19 02:12:29,569 - DEBUG - [Pod ctest-pod-07701039] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-38961905 2024-09-19 02:12:29,569 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 passed 2024-09-19 02:12:29,569 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-38961905 2024-09-19 02:12:29,688 - DEBUG - [Pod ctest-pod-07701039] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-38961905 2024-09-19 02:12:29,688 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 passed 2024-09-19 02:12:29,688 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-38961905 2024-09-19 02:12:29,759 - DEBUG - [Pod ctest-pod-07701039] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) writing to stdout ctest-pod-38961905 - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:12:29,759 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 passed 2024-09-19 02:12:29,759 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) writing to stdout ctest-pod-38961905 - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:12:29,835 - DEBUG - [Pod ctest-pod-07701039] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: ctest-pod-38961905 Connecting to 10.97.31.54:80 (10.97.31.54:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:12:29,835 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 passed 2024-09-19 02:12:29,835 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd output: ctest-pod-38961905 Connecting to 10.97.31.54:80 (10.97.31.54:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:12:29,914 - DEBUG - [Pod ctest-pod-07701039] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-38961905 2024-09-19 02:12:29,914 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 passed 2024-09-19 02:12:29,914 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-38961905 2024-09-19 02:12:30,012 - DEBUG - [Pod ctest-pod-07701039] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) writing to stdout ctest-pod-38961905 - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:12:30,012 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 passed 2024-09-19 02:12:30,012 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) writing to stdout ctest-pod-38961905 - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:12:30,109 - DEBUG - [Pod ctest-pod-07701039] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) ctest-pod-77165995 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:12:30,109 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 passed 2024-09-19 02:12:30,109 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) ctest-pod-77165995 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:12:30,109 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-38961905': 6, 'ctest-pod-77165995': 1} 2024-09-19 02:12:30,204 - DEBUG - [Pod ctest-pod-42424327] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-77165995 2024-09-19 02:12:30,204 - DEBUG - [Pod Pod ctest-pod-42424327] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 passed 2024-09-19 02:12:30,204 - DEBUG - [Pod Pod ctest-pod-42424327] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-77165995 2024-09-19 02:12:30,293 - DEBUG - [Pod ctest-pod-42424327] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) ctest-pod-77165995 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:12:30,293 - DEBUG - [Pod Pod ctest-pod-42424327] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 passed 2024-09-19 02:12:30,293 - DEBUG - [Pod Pod ctest-pod-42424327] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) ctest-pod-77165995 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:12:30,381 - DEBUG - [Pod ctest-pod-42424327] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) ctest-pod-38961905 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:12:30,381 - DEBUG - [Pod Pod ctest-pod-42424327] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 passed 2024-09-19 02:12:30,381 - DEBUG - [Pod Pod ctest-pod-42424327] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) ctest-pod-38961905 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:12:30,381 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-38961905': 1, 'ctest-pod-77165995': 2} 2024-09-19 02:12:30,387 - DEBUG - Network policy ingress-on-service not present 2024-09-19 02:12:30,387 - INFO - Creating Network Policy ingress-on-service 2024-09-19 02:12:30,401 - INFO - Network policy found in k8s 2024-09-19 02:12:30,401 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=bf02bd13-ffb6-4eaa-b4a9-413617ef3c1e 2024-09-19 02:12:30,408 - INFO - Network Policy ingress-on-service with uuid bf02bd13-ffb6-4eaa-b4a9-413617ef3c1e found in kube manager 2024-09-19 02:12:30,439 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-09-19 02:12:30,439 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-09-19 02:12:30,439 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=bf02bd13-ffb6-4eaa-b4a9-413617ef3c1e 2024-09-19 02:12:30,473 - WARNING - Network policy with name ingress-on-service not found in agent 2024-09-19 02:12:32,474 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=bf02bd13-ffb6-4eaa-b4a9-413617ef3c1e 2024-09-19 02:12:32,504 - WARNING - Network policy with name ingress-on-service not found in agent 2024-09-19 02:12:34,505 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=bf02bd13-ffb6-4eaa-b4a9-413617ef3c1e 2024-09-19 02:12:34,532 - INFO - Network policy with name ingress-on-service found in agent 2024-09-19 02:12:34,532 - INFO - Network Policy ingress-on-service verification passed 2024-09-19 02:12:39,602 - DEBUG - [Pod ctest-pod-07701039] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:12:39,602 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:12:39,602 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:12:44,705 - DEBUG - [Pod ctest-pod-07701039] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:12:44,705 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:12:44,706 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:12:49,811 - DEBUG - [Pod ctest-pod-07701039] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:12:49,812 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:12:49,812 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:12:54,878 - DEBUG - [Pod ctest-pod-07701039] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:12:54,878 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:12:54,878 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:12:59,949 - DEBUG - [Pod ctest-pod-07701039] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:12:59,949 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:12:59,949 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:13:05,021 - DEBUG - [Pod ctest-pod-07701039] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:13:05,021 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:13:05,021 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:13:10,087 - DEBUG - [Pod ctest-pod-07701039] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:13:10,087 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:13:10,087 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:13:15,167 - DEBUG - [Pod ctest-pod-07701039] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:13:15,167 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:13:15,167 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:13:20,241 - DEBUG - [Pod ctest-pod-07701039] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:13:20,241 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:13:20,241 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:13:25,326 - DEBUG - [Pod ctest-pod-07701039] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:13:25,326 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:13:25,326 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:13:25,326 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-38961905': 0, 'ctest-pod-77165995': 0} 2024-09-19 02:13:25,411 - DEBUG - [Pod ctest-pod-23663458] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) ctest-pod-38961905 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:13:25,411 - DEBUG - [Pod Pod ctest-pod-23663458] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 passed 2024-09-19 02:13:25,411 - DEBUG - [Pod Pod ctest-pod-23663458] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) ctest-pod-38961905 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:13:25,494 - DEBUG - [Pod ctest-pod-23663458] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-77165995 2024-09-19 02:13:25,494 - DEBUG - [Pod Pod ctest-pod-23663458] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 passed 2024-09-19 02:13:25,494 - DEBUG - [Pod Pod ctest-pod-23663458] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-77165995 2024-09-19 02:13:25,494 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-38961905': 1, 'ctest-pod-77165995': 1} 2024-09-19 02:13:30,581 - DEBUG - [Pod ctest-pod-42424327] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:13:30,581 - DEBUG - [Pod Pod ctest-pod-42424327] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:13:30,581 - DEBUG - [Pod Pod ctest-pod-42424327] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:13:35,657 - DEBUG - [Pod ctest-pod-42424327] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:13:35,658 - DEBUG - [Pod Pod ctest-pod-42424327] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:13:35,658 - DEBUG - [Pod Pod ctest-pod-42424327] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:13:40,749 - DEBUG - [Pod ctest-pod-42424327] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:13:40,750 - DEBUG - [Pod Pod ctest-pod-42424327] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:13:40,750 - DEBUG - [Pod Pod ctest-pod-42424327] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:13:45,831 - DEBUG - [Pod ctest-pod-42424327] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:13:45,831 - DEBUG - [Pod Pod ctest-pod-42424327] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:13:45,831 - DEBUG - [Pod Pod ctest-pod-42424327] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:13:50,905 - DEBUG - [Pod ctest-pod-42424327] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:13:50,905 - DEBUG - [Pod Pod ctest-pod-42424327] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:13:50,905 - DEBUG - [Pod Pod ctest-pod-42424327] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:13:55,979 - DEBUG - [Pod ctest-pod-42424327] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:13:55,979 - DEBUG - [Pod Pod ctest-pod-42424327] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:13:55,979 - DEBUG - [Pod Pod ctest-pod-42424327] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:14:01,050 - DEBUG - [Pod ctest-pod-42424327] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:14:01,050 - DEBUG - [Pod Pod ctest-pod-42424327] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:14:01,050 - DEBUG - [Pod Pod ctest-pod-42424327] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:14:06,132 - DEBUG - [Pod ctest-pod-42424327] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:14:06,132 - DEBUG - [Pod Pod ctest-pod-42424327] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:14:06,132 - DEBUG - [Pod Pod ctest-pod-42424327] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:14:11,207 - DEBUG - [Pod ctest-pod-42424327] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:14:11,207 - DEBUG - [Pod Pod ctest-pod-42424327] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:14:11,207 - DEBUG - [Pod Pod ctest-pod-42424327] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:14:16,281 - DEBUG - [Pod ctest-pod-42424327] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:14:16,281 - DEBUG - [Pod Pod ctest-pod-42424327] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:14:16,281 - DEBUG - [Pod Pod ctest-pod-42424327] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:14:16,281 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-38961905': 0, 'ctest-pod-77165995': 0} 2024-09-19 02:14:18,349 - DEBUG - [Pod ctest-pod-23663458] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.806 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.058 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.070 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.058/0.311/0.806 ms 2024-09-19 02:14:18,349 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-23663458 with expectation True passed 2024-09-19 02:14:20,419 - DEBUG - [Pod ctest-pod-07701039] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.510 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.051 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.063 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.051/0.208/0.510 ms 2024-09-19 02:14:20,419 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-07701039 with expectation True passed 2024-09-19 02:14:22,492 - DEBUG - [Pod ctest-pod-42424327] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=1.189 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.052 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.083 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.052/0.441/1.189 ms 2024-09-19 02:14:22,492 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-42424327 with expectation True passed 2024-09-19 02:14:22,575 - DEBUG - [Pod ctest-pod-23663458] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-19 02:14:22,575 - DEBUG - [Pod Pod ctest-pod-23663458] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-09-19 02:14:22,575 - DEBUG - [Pod Pod ctest-pod-23663458] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-19 02:14:22,575 - INFO - wget check of of http://10.47.255.250 from ctest-pod-23663458 passed 2024-09-19 02:14:22,653 - DEBUG - [Pod ctest-pod-23663458] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-19 02:14:22,654 - DEBUG - [Pod Pod ctest-pod-23663458] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 passed 2024-09-19 02:14:22,654 - DEBUG - [Pod Pod ctest-pod-23663458] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-19 02:14:22,654 - INFO - wget check of of http://10.47.255.249 from ctest-pod-23663458 passed 2024-09-19 02:14:27,729 - DEBUG - [Pod ctest-pod-07701039] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2024-09-19 02:14:27,729 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2024-09-19 02:14:27,729 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2024-09-19 02:14:27,729 - INFO - wget check of of http://10.47.255.249 from ctest-pod-07701039 passed 2024-09-19 02:14:32,797 - DEBUG - [Pod ctest-pod-14877529] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-19 02:14:32,797 - DEBUG - [Pod Pod ctest-pod-14877529] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-19 02:14:32,797 - DEBUG - [Pod Pod ctest-pod-14877529] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-19 02:14:32,797 - INFO - wget check of of http://10.47.255.250 from ctest-pod-14877529 passed 2024-09-19 02:14:32,806 - INFO - Updating Network Policy ingress-on-service 2024-09-19 02:14:37,889 - DEBUG - [Pod ctest-pod-07701039] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:14:37,889 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:14:37,889 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:14:42,971 - DEBUG - [Pod ctest-pod-07701039] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:14:42,971 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:14:42,971 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:14:48,052 - DEBUG - [Pod ctest-pod-07701039] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:14:48,052 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:14:48,052 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:14:53,135 - DEBUG - [Pod ctest-pod-07701039] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:14:53,136 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:14:53,136 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:14:58,214 - DEBUG - [Pod ctest-pod-07701039] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:14:58,214 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:14:58,214 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:15:03,299 - DEBUG - [Pod ctest-pod-07701039] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:15:03,300 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:15:03,300 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:15:08,368 - DEBUG - [Pod ctest-pod-07701039] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:15:08,368 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:15:08,368 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:15:13,440 - DEBUG - [Pod ctest-pod-07701039] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:15:13,440 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:15:13,440 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:15:18,507 - DEBUG - [Pod ctest-pod-07701039] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:15:18,507 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:15:18,507 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:15:23,583 - DEBUG - [Pod ctest-pod-07701039] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:15:23,583 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:15:23,583 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) wget: download timed out 2024-09-19 02:15:23,583 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-38961905': 0, 'ctest-pod-77165995': 0} 2024-09-19 02:15:23,669 - DEBUG - [Pod ctest-pod-23663458] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-77165995 2024-09-19 02:15:23,669 - DEBUG - [Pod Pod ctest-pod-23663458] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 passed 2024-09-19 02:15:23,669 - DEBUG - [Pod Pod ctest-pod-23663458] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-77165995 2024-09-19 02:15:23,742 - DEBUG - [Pod ctest-pod-23663458] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) ctest-pod-77165995 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:15:23,742 - DEBUG - [Pod Pod ctest-pod-23663458] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 passed 2024-09-19 02:15:23,742 - DEBUG - [Pod Pod ctest-pod-23663458] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) ctest-pod-77165995 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:15:23,819 - DEBUG - [Pod ctest-pod-23663458] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) writing to stdout ctest-pod-38961905 - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:15:23,820 - DEBUG - [Pod Pod ctest-pod-23663458] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 passed 2024-09-19 02:15:23,820 - DEBUG - [Pod Pod ctest-pod-23663458] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) writing to stdout ctest-pod-38961905 - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:15:23,820 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-38961905': 1, 'ctest-pod-77165995': 2} 2024-09-19 02:15:23,898 - DEBUG - [Pod ctest-pod-42424327] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) ctest-pod-77165995 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:15:23,898 - DEBUG - [Pod Pod ctest-pod-42424327] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 passed 2024-09-19 02:15:23,898 - DEBUG - [Pod Pod ctest-pod-42424327] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) ctest-pod-77165995 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:15:23,971 - DEBUG - [Pod ctest-pod-42424327] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) ctest-pod-77165995 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:15:23,971 - DEBUG - [Pod Pod ctest-pod-42424327] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 passed 2024-09-19 02:15:23,972 - DEBUG - [Pod Pod ctest-pod-42424327] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) ctest-pod-77165995 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:15:24,039 - DEBUG - [Pod ctest-pod-42424327] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) ctest-pod-77165995 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:15:24,039 - DEBUG - [Pod Pod ctest-pod-42424327] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 passed 2024-09-19 02:15:24,040 - DEBUG - [Pod Pod ctest-pod-42424327] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) ctest-pod-77165995 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:15:24,118 - DEBUG - [Pod ctest-pod-42424327] Cmd: wget http://10.97.31.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.31.54:80 (10.97.31.54:80) ctest-pod-38961905 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:15:24,119 - DEBUG - [Pod Pod ctest-pod-42424327] Cmd wget http://10.97.31.54:80/ -O - -T 5 -t 1 passed 2024-09-19 02:15:24,119 - DEBUG - [Pod Pod ctest-pod-42424327] Cmd output: Connecting to 10.97.31.54:80 (10.97.31.54:80) ctest-pod-38961905 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:15:24,119 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-38961905': 1, 'ctest-pod-77165995': 3} 2024-09-19 02:15:26,194 - DEBUG - [Pod ctest-pod-23663458] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.023 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.056 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.115 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.056/0.398/1.023 ms 2024-09-19 02:15:26,194 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-23663458 with expectation True passed 2024-09-19 02:15:28,269 - DEBUG - [Pod ctest-pod-07701039] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.858 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.067 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.067 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.067/0.330/0.858 ms 2024-09-19 02:15:28,269 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-07701039 with expectation True passed 2024-09-19 02:15:30,359 - DEBUG - [Pod ctest-pod-42424327] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=1.632 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.050 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.056 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.050/0.579/1.632 ms 2024-09-19 02:15:30,359 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-42424327 with expectation True passed 2024-09-19 02:15:30,457 - DEBUG - [Pod ctest-pod-23663458] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-19 02:15:30,457 - DEBUG - [Pod Pod ctest-pod-23663458] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-09-19 02:15:30,457 - DEBUG - [Pod Pod ctest-pod-23663458] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-19 02:15:30,457 - INFO - wget check of of http://10.47.255.250 from ctest-pod-23663458 passed 2024-09-19 02:15:30,550 - DEBUG - [Pod ctest-pod-23663458] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-19 02:15:30,550 - DEBUG - [Pod Pod ctest-pod-23663458] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 passed 2024-09-19 02:15:30,550 - DEBUG - [Pod Pod ctest-pod-23663458] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-19 02:15:30,550 - INFO - wget check of of http://10.47.255.249 from ctest-pod-23663458 passed 2024-09-19 02:15:35,632 - DEBUG - [Pod ctest-pod-07701039] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2024-09-19 02:15:35,633 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2024-09-19 02:15:35,633 - DEBUG - [Pod Pod ctest-pod-07701039] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2024-09-19 02:15:35,633 - INFO - wget check of of http://10.47.255.249 from ctest-pod-07701039 passed 2024-09-19 02:15:35,704 - DEBUG - [Pod ctest-pod-14877529] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-19 02:15:35,704 - DEBUG - [Pod Pod ctest-pod-14877529] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-09-19 02:15:35,704 - DEBUG - [Pod Pod ctest-pod-14877529] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-19 02:15:35,704 - INFO - wget check of of http://10.47.255.250 from ctest-pod-14877529 passed 2024-09-19 02:15:35,704 - INFO - Deleting Network Policy : ingress-on-service 2024-09-19 02:15:35,705 - INFO - Deleting service : ctest-nginx-svc-09555118 2024-09-19 02:15:36,218 - DEBUG - No XMPP flaps were noticed during the test 2024-09-19 02:15:36,218 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:10] 2024-09-19 02:15:36,218 - INFO - -------------------------------------------------------------------------------- 2024-09-19 02:15:36,223 - INFO - Deleting pod ctest-new-default-61788324:ctest-pod-38961905 2024-09-19 02:15:36,224 - INFO - Deleting pod ctest-new-default-61788324:ctest-pod-77165995 2024-09-19 02:15:36,224 - INFO - Deleting pod ctest-non-default-27406269:ctest-pod-95170536 2024-09-19 02:15:36,225 - INFO - Deleting pod ctest-non-default-27406269:ctest-pod-14347803 2024-09-19 02:15:36,225 - INFO - Deleting pod ctest-new-default-61788324:ctest-pod-07701039 2024-09-19 02:15:36,225 - INFO - Deleting pod ctest-new-default-61788324:ctest-pod-23663458 2024-09-19 02:15:36,226 - INFO - Deleting pod ctest-non-default-27406269:ctest-pod-42424327 2024-09-19 02:15:36,226 - INFO - Deleting pod ctest-non-default-27406269:ctest-pod-14877529 2024-09-19 02:15:36,402 - WARNING - Pod uuid 67bc4d77-5152-4630-9730-db3e167e4022 is still seen in agent 10.0.0.34 VM list 2024-09-19 02:15:36,402 - WARNING - Pod uuid 35099cb2-e29a-46ce-b4c0-542e806ae9fc is still seen in agent 10.0.0.34 VM list 2024-09-19 02:15:36,403 - WARNING - Pod uuid d88f5030-e3bf-4961-8f9e-2e7110980942 is still seen in agent 10.0.0.34 VM list 2024-09-19 02:15:36,403 - WARNING - Pod uuid 567821ec-58e5-44b3-84d7-9282dd71a6f8 is still seen in agent 10.0.0.34 VM list 2024-09-19 02:15:36,404 - WARNING - Pod uuid 3ad38ad6-d57d-4113-8cb5-b72f22de157d is still seen in agent 10.0.0.34 VM list 2024-09-19 02:15:36,404 - WARNING - Pod uuid f0542e05-1f52-4147-a386-a4f240633baf is still seen in agent 10.0.0.34 VM list 2024-09-19 02:15:36,405 - WARNING - Pod uuid e433ca76-da68-48ee-b981-09bb21dd3967 is still seen in agent 10.0.0.34 VM list 2024-09-19 02:15:36,405 - WARNING - Pod uuid e1c775c9-8bfb-4b5a-adf7-615c09fc5277 is still seen in agent 10.0.0.34 VM list 2024-09-19 02:15:41,445 - WARNING - Pod uuid 3ad38ad6-d57d-4113-8cb5-b72f22de157d is still seen in agent 10.0.0.34 VM list 2024-09-19 02:15:41,445 - DEBUG - Pod 35099cb2-e29a-46ce-b4c0-542e806ae9fc is not in agent 10.0.0.34 VM list 2024-09-19 02:15:41,447 - WARNING - Pod uuid 67bc4d77-5152-4630-9730-db3e167e4022 is still seen in agent 10.0.0.34 VM list 2024-09-19 02:15:41,447 - WARNING - Pod uuid 567821ec-58e5-44b3-84d7-9282dd71a6f8 is still seen in agent 10.0.0.34 VM list 2024-09-19 02:15:41,447 - WARNING - Pod uuid d88f5030-e3bf-4961-8f9e-2e7110980942 is still seen in agent 10.0.0.34 VM list 2024-09-19 02:15:41,449 - DEBUG - Pod f0542e05-1f52-4147-a386-a4f240633baf is not in agent 10.0.0.34 VM list 2024-09-19 02:15:41,450 - DEBUG - Pod e433ca76-da68-48ee-b981-09bb21dd3967 is not in agent 10.0.0.34 VM list 2024-09-19 02:15:41,451 - DEBUG - Pod e1c775c9-8bfb-4b5a-adf7-615c09fc5277 is not in agent 10.0.0.34 VM list 2024-09-19 02:15:41,463 - DEBUG - VMI 8f869f34-762c-11ef-a6d4-02423c9327d1 is removed from agent 10.0.0.34 2024-09-19 02:15:41,463 - INFO - Verified that pod ctest-pod-38961905 is removed in agent 2024-09-19 02:15:41,465 - DEBUG - VMI 903d2588-762c-11ef-a6d4-02423c9327d1 is removed from agent 10.0.0.34 2024-09-19 02:15:41,465 - INFO - Verified that pod ctest-pod-77165995 is removed in agent 2024-09-19 02:15:41,465 - DEBUG - VMI 9201034e-762c-11ef-a6d4-02423c9327d1 is removed from agent 10.0.0.34 2024-09-19 02:15:41,465 - INFO - Verified that pod ctest-pod-14347803 is removed in agent 2024-09-19 02:15:41,466 - DEBUG - VMI 9144de80-762c-11ef-a6d4-02423c9327d1 is removed from agent 10.0.0.34 2024-09-19 02:15:41,466 - INFO - Verified that pod ctest-pod-95170536 is removed in agent 2024-09-19 02:15:46,466 - WARNING - Pod uuid 67bc4d77-5152-4630-9730-db3e167e4022 is still seen in agent 10.0.0.34 VM list 2024-09-19 02:15:46,467 - WARNING - Pod uuid 3ad38ad6-d57d-4113-8cb5-b72f22de157d is still seen in agent 10.0.0.34 VM list 2024-09-19 02:15:46,468 - WARNING - Pod uuid 567821ec-58e5-44b3-84d7-9282dd71a6f8 is still seen in agent 10.0.0.34 VM list 2024-09-19 02:15:46,468 - WARNING - Pod uuid d88f5030-e3bf-4961-8f9e-2e7110980942 is still seen in agent 10.0.0.34 VM list 2024-09-19 02:15:51,485 - WARNING - Pod uuid d88f5030-e3bf-4961-8f9e-2e7110980942 is still seen in agent 10.0.0.34 VM list 2024-09-19 02:15:51,485 - WARNING - Pod uuid 567821ec-58e5-44b3-84d7-9282dd71a6f8 is still seen in agent 10.0.0.34 VM list 2024-09-19 02:15:51,485 - WARNING - Pod uuid 3ad38ad6-d57d-4113-8cb5-b72f22de157d is still seen in agent 10.0.0.34 VM list 2024-09-19 02:15:51,486 - WARNING - Pod uuid 67bc4d77-5152-4630-9730-db3e167e4022 is still seen in agent 10.0.0.34 VM list 2024-09-19 02:15:56,505 - WARNING - Pod uuid 67bc4d77-5152-4630-9730-db3e167e4022 is still seen in agent 10.0.0.34 VM list 2024-09-19 02:15:56,505 - WARNING - Pod uuid 3ad38ad6-d57d-4113-8cb5-b72f22de157d is still seen in agent 10.0.0.34 VM list 2024-09-19 02:15:56,505 - WARNING - Pod uuid 567821ec-58e5-44b3-84d7-9282dd71a6f8 is still seen in agent 10.0.0.34 VM list 2024-09-19 02:15:56,506 - WARNING - Pod uuid d88f5030-e3bf-4961-8f9e-2e7110980942 is still seen in agent 10.0.0.34 VM list 2024-09-19 02:16:01,522 - WARNING - Pod uuid 3ad38ad6-d57d-4113-8cb5-b72f22de157d is still seen in agent 10.0.0.34 VM list 2024-09-19 02:16:01,524 - WARNING - Pod uuid 567821ec-58e5-44b3-84d7-9282dd71a6f8 is still seen in agent 10.0.0.34 VM list 2024-09-19 02:16:01,524 - WARNING - Pod uuid d88f5030-e3bf-4961-8f9e-2e7110980942 is still seen in agent 10.0.0.34 VM list 2024-09-19 02:16:01,525 - WARNING - Pod uuid 67bc4d77-5152-4630-9730-db3e167e4022 is still seen in agent 10.0.0.34 VM list 2024-09-19 02:16:06,541 - WARNING - Pod uuid 567821ec-58e5-44b3-84d7-9282dd71a6f8 is still seen in agent 10.0.0.34 VM list 2024-09-19 02:16:06,541 - WARNING - Pod uuid d88f5030-e3bf-4961-8f9e-2e7110980942 is still seen in agent 10.0.0.34 VM list 2024-09-19 02:16:06,542 - WARNING - Pod uuid 3ad38ad6-d57d-4113-8cb5-b72f22de157d is still seen in agent 10.0.0.34 VM list 2024-09-19 02:16:06,543 - WARNING - Pod uuid 67bc4d77-5152-4630-9730-db3e167e4022 is still seen in agent 10.0.0.34 VM list 2024-09-19 02:16:11,558 - DEBUG - Pod 3ad38ad6-d57d-4113-8cb5-b72f22de157d is not in agent 10.0.0.34 VM list 2024-09-19 02:16:11,561 - DEBUG - Pod d88f5030-e3bf-4961-8f9e-2e7110980942 is not in agent 10.0.0.34 VM list 2024-09-19 02:16:11,562 - DEBUG - Pod 567821ec-58e5-44b3-84d7-9282dd71a6f8 is not in agent 10.0.0.34 VM list 2024-09-19 02:16:11,564 - DEBUG - Pod 67bc4d77-5152-4630-9730-db3e167e4022 is not in agent 10.0.0.34 VM list 2024-09-19 02:16:11,576 - DEBUG - VMI 939ed618-762c-11ef-a6d4-02423c9327d1 is removed from agent 10.0.0.34 2024-09-19 02:16:11,576 - INFO - Verified that pod ctest-pod-23663458 is removed in agent 2024-09-19 02:16:11,576 - DEBUG - VMI 92d3547a-762c-11ef-a6d4-02423c9327d1 is removed from agent 10.0.0.34 2024-09-19 02:16:11,576 - INFO - Verified that pod ctest-pod-07701039 is removed in agent 2024-09-19 02:16:11,577 - DEBUG - VMI 95394bd4-762c-11ef-a6d4-02423c9327d1 is removed from agent 10.0.0.34 2024-09-19 02:16:11,577 - INFO - Verified that pod ctest-pod-14877529 is removed in agent 2024-09-19 02:16:11,577 - DEBUG - VMI 946b0f4e-762c-11ef-a6d4-02423c9327d1 is removed from agent 10.0.0.34 2024-09-19 02:16:11,577 - INFO - Verified that pod ctest-pod-42424327 is removed in agent 2024-09-19 02:16:11,577 - INFO - Deleting namespace ctest-non-default-27406269 2024-09-19 02:16:11,586 - DEBUG - Namespace ctest-non-default-27406269 still in k8s 2024-09-19 02:16:13,591 - DEBUG - Namespace ctest-non-default-27406269 still in k8s 2024-09-19 02:16:15,596 - DEBUG - Namespace ctest-non-default-27406269 still in k8s 2024-09-19 02:16:17,600 - DEBUG - Namespace ctest-non-default-27406269 is not in k8s 2024-09-19 02:16:17,600 - DEBUG - No need to check project deletion in contrail-api 2024-09-19 02:16:17,600 - INFO - Deleting namespace ctest-new-default-61788324 2024-09-19 02:16:17,608 - DEBUG - Namespace ctest-new-default-61788324 still in k8s 2024-09-19 02:16:19,613 - DEBUG - Namespace ctest-new-default-61788324 still in k8s 2024-09-19 02:16:21,617 - DEBUG - Namespace ctest-new-default-61788324 still in k8s 2024-09-19 02:16:23,621 - DEBUG - Namespace ctest-new-default-61788324 is not in k8s 2024-09-19 02:16:23,621 - DEBUG - No need to check project deletion in contrail-api