2025-01-02 22:49:35,271 - INFO - Using existing project ['default-domain', 'k8s-default'](5c27cf3a-e9aa-457d-8f24-e6858cf51872) 2025-01-02 22:49:35,292 - DEBUG - Namespace ctest-new-default-90530046 not present 2025-01-02 22:49:35,300 - INFO - Created namespace ctest-new-default-90530046 2025-01-02 22:49:38,304 - DEBUG - Namespace ctest-non-default-37745828 not present 2025-01-02 22:49:38,313 - INFO - Created namespace ctest-non-default-37745828 2025-01-02 22:49:41,329 - DEBUG - Pod ctest-pod-03599406 not present 2025-01-02 22:49:41,330 - INFO - Creating Pod ctest-pod-03599406 2025-01-02 22:49:41,354 - DEBUG - Pod : ctest-pod-03599406 UUID is 4b67274e-895e-42a6-afe9-b6c98cd8fcef 2025-01-02 22:49:41,361 - DEBUG - Pod ctest-pod-97878075 not present 2025-01-02 22:49:41,361 - INFO - Creating Pod ctest-pod-97878075 2025-01-02 22:49:41,401 - DEBUG - Pod : ctest-pod-97878075 UUID is 93198618-25c7-48ec-89cc-a2d3c9fea3b7 2025-01-02 22:49:41,404 - DEBUG - Pod ctest-pod-39995811 not present 2025-01-02 22:49:41,404 - INFO - Creating Pod ctest-pod-39995811 2025-01-02 22:49:41,431 - DEBUG - Pod : ctest-pod-39995811 UUID is 9166691b-4383-47c7-9a2a-4590170ad046 2025-01-02 22:49:41,433 - DEBUG - Pod ctest-pod-39388807 not present 2025-01-02 22:49:41,433 - INFO - Creating Pod ctest-pod-39388807 2025-01-02 22:49:41,456 - DEBUG - Pod : ctest-pod-39388807 UUID is 21aacdbd-69c4-439b-9c86-0baf61409015 2025-01-02 22:49:41,463 - DEBUG - Pod ctest-pod-20481032 not present 2025-01-02 22:49:41,463 - INFO - Creating Pod ctest-pod-20481032 2025-01-02 22:49:41,487 - DEBUG - Pod : ctest-pod-20481032 UUID is e06b67d7-723d-408a-a6db-7043a5f837b2 2025-01-02 22:49:41,489 - DEBUG - Pod ctest-pod-24813020 not present 2025-01-02 22:49:41,490 - INFO - Creating Pod ctest-pod-24813020 2025-01-02 22:49:41,514 - DEBUG - Pod : ctest-pod-24813020 UUID is 2c9c7a03-85be-4d31-8637-b722003144bf 2025-01-02 22:49:41,516 - DEBUG - Pod ctest-pod-13636461 not present 2025-01-02 22:49:41,516 - INFO - Creating Pod ctest-pod-13636461 2025-01-02 22:49:41,533 - DEBUG - Pod : ctest-pod-13636461 UUID is e41f0a9d-a142-4d7a-861c-5ee9f11b2915 2025-01-02 22:49:41,535 - DEBUG - Pod ctest-pod-50712524 not present 2025-01-02 22:49:41,536 - INFO - Creating Pod ctest-pod-50712524 2025-01-02 22:49:41,553 - DEBUG - Pod : ctest-pod-50712524 UUID is 881caf49-b4f7-4df4-8058-bf2a93e4ccf5 2025-01-02 22:49:41,726 - INFO - Project default-domain:k8s-ctest-new-default-90530046 for Namespace ctest-new-default-90530046 is seen in contrail-api 2025-01-02 22:49:41,726 - DEBUG - Project uuid in Contrail is cc3b2592-1daa-449e-bdbd-064de5471b5d 2025-01-02 22:49:41,844 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NamespaceDatabaseList?namespace_uuid=af9a424d-a3e5-463c-b689-512e8794599e 2025-01-02 22:49:41,849 - INFO - Namespace ctest-new-default-90530046 with uuid af9a424d-a3e5-463c-b689-512e8794599e found in kube manager 2025-01-02 22:49:41,849 - INFO - Namespace ctest-new-default-90530046 verification passed 2025-01-02 22:49:42,105 - INFO - Project default-domain:k8s-ctest-non-default-37745828 for Namespace ctest-non-default-37745828 is seen in contrail-api 2025-01-02 22:49:42,105 - DEBUG - Project uuid in Contrail is b7302833-10b5-46fa-8bc1-9c0da501885e 2025-01-02 22:49:42,106 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NamespaceDatabaseList?namespace_uuid=0175ba34-f3c2-4250-abc9-6c14332aa327 2025-01-02 22:49:42,110 - INFO - Namespace ctest-non-default-37745828 with uuid 0175ba34-f3c2-4250-abc9-6c14332aa327 found in kube manager 2025-01-02 22:49:42,111 - INFO - Namespace ctest-non-default-37745828 verification passed 2025-01-02 22:49:42,123 - DEBUG - Pod ctest-pod-03599406 not in running state.Currently in Pending 2025-01-02 22:49:47,129 - DEBUG - Pod ctest-pod-03599406 not in running state.Currently in Pending 2025-01-02 22:49:52,136 - DEBUG - Pod ctest-pod-03599406 not in running state.Currently in Pending 2025-01-02 22:49:57,143 - INFO - Pod ctest-pod-03599406 is in running state.Got IP 10.47.255.251 2025-01-02 22:49:57,159 - DEBUG - Pod ctest-pod-03599406 has vmi db6fedba-c95b-11ef-9276-fa163ee39bec 2025-01-02 22:49:57,159 - INFO - Verified pod ctest-pod-03599406 in contrail-api 2025-01-02 22:49:57,178 - DEBUG - VMI db6fedba-c95b-11ef-9276-fa163ee39bec is active in agent 10.0.0.24 2025-01-02 22:49:57,178 - INFO - Verified Pod ctest-pod-03599406 in agent 10.0.0.24 2025-01-02 22:49:57,179 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=4b67274e-895e-42a6-afe9-b6c98cd8fcef 2025-01-02 22:49:57,184 - INFO - Pod ctest-pod-03599406 with uuid 4b67274e-895e-42a6-afe9-b6c98cd8fcef found in kube manager 2025-01-02 22:49:57,185 - INFO - Pod ctest-pod-03599406 verification passed 2025-01-02 22:49:57,190 - INFO - Pod ctest-pod-97878075 is in running state.Got IP 10.47.255.250 2025-01-02 22:49:57,264 - DEBUG - Pod ctest-pod-97878075 has vmi dbe3b9e8-c95b-11ef-9276-fa163ee39bec 2025-01-02 22:49:57,264 - INFO - Verified pod ctest-pod-97878075 in contrail-api 2025-01-02 22:49:57,283 - DEBUG - VMI dbe3b9e8-c95b-11ef-9276-fa163ee39bec is active in agent 10.0.0.24 2025-01-02 22:49:57,283 - INFO - Verified Pod ctest-pod-97878075 in agent 10.0.0.24 2025-01-02 22:49:57,283 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=93198618-25c7-48ec-89cc-a2d3c9fea3b7 2025-01-02 22:49:57,287 - INFO - Pod ctest-pod-97878075 with uuid 93198618-25c7-48ec-89cc-a2d3c9fea3b7 found in kube manager 2025-01-02 22:49:57,288 - INFO - Pod ctest-pod-97878075 verification passed 2025-01-02 22:49:57,293 - INFO - Pod ctest-pod-39995811 is in running state.Got IP 10.47.255.249 2025-01-02 22:49:57,307 - DEBUG - Pod ctest-pod-39995811 has vmi dc8463ac-c95b-11ef-9276-fa163ee39bec 2025-01-02 22:49:57,307 - INFO - Verified pod ctest-pod-39995811 in contrail-api 2025-01-02 22:49:57,321 - DEBUG - VMI dc8463ac-c95b-11ef-9276-fa163ee39bec is active in agent 10.0.0.24 2025-01-02 22:49:57,321 - INFO - Verified Pod ctest-pod-39995811 in agent 10.0.0.24 2025-01-02 22:49:57,321 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=9166691b-4383-47c7-9a2a-4590170ad046 2025-01-02 22:49:57,326 - INFO - Pod ctest-pod-39995811 with uuid 9166691b-4383-47c7-9a2a-4590170ad046 found in kube manager 2025-01-02 22:49:57,326 - INFO - Pod ctest-pod-39995811 verification passed 2025-01-02 22:49:57,332 - INFO - Pod ctest-pod-39388807 is in running state.Got IP 10.47.255.248 2025-01-02 22:49:57,387 - DEBUG - Pod ctest-pod-39388807 has vmi dd0b1e9c-c95b-11ef-9276-fa163ee39bec 2025-01-02 22:49:57,387 - INFO - Verified pod ctest-pod-39388807 in contrail-api 2025-01-02 22:49:57,401 - DEBUG - VMI dd0b1e9c-c95b-11ef-9276-fa163ee39bec is active in agent 10.0.0.24 2025-01-02 22:49:57,401 - INFO - Verified Pod ctest-pod-39388807 in agent 10.0.0.24 2025-01-02 22:49:57,401 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=21aacdbd-69c4-439b-9c86-0baf61409015 2025-01-02 22:49:57,406 - INFO - Pod ctest-pod-39388807 with uuid 21aacdbd-69c4-439b-9c86-0baf61409015 found in kube manager 2025-01-02 22:49:57,406 - INFO - Pod ctest-pod-39388807 verification passed 2025-01-02 22:49:57,411 - INFO - Pod ctest-pod-20481032 is in running state.Got IP 10.47.255.247 2025-01-02 22:49:57,466 - DEBUG - Pod ctest-pod-20481032 has vmi dd9a9a22-c95b-11ef-9276-fa163ee39bec 2025-01-02 22:49:57,467 - INFO - Verified pod ctest-pod-20481032 in contrail-api 2025-01-02 22:49:57,486 - DEBUG - VMI dd9a9a22-c95b-11ef-9276-fa163ee39bec is active in agent 10.0.0.24 2025-01-02 22:49:57,486 - INFO - Verified Pod ctest-pod-20481032 in agent 10.0.0.24 2025-01-02 22:49:57,487 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=e06b67d7-723d-408a-a6db-7043a5f837b2 2025-01-02 22:49:57,493 - INFO - Pod ctest-pod-20481032 with uuid e06b67d7-723d-408a-a6db-7043a5f837b2 found in kube manager 2025-01-02 22:49:57,493 - INFO - Pod ctest-pod-20481032 verification passed 2025-01-02 22:49:57,500 - DEBUG - Pod ctest-pod-13636461 not in running state.Currently in Pending 2025-01-02 22:50:02,509 - INFO - Pod ctest-pod-13636461 is in running state.Got IP 10.47.255.245 2025-01-02 22:50:02,533 - DEBUG - Pod ctest-pod-13636461 has vmi de8cfc4a-c95b-11ef-9276-fa163ee39bec 2025-01-02 22:50:02,533 - INFO - Verified pod ctest-pod-13636461 in contrail-api 2025-01-02 22:50:02,550 - DEBUG - VMI de8cfc4a-c95b-11ef-9276-fa163ee39bec is active in agent 10.0.0.24 2025-01-02 22:50:02,551 - INFO - Verified Pod ctest-pod-13636461 in agent 10.0.0.24 2025-01-02 22:50:02,551 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=e41f0a9d-a142-4d7a-861c-5ee9f11b2915 2025-01-02 22:50:02,557 - INFO - Pod ctest-pod-13636461 with uuid e41f0a9d-a142-4d7a-861c-5ee9f11b2915 found in kube manager 2025-01-02 22:50:02,557 - INFO - Pod ctest-pod-13636461 verification passed 2025-01-02 22:50:02,563 - INFO - Pod ctest-pod-24813020 is in running state.Got IP 10.47.255.246 2025-01-02 22:50:02,634 - DEBUG - Pod ctest-pod-24813020 has vmi de1798e2-c95b-11ef-9276-fa163ee39bec 2025-01-02 22:50:02,635 - INFO - Verified pod ctest-pod-24813020 in contrail-api 2025-01-02 22:50:02,650 - DEBUG - VMI de1798e2-c95b-11ef-9276-fa163ee39bec is active in agent 10.0.0.24 2025-01-02 22:50:02,650 - INFO - Verified Pod ctest-pod-24813020 in agent 10.0.0.24 2025-01-02 22:50:02,650 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=2c9c7a03-85be-4d31-8637-b722003144bf 2025-01-02 22:50:02,655 - INFO - Pod ctest-pod-24813020 with uuid 2c9c7a03-85be-4d31-8637-b722003144bf found in kube manager 2025-01-02 22:50:02,655 - INFO - Pod ctest-pod-24813020 verification passed 2025-01-02 22:50:02,660 - INFO - Pod ctest-pod-50712524 is in running state.Got IP 10.47.255.244 2025-01-02 22:50:02,678 - DEBUG - Pod ctest-pod-50712524 has vmi df09b1f4-c95b-11ef-9276-fa163ee39bec 2025-01-02 22:50:02,678 - INFO - Verified pod ctest-pod-50712524 in contrail-api 2025-01-02 22:50:02,693 - DEBUG - VMI df09b1f4-c95b-11ef-9276-fa163ee39bec is active in agent 10.0.0.24 2025-01-02 22:50:02,693 - INFO - Verified Pod ctest-pod-50712524 in agent 10.0.0.24 2025-01-02 22:50:02,693 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=881caf49-b4f7-4df4-8058-bf2a93e4ccf5 2025-01-02 22:50:02,699 - INFO - Pod ctest-pod-50712524 with uuid 881caf49-b4f7-4df4-8058-bf2a93e4ccf5 found in kube manager 2025-01-02 22:50:02,699 - INFO - Pod ctest-pod-50712524 verification passed 2025-01-02 22:50:02,699 - INFO - ================================================================================ 2025-01-02 22:50:02,699 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-01-02 22:50:02,699 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-01-02 22:50:02,900 - DEBUG - Nothing to compare xmpp stats {'10.0.0.24': {'10.0.0.50': '0'}} with 2025-01-02 22:50:02,900 - INFO - Initial checks done. Running the testcase now 2025-01-02 22:50:02,900 - INFO - 2025-01-02 22:50:02,955 - DEBUG - [Pod ctest-pod-03599406] Cmd: echo ctest-pod-03599406 > /usr/share/nginx/html/index.html, Output: 2025-01-02 22:50:03,028 - DEBUG - [Pod ctest-pod-97878075] Cmd: echo ctest-pod-97878075 > /usr/share/nginx/html/index.html, Output: 2025-01-02 22:50:03,099 - DEBUG - [Pod ctest-pod-39995811] Cmd: echo ctest-pod-39995811 > /usr/share/nginx/html/index.html, Output: 2025-01-02 22:50:03,172 - DEBUG - [Pod ctest-pod-39388807] Cmd: echo ctest-pod-39388807 > /usr/share/nginx/html/index.html, Output: 2025-01-02 22:50:03,175 - DEBUG - Service ctest-nginx-svc-76743322 not present 2025-01-02 22:50:03,176 - INFO - Creating service ctest-nginx-svc-76743322 2025-01-02 22:50:03,187 - INFO - Created Service ctest-nginx-svc-76743322 2025-01-02 22:50:03,196 - WARNING - Service UUID 552cf3f7-d1bf-46ba-a1b0-07c27c50874c not yet found in contrail-api 2025-01-02 22:50:04,214 - INFO - Validated that Service ctest-nginx-svc-76743322 is seen in contrail-api 2025-01-02 22:50:04,214 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_LoadbalancerDatabaseList?x=552cf3f7-d1bf-46ba-a1b0-07c27c50874c 2025-01-02 22:50:04,221 - INFO - Service ctest-nginx-svc-76743322 with uuid 552cf3f7-d1bf-46ba-a1b0-07c27c50874c found in kube manager 2025-01-02 22:50:04,221 - INFO - Service ctest-nginx-svc-76743322 verification passed 2025-01-02 22:50:05,293 - DEBUG - [Pod ctest-pod-20481032] Cmd: wget http://10.102.94.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.94.231:80 (10.102.94.231:80) ctest-pod-03599406 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 22:50:05,294 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd wget http://10.102.94.231:80/ -O - -T 5 -t 1 passed 2025-01-02 22:50:05,294 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd output: Connecting to 10.102.94.231:80 (10.102.94.231:80) ctest-pod-03599406 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 22:50:05,357 - DEBUG - [Pod ctest-pod-20481032] Cmd: wget http://10.102.94.231:80/ -O - -T 5 -t 1 , Output: ctest-pod-03599406 Connecting to 10.102.94.231:80 (10.102.94.231:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 22:50:05,357 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd wget http://10.102.94.231:80/ -O - -T 5 -t 1 passed 2025-01-02 22:50:05,357 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd output: ctest-pod-03599406 Connecting to 10.102.94.231:80 (10.102.94.231:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 22:50:05,425 - DEBUG - [Pod ctest-pod-20481032] Cmd: wget http://10.102.94.231:80/ -O - -T 5 -t 1 , Output: ctest-pod-03599406 Connecting to 10.102.94.231:80 (10.102.94.231:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 22:50:05,425 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd wget http://10.102.94.231:80/ -O - -T 5 -t 1 passed 2025-01-02 22:50:05,425 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd output: ctest-pod-03599406 Connecting to 10.102.94.231:80 (10.102.94.231:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 22:50:05,512 - DEBUG - [Pod ctest-pod-20481032] Cmd: wget http://10.102.94.231:80/ -O - -T 5 -t 1 , Output: ctest-pod-03599406 Connecting to 10.102.94.231:80 (10.102.94.231:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 22:50:05,513 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd wget http://10.102.94.231:80/ -O - -T 5 -t 1 passed 2025-01-02 22:50:05,513 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd output: ctest-pod-03599406 Connecting to 10.102.94.231:80 (10.102.94.231:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 22:50:05,586 - DEBUG - [Pod ctest-pod-20481032] Cmd: wget http://10.102.94.231:80/ -O - -T 5 -t 1 , Output: ctest-pod-03599406 Connecting to 10.102.94.231:80 (10.102.94.231:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 22:50:05,587 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd wget http://10.102.94.231:80/ -O - -T 5 -t 1 passed 2025-01-02 22:50:05,587 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd output: ctest-pod-03599406 Connecting to 10.102.94.231:80 (10.102.94.231:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 22:50:05,647 - DEBUG - [Pod ctest-pod-20481032] Cmd: wget http://10.102.94.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.94.231:80 (10.102.94.231:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-97878075 2025-01-02 22:50:05,647 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd wget http://10.102.94.231:80/ -O - -T 5 -t 1 passed 2025-01-02 22:50:05,648 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd output: Connecting to 10.102.94.231:80 (10.102.94.231:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-97878075 2025-01-02 22:50:05,648 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-03599406': 5, 'ctest-pod-97878075': 1} 2025-01-02 22:50:05,714 - DEBUG - [Pod ctest-pod-13636461] Cmd: wget http://10.102.94.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.94.231:80 (10.102.94.231:80) ctest-pod-97878075 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 22:50:05,714 - DEBUG - [Pod Pod ctest-pod-13636461] Cmd wget http://10.102.94.231:80/ -O - -T 5 -t 1 passed 2025-01-02 22:50:05,714 - DEBUG - [Pod Pod ctest-pod-13636461] Cmd output: Connecting to 10.102.94.231:80 (10.102.94.231:80) ctest-pod-97878075 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 22:50:05,773 - DEBUG - [Pod ctest-pod-13636461] Cmd: wget http://10.102.94.231:80/ -O - -T 5 -t 1 , Output: ctest-pod-03599406 Connecting to 10.102.94.231:80 (10.102.94.231:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 22:50:05,773 - DEBUG - [Pod Pod ctest-pod-13636461] Cmd wget http://10.102.94.231:80/ -O - -T 5 -t 1 passed 2025-01-02 22:50:05,773 - DEBUG - [Pod Pod ctest-pod-13636461] Cmd output: ctest-pod-03599406 Connecting to 10.102.94.231:80 (10.102.94.231:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 22:50:05,773 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-03599406': 1, 'ctest-pod-97878075': 1} 2025-01-02 22:50:05,777 - DEBUG - Network policy ingress-on-service not present 2025-01-02 22:50:05,778 - INFO - Creating Network Policy ingress-on-service 2025-01-02 22:50:05,797 - INFO - Network policy found in k8s 2025-01-02 22:50:05,797 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=d1f131dd-e229-4d27-bd45-f504cb0e0ab4 2025-01-02 22:50:05,806 - INFO - Network Policy ingress-on-service with uuid d1f131dd-e229-4d27-bd45-f504cb0e0ab4 found in kube manager 2025-01-02 22:50:05,840 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-01-02 22:50:05,840 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-01-02 22:50:05,841 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=d1f131dd-e229-4d27-bd45-f504cb0e0ab4 2025-01-02 22:50:05,873 - WARNING - Network policy with name ingress-on-service not found in agent 2025-01-02 22:50:07,874 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=d1f131dd-e229-4d27-bd45-f504cb0e0ab4 2025-01-02 22:50:07,908 - INFO - Network policy with name ingress-on-service found in agent 2025-01-02 22:50:07,908 - INFO - Network Policy ingress-on-service verification passed 2025-01-02 22:50:12,981 - DEBUG - [Pod ctest-pod-20481032] Cmd: wget http://10.102.94.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:50:12,981 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd wget http://10.102.94.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:50:12,981 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:50:18,044 - DEBUG - [Pod ctest-pod-20481032] Cmd: wget http://10.102.94.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:50:18,044 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd wget http://10.102.94.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:50:18,044 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:50:23,102 - DEBUG - [Pod ctest-pod-20481032] Cmd: wget http://10.102.94.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:50:23,102 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd wget http://10.102.94.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:50:23,102 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:50:28,160 - DEBUG - [Pod ctest-pod-20481032] Cmd: wget http://10.102.94.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:50:28,160 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd wget http://10.102.94.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:50:28,160 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:50:33,214 - DEBUG - [Pod ctest-pod-20481032] Cmd: wget http://10.102.94.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:50:33,214 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd wget http://10.102.94.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:50:33,214 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:50:38,275 - DEBUG - [Pod ctest-pod-20481032] Cmd: wget http://10.102.94.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:50:38,275 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd wget http://10.102.94.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:50:38,275 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:50:43,342 - DEBUG - [Pod ctest-pod-20481032] Cmd: wget http://10.102.94.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:50:43,343 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd wget http://10.102.94.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:50:43,343 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:50:48,407 - DEBUG - [Pod ctest-pod-20481032] Cmd: wget http://10.102.94.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:50:48,407 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd wget http://10.102.94.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:50:48,407 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:50:53,466 - DEBUG - [Pod ctest-pod-20481032] Cmd: wget http://10.102.94.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:50:53,466 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd wget http://10.102.94.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:50:53,466 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:50:58,522 - DEBUG - [Pod ctest-pod-20481032] Cmd: wget http://10.102.94.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:50:58,523 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd wget http://10.102.94.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:50:58,523 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:50:58,523 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-03599406': 0, 'ctest-pod-97878075': 0} 2025-01-02 22:50:58,601 - DEBUG - [Pod ctest-pod-24813020] Cmd: wget http://10.102.94.231:80/ -O - -T 5 -t 1 , Output: ctest-pod-97878075 Connecting to 10.102.94.231:80 (10.102.94.231:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 22:50:58,601 - DEBUG - [Pod Pod ctest-pod-24813020] Cmd wget http://10.102.94.231:80/ -O - -T 5 -t 1 passed 2025-01-02 22:50:58,601 - DEBUG - [Pod Pod ctest-pod-24813020] Cmd output: ctest-pod-97878075 Connecting to 10.102.94.231:80 (10.102.94.231:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 22:50:58,667 - DEBUG - [Pod ctest-pod-24813020] Cmd: wget http://10.102.94.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.94.231:80 (10.102.94.231:80) ctest-pod-97878075 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 22:50:58,667 - DEBUG - [Pod Pod ctest-pod-24813020] Cmd wget http://10.102.94.231:80/ -O - -T 5 -t 1 passed 2025-01-02 22:50:58,668 - DEBUG - [Pod Pod ctest-pod-24813020] Cmd output: Connecting to 10.102.94.231:80 (10.102.94.231:80) ctest-pod-97878075 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 22:50:58,737 - DEBUG - [Pod ctest-pod-24813020] Cmd: wget http://10.102.94.231:80/ -O - -T 5 -t 1 , Output: ctest-pod-97878075 Connecting to 10.102.94.231:80 (10.102.94.231:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 22:50:58,737 - DEBUG - [Pod Pod ctest-pod-24813020] Cmd wget http://10.102.94.231:80/ -O - -T 5 -t 1 passed 2025-01-02 22:50:58,737 - DEBUG - [Pod Pod ctest-pod-24813020] Cmd output: ctest-pod-97878075 Connecting to 10.102.94.231:80 (10.102.94.231:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 22:50:58,795 - DEBUG - [Pod ctest-pod-24813020] Cmd: wget http://10.102.94.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.94.231:80 (10.102.94.231:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-03599406 2025-01-02 22:50:58,795 - DEBUG - [Pod Pod ctest-pod-24813020] Cmd wget http://10.102.94.231:80/ -O - -T 5 -t 1 passed 2025-01-02 22:50:58,795 - DEBUG - [Pod Pod ctest-pod-24813020] Cmd output: Connecting to 10.102.94.231:80 (10.102.94.231:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-03599406 2025-01-02 22:50:58,795 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-03599406': 1, 'ctest-pod-97878075': 3} 2025-01-02 22:51:03,851 - DEBUG - [Pod ctest-pod-13636461] Cmd: wget http://10.102.94.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:51:03,851 - DEBUG - [Pod Pod ctest-pod-13636461] Cmd wget http://10.102.94.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:51:03,852 - DEBUG - [Pod Pod ctest-pod-13636461] Cmd output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:51:08,918 - DEBUG - [Pod ctest-pod-13636461] Cmd: wget http://10.102.94.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:51:08,918 - DEBUG - [Pod Pod ctest-pod-13636461] Cmd wget http://10.102.94.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:51:08,918 - DEBUG - [Pod Pod ctest-pod-13636461] Cmd output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:51:13,994 - DEBUG - [Pod ctest-pod-13636461] Cmd: wget http://10.102.94.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:51:13,994 - DEBUG - [Pod Pod ctest-pod-13636461] Cmd wget http://10.102.94.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:51:13,994 - DEBUG - [Pod Pod ctest-pod-13636461] Cmd output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:51:19,059 - DEBUG - [Pod ctest-pod-13636461] Cmd: wget http://10.102.94.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:51:19,059 - DEBUG - [Pod Pod ctest-pod-13636461] Cmd wget http://10.102.94.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:51:19,059 - DEBUG - [Pod Pod ctest-pod-13636461] Cmd output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:51:24,122 - DEBUG - [Pod ctest-pod-13636461] Cmd: wget http://10.102.94.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:51:24,122 - DEBUG - [Pod Pod ctest-pod-13636461] Cmd wget http://10.102.94.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:51:24,122 - DEBUG - [Pod Pod ctest-pod-13636461] Cmd output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:51:29,187 - DEBUG - [Pod ctest-pod-13636461] Cmd: wget http://10.102.94.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:51:29,187 - DEBUG - [Pod Pod ctest-pod-13636461] Cmd wget http://10.102.94.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:51:29,187 - DEBUG - [Pod Pod ctest-pod-13636461] Cmd output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:51:34,257 - DEBUG - [Pod ctest-pod-13636461] Cmd: wget http://10.102.94.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:51:34,258 - DEBUG - [Pod Pod ctest-pod-13636461] Cmd wget http://10.102.94.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:51:34,258 - DEBUG - [Pod Pod ctest-pod-13636461] Cmd output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:51:39,319 - DEBUG - [Pod ctest-pod-13636461] Cmd: wget http://10.102.94.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:51:39,319 - DEBUG - [Pod Pod ctest-pod-13636461] Cmd wget http://10.102.94.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:51:39,319 - DEBUG - [Pod Pod ctest-pod-13636461] Cmd output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:51:44,391 - DEBUG - [Pod ctest-pod-13636461] Cmd: wget http://10.102.94.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:51:44,391 - DEBUG - [Pod Pod ctest-pod-13636461] Cmd wget http://10.102.94.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:51:44,391 - DEBUG - [Pod Pod ctest-pod-13636461] Cmd output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:51:49,468 - DEBUG - [Pod ctest-pod-13636461] Cmd: wget http://10.102.94.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:51:49,468 - DEBUG - [Pod Pod ctest-pod-13636461] Cmd wget http://10.102.94.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:51:49,468 - DEBUG - [Pod Pod ctest-pod-13636461] Cmd output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:51:49,468 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-03599406': 0, 'ctest-pod-97878075': 0} 2025-01-02 22:51:51,534 - DEBUG - [Pod ctest-pod-24813020] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.358 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.092 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.085 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.085/0.511/1.358 ms 2025-01-02 22:51:51,534 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-24813020 with expectation True passed 2025-01-02 22:51:53,606 - DEBUG - [Pod ctest-pod-20481032] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.954 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.081 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.105 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.081/0.380/0.954 ms 2025-01-02 22:51:53,606 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-20481032 with expectation True passed 2025-01-02 22:51:55,686 - DEBUG - [Pod ctest-pod-13636461] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.895 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.090 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.083 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.083/0.689/1.895 ms 2025-01-02 22:51:55,686 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-13636461 with expectation True passed 2025-01-02 22:51:55,738 - DEBUG - [Pod ctest-pod-24813020] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-02 22:51:55,738 - DEBUG - [Pod Pod ctest-pod-24813020] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-01-02 22:51:55,738 - DEBUG - [Pod Pod ctest-pod-24813020] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-02 22:51:55,739 - INFO - wget check of of http://10.47.255.251 from ctest-pod-24813020 passed 2025-01-02 22:51:55,794 - DEBUG - [Pod ctest-pod-24813020] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-02 22:51:55,795 - DEBUG - [Pod Pod ctest-pod-24813020] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-01-02 22:51:55,795 - DEBUG - [Pod Pod ctest-pod-24813020] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-02 22:51:55,795 - INFO - wget check of of http://10.47.255.250 from ctest-pod-24813020 passed 2025-01-02 22:52:00,855 - DEBUG - [Pod ctest-pod-20481032] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-02 22:52:00,856 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-02 22:52:00,856 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-02 22:52:00,856 - INFO - wget check of of http://10.47.255.250 from ctest-pod-20481032 passed 2025-01-02 22:52:05,911 - DEBUG - [Pod ctest-pod-50712524] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-01-02 22:52:05,912 - DEBUG - [Pod Pod ctest-pod-50712524] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-01-02 22:52:05,912 - DEBUG - [Pod Pod ctest-pod-50712524] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-01-02 22:52:05,912 - INFO - wget check of of http://10.47.255.251 from ctest-pod-50712524 passed 2025-01-02 22:52:05,921 - INFO - Updating Network Policy ingress-on-service 2025-01-02 22:52:11,004 - DEBUG - [Pod ctest-pod-20481032] Cmd: wget http://10.102.94.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:52:11,004 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd wget http://10.102.94.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:52:11,004 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:52:16,067 - DEBUG - [Pod ctest-pod-20481032] Cmd: wget http://10.102.94.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:52:16,067 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd wget http://10.102.94.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:52:16,067 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:52:21,141 - DEBUG - [Pod ctest-pod-20481032] Cmd: wget http://10.102.94.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:52:21,141 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd wget http://10.102.94.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:52:21,141 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:52:26,217 - DEBUG - [Pod ctest-pod-20481032] Cmd: wget http://10.102.94.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:52:26,217 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd wget http://10.102.94.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:52:26,217 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:52:31,290 - DEBUG - [Pod ctest-pod-20481032] Cmd: wget http://10.102.94.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:52:31,290 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd wget http://10.102.94.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:52:31,290 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:52:36,350 - DEBUG - [Pod ctest-pod-20481032] Cmd: wget http://10.102.94.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:52:36,350 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd wget http://10.102.94.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:52:36,350 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:52:41,420 - DEBUG - [Pod ctest-pod-20481032] Cmd: wget http://10.102.94.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:52:41,420 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd wget http://10.102.94.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:52:41,420 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:52:46,472 - DEBUG - [Pod ctest-pod-20481032] Cmd: wget http://10.102.94.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:52:46,473 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd wget http://10.102.94.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:52:46,473 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:52:51,538 - DEBUG - [Pod ctest-pod-20481032] Cmd: wget http://10.102.94.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:52:51,539 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd wget http://10.102.94.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:52:51,539 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:52:56,601 - DEBUG - [Pod ctest-pod-20481032] Cmd: wget http://10.102.94.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:52:56,601 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd wget http://10.102.94.231:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:52:56,601 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd output: Connecting to 10.102.94.231:80 (10.102.94.231:80) wget: download timed out 2025-01-02 22:52:56,601 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-03599406': 0, 'ctest-pod-97878075': 0} 2025-01-02 22:52:56,668 - DEBUG - [Pod ctest-pod-24813020] Cmd: wget http://10.102.94.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.94.231:80 (10.102.94.231:80) ctest-pod-97878075 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 22:52:56,668 - DEBUG - [Pod Pod ctest-pod-24813020] Cmd wget http://10.102.94.231:80/ -O - -T 5 -t 1 passed 2025-01-02 22:52:56,668 - DEBUG - [Pod Pod ctest-pod-24813020] Cmd output: Connecting to 10.102.94.231:80 (10.102.94.231:80) ctest-pod-97878075 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 22:52:56,730 - DEBUG - [Pod ctest-pod-24813020] Cmd: wget http://10.102.94.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.94.231:80 (10.102.94.231:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-03599406 2025-01-02 22:52:56,730 - DEBUG - [Pod Pod ctest-pod-24813020] Cmd wget http://10.102.94.231:80/ -O - -T 5 -t 1 passed 2025-01-02 22:52:56,730 - DEBUG - [Pod Pod ctest-pod-24813020] Cmd output: Connecting to 10.102.94.231:80 (10.102.94.231:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-03599406 2025-01-02 22:52:56,730 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-03599406': 1, 'ctest-pod-97878075': 1} 2025-01-02 22:52:56,810 - DEBUG - [Pod ctest-pod-13636461] Cmd: wget http://10.102.94.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.94.231:80 (10.102.94.231:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-03599406 2025-01-02 22:52:56,810 - DEBUG - [Pod Pod ctest-pod-13636461] Cmd wget http://10.102.94.231:80/ -O - -T 5 -t 1 passed 2025-01-02 22:52:56,810 - DEBUG - [Pod Pod ctest-pod-13636461] Cmd output: Connecting to 10.102.94.231:80 (10.102.94.231:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-03599406 2025-01-02 22:52:56,864 - DEBUG - [Pod ctest-pod-13636461] Cmd: wget http://10.102.94.231:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.94.231:80 (10.102.94.231:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-97878075 2025-01-02 22:52:56,864 - DEBUG - [Pod Pod ctest-pod-13636461] Cmd wget http://10.102.94.231:80/ -O - -T 5 -t 1 passed 2025-01-02 22:52:56,864 - DEBUG - [Pod Pod ctest-pod-13636461] Cmd output: Connecting to 10.102.94.231:80 (10.102.94.231:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-97878075 2025-01-02 22:52:56,864 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-03599406': 1, 'ctest-pod-97878075': 1} 2025-01-02 22:52:58,925 - DEBUG - [Pod ctest-pod-24813020] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.613 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.075 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.109 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.075/0.265/0.613 ms 2025-01-02 22:52:58,925 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-24813020 with expectation True passed 2025-01-02 22:53:00,993 - DEBUG - [Pod ctest-pod-20481032] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.928 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.080 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.082 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.080/0.363/0.928 ms 2025-01-02 22:53:00,993 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-20481032 with expectation True passed 2025-01-02 22:53:03,048 - DEBUG - [Pod ctest-pod-13636461] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.072 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.081 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.085 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.081/0.412/1.072 ms 2025-01-02 22:53:03,048 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-13636461 with expectation True passed 2025-01-02 22:53:03,120 - DEBUG - [Pod ctest-pod-24813020] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-02 22:53:03,120 - DEBUG - [Pod Pod ctest-pod-24813020] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-01-02 22:53:03,120 - DEBUG - [Pod Pod ctest-pod-24813020] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-02 22:53:03,120 - INFO - wget check of of http://10.47.255.251 from ctest-pod-24813020 passed 2025-01-02 22:53:03,169 - DEBUG - [Pod ctest-pod-24813020] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-02 22:53:03,169 - DEBUG - [Pod Pod ctest-pod-24813020] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-01-02 22:53:03,169 - DEBUG - [Pod Pod ctest-pod-24813020] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-02 22:53:03,169 - INFO - wget check of of http://10.47.255.250 from ctest-pod-24813020 passed 2025-01-02 22:53:08,207 - DEBUG - [Pod ctest-pod-20481032] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-02 22:53:08,207 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-02 22:53:08,207 - DEBUG - [Pod Pod ctest-pod-20481032] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-02 22:53:08,207 - INFO - wget check of of http://10.47.255.250 from ctest-pod-20481032 passed 2025-01-02 22:53:08,264 - DEBUG - [Pod ctest-pod-50712524] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-02 22:53:08,264 - DEBUG - [Pod Pod ctest-pod-50712524] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-01-02 22:53:08,265 - DEBUG - [Pod Pod ctest-pod-50712524] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-02 22:53:08,265 - INFO - wget check of of http://10.47.255.251 from ctest-pod-50712524 passed 2025-01-02 22:53:08,265 - INFO - Deleting Network Policy : ingress-on-service 2025-01-02 22:53:08,265 - INFO - Deleting service : ctest-nginx-svc-76743322 2025-01-02 22:53:08,455 - DEBUG - No XMPP flaps were noticed during the test 2025-01-02 22:53:08,455 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:06] 2025-01-02 22:53:08,455 - INFO - -------------------------------------------------------------------------------- 2025-01-02 22:53:08,461 - INFO - Deleting pod ctest-new-default-90530046:ctest-pod-03599406 2025-01-02 22:53:08,461 - INFO - Deleting pod ctest-new-default-90530046:ctest-pod-97878075 2025-01-02 22:53:08,462 - INFO - Deleting pod ctest-non-default-37745828:ctest-pod-39995811 2025-01-02 22:53:08,462 - INFO - Deleting pod ctest-non-default-37745828:ctest-pod-39388807 2025-01-02 22:53:08,462 - INFO - Deleting pod ctest-new-default-90530046:ctest-pod-20481032 2025-01-02 22:53:08,463 - INFO - Deleting pod ctest-new-default-90530046:ctest-pod-24813020 2025-01-02 22:53:08,463 - INFO - Deleting pod ctest-non-default-37745828:ctest-pod-13636461 2025-01-02 22:53:08,463 - INFO - Deleting pod ctest-non-default-37745828:ctest-pod-50712524 2025-01-02 22:53:08,605 - WARNING - Pod uuid 21aacdbd-69c4-439b-9c86-0baf61409015 is still seen in agent 10.0.0.24 VM list 2025-01-02 22:53:08,609 - WARNING - Pod uuid 881caf49-b4f7-4df4-8058-bf2a93e4ccf5 is still seen in agent 10.0.0.24 VM list 2025-01-02 22:53:08,609 - WARNING - Pod uuid 2c9c7a03-85be-4d31-8637-b722003144bf is still seen in agent 10.0.0.24 VM list 2025-01-02 22:53:08,610 - WARNING - Pod uuid 9166691b-4383-47c7-9a2a-4590170ad046 is still seen in agent 10.0.0.24 VM list 2025-01-02 22:53:08,611 - WARNING - Pod uuid 93198618-25c7-48ec-89cc-a2d3c9fea3b7 is still seen in agent 10.0.0.24 VM list 2025-01-02 22:53:08,612 - WARNING - Pod uuid e06b67d7-723d-408a-a6db-7043a5f837b2 is still seen in agent 10.0.0.24 VM list 2025-01-02 22:53:08,612 - WARNING - Pod uuid e41f0a9d-a142-4d7a-861c-5ee9f11b2915 is still seen in agent 10.0.0.24 VM list 2025-01-02 22:53:08,613 - WARNING - Pod uuid 4b67274e-895e-42a6-afe9-b6c98cd8fcef is still seen in agent 10.0.0.24 VM list 2025-01-02 22:53:13,621 - DEBUG - Pod 21aacdbd-69c4-439b-9c86-0baf61409015 is not in agent 10.0.0.24 VM list 2025-01-02 22:53:13,636 - WARNING - Pod uuid 881caf49-b4f7-4df4-8058-bf2a93e4ccf5 is still seen in agent 10.0.0.24 VM list 2025-01-02 22:53:13,640 - WARNING - Pod uuid e06b67d7-723d-408a-a6db-7043a5f837b2 is still seen in agent 10.0.0.24 VM list 2025-01-02 22:53:13,641 - DEBUG - Pod 93198618-25c7-48ec-89cc-a2d3c9fea3b7 is not in agent 10.0.0.24 VM list 2025-01-02 22:53:13,645 - DEBUG - VMI dd0b1e9c-c95b-11ef-9276-fa163ee39bec is removed from agent 10.0.0.24 2025-01-02 22:53:13,645 - INFO - Verified that pod ctest-pod-39388807 is removed in agent 2025-01-02 22:53:13,645 - WARNING - Pod uuid e41f0a9d-a142-4d7a-861c-5ee9f11b2915 is still seen in agent 10.0.0.24 VM list 2025-01-02 22:53:13,646 - DEBUG - Pod 4b67274e-895e-42a6-afe9-b6c98cd8fcef is not in agent 10.0.0.24 VM list 2025-01-02 22:53:13,647 - DEBUG - Pod 9166691b-4383-47c7-9a2a-4590170ad046 is not in agent 10.0.0.24 VM list 2025-01-02 22:53:13,648 - WARNING - Pod uuid 2c9c7a03-85be-4d31-8637-b722003144bf is still seen in agent 10.0.0.24 VM list 2025-01-02 22:53:13,659 - DEBUG - VMI dbe3b9e8-c95b-11ef-9276-fa163ee39bec is removed from agent 10.0.0.24 2025-01-02 22:53:13,659 - INFO - Verified that pod ctest-pod-97878075 is removed in agent 2025-01-02 22:53:13,661 - DEBUG - VMI dc8463ac-c95b-11ef-9276-fa163ee39bec is removed from agent 10.0.0.24 2025-01-02 22:53:13,661 - INFO - Verified that pod ctest-pod-39995811 is removed in agent 2025-01-02 22:53:13,662 - DEBUG - VMI db6fedba-c95b-11ef-9276-fa163ee39bec is removed from agent 10.0.0.24 2025-01-02 22:53:13,662 - INFO - Verified that pod ctest-pod-03599406 is removed in agent 2025-01-02 22:53:18,646 - WARNING - Pod uuid e06b67d7-723d-408a-a6db-7043a5f837b2 is still seen in agent 10.0.0.24 VM list 2025-01-02 22:53:18,649 - WARNING - Pod uuid 881caf49-b4f7-4df4-8058-bf2a93e4ccf5 is still seen in agent 10.0.0.24 VM list 2025-01-02 22:53:18,658 - WARNING - Pod uuid 2c9c7a03-85be-4d31-8637-b722003144bf is still seen in agent 10.0.0.24 VM list 2025-01-02 22:53:18,658 - WARNING - Pod uuid e41f0a9d-a142-4d7a-861c-5ee9f11b2915 is still seen in agent 10.0.0.24 VM list 2025-01-02 22:53:23,659 - WARNING - Pod uuid e06b67d7-723d-408a-a6db-7043a5f837b2 is still seen in agent 10.0.0.24 VM list 2025-01-02 22:53:23,663 - WARNING - Pod uuid 881caf49-b4f7-4df4-8058-bf2a93e4ccf5 is still seen in agent 10.0.0.24 VM list 2025-01-02 22:53:23,670 - WARNING - Pod uuid 2c9c7a03-85be-4d31-8637-b722003144bf is still seen in agent 10.0.0.24 VM list 2025-01-02 22:53:23,671 - WARNING - Pod uuid e41f0a9d-a142-4d7a-861c-5ee9f11b2915 is still seen in agent 10.0.0.24 VM list 2025-01-02 22:53:28,669 - WARNING - Pod uuid 881caf49-b4f7-4df4-8058-bf2a93e4ccf5 is still seen in agent 10.0.0.24 VM list 2025-01-02 22:53:28,670 - WARNING - Pod uuid e06b67d7-723d-408a-a6db-7043a5f837b2 is still seen in agent 10.0.0.24 VM list 2025-01-02 22:53:28,681 - WARNING - Pod uuid 2c9c7a03-85be-4d31-8637-b722003144bf is still seen in agent 10.0.0.24 VM list 2025-01-02 22:53:28,682 - WARNING - Pod uuid e41f0a9d-a142-4d7a-861c-5ee9f11b2915 is still seen in agent 10.0.0.24 VM list 2025-01-02 22:53:33,694 - WARNING - Pod uuid e06b67d7-723d-408a-a6db-7043a5f837b2 is still seen in agent 10.0.0.24 VM list 2025-01-02 22:53:33,695 - WARNING - Pod uuid 881caf49-b4f7-4df4-8058-bf2a93e4ccf5 is still seen in agent 10.0.0.24 VM list 2025-01-02 22:53:33,703 - WARNING - Pod uuid e41f0a9d-a142-4d7a-861c-5ee9f11b2915 is still seen in agent 10.0.0.24 VM list 2025-01-02 22:53:33,703 - WARNING - Pod uuid 2c9c7a03-85be-4d31-8637-b722003144bf is still seen in agent 10.0.0.24 VM list 2025-01-02 22:53:38,708 - WARNING - Pod uuid e06b67d7-723d-408a-a6db-7043a5f837b2 is still seen in agent 10.0.0.24 VM list 2025-01-02 22:53:38,708 - WARNING - Pod uuid 881caf49-b4f7-4df4-8058-bf2a93e4ccf5 is still seen in agent 10.0.0.24 VM list 2025-01-02 22:53:38,719 - WARNING - Pod uuid e41f0a9d-a142-4d7a-861c-5ee9f11b2915 is still seen in agent 10.0.0.24 VM list 2025-01-02 22:53:38,719 - WARNING - Pod uuid 2c9c7a03-85be-4d31-8637-b722003144bf is still seen in agent 10.0.0.24 VM list 2025-01-02 22:53:43,725 - DEBUG - Pod e06b67d7-723d-408a-a6db-7043a5f837b2 is not in agent 10.0.0.24 VM list 2025-01-02 22:53:43,727 - DEBUG - Pod 881caf49-b4f7-4df4-8058-bf2a93e4ccf5 is not in agent 10.0.0.24 VM list 2025-01-02 22:53:43,739 - DEBUG - VMI df09b1f4-c95b-11ef-9276-fa163ee39bec is removed from agent 10.0.0.24 2025-01-02 22:53:43,739 - INFO - Verified that pod ctest-pod-50712524 is removed in agent 2025-01-02 22:53:43,741 - DEBUG - Pod 2c9c7a03-85be-4d31-8637-b722003144bf is not in agent 10.0.0.24 VM list 2025-01-02 22:53:43,743 - DEBUG - Pod e41f0a9d-a142-4d7a-861c-5ee9f11b2915 is not in agent 10.0.0.24 VM list 2025-01-02 22:53:43,745 - DEBUG - VMI dd9a9a22-c95b-11ef-9276-fa163ee39bec is removed from agent 10.0.0.24 2025-01-02 22:53:43,745 - INFO - Verified that pod ctest-pod-20481032 is removed in agent 2025-01-02 22:53:43,755 - DEBUG - VMI de8cfc4a-c95b-11ef-9276-fa163ee39bec is removed from agent 10.0.0.24 2025-01-02 22:53:43,755 - INFO - Verified that pod ctest-pod-13636461 is removed in agent 2025-01-02 22:53:43,755 - DEBUG - VMI de1798e2-c95b-11ef-9276-fa163ee39bec is removed from agent 10.0.0.24 2025-01-02 22:53:43,755 - INFO - Verified that pod ctest-pod-24813020 is removed in agent 2025-01-02 22:53:43,756 - INFO - Deleting namespace ctest-non-default-37745828 2025-01-02 22:53:43,773 - DEBUG - Namespace ctest-non-default-37745828 still in k8s 2025-01-02 22:53:45,778 - DEBUG - Namespace ctest-non-default-37745828 still in k8s 2025-01-02 22:53:47,783 - DEBUG - Namespace ctest-non-default-37745828 still in k8s 2025-01-02 22:53:49,788 - DEBUG - Namespace ctest-non-default-37745828 is not in k8s 2025-01-02 22:53:49,788 - DEBUG - No need to check project deletion in contrail-api 2025-01-02 22:53:49,788 - INFO - Deleting namespace ctest-new-default-90530046 2025-01-02 22:53:49,798 - DEBUG - Namespace ctest-new-default-90530046 still in k8s 2025-01-02 22:53:51,803 - DEBUG - Namespace ctest-new-default-90530046 still in k8s 2025-01-02 22:53:53,808 - DEBUG - Namespace ctest-new-default-90530046 still in k8s 2025-01-02 22:53:55,811 - DEBUG - Namespace ctest-new-default-90530046 is not in k8s 2025-01-02 22:53:55,811 - DEBUG - No need to check project deletion in contrail-api