2025-07-17 11:29:21,157 - INFO - Using existing project ['default-domain', 'k8s-default'](bf659840-f895-459e-9c77-d190f71914f4) 2025-07-17 11:29:21,176 - DEBUG - Namespace ctest-new-default-66121826 not present 2025-07-17 11:29:21,191 - INFO - Created namespace ctest-new-default-66121826 2025-07-17 11:29:24,194 - DEBUG - Namespace ctest-non-default-97089513 not present 2025-07-17 11:29:24,204 - INFO - Created namespace ctest-non-default-97089513 2025-07-17 11:29:27,228 - DEBUG - Pod ctest-pod-92637337 not present 2025-07-17 11:29:27,229 - INFO - Creating Pod ctest-pod-92637337 2025-07-17 11:29:27,260 - DEBUG - Pod : ctest-pod-92637337 UUID is 54d64321-6955-41b3-abf8-0b616ef8cd6d 2025-07-17 11:29:27,264 - DEBUG - Pod ctest-pod-87313915 not present 2025-07-17 11:29:27,265 - INFO - Creating Pod ctest-pod-87313915 2025-07-17 11:29:27,297 - DEBUG - Pod : ctest-pod-87313915 UUID is 19102d28-da6a-4061-a19d-e072722d5490 2025-07-17 11:29:27,299 - DEBUG - Pod ctest-pod-30900045 not present 2025-07-17 11:29:27,299 - INFO - Creating Pod ctest-pod-30900045 2025-07-17 11:29:27,328 - DEBUG - Pod : ctest-pod-30900045 UUID is d5924edb-290f-44fd-ab53-29047774e79e 2025-07-17 11:29:27,333 - DEBUG - Pod ctest-pod-30884066 not present 2025-07-17 11:29:27,334 - INFO - Creating Pod ctest-pod-30884066 2025-07-17 11:29:27,360 - DEBUG - Pod : ctest-pod-30884066 UUID is e1284e1e-d2eb-4484-8d2f-33cd630c76b4 2025-07-17 11:29:27,362 - DEBUG - Pod ctest-pod-05173603 not present 2025-07-17 11:29:27,362 - INFO - Creating Pod ctest-pod-05173603 2025-07-17 11:29:27,381 - DEBUG - Pod : ctest-pod-05173603 UUID is 241fec15-a5bf-4392-8ca6-687d355ab7ae 2025-07-17 11:29:27,383 - DEBUG - Pod ctest-pod-78804160 not present 2025-07-17 11:29:27,383 - INFO - Creating Pod ctest-pod-78804160 2025-07-17 11:29:27,404 - DEBUG - Pod : ctest-pod-78804160 UUID is 1721e9ee-2e93-4d9a-b9a4-bf627afcb135 2025-07-17 11:29:27,406 - DEBUG - Pod ctest-pod-75151664 not present 2025-07-17 11:29:27,406 - INFO - Creating Pod ctest-pod-75151664 2025-07-17 11:29:27,423 - DEBUG - Pod : ctest-pod-75151664 UUID is 3d185ee1-25b7-4957-9100-383a694b96fb 2025-07-17 11:29:27,428 - DEBUG - Pod ctest-pod-97842792 not present 2025-07-17 11:29:27,428 - INFO - Creating Pod ctest-pod-97842792 2025-07-17 11:29:27,458 - DEBUG - Pod : ctest-pod-97842792 UUID is 1215bf7e-5822-4603-a84e-44f5171c0aee 2025-07-17 11:29:27,618 - INFO - Project default-domain:k8s-ctest-new-default-66121826 for Namespace ctest-new-default-66121826 is seen in contrail-api 2025-07-17 11:29:27,618 - DEBUG - Project uuid in Contrail is 0ea637dc-44fa-4f4d-9345-0f5ebf9c9854 2025-07-17 11:29:27,795 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=b66738e5-2d73-4f7a-8b0a-8f9564ad70b5 2025-07-17 11:29:27,800 - INFO - Namespace ctest-new-default-66121826 with uuid b66738e5-2d73-4f7a-8b0a-8f9564ad70b5 found in kube manager 2025-07-17 11:29:27,800 - INFO - Namespace ctest-new-default-66121826 verification passed 2025-07-17 11:29:27,974 - INFO - Project default-domain:k8s-ctest-non-default-97089513 for Namespace ctest-non-default-97089513 is seen in contrail-api 2025-07-17 11:29:27,975 - DEBUG - Project uuid in Contrail is 8f1bf856-ae34-45da-91e3-5b2d2ef057d8 2025-07-17 11:29:27,975 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=71390c24-b38f-4866-acc5-6c05ceff82f5 2025-07-17 11:29:27,984 - INFO - Namespace ctest-non-default-97089513 with uuid 71390c24-b38f-4866-acc5-6c05ceff82f5 found in kube manager 2025-07-17 11:29:27,984 - INFO - Namespace ctest-non-default-97089513 verification passed 2025-07-17 11:29:27,989 - DEBUG - Pod ctest-pod-92637337 not in running state.Currently in Pending 2025-07-17 11:29:33,011 - DEBUG - Pod ctest-pod-92637337 not in running state.Currently in Pending 2025-07-17 11:29:38,018 - INFO - Pod ctest-pod-92637337 is in running state.Got IP 10.47.255.251 2025-07-17 11:29:38,083 - DEBUG - Pod ctest-pod-92637337 has vmi 4d28bf88-6301-11f0-9829-fa163ed9da0d 2025-07-17 11:29:38,083 - INFO - Verified pod ctest-pod-92637337 in contrail-api 2025-07-17 11:29:38,097 - DEBUG - VMI 4d28bf88-6301-11f0-9829-fa163ed9da0d is active in agent 10.0.0.27 2025-07-17 11:29:38,097 - INFO - Verified Pod ctest-pod-92637337 in agent 10.0.0.27 2025-07-17 11:29:38,097 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=54d64321-6955-41b3-abf8-0b616ef8cd6d 2025-07-17 11:29:38,101 - INFO - Pod ctest-pod-92637337 with uuid 54d64321-6955-41b3-abf8-0b616ef8cd6d found in kube manager 2025-07-17 11:29:38,101 - INFO - Pod ctest-pod-92637337 verification passed 2025-07-17 11:29:38,106 - DEBUG - Pod ctest-pod-87313915 not in running state.Currently in Pending 2025-07-17 11:29:43,113 - INFO - Pod ctest-pod-87313915 is in running state.Got IP 10.47.255.250 2025-07-17 11:29:43,132 - DEBUG - Pod ctest-pod-87313915 has vmi 4da26d56-6301-11f0-9829-fa163ed9da0d 2025-07-17 11:29:43,132 - INFO - Verified pod ctest-pod-87313915 in contrail-api 2025-07-17 11:29:43,146 - DEBUG - VMI 4da26d56-6301-11f0-9829-fa163ed9da0d is active in agent 10.0.0.27 2025-07-17 11:29:43,146 - INFO - Verified Pod ctest-pod-87313915 in agent 10.0.0.27 2025-07-17 11:29:43,146 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=19102d28-da6a-4061-a19d-e072722d5490 2025-07-17 11:29:43,151 - INFO - Pod ctest-pod-87313915 with uuid 19102d28-da6a-4061-a19d-e072722d5490 found in kube manager 2025-07-17 11:29:43,151 - INFO - Pod ctest-pod-87313915 verification passed 2025-07-17 11:29:43,157 - INFO - Pod ctest-pod-30900045 is in running state.Got IP 10.47.255.249 2025-07-17 11:29:43,215 - DEBUG - Pod ctest-pod-30900045 has vmi 4e3f332a-6301-11f0-9829-fa163ed9da0d 2025-07-17 11:29:43,215 - INFO - Verified pod ctest-pod-30900045 in contrail-api 2025-07-17 11:29:43,227 - DEBUG - VMI 4e3f332a-6301-11f0-9829-fa163ed9da0d is active in agent 10.0.0.27 2025-07-17 11:29:43,228 - INFO - Verified Pod ctest-pod-30900045 in agent 10.0.0.27 2025-07-17 11:29:43,228 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=d5924edb-290f-44fd-ab53-29047774e79e 2025-07-17 11:29:43,233 - INFO - Pod ctest-pod-30900045 with uuid d5924edb-290f-44fd-ab53-29047774e79e found in kube manager 2025-07-17 11:29:43,233 - INFO - Pod ctest-pod-30900045 verification passed 2025-07-17 11:29:43,239 - INFO - Pod ctest-pod-30884066 is in running state.Got IP 10.47.255.248 2025-07-17 11:29:43,252 - DEBUG - Pod ctest-pod-30884066 has vmi 4eae3a72-6301-11f0-9829-fa163ed9da0d 2025-07-17 11:29:43,252 - INFO - Verified pod ctest-pod-30884066 in contrail-api 2025-07-17 11:29:43,264 - DEBUG - VMI 4eae3a72-6301-11f0-9829-fa163ed9da0d is active in agent 10.0.0.27 2025-07-17 11:29:43,264 - INFO - Verified Pod ctest-pod-30884066 in agent 10.0.0.27 2025-07-17 11:29:43,264 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=e1284e1e-d2eb-4484-8d2f-33cd630c76b4 2025-07-17 11:29:43,268 - INFO - Pod ctest-pod-30884066 with uuid e1284e1e-d2eb-4484-8d2f-33cd630c76b4 found in kube manager 2025-07-17 11:29:43,269 - INFO - Pod ctest-pod-30884066 verification passed 2025-07-17 11:29:43,274 - INFO - Pod ctest-pod-05173603 is in running state.Got IP 10.47.255.247 2025-07-17 11:29:43,331 - DEBUG - Pod ctest-pod-05173603 has vmi 4f3a642a-6301-11f0-9829-fa163ed9da0d 2025-07-17 11:29:43,331 - INFO - Verified pod ctest-pod-05173603 in contrail-api 2025-07-17 11:29:43,343 - DEBUG - VMI 4f3a642a-6301-11f0-9829-fa163ed9da0d is active in agent 10.0.0.27 2025-07-17 11:29:43,343 - INFO - Verified Pod ctest-pod-05173603 in agent 10.0.0.27 2025-07-17 11:29:43,343 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=241fec15-a5bf-4392-8ca6-687d355ab7ae 2025-07-17 11:29:43,347 - INFO - Pod ctest-pod-05173603 with uuid 241fec15-a5bf-4392-8ca6-687d355ab7ae found in kube manager 2025-07-17 11:29:43,348 - INFO - Pod ctest-pod-05173603 verification passed 2025-07-17 11:29:43,353 - DEBUG - Pod ctest-pod-75151664 not in running state.Currently in Pending 2025-07-17 11:29:48,359 - INFO - Pod ctest-pod-75151664 is in running state.Got IP 10.47.255.245 2025-07-17 11:29:48,373 - DEBUG - Pod ctest-pod-75151664 has vmi 5034bb78-6301-11f0-9829-fa163ed9da0d 2025-07-17 11:29:48,373 - INFO - Verified pod ctest-pod-75151664 in contrail-api 2025-07-17 11:29:48,387 - DEBUG - VMI 5034bb78-6301-11f0-9829-fa163ed9da0d is active in agent 10.0.0.27 2025-07-17 11:29:48,388 - INFO - Verified Pod ctest-pod-75151664 in agent 10.0.0.27 2025-07-17 11:29:48,388 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=3d185ee1-25b7-4957-9100-383a694b96fb 2025-07-17 11:29:48,392 - INFO - Pod ctest-pod-75151664 with uuid 3d185ee1-25b7-4957-9100-383a694b96fb found in kube manager 2025-07-17 11:29:48,392 - INFO - Pod ctest-pod-75151664 verification passed 2025-07-17 11:29:48,462 - INFO - Pod ctest-pod-78804160 is in running state.Got IP 10.47.255.246 2025-07-17 11:29:48,519 - DEBUG - Pod ctest-pod-78804160 has vmi 4fc0a4ea-6301-11f0-9829-fa163ed9da0d 2025-07-17 11:29:48,519 - INFO - Verified pod ctest-pod-78804160 in contrail-api 2025-07-17 11:29:48,531 - DEBUG - VMI 4fc0a4ea-6301-11f0-9829-fa163ed9da0d is active in agent 10.0.0.27 2025-07-17 11:29:48,531 - INFO - Verified Pod ctest-pod-78804160 in agent 10.0.0.27 2025-07-17 11:29:48,532 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=1721e9ee-2e93-4d9a-b9a4-bf627afcb135 2025-07-17 11:29:48,536 - INFO - Pod ctest-pod-78804160 with uuid 1721e9ee-2e93-4d9a-b9a4-bf627afcb135 found in kube manager 2025-07-17 11:29:48,536 - INFO - Pod ctest-pod-78804160 verification passed 2025-07-17 11:29:48,541 - INFO - Pod ctest-pod-97842792 is in running state.Got IP 10.47.255.244 2025-07-17 11:29:48,554 - DEBUG - Pod ctest-pod-97842792 has vmi 50aa4884-6301-11f0-9829-fa163ed9da0d 2025-07-17 11:29:48,554 - INFO - Verified pod ctest-pod-97842792 in contrail-api 2025-07-17 11:29:48,566 - DEBUG - VMI 50aa4884-6301-11f0-9829-fa163ed9da0d is active in agent 10.0.0.27 2025-07-17 11:29:48,567 - INFO - Verified Pod ctest-pod-97842792 in agent 10.0.0.27 2025-07-17 11:29:48,567 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=1215bf7e-5822-4603-a84e-44f5171c0aee 2025-07-17 11:29:48,571 - INFO - Pod ctest-pod-97842792 with uuid 1215bf7e-5822-4603-a84e-44f5171c0aee found in kube manager 2025-07-17 11:29:48,571 - INFO - Pod ctest-pod-97842792 verification passed 2025-07-17 11:29:48,571 - INFO - ================================================================================ 2025-07-17 11:29:48,571 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-07-17 11:29:48,571 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-07-17 11:29:48,777 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.0.0.22': '0'}} with 2025-07-17 11:29:48,777 - INFO - Initial checks done. Running the testcase now 2025-07-17 11:29:48,778 - INFO - 2025-07-17 11:29:48,826 - DEBUG - [Pod ctest-pod-92637337] Cmd: echo ctest-pod-92637337 > /usr/share/nginx/html/index.html, Output: 2025-07-17 11:29:48,891 - DEBUG - [Pod ctest-pod-87313915] Cmd: echo ctest-pod-87313915 > /usr/share/nginx/html/index.html, Output: 2025-07-17 11:29:48,947 - DEBUG - [Pod ctest-pod-30900045] Cmd: echo ctest-pod-30900045 > /usr/share/nginx/html/index.html, Output: 2025-07-17 11:29:49,005 - DEBUG - [Pod ctest-pod-30884066] Cmd: echo ctest-pod-30884066 > /usr/share/nginx/html/index.html, Output: 2025-07-17 11:29:49,008 - DEBUG - Service ctest-nginx-svc-69402844 not present 2025-07-17 11:29:49,008 - INFO - Creating service ctest-nginx-svc-69402844 2025-07-17 11:29:49,023 - INFO - Created Service ctest-nginx-svc-69402844 2025-07-17 11:29:49,032 - WARNING - Service UUID ac0eec0f-378c-473c-8da2-c12290da63fa not yet found in contrail-api 2025-07-17 11:29:50,038 - INFO - Validated that Service ctest-nginx-svc-69402844 is seen in contrail-api 2025-07-17 11:29:50,038 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_LoadbalancerDatabaseList?x=ac0eec0f-378c-473c-8da2-c12290da63fa 2025-07-17 11:29:50,042 - INFO - Service ctest-nginx-svc-69402844 with uuid ac0eec0f-378c-473c-8da2-c12290da63fa found in kube manager 2025-07-17 11:29:50,042 - INFO - Service ctest-nginx-svc-69402844 verification passed 2025-07-17 11:29:51,100 - DEBUG - [Pod ctest-pod-05173603] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.210.240:80 (10.107.210.240:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-87313915 2025-07-17 11:29:51,100 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 passed 2025-07-17 11:29:51,100 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd output: Connecting to 10.107.210.240:80 (10.107.210.240:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-87313915 2025-07-17 11:29:51,149 - DEBUG - [Pod ctest-pod-05173603] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: ctest-pod-87313915 Connecting to 10.107.210.240:80 (10.107.210.240:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-17 11:29:51,149 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 passed 2025-07-17 11:29:51,149 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd output: ctest-pod-87313915 Connecting to 10.107.210.240:80 (10.107.210.240:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-17 11:29:51,198 - DEBUG - [Pod ctest-pod-05173603] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: ctest-pod-87313915 Connecting to 10.107.210.240:80 (10.107.210.240:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-17 11:29:51,198 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 passed 2025-07-17 11:29:51,198 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd output: ctest-pod-87313915 Connecting to 10.107.210.240:80 (10.107.210.240:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-17 11:29:51,259 - DEBUG - [Pod ctest-pod-05173603] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: ctest-pod-92637337 Connecting to 10.107.210.240:80 (10.107.210.240:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-17 11:29:51,259 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 passed 2025-07-17 11:29:51,260 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd output: ctest-pod-92637337 Connecting to 10.107.210.240:80 (10.107.210.240:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-17 11:29:51,260 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-92637337': 1, 'ctest-pod-87313915': 3} 2025-07-17 11:29:51,320 - DEBUG - [Pod ctest-pod-75151664] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: ctest-pod-92637337 Connecting to 10.107.210.240:80 (10.107.210.240:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-17 11:29:51,320 - DEBUG - [Pod Pod ctest-pod-75151664] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 passed 2025-07-17 11:29:51,320 - DEBUG - [Pod Pod ctest-pod-75151664] Cmd output: ctest-pod-92637337 Connecting to 10.107.210.240:80 (10.107.210.240:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-17 11:29:51,388 - DEBUG - [Pod ctest-pod-75151664] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: ctest-pod-87313915 Connecting to 10.107.210.240:80 (10.107.210.240:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-17 11:29:51,388 - DEBUG - [Pod Pod ctest-pod-75151664] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 passed 2025-07-17 11:29:51,388 - DEBUG - [Pod Pod ctest-pod-75151664] Cmd output: ctest-pod-87313915 Connecting to 10.107.210.240:80 (10.107.210.240:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-17 11:29:51,388 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-92637337': 1, 'ctest-pod-87313915': 1} 2025-07-17 11:29:51,392 - DEBUG - Network policy ingress-on-service not present 2025-07-17 11:29:51,393 - INFO - Creating Network Policy ingress-on-service 2025-07-17 11:29:51,411 - INFO - Network policy found in k8s 2025-07-17 11:29:51,411 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=3ef8a2bc-c55e-4d19-85df-55150e55bf47 2025-07-17 11:29:51,420 - INFO - Network Policy ingress-on-service with uuid 3ef8a2bc-c55e-4d19-85df-55150e55bf47 found in kube manager 2025-07-17 11:29:51,454 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-07-17 11:29:51,455 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-07-17 11:29:51,455 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=3ef8a2bc-c55e-4d19-85df-55150e55bf47 2025-07-17 11:29:51,499 - WARNING - Network policy with name ingress-on-service not found in agent 2025-07-17 11:29:53,500 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=3ef8a2bc-c55e-4d19-85df-55150e55bf47 2025-07-17 11:29:53,537 - INFO - Network policy with name ingress-on-service found in agent 2025-07-17 11:29:53,537 - INFO - Network Policy ingress-on-service verification passed 2025-07-17 11:29:58,597 - DEBUG - [Pod ctest-pod-05173603] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:29:58,597 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:29:58,597 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:30:03,644 - DEBUG - [Pod ctest-pod-05173603] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:30:03,644 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:30:03,644 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:30:08,804 - DEBUG - [Pod ctest-pod-05173603] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:30:08,805 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:30:08,805 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:30:13,851 - DEBUG - [Pod ctest-pod-05173603] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:30:13,852 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:30:13,852 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:30:18,906 - DEBUG - [Pod ctest-pod-05173603] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:30:18,906 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:30:18,906 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:30:23,962 - DEBUG - [Pod ctest-pod-05173603] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:30:23,962 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:30:23,962 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:30:29,019 - DEBUG - [Pod ctest-pod-05173603] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:30:29,019 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:30:29,019 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:30:34,071 - DEBUG - [Pod ctest-pod-05173603] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:30:34,071 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:30:34,071 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:30:39,132 - DEBUG - [Pod ctest-pod-05173603] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:30:39,132 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:30:39,133 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:30:44,184 - DEBUG - [Pod ctest-pod-05173603] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:30:44,184 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:30:44,184 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:30:44,184 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-92637337': 0, 'ctest-pod-87313915': 0} 2025-07-17 11:30:44,243 - DEBUG - [Pod ctest-pod-78804160] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: ctest-pod-87313915 Connecting to 10.107.210.240:80 (10.107.210.240:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-17 11:30:44,243 - DEBUG - [Pod Pod ctest-pod-78804160] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 passed 2025-07-17 11:30:44,243 - DEBUG - [Pod Pod ctest-pod-78804160] Cmd output: ctest-pod-87313915 Connecting to 10.107.210.240:80 (10.107.210.240:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-17 11:30:44,297 - DEBUG - [Pod ctest-pod-78804160] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: ctest-pod-92637337 Connecting to 10.107.210.240:80 (10.107.210.240:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-17 11:30:44,297 - DEBUG - [Pod Pod ctest-pod-78804160] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 passed 2025-07-17 11:30:44,297 - DEBUG - [Pod Pod ctest-pod-78804160] Cmd output: ctest-pod-92637337 Connecting to 10.107.210.240:80 (10.107.210.240:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-17 11:30:44,297 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-92637337': 1, 'ctest-pod-87313915': 1} 2025-07-17 11:30:49,331 - DEBUG - [Pod ctest-pod-75151664] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:30:49,331 - DEBUG - [Pod Pod ctest-pod-75151664] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:30:49,331 - DEBUG - [Pod Pod ctest-pod-75151664] Cmd output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:30:54,375 - DEBUG - [Pod ctest-pod-75151664] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:30:54,375 - DEBUG - [Pod Pod ctest-pod-75151664] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:30:54,375 - DEBUG - [Pod Pod ctest-pod-75151664] Cmd output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:30:59,431 - DEBUG - [Pod ctest-pod-75151664] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:30:59,431 - DEBUG - [Pod Pod ctest-pod-75151664] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:30:59,431 - DEBUG - [Pod Pod ctest-pod-75151664] Cmd output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:31:04,471 - DEBUG - [Pod ctest-pod-75151664] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:31:04,472 - DEBUG - [Pod Pod ctest-pod-75151664] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:31:04,472 - DEBUG - [Pod Pod ctest-pod-75151664] Cmd output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:31:09,516 - DEBUG - [Pod ctest-pod-75151664] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:31:09,516 - DEBUG - [Pod Pod ctest-pod-75151664] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:31:09,516 - DEBUG - [Pod Pod ctest-pod-75151664] Cmd output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:31:14,579 - DEBUG - [Pod ctest-pod-75151664] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:31:14,579 - DEBUG - [Pod Pod ctest-pod-75151664] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:31:14,579 - DEBUG - [Pod Pod ctest-pod-75151664] Cmd output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:31:19,631 - DEBUG - [Pod ctest-pod-75151664] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:31:19,632 - DEBUG - [Pod Pod ctest-pod-75151664] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:31:19,632 - DEBUG - [Pod Pod ctest-pod-75151664] Cmd output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:31:24,683 - DEBUG - [Pod ctest-pod-75151664] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:31:24,684 - DEBUG - [Pod Pod ctest-pod-75151664] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:31:24,684 - DEBUG - [Pod Pod ctest-pod-75151664] Cmd output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:31:29,728 - DEBUG - [Pod ctest-pod-75151664] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:31:29,729 - DEBUG - [Pod Pod ctest-pod-75151664] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:31:29,729 - DEBUG - [Pod Pod ctest-pod-75151664] Cmd output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:31:34,781 - DEBUG - [Pod ctest-pod-75151664] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:31:34,781 - DEBUG - [Pod Pod ctest-pod-75151664] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:31:34,781 - DEBUG - [Pod Pod ctest-pod-75151664] Cmd output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:31:34,781 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-92637337': 0, 'ctest-pod-87313915': 0} 2025-07-17 11:31:36,840 - DEBUG - [Pod ctest-pod-78804160] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.153 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.075 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.082 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.075/0.436/1.153 ms 2025-07-17 11:31:36,840 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-78804160 with expectation True passed 2025-07-17 11:31:38,894 - DEBUG - [Pod ctest-pod-05173603] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.657 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.063 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.086 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.063/0.268/0.657 ms 2025-07-17 11:31:38,894 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-05173603 with expectation True passed 2025-07-17 11:31:40,940 - DEBUG - [Pod ctest-pod-75151664] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.003 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.074 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.091 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.074/0.389/1.003 ms 2025-07-17 11:31:40,940 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-75151664 with expectation True passed 2025-07-17 11:31:40,995 - DEBUG - [Pod ctest-pod-78804160] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-17 11:31:40,996 - DEBUG - [Pod Pod ctest-pod-78804160] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-07-17 11:31:40,996 - DEBUG - [Pod Pod ctest-pod-78804160] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-17 11:31:40,996 - INFO - wget check of of http://10.47.255.251 from ctest-pod-78804160 passed 2025-07-17 11:31:41,065 - DEBUG - [Pod ctest-pod-78804160] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-17 11:31:41,065 - DEBUG - [Pod Pod ctest-pod-78804160] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-07-17 11:31:41,065 - DEBUG - [Pod Pod ctest-pod-78804160] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-17 11:31:41,065 - INFO - wget check of of http://10.47.255.250 from ctest-pod-78804160 passed 2025-07-17 11:31:46,128 - DEBUG - [Pod ctest-pod-05173603] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-07-17 11:31:46,128 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-07-17 11:31:46,128 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-07-17 11:31:46,128 - INFO - wget check of of http://10.47.255.250 from ctest-pod-05173603 passed 2025-07-17 11:31:51,181 - DEBUG - [Pod ctest-pod-97842792] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-07-17 11:31:51,181 - DEBUG - [Pod Pod ctest-pod-97842792] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-07-17 11:31:51,181 - DEBUG - [Pod Pod ctest-pod-97842792] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-07-17 11:31:51,181 - INFO - wget check of of http://10.47.255.251 from ctest-pod-97842792 passed 2025-07-17 11:31:51,190 - INFO - Updating Network Policy ingress-on-service 2025-07-17 11:31:56,252 - DEBUG - [Pod ctest-pod-05173603] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:31:56,253 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:31:56,253 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:32:01,311 - DEBUG - [Pod ctest-pod-05173603] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:32:01,312 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:32:01,312 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:32:06,363 - DEBUG - [Pod ctest-pod-05173603] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:32:06,364 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:32:06,364 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:32:11,416 - DEBUG - [Pod ctest-pod-05173603] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:32:11,416 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:32:11,416 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:32:16,467 - DEBUG - [Pod ctest-pod-05173603] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:32:16,468 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:32:16,468 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:32:21,514 - DEBUG - [Pod ctest-pod-05173603] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:32:21,514 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:32:21,514 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:32:26,563 - DEBUG - [Pod ctest-pod-05173603] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:32:26,564 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:32:26,564 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:32:31,616 - DEBUG - [Pod ctest-pod-05173603] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:32:31,616 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:32:31,616 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:32:36,667 - DEBUG - [Pod ctest-pod-05173603] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:32:36,667 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:32:36,667 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:32:41,729 - DEBUG - [Pod ctest-pod-05173603] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:32:41,729 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:32:41,729 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd output: Connecting to 10.107.210.240:80 (10.107.210.240:80) wget: download timed out 2025-07-17 11:32:41,729 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-92637337': 0, 'ctest-pod-87313915': 0} 2025-07-17 11:32:41,786 - DEBUG - [Pod ctest-pod-78804160] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: ctest-pod-87313915 Connecting to 10.107.210.240:80 (10.107.210.240:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-17 11:32:41,786 - DEBUG - [Pod Pod ctest-pod-78804160] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 passed 2025-07-17 11:32:41,786 - DEBUG - [Pod Pod ctest-pod-78804160] Cmd output: ctest-pod-87313915 Connecting to 10.107.210.240:80 (10.107.210.240:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-17 11:32:41,835 - DEBUG - [Pod ctest-pod-78804160] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.210.240:80 (10.107.210.240:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-87313915 2025-07-17 11:32:41,835 - DEBUG - [Pod Pod ctest-pod-78804160] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 passed 2025-07-17 11:32:41,835 - DEBUG - [Pod Pod ctest-pod-78804160] Cmd output: Connecting to 10.107.210.240:80 (10.107.210.240:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-87313915 2025-07-17 11:32:41,901 - DEBUG - [Pod ctest-pod-78804160] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.210.240:80 (10.107.210.240:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-87313915 2025-07-17 11:32:41,901 - DEBUG - [Pod Pod ctest-pod-78804160] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 passed 2025-07-17 11:32:41,901 - DEBUG - [Pod Pod ctest-pod-78804160] Cmd output: Connecting to 10.107.210.240:80 (10.107.210.240:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-87313915 2025-07-17 11:32:41,958 - DEBUG - [Pod ctest-pod-78804160] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: ctest-pod-87313915 Connecting to 10.107.210.240:80 (10.107.210.240:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-17 11:32:41,958 - DEBUG - [Pod Pod ctest-pod-78804160] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 passed 2025-07-17 11:32:41,958 - DEBUG - [Pod Pod ctest-pod-78804160] Cmd output: ctest-pod-87313915 Connecting to 10.107.210.240:80 (10.107.210.240:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-17 11:32:42,005 - DEBUG - [Pod ctest-pod-78804160] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.210.240:80 (10.107.210.240:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-92637337 2025-07-17 11:32:42,005 - DEBUG - [Pod Pod ctest-pod-78804160] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 passed 2025-07-17 11:32:42,005 - DEBUG - [Pod Pod ctest-pod-78804160] Cmd output: Connecting to 10.107.210.240:80 (10.107.210.240:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-92637337 2025-07-17 11:32:42,005 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-92637337': 1, 'ctest-pod-87313915': 4} 2025-07-17 11:32:42,066 - DEBUG - [Pod ctest-pod-75151664] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: ctest-pod-92637337 Connecting to 10.107.210.240:80 (10.107.210.240:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-17 11:32:42,066 - DEBUG - [Pod Pod ctest-pod-75151664] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 passed 2025-07-17 11:32:42,066 - DEBUG - [Pod Pod ctest-pod-75151664] Cmd output: ctest-pod-92637337 Connecting to 10.107.210.240:80 (10.107.210.240:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-17 11:32:42,119 - DEBUG - [Pod ctest-pod-75151664] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: ctest-pod-92637337 Connecting to 10.107.210.240:80 (10.107.210.240:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-17 11:32:42,119 - DEBUG - [Pod Pod ctest-pod-75151664] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 passed 2025-07-17 11:32:42,119 - DEBUG - [Pod Pod ctest-pod-75151664] Cmd output: ctest-pod-92637337 Connecting to 10.107.210.240:80 (10.107.210.240:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-17 11:32:42,169 - DEBUG - [Pod ctest-pod-75151664] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: ctest-pod-92637337 Connecting to 10.107.210.240:80 (10.107.210.240:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-17 11:32:42,170 - DEBUG - [Pod Pod ctest-pod-75151664] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 passed 2025-07-17 11:32:42,170 - DEBUG - [Pod Pod ctest-pod-75151664] Cmd output: ctest-pod-92637337 Connecting to 10.107.210.240:80 (10.107.210.240:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-17 11:32:42,218 - DEBUG - [Pod ctest-pod-75151664] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: ctest-pod-92637337 Connecting to 10.107.210.240:80 (10.107.210.240:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-17 11:32:42,218 - DEBUG - [Pod Pod ctest-pod-75151664] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 passed 2025-07-17 11:32:42,218 - DEBUG - [Pod Pod ctest-pod-75151664] Cmd output: ctest-pod-92637337 Connecting to 10.107.210.240:80 (10.107.210.240:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-17 11:32:42,269 - DEBUG - [Pod ctest-pod-75151664] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: ctest-pod-92637337 Connecting to 10.107.210.240:80 (10.107.210.240:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-17 11:32:42,269 - DEBUG - [Pod Pod ctest-pod-75151664] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 passed 2025-07-17 11:32:42,269 - DEBUG - [Pod Pod ctest-pod-75151664] Cmd output: ctest-pod-92637337 Connecting to 10.107.210.240:80 (10.107.210.240:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-17 11:32:42,321 - DEBUG - [Pod ctest-pod-75151664] Cmd: wget http://10.107.210.240:80/ -O - -T 5 -t 1 , Output: ctest-pod-87313915 Connecting to 10.107.210.240:80 (10.107.210.240:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-17 11:32:42,321 - DEBUG - [Pod Pod ctest-pod-75151664] Cmd wget http://10.107.210.240:80/ -O - -T 5 -t 1 passed 2025-07-17 11:32:42,322 - DEBUG - [Pod Pod ctest-pod-75151664] Cmd output: ctest-pod-87313915 Connecting to 10.107.210.240:80 (10.107.210.240:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-17 11:32:42,322 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-92637337': 5, 'ctest-pod-87313915': 1} 2025-07-17 11:32:44,368 - DEBUG - [Pod ctest-pod-78804160] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.646 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.085 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.094 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.085/0.275/0.646 ms 2025-07-17 11:32:44,368 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-78804160 with expectation True passed 2025-07-17 11:32:46,421 - DEBUG - [Pod ctest-pod-05173603] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.012 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.086 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.081 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.081/0.393/1.012 ms 2025-07-17 11:32:46,421 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-05173603 with expectation True passed 2025-07-17 11:32:48,485 - DEBUG - [Pod ctest-pod-75151664] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.769 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.069 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.071 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.069/0.303/0.769 ms 2025-07-17 11:32:48,485 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-75151664 with expectation True passed 2025-07-17 11:32:48,537 - DEBUG - [Pod ctest-pod-78804160] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-17 11:32:48,537 - DEBUG - [Pod Pod ctest-pod-78804160] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-07-17 11:32:48,537 - DEBUG - [Pod Pod ctest-pod-78804160] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-17 11:32:48,537 - INFO - wget check of of http://10.47.255.251 from ctest-pod-78804160 passed 2025-07-17 11:32:48,597 - DEBUG - [Pod ctest-pod-78804160] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-17 11:32:48,597 - DEBUG - [Pod Pod ctest-pod-78804160] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-07-17 11:32:48,598 - DEBUG - [Pod Pod ctest-pod-78804160] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-17 11:32:48,598 - INFO - wget check of of http://10.47.255.250 from ctest-pod-78804160 passed 2025-07-17 11:32:53,645 - DEBUG - [Pod ctest-pod-05173603] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-07-17 11:32:53,645 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-07-17 11:32:53,645 - DEBUG - [Pod Pod ctest-pod-05173603] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-07-17 11:32:53,645 - INFO - wget check of of http://10.47.255.250 from ctest-pod-05173603 passed 2025-07-17 11:32:53,699 - DEBUG - [Pod ctest-pod-97842792] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-17 11:32:53,700 - DEBUG - [Pod Pod ctest-pod-97842792] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-07-17 11:32:53,700 - DEBUG - [Pod Pod ctest-pod-97842792] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-17 11:32:53,700 - INFO - wget check of of http://10.47.255.251 from ctest-pod-97842792 passed 2025-07-17 11:32:53,700 - INFO - Deleting Network Policy : ingress-on-service 2025-07-17 11:32:53,701 - INFO - Deleting service : ctest-nginx-svc-69402844 2025-07-17 11:32:53,896 - DEBUG - No XMPP flaps were noticed during the test 2025-07-17 11:32:53,896 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:05] 2025-07-17 11:32:53,896 - INFO - -------------------------------------------------------------------------------- 2025-07-17 11:32:53,901 - INFO - Deleting pod ctest-new-default-66121826:ctest-pod-92637337 2025-07-17 11:32:53,901 - INFO - Deleting pod ctest-new-default-66121826:ctest-pod-87313915 2025-07-17 11:32:53,902 - INFO - Deleting pod ctest-non-default-97089513:ctest-pod-30900045 2025-07-17 11:32:53,902 - INFO - Deleting pod ctest-non-default-97089513:ctest-pod-30884066 2025-07-17 11:32:53,903 - INFO - Deleting pod ctest-new-default-66121826:ctest-pod-05173603 2025-07-17 11:32:53,903 - INFO - Deleting pod ctest-new-default-66121826:ctest-pod-78804160 2025-07-17 11:32:53,903 - INFO - Deleting pod ctest-non-default-97089513:ctest-pod-75151664 2025-07-17 11:32:53,903 - INFO - Deleting pod ctest-non-default-97089513:ctest-pod-97842792 2025-07-17 11:32:53,953 - WARNING - Pod uuid 54d64321-6955-41b3-abf8-0b616ef8cd6d is still seen in agent 10.0.0.27 VM list 2025-07-17 11:32:54,099 - WARNING - Pod uuid 1721e9ee-2e93-4d9a-b9a4-bf627afcb135 is still seen in agent 10.0.0.27 VM list 2025-07-17 11:32:54,099 - WARNING - Pod uuid 19102d28-da6a-4061-a19d-e072722d5490 is still seen in agent 10.0.0.27 VM list 2025-07-17 11:32:54,100 - WARNING - Pod uuid 241fec15-a5bf-4392-8ca6-687d355ab7ae is still seen in agent 10.0.0.27 VM list 2025-07-17 11:32:54,100 - WARNING - Pod uuid d5924edb-290f-44fd-ab53-29047774e79e is still seen in agent 10.0.0.27 VM list 2025-07-17 11:32:54,100 - WARNING - Pod uuid 1215bf7e-5822-4603-a84e-44f5171c0aee is still seen in agent 10.0.0.27 VM list 2025-07-17 11:32:54,101 - WARNING - Pod uuid e1284e1e-d2eb-4484-8d2f-33cd630c76b4 is still seen in agent 10.0.0.27 VM list 2025-07-17 11:32:54,101 - WARNING - Pod uuid 3d185ee1-25b7-4957-9100-383a694b96fb is still seen in agent 10.0.0.27 VM list 2025-07-17 11:32:58,962 - WARNING - Pod uuid 54d64321-6955-41b3-abf8-0b616ef8cd6d is still seen in agent 10.0.0.27 VM list 2025-07-17 11:32:59,135 - WARNING - Pod uuid 3d185ee1-25b7-4957-9100-383a694b96fb is still seen in agent 10.0.0.27 VM list 2025-07-17 11:32:59,136 - WARNING - Pod uuid 19102d28-da6a-4061-a19d-e072722d5490 is still seen in agent 10.0.0.27 VM list 2025-07-17 11:32:59,136 - WARNING - Pod uuid 241fec15-a5bf-4392-8ca6-687d355ab7ae is still seen in agent 10.0.0.27 VM list 2025-07-17 11:32:59,137 - WARNING - Pod uuid 1721e9ee-2e93-4d9a-b9a4-bf627afcb135 is still seen in agent 10.0.0.27 VM list 2025-07-17 11:32:59,137 - DEBUG - Pod d5924edb-290f-44fd-ab53-29047774e79e is not in agent 10.0.0.27 VM list 2025-07-17 11:32:59,143 - DEBUG - Pod e1284e1e-d2eb-4484-8d2f-33cd630c76b4 is not in agent 10.0.0.27 VM list 2025-07-17 11:32:59,145 - WARNING - Pod uuid 1215bf7e-5822-4603-a84e-44f5171c0aee is still seen in agent 10.0.0.27 VM list 2025-07-17 11:32:59,156 - DEBUG - VMI 4eae3a72-6301-11f0-9829-fa163ed9da0d is removed from agent 10.0.0.27 2025-07-17 11:32:59,156 - INFO - Verified that pod ctest-pod-30884066 is removed in agent 2025-07-17 11:32:59,156 - DEBUG - VMI 4e3f332a-6301-11f0-9829-fa163ed9da0d is removed from agent 10.0.0.27 2025-07-17 11:32:59,156 - INFO - Verified that pod ctest-pod-30900045 is removed in agent 2025-07-17 11:33:03,970 - WARNING - Pod uuid 54d64321-6955-41b3-abf8-0b616ef8cd6d is still seen in agent 10.0.0.27 VM list 2025-07-17 11:33:04,155 - WARNING - Pod uuid 19102d28-da6a-4061-a19d-e072722d5490 is still seen in agent 10.0.0.27 VM list 2025-07-17 11:33:04,156 - WARNING - Pod uuid 3d185ee1-25b7-4957-9100-383a694b96fb is still seen in agent 10.0.0.27 VM list 2025-07-17 11:33:04,157 - WARNING - Pod uuid 1215bf7e-5822-4603-a84e-44f5171c0aee is still seen in agent 10.0.0.27 VM list 2025-07-17 11:33:04,158 - WARNING - Pod uuid 241fec15-a5bf-4392-8ca6-687d355ab7ae is still seen in agent 10.0.0.27 VM list 2025-07-17 11:33:04,158 - WARNING - Pod uuid 1721e9ee-2e93-4d9a-b9a4-bf627afcb135 is still seen in agent 10.0.0.27 VM list 2025-07-17 11:33:08,986 - WARNING - Pod uuid 54d64321-6955-41b3-abf8-0b616ef8cd6d is still seen in agent 10.0.0.27 VM list 2025-07-17 11:33:09,183 - WARNING - Pod uuid 241fec15-a5bf-4392-8ca6-687d355ab7ae is still seen in agent 10.0.0.27 VM list 2025-07-17 11:33:09,184 - WARNING - Pod uuid 1215bf7e-5822-4603-a84e-44f5171c0aee is still seen in agent 10.0.0.27 VM list 2025-07-17 11:33:09,185 - WARNING - Pod uuid 1721e9ee-2e93-4d9a-b9a4-bf627afcb135 is still seen in agent 10.0.0.27 VM list 2025-07-17 11:33:09,185 - WARNING - Pod uuid 3d185ee1-25b7-4957-9100-383a694b96fb is still seen in agent 10.0.0.27 VM list 2025-07-17 11:33:09,185 - WARNING - Pod uuid 19102d28-da6a-4061-a19d-e072722d5490 is still seen in agent 10.0.0.27 VM list 2025-07-17 11:33:13,994 - WARNING - Pod uuid 54d64321-6955-41b3-abf8-0b616ef8cd6d is still seen in agent 10.0.0.27 VM list 2025-07-17 11:33:14,221 - WARNING - Pod uuid 241fec15-a5bf-4392-8ca6-687d355ab7ae is still seen in agent 10.0.0.27 VM list 2025-07-17 11:33:14,222 - WARNING - Pod uuid 19102d28-da6a-4061-a19d-e072722d5490 is still seen in agent 10.0.0.27 VM list 2025-07-17 11:33:14,222 - WARNING - Pod uuid 3d185ee1-25b7-4957-9100-383a694b96fb is still seen in agent 10.0.0.27 VM list 2025-07-17 11:33:14,223 - WARNING - Pod uuid 1721e9ee-2e93-4d9a-b9a4-bf627afcb135 is still seen in agent 10.0.0.27 VM list 2025-07-17 11:33:14,223 - WARNING - Pod uuid 1215bf7e-5822-4603-a84e-44f5171c0aee is still seen in agent 10.0.0.27 VM list 2025-07-17 11:33:19,002 - WARNING - Pod uuid 54d64321-6955-41b3-abf8-0b616ef8cd6d is still seen in agent 10.0.0.27 VM list 2025-07-17 11:33:19,244 - WARNING - Pod uuid 19102d28-da6a-4061-a19d-e072722d5490 is still seen in agent 10.0.0.27 VM list 2025-07-17 11:33:19,244 - WARNING - Pod uuid 1215bf7e-5822-4603-a84e-44f5171c0aee is still seen in agent 10.0.0.27 VM list 2025-07-17 11:33:19,245 - WARNING - Pod uuid 241fec15-a5bf-4392-8ca6-687d355ab7ae is still seen in agent 10.0.0.27 VM list 2025-07-17 11:33:19,246 - WARNING - Pod uuid 1721e9ee-2e93-4d9a-b9a4-bf627afcb135 is still seen in agent 10.0.0.27 VM list 2025-07-17 11:33:19,246 - WARNING - Pod uuid 3d185ee1-25b7-4957-9100-383a694b96fb is still seen in agent 10.0.0.27 VM list 2025-07-17 11:33:24,010 - WARNING - Pod uuid 54d64321-6955-41b3-abf8-0b616ef8cd6d is still seen in agent 10.0.0.27 VM list 2025-07-17 11:33:24,267 - WARNING - Pod uuid 1721e9ee-2e93-4d9a-b9a4-bf627afcb135 is still seen in agent 10.0.0.27 VM list 2025-07-17 11:33:24,267 - WARNING - Pod uuid 241fec15-a5bf-4392-8ca6-687d355ab7ae is still seen in agent 10.0.0.27 VM list 2025-07-17 11:33:24,267 - WARNING - Pod uuid 1215bf7e-5822-4603-a84e-44f5171c0aee is still seen in agent 10.0.0.27 VM list 2025-07-17 11:33:24,268 - WARNING - Pod uuid 3d185ee1-25b7-4957-9100-383a694b96fb is still seen in agent 10.0.0.27 VM list 2025-07-17 11:33:24,269 - WARNING - Pod uuid 19102d28-da6a-4061-a19d-e072722d5490 is still seen in agent 10.0.0.27 VM list 2025-07-17 11:33:29,019 - DEBUG - Pod 54d64321-6955-41b3-abf8-0b616ef8cd6d is not in agent 10.0.0.27 VM list 2025-07-17 11:33:29,027 - DEBUG - VMI 4d28bf88-6301-11f0-9829-fa163ed9da0d is removed from agent 10.0.0.27 2025-07-17 11:33:29,027 - INFO - Verified that pod ctest-pod-92637337 is removed in agent 2025-07-17 11:33:29,289 - DEBUG - Pod 241fec15-a5bf-4392-8ca6-687d355ab7ae is not in agent 10.0.0.27 VM list 2025-07-17 11:33:29,291 - DEBUG - Pod 1721e9ee-2e93-4d9a-b9a4-bf627afcb135 is not in agent 10.0.0.27 VM list 2025-07-17 11:33:29,294 - DEBUG - Pod 3d185ee1-25b7-4957-9100-383a694b96fb is not in agent 10.0.0.27 VM list 2025-07-17 11:33:29,295 - DEBUG - Pod 19102d28-da6a-4061-a19d-e072722d5490 is not in agent 10.0.0.27 VM list 2025-07-17 11:33:29,296 - DEBUG - Pod 1215bf7e-5822-4603-a84e-44f5171c0aee is not in agent 10.0.0.27 VM list 2025-07-17 11:33:29,326 - DEBUG - VMI 4da26d56-6301-11f0-9829-fa163ed9da0d is removed from agent 10.0.0.27 2025-07-17 11:33:29,326 - INFO - Verified that pod ctest-pod-87313915 is removed in agent 2025-07-17 11:33:29,326 - DEBUG - VMI 5034bb78-6301-11f0-9829-fa163ed9da0d is removed from agent 10.0.0.27 2025-07-17 11:33:29,326 - INFO - Verified that pod ctest-pod-75151664 is removed in agent 2025-07-17 11:33:29,327 - DEBUG - VMI 4fc0a4ea-6301-11f0-9829-fa163ed9da0d is removed from agent 10.0.0.27 2025-07-17 11:33:29,327 - INFO - Verified that pod ctest-pod-78804160 is removed in agent 2025-07-17 11:33:29,328 - DEBUG - VMI 50aa4884-6301-11f0-9829-fa163ed9da0d is removed from agent 10.0.0.27 2025-07-17 11:33:29,328 - INFO - Verified that pod ctest-pod-97842792 is removed in agent 2025-07-17 11:33:29,328 - DEBUG - VMI 4f3a642a-6301-11f0-9829-fa163ed9da0d is removed from agent 10.0.0.27 2025-07-17 11:33:29,328 - INFO - Verified that pod ctest-pod-05173603 is removed in agent 2025-07-17 11:33:29,329 - INFO - Deleting namespace ctest-non-default-97089513 2025-07-17 11:33:29,340 - DEBUG - Namespace ctest-non-default-97089513 still in k8s 2025-07-17 11:33:31,345 - DEBUG - Namespace ctest-non-default-97089513 still in k8s 2025-07-17 11:33:33,350 - DEBUG - Namespace ctest-non-default-97089513 still in k8s 2025-07-17 11:33:35,353 - DEBUG - Namespace ctest-non-default-97089513 is not in k8s 2025-07-17 11:33:35,353 - DEBUG - No need to check project deletion in contrail-api 2025-07-17 11:33:35,353 - INFO - Deleting namespace ctest-new-default-66121826 2025-07-17 11:33:35,361 - DEBUG - Namespace ctest-new-default-66121826 still in k8s 2025-07-17 11:33:37,373 - DEBUG - Namespace ctest-new-default-66121826 still in k8s 2025-07-17 11:33:39,377 - DEBUG - Namespace ctest-new-default-66121826 still in k8s 2025-07-17 11:33:41,381 - DEBUG - Namespace ctest-new-default-66121826 is not in k8s 2025-07-17 11:33:41,381 - DEBUG - No need to check project deletion in contrail-api