2024-08-29 17:47:27,094 - INFO - Using existing project ['default-domain', 'k8s-default'](8cec1b84-7fc7-4874-b048-d4e5f0bc5aac) 2024-08-29 17:47:27,117 - DEBUG - Namespace ctest-new-default-35307270 not present 2024-08-29 17:47:27,128 - INFO - Created namespace ctest-new-default-35307270 2024-08-29 17:47:30,132 - DEBUG - Namespace ctest-non-default-32834879 not present 2024-08-29 17:47:30,139 - INFO - Created namespace ctest-non-default-32834879 2024-08-29 17:47:33,164 - DEBUG - Pod ctest-pod-54313053 not present 2024-08-29 17:47:33,164 - INFO - Creating Pod ctest-pod-54313053 2024-08-29 17:47:33,192 - DEBUG - Pod : ctest-pod-54313053 UUID is d3b6a58d-f153-4a6b-9fa1-a54858c86d83 2024-08-29 17:47:33,197 - DEBUG - Pod ctest-pod-45747592 not present 2024-08-29 17:47:33,197 - INFO - Creating Pod ctest-pod-45747592 2024-08-29 17:47:33,230 - DEBUG - Pod : ctest-pod-45747592 UUID is e28d83a6-ab6e-4765-976e-e047098d9190 2024-08-29 17:47:33,233 - DEBUG - Pod ctest-pod-68959783 not present 2024-08-29 17:47:33,233 - INFO - Creating Pod ctest-pod-68959783 2024-08-29 17:47:33,264 - DEBUG - Pod : ctest-pod-68959783 UUID is 215cd5c6-31d6-4ff9-ad7c-414ca707b517 2024-08-29 17:47:33,271 - DEBUG - Pod ctest-pod-42289409 not present 2024-08-29 17:47:33,271 - INFO - Creating Pod ctest-pod-42289409 2024-08-29 17:47:33,295 - DEBUG - Pod : ctest-pod-42289409 UUID is 8220d5fe-a978-45e6-8b5a-6fa5bcb2655a 2024-08-29 17:47:33,299 - DEBUG - Pod ctest-pod-60050840 not present 2024-08-29 17:47:33,300 - INFO - Creating Pod ctest-pod-60050840 2024-08-29 17:47:33,316 - DEBUG - Pod : ctest-pod-60050840 UUID is c11f6bb2-1010-4517-8fcc-097965d0ef6b 2024-08-29 17:47:33,318 - DEBUG - Pod ctest-pod-26117664 not present 2024-08-29 17:47:33,318 - INFO - Creating Pod ctest-pod-26117664 2024-08-29 17:47:33,342 - DEBUG - Pod : ctest-pod-26117664 UUID is aedc77fa-992c-4ba1-ab71-39238b76749d 2024-08-29 17:47:33,344 - DEBUG - Pod ctest-pod-10256889 not present 2024-08-29 17:47:33,344 - INFO - Creating Pod ctest-pod-10256889 2024-08-29 17:47:33,361 - DEBUG - Pod : ctest-pod-10256889 UUID is c6b9aedf-c48b-4ebe-b438-33bd255ab822 2024-08-29 17:47:33,363 - DEBUG - Pod ctest-pod-72440438 not present 2024-08-29 17:47:33,363 - INFO - Creating Pod ctest-pod-72440438 2024-08-29 17:47:33,384 - DEBUG - Pod : ctest-pod-72440438 UUID is fe28c794-852d-4f46-aca2-462652ee0b73 2024-08-29 17:47:33,574 - INFO - Project default-domain:k8s-ctest-new-default-35307270 for Namespace ctest-new-default-35307270 is seen in contrail-api 2024-08-29 17:47:33,574 - DEBUG - Project uuid in Contrail is 88458ba4-27a7-483e-ace6-08fdccd90f5a 2024-08-29 17:47:33,695 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_NamespaceDatabaseList?namespace_uuid=d4a53339-1106-4218-97fc-f6f2d7fbf086 2024-08-29 17:47:33,713 - INFO - Namespace ctest-new-default-35307270 with uuid d4a53339-1106-4218-97fc-f6f2d7fbf086 found in kube manager 2024-08-29 17:47:33,713 - INFO - Namespace ctest-new-default-35307270 verification passed 2024-08-29 17:47:33,849 - INFO - Project default-domain:k8s-ctest-non-default-32834879 for Namespace ctest-non-default-32834879 is seen in contrail-api 2024-08-29 17:47:33,849 - DEBUG - Project uuid in Contrail is 5a7e21cd-f506-4f57-9ddb-98ff8aa67ada 2024-08-29 17:47:33,849 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_NamespaceDatabaseList?namespace_uuid=807de809-145d-453c-9c4b-46e2d7dbb8d3 2024-08-29 17:47:33,853 - INFO - Namespace ctest-non-default-32834879 with uuid 807de809-145d-453c-9c4b-46e2d7dbb8d3 found in kube manager 2024-08-29 17:47:33,853 - INFO - Namespace ctest-non-default-32834879 verification passed 2024-08-29 17:47:33,859 - DEBUG - Pod ctest-pod-54313053 not in running state.Currently in Pending 2024-08-29 17:47:38,867 - DEBUG - Pod ctest-pod-54313053 not in running state.Currently in Pending 2024-08-29 17:47:43,873 - INFO - Pod ctest-pod-54313053 is in running state.Got IP 10.47.255.251 2024-08-29 17:47:43,884 - DEBUG - Pod ctest-pod-54313053 has vmi c5f26d4a-662e-11ef-9d66-fa163ed67f37 2024-08-29 17:47:43,884 - INFO - Verified pod ctest-pod-54313053 in contrail-api 2024-08-29 17:47:43,898 - DEBUG - VMI c5f26d4a-662e-11ef-9d66-fa163ed67f37 is active in agent 10.0.0.44 2024-08-29 17:47:43,898 - INFO - Verified Pod ctest-pod-54313053 in agent 10.0.0.44 2024-08-29 17:47:43,898 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_VirtualMachineDatabaseList?x=d3b6a58d-f153-4a6b-9fa1-a54858c86d83 2024-08-29 17:47:43,904 - INFO - Pod ctest-pod-54313053 with uuid d3b6a58d-f153-4a6b-9fa1-a54858c86d83 found in kube manager 2024-08-29 17:47:43,904 - INFO - Pod ctest-pod-54313053 verification passed 2024-08-29 17:47:43,910 - DEBUG - Pod ctest-pod-45747592 not in running state.Currently in Pending 2024-08-29 17:47:48,916 - INFO - Pod ctest-pod-45747592 is in running state.Got IP 10.47.255.250 2024-08-29 17:47:48,926 - DEBUG - Pod ctest-pod-45747592 has vmi c66ab868-662e-11ef-9d66-fa163ed67f37 2024-08-29 17:47:48,926 - INFO - Verified pod ctest-pod-45747592 in contrail-api 2024-08-29 17:47:48,940 - DEBUG - VMI c66ab868-662e-11ef-9d66-fa163ed67f37 is active in agent 10.0.0.44 2024-08-29 17:47:48,940 - INFO - Verified Pod ctest-pod-45747592 in agent 10.0.0.44 2024-08-29 17:47:48,940 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_VirtualMachineDatabaseList?x=e28d83a6-ab6e-4765-976e-e047098d9190 2024-08-29 17:47:48,945 - INFO - Pod ctest-pod-45747592 with uuid e28d83a6-ab6e-4765-976e-e047098d9190 found in kube manager 2024-08-29 17:47:48,945 - INFO - Pod ctest-pod-45747592 verification passed 2024-08-29 17:47:48,950 - INFO - Pod ctest-pod-68959783 is in running state.Got IP 10.47.255.249 2024-08-29 17:47:49,005 - DEBUG - Pod ctest-pod-68959783 has vmi c70cb9c4-662e-11ef-9d66-fa163ed67f37 2024-08-29 17:47:49,005 - INFO - Verified pod ctest-pod-68959783 in contrail-api 2024-08-29 17:47:49,019 - DEBUG - VMI c70cb9c4-662e-11ef-9d66-fa163ed67f37 is active in agent 10.0.0.44 2024-08-29 17:47:49,019 - INFO - Verified Pod ctest-pod-68959783 in agent 10.0.0.44 2024-08-29 17:47:49,019 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_VirtualMachineDatabaseList?x=215cd5c6-31d6-4ff9-ad7c-414ca707b517 2024-08-29 17:47:49,024 - INFO - Pod ctest-pod-68959783 with uuid 215cd5c6-31d6-4ff9-ad7c-414ca707b517 found in kube manager 2024-08-29 17:47:49,024 - INFO - Pod ctest-pod-68959783 verification passed 2024-08-29 17:47:49,029 - INFO - Pod ctest-pod-42289409 is in running state.Got IP 10.47.255.248 2024-08-29 17:47:49,040 - DEBUG - Pod ctest-pod-42289409 has vmi c7851d2e-662e-11ef-9d66-fa163ed67f37 2024-08-29 17:47:49,040 - INFO - Verified pod ctest-pod-42289409 in contrail-api 2024-08-29 17:47:49,057 - DEBUG - VMI c7851d2e-662e-11ef-9d66-fa163ed67f37 is active in agent 10.0.0.44 2024-08-29 17:47:49,058 - INFO - Verified Pod ctest-pod-42289409 in agent 10.0.0.44 2024-08-29 17:47:49,058 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_VirtualMachineDatabaseList?x=8220d5fe-a978-45e6-8b5a-6fa5bcb2655a 2024-08-29 17:47:49,063 - INFO - Pod ctest-pod-42289409 with uuid 8220d5fe-a978-45e6-8b5a-6fa5bcb2655a found in kube manager 2024-08-29 17:47:49,063 - INFO - Pod ctest-pod-42289409 verification passed 2024-08-29 17:47:49,068 - INFO - Pod ctest-pod-60050840 is in running state.Got IP 10.47.255.247 2024-08-29 17:47:49,129 - DEBUG - Pod ctest-pod-60050840 has vmi c80ab524-662e-11ef-9d66-fa163ed67f37 2024-08-29 17:47:49,129 - INFO - Verified pod ctest-pod-60050840 in contrail-api 2024-08-29 17:47:49,146 - DEBUG - VMI c80ab524-662e-11ef-9d66-fa163ed67f37 is active in agent 10.0.0.44 2024-08-29 17:47:49,146 - INFO - Verified Pod ctest-pod-60050840 in agent 10.0.0.44 2024-08-29 17:47:49,146 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_VirtualMachineDatabaseList?x=c11f6bb2-1010-4517-8fcc-097965d0ef6b 2024-08-29 17:47:49,151 - INFO - Pod ctest-pod-60050840 with uuid c11f6bb2-1010-4517-8fcc-097965d0ef6b found in kube manager 2024-08-29 17:47:49,151 - INFO - Pod ctest-pod-60050840 verification passed 2024-08-29 17:47:49,159 - INFO - Pod ctest-pod-10256889 is in running state.Got IP 10.47.255.245 2024-08-29 17:47:49,211 - DEBUG - Pod ctest-pod-10256889 has vmi c8e9f1f8-662e-11ef-9d66-fa163ed67f37 2024-08-29 17:47:49,211 - INFO - Verified pod ctest-pod-10256889 in contrail-api 2024-08-29 17:47:49,224 - DEBUG - VMI c8e9f1f8-662e-11ef-9d66-fa163ed67f37 is active in agent 10.0.0.44 2024-08-29 17:47:49,224 - INFO - Verified Pod ctest-pod-10256889 in agent 10.0.0.44 2024-08-29 17:47:49,225 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_VirtualMachineDatabaseList?x=c6b9aedf-c48b-4ebe-b438-33bd255ab822 2024-08-29 17:47:49,229 - INFO - Pod ctest-pod-10256889 with uuid c6b9aedf-c48b-4ebe-b438-33bd255ab822 found in kube manager 2024-08-29 17:47:49,229 - INFO - Pod ctest-pod-10256889 verification passed 2024-08-29 17:47:49,235 - DEBUG - Pod ctest-pod-26117664 not in running state.Currently in Pending 2024-08-29 17:47:54,241 - INFO - Pod ctest-pod-26117664 is in running state.Got IP 10.47.255.246 2024-08-29 17:47:54,251 - DEBUG - Pod ctest-pod-26117664 has vmi c8743a9e-662e-11ef-9d66-fa163ed67f37 2024-08-29 17:47:54,251 - INFO - Verified pod ctest-pod-26117664 in contrail-api 2024-08-29 17:47:54,264 - DEBUG - VMI c8743a9e-662e-11ef-9d66-fa163ed67f37 is active in agent 10.0.0.44 2024-08-29 17:47:54,264 - INFO - Verified Pod ctest-pod-26117664 in agent 10.0.0.44 2024-08-29 17:47:54,265 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_VirtualMachineDatabaseList?x=aedc77fa-992c-4ba1-ab71-39238b76749d 2024-08-29 17:47:54,269 - INFO - Pod ctest-pod-26117664 with uuid aedc77fa-992c-4ba1-ab71-39238b76749d found in kube manager 2024-08-29 17:47:54,269 - INFO - Pod ctest-pod-26117664 verification passed 2024-08-29 17:47:54,274 - INFO - Pod ctest-pod-72440438 is in running state.Got IP 10.47.255.244 2024-08-29 17:47:54,283 - DEBUG - Pod ctest-pod-72440438 has vmi c951ee66-662e-11ef-9d66-fa163ed67f37 2024-08-29 17:47:54,283 - INFO - Verified pod ctest-pod-72440438 in contrail-api 2024-08-29 17:47:54,298 - DEBUG - VMI c951ee66-662e-11ef-9d66-fa163ed67f37 is active in agent 10.0.0.44 2024-08-29 17:47:54,298 - INFO - Verified Pod ctest-pod-72440438 in agent 10.0.0.44 2024-08-29 17:47:54,298 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_VirtualMachineDatabaseList?x=fe28c794-852d-4f46-aca2-462652ee0b73 2024-08-29 17:47:54,303 - INFO - Pod ctest-pod-72440438 with uuid fe28c794-852d-4f46-aca2-462652ee0b73 found in kube manager 2024-08-29 17:47:54,303 - INFO - Pod ctest-pod-72440438 verification passed 2024-08-29 17:47:54,303 - INFO - ================================================================================ 2024-08-29 17:47:54,303 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-08-29 17:47:54,303 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-08-29 17:47:54,508 - DEBUG - Nothing to compare xmpp stats {'10.0.0.44': {'10.0.0.34': '0'}} with 2024-08-29 17:47:54,508 - INFO - Initial checks done. Running the testcase now 2024-08-29 17:47:54,509 - INFO - 2024-08-29 17:47:54,594 - DEBUG - [Pod ctest-pod-54313053] Cmd: echo ctest-pod-54313053 > /usr/share/nginx/html/index.html, Output: 2024-08-29 17:47:54,689 - DEBUG - [Pod ctest-pod-45747592] Cmd: echo ctest-pod-45747592 > /usr/share/nginx/html/index.html, Output: 2024-08-29 17:47:54,761 - DEBUG - [Pod ctest-pod-68959783] Cmd: echo ctest-pod-68959783 > /usr/share/nginx/html/index.html, Output: 2024-08-29 17:47:54,828 - DEBUG - [Pod ctest-pod-42289409] Cmd: echo ctest-pod-42289409 > /usr/share/nginx/html/index.html, Output: 2024-08-29 17:47:54,831 - DEBUG - Service ctest-nginx-svc-06991885 not present 2024-08-29 17:47:54,832 - INFO - Creating service ctest-nginx-svc-06991885 2024-08-29 17:47:54,842 - INFO - Created Service ctest-nginx-svc-06991885 2024-08-29 17:47:54,862 - WARNING - Service UUID 8d35e300-8e2b-427f-87fe-41a038083c99 not yet found in contrail-api 2024-08-29 17:47:55,869 - INFO - Validated that Service ctest-nginx-svc-06991885 is seen in contrail-api 2024-08-29 17:47:55,870 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_LoadbalancerDatabaseList?x=8d35e300-8e2b-427f-87fe-41a038083c99 2024-08-29 17:47:55,881 - INFO - Service ctest-nginx-svc-06991885 with uuid 8d35e300-8e2b-427f-87fe-41a038083c99 found in kube manager 2024-08-29 17:47:55,881 - INFO - Service ctest-nginx-svc-06991885 verification passed 2024-08-29 17:47:56,966 - DEBUG - [Pod ctest-pod-60050840] Cmd: wget http://10.108.64.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.64.106:80 (10.108.64.106:80) ctest-pod-45747592 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-29 17:47:56,966 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd wget http://10.108.64.106:80/ -O - -T 5 -t 1 passed 2024-08-29 17:47:56,966 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd output: Connecting to 10.108.64.106:80 (10.108.64.106:80) ctest-pod-45747592 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-29 17:47:57,035 - DEBUG - [Pod ctest-pod-60050840] Cmd: wget http://10.108.64.106:80/ -O - -T 5 -t 1 , Output: ctest-pod-45747592 Connecting to 10.108.64.106:80 (10.108.64.106:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-29 17:47:57,036 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd wget http://10.108.64.106:80/ -O - -T 5 -t 1 passed 2024-08-29 17:47:57,036 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd output: ctest-pod-45747592 Connecting to 10.108.64.106:80 (10.108.64.106:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-29 17:47:57,116 - DEBUG - [Pod ctest-pod-60050840] Cmd: wget http://10.108.64.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.64.106:80 (10.108.64.106:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-54313053 2024-08-29 17:47:57,116 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd wget http://10.108.64.106:80/ -O - -T 5 -t 1 passed 2024-08-29 17:47:57,116 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd output: Connecting to 10.108.64.106:80 (10.108.64.106:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-54313053 2024-08-29 17:47:57,116 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-54313053': 1, 'ctest-pod-45747592': 2} 2024-08-29 17:47:57,191 - DEBUG - [Pod ctest-pod-10256889] Cmd: wget http://10.108.64.106:80/ -O - -T 5 -t 1 , Output: ctest-pod-45747592 Connecting to 10.108.64.106:80 (10.108.64.106:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-29 17:47:57,191 - DEBUG - [Pod Pod ctest-pod-10256889] Cmd wget http://10.108.64.106:80/ -O - -T 5 -t 1 passed 2024-08-29 17:47:57,191 - DEBUG - [Pod Pod ctest-pod-10256889] Cmd output: ctest-pod-45747592 Connecting to 10.108.64.106:80 (10.108.64.106:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-29 17:47:57,250 - DEBUG - [Pod ctest-pod-10256889] Cmd: wget http://10.108.64.106:80/ -O - -T 5 -t 1 , Output: ctest-pod-54313053 Connecting to 10.108.64.106:80 (10.108.64.106:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-29 17:47:57,250 - DEBUG - [Pod Pod ctest-pod-10256889] Cmd wget http://10.108.64.106:80/ -O - -T 5 -t 1 passed 2024-08-29 17:47:57,250 - DEBUG - [Pod Pod ctest-pod-10256889] Cmd output: ctest-pod-54313053 Connecting to 10.108.64.106:80 (10.108.64.106:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-29 17:47:57,250 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-54313053': 1, 'ctest-pod-45747592': 1} 2024-08-29 17:47:57,253 - DEBUG - Network policy ingress-on-service not present 2024-08-29 17:47:57,254 - INFO - Creating Network Policy ingress-on-service 2024-08-29 17:47:57,268 - INFO - Network policy found in k8s 2024-08-29 17:47:57,268 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=fe8be8fa-d221-4bac-9dbd-61485380aaf8 2024-08-29 17:47:57,273 - INFO - Network Policy ingress-on-service with uuid fe8be8fa-d221-4bac-9dbd-61485380aaf8 found in kube manager 2024-08-29 17:47:57,307 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-08-29 17:47:57,307 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-08-29 17:47:57,307 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=fe8be8fa-d221-4bac-9dbd-61485380aaf8 2024-08-29 17:47:57,335 - WARNING - Network policy with name ingress-on-service not found in agent 2024-08-29 17:47:59,336 - DEBUG - Requesting: http://10.0.0.34:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=fe8be8fa-d221-4bac-9dbd-61485380aaf8 2024-08-29 17:47:59,366 - INFO - Network policy with name ingress-on-service found in agent 2024-08-29 17:47:59,367 - INFO - Network Policy ingress-on-service verification passed 2024-08-29 17:48:04,444 - DEBUG - [Pod ctest-pod-60050840] Cmd: wget http://10.108.64.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:48:04,444 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd wget http://10.108.64.106:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:48:04,444 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:48:09,516 - DEBUG - [Pod ctest-pod-60050840] Cmd: wget http://10.108.64.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:48:09,516 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd wget http://10.108.64.106:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:48:09,516 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:48:14,599 - DEBUG - [Pod ctest-pod-60050840] Cmd: wget http://10.108.64.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:48:14,599 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd wget http://10.108.64.106:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:48:14,599 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:48:19,673 - DEBUG - [Pod ctest-pod-60050840] Cmd: wget http://10.108.64.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:48:19,673 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd wget http://10.108.64.106:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:48:19,673 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:48:24,745 - DEBUG - [Pod ctest-pod-60050840] Cmd: wget http://10.108.64.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:48:24,745 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd wget http://10.108.64.106:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:48:24,745 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:48:29,798 - DEBUG - [Pod ctest-pod-60050840] Cmd: wget http://10.108.64.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:48:29,798 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd wget http://10.108.64.106:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:48:29,798 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:48:34,859 - DEBUG - [Pod ctest-pod-60050840] Cmd: wget http://10.108.64.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:48:34,860 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd wget http://10.108.64.106:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:48:34,860 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:48:39,928 - DEBUG - [Pod ctest-pod-60050840] Cmd: wget http://10.108.64.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:48:39,928 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd wget http://10.108.64.106:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:48:39,928 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:48:44,986 - DEBUG - [Pod ctest-pod-60050840] Cmd: wget http://10.108.64.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:48:44,986 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd wget http://10.108.64.106:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:48:44,986 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:48:50,049 - DEBUG - [Pod ctest-pod-60050840] Cmd: wget http://10.108.64.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:48:50,049 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd wget http://10.108.64.106:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:48:50,050 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:48:50,050 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-54313053': 0, 'ctest-pod-45747592': 0} 2024-08-29 17:48:50,117 - DEBUG - [Pod ctest-pod-26117664] Cmd: wget http://10.108.64.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.64.106:80 (10.108.64.106:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-54313053 2024-08-29 17:48:50,117 - DEBUG - [Pod Pod ctest-pod-26117664] Cmd wget http://10.108.64.106:80/ -O - -T 5 -t 1 passed 2024-08-29 17:48:50,117 - DEBUG - [Pod Pod ctest-pod-26117664] Cmd output: Connecting to 10.108.64.106:80 (10.108.64.106:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-54313053 2024-08-29 17:48:50,204 - DEBUG - [Pod ctest-pod-26117664] Cmd: wget http://10.108.64.106:80/ -O - -T 5 -t 1 , Output: ctest-pod-54313053 Connecting to 10.108.64.106:80 (10.108.64.106:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-29 17:48:50,205 - DEBUG - [Pod Pod ctest-pod-26117664] Cmd wget http://10.108.64.106:80/ -O - -T 5 -t 1 passed 2024-08-29 17:48:50,205 - DEBUG - [Pod Pod ctest-pod-26117664] Cmd output: ctest-pod-54313053 Connecting to 10.108.64.106:80 (10.108.64.106:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-29 17:48:50,268 - DEBUG - [Pod ctest-pod-26117664] Cmd: wget http://10.108.64.106:80/ -O - -T 5 -t 1 , Output: ctest-pod-54313053 Connecting to 10.108.64.106:80 (10.108.64.106:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-29 17:48:50,268 - DEBUG - [Pod Pod ctest-pod-26117664] Cmd wget http://10.108.64.106:80/ -O - -T 5 -t 1 passed 2024-08-29 17:48:50,268 - DEBUG - [Pod Pod ctest-pod-26117664] Cmd output: ctest-pod-54313053 Connecting to 10.108.64.106:80 (10.108.64.106:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-29 17:48:50,416 - DEBUG - [Pod ctest-pod-26117664] Cmd: wget http://10.108.64.106:80/ -O - -T 5 -t 1 , Output: ctest-pod-45747592 Connecting to 10.108.64.106:80 (10.108.64.106:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-29 17:48:50,416 - DEBUG - [Pod Pod ctest-pod-26117664] Cmd wget http://10.108.64.106:80/ -O - -T 5 -t 1 passed 2024-08-29 17:48:50,416 - DEBUG - [Pod Pod ctest-pod-26117664] Cmd output: ctest-pod-45747592 Connecting to 10.108.64.106:80 (10.108.64.106:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-29 17:48:50,416 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-54313053': 3, 'ctest-pod-45747592': 1} 2024-08-29 17:48:55,486 - DEBUG - [Pod ctest-pod-10256889] Cmd: wget http://10.108.64.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:48:55,486 - DEBUG - [Pod Pod ctest-pod-10256889] Cmd wget http://10.108.64.106:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:48:55,486 - DEBUG - [Pod Pod ctest-pod-10256889] Cmd output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:49:00,548 - DEBUG - [Pod ctest-pod-10256889] Cmd: wget http://10.108.64.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:49:00,548 - DEBUG - [Pod Pod ctest-pod-10256889] Cmd wget http://10.108.64.106:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:49:00,548 - DEBUG - [Pod Pod ctest-pod-10256889] Cmd output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:49:05,607 - DEBUG - [Pod ctest-pod-10256889] Cmd: wget http://10.108.64.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:49:05,607 - DEBUG - [Pod Pod ctest-pod-10256889] Cmd wget http://10.108.64.106:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:49:05,607 - DEBUG - [Pod Pod ctest-pod-10256889] Cmd output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:49:10,682 - DEBUG - [Pod ctest-pod-10256889] Cmd: wget http://10.108.64.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:49:10,682 - DEBUG - [Pod Pod ctest-pod-10256889] Cmd wget http://10.108.64.106:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:49:10,682 - DEBUG - [Pod Pod ctest-pod-10256889] Cmd output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:49:15,742 - DEBUG - [Pod ctest-pod-10256889] Cmd: wget http://10.108.64.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:49:15,742 - DEBUG - [Pod Pod ctest-pod-10256889] Cmd wget http://10.108.64.106:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:49:15,742 - DEBUG - [Pod Pod ctest-pod-10256889] Cmd output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:49:20,810 - DEBUG - [Pod ctest-pod-10256889] Cmd: wget http://10.108.64.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:49:20,810 - DEBUG - [Pod Pod ctest-pod-10256889] Cmd wget http://10.108.64.106:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:49:20,810 - DEBUG - [Pod Pod ctest-pod-10256889] Cmd output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:49:25,866 - DEBUG - [Pod ctest-pod-10256889] Cmd: wget http://10.108.64.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:49:25,866 - DEBUG - [Pod Pod ctest-pod-10256889] Cmd wget http://10.108.64.106:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:49:25,866 - DEBUG - [Pod Pod ctest-pod-10256889] Cmd output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:49:30,941 - DEBUG - [Pod ctest-pod-10256889] Cmd: wget http://10.108.64.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:49:30,942 - DEBUG - [Pod Pod ctest-pod-10256889] Cmd wget http://10.108.64.106:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:49:30,942 - DEBUG - [Pod Pod ctest-pod-10256889] Cmd output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:49:35,995 - DEBUG - [Pod ctest-pod-10256889] Cmd: wget http://10.108.64.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:49:35,996 - DEBUG - [Pod Pod ctest-pod-10256889] Cmd wget http://10.108.64.106:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:49:35,996 - DEBUG - [Pod Pod ctest-pod-10256889] Cmd output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:49:41,075 - DEBUG - [Pod ctest-pod-10256889] Cmd: wget http://10.108.64.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:49:41,076 - DEBUG - [Pod Pod ctest-pod-10256889] Cmd wget http://10.108.64.106:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:49:41,076 - DEBUG - [Pod Pod ctest-pod-10256889] Cmd output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:49:41,076 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-54313053': 0, 'ctest-pod-45747592': 0} 2024-08-29 17:49:43,136 - DEBUG - [Pod ctest-pod-26117664] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.607 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.084 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.125 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.084/0.605/1.607 ms 2024-08-29 17:49:43,136 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-26117664 with expectation True passed 2024-08-29 17:49:45,205 - DEBUG - [Pod ctest-pod-60050840] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.671 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.084 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.119 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.084/0.624/1.671 ms 2024-08-29 17:49:45,205 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-60050840 with expectation True passed 2024-08-29 17:49:47,274 - DEBUG - [Pod ctest-pod-10256889] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=2.649 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.083 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.080 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.080/0.937/2.649 ms 2024-08-29 17:49:47,274 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-10256889 with expectation True passed 2024-08-29 17:49:47,337 - DEBUG - [Pod ctest-pod-26117664] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-29 17:49:47,337 - DEBUG - [Pod Pod ctest-pod-26117664] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-08-29 17:49:47,337 - DEBUG - [Pod Pod ctest-pod-26117664] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-29 17:49:47,337 - INFO - wget check of of http://10.47.255.251 from ctest-pod-26117664 passed 2024-08-29 17:49:47,415 - DEBUG - [Pod ctest-pod-26117664] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-29 17:49:47,415 - DEBUG - [Pod Pod ctest-pod-26117664] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-08-29 17:49:47,416 - DEBUG - [Pod Pod ctest-pod-26117664] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-29 17:49:47,416 - INFO - wget check of of http://10.47.255.250 from ctest-pod-26117664 passed 2024-08-29 17:49:52,482 - DEBUG - [Pod ctest-pod-60050840] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-29 17:49:52,482 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-29 17:49:52,482 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-29 17:49:52,482 - INFO - wget check of of http://10.47.255.250 from ctest-pod-60050840 passed 2024-08-29 17:49:57,541 - DEBUG - [Pod ctest-pod-72440438] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-08-29 17:49:57,541 - DEBUG - [Pod Pod ctest-pod-72440438] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-08-29 17:49:57,541 - DEBUG - [Pod Pod ctest-pod-72440438] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-08-29 17:49:57,541 - INFO - wget check of of http://10.47.255.251 from ctest-pod-72440438 passed 2024-08-29 17:49:57,550 - INFO - Updating Network Policy ingress-on-service 2024-08-29 17:50:02,632 - DEBUG - [Pod ctest-pod-60050840] Cmd: wget http://10.108.64.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:50:02,632 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd wget http://10.108.64.106:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:50:02,632 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:50:07,706 - DEBUG - [Pod ctest-pod-60050840] Cmd: wget http://10.108.64.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:50:07,706 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd wget http://10.108.64.106:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:50:07,706 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:50:12,775 - DEBUG - [Pod ctest-pod-60050840] Cmd: wget http://10.108.64.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:50:12,775 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd wget http://10.108.64.106:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:50:12,775 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:50:17,838 - DEBUG - [Pod ctest-pod-60050840] Cmd: wget http://10.108.64.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:50:17,838 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd wget http://10.108.64.106:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:50:17,838 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:50:22,903 - DEBUG - [Pod ctest-pod-60050840] Cmd: wget http://10.108.64.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:50:22,903 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd wget http://10.108.64.106:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:50:22,903 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:50:27,962 - DEBUG - [Pod ctest-pod-60050840] Cmd: wget http://10.108.64.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:50:27,962 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd wget http://10.108.64.106:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:50:27,962 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:50:33,034 - DEBUG - [Pod ctest-pod-60050840] Cmd: wget http://10.108.64.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:50:33,034 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd wget http://10.108.64.106:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:50:33,034 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:50:38,097 - DEBUG - [Pod ctest-pod-60050840] Cmd: wget http://10.108.64.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:50:38,097 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd wget http://10.108.64.106:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:50:38,097 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:50:43,174 - DEBUG - [Pod ctest-pod-60050840] Cmd: wget http://10.108.64.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:50:43,175 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd wget http://10.108.64.106:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:50:43,175 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:50:48,251 - DEBUG - [Pod ctest-pod-60050840] Cmd: wget http://10.108.64.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:50:48,251 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd wget http://10.108.64.106:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:50:48,251 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd output: Connecting to 10.108.64.106:80 (10.108.64.106:80) wget: download timed out 2024-08-29 17:50:48,252 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-54313053': 0, 'ctest-pod-45747592': 0} 2024-08-29 17:50:48,320 - DEBUG - [Pod ctest-pod-26117664] Cmd: wget http://10.108.64.106:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.64.106:80 (10.108.64.106:80) ctest-pod-54313053 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-29 17:50:48,320 - DEBUG - [Pod Pod ctest-pod-26117664] Cmd wget http://10.108.64.106:80/ -O - -T 5 -t 1 passed 2024-08-29 17:50:48,320 - DEBUG - [Pod Pod ctest-pod-26117664] Cmd output: Connecting to 10.108.64.106:80 (10.108.64.106:80) ctest-pod-54313053 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-29 17:50:48,408 - DEBUG - [Pod ctest-pod-26117664] Cmd: wget http://10.108.64.106:80/ -O - -T 5 -t 1 , Output: ctest-pod-54313053 Connecting to 10.108.64.106:80 (10.108.64.106:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-29 17:50:48,408 - DEBUG - [Pod Pod ctest-pod-26117664] Cmd wget http://10.108.64.106:80/ -O - -T 5 -t 1 passed 2024-08-29 17:50:48,408 - DEBUG - [Pod Pod ctest-pod-26117664] Cmd output: ctest-pod-54313053 Connecting to 10.108.64.106:80 (10.108.64.106:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-29 17:50:48,477 - DEBUG - [Pod ctest-pod-26117664] Cmd: wget http://10.108.64.106:80/ -O - -T 5 -t 1 , Output: ctest-pod-45747592 Connecting to 10.108.64.106:80 (10.108.64.106:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-29 17:50:48,477 - DEBUG - [Pod Pod ctest-pod-26117664] Cmd wget http://10.108.64.106:80/ -O - -T 5 -t 1 passed 2024-08-29 17:50:48,478 - DEBUG - [Pod Pod ctest-pod-26117664] Cmd output: ctest-pod-45747592 Connecting to 10.108.64.106:80 (10.108.64.106:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-29 17:50:48,478 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-54313053': 2, 'ctest-pod-45747592': 1} 2024-08-29 17:50:48,538 - DEBUG - [Pod ctest-pod-10256889] Cmd: wget http://10.108.64.106:80/ -O - -T 5 -t 1 , Output: ctest-pod-45747592 Connecting to 10.108.64.106:80 (10.108.64.106:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-29 17:50:48,538 - DEBUG - [Pod Pod ctest-pod-10256889] Cmd wget http://10.108.64.106:80/ -O - -T 5 -t 1 passed 2024-08-29 17:50:48,538 - DEBUG - [Pod Pod ctest-pod-10256889] Cmd output: ctest-pod-45747592 Connecting to 10.108.64.106:80 (10.108.64.106:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-29 17:50:48,615 - DEBUG - [Pod ctest-pod-10256889] Cmd: wget http://10.108.64.106:80/ -O - -T 5 -t 1 , Output: ctest-pod-54313053 Connecting to 10.108.64.106:80 (10.108.64.106:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-29 17:50:48,615 - DEBUG - [Pod Pod ctest-pod-10256889] Cmd wget http://10.108.64.106:80/ -O - -T 5 -t 1 passed 2024-08-29 17:50:48,615 - DEBUG - [Pod Pod ctest-pod-10256889] Cmd output: ctest-pod-54313053 Connecting to 10.108.64.106:80 (10.108.64.106:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-29 17:50:48,615 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-54313053': 1, 'ctest-pod-45747592': 1} 2024-08-29 17:50:50,681 - DEBUG - [Pod ctest-pod-26117664] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.141 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.106 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.094 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.094/0.447/1.141 ms 2024-08-29 17:50:50,682 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-26117664 with expectation True passed 2024-08-29 17:50:52,762 - DEBUG - [Pod ctest-pod-60050840] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.825 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.101 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.091 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.091/0.339/0.825 ms 2024-08-29 17:50:52,762 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-60050840 with expectation True passed 2024-08-29 17:50:54,826 - DEBUG - [Pod ctest-pod-10256889] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.782 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.083 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.088 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.083/0.317/0.782 ms 2024-08-29 17:50:54,826 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-10256889 with expectation True passed 2024-08-29 17:50:54,895 - DEBUG - [Pod ctest-pod-26117664] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-29 17:50:54,895 - DEBUG - [Pod Pod ctest-pod-26117664] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-08-29 17:50:54,895 - DEBUG - [Pod Pod ctest-pod-26117664] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-29 17:50:54,895 - INFO - wget check of of http://10.47.255.251 from ctest-pod-26117664 passed 2024-08-29 17:50:54,951 - DEBUG - [Pod ctest-pod-26117664] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-29 17:50:54,951 - DEBUG - [Pod Pod ctest-pod-26117664] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-08-29 17:50:54,952 - DEBUG - [Pod Pod ctest-pod-26117664] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-29 17:50:54,952 - INFO - wget check of of http://10.47.255.250 from ctest-pod-26117664 passed 2024-08-29 17:51:00,022 - DEBUG - [Pod ctest-pod-60050840] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-29 17:51:00,023 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-29 17:51:00,023 - DEBUG - [Pod Pod ctest-pod-60050840] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-29 17:51:00,023 - INFO - wget check of of http://10.47.255.250 from ctest-pod-60050840 passed 2024-08-29 17:51:00,085 - DEBUG - [Pod ctest-pod-72440438] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-29 17:51:00,085 - DEBUG - [Pod Pod ctest-pod-72440438] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-08-29 17:51:00,085 - DEBUG - [Pod Pod ctest-pod-72440438] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-29 17:51:00,085 - INFO - wget check of of http://10.47.255.251 from ctest-pod-72440438 passed 2024-08-29 17:51:00,086 - INFO - Deleting Network Policy : ingress-on-service 2024-08-29 17:51:00,086 - INFO - Deleting service : ctest-nginx-svc-06991885 2024-08-29 17:51:00,338 - DEBUG - No XMPP flaps were noticed during the test
2024-08-29 17:51:00,338 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:06]
2024-08-29 17:51:00,338 - INFO - -------------------------------------------------------------------------------- 2024-08-29 17:51:00,344 - INFO - Deleting pod ctest-new-default-35307270:ctest-pod-54313053 2024-08-29 17:51:00,344 - INFO - Deleting pod ctest-new-default-35307270:ctest-pod-45747592 2024-08-29 17:51:00,345 - INFO - Deleting pod ctest-non-default-32834879:ctest-pod-68959783 2024-08-29 17:51:00,345 - INFO - Deleting pod ctest-non-default-32834879:ctest-pod-42289409 2024-08-29 17:51:00,345 - INFO - Deleting pod ctest-new-default-35307270:ctest-pod-60050840 2024-08-29 17:51:00,346 - INFO - Deleting pod ctest-new-default-35307270:ctest-pod-26117664 2024-08-29 17:51:00,346 - INFO - Deleting pod ctest-non-default-32834879:ctest-pod-10256889 2024-08-29 17:51:00,347 - INFO - Deleting pod ctest-non-default-32834879:ctest-pod-72440438 2024-08-29 17:51:00,402 - WARNING - Pod uuid d3b6a58d-f153-4a6b-9fa1-a54858c86d83 is still seen in agent 10.0.0.44 VM list 2024-08-29 17:51:00,420 - WARNING - Pod uuid e28d83a6-ab6e-4765-976e-e047098d9190 is still seen in agent 10.0.0.44 VM list 2024-08-29 17:51:00,434 - WARNING - Pod uuid 8220d5fe-a978-45e6-8b5a-6fa5bcb2655a is still seen in agent 10.0.0.44 VM list 2024-08-29 17:51:00,497 - WARNING - Pod uuid c6b9aedf-c48b-4ebe-b438-33bd255ab822 is still seen in agent 10.0.0.44 VM list 2024-08-29 17:51:00,500 - WARNING - Pod uuid fe28c794-852d-4f46-aca2-462652ee0b73 is still seen in agent 10.0.0.44 VM list 2024-08-29 17:51:00,501 - WARNING - Pod uuid 215cd5c6-31d6-4ff9-ad7c-414ca707b517 is still seen in agent 10.0.0.44 VM list 2024-08-29 17:51:00,501 - WARNING - Pod uuid aedc77fa-992c-4ba1-ab71-39238b76749d is still seen in agent 10.0.0.44 VM list 2024-08-29 17:51:00,502 - WARNING - Pod uuid c11f6bb2-1010-4517-8fcc-097965d0ef6b is still seen in agent 10.0.0.44 VM list 2024-08-29 17:51:05,421 - DEBUG - Pod d3b6a58d-f153-4a6b-9fa1-a54858c86d83 is not in agent 10.0.0.44 VM list 2024-08-29 17:51:05,433 - DEBUG - Pod e28d83a6-ab6e-4765-976e-e047098d9190 is not in agent 10.0.0.44 VM list 2024-08-29 17:51:05,440 - DEBUG - VMI c5f26d4a-662e-11ef-9d66-fa163ed67f37 is removed from agent 10.0.0.44 2024-08-29 17:51:05,440 - INFO - Verified that pod ctest-pod-54313053 is removed in agent 2024-08-29 17:51:05,450 - DEBUG - VMI c66ab868-662e-11ef-9d66-fa163ed67f37 is removed from agent 10.0.0.44 2024-08-29 17:51:05,450 - INFO - Verified that pod ctest-pod-45747592 is removed in agent 2024-08-29 17:51:05,451 - DEBUG - Pod 8220d5fe-a978-45e6-8b5a-6fa5bcb2655a is not in agent 10.0.0.44 VM list 2024-08-29 17:51:05,460 - DEBUG - VMI c7851d2e-662e-11ef-9d66-fa163ed67f37 is removed from agent 10.0.0.44 2024-08-29 17:51:05,460 - INFO - Verified that pod ctest-pod-42289409 is removed in agent 2024-08-29 17:51:05,530 - DEBUG - Pod 215cd5c6-31d6-4ff9-ad7c-414ca707b517 is not in agent 10.0.0.44 VM list 2024-08-29 17:51:05,532 - WARNING - Pod uuid c11f6bb2-1010-4517-8fcc-097965d0ef6b is still seen in agent 10.0.0.44 VM list 2024-08-29 17:51:05,532 - WARNING - Pod uuid aedc77fa-992c-4ba1-ab71-39238b76749d is still seen in agent 10.0.0.44 VM list 2024-08-29 17:51:05,532 - WARNING - Pod uuid c6b9aedf-c48b-4ebe-b438-33bd255ab822 is still seen in agent 10.0.0.44 VM list 2024-08-29 17:51:05,532 - WARNING - Pod uuid fe28c794-852d-4f46-aca2-462652ee0b73 is still seen in agent 10.0.0.44 VM list 2024-08-29 17:51:05,538 - DEBUG - VMI c70cb9c4-662e-11ef-9d66-fa163ed67f37 is removed from agent 10.0.0.44 2024-08-29 17:51:05,538 - INFO - Verified that pod ctest-pod-68959783 is removed in agent 2024-08-29 17:51:10,551 - WARNING - Pod uuid c11f6bb2-1010-4517-8fcc-097965d0ef6b is still seen in agent 10.0.0.44 VM list 2024-08-29 17:51:10,553 - WARNING - Pod uuid aedc77fa-992c-4ba1-ab71-39238b76749d is still seen in agent 10.0.0.44 VM list 2024-08-29 17:51:10,553 - WARNING - Pod uuid fe28c794-852d-4f46-aca2-462652ee0b73 is still seen in agent 10.0.0.44 VM list 2024-08-29 17:51:10,554 - WARNING - Pod uuid c6b9aedf-c48b-4ebe-b438-33bd255ab822 is still seen in agent 10.0.0.44 VM list 2024-08-29 17:51:15,572 - WARNING - Pod uuid c11f6bb2-1010-4517-8fcc-097965d0ef6b is still seen in agent 10.0.0.44 VM list 2024-08-29 17:51:15,574 - WARNING - Pod uuid aedc77fa-992c-4ba1-ab71-39238b76749d is still seen in agent 10.0.0.44 VM list 2024-08-29 17:51:15,575 - WARNING - Pod uuid c6b9aedf-c48b-4ebe-b438-33bd255ab822 is still seen in agent 10.0.0.44 VM list 2024-08-29 17:51:15,575 - WARNING - Pod uuid fe28c794-852d-4f46-aca2-462652ee0b73 is still seen in agent 10.0.0.44 VM list 2024-08-29 17:51:20,599 - WARNING - Pod uuid c11f6bb2-1010-4517-8fcc-097965d0ef6b is still seen in agent 10.0.0.44 VM list 2024-08-29 17:51:20,601 - WARNING - Pod uuid aedc77fa-992c-4ba1-ab71-39238b76749d is still seen in agent 10.0.0.44 VM list 2024-08-29 17:51:20,601 - WARNING - Pod uuid c6b9aedf-c48b-4ebe-b438-33bd255ab822 is still seen in agent 10.0.0.44 VM list 2024-08-29 17:51:20,601 - WARNING - Pod uuid fe28c794-852d-4f46-aca2-462652ee0b73 is still seen in agent 10.0.0.44 VM list 2024-08-29 17:51:25,622 - WARNING - Pod uuid c11f6bb2-1010-4517-8fcc-097965d0ef6b is still seen in agent 10.0.0.44 VM list 2024-08-29 17:51:25,623 - WARNING - Pod uuid fe28c794-852d-4f46-aca2-462652ee0b73 is still seen in agent 10.0.0.44 VM list 2024-08-29 17:51:25,625 - WARNING - Pod uuid c6b9aedf-c48b-4ebe-b438-33bd255ab822 is still seen in agent 10.0.0.44 VM list 2024-08-29 17:51:25,625 - WARNING - Pod uuid aedc77fa-992c-4ba1-ab71-39238b76749d is still seen in agent 10.0.0.44 VM list 2024-08-29 17:51:30,653 - WARNING - Pod uuid c6b9aedf-c48b-4ebe-b438-33bd255ab822 is still seen in agent 10.0.0.44 VM list 2024-08-29 17:51:30,654 - WARNING - Pod uuid aedc77fa-992c-4ba1-ab71-39238b76749d is still seen in agent 10.0.0.44 VM list 2024-08-29 17:51:30,654 - WARNING - Pod uuid fe28c794-852d-4f46-aca2-462652ee0b73 is still seen in agent 10.0.0.44 VM list 2024-08-29 17:51:30,654 - WARNING - Pod uuid c11f6bb2-1010-4517-8fcc-097965d0ef6b is still seen in agent 10.0.0.44 VM list 2024-08-29 17:51:35,675 - DEBUG - Pod c6b9aedf-c48b-4ebe-b438-33bd255ab822 is not in agent 10.0.0.44 VM list 2024-08-29 17:51:35,679 - DEBUG - Pod fe28c794-852d-4f46-aca2-462652ee0b73 is not in agent 10.0.0.44 VM list 2024-08-29 17:51:35,680 - DEBUG - Pod c11f6bb2-1010-4517-8fcc-097965d0ef6b is not in agent 10.0.0.44 VM list 2024-08-29 17:51:35,681 - DEBUG - Pod aedc77fa-992c-4ba1-ab71-39238b76749d is not in agent 10.0.0.44 VM list 2024-08-29 17:51:35,713 - DEBUG - VMI c8e9f1f8-662e-11ef-9d66-fa163ed67f37 is removed from agent 10.0.0.44 2024-08-29 17:51:35,713 - INFO - Verified that pod ctest-pod-10256889 is removed in agent 2024-08-29 17:51:35,715 - DEBUG - VMI c80ab524-662e-11ef-9d66-fa163ed67f37 is removed from agent 10.0.0.44 2024-08-29 17:51:35,715 - INFO - Verified that pod ctest-pod-60050840 is removed in agent 2024-08-29 17:51:35,716 - DEBUG - VMI c8743a9e-662e-11ef-9d66-fa163ed67f37 is removed from agent 10.0.0.44 2024-08-29 17:51:35,716 - INFO - Verified that pod ctest-pod-26117664 is removed in agent 2024-08-29 17:51:35,716 - DEBUG - VMI c951ee66-662e-11ef-9d66-fa163ed67f37 is removed from agent 10.0.0.44 2024-08-29 17:51:35,716 - INFO - Verified that pod ctest-pod-72440438 is removed in agent 2024-08-29 17:51:35,716 - INFO - Deleting namespace ctest-non-default-32834879 2024-08-29 17:51:35,733 - DEBUG - Namespace ctest-non-default-32834879 still in k8s 2024-08-29 17:51:37,738 - DEBUG - Namespace ctest-non-default-32834879 still in k8s 2024-08-29 17:51:39,744 - DEBUG - Namespace ctest-non-default-32834879 still in k8s 2024-08-29 17:51:41,748 - DEBUG - Namespace ctest-non-default-32834879 is not in k8s 2024-08-29 17:51:41,748 - DEBUG - No need to check project deletion in contrail-api 2024-08-29 17:51:41,748 - INFO - Deleting namespace ctest-new-default-35307270 2024-08-29 17:51:41,757 - DEBUG - Namespace ctest-new-default-35307270 still in k8s 2024-08-29 17:51:43,762 - DEBUG - Namespace ctest-new-default-35307270 still in k8s 2024-08-29 17:51:45,767 - DEBUG - Namespace ctest-new-default-35307270 still in k8s 2024-08-29 17:51:47,771 - DEBUG - Namespace ctest-new-default-35307270 is not in k8s 2024-08-29 17:51:47,771 - DEBUG - No need to check project deletion in contrail-api