2025-04-18 06:51:02,622 - INFO - Using existing project ['default-domain', 'k8s-default'](a48a5a56-2866-4c84-8d65-18e6324d0f7a) 2025-04-18 06:51:02,643 - DEBUG - Namespace ctest-new-default-90933507 not present 2025-04-18 06:51:02,652 - INFO - Created namespace ctest-new-default-90933507 2025-04-18 06:51:05,658 - DEBUG - Namespace ctest-non-default-47802146 not present 2025-04-18 06:51:05,677 - INFO - Created namespace ctest-non-default-47802146 2025-04-18 06:51:08,702 - DEBUG - Pod ctest-pod-04233725 not present 2025-04-18 06:51:08,703 - INFO - Creating Pod ctest-pod-04233725 2025-04-18 06:51:08,750 - DEBUG - Pod : ctest-pod-04233725 UUID is 1a74ea37-2ce6-49e5-b595-1a0e127c2ec9 2025-04-18 06:51:08,763 - DEBUG - Pod ctest-pod-24836778 not present 2025-04-18 06:51:08,764 - INFO - Creating Pod ctest-pod-24836778 2025-04-18 06:51:08,795 - DEBUG - Pod : ctest-pod-24836778 UUID is 5cbd26c3-6ccf-46ed-ab97-b047c9b65e71 2025-04-18 06:51:08,801 - DEBUG - Pod ctest-pod-55192096 not present 2025-04-18 06:51:08,801 - INFO - Creating Pod ctest-pod-55192096 2025-04-18 06:51:08,870 - DEBUG - Pod : ctest-pod-55192096 UUID is aece510a-e67f-4a62-8423-f1d2669b2794 2025-04-18 06:51:08,882 - DEBUG - Pod ctest-pod-20949203 not present 2025-04-18 06:51:08,882 - INFO - Creating Pod ctest-pod-20949203 2025-04-18 06:51:08,919 - DEBUG - Pod : ctest-pod-20949203 UUID is 654653c2-d87c-4427-a774-989e0a74234b 2025-04-18 06:51:08,924 - DEBUG - Pod ctest-pod-82429413 not present 2025-04-18 06:51:08,924 - INFO - Creating Pod ctest-pod-82429413 2025-04-18 06:51:08,954 - DEBUG - Pod : ctest-pod-82429413 UUID is 5a44ca8f-2c16-441d-a7bb-bd8b08310569 2025-04-18 06:51:08,959 - DEBUG - Pod ctest-pod-73541932 not present 2025-04-18 06:51:08,960 - INFO - Creating Pod ctest-pod-73541932 2025-04-18 06:51:08,998 - DEBUG - Node for Pod ctest-pod-73541932 not yet populated 2025-04-18 06:51:12,007 - DEBUG - Pod : ctest-pod-73541932 UUID is 9ec6896d-f9a0-4694-8097-ecb45434198b 2025-04-18 06:51:12,010 - DEBUG - Pod ctest-pod-79119376 not present 2025-04-18 06:51:12,011 - INFO - Creating Pod ctest-pod-79119376 2025-04-18 06:51:12,045 - DEBUG - Node for Pod ctest-pod-79119376 not yet populated 2025-04-18 06:51:15,059 - DEBUG - Pod : ctest-pod-79119376 UUID is 6a98ad6d-e3d8-4ddd-8b64-11af4c79b5e1 2025-04-18 06:51:15,063 - DEBUG - Pod ctest-pod-13132535 not present 2025-04-18 06:51:15,064 - INFO - Creating Pod ctest-pod-13132535 2025-04-18 06:51:15,096 - DEBUG - Node for Pod ctest-pod-13132535 not yet populated 2025-04-18 06:51:18,105 - DEBUG - Pod : ctest-pod-13132535 UUID is 1798eec3-2976-403f-a3bb-4f212d2ebd79 2025-04-18 06:51:18,424 - INFO - Project default-domain:k8s-ctest-new-default-90933507 for Namespace ctest-new-default-90933507 is seen in contrail-api 2025-04-18 06:51:18,425 - DEBUG - Project uuid in Contrail is f27cbcee-c2c5-41ba-8020-125cd5d3fe40 2025-04-18 06:51:18,577 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NamespaceDatabaseList?namespace_uuid=bcb2c217-3e60-4d30-b76b-734d043c9628 2025-04-18 06:51:18,584 - INFO - Namespace ctest-new-default-90933507 with uuid bcb2c217-3e60-4d30-b76b-734d043c9628 found in kube manager 2025-04-18 06:51:18,584 - INFO - Namespace ctest-new-default-90933507 verification passed 2025-04-18 06:51:18,827 - INFO - Project default-domain:k8s-ctest-non-default-47802146 for Namespace ctest-non-default-47802146 is seen in contrail-api 2025-04-18 06:51:18,827 - DEBUG - Project uuid in Contrail is aa5ef852-5073-469c-b73b-e2b278d470d4 2025-04-18 06:51:18,827 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NamespaceDatabaseList?namespace_uuid=f8b63ae9-64b8-4697-9d72-9f8a039db896 2025-04-18 06:51:18,833 - INFO - Namespace ctest-non-default-47802146 with uuid f8b63ae9-64b8-4697-9d72-9f8a039db896 found in kube manager 2025-04-18 06:51:18,833 - INFO - Namespace ctest-non-default-47802146 verification passed 2025-04-18 06:51:18,843 - INFO - Pod ctest-pod-04233725 is in running state.Got IP 10.47.255.251 2025-04-18 06:51:18,861 - DEBUG - Pod ctest-pod-04233725 has vmi 8380059a-1c21-11f0-8c5f-fa163e0057d2 2025-04-18 06:51:18,861 - INFO - Verified pod ctest-pod-04233725 in contrail-api 2025-04-18 06:51:18,881 - DEBUG - VMI 8380059a-1c21-11f0-8c5f-fa163e0057d2 is active in agent 10.0.0.57 2025-04-18 06:51:18,882 - INFO - Verified Pod ctest-pod-04233725 in agent 10.0.0.57 2025-04-18 06:51:18,882 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=1a74ea37-2ce6-49e5-b595-1a0e127c2ec9 2025-04-18 06:51:18,899 - INFO - Pod ctest-pod-04233725 with uuid 1a74ea37-2ce6-49e5-b595-1a0e127c2ec9 found in kube manager 2025-04-18 06:51:18,900 - INFO - Pod ctest-pod-04233725 verification passed 2025-04-18 06:51:18,912 - DEBUG - Pod ctest-pod-24836778 not in running state.Currently in Pending 2025-04-18 06:51:23,921 - INFO - Pod ctest-pod-24836778 is in running state.Got IP 10.47.255.250 2025-04-18 06:51:23,978 - DEBUG - Pod ctest-pod-24836778 has vmi 843aa47c-1c21-11f0-8c5f-fa163e0057d2 2025-04-18 06:51:23,978 - INFO - Verified pod ctest-pod-24836778 in contrail-api 2025-04-18 06:51:23,992 - DEBUG - VMI 843aa47c-1c21-11f0-8c5f-fa163e0057d2 is active in agent 10.0.0.57 2025-04-18 06:51:23,993 - INFO - Verified Pod ctest-pod-24836778 in agent 10.0.0.57 2025-04-18 06:51:23,993 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=5cbd26c3-6ccf-46ed-ab97-b047c9b65e71 2025-04-18 06:51:23,998 - INFO - Pod ctest-pod-24836778 with uuid 5cbd26c3-6ccf-46ed-ab97-b047c9b65e71 found in kube manager 2025-04-18 06:51:23,998 - INFO - Pod ctest-pod-24836778 verification passed 2025-04-18 06:51:24,008 - INFO - Pod ctest-pod-55192096 is in running state.Got IP 10.47.255.249 2025-04-18 06:51:24,022 - DEBUG - Pod ctest-pod-55192096 has vmi 84fbc580-1c21-11f0-8c5f-fa163e0057d2 2025-04-18 06:51:24,022 - INFO - Verified pod ctest-pod-55192096 in contrail-api 2025-04-18 06:51:24,039 - DEBUG - VMI 84fbc580-1c21-11f0-8c5f-fa163e0057d2 is active in agent 10.0.0.57 2025-04-18 06:51:24,039 - INFO - Verified Pod ctest-pod-55192096 in agent 10.0.0.57 2025-04-18 06:51:24,039 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=aece510a-e67f-4a62-8423-f1d2669b2794 2025-04-18 06:51:24,045 - INFO - Pod ctest-pod-55192096 with uuid aece510a-e67f-4a62-8423-f1d2669b2794 found in kube manager 2025-04-18 06:51:24,046 - INFO - Pod ctest-pod-55192096 verification passed 2025-04-18 06:51:24,053 - INFO - Pod ctest-pod-20949203 is in running state.Got IP 10.47.255.248 2025-04-18 06:51:24,118 - DEBUG - Pod ctest-pod-20949203 has vmi 85a699f6-1c21-11f0-8c5f-fa163e0057d2 2025-04-18 06:51:24,119 - INFO - Verified pod ctest-pod-20949203 in contrail-api 2025-04-18 06:51:24,135 - DEBUG - VMI 85a699f6-1c21-11f0-8c5f-fa163e0057d2 is active in agent 10.0.0.57 2025-04-18 06:51:24,135 - INFO - Verified Pod ctest-pod-20949203 in agent 10.0.0.57 2025-04-18 06:51:24,135 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=654653c2-d87c-4427-a774-989e0a74234b 2025-04-18 06:51:24,141 - INFO - Pod ctest-pod-20949203 with uuid 654653c2-d87c-4427-a774-989e0a74234b found in kube manager 2025-04-18 06:51:24,141 - INFO - Pod ctest-pod-20949203 verification passed 2025-04-18 06:51:24,147 - INFO - Pod ctest-pod-82429413 is in running state.Got IP 10.47.255.247 2025-04-18 06:51:24,206 - DEBUG - Pod ctest-pod-82429413 has vmi 865f41c2-1c21-11f0-8c5f-fa163e0057d2 2025-04-18 06:51:24,206 - INFO - Verified pod ctest-pod-82429413 in contrail-api 2025-04-18 06:51:24,221 - DEBUG - VMI 865f41c2-1c21-11f0-8c5f-fa163e0057d2 is active in agent 10.0.0.57 2025-04-18 06:51:24,222 - INFO - Verified Pod ctest-pod-82429413 in agent 10.0.0.57 2025-04-18 06:51:24,222 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=5a44ca8f-2c16-441d-a7bb-bd8b08310569 2025-04-18 06:51:24,228 - INFO - Pod ctest-pod-82429413 with uuid 5a44ca8f-2c16-441d-a7bb-bd8b08310569 found in kube manager 2025-04-18 06:51:24,228 - INFO - Pod ctest-pod-82429413 verification passed 2025-04-18 06:51:24,234 - INFO - Pod ctest-pod-79119376 is in running state.Got IP 10.47.255.245 2025-04-18 06:51:24,253 - DEBUG - Pod ctest-pod-79119376 has vmi 87927014-1c21-11f0-8c5f-fa163e0057d2 2025-04-18 06:51:24,253 - INFO - Verified pod ctest-pod-79119376 in contrail-api 2025-04-18 06:51:24,268 - DEBUG - VMI 87927014-1c21-11f0-8c5f-fa163e0057d2 is active in agent 10.0.0.57 2025-04-18 06:51:24,268 - INFO - Verified Pod ctest-pod-79119376 in agent 10.0.0.57 2025-04-18 06:51:24,268 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=6a98ad6d-e3d8-4ddd-8b64-11af4c79b5e1 2025-04-18 06:51:24,274 - INFO - Pod ctest-pod-79119376 with uuid 6a98ad6d-e3d8-4ddd-8b64-11af4c79b5e1 found in kube manager 2025-04-18 06:51:24,274 - INFO - Pod ctest-pod-79119376 verification passed 2025-04-18 06:51:24,388 - DEBUG - Pod ctest-pod-73541932 not in running state.Currently in Pending 2025-04-18 06:51:29,405 - INFO - Pod ctest-pod-73541932 is in running state.Got IP 10.47.255.246 2025-04-18 06:51:29,474 - DEBUG - Pod ctest-pod-73541932 has vmi 86e5605e-1c21-11f0-8c5f-fa163e0057d2 2025-04-18 06:51:29,474 - INFO - Verified pod ctest-pod-73541932 in contrail-api 2025-04-18 06:51:29,490 - DEBUG - VMI 86e5605e-1c21-11f0-8c5f-fa163e0057d2 is active in agent 10.0.0.57 2025-04-18 06:51:29,491 - INFO - Verified Pod ctest-pod-73541932 in agent 10.0.0.57 2025-04-18 06:51:29,491 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=9ec6896d-f9a0-4694-8097-ecb45434198b 2025-04-18 06:51:29,496 - INFO - Pod ctest-pod-73541932 with uuid 9ec6896d-f9a0-4694-8097-ecb45434198b found in kube manager 2025-04-18 06:51:29,496 - INFO - Pod ctest-pod-73541932 verification passed 2025-04-18 06:51:29,503 - INFO - Pod ctest-pod-13132535 is in running state.Got IP 10.47.255.244 2025-04-18 06:51:29,518 - DEBUG - Pod ctest-pod-13132535 has vmi 884cccca-1c21-11f0-8c5f-fa163e0057d2 2025-04-18 06:51:29,518 - INFO - Verified pod ctest-pod-13132535 in contrail-api 2025-04-18 06:51:29,532 - DEBUG - VMI 884cccca-1c21-11f0-8c5f-fa163e0057d2 is active in agent 10.0.0.57 2025-04-18 06:51:29,532 - INFO - Verified Pod ctest-pod-13132535 in agent 10.0.0.57 2025-04-18 06:51:29,532 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=1798eec3-2976-403f-a3bb-4f212d2ebd79 2025-04-18 06:51:29,538 - INFO - Pod ctest-pod-13132535 with uuid 1798eec3-2976-403f-a3bb-4f212d2ebd79 found in kube manager 2025-04-18 06:51:29,538 - INFO - Pod ctest-pod-13132535 verification passed 2025-04-18 06:51:29,538 - INFO - ================================================================================ 2025-04-18 06:51:29,539 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-04-18 06:51:29,539 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-04-18 06:51:29,776 - DEBUG - Nothing to compare xmpp stats {'10.0.0.57': {'10.0.0.48': '0'}} with 2025-04-18 06:51:29,776 - INFO - Initial checks done. Running the testcase now 2025-04-18 06:51:29,776 - INFO - 2025-04-18 06:51:29,831 - DEBUG - [Pod ctest-pod-04233725] Cmd: echo ctest-pod-04233725 > /usr/share/nginx/html/index.html, Output: 2025-04-18 06:51:29,892 - DEBUG - [Pod ctest-pod-24836778] Cmd: echo ctest-pod-24836778 > /usr/share/nginx/html/index.html, Output: 2025-04-18 06:51:29,952 - DEBUG - [Pod ctest-pod-55192096] Cmd: echo ctest-pod-55192096 > /usr/share/nginx/html/index.html, Output: 2025-04-18 06:51:30,007 - DEBUG - [Pod ctest-pod-20949203] Cmd: echo ctest-pod-20949203 > /usr/share/nginx/html/index.html, Output: 2025-04-18 06:51:30,011 - DEBUG - Service ctest-nginx-svc-67090916 not present 2025-04-18 06:51:30,012 - INFO - Creating service ctest-nginx-svc-67090916 2025-04-18 06:51:30,027 - INFO - Created Service ctest-nginx-svc-67090916 2025-04-18 06:51:30,033 - WARNING - Service UUID e7131dc8-2dfb-4ad6-9739-be1a63bdb2c8 not yet found in contrail-api 2025-04-18 06:51:31,043 - INFO - Validated that Service ctest-nginx-svc-67090916 is seen in contrail-api 2025-04-18 06:51:31,044 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_LoadbalancerDatabaseList?x=e7131dc8-2dfb-4ad6-9739-be1a63bdb2c8 2025-04-18 06:51:31,050 - INFO - Service ctest-nginx-svc-67090916 with uuid e7131dc8-2dfb-4ad6-9739-be1a63bdb2c8 found in kube manager 2025-04-18 06:51:31,050 - INFO - Service ctest-nginx-svc-67090916 verification passed 2025-04-18 06:51:32,116 - DEBUG - [Pod ctest-pod-82429413] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.10.248:80 (10.109.10.248:80) ctest-pod-04233725 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-18 06:51:32,116 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 passed 2025-04-18 06:51:32,116 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd output: Connecting to 10.109.10.248:80 (10.109.10.248:80) ctest-pod-04233725 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-18 06:51:32,185 - DEBUG - [Pod ctest-pod-82429413] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.10.248:80 (10.109.10.248:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-24836778 2025-04-18 06:51:32,186 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 passed 2025-04-18 06:51:32,186 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd output: Connecting to 10.109.10.248:80 (10.109.10.248:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-24836778 2025-04-18 06:51:32,186 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-04233725': 1, 'ctest-pod-24836778': 1} 2025-04-18 06:51:32,245 - DEBUG - [Pod ctest-pod-79119376] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.10.248:80 (10.109.10.248:80) ctest-pod-04233725 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-18 06:51:32,245 - DEBUG - [Pod Pod ctest-pod-79119376] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 passed 2025-04-18 06:51:32,245 - DEBUG - [Pod Pod ctest-pod-79119376] Cmd output: Connecting to 10.109.10.248:80 (10.109.10.248:80) ctest-pod-04233725 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-18 06:51:32,299 - DEBUG - [Pod ctest-pod-79119376] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.10.248:80 (10.109.10.248:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-04233725 2025-04-18 06:51:32,299 - DEBUG - [Pod Pod ctest-pod-79119376] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 passed 2025-04-18 06:51:32,299 - DEBUG - [Pod Pod ctest-pod-79119376] Cmd output: Connecting to 10.109.10.248:80 (10.109.10.248:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-04233725 2025-04-18 06:51:32,361 - DEBUG - [Pod ctest-pod-79119376] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: ctest-pod-04233725 Connecting to 10.109.10.248:80 (10.109.10.248:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-18 06:51:32,361 - DEBUG - [Pod Pod ctest-pod-79119376] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 passed 2025-04-18 06:51:32,361 - DEBUG - [Pod Pod ctest-pod-79119376] Cmd output: ctest-pod-04233725 Connecting to 10.109.10.248:80 (10.109.10.248:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-18 06:51:32,419 - DEBUG - [Pod ctest-pod-79119376] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.10.248:80 (10.109.10.248:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-24836778 2025-04-18 06:51:32,419 - DEBUG - [Pod Pod ctest-pod-79119376] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 passed 2025-04-18 06:51:32,419 - DEBUG - [Pod Pod ctest-pod-79119376] Cmd output: Connecting to 10.109.10.248:80 (10.109.10.248:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-24836778 2025-04-18 06:51:32,419 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-04233725': 3, 'ctest-pod-24836778': 1} 2025-04-18 06:51:32,423 - DEBUG - Network policy ingress-on-service not present 2025-04-18 06:51:32,424 - INFO - Creating Network Policy ingress-on-service 2025-04-18 06:51:32,446 - INFO - Network policy found in k8s 2025-04-18 06:51:32,446 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=cdecdbd6-e2f6-48ca-a1ea-ea2a2ce73694 2025-04-18 06:51:32,453 - INFO - Network Policy ingress-on-service with uuid cdecdbd6-e2f6-48ca-a1ea-ea2a2ce73694 found in kube manager 2025-04-18 06:51:32,488 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-04-18 06:51:32,488 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-04-18 06:51:32,489 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=cdecdbd6-e2f6-48ca-a1ea-ea2a2ce73694 2025-04-18 06:51:32,527 - WARNING - Network policy with name ingress-on-service not found in agent 2025-04-18 06:51:34,528 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=cdecdbd6-e2f6-48ca-a1ea-ea2a2ce73694 2025-04-18 06:51:34,570 - INFO - Network policy with name ingress-on-service found in agent 2025-04-18 06:51:34,571 - INFO - Network Policy ingress-on-service verification passed 2025-04-18 06:51:39,627 - DEBUG - [Pod ctest-pod-82429413] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:51:39,628 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:51:39,628 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:51:44,684 - DEBUG - [Pod ctest-pod-82429413] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:51:44,684 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:51:44,684 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:51:49,739 - DEBUG - [Pod ctest-pod-82429413] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:51:49,739 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:51:49,739 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:51:54,787 - DEBUG - [Pod ctest-pod-82429413] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:51:54,787 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:51:54,787 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:51:59,841 - DEBUG - [Pod ctest-pod-82429413] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:51:59,841 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:51:59,841 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:52:04,892 - DEBUG - [Pod ctest-pod-82429413] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:52:04,892 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:52:04,892 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:52:09,945 - DEBUG - [Pod ctest-pod-82429413] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:52:09,945 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:52:09,945 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:52:14,999 - DEBUG - [Pod ctest-pod-82429413] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:52:14,999 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:52:14,999 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:52:20,059 - DEBUG - [Pod ctest-pod-82429413] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:52:20,059 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:52:20,059 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:52:25,109 - DEBUG - [Pod ctest-pod-82429413] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:52:25,109 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:52:25,109 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:52:25,109 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-04233725': 0, 'ctest-pod-24836778': 0} 2025-04-18 06:52:25,172 - DEBUG - [Pod ctest-pod-73541932] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: ctest-pod-04233725 Connecting to 10.109.10.248:80 (10.109.10.248:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-18 06:52:25,172 - DEBUG - [Pod Pod ctest-pod-73541932] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 passed 2025-04-18 06:52:25,172 - DEBUG - [Pod Pod ctest-pod-73541932] Cmd output: ctest-pod-04233725 Connecting to 10.109.10.248:80 (10.109.10.248:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-18 06:52:25,226 - DEBUG - [Pod ctest-pod-73541932] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: ctest-pod-04233725 Connecting to 10.109.10.248:80 (10.109.10.248:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-18 06:52:25,226 - DEBUG - [Pod Pod ctest-pod-73541932] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 passed 2025-04-18 06:52:25,227 - DEBUG - [Pod Pod ctest-pod-73541932] Cmd output: ctest-pod-04233725 Connecting to 10.109.10.248:80 (10.109.10.248:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-18 06:52:25,277 - DEBUG - [Pod ctest-pod-73541932] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: ctest-pod-24836778 Connecting to 10.109.10.248:80 (10.109.10.248:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-18 06:52:25,277 - DEBUG - [Pod Pod ctest-pod-73541932] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 passed 2025-04-18 06:52:25,277 - DEBUG - [Pod Pod ctest-pod-73541932] Cmd output: ctest-pod-24836778 Connecting to 10.109.10.248:80 (10.109.10.248:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-18 06:52:25,277 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-04233725': 2, 'ctest-pod-24836778': 1} 2025-04-18 06:52:30,332 - DEBUG - [Pod ctest-pod-79119376] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:52:30,332 - DEBUG - [Pod Pod ctest-pod-79119376] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:52:30,332 - DEBUG - [Pod Pod ctest-pod-79119376] Cmd output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:52:35,401 - DEBUG - [Pod ctest-pod-79119376] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:52:35,401 - DEBUG - [Pod Pod ctest-pod-79119376] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:52:35,401 - DEBUG - [Pod Pod ctest-pod-79119376] Cmd output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:52:40,452 - DEBUG - [Pod ctest-pod-79119376] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:52:40,452 - DEBUG - [Pod Pod ctest-pod-79119376] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:52:40,452 - DEBUG - [Pod Pod ctest-pod-79119376] Cmd output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:52:45,500 - DEBUG - [Pod ctest-pod-79119376] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:52:45,500 - DEBUG - [Pod Pod ctest-pod-79119376] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:52:45,501 - DEBUG - [Pod Pod ctest-pod-79119376] Cmd output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:52:50,551 - DEBUG - [Pod ctest-pod-79119376] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:52:50,551 - DEBUG - [Pod Pod ctest-pod-79119376] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:52:50,551 - DEBUG - [Pod Pod ctest-pod-79119376] Cmd output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:52:55,608 - DEBUG - [Pod ctest-pod-79119376] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:52:55,608 - DEBUG - [Pod Pod ctest-pod-79119376] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:52:55,608 - DEBUG - [Pod Pod ctest-pod-79119376] Cmd output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:53:00,659 - DEBUG - [Pod ctest-pod-79119376] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:53:00,659 - DEBUG - [Pod Pod ctest-pod-79119376] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:53:00,659 - DEBUG - [Pod Pod ctest-pod-79119376] Cmd output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:53:05,712 - DEBUG - [Pod ctest-pod-79119376] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:53:05,713 - DEBUG - [Pod Pod ctest-pod-79119376] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:53:05,713 - DEBUG - [Pod Pod ctest-pod-79119376] Cmd output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:53:10,764 - DEBUG - [Pod ctest-pod-79119376] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:53:10,765 - DEBUG - [Pod Pod ctest-pod-79119376] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:53:10,765 - DEBUG - [Pod Pod ctest-pod-79119376] Cmd output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:53:15,816 - DEBUG - [Pod ctest-pod-79119376] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:53:15,816 - DEBUG - [Pod Pod ctest-pod-79119376] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:53:15,816 - DEBUG - [Pod Pod ctest-pod-79119376] Cmd output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:53:15,816 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-04233725': 0, 'ctest-pod-24836778': 0} 2025-04-18 06:53:17,875 - DEBUG - [Pod ctest-pod-73541932] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.027 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.078 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.077 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.077/0.394/1.027 ms 2025-04-18 06:53:17,876 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-73541932 with expectation True passed 2025-04-18 06:53:19,929 - DEBUG - [Pod ctest-pod-82429413] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.013 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.077 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.080 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.077/0.390/1.013 ms 2025-04-18 06:53:19,929 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-82429413 with expectation True passed 2025-04-18 06:53:21,984 - DEBUG - [Pod ctest-pod-79119376] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.587 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.085 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.081 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.081/0.584/1.587 ms 2025-04-18 06:53:21,985 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-79119376 with expectation True passed 2025-04-18 06:53:22,039 - DEBUG - [Pod ctest-pod-73541932] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-18 06:53:22,039 - DEBUG - [Pod Pod ctest-pod-73541932] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-04-18 06:53:22,039 - DEBUG - [Pod Pod ctest-pod-73541932] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-18 06:53:22,039 - INFO - wget check of of http://10.47.255.251 from ctest-pod-73541932 passed 2025-04-18 06:53:22,089 - DEBUG - [Pod ctest-pod-73541932] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-18 06:53:22,089 - DEBUG - [Pod Pod ctest-pod-73541932] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-04-18 06:53:22,089 - DEBUG - [Pod Pod ctest-pod-73541932] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-18 06:53:22,089 - INFO - wget check of of http://10.47.255.250 from ctest-pod-73541932 passed 2025-04-18 06:53:27,145 - DEBUG - [Pod ctest-pod-82429413] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-04-18 06:53:27,146 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-04-18 06:53:27,146 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-04-18 06:53:27,146 - INFO - wget check of of http://10.47.255.250 from ctest-pod-82429413 passed 2025-04-18 06:53:32,199 - DEBUG - [Pod ctest-pod-13132535] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-04-18 06:53:32,199 - DEBUG - [Pod Pod ctest-pod-13132535] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-04-18 06:53:32,199 - DEBUG - [Pod Pod ctest-pod-13132535] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-04-18 06:53:32,199 - INFO - wget check of of http://10.47.255.251 from ctest-pod-13132535 passed 2025-04-18 06:53:32,227 - INFO - Updating Network Policy ingress-on-service 2025-04-18 06:53:37,292 - DEBUG - [Pod ctest-pod-82429413] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:53:37,292 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:53:37,292 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:53:42,340 - DEBUG - [Pod ctest-pod-82429413] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:53:42,340 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:53:42,340 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:53:47,400 - DEBUG - [Pod ctest-pod-82429413] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:53:47,400 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:53:47,400 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:53:52,451 - DEBUG - [Pod ctest-pod-82429413] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:53:52,451 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:53:52,451 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:53:57,505 - DEBUG - [Pod ctest-pod-82429413] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:53:57,505 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:53:57,505 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:54:02,560 - DEBUG - [Pod ctest-pod-82429413] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:54:02,560 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:54:02,560 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:54:07,629 - DEBUG - [Pod ctest-pod-82429413] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:54:07,629 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:54:07,629 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:54:12,683 - DEBUG - [Pod ctest-pod-82429413] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:54:12,683 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:54:12,683 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:54:13,632 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2025-04-18 06:54:23,689 - DEBUG - [Pod ctest-pod-82429413] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:54:23,689 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:54:23,689 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:54:28,735 - DEBUG - [Pod ctest-pod-82429413] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:54:28,735 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:54:28,735 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd output: Connecting to 10.109.10.248:80 (10.109.10.248:80) wget: download timed out 2025-04-18 06:54:28,735 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-04233725': 0, 'ctest-pod-24836778': 0} 2025-04-18 06:54:28,787 - DEBUG - [Pod ctest-pod-73541932] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: ctest-pod-24836778 Connecting to 10.109.10.248:80 (10.109.10.248:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-18 06:54:28,787 - DEBUG - [Pod Pod ctest-pod-73541932] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 passed 2025-04-18 06:54:28,787 - DEBUG - [Pod Pod ctest-pod-73541932] Cmd output: ctest-pod-24836778 Connecting to 10.109.10.248:80 (10.109.10.248:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-18 06:54:28,837 - DEBUG - [Pod ctest-pod-73541932] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: ctest-pod-24836778 Connecting to 10.109.10.248:80 (10.109.10.248:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-18 06:54:28,837 - DEBUG - [Pod Pod ctest-pod-73541932] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 passed 2025-04-18 06:54:28,837 - DEBUG - [Pod Pod ctest-pod-73541932] Cmd output: ctest-pod-24836778 Connecting to 10.109.10.248:80 (10.109.10.248:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-18 06:54:28,895 - DEBUG - [Pod ctest-pod-73541932] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: ctest-pod-24836778 Connecting to 10.109.10.248:80 (10.109.10.248:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-18 06:54:28,896 - DEBUG - [Pod Pod ctest-pod-73541932] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 passed 2025-04-18 06:54:28,896 - DEBUG - [Pod Pod ctest-pod-73541932] Cmd output: ctest-pod-24836778 Connecting to 10.109.10.248:80 (10.109.10.248:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-18 06:54:28,944 - DEBUG - [Pod ctest-pod-73541932] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.10.248:80 (10.109.10.248:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-24836778 2025-04-18 06:54:28,944 - DEBUG - [Pod Pod ctest-pod-73541932] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 passed 2025-04-18 06:54:28,944 - DEBUG - [Pod Pod ctest-pod-73541932] Cmd output: Connecting to 10.109.10.248:80 (10.109.10.248:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-24836778 2025-04-18 06:54:28,997 - DEBUG - [Pod ctest-pod-73541932] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: ctest-pod-04233725 Connecting to 10.109.10.248:80 (10.109.10.248:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-18 06:54:28,997 - DEBUG - [Pod Pod ctest-pod-73541932] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 passed 2025-04-18 06:54:28,997 - DEBUG - [Pod Pod ctest-pod-73541932] Cmd output: ctest-pod-04233725 Connecting to 10.109.10.248:80 (10.109.10.248:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-18 06:54:28,997 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-04233725': 1, 'ctest-pod-24836778': 4} 2025-04-18 06:54:29,057 - DEBUG - [Pod ctest-pod-79119376] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.10.248:80 (10.109.10.248:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-04233725 2025-04-18 06:54:29,057 - DEBUG - [Pod Pod ctest-pod-79119376] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 passed 2025-04-18 06:54:29,057 - DEBUG - [Pod Pod ctest-pod-79119376] Cmd output: Connecting to 10.109.10.248:80 (10.109.10.248:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-04233725 2025-04-18 06:54:29,113 - DEBUG - [Pod ctest-pod-79119376] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: ctest-pod-04233725 Connecting to 10.109.10.248:80 (10.109.10.248:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-18 06:54:29,113 - DEBUG - [Pod Pod ctest-pod-79119376] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 passed 2025-04-18 06:54:29,113 - DEBUG - [Pod Pod ctest-pod-79119376] Cmd output: ctest-pod-04233725 Connecting to 10.109.10.248:80 (10.109.10.248:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-18 06:54:29,172 - DEBUG - [Pod ctest-pod-79119376] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: ctest-pod-04233725 Connecting to 10.109.10.248:80 (10.109.10.248:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-18 06:54:29,172 - DEBUG - [Pod Pod ctest-pod-79119376] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 passed 2025-04-18 06:54:29,172 - DEBUG - [Pod Pod ctest-pod-79119376] Cmd output: ctest-pod-04233725 Connecting to 10.109.10.248:80 (10.109.10.248:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-18 06:54:29,231 - DEBUG - [Pod ctest-pod-79119376] Cmd: wget http://10.109.10.248:80/ -O - -T 5 -t 1 , Output: ctest-pod-24836778 Connecting to 10.109.10.248:80 (10.109.10.248:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-18 06:54:29,231 - DEBUG - [Pod Pod ctest-pod-79119376] Cmd wget http://10.109.10.248:80/ -O - -T 5 -t 1 passed 2025-04-18 06:54:29,231 - DEBUG - [Pod Pod ctest-pod-79119376] Cmd output: ctest-pod-24836778 Connecting to 10.109.10.248:80 (10.109.10.248:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-18 06:54:29,231 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-04233725': 3, 'ctest-pod-24836778': 1} 2025-04-18 06:54:31,279 - DEBUG - [Pod ctest-pod-73541932] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.008 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.084 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.077 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.077/0.389/1.008 ms 2025-04-18 06:54:31,279 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-73541932 with expectation True passed 2025-04-18 06:54:33,337 - DEBUG - [Pod ctest-pod-82429413] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.655 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.076 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.089 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.076/0.606/1.655 ms 2025-04-18 06:54:33,337 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-82429413 with expectation True passed 2025-04-18 06:54:35,391 - DEBUG - [Pod ctest-pod-79119376] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.596 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.073 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.095 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.073/0.254/0.596 ms 2025-04-18 06:54:35,391 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-79119376 with expectation True passed 2025-04-18 06:54:35,456 - DEBUG - [Pod ctest-pod-73541932] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-18 06:54:35,456 - DEBUG - [Pod Pod ctest-pod-73541932] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-04-18 06:54:35,456 - DEBUG - [Pod Pod ctest-pod-73541932] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-18 06:54:35,456 - INFO - wget check of of http://10.47.255.251 from ctest-pod-73541932 passed 2025-04-18 06:54:35,522 - DEBUG - [Pod ctest-pod-73541932] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-18 06:54:35,522 - DEBUG - [Pod Pod ctest-pod-73541932] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-04-18 06:54:35,522 - DEBUG - [Pod Pod ctest-pod-73541932] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-18 06:54:35,522 - INFO - wget check of of http://10.47.255.250 from ctest-pod-73541932 passed 2025-04-18 06:54:40,581 - DEBUG - [Pod ctest-pod-82429413] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-04-18 06:54:40,581 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-04-18 06:54:40,581 - DEBUG - [Pod Pod ctest-pod-82429413] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-04-18 06:54:40,581 - INFO - wget check of of http://10.47.255.250 from ctest-pod-82429413 passed 2025-04-18 06:54:40,643 - DEBUG - [Pod ctest-pod-13132535] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-18 06:54:40,643 - DEBUG - [Pod Pod ctest-pod-13132535] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-04-18 06:54:40,643 - DEBUG - [Pod Pod ctest-pod-13132535] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-18 06:54:40,643 - INFO - wget check of of http://10.47.255.251 from ctest-pod-13132535 passed 2025-04-18 06:54:40,643 - INFO - Deleting Network Policy : ingress-on-service 2025-04-18 06:54:40,644 - INFO - Deleting service : ctest-nginx-svc-67090916 2025-04-18 06:54:40,912 - DEBUG - No XMPP flaps were noticed during the test 2025-04-18 06:54:40,913 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:11] 2025-04-18 06:54:40,913 - INFO - -------------------------------------------------------------------------------- 2025-04-18 06:54:40,919 - INFO - Deleting pod ctest-new-default-90933507:ctest-pod-04233725 2025-04-18 06:54:40,919 - INFO - Deleting pod ctest-new-default-90933507:ctest-pod-24836778 2025-04-18 06:54:40,920 - INFO - Deleting pod ctest-non-default-47802146:ctest-pod-55192096 2025-04-18 06:54:40,920 - INFO - Deleting pod ctest-non-default-47802146:ctest-pod-20949203 2025-04-18 06:54:40,920 - INFO - Deleting pod ctest-new-default-90933507:ctest-pod-82429413 2025-04-18 06:54:40,920 - INFO - Deleting pod ctest-new-default-90933507:ctest-pod-73541932 2025-04-18 06:54:40,921 - INFO - Deleting pod ctest-non-default-47802146:ctest-pod-79119376 2025-04-18 06:54:40,921 - INFO - Deleting pod ctest-non-default-47802146:ctest-pod-13132535 2025-04-18 06:54:41,030 - WARNING - Pod uuid 1a74ea37-2ce6-49e5-b595-1a0e127c2ec9 is still seen in agent 10.0.0.57 VM list 2025-04-18 06:54:41,036 - WARNING - Pod uuid 6a98ad6d-e3d8-4ddd-8b64-11af4c79b5e1 is still seen in agent 10.0.0.57 VM list 2025-04-18 06:54:41,037 - WARNING - Pod uuid 1798eec3-2976-403f-a3bb-4f212d2ebd79 is still seen in agent 10.0.0.57 VM list 2025-04-18 06:54:41,075 - WARNING - Pod uuid 9ec6896d-f9a0-4694-8097-ecb45434198b is still seen in agent 10.0.0.57 VM list 2025-04-18 06:54:41,075 - WARNING - Pod uuid aece510a-e67f-4a62-8423-f1d2669b2794 is still seen in agent 10.0.0.57 VM list 2025-04-18 06:54:41,076 - WARNING - Pod uuid 5cbd26c3-6ccf-46ed-ab97-b047c9b65e71 is still seen in agent 10.0.0.57 VM list 2025-04-18 06:54:41,077 - WARNING - Pod uuid 5a44ca8f-2c16-441d-a7bb-bd8b08310569 is still seen in agent 10.0.0.57 VM list 2025-04-18 06:54:41,077 - WARNING - Pod uuid 654653c2-d87c-4427-a774-989e0a74234b is still seen in agent 10.0.0.57 VM list 2025-04-18 06:54:46,042 - DEBUG - Pod 1a74ea37-2ce6-49e5-b595-1a0e127c2ec9 is not in agent 10.0.0.57 VM list 2025-04-18 06:54:46,054 - WARNING - Pod uuid 6a98ad6d-e3d8-4ddd-8b64-11af4c79b5e1 is still seen in agent 10.0.0.57 VM list 2025-04-18 06:54:46,055 - DEBUG - VMI 8380059a-1c21-11f0-8c5f-fa163e0057d2 is removed from agent 10.0.0.57 2025-04-18 06:54:46,055 - INFO - Verified that pod ctest-pod-04233725 is removed in agent 2025-04-18 06:54:46,056 - WARNING - Pod uuid 1798eec3-2976-403f-a3bb-4f212d2ebd79 is still seen in agent 10.0.0.57 VM list 2025-04-18 06:54:46,108 - WARNING - Pod uuid 5a44ca8f-2c16-441d-a7bb-bd8b08310569 is still seen in agent 10.0.0.57 VM list 2025-04-18 06:54:46,108 - DEBUG - Pod 5cbd26c3-6ccf-46ed-ab97-b047c9b65e71 is not in agent 10.0.0.57 VM list 2025-04-18 06:54:46,110 - DEBUG - Pod aece510a-e67f-4a62-8423-f1d2669b2794 is not in agent 10.0.0.57 VM list 2025-04-18 06:54:46,112 - WARNING - Pod uuid 9ec6896d-f9a0-4694-8097-ecb45434198b is still seen in agent 10.0.0.57 VM list 2025-04-18 06:54:46,113 - DEBUG - Pod 654653c2-d87c-4427-a774-989e0a74234b is not in agent 10.0.0.57 VM list 2025-04-18 06:54:46,128 - DEBUG - VMI 85a699f6-1c21-11f0-8c5f-fa163e0057d2 is removed from agent 10.0.0.57 2025-04-18 06:54:46,128 - INFO - Verified that pod ctest-pod-20949203 is removed in agent 2025-04-18 06:54:46,129 - DEBUG - VMI 84fbc580-1c21-11f0-8c5f-fa163e0057d2 is removed from agent 10.0.0.57 2025-04-18 06:54:46,130 - INFO - Verified that pod ctest-pod-55192096 is removed in agent 2025-04-18 06:54:46,131 - DEBUG - VMI 843aa47c-1c21-11f0-8c5f-fa163e0057d2 is removed from agent 10.0.0.57 2025-04-18 06:54:46,131 - INFO - Verified that pod ctest-pod-24836778 is removed in agent 2025-04-18 06:54:51,067 - WARNING - Pod uuid 1798eec3-2976-403f-a3bb-4f212d2ebd79 is still seen in agent 10.0.0.57 VM list 2025-04-18 06:54:51,068 - WARNING - Pod uuid 6a98ad6d-e3d8-4ddd-8b64-11af4c79b5e1 is still seen in agent 10.0.0.57 VM list 2025-04-18 06:54:51,118 - WARNING - Pod uuid 5a44ca8f-2c16-441d-a7bb-bd8b08310569 is still seen in agent 10.0.0.57 VM list 2025-04-18 06:54:51,123 - WARNING - Pod uuid 9ec6896d-f9a0-4694-8097-ecb45434198b is still seen in agent 10.0.0.57 VM list 2025-04-18 06:54:56,087 - WARNING - Pod uuid 6a98ad6d-e3d8-4ddd-8b64-11af4c79b5e1 is still seen in agent 10.0.0.57 VM list 2025-04-18 06:54:56,088 - WARNING - Pod uuid 1798eec3-2976-403f-a3bb-4f212d2ebd79 is still seen in agent 10.0.0.57 VM list 2025-04-18 06:54:56,128 - WARNING - Pod uuid 5a44ca8f-2c16-441d-a7bb-bd8b08310569 is still seen in agent 10.0.0.57 VM list 2025-04-18 06:54:56,134 - WARNING - Pod uuid 9ec6896d-f9a0-4694-8097-ecb45434198b is still seen in agent 10.0.0.57 VM list 2025-04-18 06:55:01,104 - WARNING - Pod uuid 6a98ad6d-e3d8-4ddd-8b64-11af4c79b5e1 is still seen in agent 10.0.0.57 VM list 2025-04-18 06:55:01,104 - WARNING - Pod uuid 1798eec3-2976-403f-a3bb-4f212d2ebd79 is still seen in agent 10.0.0.57 VM list 2025-04-18 06:55:01,140 - WARNING - Pod uuid 5a44ca8f-2c16-441d-a7bb-bd8b08310569 is still seen in agent 10.0.0.57 VM list 2025-04-18 06:55:01,147 - WARNING - Pod uuid 9ec6896d-f9a0-4694-8097-ecb45434198b is still seen in agent 10.0.0.57 VM list 2025-04-18 06:55:06,117 - WARNING - Pod uuid 6a98ad6d-e3d8-4ddd-8b64-11af4c79b5e1 is still seen in agent 10.0.0.57 VM list 2025-04-18 06:55:06,119 - WARNING - Pod uuid 1798eec3-2976-403f-a3bb-4f212d2ebd79 is still seen in agent 10.0.0.57 VM list 2025-04-18 06:55:06,150 - WARNING - Pod uuid 5a44ca8f-2c16-441d-a7bb-bd8b08310569 is still seen in agent 10.0.0.57 VM list 2025-04-18 06:55:06,156 - WARNING - Pod uuid 9ec6896d-f9a0-4694-8097-ecb45434198b is still seen in agent 10.0.0.57 VM list 2025-04-18 06:55:11,135 - WARNING - Pod uuid 1798eec3-2976-403f-a3bb-4f212d2ebd79 is still seen in agent 10.0.0.57 VM list 2025-04-18 06:55:11,136 - WARNING - Pod uuid 6a98ad6d-e3d8-4ddd-8b64-11af4c79b5e1 is still seen in agent 10.0.0.57 VM list 2025-04-18 06:55:11,161 - WARNING - Pod uuid 5a44ca8f-2c16-441d-a7bb-bd8b08310569 is still seen in agent 10.0.0.57 VM list 2025-04-18 06:55:11,167 - WARNING - Pod uuid 9ec6896d-f9a0-4694-8097-ecb45434198b is still seen in agent 10.0.0.57 VM list 2025-04-18 06:55:16,148 - DEBUG - Pod 6a98ad6d-e3d8-4ddd-8b64-11af4c79b5e1 is not in agent 10.0.0.57 VM list 2025-04-18 06:55:16,151 - DEBUG - Pod 1798eec3-2976-403f-a3bb-4f212d2ebd79 is not in agent 10.0.0.57 VM list 2025-04-18 06:55:16,159 - DEBUG - VMI 87927014-1c21-11f0-8c5f-fa163e0057d2 is removed from agent 10.0.0.57 2025-04-18 06:55:16,159 - INFO - Verified that pod ctest-pod-79119376 is removed in agent 2025-04-18 06:55:16,161 - DEBUG - VMI 884cccca-1c21-11f0-8c5f-fa163e0057d2 is removed from agent 10.0.0.57 2025-04-18 06:55:16,161 - INFO - Verified that pod ctest-pod-13132535 is removed in agent 2025-04-18 06:55:16,168 - DEBUG - Pod 5a44ca8f-2c16-441d-a7bb-bd8b08310569 is not in agent 10.0.0.57 VM list 2025-04-18 06:55:16,182 - DEBUG - VMI 865f41c2-1c21-11f0-8c5f-fa163e0057d2 is removed from agent 10.0.0.57 2025-04-18 06:55:16,182 - INFO - Verified that pod ctest-pod-82429413 is removed in agent 2025-04-18 06:55:16,184 - DEBUG - Pod 9ec6896d-f9a0-4694-8097-ecb45434198b is not in agent 10.0.0.57 VM list 2025-04-18 06:55:16,192 - DEBUG - VMI 86e5605e-1c21-11f0-8c5f-fa163e0057d2 is removed from agent 10.0.0.57 2025-04-18 06:55:16,193 - INFO - Verified that pod ctest-pod-73541932 is removed in agent 2025-04-18 06:55:16,193 - INFO - Deleting namespace ctest-non-default-47802146 2025-04-18 06:55:16,207 - DEBUG - Namespace ctest-non-default-47802146 still in k8s 2025-04-18 06:55:18,213 - DEBUG - Namespace ctest-non-default-47802146 still in k8s 2025-04-18 06:55:20,222 - DEBUG - Namespace ctest-non-default-47802146 still in k8s 2025-04-18 06:55:22,232 - DEBUG - Namespace ctest-non-default-47802146 is not in k8s 2025-04-18 06:55:22,232 - DEBUG - No need to check project deletion in contrail-api 2025-04-18 06:55:22,232 - INFO - Deleting namespace ctest-new-default-90933507 2025-04-18 06:55:22,266 - DEBUG - Namespace ctest-new-default-90933507 still in k8s 2025-04-18 06:55:24,272 - DEBUG - Namespace ctest-new-default-90933507 still in k8s 2025-04-18 06:55:26,281 - DEBUG - Namespace ctest-new-default-90933507 still in k8s 2025-04-18 06:55:28,286 - DEBUG - Namespace ctest-new-default-90933507 is not in k8s 2025-04-18 06:55:28,286 - DEBUG - No need to check project deletion in contrail-api