2025-03-24 20:59:48,159 - INFO - Using existing project ['default-domain', 'k8s-default'](6f9b7dc7-9d53-42bb-9202-47f9c8df8e37) 2025-03-24 20:59:48,183 - DEBUG - Namespace ctest-new-default-86712314 not present 2025-03-24 20:59:48,194 - INFO - Created namespace ctest-new-default-86712314 2025-03-24 20:59:51,200 - DEBUG - Namespace ctest-non-default-58158707 not present 2025-03-24 20:59:51,215 - INFO - Created namespace ctest-non-default-58158707 2025-03-24 20:59:54,248 - DEBUG - Pod ctest-pod-92857756 not present 2025-03-24 20:59:54,248 - INFO - Creating Pod ctest-pod-92857756 2025-03-24 20:59:54,274 - DEBUG - Node for Pod ctest-pod-92857756 not yet populated 2025-03-24 20:59:57,285 - DEBUG - Pod : ctest-pod-92857756 UUID is c17efeb3-5867-40e1-9b2b-69b670dac9fc 2025-03-24 20:59:57,289 - DEBUG - Pod ctest-pod-24175498 not present 2025-03-24 20:59:57,289 - INFO - Creating Pod ctest-pod-24175498 2025-03-24 20:59:57,371 - DEBUG - Pod : ctest-pod-24175498 UUID is c935cf84-8a0b-4c74-b41c-5fce769284df 2025-03-24 20:59:57,395 - DEBUG - Pod ctest-pod-65422758 not present 2025-03-24 20:59:57,395 - INFO - Creating Pod ctest-pod-65422758 2025-03-24 20:59:57,426 - DEBUG - Pod : ctest-pod-65422758 UUID is 98d459df-4938-4aad-ae69-10280b283104 2025-03-24 20:59:57,432 - DEBUG - Pod ctest-pod-41979214 not present 2025-03-24 20:59:57,433 - INFO - Creating Pod ctest-pod-41979214 2025-03-24 20:59:57,455 - DEBUG - Pod : ctest-pod-41979214 UUID is 2c93002e-9b87-4799-a25f-3a822d1cc3ee 2025-03-24 20:59:57,458 - DEBUG - Pod ctest-pod-64653482 not present 2025-03-24 20:59:57,459 - INFO - Creating Pod ctest-pod-64653482 2025-03-24 20:59:57,504 - DEBUG - Pod : ctest-pod-64653482 UUID is 21f8c99c-6d95-42f0-868a-db0d776d0c90 2025-03-24 20:59:57,554 - DEBUG - Pod ctest-pod-47179189 not present 2025-03-24 20:59:57,557 - INFO - Creating Pod ctest-pod-47179189 2025-03-24 20:59:57,630 - DEBUG - Pod : ctest-pod-47179189 UUID is 66bd8d8b-a206-4750-8370-5d6e0c798e1e 2025-03-24 20:59:57,633 - DEBUG - Pod ctest-pod-91443665 not present 2025-03-24 20:59:57,642 - INFO - Creating Pod ctest-pod-91443665 2025-03-24 20:59:57,697 - DEBUG - Pod : ctest-pod-91443665 UUID is dd62c1b5-a6b0-4508-985d-9050f3d08b8b 2025-03-24 20:59:57,702 - DEBUG - Pod ctest-pod-74439477 not present 2025-03-24 20:59:57,703 - INFO - Creating Pod ctest-pod-74439477 2025-03-24 20:59:57,737 - DEBUG - Pod : ctest-pod-74439477 UUID is 9574b917-95fa-47fd-8b1a-bf25393d8042 2025-03-24 20:59:58,084 - INFO - Project default-domain:k8s-ctest-new-default-86712314 for Namespace ctest-new-default-86712314 is seen in contrail-api 2025-03-24 20:59:58,084 - DEBUG - Project uuid in Contrail is d098aee0-fe18-4cc4-b2a6-8f14f88f351c 2025-03-24 20:59:58,293 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_NamespaceDatabaseList?namespace_uuid=6fc2d297-6176-4368-816b-8be2878cf776 2025-03-24 20:59:58,301 - INFO - Namespace ctest-new-default-86712314 with uuid 6fc2d297-6176-4368-816b-8be2878cf776 found in kube manager 2025-03-24 20:59:58,301 - INFO - Namespace ctest-new-default-86712314 verification passed 2025-03-24 20:59:58,628 - INFO - Project default-domain:k8s-ctest-non-default-58158707 for Namespace ctest-non-default-58158707 is seen in contrail-api 2025-03-24 20:59:58,628 - DEBUG - Project uuid in Contrail is 987efe9e-0f78-48c2-934f-8a0d9d5c81e2 2025-03-24 20:59:58,629 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_NamespaceDatabaseList?namespace_uuid=ab145663-b9b9-43a9-9df7-227046e7c50a 2025-03-24 20:59:58,634 - INFO - Namespace ctest-non-default-58158707 with uuid ab145663-b9b9-43a9-9df7-227046e7c50a found in kube manager 2025-03-24 20:59:58,634 - INFO - Namespace ctest-non-default-58158707 verification passed 2025-03-24 20:59:58,639 - DEBUG - Pod ctest-pod-92857756 not in running state.Currently in Pending 2025-03-24 21:00:03,653 - INFO - Pod ctest-pod-92857756 is in running state.Got IP 10.47.255.251 2025-03-24 21:00:03,719 - DEBUG - Pod ctest-pod-92857756 has vmi f0d15f28-08f2-11f0-a23d-fa163e41248c 2025-03-24 21:00:03,719 - INFO - Verified pod ctest-pod-92857756 in contrail-api 2025-03-24 21:00:03,743 - DEBUG - VMI f0d15f28-08f2-11f0-a23d-fa163e41248c is active in agent 10.0.0.30 2025-03-24 21:00:03,743 - INFO - Verified Pod ctest-pod-92857756 in agent 10.0.0.30 2025-03-24 21:00:03,743 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_VirtualMachineDatabaseList?x=c17efeb3-5867-40e1-9b2b-69b670dac9fc 2025-03-24 21:00:03,762 - INFO - Pod ctest-pod-92857756 with uuid c17efeb3-5867-40e1-9b2b-69b670dac9fc found in kube manager 2025-03-24 21:00:03,765 - INFO - Pod ctest-pod-92857756 verification passed 2025-03-24 21:00:03,776 - DEBUG - Pod ctest-pod-24175498 not in running state.Currently in Pending 2025-03-24 21:00:08,783 - INFO - Pod ctest-pod-24175498 is in running state.Got IP 10.47.255.250 2025-03-24 21:00:08,803 - DEBUG - Pod ctest-pod-24175498 has vmi f192d446-08f2-11f0-a23d-fa163e41248c 2025-03-24 21:00:08,803 - INFO - Verified pod ctest-pod-24175498 in contrail-api 2025-03-24 21:00:08,818 - DEBUG - VMI f192d446-08f2-11f0-a23d-fa163e41248c is active in agent 10.0.0.30 2025-03-24 21:00:08,818 - INFO - Verified Pod ctest-pod-24175498 in agent 10.0.0.30 2025-03-24 21:00:08,818 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_VirtualMachineDatabaseList?x=c935cf84-8a0b-4c74-b41c-5fce769284df 2025-03-24 21:00:08,826 - INFO - Pod ctest-pod-24175498 with uuid c935cf84-8a0b-4c74-b41c-5fce769284df found in kube manager 2025-03-24 21:00:08,826 - INFO - Pod ctest-pod-24175498 verification passed 2025-03-24 21:00:08,832 - DEBUG - Pod ctest-pod-65422758 not in running state.Currently in Pending 2025-03-24 21:00:13,841 - INFO - Pod ctest-pod-65422758 is in running state.Got IP 10.47.255.249 2025-03-24 21:00:13,900 - DEBUG - Pod ctest-pod-65422758 has vmi f298e312-08f2-11f0-a23d-fa163e41248c 2025-03-24 21:00:13,900 - INFO - Verified pod ctest-pod-65422758 in contrail-api 2025-03-24 21:00:13,919 - DEBUG - VMI f298e312-08f2-11f0-a23d-fa163e41248c is active in agent 10.0.0.30 2025-03-24 21:00:13,919 - INFO - Verified Pod ctest-pod-65422758 in agent 10.0.0.30 2025-03-24 21:00:13,919 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_VirtualMachineDatabaseList?x=98d459df-4938-4aad-ae69-10280b283104 2025-03-24 21:00:13,925 - INFO - Pod ctest-pod-65422758 with uuid 98d459df-4938-4aad-ae69-10280b283104 found in kube manager 2025-03-24 21:00:13,925 - INFO - Pod ctest-pod-65422758 verification passed 2025-03-24 21:00:13,931 - INFO - Pod ctest-pod-41979214 is in running state.Got IP 10.47.255.248 2025-03-24 21:00:13,948 - DEBUG - Pod ctest-pod-41979214 has vmi f3319dc8-08f2-11f0-a23d-fa163e41248c 2025-03-24 21:00:13,948 - INFO - Verified pod ctest-pod-41979214 in contrail-api 2025-03-24 21:00:13,965 - DEBUG - VMI f3319dc8-08f2-11f0-a23d-fa163e41248c is active in agent 10.0.0.30 2025-03-24 21:00:13,966 - INFO - Verified Pod ctest-pod-41979214 in agent 10.0.0.30 2025-03-24 21:00:13,966 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_VirtualMachineDatabaseList?x=2c93002e-9b87-4799-a25f-3a822d1cc3ee 2025-03-24 21:00:13,972 - INFO - Pod ctest-pod-41979214 with uuid 2c93002e-9b87-4799-a25f-3a822d1cc3ee found in kube manager 2025-03-24 21:00:13,972 - INFO - Pod ctest-pod-41979214 verification passed 2025-03-24 21:00:13,978 - INFO - Pod ctest-pod-64653482 is in running state.Got IP 10.47.255.247 2025-03-24 21:00:14,039 - DEBUG - Pod ctest-pod-64653482 has vmi f3e0638a-08f2-11f0-a23d-fa163e41248c 2025-03-24 21:00:14,039 - INFO - Verified pod ctest-pod-64653482 in contrail-api 2025-03-24 21:00:14,056 - DEBUG - VMI f3e0638a-08f2-11f0-a23d-fa163e41248c is active in agent 10.0.0.30 2025-03-24 21:00:14,056 - INFO - Verified Pod ctest-pod-64653482 in agent 10.0.0.30 2025-03-24 21:00:14,057 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_VirtualMachineDatabaseList?x=21f8c99c-6d95-42f0-868a-db0d776d0c90 2025-03-24 21:00:14,062 - INFO - Pod ctest-pod-64653482 with uuid 21f8c99c-6d95-42f0-868a-db0d776d0c90 found in kube manager 2025-03-24 21:00:14,062 - INFO - Pod ctest-pod-64653482 verification passed 2025-03-24 21:00:14,069 - INFO - Pod ctest-pod-91443665 is in running state.Got IP 10.47.255.245 2025-03-24 21:00:14,132 - DEBUG - Pod ctest-pod-91443665 has vmi f532e776-08f2-11f0-a23d-fa163e41248c 2025-03-24 21:00:14,132 - INFO - Verified pod ctest-pod-91443665 in contrail-api 2025-03-24 21:00:14,148 - DEBUG - VMI f532e776-08f2-11f0-a23d-fa163e41248c is active in agent 10.0.0.30 2025-03-24 21:00:14,148 - INFO - Verified Pod ctest-pod-91443665 in agent 10.0.0.30 2025-03-24 21:00:14,149 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_VirtualMachineDatabaseList?x=dd62c1b5-a6b0-4508-985d-9050f3d08b8b 2025-03-24 21:00:14,154 - INFO - Pod ctest-pod-91443665 with uuid dd62c1b5-a6b0-4508-985d-9050f3d08b8b found in kube manager 2025-03-24 21:00:14,154 - INFO - Pod ctest-pod-91443665 verification passed 2025-03-24 21:00:14,164 - INFO - Pod ctest-pod-47179189 is in running state.Got IP 10.47.255.246 2025-03-24 21:00:14,181 - DEBUG - Pod ctest-pod-47179189 has vmi f494b98e-08f2-11f0-a23d-fa163e41248c 2025-03-24 21:00:14,181 - INFO - Verified pod ctest-pod-47179189 in contrail-api 2025-03-24 21:00:14,199 - DEBUG - VMI f494b98e-08f2-11f0-a23d-fa163e41248c is active in agent 10.0.0.30 2025-03-24 21:00:14,200 - INFO - Verified Pod ctest-pod-47179189 in agent 10.0.0.30 2025-03-24 21:00:14,200 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_VirtualMachineDatabaseList?x=66bd8d8b-a206-4750-8370-5d6e0c798e1e 2025-03-24 21:00:14,206 - INFO - Pod ctest-pod-47179189 with uuid 66bd8d8b-a206-4750-8370-5d6e0c798e1e found in kube manager 2025-03-24 21:00:14,206 - INFO - Pod ctest-pod-47179189 verification passed 2025-03-24 21:00:14,213 - DEBUG - Pod ctest-pod-74439477 not in running state.Currently in Pending 2025-03-24 21:00:19,221 - INFO - Pod ctest-pod-74439477 is in running state.Got IP 10.47.255.244 2025-03-24 21:00:19,280 - DEBUG - Pod ctest-pod-74439477 has vmi f5c14f16-08f2-11f0-a23d-fa163e41248c 2025-03-24 21:00:19,280 - INFO - Verified pod ctest-pod-74439477 in contrail-api 2025-03-24 21:00:19,297 - DEBUG - VMI f5c14f16-08f2-11f0-a23d-fa163e41248c is active in agent 10.0.0.30 2025-03-24 21:00:19,298 - INFO - Verified Pod ctest-pod-74439477 in agent 10.0.0.30 2025-03-24 21:00:19,298 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_VirtualMachineDatabaseList?x=9574b917-95fa-47fd-8b1a-bf25393d8042 2025-03-24 21:00:19,306 - INFO - Pod ctest-pod-74439477 with uuid 9574b917-95fa-47fd-8b1a-bf25393d8042 found in kube manager 2025-03-24 21:00:19,306 - INFO - Pod ctest-pod-74439477 verification passed 2025-03-24 21:00:19,306 - INFO - ================================================================================ 2025-03-24 21:00:19,306 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-03-24 21:00:19,306 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-03-24 21:00:19,556 - DEBUG - Nothing to compare xmpp stats {'10.0.0.30': {'10.0.0.45': '0'}} with 2025-03-24 21:00:19,556 - INFO - Initial checks done. Running the testcase now 2025-03-24 21:00:19,557 - INFO - 2025-03-24 21:00:19,625 - DEBUG - [Pod ctest-pod-92857756] Cmd: echo ctest-pod-92857756 > /usr/share/nginx/html/index.html, Output: 2025-03-24 21:00:19,704 - DEBUG - [Pod ctest-pod-24175498] Cmd: echo ctest-pod-24175498 > /usr/share/nginx/html/index.html, Output: 2025-03-24 21:00:19,786 - DEBUG - [Pod ctest-pod-65422758] Cmd: echo ctest-pod-65422758 > /usr/share/nginx/html/index.html, Output: 2025-03-24 21:00:19,856 - DEBUG - [Pod ctest-pod-41979214] Cmd: echo ctest-pod-41979214 > /usr/share/nginx/html/index.html, Output: 2025-03-24 21:00:19,860 - DEBUG - Service ctest-nginx-svc-87489977 not present 2025-03-24 21:00:19,860 - INFO - Creating service ctest-nginx-svc-87489977 2025-03-24 21:00:19,877 - INFO - Created Service ctest-nginx-svc-87489977 2025-03-24 21:00:19,888 - WARNING - Service UUID 0f06c8ae-24c1-4091-aaab-7c897c21a176 not yet found in contrail-api 2025-03-24 21:00:20,896 - INFO - Validated that Service ctest-nginx-svc-87489977 is seen in contrail-api 2025-03-24 21:00:20,896 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_LoadbalancerDatabaseList?x=0f06c8ae-24c1-4091-aaab-7c897c21a176 2025-03-24 21:00:20,902 - INFO - Service ctest-nginx-svc-87489977 with uuid 0f06c8ae-24c1-4091-aaab-7c897c21a176 found in kube manager 2025-03-24 21:00:20,902 - INFO - Service ctest-nginx-svc-87489977 verification passed 2025-03-24 21:00:21,967 - DEBUG - [Pod ctest-pod-64653482] Cmd: wget http://10.107.225.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.225.62:80 (10.107.225.62:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-92857756 2025-03-24 21:00:21,967 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd wget http://10.107.225.62:80/ -O - -T 5 -t 1 passed 2025-03-24 21:00:21,967 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd output: Connecting to 10.107.225.62:80 (10.107.225.62:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-92857756 2025-03-24 21:00:22,028 - DEBUG - [Pod ctest-pod-64653482] Cmd: wget http://10.107.225.62:80/ -O - -T 5 -t 1 , Output: ctest-pod-24175498 Connecting to 10.107.225.62:80 (10.107.225.62:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-24 21:00:22,028 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd wget http://10.107.225.62:80/ -O - -T 5 -t 1 passed 2025-03-24 21:00:22,028 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd output: ctest-pod-24175498 Connecting to 10.107.225.62:80 (10.107.225.62:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-24 21:00:22,028 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-92857756': 1, 'ctest-pod-24175498': 1} 2025-03-24 21:00:22,094 - DEBUG - [Pod ctest-pod-91443665] Cmd: wget http://10.107.225.62:80/ -O - -T 5 -t 1 , Output: ctest-pod-92857756 Connecting to 10.107.225.62:80 (10.107.225.62:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-24 21:00:22,094 - DEBUG - [Pod Pod ctest-pod-91443665] Cmd wget http://10.107.225.62:80/ -O - -T 5 -t 1 passed 2025-03-24 21:00:22,094 - DEBUG - [Pod Pod ctest-pod-91443665] Cmd output: ctest-pod-92857756 Connecting to 10.107.225.62:80 (10.107.225.62:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-24 21:00:22,172 - DEBUG - [Pod ctest-pod-91443665] Cmd: wget http://10.107.225.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.225.62:80 (10.107.225.62:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-24175498 2025-03-24 21:00:22,172 - DEBUG - [Pod Pod ctest-pod-91443665] Cmd wget http://10.107.225.62:80/ -O - -T 5 -t 1 passed 2025-03-24 21:00:22,172 - DEBUG - [Pod Pod ctest-pod-91443665] Cmd output: Connecting to 10.107.225.62:80 (10.107.225.62:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-24175498 2025-03-24 21:00:22,172 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-92857756': 1, 'ctest-pod-24175498': 1} 2025-03-24 21:00:22,176 - DEBUG - Network policy ingress-on-service not present 2025-03-24 21:00:22,264 - INFO - Creating Network Policy ingress-on-service 2025-03-24 21:00:22,276 - INFO - Network policy found in k8s 2025-03-24 21:00:22,277 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=15851491-fd67-41b6-9f3f-7d0e0a34f8e5 2025-03-24 21:00:22,284 - INFO - Network Policy ingress-on-service with uuid 15851491-fd67-41b6-9f3f-7d0e0a34f8e5 found in kube manager 2025-03-24 21:00:22,321 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-03-24 21:00:22,322 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-03-24 21:00:22,322 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=15851491-fd67-41b6-9f3f-7d0e0a34f8e5 2025-03-24 21:00:22,357 - WARNING - Network policy with name ingress-on-service not found in agent 2025-03-24 21:00:24,358 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=15851491-fd67-41b6-9f3f-7d0e0a34f8e5 2025-03-24 21:00:24,391 - INFO - Network policy with name ingress-on-service found in agent 2025-03-24 21:00:24,392 - INFO - Network Policy ingress-on-service verification passed 2025-03-24 21:00:29,471 - DEBUG - [Pod ctest-pod-64653482] Cmd: wget http://10.107.225.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:00:29,471 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd wget http://10.107.225.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:00:29,471 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:00:34,549 - DEBUG - [Pod ctest-pod-64653482] Cmd: wget http://10.107.225.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:00:34,549 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd wget http://10.107.225.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:00:34,549 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:00:39,616 - DEBUG - [Pod ctest-pod-64653482] Cmd: wget http://10.107.225.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:00:39,617 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd wget http://10.107.225.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:00:39,617 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:00:44,681 - DEBUG - [Pod ctest-pod-64653482] Cmd: wget http://10.107.225.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:00:44,682 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd wget http://10.107.225.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:00:44,682 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:00:49,770 - DEBUG - [Pod ctest-pod-64653482] Cmd: wget http://10.107.225.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:00:49,770 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd wget http://10.107.225.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:00:49,771 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:00:54,838 - DEBUG - [Pod ctest-pod-64653482] Cmd: wget http://10.107.225.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:00:54,838 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd wget http://10.107.225.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:00:54,838 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:00:59,911 - DEBUG - [Pod ctest-pod-64653482] Cmd: wget http://10.107.225.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:00:59,911 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd wget http://10.107.225.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:00:59,911 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:01:04,975 - DEBUG - [Pod ctest-pod-64653482] Cmd: wget http://10.107.225.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:01:04,976 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd wget http://10.107.225.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:01:04,976 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:01:10,044 - DEBUG - [Pod ctest-pod-64653482] Cmd: wget http://10.107.225.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:01:10,044 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd wget http://10.107.225.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:01:10,044 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:01:15,113 - DEBUG - [Pod ctest-pod-64653482] Cmd: wget http://10.107.225.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:01:15,113 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd wget http://10.107.225.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:01:15,113 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:01:15,113 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-92857756': 0, 'ctest-pod-24175498': 0} 2025-03-24 21:01:15,186 - DEBUG - [Pod ctest-pod-47179189] Cmd: wget http://10.107.225.62:80/ -O - -T 5 -t 1 , Output: ctest-pod-24175498 Connecting to 10.107.225.62:80 (10.107.225.62:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-24 21:01:15,186 - DEBUG - [Pod Pod ctest-pod-47179189] Cmd wget http://10.107.225.62:80/ -O - -T 5 -t 1 passed 2025-03-24 21:01:15,186 - DEBUG - [Pod Pod ctest-pod-47179189] Cmd output: ctest-pod-24175498 Connecting to 10.107.225.62:80 (10.107.225.62:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-24 21:01:15,243 - DEBUG - [Pod ctest-pod-47179189] Cmd: wget http://10.107.225.62:80/ -O - -T 5 -t 1 , Output: ctest-pod-24175498 Connecting to 10.107.225.62:80 (10.107.225.62:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-24 21:01:15,244 - DEBUG - [Pod Pod ctest-pod-47179189] Cmd wget http://10.107.225.62:80/ -O - -T 5 -t 1 passed 2025-03-24 21:01:15,244 - DEBUG - [Pod Pod ctest-pod-47179189] Cmd output: ctest-pod-24175498 Connecting to 10.107.225.62:80 (10.107.225.62:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-24 21:01:15,295 - DEBUG - [Pod ctest-pod-47179189] Cmd: wget http://10.107.225.62:80/ -O - -T 5 -t 1 , Output: ctest-pod-24175498 Connecting to 10.107.225.62:80 (10.107.225.62:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-24 21:01:15,295 - DEBUG - [Pod Pod ctest-pod-47179189] Cmd wget http://10.107.225.62:80/ -O - -T 5 -t 1 passed 2025-03-24 21:01:15,295 - DEBUG - [Pod Pod ctest-pod-47179189] Cmd output: ctest-pod-24175498 Connecting to 10.107.225.62:80 (10.107.225.62:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-24 21:01:15,363 - DEBUG - [Pod ctest-pod-47179189] Cmd: wget http://10.107.225.62:80/ -O - -T 5 -t 1 , Output: ctest-pod-92857756 Connecting to 10.107.225.62:80 (10.107.225.62:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-24 21:01:15,363 - DEBUG - [Pod Pod ctest-pod-47179189] Cmd wget http://10.107.225.62:80/ -O - -T 5 -t 1 passed 2025-03-24 21:01:15,363 - DEBUG - [Pod Pod ctest-pod-47179189] Cmd output: ctest-pod-92857756 Connecting to 10.107.225.62:80 (10.107.225.62:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-24 21:01:15,363 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-92857756': 1, 'ctest-pod-24175498': 3} 2025-03-24 21:01:20,419 - DEBUG - [Pod ctest-pod-91443665] Cmd: wget http://10.107.225.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:01:20,419 - DEBUG - [Pod Pod ctest-pod-91443665] Cmd wget http://10.107.225.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:01:20,419 - DEBUG - [Pod Pod ctest-pod-91443665] Cmd output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:01:25,493 - DEBUG - [Pod ctest-pod-91443665] Cmd: wget http://10.107.225.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:01:25,493 - DEBUG - [Pod Pod ctest-pod-91443665] Cmd wget http://10.107.225.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:01:25,493 - DEBUG - [Pod Pod ctest-pod-91443665] Cmd output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:01:30,548 - DEBUG - [Pod ctest-pod-91443665] Cmd: wget http://10.107.225.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:01:30,548 - DEBUG - [Pod Pod ctest-pod-91443665] Cmd wget http://10.107.225.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:01:30,548 - DEBUG - [Pod Pod ctest-pod-91443665] Cmd output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:01:35,614 - DEBUG - [Pod ctest-pod-91443665] Cmd: wget http://10.107.225.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:01:35,614 - DEBUG - [Pod Pod ctest-pod-91443665] Cmd wget http://10.107.225.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:01:35,614 - DEBUG - [Pod Pod ctest-pod-91443665] Cmd output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:01:40,667 - DEBUG - [Pod ctest-pod-91443665] Cmd: wget http://10.107.225.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:01:40,667 - DEBUG - [Pod Pod ctest-pod-91443665] Cmd wget http://10.107.225.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:01:40,667 - DEBUG - [Pod Pod ctest-pod-91443665] Cmd output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:01:45,727 - DEBUG - [Pod ctest-pod-91443665] Cmd: wget http://10.107.225.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:01:45,727 - DEBUG - [Pod Pod ctest-pod-91443665] Cmd wget http://10.107.225.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:01:45,727 - DEBUG - [Pod Pod ctest-pod-91443665] Cmd output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:01:50,793 - DEBUG - [Pod ctest-pod-91443665] Cmd: wget http://10.107.225.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:01:50,793 - DEBUG - [Pod Pod ctest-pod-91443665] Cmd wget http://10.107.225.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:01:50,793 - DEBUG - [Pod Pod ctest-pod-91443665] Cmd output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:01:55,860 - DEBUG - [Pod ctest-pod-91443665] Cmd: wget http://10.107.225.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:01:55,861 - DEBUG - [Pod Pod ctest-pod-91443665] Cmd wget http://10.107.225.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:01:55,861 - DEBUG - [Pod Pod ctest-pod-91443665] Cmd output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:02:00,927 - DEBUG - [Pod ctest-pod-91443665] Cmd: wget http://10.107.225.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:02:00,927 - DEBUG - [Pod Pod ctest-pod-91443665] Cmd wget http://10.107.225.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:02:00,927 - DEBUG - [Pod Pod ctest-pod-91443665] Cmd output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:02:06,043 - DEBUG - [Pod ctest-pod-91443665] Cmd: wget http://10.107.225.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:02:06,043 - DEBUG - [Pod Pod ctest-pod-91443665] Cmd wget http://10.107.225.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:02:06,043 - DEBUG - [Pod Pod ctest-pod-91443665] Cmd output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:02:06,043 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-92857756': 0, 'ctest-pod-24175498': 0} 2025-03-24 21:02:08,107 - DEBUG - [Pod ctest-pod-47179189] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.157 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.093 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.098 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.093/0.449/1.157 ms 2025-03-24 21:02:08,107 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-47179189 with expectation True passed 2025-03-24 21:02:10,170 - DEBUG - [Pod ctest-pod-64653482] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.065 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.089 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.091 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.089/0.415/1.065 ms 2025-03-24 21:02:10,170 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-64653482 with expectation True passed 2025-03-24 21:02:12,223 - DEBUG - [Pod ctest-pod-91443665] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.795 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.089 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.111 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.089/0.331/0.795 ms 2025-03-24 21:02:12,224 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-91443665 with expectation True passed 2025-03-24 21:02:12,291 - DEBUG - [Pod ctest-pod-47179189] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-24 21:02:12,291 - DEBUG - [Pod Pod ctest-pod-47179189] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-03-24 21:02:12,291 - DEBUG - [Pod Pod ctest-pod-47179189] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-24 21:02:12,291 - INFO - wget check of of http://10.47.255.251 from ctest-pod-47179189 passed 2025-03-24 21:02:12,368 - DEBUG - [Pod ctest-pod-47179189] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-24 21:02:12,369 - DEBUG - [Pod Pod ctest-pod-47179189] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-03-24 21:02:12,369 - DEBUG - [Pod Pod ctest-pod-47179189] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-24 21:02:12,369 - INFO - wget check of of http://10.47.255.250 from ctest-pod-47179189 passed 2025-03-24 21:02:17,435 - DEBUG - [Pod ctest-pod-64653482] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-24 21:02:17,435 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-24 21:02:17,435 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-24 21:02:17,435 - INFO - wget check of of http://10.47.255.250 from ctest-pod-64653482 passed 2025-03-24 21:02:22,495 - DEBUG - [Pod ctest-pod-74439477] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-03-24 21:02:22,496 - DEBUG - [Pod Pod ctest-pod-74439477] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-03-24 21:02:22,496 - DEBUG - [Pod Pod ctest-pod-74439477] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-03-24 21:02:22,496 - INFO - wget check of of http://10.47.255.251 from ctest-pod-74439477 passed 2025-03-24 21:02:22,509 - INFO - Updating Network Policy ingress-on-service 2025-03-24 21:02:27,587 - DEBUG - [Pod ctest-pod-64653482] Cmd: wget http://10.107.225.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:02:27,587 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd wget http://10.107.225.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:02:27,587 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:02:32,659 - DEBUG - [Pod ctest-pod-64653482] Cmd: wget http://10.107.225.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:02:32,659 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd wget http://10.107.225.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:02:32,659 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:02:37,721 - DEBUG - [Pod ctest-pod-64653482] Cmd: wget http://10.107.225.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:02:37,721 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd wget http://10.107.225.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:02:37,721 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:02:42,792 - DEBUG - [Pod ctest-pod-64653482] Cmd: wget http://10.107.225.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:02:42,792 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd wget http://10.107.225.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:02:42,792 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:02:47,863 - DEBUG - [Pod ctest-pod-64653482] Cmd: wget http://10.107.225.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:02:47,863 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd wget http://10.107.225.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:02:47,864 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:02:52,930 - DEBUG - [Pod ctest-pod-64653482] Cmd: wget http://10.107.225.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:02:52,930 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd wget http://10.107.225.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:02:52,930 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:02:58,012 - DEBUG - [Pod ctest-pod-64653482] Cmd: wget http://10.107.225.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:02:58,012 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd wget http://10.107.225.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:02:58,012 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:03:03,085 - DEBUG - [Pod ctest-pod-64653482] Cmd: wget http://10.107.225.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:03:03,085 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd wget http://10.107.225.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:03:03,085 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:03:08,162 - DEBUG - [Pod ctest-pod-64653482] Cmd: wget http://10.107.225.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:03:08,162 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd wget http://10.107.225.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:03:08,162 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:03:13,228 - DEBUG - [Pod ctest-pod-64653482] Cmd: wget http://10.107.225.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:03:13,228 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd wget http://10.107.225.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:03:13,228 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd output: Connecting to 10.107.225.62:80 (10.107.225.62:80) wget: download timed out 2025-03-24 21:03:13,228 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-92857756': 0, 'ctest-pod-24175498': 0} 2025-03-24 21:03:13,304 - DEBUG - [Pod ctest-pod-47179189] Cmd: wget http://10.107.225.62:80/ -O - -T 5 -t 1 , Output: ctest-pod-92857756 Connecting to 10.107.225.62:80 (10.107.225.62:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-24 21:03:13,304 - DEBUG - [Pod Pod ctest-pod-47179189] Cmd wget http://10.107.225.62:80/ -O - -T 5 -t 1 passed 2025-03-24 21:03:13,304 - DEBUG - [Pod Pod ctest-pod-47179189] Cmd output: ctest-pod-92857756 Connecting to 10.107.225.62:80 (10.107.225.62:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-24 21:03:13,385 - DEBUG - [Pod ctest-pod-47179189] Cmd: wget http://10.107.225.62:80/ -O - -T 5 -t 1 , Output: ctest-pod-24175498 Connecting to 10.107.225.62:80 (10.107.225.62:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-24 21:03:13,385 - DEBUG - [Pod Pod ctest-pod-47179189] Cmd wget http://10.107.225.62:80/ -O - -T 5 -t 1 passed 2025-03-24 21:03:13,385 - DEBUG - [Pod Pod ctest-pod-47179189] Cmd output: ctest-pod-24175498 Connecting to 10.107.225.62:80 (10.107.225.62:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-24 21:03:13,385 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-92857756': 1, 'ctest-pod-24175498': 1} 2025-03-24 21:03:13,440 - DEBUG - [Pod ctest-pod-91443665] Cmd: wget http://10.107.225.62:80/ -O - -T 5 -t 1 , Output: ctest-pod-92857756 Connecting to 10.107.225.62:80 (10.107.225.62:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-24 21:03:13,440 - DEBUG - [Pod Pod ctest-pod-91443665] Cmd wget http://10.107.225.62:80/ -O - -T 5 -t 1 passed 2025-03-24 21:03:13,440 - DEBUG - [Pod Pod ctest-pod-91443665] Cmd output: ctest-pod-92857756 Connecting to 10.107.225.62:80 (10.107.225.62:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-24 21:03:13,507 - DEBUG - [Pod ctest-pod-91443665] Cmd: wget http://10.107.225.62:80/ -O - -T 5 -t 1 , Output: ctest-pod-24175498 Connecting to 10.107.225.62:80 (10.107.225.62:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-24 21:03:13,507 - DEBUG - [Pod Pod ctest-pod-91443665] Cmd wget http://10.107.225.62:80/ -O - -T 5 -t 1 passed 2025-03-24 21:03:13,507 - DEBUG - [Pod Pod ctest-pod-91443665] Cmd output: ctest-pod-24175498 Connecting to 10.107.225.62:80 (10.107.225.62:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-24 21:03:13,507 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-92857756': 1, 'ctest-pod-24175498': 1} 2025-03-24 21:03:15,564 - DEBUG - [Pod ctest-pod-47179189] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.457 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.088 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.106 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.088/0.217/0.457 ms 2025-03-24 21:03:15,564 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-47179189 with expectation True passed 2025-03-24 21:03:17,624 - DEBUG - [Pod ctest-pod-64653482] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.885 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.103 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.093 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.093/0.360/0.885 ms 2025-03-24 21:03:17,624 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-64653482 with expectation True passed 2025-03-24 21:03:19,704 - DEBUG - [Pod ctest-pod-91443665] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.146 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.082 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.114 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.082/0.447/1.146 ms 2025-03-24 21:03:19,704 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-91443665 with expectation True passed 2025-03-24 21:03:19,764 - DEBUG - [Pod ctest-pod-47179189] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-24 21:03:19,764 - DEBUG - [Pod Pod ctest-pod-47179189] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-03-24 21:03:19,764 - DEBUG - [Pod Pod ctest-pod-47179189] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-24 21:03:19,764 - INFO - wget check of of http://10.47.255.251 from ctest-pod-47179189 passed 2025-03-24 21:03:19,837 - DEBUG - [Pod ctest-pod-47179189] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-24 21:03:19,837 - DEBUG - [Pod Pod ctest-pod-47179189] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-03-24 21:03:19,837 - DEBUG - [Pod Pod ctest-pod-47179189] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-24 21:03:19,837 - INFO - wget check of of http://10.47.255.250 from ctest-pod-47179189 passed 2025-03-24 21:03:24,902 - DEBUG - [Pod ctest-pod-64653482] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-24 21:03:24,902 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-24 21:03:24,902 - DEBUG - [Pod Pod ctest-pod-64653482] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-24 21:03:24,902 - INFO - wget check of of http://10.47.255.250 from ctest-pod-64653482 passed 2025-03-24 21:03:24,965 - DEBUG - [Pod ctest-pod-74439477] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-24 21:03:24,965 - DEBUG - [Pod Pod ctest-pod-74439477] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-03-24 21:03:24,965 - DEBUG - [Pod Pod ctest-pod-74439477] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-24 21:03:24,965 - INFO - wget check of of http://10.47.255.251 from ctest-pod-74439477 passed 2025-03-24 21:03:24,965 - INFO - Deleting Network Policy : ingress-on-service 2025-03-24 21:03:24,966 - INFO - Deleting service : ctest-nginx-svc-87489977 2025-03-24 21:03:25,204 - DEBUG - No XMPP flaps were noticed during the test 2025-03-24 21:03:25,204 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:06] 2025-03-24 21:03:25,204 - INFO - -------------------------------------------------------------------------------- 2025-03-24 21:03:25,209 - INFO - Deleting pod ctest-new-default-86712314:ctest-pod-92857756 2025-03-24 21:03:25,210 - INFO - Deleting pod ctest-new-default-86712314:ctest-pod-24175498 2025-03-24 21:03:25,211 - INFO - Deleting pod ctest-non-default-58158707:ctest-pod-65422758 2025-03-24 21:03:25,211 - INFO - Deleting pod ctest-non-default-58158707:ctest-pod-41979214 2025-03-24 21:03:25,211 - INFO - Deleting pod ctest-new-default-86712314:ctest-pod-64653482 2025-03-24 21:03:25,211 - INFO - Deleting pod ctest-new-default-86712314:ctest-pod-47179189 2025-03-24 21:03:25,212 - INFO - Deleting pod ctest-non-default-58158707:ctest-pod-91443665 2025-03-24 21:03:25,212 - INFO - Deleting pod ctest-non-default-58158707:ctest-pod-74439477 2025-03-24 21:03:25,412 - WARNING - Pod uuid 66bd8d8b-a206-4750-8370-5d6e0c798e1e is still seen in agent 10.0.0.30 VM list 2025-03-24 21:03:25,413 - WARNING - Pod uuid dd62c1b5-a6b0-4508-985d-9050f3d08b8b is still seen in agent 10.0.0.30 VM list 2025-03-24 21:03:25,413 - WARNING - Pod uuid 21f8c99c-6d95-42f0-868a-db0d776d0c90 is still seen in agent 10.0.0.30 VM list 2025-03-24 21:03:25,414 - WARNING - Pod uuid c17efeb3-5867-40e1-9b2b-69b670dac9fc is still seen in agent 10.0.0.30 VM list 2025-03-24 21:03:25,414 - WARNING - Pod uuid 9574b917-95fa-47fd-8b1a-bf25393d8042 is still seen in agent 10.0.0.30 VM list 2025-03-24 21:03:25,414 - WARNING - Pod uuid c935cf84-8a0b-4c74-b41c-5fce769284df is still seen in agent 10.0.0.30 VM list 2025-03-24 21:03:25,415 - WARNING - Pod uuid 98d459df-4938-4aad-ae69-10280b283104 is still seen in agent 10.0.0.30 VM list 2025-03-24 21:03:25,415 - WARNING - Pod uuid 2c93002e-9b87-4799-a25f-3a822d1cc3ee is still seen in agent 10.0.0.30 VM list 2025-03-24 21:03:30,445 - WARNING - Pod uuid 66bd8d8b-a206-4750-8370-5d6e0c798e1e is still seen in agent 10.0.0.30 VM list 2025-03-24 21:03:30,445 - DEBUG - Pod 98d459df-4938-4aad-ae69-10280b283104 is not in agent 10.0.0.30 VM list 2025-03-24 21:03:30,447 - DEBUG - Pod 2c93002e-9b87-4799-a25f-3a822d1cc3ee is not in agent 10.0.0.30 VM list 2025-03-24 21:03:30,448 - DEBUG - Pod c935cf84-8a0b-4c74-b41c-5fce769284df is not in agent 10.0.0.30 VM list 2025-03-24 21:03:30,449 - DEBUG - Pod c17efeb3-5867-40e1-9b2b-69b670dac9fc is not in agent 10.0.0.30 VM list 2025-03-24 21:03:30,451 - WARNING - Pod uuid dd62c1b5-a6b0-4508-985d-9050f3d08b8b is still seen in agent 10.0.0.30 VM list 2025-03-24 21:03:30,451 - WARNING - Pod uuid 21f8c99c-6d95-42f0-868a-db0d776d0c90 is still seen in agent 10.0.0.30 VM list 2025-03-24 21:03:30,451 - WARNING - Pod uuid 9574b917-95fa-47fd-8b1a-bf25393d8042 is still seen in agent 10.0.0.30 VM list 2025-03-24 21:03:30,467 - DEBUG - VMI f3319dc8-08f2-11f0-a23d-fa163e41248c is removed from agent 10.0.0.30 2025-03-24 21:03:30,467 - INFO - Verified that pod ctest-pod-41979214 is removed in agent 2025-03-24 21:03:30,468 - DEBUG - VMI f0d15f28-08f2-11f0-a23d-fa163e41248c is removed from agent 10.0.0.30 2025-03-24 21:03:30,468 - INFO - Verified that pod ctest-pod-92857756 is removed in agent 2025-03-24 21:03:30,468 - DEBUG - VMI f298e312-08f2-11f0-a23d-fa163e41248c is removed from agent 10.0.0.30 2025-03-24 21:03:30,468 - INFO - Verified that pod ctest-pod-65422758 is removed in agent 2025-03-24 21:03:30,469 - DEBUG - VMI f192d446-08f2-11f0-a23d-fa163e41248c is removed from agent 10.0.0.30 2025-03-24 21:03:30,469 - INFO - Verified that pod ctest-pod-24175498 is removed in agent 2025-03-24 21:03:35,457 - WARNING - Pod uuid 66bd8d8b-a206-4750-8370-5d6e0c798e1e is still seen in agent 10.0.0.30 VM list 2025-03-24 21:03:35,467 - WARNING - Pod uuid dd62c1b5-a6b0-4508-985d-9050f3d08b8b is still seen in agent 10.0.0.30 VM list 2025-03-24 21:03:35,469 - WARNING - Pod uuid 9574b917-95fa-47fd-8b1a-bf25393d8042 is still seen in agent 10.0.0.30 VM list 2025-03-24 21:03:35,470 - WARNING - Pod uuid 21f8c99c-6d95-42f0-868a-db0d776d0c90 is still seen in agent 10.0.0.30 VM list 2025-03-24 21:03:40,467 - WARNING - Pod uuid 66bd8d8b-a206-4750-8370-5d6e0c798e1e is still seen in agent 10.0.0.30 VM list 2025-03-24 21:03:40,483 - WARNING - Pod uuid dd62c1b5-a6b0-4508-985d-9050f3d08b8b is still seen in agent 10.0.0.30 VM list 2025-03-24 21:03:40,485 - WARNING - Pod uuid 21f8c99c-6d95-42f0-868a-db0d776d0c90 is still seen in agent 10.0.0.30 VM list 2025-03-24 21:03:40,485 - WARNING - Pod uuid 9574b917-95fa-47fd-8b1a-bf25393d8042 is still seen in agent 10.0.0.30 VM list 2025-03-24 21:03:45,476 - WARNING - Pod uuid 66bd8d8b-a206-4750-8370-5d6e0c798e1e is still seen in agent 10.0.0.30 VM list 2025-03-24 21:03:45,500 - WARNING - Pod uuid 21f8c99c-6d95-42f0-868a-db0d776d0c90 is still seen in agent 10.0.0.30 VM list 2025-03-24 21:03:45,501 - WARNING - Pod uuid dd62c1b5-a6b0-4508-985d-9050f3d08b8b is still seen in agent 10.0.0.30 VM list 2025-03-24 21:03:45,503 - WARNING - Pod uuid 9574b917-95fa-47fd-8b1a-bf25393d8042 is still seen in agent 10.0.0.30 VM list 2025-03-24 21:03:50,485 - WARNING - Pod uuid 66bd8d8b-a206-4750-8370-5d6e0c798e1e is still seen in agent 10.0.0.30 VM list 2025-03-24 21:03:50,523 - WARNING - Pod uuid 21f8c99c-6d95-42f0-868a-db0d776d0c90 is still seen in agent 10.0.0.30 VM list 2025-03-24 21:03:50,525 - WARNING - Pod uuid dd62c1b5-a6b0-4508-985d-9050f3d08b8b is still seen in agent 10.0.0.30 VM list 2025-03-24 21:03:50,526 - WARNING - Pod uuid 9574b917-95fa-47fd-8b1a-bf25393d8042 is still seen in agent 10.0.0.30 VM list 2025-03-24 21:03:55,522 - WARNING - Pod uuid 66bd8d8b-a206-4750-8370-5d6e0c798e1e is still seen in agent 10.0.0.30 VM list 2025-03-24 21:03:55,540 - WARNING - Pod uuid 21f8c99c-6d95-42f0-868a-db0d776d0c90 is still seen in agent 10.0.0.30 VM list 2025-03-24 21:03:55,542 - WARNING - Pod uuid dd62c1b5-a6b0-4508-985d-9050f3d08b8b is still seen in agent 10.0.0.30 VM list 2025-03-24 21:03:55,543 - WARNING - Pod uuid 9574b917-95fa-47fd-8b1a-bf25393d8042 is still seen in agent 10.0.0.30 VM list 2025-03-24 21:04:00,532 - DEBUG - Pod 66bd8d8b-a206-4750-8370-5d6e0c798e1e is not in agent 10.0.0.30 VM list 2025-03-24 21:04:00,540 - DEBUG - VMI f494b98e-08f2-11f0-a23d-fa163e41248c is removed from agent 10.0.0.30 2025-03-24 21:04:00,540 - INFO - Verified that pod ctest-pod-47179189 is removed in agent 2025-03-24 21:04:00,555 - DEBUG - Pod 21f8c99c-6d95-42f0-868a-db0d776d0c90 is not in agent 10.0.0.30 VM list 2025-03-24 21:04:00,559 - DEBUG - Pod 9574b917-95fa-47fd-8b1a-bf25393d8042 is not in agent 10.0.0.30 VM list 2025-03-24 21:04:00,561 - DEBUG - Pod dd62c1b5-a6b0-4508-985d-9050f3d08b8b is not in agent 10.0.0.30 VM list 2025-03-24 21:04:00,573 - DEBUG - VMI f3e0638a-08f2-11f0-a23d-fa163e41248c is removed from agent 10.0.0.30 2025-03-24 21:04:00,573 - INFO - Verified that pod ctest-pod-64653482 is removed in agent 2025-03-24 21:04:00,575 - DEBUG - VMI f5c14f16-08f2-11f0-a23d-fa163e41248c is removed from agent 10.0.0.30 2025-03-24 21:04:00,575 - INFO - Verified that pod ctest-pod-74439477 is removed in agent 2025-03-24 21:04:00,575 - DEBUG - VMI f532e776-08f2-11f0-a23d-fa163e41248c is removed from agent 10.0.0.30 2025-03-24 21:04:00,575 - INFO - Verified that pod ctest-pod-91443665 is removed in agent 2025-03-24 21:04:00,575 - INFO - Deleting namespace ctest-non-default-58158707 2025-03-24 21:04:00,598 - DEBUG - Namespace ctest-non-default-58158707 still in k8s 2025-03-24 21:04:02,603 - DEBUG - Namespace ctest-non-default-58158707 still in k8s 2025-03-24 21:04:04,609 - DEBUG - Namespace ctest-non-default-58158707 still in k8s 2025-03-24 21:04:06,613 - DEBUG - Namespace ctest-non-default-58158707 is not in k8s 2025-03-24 21:04:06,613 - DEBUG - No need to check project deletion in contrail-api 2025-03-24 21:04:06,613 - INFO - Deleting namespace ctest-new-default-86712314 2025-03-24 21:04:06,623 - DEBUG - Namespace ctest-new-default-86712314 still in k8s 2025-03-24 21:04:08,628 - DEBUG - Namespace ctest-new-default-86712314 still in k8s 2025-03-24 21:04:10,633 - DEBUG - Namespace ctest-new-default-86712314 still in k8s 2025-03-24 21:04:12,637 - DEBUG - Namespace ctest-new-default-86712314 is not in k8s 2025-03-24 21:04:12,637 - DEBUG - No need to check project deletion in contrail-api