2024-09-20 19:34:07,506 - INFO - Using existing project ['default-domain', 'k8s-default'](73088a4f-63e7-4784-b19f-63d2f0a8268e) 2024-09-20 19:34:07,525 - DEBUG - Namespace ctest-new-default-40072181 not present 2024-09-20 19:34:07,539 - INFO - Created namespace ctest-new-default-40072181 2024-09-20 19:34:10,543 - DEBUG - Namespace ctest-non-default-14533403 not present 2024-09-20 19:34:10,555 - INFO - Created namespace ctest-non-default-14533403 2024-09-20 19:34:13,568 - DEBUG - Pod ctest-pod-99126705 not present 2024-09-20 19:34:13,568 - INFO - Creating Pod ctest-pod-99126705 2024-09-20 19:34:13,605 - DEBUG - Pod : ctest-pod-99126705 UUID is 3f8bfe2c-2183-4f95-82f1-688aefba34b7 2024-09-20 19:34:13,621 - DEBUG - Pod ctest-pod-01191461 not present 2024-09-20 19:34:13,622 - INFO - Creating Pod ctest-pod-01191461 2024-09-20 19:34:13,644 - DEBUG - Pod : ctest-pod-01191461 UUID is b1f1ddff-5a29-4b11-b4a0-86343fafc96e 2024-09-20 19:34:13,646 - DEBUG - Pod ctest-pod-11924584 not present 2024-09-20 19:34:13,646 - INFO - Creating Pod ctest-pod-11924584 2024-09-20 19:34:13,688 - DEBUG - Pod : ctest-pod-11924584 UUID is 7b3956ab-7574-4f23-ab17-fa4deeac01c3 2024-09-20 19:34:13,692 - DEBUG - Pod ctest-pod-19415390 not present 2024-09-20 19:34:13,693 - INFO - Creating Pod ctest-pod-19415390 2024-09-20 19:34:13,724 - DEBUG - Pod : ctest-pod-19415390 UUID is 2ecb2e5e-e98c-42d5-b5fd-612ac1bcf1aa 2024-09-20 19:34:13,726 - DEBUG - Pod ctest-pod-26338421 not present 2024-09-20 19:34:13,726 - INFO - Creating Pod ctest-pod-26338421 2024-09-20 19:34:13,741 - DEBUG - Pod : ctest-pod-26338421 UUID is 75c86820-fa5c-4324-a23e-7ee4c461a0a2 2024-09-20 19:34:13,743 - DEBUG - Pod ctest-pod-14063729 not present 2024-09-20 19:34:13,743 - INFO - Creating Pod ctest-pod-14063729 2024-09-20 19:34:13,759 - DEBUG - Pod : ctest-pod-14063729 UUID is 2d8a5291-4666-4529-b54a-f48428b307ad 2024-09-20 19:34:13,766 - DEBUG - Pod ctest-pod-23163492 not present 2024-09-20 19:34:13,766 - INFO - Creating Pod ctest-pod-23163492 2024-09-20 19:34:13,784 - DEBUG - Pod : ctest-pod-23163492 UUID is bdbf244a-6779-437f-9930-173e13409e25 2024-09-20 19:34:13,786 - DEBUG - Pod ctest-pod-62365315 not present 2024-09-20 19:34:13,786 - INFO - Creating Pod ctest-pod-62365315 2024-09-20 19:34:13,805 - DEBUG - Pod : ctest-pod-62365315 UUID is 270e1a0f-8fc5-466f-a8dd-0f407503b3b5 2024-09-20 19:34:14,031 - INFO - Project default-domain:k8s-ctest-new-default-40072181 for Namespace ctest-new-default-40072181 is seen in contrail-api 2024-09-20 19:34:14,031 - DEBUG - Project uuid in Contrail is 393f6a01-4285-4f07-a0c1-f6ffbb7bb863 2024-09-20 19:34:14,229 - DEBUG - Requesting: http://10.0.0.52:8108/Snh_NamespaceDatabaseList?namespace_uuid=358c5b30-ad3f-402d-8528-923bd81186a1 2024-09-20 19:34:14,233 - INFO - Namespace ctest-new-default-40072181 with uuid 358c5b30-ad3f-402d-8528-923bd81186a1 found in kube manager 2024-09-20 19:34:14,233 - INFO - Namespace ctest-new-default-40072181 verification passed 2024-09-20 19:34:14,564 - INFO - Project default-domain:k8s-ctest-non-default-14533403 for Namespace ctest-non-default-14533403 is seen in contrail-api 2024-09-20 19:34:14,565 - DEBUG - Project uuid in Contrail is 10d9fa50-5153-41f6-8446-2f65eb963b99 2024-09-20 19:34:14,565 - DEBUG - Requesting: http://10.0.0.52:8108/Snh_NamespaceDatabaseList?namespace_uuid=fc3f0b83-635b-4964-841e-42461244a3ee 2024-09-20 19:34:14,572 - INFO - Namespace ctest-non-default-14533403 with uuid fc3f0b83-635b-4964-841e-42461244a3ee found in kube manager 2024-09-20 19:34:14,573 - INFO - Namespace ctest-non-default-14533403 verification passed 2024-09-20 19:34:14,581 - DEBUG - Pod ctest-pod-99126705 not in running state.Currently in Pending 2024-09-20 19:34:19,587 - DEBUG - Pod ctest-pod-99126705 not in running state.Currently in Pending 2024-09-20 19:34:24,594 - DEBUG - Pod ctest-pod-99126705 not in running state.Currently in Pending 2024-09-20 19:34:29,601 - INFO - Pod ctest-pod-99126705 is in running state.Got IP 10.47.255.251 2024-09-20 19:34:29,621 - DEBUG - Pod ctest-pod-99126705 has vmi 523a16cc-7787-11ef-ba61-fa163ec7a5d7 2024-09-20 19:34:29,621 - INFO - Verified pod ctest-pod-99126705 in contrail-api 2024-09-20 19:34:29,636 - DEBUG - VMI 523a16cc-7787-11ef-ba61-fa163ec7a5d7 is active in agent 10.0.0.34 2024-09-20 19:34:29,637 - INFO - Verified Pod ctest-pod-99126705 in agent 10.0.0.34 2024-09-20 19:34:29,637 - DEBUG - Requesting: http://10.0.0.52:8108/Snh_VirtualMachineDatabaseList?x=3f8bfe2c-2183-4f95-82f1-688aefba34b7 2024-09-20 19:34:29,644 - INFO - Pod ctest-pod-99126705 with uuid 3f8bfe2c-2183-4f95-82f1-688aefba34b7 found in kube manager 2024-09-20 19:34:29,644 - INFO - Pod ctest-pod-99126705 verification passed 2024-09-20 19:34:29,650 - INFO - Pod ctest-pod-01191461 is in running state.Got IP 10.47.255.250 2024-09-20 19:34:29,714 - DEBUG - Pod ctest-pod-01191461 has vmi 52bd2c10-7787-11ef-ba61-fa163ec7a5d7 2024-09-20 19:34:29,714 - INFO - Verified pod ctest-pod-01191461 in contrail-api 2024-09-20 19:34:29,728 - DEBUG - VMI 52bd2c10-7787-11ef-ba61-fa163ec7a5d7 is active in agent 10.0.0.34 2024-09-20 19:34:29,728 - INFO - Verified Pod ctest-pod-01191461 in agent 10.0.0.34 2024-09-20 19:34:29,728 - DEBUG - Requesting: http://10.0.0.52:8108/Snh_VirtualMachineDatabaseList?x=b1f1ddff-5a29-4b11-b4a0-86343fafc96e 2024-09-20 19:34:29,733 - INFO - Pod ctest-pod-01191461 with uuid b1f1ddff-5a29-4b11-b4a0-86343fafc96e found in kube manager 2024-09-20 19:34:29,733 - INFO - Pod ctest-pod-01191461 verification passed 2024-09-20 19:34:29,738 - INFO - Pod ctest-pod-11924584 is in running state.Got IP 10.47.255.249 2024-09-20 19:34:29,754 - DEBUG - Pod ctest-pod-11924584 has vmi 5367daa2-7787-11ef-ba61-fa163ec7a5d7 2024-09-20 19:34:29,754 - INFO - Verified pod ctest-pod-11924584 in contrail-api 2024-09-20 19:34:29,766 - DEBUG - VMI 5367daa2-7787-11ef-ba61-fa163ec7a5d7 is active in agent 10.0.0.34 2024-09-20 19:34:29,766 - INFO - Verified Pod ctest-pod-11924584 in agent 10.0.0.34 2024-09-20 19:34:29,767 - DEBUG - Requesting: http://10.0.0.52:8108/Snh_VirtualMachineDatabaseList?x=7b3956ab-7574-4f23-ab17-fa4deeac01c3 2024-09-20 19:34:29,771 - INFO - Pod ctest-pod-11924584 with uuid 7b3956ab-7574-4f23-ab17-fa4deeac01c3 found in kube manager 2024-09-20 19:34:29,771 - INFO - Pod ctest-pod-11924584 verification passed 2024-09-20 19:34:29,776 - INFO - Pod ctest-pod-19415390 is in running state.Got IP 10.47.255.248 2024-09-20 19:34:29,833 - DEBUG - Pod ctest-pod-19415390 has vmi 53ee7972-7787-11ef-ba61-fa163ec7a5d7 2024-09-20 19:34:29,833 - INFO - Verified pod ctest-pod-19415390 in contrail-api 2024-09-20 19:34:29,846 - DEBUG - VMI 53ee7972-7787-11ef-ba61-fa163ec7a5d7 is active in agent 10.0.0.34 2024-09-20 19:34:29,846 - INFO - Verified Pod ctest-pod-19415390 in agent 10.0.0.34 2024-09-20 19:34:29,846 - DEBUG - Requesting: http://10.0.0.52:8108/Snh_VirtualMachineDatabaseList?x=2ecb2e5e-e98c-42d5-b5fd-612ac1bcf1aa 2024-09-20 19:34:29,851 - INFO - Pod ctest-pod-19415390 with uuid 2ecb2e5e-e98c-42d5-b5fd-612ac1bcf1aa found in kube manager 2024-09-20 19:34:29,851 - INFO - Pod ctest-pod-19415390 verification passed 2024-09-20 19:34:29,859 - INFO - Pod ctest-pod-26338421 is in running state.Got IP 10.47.255.247 2024-09-20 19:34:29,918 - DEBUG - Pod ctest-pod-26338421 has vmi 54a21e14-7787-11ef-ba61-fa163ec7a5d7 2024-09-20 19:34:29,918 - INFO - Verified pod ctest-pod-26338421 in contrail-api 2024-09-20 19:34:29,931 - DEBUG - VMI 54a21e14-7787-11ef-ba61-fa163ec7a5d7 is active in agent 10.0.0.34 2024-09-20 19:34:29,931 - INFO - Verified Pod ctest-pod-26338421 in agent 10.0.0.34 2024-09-20 19:34:29,931 - DEBUG - Requesting: http://10.0.0.52:8108/Snh_VirtualMachineDatabaseList?x=75c86820-fa5c-4324-a23e-7ee4c461a0a2 2024-09-20 19:34:29,936 - INFO - Pod ctest-pod-26338421 with uuid 75c86820-fa5c-4324-a23e-7ee4c461a0a2 found in kube manager 2024-09-20 19:34:29,936 - INFO - Pod ctest-pod-26338421 verification passed 2024-09-20 19:34:29,942 - INFO - Pod ctest-pod-23163492 is in running state.Got IP 10.47.255.245 2024-09-20 19:34:29,967 - DEBUG - Pod ctest-pod-23163492 has vmi 55d56354-7787-11ef-ba61-fa163ec7a5d7 2024-09-20 19:34:29,967 - INFO - Verified pod ctest-pod-23163492 in contrail-api 2024-09-20 19:34:29,982 - DEBUG - VMI 55d56354-7787-11ef-ba61-fa163ec7a5d7 is active in agent 10.0.0.34 2024-09-20 19:34:29,982 - INFO - Verified Pod ctest-pod-23163492 in agent 10.0.0.34 2024-09-20 19:34:29,982 - DEBUG - Requesting: http://10.0.0.52:8108/Snh_VirtualMachineDatabaseList?x=bdbf244a-6779-437f-9930-173e13409e25 2024-09-20 19:34:29,987 - INFO - Pod ctest-pod-23163492 with uuid bdbf244a-6779-437f-9930-173e13409e25 found in kube manager 2024-09-20 19:34:29,987 - INFO - Pod ctest-pod-23163492 verification passed 2024-09-20 19:34:29,993 - DEBUG - Pod ctest-pod-14063729 not in running state.Currently in Pending 2024-09-20 19:34:35,000 - INFO - Pod ctest-pod-14063729 is in running state.Got IP 10.47.255.246 2024-09-20 19:34:35,062 - DEBUG - Pod ctest-pod-14063729 has vmi 55306e8a-7787-11ef-ba61-fa163ec7a5d7 2024-09-20 19:34:35,062 - INFO - Verified pod ctest-pod-14063729 in contrail-api 2024-09-20 19:34:35,075 - DEBUG - VMI 55306e8a-7787-11ef-ba61-fa163ec7a5d7 is active in agent 10.0.0.34 2024-09-20 19:34:35,075 - INFO - Verified Pod ctest-pod-14063729 in agent 10.0.0.34 2024-09-20 19:34:35,075 - DEBUG - Requesting: http://10.0.0.52:8108/Snh_VirtualMachineDatabaseList?x=2d8a5291-4666-4529-b54a-f48428b307ad 2024-09-20 19:34:35,079 - INFO - Pod ctest-pod-14063729 with uuid 2d8a5291-4666-4529-b54a-f48428b307ad found in kube manager 2024-09-20 19:34:35,079 - INFO - Pod ctest-pod-14063729 verification passed 2024-09-20 19:34:35,084 - INFO - Pod ctest-pod-62365315 is in running state.Got IP 10.47.255.244 2024-09-20 19:34:35,101 - DEBUG - Pod ctest-pod-62365315 has vmi 5668da80-7787-11ef-ba61-fa163ec7a5d7 2024-09-20 19:34:35,101 - INFO - Verified pod ctest-pod-62365315 in contrail-api 2024-09-20 19:34:35,114 - DEBUG - VMI 5668da80-7787-11ef-ba61-fa163ec7a5d7 is active in agent 10.0.0.34 2024-09-20 19:34:35,114 - INFO - Verified Pod ctest-pod-62365315 in agent 10.0.0.34 2024-09-20 19:34:35,114 - DEBUG - Requesting: http://10.0.0.52:8108/Snh_VirtualMachineDatabaseList?x=270e1a0f-8fc5-466f-a8dd-0f407503b3b5 2024-09-20 19:34:35,119 - INFO - Pod ctest-pod-62365315 with uuid 270e1a0f-8fc5-466f-a8dd-0f407503b3b5 found in kube manager 2024-09-20 19:34:35,119 - INFO - Pod ctest-pod-62365315 verification passed 2024-09-20 19:34:35,119 - INFO - ================================================================================ 2024-09-20 19:34:35,119 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-09-20 19:34:35,119 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-09-20 19:34:35,310 - DEBUG - Nothing to compare xmpp stats {'10.0.0.34': {'10.0.0.52': '0'}} with 2024-09-20 19:34:35,310 - INFO - Initial checks done. Running the testcase now 2024-09-20 19:34:35,310 - INFO - 2024-09-20 19:34:35,370 - DEBUG - [Pod ctest-pod-99126705] Cmd: echo ctest-pod-99126705 > /usr/share/nginx/html/index.html, Output: 2024-09-20 19:34:35,440 - DEBUG - [Pod ctest-pod-01191461] Cmd: echo ctest-pod-01191461 > /usr/share/nginx/html/index.html, Output: 2024-09-20 19:34:35,510 - DEBUG - [Pod ctest-pod-11924584] Cmd: echo ctest-pod-11924584 > /usr/share/nginx/html/index.html, Output: 2024-09-20 19:34:35,573 - DEBUG - [Pod ctest-pod-19415390] Cmd: echo ctest-pod-19415390 > /usr/share/nginx/html/index.html, Output: 2024-09-20 19:34:35,575 - DEBUG - Service ctest-nginx-svc-90850687 not present 2024-09-20 19:34:35,576 - INFO - Creating service ctest-nginx-svc-90850687 2024-09-20 19:34:35,587 - INFO - Created Service ctest-nginx-svc-90850687 2024-09-20 19:34:35,596 - WARNING - Service UUID b749b359-5b24-41b2-a206-b950dce6aa66 not yet found in contrail-api 2024-09-20 19:34:36,602 - INFO - Validated that Service ctest-nginx-svc-90850687 is seen in contrail-api 2024-09-20 19:34:36,602 - DEBUG - Requesting: http://10.0.0.52:8108/Snh_LoadbalancerDatabaseList?x=b749b359-5b24-41b2-a206-b950dce6aa66 2024-09-20 19:34:36,608 - INFO - Service ctest-nginx-svc-90850687 with uuid b749b359-5b24-41b2-a206-b950dce6aa66 found in kube manager 2024-09-20 19:34:36,608 - INFO - Service ctest-nginx-svc-90850687 verification passed 2024-09-20 19:34:37,690 - DEBUG - [Pod ctest-pod-26338421] Cmd: wget http://10.103.238.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.238.137:80 (10.103.238.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-99126705 2024-09-20 19:34:37,690 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd wget http://10.103.238.137:80/ -O - -T 5 -t 1 passed 2024-09-20 19:34:37,690 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd output: Connecting to 10.103.238.137:80 (10.103.238.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-99126705 2024-09-20 19:34:37,763 - DEBUG - [Pod ctest-pod-26338421] Cmd: wget http://10.103.238.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.238.137:80 (10.103.238.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-99126705 2024-09-20 19:34:37,763 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd wget http://10.103.238.137:80/ -O - -T 5 -t 1 passed 2024-09-20 19:34:37,763 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd output: Connecting to 10.103.238.137:80 (10.103.238.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-99126705 2024-09-20 19:34:37,830 - DEBUG - [Pod ctest-pod-26338421] Cmd: wget http://10.103.238.137:80/ -O - -T 5 -t 1 , Output: ctest-pod-01191461 Connecting to 10.103.238.137:80 (10.103.238.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-20 19:34:37,830 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd wget http://10.103.238.137:80/ -O - -T 5 -t 1 passed 2024-09-20 19:34:37,830 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd output: ctest-pod-01191461 Connecting to 10.103.238.137:80 (10.103.238.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-20 19:34:37,831 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-99126705': 2, 'ctest-pod-01191461': 1} 2024-09-20 19:34:37,900 - DEBUG - [Pod ctest-pod-23163492] Cmd: wget http://10.103.238.137:80/ -O - -T 5 -t 1 , Output: ctest-pod-01191461 Connecting to 10.103.238.137:80 (10.103.238.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-20 19:34:37,900 - DEBUG - [Pod Pod ctest-pod-23163492] Cmd wget http://10.103.238.137:80/ -O - -T 5 -t 1 passed 2024-09-20 19:34:37,900 - DEBUG - [Pod Pod ctest-pod-23163492] Cmd output: ctest-pod-01191461 Connecting to 10.103.238.137:80 (10.103.238.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-20 19:34:37,979 - DEBUG - [Pod ctest-pod-23163492] Cmd: wget http://10.103.238.137:80/ -O - -T 5 -t 1 , Output: ctest-pod-01191461 Connecting to 10.103.238.137:80 (10.103.238.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-20 19:34:37,979 - DEBUG - [Pod Pod ctest-pod-23163492] Cmd wget http://10.103.238.137:80/ -O - -T 5 -t 1 passed 2024-09-20 19:34:37,979 - DEBUG - [Pod Pod ctest-pod-23163492] Cmd output: ctest-pod-01191461 Connecting to 10.103.238.137:80 (10.103.238.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-20 19:34:38,047 - DEBUG - [Pod ctest-pod-23163492] Cmd: wget http://10.103.238.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.238.137:80 (10.103.238.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-99126705 2024-09-20 19:34:38,047 - DEBUG - [Pod Pod ctest-pod-23163492] Cmd wget http://10.103.238.137:80/ -O - -T 5 -t 1 passed 2024-09-20 19:34:38,047 - DEBUG - [Pod Pod ctest-pod-23163492] Cmd output: Connecting to 10.103.238.137:80 (10.103.238.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-99126705 2024-09-20 19:34:38,047 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-99126705': 1, 'ctest-pod-01191461': 2} 2024-09-20 19:34:38,050 - DEBUG - Network policy ingress-on-service not present 2024-09-20 19:34:38,051 - INFO - Creating Network Policy ingress-on-service 2024-09-20 19:34:38,068 - INFO - Network policy found in k8s 2024-09-20 19:34:38,068 - DEBUG - Requesting: http://10.0.0.52:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=7838ca01-0541-4c07-9085-6592e9c80b95 2024-09-20 19:34:38,083 - INFO - Network Policy ingress-on-service with uuid 7838ca01-0541-4c07-9085-6592e9c80b95 found in kube manager 2024-09-20 19:34:38,121 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-09-20 19:34:38,121 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-09-20 19:34:38,121 - DEBUG - Requesting: http://10.0.0.52:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=7838ca01-0541-4c07-9085-6592e9c80b95 2024-09-20 19:34:38,159 - WARNING - Network policy with name ingress-on-service not found in agent 2024-09-20 19:34:40,160 - DEBUG - Requesting: http://10.0.0.52:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=7838ca01-0541-4c07-9085-6592e9c80b95 2024-09-20 19:34:40,198 - INFO - Network policy with name ingress-on-service found in agent 2024-09-20 19:34:40,198 - INFO - Network Policy ingress-on-service verification passed 2024-09-20 19:34:45,253 - DEBUG - [Pod ctest-pod-26338421] Cmd: wget http://10.103.238.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:34:45,253 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd wget http://10.103.238.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:34:45,254 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:34:50,316 - DEBUG - [Pod ctest-pod-26338421] Cmd: wget http://10.103.238.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:34:50,316 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd wget http://10.103.238.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:34:50,316 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:34:55,374 - DEBUG - [Pod ctest-pod-26338421] Cmd: wget http://10.103.238.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:34:55,374 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd wget http://10.103.238.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:34:55,374 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:35:00,449 - DEBUG - [Pod ctest-pod-26338421] Cmd: wget http://10.103.238.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:35:00,450 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd wget http://10.103.238.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:35:00,450 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:35:05,513 - DEBUG - [Pod ctest-pod-26338421] Cmd: wget http://10.103.238.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:35:05,513 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd wget http://10.103.238.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:35:05,513 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:35:10,585 - DEBUG - [Pod ctest-pod-26338421] Cmd: wget http://10.103.238.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:35:10,585 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd wget http://10.103.238.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:35:10,585 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:35:15,645 - DEBUG - [Pod ctest-pod-26338421] Cmd: wget http://10.103.238.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:35:15,645 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd wget http://10.103.238.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:35:15,645 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:35:20,714 - DEBUG - [Pod ctest-pod-26338421] Cmd: wget http://10.103.238.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:35:20,714 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd wget http://10.103.238.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:35:20,714 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:35:25,772 - DEBUG - [Pod ctest-pod-26338421] Cmd: wget http://10.103.238.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:35:25,772 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd wget http://10.103.238.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:35:25,772 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:35:30,834 - DEBUG - [Pod ctest-pod-26338421] Cmd: wget http://10.103.238.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:35:30,834 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd wget http://10.103.238.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:35:30,834 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:35:30,834 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-99126705': 0, 'ctest-pod-01191461': 0} 2024-09-20 19:35:30,897 - DEBUG - [Pod ctest-pod-14063729] Cmd: wget http://10.103.238.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.238.137:80 (10.103.238.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-01191461 2024-09-20 19:35:30,898 - DEBUG - [Pod Pod ctest-pod-14063729] Cmd wget http://10.103.238.137:80/ -O - -T 5 -t 1 passed 2024-09-20 19:35:30,898 - DEBUG - [Pod Pod ctest-pod-14063729] Cmd output: Connecting to 10.103.238.137:80 (10.103.238.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-01191461 2024-09-20 19:35:30,946 - DEBUG - [Pod ctest-pod-14063729] Cmd: wget http://10.103.238.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.238.137:80 (10.103.238.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-99126705 2024-09-20 19:35:30,946 - DEBUG - [Pod Pod ctest-pod-14063729] Cmd wget http://10.103.238.137:80/ -O - -T 5 -t 1 passed 2024-09-20 19:35:30,946 - DEBUG - [Pod Pod ctest-pod-14063729] Cmd output: Connecting to 10.103.238.137:80 (10.103.238.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-99126705 2024-09-20 19:35:30,946 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-99126705': 1, 'ctest-pod-01191461': 1} 2024-09-20 19:35:36,005 - DEBUG - [Pod ctest-pod-23163492] Cmd: wget http://10.103.238.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:35:36,005 - DEBUG - [Pod Pod ctest-pod-23163492] Cmd wget http://10.103.238.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:35:36,005 - DEBUG - [Pod Pod ctest-pod-23163492] Cmd output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:35:41,082 - DEBUG - [Pod ctest-pod-23163492] Cmd: wget http://10.103.238.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:35:41,082 - DEBUG - [Pod Pod ctest-pod-23163492] Cmd wget http://10.103.238.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:35:41,082 - DEBUG - [Pod Pod ctest-pod-23163492] Cmd output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:35:46,153 - DEBUG - [Pod ctest-pod-23163492] Cmd: wget http://10.103.238.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:35:46,153 - DEBUG - [Pod Pod ctest-pod-23163492] Cmd wget http://10.103.238.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:35:46,153 - DEBUG - [Pod Pod ctest-pod-23163492] Cmd output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:35:51,213 - DEBUG - [Pod ctest-pod-23163492] Cmd: wget http://10.103.238.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:35:51,213 - DEBUG - [Pod Pod ctest-pod-23163492] Cmd wget http://10.103.238.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:35:51,213 - DEBUG - [Pod Pod ctest-pod-23163492] Cmd output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:35:56,267 - DEBUG - [Pod ctest-pod-23163492] Cmd: wget http://10.103.238.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:35:56,267 - DEBUG - [Pod Pod ctest-pod-23163492] Cmd wget http://10.103.238.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:35:56,267 - DEBUG - [Pod Pod ctest-pod-23163492] Cmd output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:36:01,350 - DEBUG - [Pod ctest-pod-23163492] Cmd: wget http://10.103.238.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:36:01,350 - DEBUG - [Pod Pod ctest-pod-23163492] Cmd wget http://10.103.238.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:36:01,350 - DEBUG - [Pod Pod ctest-pod-23163492] Cmd output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:36:06,413 - DEBUG - [Pod ctest-pod-23163492] Cmd: wget http://10.103.238.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:36:06,413 - DEBUG - [Pod Pod ctest-pod-23163492] Cmd wget http://10.103.238.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:36:06,413 - DEBUG - [Pod Pod ctest-pod-23163492] Cmd output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:36:11,467 - DEBUG - [Pod ctest-pod-23163492] Cmd: wget http://10.103.238.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:36:11,468 - DEBUG - [Pod Pod ctest-pod-23163492] Cmd wget http://10.103.238.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:36:11,468 - DEBUG - [Pod Pod ctest-pod-23163492] Cmd output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:36:16,529 - DEBUG - [Pod ctest-pod-23163492] Cmd: wget http://10.103.238.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:36:16,529 - DEBUG - [Pod Pod ctest-pod-23163492] Cmd wget http://10.103.238.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:36:16,529 - DEBUG - [Pod Pod ctest-pod-23163492] Cmd output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:36:21,589 - DEBUG - [Pod ctest-pod-23163492] Cmd: wget http://10.103.238.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:36:21,589 - DEBUG - [Pod Pod ctest-pod-23163492] Cmd wget http://10.103.238.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:36:21,589 - DEBUG - [Pod Pod ctest-pod-23163492] Cmd output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:36:21,589 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-99126705': 0, 'ctest-pod-01191461': 0} 2024-09-20 19:36:23,659 - DEBUG - [Pod ctest-pod-14063729] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.875 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.077 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.090 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.077/0.347/0.875 ms 2024-09-20 19:36:23,659 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-14063729 with expectation True passed 2024-09-20 19:36:25,706 - DEBUG - [Pod ctest-pod-26338421] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.738 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.082 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.297/0.738 ms 2024-09-20 19:36:25,706 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-26338421 with expectation True passed 2024-09-20 19:36:27,770 - DEBUG - [Pod ctest-pod-23163492] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.762 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.073 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.088 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.073/0.307/0.762 ms 2024-09-20 19:36:27,770 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-23163492 with expectation True passed 2024-09-20 19:36:27,825 - DEBUG - [Pod ctest-pod-14063729] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-20 19:36:27,825 - DEBUG - [Pod Pod ctest-pod-14063729] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-20 19:36:27,825 - DEBUG - [Pod Pod ctest-pod-14063729] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-20 19:36:27,825 - INFO - wget check of of http://10.47.255.251 from ctest-pod-14063729 passed 2024-09-20 19:36:27,886 - DEBUG - [Pod ctest-pod-14063729] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-20 19:36:27,886 - DEBUG - [Pod Pod ctest-pod-14063729] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-09-20 19:36:27,886 - DEBUG - [Pod Pod ctest-pod-14063729] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-20 19:36:27,886 - INFO - wget check of of http://10.47.255.250 from ctest-pod-14063729 passed 2024-09-20 19:36:32,949 - DEBUG - [Pod ctest-pod-26338421] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-20 19:36:32,949 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-20 19:36:32,949 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-20 19:36:32,949 - INFO - wget check of of http://10.47.255.250 from ctest-pod-26338421 passed 2024-09-20 19:36:38,013 - DEBUG - [Pod ctest-pod-62365315] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-20 19:36:38,013 - DEBUG - [Pod Pod ctest-pod-62365315] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-20 19:36:38,013 - DEBUG - [Pod Pod ctest-pod-62365315] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-20 19:36:38,013 - INFO - wget check of of http://10.47.255.251 from ctest-pod-62365315 passed 2024-09-20 19:36:38,022 - INFO - Updating Network Policy ingress-on-service 2024-09-20 19:36:43,109 - DEBUG - [Pod ctest-pod-26338421] Cmd: wget http://10.103.238.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:36:43,109 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd wget http://10.103.238.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:36:43,109 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:36:48,166 - DEBUG - [Pod ctest-pod-26338421] Cmd: wget http://10.103.238.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:36:48,167 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd wget http://10.103.238.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:36:48,167 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:36:53,233 - DEBUG - [Pod ctest-pod-26338421] Cmd: wget http://10.103.238.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:36:53,233 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd wget http://10.103.238.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:36:53,233 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:36:58,285 - DEBUG - [Pod ctest-pod-26338421] Cmd: wget http://10.103.238.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:36:58,285 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd wget http://10.103.238.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:36:58,285 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:37:03,367 - DEBUG - [Pod ctest-pod-26338421] Cmd: wget http://10.103.238.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:37:03,367 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd wget http://10.103.238.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:37:03,367 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:37:06,504 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2024-09-20 19:37:16,897 - DEBUG - [Pod ctest-pod-26338421] Cmd: wget http://10.103.238.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:37:16,897 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd wget http://10.103.238.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:37:16,898 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:37:21,959 - DEBUG - [Pod ctest-pod-26338421] Cmd: wget http://10.103.238.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:37:21,959 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd wget http://10.103.238.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:37:21,959 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:37:27,028 - DEBUG - [Pod ctest-pod-26338421] Cmd: wget http://10.103.238.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:37:27,028 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd wget http://10.103.238.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:37:27,029 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:37:32,090 - DEBUG - [Pod ctest-pod-26338421] Cmd: wget http://10.103.238.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:37:32,090 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd wget http://10.103.238.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:37:32,090 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:37:37,158 - DEBUG - [Pod ctest-pod-26338421] Cmd: wget http://10.103.238.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:37:37,158 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd wget http://10.103.238.137:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:37:37,158 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd output: Connecting to 10.103.238.137:80 (10.103.238.137:80) wget: download timed out 2024-09-20 19:37:37,158 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-99126705': 0, 'ctest-pod-01191461': 0} 2024-09-20 19:37:37,235 - DEBUG - [Pod ctest-pod-14063729] Cmd: wget http://10.103.238.137:80/ -O - -T 5 -t 1 , Output: ctest-pod-01191461 Connecting to 10.103.238.137:80 (10.103.238.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-20 19:37:37,235 - DEBUG - [Pod Pod ctest-pod-14063729] Cmd wget http://10.103.238.137:80/ -O - -T 5 -t 1 passed 2024-09-20 19:37:37,235 - DEBUG - [Pod Pod ctest-pod-14063729] Cmd output: ctest-pod-01191461 Connecting to 10.103.238.137:80 (10.103.238.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-20 19:37:37,304 - DEBUG - [Pod ctest-pod-14063729] Cmd: wget http://10.103.238.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.238.137:80 (10.103.238.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-99126705 2024-09-20 19:37:37,304 - DEBUG - [Pod Pod ctest-pod-14063729] Cmd wget http://10.103.238.137:80/ -O - -T 5 -t 1 passed 2024-09-20 19:37:37,304 - DEBUG - [Pod Pod ctest-pod-14063729] Cmd output: Connecting to 10.103.238.137:80 (10.103.238.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-99126705 2024-09-20 19:37:37,305 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-99126705': 1, 'ctest-pod-01191461': 1} 2024-09-20 19:37:37,368 - DEBUG - [Pod ctest-pod-23163492] Cmd: wget http://10.103.238.137:80/ -O - -T 5 -t 1 , Output: ctest-pod-99126705 Connecting to 10.103.238.137:80 (10.103.238.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-20 19:37:37,368 - DEBUG - [Pod Pod ctest-pod-23163492] Cmd wget http://10.103.238.137:80/ -O - -T 5 -t 1 passed 2024-09-20 19:37:37,368 - DEBUG - [Pod Pod ctest-pod-23163492] Cmd output: ctest-pod-99126705 Connecting to 10.103.238.137:80 (10.103.238.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-20 19:37:37,425 - DEBUG - [Pod ctest-pod-23163492] Cmd: wget http://10.103.238.137:80/ -O - -T 5 -t 1 , Output: ctest-pod-99126705 Connecting to 10.103.238.137:80 (10.103.238.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-20 19:37:37,425 - DEBUG - [Pod Pod ctest-pod-23163492] Cmd wget http://10.103.238.137:80/ -O - -T 5 -t 1 passed 2024-09-20 19:37:37,425 - DEBUG - [Pod Pod ctest-pod-23163492] Cmd output: ctest-pod-99126705 Connecting to 10.103.238.137:80 (10.103.238.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-20 19:37:37,492 - DEBUG - [Pod ctest-pod-23163492] Cmd: wget http://10.103.238.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.238.137:80 (10.103.238.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-99126705 2024-09-20 19:37:37,492 - DEBUG - [Pod Pod ctest-pod-23163492] Cmd wget http://10.103.238.137:80/ -O - -T 5 -t 1 passed 2024-09-20 19:37:37,492 - DEBUG - [Pod Pod ctest-pod-23163492] Cmd output: Connecting to 10.103.238.137:80 (10.103.238.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-99126705 2024-09-20 19:37:37,566 - DEBUG - [Pod ctest-pod-23163492] Cmd: wget http://10.103.238.137:80/ -O - -T 5 -t 1 , Output: ctest-pod-99126705 Connecting to 10.103.238.137:80 (10.103.238.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-20 19:37:37,566 - DEBUG - [Pod Pod ctest-pod-23163492] Cmd wget http://10.103.238.137:80/ -O - -T 5 -t 1 passed 2024-09-20 19:37:37,566 - DEBUG - [Pod Pod ctest-pod-23163492] Cmd output: ctest-pod-99126705 Connecting to 10.103.238.137:80 (10.103.238.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-20 19:37:37,644 - DEBUG - [Pod ctest-pod-23163492] Cmd: wget http://10.103.238.137:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.238.137:80 (10.103.238.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-01191461 2024-09-20 19:37:37,644 - DEBUG - [Pod Pod ctest-pod-23163492] Cmd wget http://10.103.238.137:80/ -O - -T 5 -t 1 passed 2024-09-20 19:37:37,644 - DEBUG - [Pod Pod ctest-pod-23163492] Cmd output: Connecting to 10.103.238.137:80 (10.103.238.137:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-01191461 2024-09-20 19:37:37,644 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-99126705': 4, 'ctest-pod-01191461': 1} 2024-09-20 19:37:39,705 - DEBUG - [Pod ctest-pod-14063729] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.245 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.087 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.078 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.078/0.470/1.245 ms 2024-09-20 19:37:39,706 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-14063729 with expectation True passed 2024-09-20 19:37:41,778 - DEBUG - [Pod ctest-pod-26338421] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.236 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.095 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.100 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.095/0.477/1.236 ms 2024-09-20 19:37:41,778 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-26338421 with expectation True passed 2024-09-20 19:37:43,833 - DEBUG - [Pod ctest-pod-23163492] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.735 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.090 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.298/0.735 ms 2024-09-20 19:37:43,834 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-23163492 with expectation True passed 2024-09-20 19:37:43,896 - DEBUG - [Pod ctest-pod-14063729] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-20 19:37:43,896 - DEBUG - [Pod Pod ctest-pod-14063729] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-20 19:37:43,896 - DEBUG - [Pod Pod ctest-pod-14063729] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-20 19:37:43,897 - INFO - wget check of of http://10.47.255.251 from ctest-pod-14063729 passed 2024-09-20 19:37:43,962 - DEBUG - [Pod ctest-pod-14063729] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-20 19:37:43,963 - DEBUG - [Pod Pod ctest-pod-14063729] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-09-20 19:37:43,963 - DEBUG - [Pod Pod ctest-pod-14063729] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-20 19:37:43,963 - INFO - wget check of of http://10.47.255.250 from ctest-pod-14063729 passed 2024-09-20 19:37:49,033 - DEBUG - [Pod ctest-pod-26338421] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-20 19:37:49,033 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-20 19:37:49,033 - DEBUG - [Pod Pod ctest-pod-26338421] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-20 19:37:49,033 - INFO - wget check of of http://10.47.255.250 from ctest-pod-26338421 passed 2024-09-20 19:37:49,101 - DEBUG - [Pod ctest-pod-62365315] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-20 19:37:49,101 - DEBUG - [Pod Pod ctest-pod-62365315] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-20 19:37:49,101 - DEBUG - [Pod Pod ctest-pod-62365315] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-20 19:37:49,101 - INFO - wget check of of http://10.47.255.251 from ctest-pod-62365315 passed 2024-09-20 19:37:49,102 - INFO - Deleting Network Policy : ingress-on-service 2024-09-20 19:37:49,102 - INFO - Deleting service : ctest-nginx-svc-90850687 2024-09-20 19:37:49,329 - DEBUG - No XMPP flaps were noticed during the test 2024-09-20 19:37:49,330 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:14] 2024-09-20 19:37:49,330 - INFO - -------------------------------------------------------------------------------- 2024-09-20 19:37:49,335 - INFO - Deleting pod ctest-new-default-40072181:ctest-pod-99126705 2024-09-20 19:37:49,336 - INFO - Deleting pod ctest-new-default-40072181:ctest-pod-01191461 2024-09-20 19:37:49,336 - INFO - Deleting pod ctest-non-default-14533403:ctest-pod-11924584 2024-09-20 19:37:49,336 - INFO - Deleting pod ctest-non-default-14533403:ctest-pod-19415390 2024-09-20 19:37:49,337 - INFO - Deleting pod ctest-new-default-40072181:ctest-pod-26338421 2024-09-20 19:37:49,337 - INFO - Deleting pod ctest-new-default-40072181:ctest-pod-14063729 2024-09-20 19:37:49,337 - INFO - Deleting pod ctest-non-default-14533403:ctest-pod-23163492 2024-09-20 19:37:49,338 - INFO - Deleting pod ctest-non-default-14533403:ctest-pod-62365315 2024-09-20 19:37:49,417 - WARNING - Pod uuid 3f8bfe2c-2183-4f95-82f1-688aefba34b7 is still seen in agent 10.0.0.34 VM list 2024-09-20 19:37:49,472 - WARNING - Pod uuid 270e1a0f-8fc5-466f-a8dd-0f407503b3b5 is still seen in agent 10.0.0.34 VM list 2024-09-20 19:37:49,474 - WARNING - Pod uuid 2ecb2e5e-e98c-42d5-b5fd-612ac1bcf1aa is still seen in agent 10.0.0.34 VM list 2024-09-20 19:37:49,474 - WARNING - Pod uuid 2d8a5291-4666-4529-b54a-f48428b307ad is still seen in agent 10.0.0.34 VM list 2024-09-20 19:37:49,475 - WARNING - Pod uuid b1f1ddff-5a29-4b11-b4a0-86343fafc96e is still seen in agent 10.0.0.34 VM list 2024-09-20 19:37:49,475 - WARNING - Pod uuid 75c86820-fa5c-4324-a23e-7ee4c461a0a2 is still seen in agent 10.0.0.34 VM list 2024-09-20 19:37:49,476 - WARNING - Pod uuid bdbf244a-6779-437f-9930-173e13409e25 is still seen in agent 10.0.0.34 VM list 2024-09-20 19:37:49,476 - WARNING - Pod uuid 7b3956ab-7574-4f23-ab17-fa4deeac01c3 is still seen in agent 10.0.0.34 VM list 2024-09-20 19:37:54,424 - DEBUG - Pod 3f8bfe2c-2183-4f95-82f1-688aefba34b7 is not in agent 10.0.0.34 VM list 2024-09-20 19:37:54,430 - DEBUG - VMI 523a16cc-7787-11ef-ba61-fa163ec7a5d7 is removed from agent 10.0.0.34 2024-09-20 19:37:54,430 - INFO - Verified that pod ctest-pod-99126705 is removed in agent 2024-09-20 19:37:54,501 - WARNING - Pod uuid bdbf244a-6779-437f-9930-173e13409e25 is still seen in agent 10.0.0.34 VM list 2024-09-20 19:37:54,502 - DEBUG - Pod b1f1ddff-5a29-4b11-b4a0-86343fafc96e is not in agent 10.0.0.34 VM list 2024-09-20 19:37:54,503 - DEBUG - Pod 2ecb2e5e-e98c-42d5-b5fd-612ac1bcf1aa is not in agent 10.0.0.34 VM list 2024-09-20 19:37:54,505 - WARNING - Pod uuid 75c86820-fa5c-4324-a23e-7ee4c461a0a2 is still seen in agent 10.0.0.34 VM list 2024-09-20 19:37:54,505 - WARNING - Pod uuid 270e1a0f-8fc5-466f-a8dd-0f407503b3b5 is still seen in agent 10.0.0.34 VM list 2024-09-20 19:37:54,507 - DEBUG - Pod 7b3956ab-7574-4f23-ab17-fa4deeac01c3 is not in agent 10.0.0.34 VM list 2024-09-20 19:37:54,509 - WARNING - Pod uuid 2d8a5291-4666-4529-b54a-f48428b307ad is still seen in agent 10.0.0.34 VM list 2024-09-20 19:37:54,518 - DEBUG - VMI 52bd2c10-7787-11ef-ba61-fa163ec7a5d7 is removed from agent 10.0.0.34 2024-09-20 19:37:54,518 - INFO - Verified that pod ctest-pod-01191461 is removed in agent 2024-09-20 19:37:54,520 - DEBUG - VMI 53ee7972-7787-11ef-ba61-fa163ec7a5d7 is removed from agent 10.0.0.34 2024-09-20 19:37:54,520 - INFO - Verified that pod ctest-pod-19415390 is removed in agent 2024-09-20 19:37:54,521 - DEBUG - VMI 5367daa2-7787-11ef-ba61-fa163ec7a5d7 is removed from agent 10.0.0.34 2024-09-20 19:37:54,521 - INFO - Verified that pod ctest-pod-11924584 is removed in agent 2024-09-20 19:37:59,512 - WARNING - Pod uuid bdbf244a-6779-437f-9930-173e13409e25 is still seen in agent 10.0.0.34 VM list 2024-09-20 19:37:59,518 - WARNING - Pod uuid 2d8a5291-4666-4529-b54a-f48428b307ad is still seen in agent 10.0.0.34 VM list 2024-09-20 19:37:59,519 - WARNING - Pod uuid 75c86820-fa5c-4324-a23e-7ee4c461a0a2 is still seen in agent 10.0.0.34 VM list 2024-09-20 19:37:59,519 - WARNING - Pod uuid 270e1a0f-8fc5-466f-a8dd-0f407503b3b5 is still seen in agent 10.0.0.34 VM list 2024-09-20 19:38:04,520 - WARNING - Pod uuid bdbf244a-6779-437f-9930-173e13409e25 is still seen in agent 10.0.0.34 VM list 2024-09-20 19:38:04,534 - WARNING - Pod uuid 2d8a5291-4666-4529-b54a-f48428b307ad is still seen in agent 10.0.0.34 VM list 2024-09-20 19:38:04,535 - WARNING - Pod uuid 75c86820-fa5c-4324-a23e-7ee4c461a0a2 is still seen in agent 10.0.0.34 VM list 2024-09-20 19:38:04,536 - WARNING - Pod uuid 270e1a0f-8fc5-466f-a8dd-0f407503b3b5 is still seen in agent 10.0.0.34 VM list 2024-09-20 19:38:09,530 - WARNING - Pod uuid bdbf244a-6779-437f-9930-173e13409e25 is still seen in agent 10.0.0.34 VM list 2024-09-20 19:38:09,548 - WARNING - Pod uuid 2d8a5291-4666-4529-b54a-f48428b307ad is still seen in agent 10.0.0.34 VM list 2024-09-20 19:38:09,550 - WARNING - Pod uuid 270e1a0f-8fc5-466f-a8dd-0f407503b3b5 is still seen in agent 10.0.0.34 VM list 2024-09-20 19:38:09,550 - WARNING - Pod uuid 75c86820-fa5c-4324-a23e-7ee4c461a0a2 is still seen in agent 10.0.0.34 VM list 2024-09-20 19:38:14,537 - WARNING - Pod uuid bdbf244a-6779-437f-9930-173e13409e25 is still seen in agent 10.0.0.34 VM list 2024-09-20 19:38:14,563 - WARNING - Pod uuid 2d8a5291-4666-4529-b54a-f48428b307ad is still seen in agent 10.0.0.34 VM list 2024-09-20 19:38:14,564 - WARNING - Pod uuid 270e1a0f-8fc5-466f-a8dd-0f407503b3b5 is still seen in agent 10.0.0.34 VM list 2024-09-20 19:38:14,565 - WARNING - Pod uuid 75c86820-fa5c-4324-a23e-7ee4c461a0a2 is still seen in agent 10.0.0.34 VM list 2024-09-20 19:38:19,545 - WARNING - Pod uuid bdbf244a-6779-437f-9930-173e13409e25 is still seen in agent 10.0.0.34 VM list 2024-09-20 19:38:19,578 - WARNING - Pod uuid 2d8a5291-4666-4529-b54a-f48428b307ad is still seen in agent 10.0.0.34 VM list 2024-09-20 19:38:19,580 - WARNING - Pod uuid 75c86820-fa5c-4324-a23e-7ee4c461a0a2 is still seen in agent 10.0.0.34 VM list 2024-09-20 19:38:19,580 - WARNING - Pod uuid 270e1a0f-8fc5-466f-a8dd-0f407503b3b5 is still seen in agent 10.0.0.34 VM list 2024-09-20 19:38:24,552 - DEBUG - Pod bdbf244a-6779-437f-9930-173e13409e25 is not in agent 10.0.0.34 VM list 2024-09-20 19:38:24,558 - DEBUG - VMI 55d56354-7787-11ef-ba61-fa163ec7a5d7 is removed from agent 10.0.0.34 2024-09-20 19:38:24,558 - INFO - Verified that pod ctest-pod-23163492 is removed in agent 2024-09-20 19:38:24,593 - DEBUG - Pod 2d8a5291-4666-4529-b54a-f48428b307ad is not in agent 10.0.0.34 VM list 2024-09-20 19:38:24,595 - DEBUG - Pod 75c86820-fa5c-4324-a23e-7ee4c461a0a2 is not in agent 10.0.0.34 VM list 2024-09-20 19:38:24,597 - DEBUG - Pod 270e1a0f-8fc5-466f-a8dd-0f407503b3b5 is not in agent 10.0.0.34 VM list 2024-09-20 19:38:24,606 - DEBUG - VMI 55306e8a-7787-11ef-ba61-fa163ec7a5d7 is removed from agent 10.0.0.34 2024-09-20 19:38:24,606 - INFO - Verified that pod ctest-pod-14063729 is removed in agent 2024-09-20 19:38:24,608 - DEBUG - VMI 54a21e14-7787-11ef-ba61-fa163ec7a5d7 is removed from agent 10.0.0.34 2024-09-20 19:38:24,608 - INFO - Verified that pod ctest-pod-26338421 is removed in agent 2024-09-20 19:38:24,608 - DEBUG - VMI 5668da80-7787-11ef-ba61-fa163ec7a5d7 is removed from agent 10.0.0.34 2024-09-20 19:38:24,608 - INFO - Verified that pod ctest-pod-62365315 is removed in agent 2024-09-20 19:38:24,608 - INFO - Deleting namespace ctest-non-default-14533403 2024-09-20 19:38:24,628 - DEBUG - Namespace ctest-non-default-14533403 still in k8s 2024-09-20 19:38:26,632 - DEBUG - Namespace ctest-non-default-14533403 still in k8s 2024-09-20 19:38:28,637 - DEBUG - Namespace ctest-non-default-14533403 still in k8s 2024-09-20 19:38:30,641 - DEBUG - Namespace ctest-non-default-14533403 is not in k8s 2024-09-20 19:38:30,641 - DEBUG - No need to check project deletion in contrail-api 2024-09-20 19:38:30,641 - INFO - Deleting namespace ctest-new-default-40072181 2024-09-20 19:38:30,649 - DEBUG - Namespace ctest-new-default-40072181 still in k8s 2024-09-20 19:38:32,654 - DEBUG - Namespace ctest-new-default-40072181 still in k8s 2024-09-20 19:38:34,660 - DEBUG - Namespace ctest-new-default-40072181 still in k8s 2024-09-20 19:38:36,664 - DEBUG - Namespace ctest-new-default-40072181 is not in k8s 2024-09-20 19:38:36,664 - DEBUG - No need to check project deletion in contrail-api