2025-11-20 16:50:27,624 - INFO - Using existing project ['default-domain', 'k8s-default'](83624f46-bb05-40e1-83e7-ce2affb33b7a) 2025-11-20 16:50:27,645 - DEBUG - Namespace ctest-new-default-52171645 not present 2025-11-20 16:50:27,653 - INFO - Created namespace ctest-new-default-52171645 2025-11-20 16:50:30,657 - DEBUG - Namespace ctest-non-default-50906561 not present 2025-11-20 16:50:30,664 - INFO - Created namespace ctest-non-default-50906561 2025-11-20 16:50:33,683 - DEBUG - Pod ctest-pod-01573911 not present 2025-11-20 16:50:33,684 - INFO - Creating Pod ctest-pod-01573911 2025-11-20 16:50:33,743 - DEBUG - Pod : ctest-pod-01573911 UUID is e514bd6b-af40-447d-b360-c96ad26ec908 2025-11-20 16:50:33,753 - DEBUG - Pod ctest-pod-74984365 not present 2025-11-20 16:50:33,755 - INFO - Creating Pod ctest-pod-74984365 2025-11-20 16:50:33,797 - DEBUG - Pod : ctest-pod-74984365 UUID is 447f0177-c070-4bcb-9d02-65b285755125 2025-11-20 16:50:33,799 - DEBUG - Pod ctest-pod-07913667 not present 2025-11-20 16:50:33,800 - INFO - Creating Pod ctest-pod-07913667 2025-11-20 16:50:33,819 - DEBUG - Pod : ctest-pod-07913667 UUID is 54cdde90-3e0d-489b-8130-d4725d19ccc1 2025-11-20 16:50:33,822 - DEBUG - Pod ctest-pod-64155597 not present 2025-11-20 16:50:33,823 - INFO - Creating Pod ctest-pod-64155597 2025-11-20 16:50:33,851 - DEBUG - Pod : ctest-pod-64155597 UUID is 2d87d324-ab72-404c-9f7c-c97a746206b7 2025-11-20 16:50:33,853 - DEBUG - Pod ctest-pod-90613106 not present 2025-11-20 16:50:33,853 - INFO - Creating Pod ctest-pod-90613106 2025-11-20 16:50:33,879 - DEBUG - Pod : ctest-pod-90613106 UUID is 6a9b9c40-6c05-452d-ba7b-330154385de0 2025-11-20 16:50:33,881 - DEBUG - Pod ctest-pod-24808513 not present 2025-11-20 16:50:33,881 - INFO - Creating Pod ctest-pod-24808513 2025-11-20 16:50:33,900 - DEBUG - Pod : ctest-pod-24808513 UUID is 2bbc003c-c163-4ebe-bdd0-53180f78d242 2025-11-20 16:50:33,902 - DEBUG - Pod ctest-pod-04949678 not present 2025-11-20 16:50:33,902 - INFO - Creating Pod ctest-pod-04949678 2025-11-20 16:50:33,925 - DEBUG - Pod : ctest-pod-04949678 UUID is a3725d43-bc70-4c5e-8903-74a486786625 2025-11-20 16:50:33,927 - DEBUG - Pod ctest-pod-35423603 not present 2025-11-20 16:50:33,928 - INFO - Creating Pod ctest-pod-35423603 2025-11-20 16:50:33,964 - DEBUG - Pod : ctest-pod-35423603 UUID is 527115c3-d8b4-4269-b8b1-51a31e361d5f 2025-11-20 16:50:34,154 - INFO - Project default-domain:k8s-ctest-new-default-52171645 for Namespace ctest-new-default-52171645 is seen in contrail-api 2025-11-20 16:50:34,154 - DEBUG - Project uuid in Contrail is 235c3b5a-e25b-4e8a-bf49-d5fa937390b8 2025-11-20 16:50:34,320 - DEBUG - Requesting: http://10.0.0.128:8108/Snh_NamespaceDatabaseList?namespace_uuid=b893157f-338c-4141-a4d1-12ea40c3a52b 2025-11-20 16:50:34,324 - INFO - Namespace ctest-new-default-52171645 with uuid b893157f-338c-4141-a4d1-12ea40c3a52b found in kube manager 2025-11-20 16:50:34,324 - INFO - Namespace ctest-new-default-52171645 verification passed 2025-11-20 16:50:34,491 - INFO - Project default-domain:k8s-ctest-non-default-50906561 for Namespace ctest-non-default-50906561 is seen in contrail-api 2025-11-20 16:50:34,492 - DEBUG - Project uuid in Contrail is f548e4a8-3a1e-4d1a-891f-ba1d3f84f35d 2025-11-20 16:50:34,493 - DEBUG - Requesting: http://10.0.0.128:8108/Snh_NamespaceDatabaseList?namespace_uuid=ba7f0b32-9d7a-4bd1-94af-d29c29aa793f 2025-11-20 16:50:34,498 - INFO - Namespace ctest-non-default-50906561 with uuid ba7f0b32-9d7a-4bd1-94af-d29c29aa793f found in kube manager 2025-11-20 16:50:34,498 - INFO - Namespace ctest-non-default-50906561 verification passed 2025-11-20 16:50:34,504 - DEBUG - Pod ctest-pod-01573911 not in running state.Currently in Pending 2025-11-20 16:50:39,512 - DEBUG - Pod ctest-pod-01573911 not in running state.Currently in Pending 2025-11-20 16:50:44,518 - DEBUG - Pod ctest-pod-01573911 not in running state.Currently in Pending 2025-11-20 16:50:49,533 - INFO - Pod ctest-pod-01573911 is in running state.Got IP 10.47.255.251 2025-11-20 16:50:49,585 - DEBUG - Pod ctest-pod-01573911 has vmi 08dbc026-c631-11f0-895f-fa163e4ed8f4 2025-11-20 16:50:49,585 - INFO - Verified pod ctest-pod-01573911 in contrail-api 2025-11-20 16:50:49,599 - DEBUG - VMI 08dbc026-c631-11f0-895f-fa163e4ed8f4 is active in agent 10.0.0.72 2025-11-20 16:50:49,599 - INFO - Verified Pod ctest-pod-01573911 in agent 10.0.0.72 2025-11-20 16:50:49,599 - DEBUG - Requesting: http://10.0.0.128:8108/Snh_VirtualMachineDatabaseList?x=e514bd6b-af40-447d-b360-c96ad26ec908 2025-11-20 16:50:49,603 - INFO - Pod ctest-pod-01573911 with uuid e514bd6b-af40-447d-b360-c96ad26ec908 found in kube manager 2025-11-20 16:50:49,603 - INFO - Pod ctest-pod-01573911 verification passed 2025-11-20 16:50:49,610 - INFO - Pod ctest-pod-74984365 is in running state.Got IP 10.47.255.250 2025-11-20 16:50:49,621 - DEBUG - Pod ctest-pod-74984365 has vmi 094ac71e-c631-11f0-895f-fa163e4ed8f4 2025-11-20 16:50:49,621 - INFO - Verified pod ctest-pod-74984365 in contrail-api 2025-11-20 16:50:49,633 - DEBUG - VMI 094ac71e-c631-11f0-895f-fa163e4ed8f4 is active in agent 10.0.0.72 2025-11-20 16:50:49,633 - INFO - Verified Pod ctest-pod-74984365 in agent 10.0.0.72 2025-11-20 16:50:49,633 - DEBUG - Requesting: http://10.0.0.128:8108/Snh_VirtualMachineDatabaseList?x=447f0177-c070-4bcb-9d02-65b285755125 2025-11-20 16:50:49,637 - INFO - Pod ctest-pod-74984365 with uuid 447f0177-c070-4bcb-9d02-65b285755125 found in kube manager 2025-11-20 16:50:49,637 - INFO - Pod ctest-pod-74984365 verification passed 2025-11-20 16:50:49,643 - INFO - Pod ctest-pod-07913667 is in running state.Got IP 10.47.255.249 2025-11-20 16:50:49,695 - DEBUG - Pod ctest-pod-07913667 has vmi 09de9c0a-c631-11f0-895f-fa163e4ed8f4 2025-11-20 16:50:49,695 - INFO - Verified pod ctest-pod-07913667 in contrail-api 2025-11-20 16:50:49,708 - DEBUG - VMI 09de9c0a-c631-11f0-895f-fa163e4ed8f4 is active in agent 10.0.0.72 2025-11-20 16:50:49,708 - INFO - Verified Pod ctest-pod-07913667 in agent 10.0.0.72 2025-11-20 16:50:49,708 - DEBUG - Requesting: http://10.0.0.128:8108/Snh_VirtualMachineDatabaseList?x=54cdde90-3e0d-489b-8130-d4725d19ccc1 2025-11-20 16:50:49,712 - INFO - Pod ctest-pod-07913667 with uuid 54cdde90-3e0d-489b-8130-d4725d19ccc1 found in kube manager 2025-11-20 16:50:49,712 - INFO - Pod ctest-pod-07913667 verification passed 2025-11-20 16:50:49,718 - INFO - Pod ctest-pod-64155597 is in running state.Got IP 10.47.255.248 2025-11-20 16:50:49,773 - DEBUG - Pod ctest-pod-64155597 has vmi 0a4ad8e8-c631-11f0-895f-fa163e4ed8f4 2025-11-20 16:50:49,773 - INFO - Verified pod ctest-pod-64155597 in contrail-api 2025-11-20 16:50:49,784 - DEBUG - VMI 0a4ad8e8-c631-11f0-895f-fa163e4ed8f4 is active in agent 10.0.0.72 2025-11-20 16:50:49,785 - INFO - Verified Pod ctest-pod-64155597 in agent 10.0.0.72 2025-11-20 16:50:49,785 - DEBUG - Requesting: http://10.0.0.128:8108/Snh_VirtualMachineDatabaseList?x=2d87d324-ab72-404c-9f7c-c97a746206b7 2025-11-20 16:50:49,788 - INFO - Pod ctest-pod-64155597 with uuid 2d87d324-ab72-404c-9f7c-c97a746206b7 found in kube manager 2025-11-20 16:50:49,788 - INFO - Pod ctest-pod-64155597 verification passed 2025-11-20 16:50:49,794 - DEBUG - Pod ctest-pod-90613106 not in running state.Currently in Pending 2025-11-20 16:50:54,801 - INFO - Pod ctest-pod-90613106 is in running state.Got IP 10.47.255.247 2025-11-20 16:50:54,826 - DEBUG - Pod ctest-pod-90613106 has vmi 0acc729a-c631-11f0-895f-fa163e4ed8f4 2025-11-20 16:50:54,826 - INFO - Verified pod ctest-pod-90613106 in contrail-api 2025-11-20 16:50:54,838 - DEBUG - VMI 0acc729a-c631-11f0-895f-fa163e4ed8f4 is active in agent 10.0.0.72 2025-11-20 16:50:54,838 - INFO - Verified Pod ctest-pod-90613106 in agent 10.0.0.72 2025-11-20 16:50:54,838 - DEBUG - Requesting: http://10.0.0.128:8108/Snh_VirtualMachineDatabaseList?x=6a9b9c40-6c05-452d-ba7b-330154385de0 2025-11-20 16:50:54,842 - INFO - Pod ctest-pod-90613106 with uuid 6a9b9c40-6c05-452d-ba7b-330154385de0 found in kube manager 2025-11-20 16:50:54,842 - INFO - Pod ctest-pod-90613106 verification passed 2025-11-20 16:50:54,848 - INFO - Pod ctest-pod-04949678 is in running state.Got IP 10.47.255.245 2025-11-20 16:50:54,858 - DEBUG - Pod ctest-pod-04949678 has vmi 0b9faffc-c631-11f0-895f-fa163e4ed8f4 2025-11-20 16:50:54,858 - INFO - Verified pod ctest-pod-04949678 in contrail-api 2025-11-20 16:50:54,870 - DEBUG - VMI 0b9faffc-c631-11f0-895f-fa163e4ed8f4 is active in agent 10.0.0.72 2025-11-20 16:50:54,870 - INFO - Verified Pod ctest-pod-04949678 in agent 10.0.0.72 2025-11-20 16:50:54,870 - DEBUG - Requesting: http://10.0.0.128:8108/Snh_VirtualMachineDatabaseList?x=a3725d43-bc70-4c5e-8903-74a486786625 2025-11-20 16:50:54,873 - INFO - Pod ctest-pod-04949678 with uuid a3725d43-bc70-4c5e-8903-74a486786625 found in kube manager 2025-11-20 16:50:54,873 - INFO - Pod ctest-pod-04949678 verification passed 2025-11-20 16:50:54,879 - INFO - Pod ctest-pod-24808513 is in running state.Got IP 10.47.255.246 2025-11-20 16:50:54,936 - DEBUG - Pod ctest-pod-24808513 has vmi 0b3680a4-c631-11f0-895f-fa163e4ed8f4 2025-11-20 16:50:54,936 - INFO - Verified pod ctest-pod-24808513 in contrail-api 2025-11-20 16:50:54,950 - DEBUG - VMI 0b3680a4-c631-11f0-895f-fa163e4ed8f4 is active in agent 10.0.0.72 2025-11-20 16:50:54,950 - INFO - Verified Pod ctest-pod-24808513 in agent 10.0.0.72 2025-11-20 16:50:54,950 - DEBUG - Requesting: http://10.0.0.128:8108/Snh_VirtualMachineDatabaseList?x=2bbc003c-c163-4ebe-bdd0-53180f78d242 2025-11-20 16:50:54,954 - INFO - Pod ctest-pod-24808513 with uuid 2bbc003c-c163-4ebe-bdd0-53180f78d242 found in kube manager 2025-11-20 16:50:54,954 - INFO - Pod ctest-pod-24808513 verification passed 2025-11-20 16:50:54,960 - INFO - Pod ctest-pod-35423603 is in running state.Got IP 10.47.255.244 2025-11-20 16:50:54,971 - DEBUG - Pod ctest-pod-35423603 has vmi 0c0d7604-c631-11f0-895f-fa163e4ed8f4 2025-11-20 16:50:54,971 - INFO - Verified pod ctest-pod-35423603 in contrail-api 2025-11-20 16:50:54,981 - DEBUG - VMI 0c0d7604-c631-11f0-895f-fa163e4ed8f4 is active in agent 10.0.0.72 2025-11-20 16:50:54,981 - INFO - Verified Pod ctest-pod-35423603 in agent 10.0.0.72 2025-11-20 16:50:54,981 - DEBUG - Requesting: http://10.0.0.128:8108/Snh_VirtualMachineDatabaseList?x=527115c3-d8b4-4269-b8b1-51a31e361d5f 2025-11-20 16:50:54,985 - INFO - Pod ctest-pod-35423603 with uuid 527115c3-d8b4-4269-b8b1-51a31e361d5f found in kube manager 2025-11-20 16:50:54,985 - INFO - Pod ctest-pod-35423603 verification passed 2025-11-20 16:50:54,985 - INFO - ================================================================================ 2025-11-20 16:50:54,985 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-11-20 16:50:54,985 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-11-20 16:50:55,214 - DEBUG - Nothing to compare xmpp stats {'10.0.0.72': {'10.0.0.128': '0'}} with 2025-11-20 16:50:55,214 - INFO - Initial checks done. Running the testcase now 2025-11-20 16:50:55,214 - INFO - 2025-11-20 16:50:55,270 - DEBUG - [Pod ctest-pod-01573911] Cmd: echo ctest-pod-01573911 > /usr/share/nginx/html/index.html, Output: 2025-11-20 16:50:55,331 - DEBUG - [Pod ctest-pod-74984365] Cmd: echo ctest-pod-74984365 > /usr/share/nginx/html/index.html, Output: 2025-11-20 16:50:55,397 - DEBUG - [Pod ctest-pod-07913667] Cmd: echo ctest-pod-07913667 > /usr/share/nginx/html/index.html, Output: 2025-11-20 16:50:55,459 - DEBUG - [Pod ctest-pod-64155597] Cmd: echo ctest-pod-64155597 > /usr/share/nginx/html/index.html, Output: 2025-11-20 16:50:55,462 - DEBUG - Service ctest-nginx-svc-63972782 not present 2025-11-20 16:50:55,463 - INFO - Creating service ctest-nginx-svc-63972782 2025-11-20 16:50:55,482 - INFO - Created Service ctest-nginx-svc-63972782 2025-11-20 16:50:55,489 - WARNING - Service UUID 5a5daa01-566d-450f-ab16-185df6a9b2cf not yet found in contrail-api 2025-11-20 16:50:56,496 - INFO - Validated that Service ctest-nginx-svc-63972782 is seen in contrail-api 2025-11-20 16:50:56,496 - DEBUG - Requesting: http://10.0.0.128:8108/Snh_LoadbalancerDatabaseList?x=5a5daa01-566d-450f-ab16-185df6a9b2cf 2025-11-20 16:50:56,509 - INFO - Service ctest-nginx-svc-63972782 with uuid 5a5daa01-566d-450f-ab16-185df6a9b2cf found in kube manager 2025-11-20 16:50:56,509 - INFO - Service ctest-nginx-svc-63972782 verification passed 2025-11-20 16:50:56,585 - DEBUG - [Pod ctest-pod-90613106] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: ctest-pod-74984365 Connecting to 10.98.69.134:80 (10.98.69.134:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-20 16:50:56,585 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 passed 2025-11-20 16:50:56,586 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd output: ctest-pod-74984365 Connecting to 10.98.69.134:80 (10.98.69.134:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-20 16:50:56,647 - DEBUG - [Pod ctest-pod-90613106] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: ctest-pod-74984365 Connecting to 10.98.69.134:80 (10.98.69.134:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-20 16:50:56,648 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 passed 2025-11-20 16:50:56,648 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd output: ctest-pod-74984365 Connecting to 10.98.69.134:80 (10.98.69.134:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-20 16:50:56,708 - DEBUG - [Pod ctest-pod-90613106] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: ctest-pod-74984365 Connecting to 10.98.69.134:80 (10.98.69.134:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-20 16:50:56,708 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 passed 2025-11-20 16:50:56,708 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd output: ctest-pod-74984365 Connecting to 10.98.69.134:80 (10.98.69.134:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-20 16:50:56,781 - DEBUG - [Pod ctest-pod-90613106] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.69.134:80 (10.98.69.134:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-74984365 2025-11-20 16:50:56,781 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 passed 2025-11-20 16:50:56,781 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd output: Connecting to 10.98.69.134:80 (10.98.69.134:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-74984365 2025-11-20 16:50:56,840 - DEBUG - [Pod ctest-pod-90613106] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.69.134:80 (10.98.69.134:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-74984365 2025-11-20 16:50:56,840 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 passed 2025-11-20 16:50:56,840 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd output: Connecting to 10.98.69.134:80 (10.98.69.134:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-74984365 2025-11-20 16:50:56,899 - DEBUG - [Pod ctest-pod-90613106] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.69.134:80 (10.98.69.134:80) ctest-pod-01573911 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-20 16:50:56,899 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 passed 2025-11-20 16:50:56,899 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd output: Connecting to 10.98.69.134:80 (10.98.69.134:80) ctest-pod-01573911 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-20 16:50:56,899 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-01573911': 1, 'ctest-pod-74984365': 5} 2025-11-20 16:50:56,965 - DEBUG - [Pod ctest-pod-04949678] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: ctest-pod-74984365 Connecting to 10.98.69.134:80 (10.98.69.134:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-20 16:50:56,965 - DEBUG - [Pod Pod ctest-pod-04949678] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 passed 2025-11-20 16:50:56,965 - DEBUG - [Pod Pod ctest-pod-04949678] Cmd output: ctest-pod-74984365 Connecting to 10.98.69.134:80 (10.98.69.134:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-20 16:50:57,021 - DEBUG - [Pod ctest-pod-04949678] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: ctest-pod-01573911 Connecting to 10.98.69.134:80 (10.98.69.134:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-20 16:50:57,021 - DEBUG - [Pod Pod ctest-pod-04949678] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 passed 2025-11-20 16:50:57,021 - DEBUG - [Pod Pod ctest-pod-04949678] Cmd output: ctest-pod-01573911 Connecting to 10.98.69.134:80 (10.98.69.134:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-20 16:50:57,021 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-01573911': 1, 'ctest-pod-74984365': 1} 2025-11-20 16:50:57,025 - DEBUG - Network policy ingress-on-service not present 2025-11-20 16:50:57,025 - INFO - Creating Network Policy ingress-on-service 2025-11-20 16:50:57,039 - INFO - Network policy found in k8s 2025-11-20 16:50:57,039 - DEBUG - Requesting: http://10.0.0.128:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=ad454cc8-d74f-4f71-a276-21598d593ed0 2025-11-20 16:50:57,045 - INFO - Network Policy ingress-on-service with uuid ad454cc8-d74f-4f71-a276-21598d593ed0 found in kube manager 2025-11-20 16:50:57,075 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-11-20 16:50:57,075 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-11-20 16:50:57,076 - DEBUG - Requesting: http://10.0.0.128:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=ad454cc8-d74f-4f71-a276-21598d593ed0 2025-11-20 16:50:57,105 - WARNING - Network policy with name ingress-on-service not found in agent 2025-11-20 16:50:59,105 - DEBUG - Requesting: http://10.0.0.128:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=ad454cc8-d74f-4f71-a276-21598d593ed0 2025-11-20 16:50:59,129 - INFO - Network policy with name ingress-on-service found in agent 2025-11-20 16:50:59,129 - INFO - Network Policy ingress-on-service verification passed 2025-11-20 16:51:04,183 - DEBUG - [Pod ctest-pod-90613106] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:51:04,183 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:51:04,183 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:51:09,234 - DEBUG - [Pod ctest-pod-90613106] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:51:09,234 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:51:09,234 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:51:14,289 - DEBUG - [Pod ctest-pod-90613106] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:51:14,289 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:51:14,289 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:51:19,342 - DEBUG - [Pod ctest-pod-90613106] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:51:19,343 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:51:19,343 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:51:24,395 - DEBUG - [Pod ctest-pod-90613106] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:51:24,395 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:51:24,395 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:51:29,452 - DEBUG - [Pod ctest-pod-90613106] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:51:29,452 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:51:29,452 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:51:34,507 - DEBUG - [Pod ctest-pod-90613106] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:51:34,507 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:51:34,507 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:51:39,568 - DEBUG - [Pod ctest-pod-90613106] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:51:39,568 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:51:39,568 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:51:40,216 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2025-11-20 16:51:50,283 - DEBUG - [Pod ctest-pod-90613106] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:51:50,283 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:51:50,283 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:51:55,344 - DEBUG - [Pod ctest-pod-90613106] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:51:55,344 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:51:55,344 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:51:55,344 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-01573911': 0, 'ctest-pod-74984365': 0} 2025-11-20 16:51:55,415 - DEBUG - [Pod ctest-pod-24808513] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: ctest-pod-74984365 Connecting to 10.98.69.134:80 (10.98.69.134:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-20 16:51:55,415 - DEBUG - [Pod Pod ctest-pod-24808513] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 passed 2025-11-20 16:51:55,415 - DEBUG - [Pod Pod ctest-pod-24808513] Cmd output: ctest-pod-74984365 Connecting to 10.98.69.134:80 (10.98.69.134:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-20 16:51:55,475 - DEBUG - [Pod ctest-pod-24808513] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: ctest-pod-74984365 Connecting to 10.98.69.134:80 (10.98.69.134:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-20 16:51:55,475 - DEBUG - [Pod Pod ctest-pod-24808513] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 passed 2025-11-20 16:51:55,475 - DEBUG - [Pod Pod ctest-pod-24808513] Cmd output: ctest-pod-74984365 Connecting to 10.98.69.134:80 (10.98.69.134:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-20 16:51:55,542 - DEBUG - [Pod ctest-pod-24808513] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.69.134:80 (10.98.69.134:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-01573911 2025-11-20 16:51:55,542 - DEBUG - [Pod Pod ctest-pod-24808513] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 passed 2025-11-20 16:51:55,543 - DEBUG - [Pod Pod ctest-pod-24808513] Cmd output: Connecting to 10.98.69.134:80 (10.98.69.134:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-01573911 2025-11-20 16:51:55,543 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-01573911': 1, 'ctest-pod-74984365': 2} 2025-11-20 16:52:00,600 - DEBUG - [Pod ctest-pod-04949678] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:52:00,600 - DEBUG - [Pod Pod ctest-pod-04949678] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:52:00,600 - DEBUG - [Pod Pod ctest-pod-04949678] Cmd output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:52:05,657 - DEBUG - [Pod ctest-pod-04949678] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:52:05,657 - DEBUG - [Pod Pod ctest-pod-04949678] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:52:05,657 - DEBUG - [Pod Pod ctest-pod-04949678] Cmd output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:52:10,712 - DEBUG - [Pod ctest-pod-04949678] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:52:10,712 - DEBUG - [Pod Pod ctest-pod-04949678] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:52:10,712 - DEBUG - [Pod Pod ctest-pod-04949678] Cmd output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:52:15,768 - DEBUG - [Pod ctest-pod-04949678] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:52:15,768 - DEBUG - [Pod Pod ctest-pod-04949678] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:52:15,768 - DEBUG - [Pod Pod ctest-pod-04949678] Cmd output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:52:20,832 - DEBUG - [Pod ctest-pod-04949678] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:52:20,832 - DEBUG - [Pod Pod ctest-pod-04949678] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:52:20,833 - DEBUG - [Pod Pod ctest-pod-04949678] Cmd output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:52:25,886 - DEBUG - [Pod ctest-pod-04949678] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:52:25,886 - DEBUG - [Pod Pod ctest-pod-04949678] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:52:25,886 - DEBUG - [Pod Pod ctest-pod-04949678] Cmd output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:52:30,939 - DEBUG - [Pod ctest-pod-04949678] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:52:30,940 - DEBUG - [Pod Pod ctest-pod-04949678] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:52:30,940 - DEBUG - [Pod Pod ctest-pod-04949678] Cmd output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:52:35,990 - DEBUG - [Pod ctest-pod-04949678] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:52:35,991 - DEBUG - [Pod Pod ctest-pod-04949678] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:52:35,991 - DEBUG - [Pod Pod ctest-pod-04949678] Cmd output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:52:41,050 - DEBUG - [Pod ctest-pod-04949678] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:52:41,050 - DEBUG - [Pod Pod ctest-pod-04949678] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:52:41,050 - DEBUG - [Pod Pod ctest-pod-04949678] Cmd output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:52:46,108 - DEBUG - [Pod ctest-pod-04949678] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:52:46,108 - DEBUG - [Pod Pod ctest-pod-04949678] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:52:46,108 - DEBUG - [Pod Pod ctest-pod-04949678] Cmd output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:52:46,108 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-01573911': 0, 'ctest-pod-74984365': 0} 2025-11-20 16:52:48,166 - DEBUG - [Pod ctest-pod-24808513] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.442 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.081 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.092 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.081/0.205/0.442 ms 2025-11-20 16:52:48,167 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-24808513 with expectation True passed 2025-11-20 16:52:50,223 - DEBUG - [Pod ctest-pod-90613106] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.806 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.093 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.106 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.093/0.335/0.806 ms 2025-11-20 16:52:50,223 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-90613106 with expectation True passed 2025-11-20 16:52:52,276 - DEBUG - [Pod ctest-pod-04949678] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.881 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.080 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.091 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.080/0.684/1.881 ms 2025-11-20 16:52:52,276 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-04949678 with expectation True passed 2025-11-20 16:52:52,334 - DEBUG - [Pod ctest-pod-24808513] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-11-20 16:52:52,334 - DEBUG - [Pod Pod ctest-pod-24808513] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-11-20 16:52:52,334 - DEBUG - [Pod Pod ctest-pod-24808513] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-11-20 16:52:52,334 - INFO - wget check of of http://10.47.255.251 from ctest-pod-24808513 passed 2025-11-20 16:52:52,389 - DEBUG - [Pod ctest-pod-24808513] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-11-20 16:52:52,389 - DEBUG - [Pod Pod ctest-pod-24808513] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-11-20 16:52:52,389 - DEBUG - [Pod Pod ctest-pod-24808513] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-11-20 16:52:52,389 - INFO - wget check of of http://10.47.255.250 from ctest-pod-24808513 passed 2025-11-20 16:52:57,445 - DEBUG - [Pod ctest-pod-90613106] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-11-20 16:52:57,446 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-11-20 16:52:57,446 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-11-20 16:52:57,446 - INFO - wget check of of http://10.47.255.250 from ctest-pod-90613106 passed 2025-11-20 16:53:02,512 - DEBUG - [Pod ctest-pod-35423603] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-11-20 16:53:02,513 - DEBUG - [Pod Pod ctest-pod-35423603] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-11-20 16:53:02,513 - DEBUG - [Pod Pod ctest-pod-35423603] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-11-20 16:53:02,513 - INFO - wget check of of http://10.47.255.251 from ctest-pod-35423603 passed 2025-11-20 16:53:02,521 - INFO - Updating Network Policy ingress-on-service 2025-11-20 16:53:07,585 - DEBUG - [Pod ctest-pod-90613106] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:53:07,585 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:53:07,585 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:53:12,644 - DEBUG - [Pod ctest-pod-90613106] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:53:12,644 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:53:12,644 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:53:17,706 - DEBUG - [Pod ctest-pod-90613106] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:53:17,706 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:53:17,706 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:53:22,759 - DEBUG - [Pod ctest-pod-90613106] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:53:22,759 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:53:22,759 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:53:27,810 - DEBUG - [Pod ctest-pod-90613106] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:53:27,810 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:53:27,810 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:53:32,859 - DEBUG - [Pod ctest-pod-90613106] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:53:32,859 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:53:32,859 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:53:37,919 - DEBUG - [Pod ctest-pod-90613106] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:53:37,919 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:53:37,919 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:53:42,969 - DEBUG - [Pod ctest-pod-90613106] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:53:42,969 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:53:42,969 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:53:48,020 - DEBUG - [Pod ctest-pod-90613106] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:53:48,021 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:53:48,021 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:53:53,079 - DEBUG - [Pod ctest-pod-90613106] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:53:53,079 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:53:53,079 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd output: Connecting to 10.98.69.134:80 (10.98.69.134:80) wget: download timed out 2025-11-20 16:53:53,079 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-01573911': 0, 'ctest-pod-74984365': 0} 2025-11-20 16:53:53,132 - DEBUG - [Pod ctest-pod-24808513] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: ctest-pod-01573911 Connecting to 10.98.69.134:80 (10.98.69.134:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-20 16:53:53,132 - DEBUG - [Pod Pod ctest-pod-24808513] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 passed 2025-11-20 16:53:53,132 - DEBUG - [Pod Pod ctest-pod-24808513] Cmd output: ctest-pod-01573911 Connecting to 10.98.69.134:80 (10.98.69.134:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-20 16:53:53,197 - DEBUG - [Pod ctest-pod-24808513] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: ctest-pod-01573911 Connecting to 10.98.69.134:80 (10.98.69.134:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-20 16:53:53,197 - DEBUG - [Pod Pod ctest-pod-24808513] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 passed 2025-11-20 16:53:53,197 - DEBUG - [Pod Pod ctest-pod-24808513] Cmd output: ctest-pod-01573911 Connecting to 10.98.69.134:80 (10.98.69.134:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-20 16:53:53,263 - DEBUG - [Pod ctest-pod-24808513] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: ctest-pod-01573911 Connecting to 10.98.69.134:80 (10.98.69.134:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-20 16:53:53,263 - DEBUG - [Pod Pod ctest-pod-24808513] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 passed 2025-11-20 16:53:53,263 - DEBUG - [Pod Pod ctest-pod-24808513] Cmd output: ctest-pod-01573911 Connecting to 10.98.69.134:80 (10.98.69.134:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-20 16:53:53,308 - DEBUG - [Pod ctest-pod-24808513] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.69.134:80 (10.98.69.134:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-74984365 2025-11-20 16:53:53,308 - DEBUG - [Pod Pod ctest-pod-24808513] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 passed 2025-11-20 16:53:53,308 - DEBUG - [Pod Pod ctest-pod-24808513] Cmd output: Connecting to 10.98.69.134:80 (10.98.69.134:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-74984365 2025-11-20 16:53:53,308 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-01573911': 3, 'ctest-pod-74984365': 1} 2025-11-20 16:53:53,362 - DEBUG - [Pod ctest-pod-04949678] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.69.134:80 (10.98.69.134:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-74984365 2025-11-20 16:53:53,362 - DEBUG - [Pod Pod ctest-pod-04949678] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 passed 2025-11-20 16:53:53,362 - DEBUG - [Pod Pod ctest-pod-04949678] Cmd output: Connecting to 10.98.69.134:80 (10.98.69.134:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-74984365 2025-11-20 16:53:53,423 - DEBUG - [Pod ctest-pod-04949678] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: ctest-pod-74984365 Connecting to 10.98.69.134:80 (10.98.69.134:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-20 16:53:53,423 - DEBUG - [Pod Pod ctest-pod-04949678] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 passed 2025-11-20 16:53:53,423 - DEBUG - [Pod Pod ctest-pod-04949678] Cmd output: ctest-pod-74984365 Connecting to 10.98.69.134:80 (10.98.69.134:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-20 16:53:53,483 - DEBUG - [Pod ctest-pod-04949678] Cmd: wget http://10.98.69.134:80/ -O - -T 5 -t 1 , Output: ctest-pod-01573911 Connecting to 10.98.69.134:80 (10.98.69.134:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-20 16:53:53,483 - DEBUG - [Pod Pod ctest-pod-04949678] Cmd wget http://10.98.69.134:80/ -O - -T 5 -t 1 passed 2025-11-20 16:53:53,483 - DEBUG - [Pod Pod ctest-pod-04949678] Cmd output: ctest-pod-01573911 Connecting to 10.98.69.134:80 (10.98.69.134:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-20 16:53:53,483 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-01573911': 1, 'ctest-pod-74984365': 2} 2025-11-20 16:53:55,547 - DEBUG - [Pod ctest-pod-24808513] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.703 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.086 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.122 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.086/0.303/0.703 ms 2025-11-20 16:53:55,547 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-24808513 with expectation True passed 2025-11-20 16:53:57,602 - DEBUG - [Pod ctest-pod-90613106] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.754 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.074 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.083 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.074/0.303/0.754 ms 2025-11-20 16:53:57,602 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-90613106 with expectation True passed 2025-11-20 16:53:59,654 - DEBUG - [Pod ctest-pod-04949678] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.846 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.076 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.101 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.076/0.341/0.846 ms 2025-11-20 16:53:59,654 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-04949678 with expectation True passed 2025-11-20 16:53:59,717 - DEBUG - [Pod ctest-pod-24808513] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-11-20 16:53:59,717 - DEBUG - [Pod Pod ctest-pod-24808513] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-11-20 16:53:59,717 - DEBUG - [Pod Pod ctest-pod-24808513] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-11-20 16:53:59,717 - INFO - wget check of of http://10.47.255.251 from ctest-pod-24808513 passed 2025-11-20 16:53:59,771 - DEBUG - [Pod ctest-pod-24808513] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-11-20 16:53:59,771 - DEBUG - [Pod Pod ctest-pod-24808513] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-11-20 16:53:59,771 - DEBUG - [Pod Pod ctest-pod-24808513] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-11-20 16:53:59,771 - INFO - wget check of of http://10.47.255.250 from ctest-pod-24808513 passed 2025-11-20 16:54:04,822 - DEBUG - [Pod ctest-pod-90613106] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-11-20 16:54:04,822 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-11-20 16:54:04,822 - DEBUG - [Pod Pod ctest-pod-90613106] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-11-20 16:54:04,822 - INFO - wget check of of http://10.47.255.250 from ctest-pod-90613106 passed 2025-11-20 16:54:04,875 - DEBUG - [Pod ctest-pod-35423603] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-11-20 16:54:04,875 - DEBUG - [Pod Pod ctest-pod-35423603] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-11-20 16:54:04,875 - DEBUG - [Pod Pod ctest-pod-35423603] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-11-20 16:54:04,875 - INFO - wget check of of http://10.47.255.251 from ctest-pod-35423603 passed 2025-11-20 16:54:04,875 - INFO - Deleting Network Policy : ingress-on-service 2025-11-20 16:54:04,876 - INFO - Deleting service : ctest-nginx-svc-63972782 2025-11-20 16:54:05,113 - DEBUG - No XMPP flaps were noticed during the test 2025-11-20 16:54:05,114 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:11] 2025-11-20 16:54:05,114 - INFO - -------------------------------------------------------------------------------- 2025-11-20 16:54:05,118 - INFO - Deleting pod ctest-new-default-52171645:ctest-pod-01573911 2025-11-20 16:54:05,118 - INFO - Deleting pod ctest-new-default-52171645:ctest-pod-74984365 2025-11-20 16:54:05,119 - INFO - Deleting pod ctest-non-default-50906561:ctest-pod-07913667 2025-11-20 16:54:05,119 - INFO - Deleting pod ctest-non-default-50906561:ctest-pod-64155597 2025-11-20 16:54:05,119 - INFO - Deleting pod ctest-new-default-52171645:ctest-pod-90613106 2025-11-20 16:54:05,120 - INFO - Deleting pod ctest-new-default-52171645:ctest-pod-24808513 2025-11-20 16:54:05,120 - INFO - Deleting pod ctest-non-default-50906561:ctest-pod-04949678 2025-11-20 16:54:05,120 - INFO - Deleting pod ctest-non-default-50906561:ctest-pod-35423603 2025-11-20 16:54:05,255 - WARNING - Pod uuid a3725d43-bc70-4c5e-8903-74a486786625 is still seen in agent 10.0.0.72 VM list 2025-11-20 16:54:05,255 - WARNING - Pod uuid 527115c3-d8b4-4269-b8b1-51a31e361d5f is still seen in agent 10.0.0.72 VM list 2025-11-20 16:54:05,255 - WARNING - Pod uuid 2d87d324-ab72-404c-9f7c-c97a746206b7 is still seen in agent 10.0.0.72 VM list 2025-11-20 16:54:05,261 - WARNING - Pod uuid e514bd6b-af40-447d-b360-c96ad26ec908 is still seen in agent 10.0.0.72 VM list 2025-11-20 16:54:05,262 - WARNING - Pod uuid 2bbc003c-c163-4ebe-bdd0-53180f78d242 is still seen in agent 10.0.0.72 VM list 2025-11-20 16:54:05,262 - WARNING - Pod uuid 54cdde90-3e0d-489b-8130-d4725d19ccc1 is still seen in agent 10.0.0.72 VM list 2025-11-20 16:54:05,265 - WARNING - Pod uuid 447f0177-c070-4bcb-9d02-65b285755125 is still seen in agent 10.0.0.72 VM list 2025-11-20 16:54:05,266 - WARNING - Pod uuid 6a9b9c40-6c05-452d-ba7b-330154385de0 is still seen in agent 10.0.0.72 VM list 2025-11-20 16:54:10,270 - WARNING - Pod uuid a3725d43-bc70-4c5e-8903-74a486786625 is still seen in agent 10.0.0.72 VM list 2025-11-20 16:54:10,272 - WARNING - Pod uuid 527115c3-d8b4-4269-b8b1-51a31e361d5f is still seen in agent 10.0.0.72 VM list 2025-11-20 16:54:10,272 - DEBUG - Pod 2d87d324-ab72-404c-9f7c-c97a746206b7 is not in agent 10.0.0.72 VM list 2025-11-20 16:54:10,275 - DEBUG - Pod e514bd6b-af40-447d-b360-c96ad26ec908 is not in agent 10.0.0.72 VM list 2025-11-20 16:54:10,276 - WARNING - Pod uuid 2bbc003c-c163-4ebe-bdd0-53180f78d242 is still seen in agent 10.0.0.72 VM list 2025-11-20 16:54:10,288 - WARNING - Pod uuid 6a9b9c40-6c05-452d-ba7b-330154385de0 is still seen in agent 10.0.0.72 VM list 2025-11-20 16:54:10,289 - DEBUG - Pod 54cdde90-3e0d-489b-8130-d4725d19ccc1 is not in agent 10.0.0.72 VM list 2025-11-20 16:54:10,290 - DEBUG - VMI 0a4ad8e8-c631-11f0-895f-fa163e4ed8f4 is removed from agent 10.0.0.72 2025-11-20 16:54:10,290 - INFO - Verified that pod ctest-pod-64155597 is removed in agent 2025-11-20 16:54:10,291 - WARNING - Pod uuid 447f0177-c070-4bcb-9d02-65b285755125 is still seen in agent 10.0.0.72 VM list 2025-11-20 16:54:10,291 - DEBUG - VMI 08dbc026-c631-11f0-895f-fa163e4ed8f4 is removed from agent 10.0.0.72 2025-11-20 16:54:10,291 - INFO - Verified that pod ctest-pod-01573911 is removed in agent 2025-11-20 16:54:10,296 - DEBUG - VMI 09de9c0a-c631-11f0-895f-fa163e4ed8f4 is removed from agent 10.0.0.72 2025-11-20 16:54:10,296 - INFO - Verified that pod ctest-pod-07913667 is removed in agent 2025-11-20 16:54:15,282 - WARNING - Pod uuid a3725d43-bc70-4c5e-8903-74a486786625 is still seen in agent 10.0.0.72 VM list 2025-11-20 16:54:15,282 - WARNING - Pod uuid 527115c3-d8b4-4269-b8b1-51a31e361d5f is still seen in agent 10.0.0.72 VM list 2025-11-20 16:54:15,283 - WARNING - Pod uuid 2bbc003c-c163-4ebe-bdd0-53180f78d242 is still seen in agent 10.0.0.72 VM list 2025-11-20 16:54:15,295 - WARNING - Pod uuid 6a9b9c40-6c05-452d-ba7b-330154385de0 is still seen in agent 10.0.0.72 VM list 2025-11-20 16:54:15,300 - WARNING - Pod uuid 447f0177-c070-4bcb-9d02-65b285755125 is still seen in agent 10.0.0.72 VM list 2025-11-20 16:54:20,294 - WARNING - Pod uuid a3725d43-bc70-4c5e-8903-74a486786625 is still seen in agent 10.0.0.72 VM list 2025-11-20 16:54:20,296 - WARNING - Pod uuid 2bbc003c-c163-4ebe-bdd0-53180f78d242 is still seen in agent 10.0.0.72 VM list 2025-11-20 16:54:20,296 - WARNING - Pod uuid 527115c3-d8b4-4269-b8b1-51a31e361d5f is still seen in agent 10.0.0.72 VM list 2025-11-20 16:54:20,302 - WARNING - Pod uuid 6a9b9c40-6c05-452d-ba7b-330154385de0 is still seen in agent 10.0.0.72 VM list 2025-11-20 16:54:20,306 - WARNING - Pod uuid 447f0177-c070-4bcb-9d02-65b285755125 is still seen in agent 10.0.0.72 VM list 2025-11-20 16:54:25,310 - WARNING - Pod uuid 527115c3-d8b4-4269-b8b1-51a31e361d5f is still seen in agent 10.0.0.72 VM list 2025-11-20 16:54:25,311 - WARNING - Pod uuid 2bbc003c-c163-4ebe-bdd0-53180f78d242 is still seen in agent 10.0.0.72 VM list 2025-11-20 16:54:25,311 - WARNING - Pod uuid a3725d43-bc70-4c5e-8903-74a486786625 is still seen in agent 10.0.0.72 VM list 2025-11-20 16:54:25,312 - WARNING - Pod uuid 6a9b9c40-6c05-452d-ba7b-330154385de0 is still seen in agent 10.0.0.72 VM list 2025-11-20 16:54:25,317 - WARNING - Pod uuid 447f0177-c070-4bcb-9d02-65b285755125 is still seen in agent 10.0.0.72 VM list 2025-11-20 16:54:30,329 - WARNING - Pod uuid 2bbc003c-c163-4ebe-bdd0-53180f78d242 is still seen in agent 10.0.0.72 VM list 2025-11-20 16:54:30,329 - WARNING - Pod uuid 527115c3-d8b4-4269-b8b1-51a31e361d5f is still seen in agent 10.0.0.72 VM list 2025-11-20 16:54:30,331 - WARNING - Pod uuid 447f0177-c070-4bcb-9d02-65b285755125 is still seen in agent 10.0.0.72 VM list 2025-11-20 16:54:30,332 - WARNING - Pod uuid a3725d43-bc70-4c5e-8903-74a486786625 is still seen in agent 10.0.0.72 VM list 2025-11-20 16:54:30,332 - WARNING - Pod uuid 6a9b9c40-6c05-452d-ba7b-330154385de0 is still seen in agent 10.0.0.72 VM list 2025-11-20 16:54:35,362 - WARNING - Pod uuid 6a9b9c40-6c05-452d-ba7b-330154385de0 is still seen in agent 10.0.0.72 VM list 2025-11-20 16:54:35,362 - WARNING - Pod uuid 527115c3-d8b4-4269-b8b1-51a31e361d5f is still seen in agent 10.0.0.72 VM list 2025-11-20 16:54:35,363 - WARNING - Pod uuid 2bbc003c-c163-4ebe-bdd0-53180f78d242 is still seen in agent 10.0.0.72 VM list 2025-11-20 16:54:35,364 - WARNING - Pod uuid a3725d43-bc70-4c5e-8903-74a486786625 is still seen in agent 10.0.0.72 VM list 2025-11-20 16:54:35,365 - WARNING - Pod uuid 447f0177-c070-4bcb-9d02-65b285755125 is still seen in agent 10.0.0.72 VM list 2025-11-20 16:54:40,380 - DEBUG - Pod a3725d43-bc70-4c5e-8903-74a486786625 is not in agent 10.0.0.72 VM list 2025-11-20 16:54:40,382 - DEBUG - Pod 447f0177-c070-4bcb-9d02-65b285755125 is not in agent 10.0.0.72 VM list 2025-11-20 16:54:40,382 - DEBUG - Pod 527115c3-d8b4-4269-b8b1-51a31e361d5f is not in agent 10.0.0.72 VM list 2025-11-20 16:54:40,385 - DEBUG - Pod 6a9b9c40-6c05-452d-ba7b-330154385de0 is not in agent 10.0.0.72 VM list 2025-11-20 16:54:40,386 - DEBUG - Pod 2bbc003c-c163-4ebe-bdd0-53180f78d242 is not in agent 10.0.0.72 VM list 2025-11-20 16:54:40,401 - DEBUG - VMI 0b3680a4-c631-11f0-895f-fa163e4ed8f4 is removed from agent 10.0.0.72 2025-11-20 16:54:40,401 - INFO - Verified that pod ctest-pod-24808513 is removed in agent 2025-11-20 16:54:40,401 - DEBUG - VMI 094ac71e-c631-11f0-895f-fa163e4ed8f4 is removed from agent 10.0.0.72 2025-11-20 16:54:40,401 - INFO - Verified that pod ctest-pod-74984365 is removed in agent 2025-11-20 16:54:40,401 - DEBUG - VMI 0b9faffc-c631-11f0-895f-fa163e4ed8f4 is removed from agent 10.0.0.72 2025-11-20 16:54:40,401 - INFO - Verified that pod ctest-pod-04949678 is removed in agent 2025-11-20 16:54:40,402 - DEBUG - VMI 0c0d7604-c631-11f0-895f-fa163e4ed8f4 is removed from agent 10.0.0.72 2025-11-20 16:54:40,402 - INFO - Verified that pod ctest-pod-35423603 is removed in agent 2025-11-20 16:54:40,402 - DEBUG - VMI 0acc729a-c631-11f0-895f-fa163e4ed8f4 is removed from agent 10.0.0.72 2025-11-20 16:54:40,402 - INFO - Verified that pod ctest-pod-90613106 is removed in agent 2025-11-20 16:54:40,403 - INFO - Deleting namespace ctest-non-default-50906561 2025-11-20 16:54:40,414 - DEBUG - Namespace ctest-non-default-50906561 still in k8s 2025-11-20 16:54:42,419 - DEBUG - Namespace ctest-non-default-50906561 still in k8s 2025-11-20 16:54:44,424 - DEBUG - Namespace ctest-non-default-50906561 still in k8s 2025-11-20 16:54:46,427 - DEBUG - Namespace ctest-non-default-50906561 is not in k8s 2025-11-20 16:54:46,427 - DEBUG - No need to check project deletion in contrail-api 2025-11-20 16:54:46,427 - INFO - Deleting namespace ctest-new-default-52171645 2025-11-20 16:54:46,438 - DEBUG - Namespace ctest-new-default-52171645 still in k8s 2025-11-20 16:54:48,443 - DEBUG - Namespace ctest-new-default-52171645 still in k8s 2025-11-20 16:54:50,446 - DEBUG - Namespace ctest-new-default-52171645 still in k8s 2025-11-20 16:54:52,451 - DEBUG - Namespace ctest-new-default-52171645 is not in k8s 2025-11-20 16:54:52,451 - DEBUG - No need to check project deletion in contrail-api