2025-02-10 15:02:56,398 - INFO - Using existing project ['default-domain', 'k8s-default'](f73626f2-1656-4c6d-8d98-16dcf15a9013) 2025-02-10 15:02:56,417 - DEBUG - Namespace ctest-new-default-00393999 not present 2025-02-10 15:02:56,423 - INFO - Created namespace ctest-new-default-00393999 2025-02-10 15:02:59,428 - DEBUG - Namespace ctest-non-default-52770776 not present 2025-02-10 15:02:59,442 - INFO - Created namespace ctest-non-default-52770776 2025-02-10 15:03:02,462 - DEBUG - Pod ctest-pod-42004626 not present 2025-02-10 15:03:02,463 - INFO - Creating Pod ctest-pod-42004626 2025-02-10 15:03:02,488 - DEBUG - Pod : ctest-pod-42004626 UUID is 6abc6987-95d2-4394-87c1-e35622f9b577 2025-02-10 15:03:02,491 - DEBUG - Pod ctest-pod-03307207 not present 2025-02-10 15:03:02,491 - INFO - Creating Pod ctest-pod-03307207 2025-02-10 15:03:02,530 - DEBUG - Pod : ctest-pod-03307207 UUID is 0c18092e-685d-4ca2-83cd-5869de8a1925 2025-02-10 15:03:02,532 - DEBUG - Pod ctest-pod-48549041 not present 2025-02-10 15:03:02,532 - INFO - Creating Pod ctest-pod-48549041 2025-02-10 15:03:02,552 - DEBUG - Pod : ctest-pod-48549041 UUID is 94c9ff5f-c5c5-4cfd-b6a9-ddbe09df4adb 2025-02-10 15:03:02,556 - DEBUG - Pod ctest-pod-70782608 not present 2025-02-10 15:03:02,556 - INFO - Creating Pod ctest-pod-70782608 2025-02-10 15:03:02,594 - DEBUG - Pod : ctest-pod-70782608 UUID is 492b3c9c-12a8-4c59-90ce-77ee770919c2 2025-02-10 15:03:02,596 - DEBUG - Pod ctest-pod-11922631 not present 2025-02-10 15:03:02,596 - INFO - Creating Pod ctest-pod-11922631 2025-02-10 15:03:02,612 - DEBUG - Pod : ctest-pod-11922631 UUID is 4ae18f07-98ff-4c6b-852c-156db58eea82 2025-02-10 15:03:02,614 - DEBUG - Pod ctest-pod-27686373 not present 2025-02-10 15:03:02,614 - INFO - Creating Pod ctest-pod-27686373 2025-02-10 15:03:02,630 - DEBUG - Pod : ctest-pod-27686373 UUID is 279bfd41-a300-49b9-bdee-0b4d1f2a3e9f 2025-02-10 15:03:02,632 - DEBUG - Pod ctest-pod-37556792 not present 2025-02-10 15:03:02,632 - INFO - Creating Pod ctest-pod-37556792 2025-02-10 15:03:02,653 - DEBUG - Pod : ctest-pod-37556792 UUID is d2392130-9d80-4a30-a831-fd0678ebd1fd 2025-02-10 15:03:02,655 - DEBUG - Pod ctest-pod-86220149 not present 2025-02-10 15:03:02,655 - INFO - Creating Pod ctest-pod-86220149 2025-02-10 15:03:02,674 - DEBUG - Pod : ctest-pod-86220149 UUID is 68cd02ef-8b71-46ee-a565-4238cd5f7558 2025-02-10 15:03:02,894 - INFO - Project default-domain:k8s-ctest-new-default-00393999 for Namespace ctest-new-default-00393999 is seen in contrail-api 2025-02-10 15:03:02,894 - DEBUG - Project uuid in Contrail is fadb2080-01ba-4cd4-ac76-27a3ae8ddb1b 2025-02-10 15:03:03,074 - DEBUG - Requesting: http://10.0.0.30:8108/Snh_NamespaceDatabaseList?namespace_uuid=da6704a6-f11c-408e-95a3-c53f0d6430b7 2025-02-10 15:03:03,086 - INFO - Namespace ctest-new-default-00393999 with uuid da6704a6-f11c-408e-95a3-c53f0d6430b7 found in kube manager 2025-02-10 15:03:03,086 - INFO - Namespace ctest-new-default-00393999 verification passed 2025-02-10 15:03:03,288 - INFO - Project default-domain:k8s-ctest-non-default-52770776 for Namespace ctest-non-default-52770776 is seen in contrail-api 2025-02-10 15:03:03,288 - DEBUG - Project uuid in Contrail is 850a3017-a691-4d09-b7d8-5be32b2f3fc8 2025-02-10 15:03:03,288 - DEBUG - Requesting: http://10.0.0.30:8108/Snh_NamespaceDatabaseList?namespace_uuid=f57e56db-9106-4b16-bb7a-d882bea9f883 2025-02-10 15:03:03,295 - INFO - Namespace ctest-non-default-52770776 with uuid f57e56db-9106-4b16-bb7a-d882bea9f883 found in kube manager 2025-02-10 15:03:03,295 - INFO - Namespace ctest-non-default-52770776 verification passed 2025-02-10 15:03:03,301 - DEBUG - Pod ctest-pod-42004626 not in running state.Currently in Pending 2025-02-10 15:03:08,315 - DEBUG - Pod ctest-pod-42004626 not in running state.Currently in Pending 2025-02-10 15:03:13,321 - DEBUG - Pod ctest-pod-42004626 not in running state.Currently in Pending 2025-02-10 15:03:18,328 - INFO - Pod ctest-pod-42004626 is in running state.Got IP 10.47.255.251 2025-02-10 15:03:18,344 - DEBUG - Pod ctest-pod-42004626 has vmi 20dff926-e7c0-11ef-b6ee-fa163e6cd968 2025-02-10 15:03:18,344 - INFO - Verified pod ctest-pod-42004626 in contrail-api 2025-02-10 15:03:18,361 - DEBUG - VMI 20dff926-e7c0-11ef-b6ee-fa163e6cd968 is active in agent 10.0.0.12 2025-02-10 15:03:18,362 - INFO - Verified Pod ctest-pod-42004626 in agent 10.0.0.12 2025-02-10 15:03:18,362 - DEBUG - Requesting: http://10.0.0.30:8108/Snh_VirtualMachineDatabaseList?x=6abc6987-95d2-4394-87c1-e35622f9b577 2025-02-10 15:03:18,367 - INFO - Pod ctest-pod-42004626 with uuid 6abc6987-95d2-4394-87c1-e35622f9b577 found in kube manager 2025-02-10 15:03:18,367 - INFO - Pod ctest-pod-42004626 verification passed 2025-02-10 15:03:18,372 - INFO - Pod ctest-pod-03307207 is in running state.Got IP 10.47.255.250 2025-02-10 15:03:18,431 - DEBUG - Pod ctest-pod-03307207 has vmi 216502ec-e7c0-11ef-b6ee-fa163e6cd968 2025-02-10 15:03:18,431 - INFO - Verified pod ctest-pod-03307207 in contrail-api 2025-02-10 15:03:18,447 - DEBUG - VMI 216502ec-e7c0-11ef-b6ee-fa163e6cd968 is active in agent 10.0.0.12 2025-02-10 15:03:18,447 - INFO - Verified Pod ctest-pod-03307207 in agent 10.0.0.12 2025-02-10 15:03:18,447 - DEBUG - Requesting: http://10.0.0.30:8108/Snh_VirtualMachineDatabaseList?x=0c18092e-685d-4ca2-83cd-5869de8a1925 2025-02-10 15:03:18,451 - INFO - Pod ctest-pod-03307207 with uuid 0c18092e-685d-4ca2-83cd-5869de8a1925 found in kube manager 2025-02-10 15:03:18,452 - INFO - Pod ctest-pod-03307207 verification passed 2025-02-10 15:03:18,458 - INFO - Pod ctest-pod-48549041 is in running state.Got IP 10.47.255.249 2025-02-10 15:03:18,518 - DEBUG - Pod ctest-pod-48549041 has vmi 22219c36-e7c0-11ef-b6ee-fa163e6cd968 2025-02-10 15:03:18,518 - INFO - Verified pod ctest-pod-48549041 in contrail-api 2025-02-10 15:03:18,532 - DEBUG - VMI 22219c36-e7c0-11ef-b6ee-fa163e6cd968 is active in agent 10.0.0.12 2025-02-10 15:03:18,532 - INFO - Verified Pod ctest-pod-48549041 in agent 10.0.0.12 2025-02-10 15:03:18,532 - DEBUG - Requesting: http://10.0.0.30:8108/Snh_VirtualMachineDatabaseList?x=94c9ff5f-c5c5-4cfd-b6a9-ddbe09df4adb 2025-02-10 15:03:18,537 - INFO - Pod ctest-pod-48549041 with uuid 94c9ff5f-c5c5-4cfd-b6a9-ddbe09df4adb found in kube manager 2025-02-10 15:03:18,537 - INFO - Pod ctest-pod-48549041 verification passed 2025-02-10 15:03:18,542 - INFO - Pod ctest-pod-70782608 is in running state.Got IP 10.47.255.248 2025-02-10 15:03:18,555 - DEBUG - Pod ctest-pod-70782608 has vmi 22b1722a-e7c0-11ef-b6ee-fa163e6cd968 2025-02-10 15:03:18,555 - INFO - Verified pod ctest-pod-70782608 in contrail-api 2025-02-10 15:03:18,570 - DEBUG - VMI 22b1722a-e7c0-11ef-b6ee-fa163e6cd968 is active in agent 10.0.0.12 2025-02-10 15:03:18,571 - INFO - Verified Pod ctest-pod-70782608 in agent 10.0.0.12 2025-02-10 15:03:18,571 - DEBUG - Requesting: http://10.0.0.30:8108/Snh_VirtualMachineDatabaseList?x=492b3c9c-12a8-4c59-90ce-77ee770919c2 2025-02-10 15:03:18,575 - INFO - Pod ctest-pod-70782608 with uuid 492b3c9c-12a8-4c59-90ce-77ee770919c2 found in kube manager 2025-02-10 15:03:18,575 - INFO - Pod ctest-pod-70782608 verification passed 2025-02-10 15:03:18,580 - INFO - Pod ctest-pod-11922631 is in running state.Got IP 10.47.255.247 2025-02-10 15:03:18,639 - DEBUG - Pod ctest-pod-11922631 has vmi 2350d4be-e7c0-11ef-b6ee-fa163e6cd968 2025-02-10 15:03:18,639 - INFO - Verified pod ctest-pod-11922631 in contrail-api 2025-02-10 15:03:18,655 - DEBUG - VMI 2350d4be-e7c0-11ef-b6ee-fa163e6cd968 is active in agent 10.0.0.12 2025-02-10 15:03:18,655 - INFO - Verified Pod ctest-pod-11922631 in agent 10.0.0.12 2025-02-10 15:03:18,655 - DEBUG - Requesting: http://10.0.0.30:8108/Snh_VirtualMachineDatabaseList?x=4ae18f07-98ff-4c6b-852c-156db58eea82 2025-02-10 15:03:18,660 - INFO - Pod ctest-pod-11922631 with uuid 4ae18f07-98ff-4c6b-852c-156db58eea82 found in kube manager 2025-02-10 15:03:18,660 - INFO - Pod ctest-pod-11922631 verification passed 2025-02-10 15:03:18,666 - DEBUG - Pod ctest-pod-37556792 not in running state.Currently in Pending 2025-02-10 15:03:23,672 - INFO - Pod ctest-pod-37556792 is in running state.Got IP 10.47.255.245 2025-02-10 15:03:23,700 - DEBUG - Pod ctest-pod-37556792 has vmi 24547e92-e7c0-11ef-b6ee-fa163e6cd968 2025-02-10 15:03:23,700 - INFO - Verified pod ctest-pod-37556792 in contrail-api 2025-02-10 15:03:23,714 - DEBUG - VMI 24547e92-e7c0-11ef-b6ee-fa163e6cd968 is active in agent 10.0.0.12 2025-02-10 15:03:23,714 - INFO - Verified Pod ctest-pod-37556792 in agent 10.0.0.12 2025-02-10 15:03:23,715 - DEBUG - Requesting: http://10.0.0.30:8108/Snh_VirtualMachineDatabaseList?x=d2392130-9d80-4a30-a831-fd0678ebd1fd 2025-02-10 15:03:23,719 - INFO - Pod ctest-pod-37556792 with uuid d2392130-9d80-4a30-a831-fd0678ebd1fd found in kube manager 2025-02-10 15:03:23,719 - INFO - Pod ctest-pod-37556792 verification passed 2025-02-10 15:03:23,724 - INFO - Pod ctest-pod-27686373 is in running state.Got IP 10.47.255.246 2025-02-10 15:03:23,779 - DEBUG - Pod ctest-pod-27686373 has vmi 23d6f580-e7c0-11ef-b6ee-fa163e6cd968 2025-02-10 15:03:23,779 - INFO - Verified pod ctest-pod-27686373 in contrail-api 2025-02-10 15:03:23,794 - DEBUG - VMI 23d6f580-e7c0-11ef-b6ee-fa163e6cd968 is active in agent 10.0.0.12 2025-02-10 15:03:23,795 - INFO - Verified Pod ctest-pod-27686373 in agent 10.0.0.12 2025-02-10 15:03:23,795 - DEBUG - Requesting: http://10.0.0.30:8108/Snh_VirtualMachineDatabaseList?x=279bfd41-a300-49b9-bdee-0b4d1f2a3e9f 2025-02-10 15:03:23,800 - INFO - Pod ctest-pod-27686373 with uuid 279bfd41-a300-49b9-bdee-0b4d1f2a3e9f found in kube manager 2025-02-10 15:03:23,800 - INFO - Pod ctest-pod-27686373 verification passed 2025-02-10 15:03:23,805 - INFO - Pod ctest-pod-86220149 is in running state.Got IP 10.47.255.244 2025-02-10 15:03:23,862 - DEBUG - Pod ctest-pod-86220149 has vmi 24db348c-e7c0-11ef-b6ee-fa163e6cd968 2025-02-10 15:03:23,862 - INFO - Verified pod ctest-pod-86220149 in contrail-api 2025-02-10 15:03:23,876 - DEBUG - VMI 24db348c-e7c0-11ef-b6ee-fa163e6cd968 is active in agent 10.0.0.12 2025-02-10 15:03:23,877 - INFO - Verified Pod ctest-pod-86220149 in agent 10.0.0.12 2025-02-10 15:03:23,877 - DEBUG - Requesting: http://10.0.0.30:8108/Snh_VirtualMachineDatabaseList?x=68cd02ef-8b71-46ee-a565-4238cd5f7558 2025-02-10 15:03:23,881 - INFO - Pod ctest-pod-86220149 with uuid 68cd02ef-8b71-46ee-a565-4238cd5f7558 found in kube manager 2025-02-10 15:03:23,882 - INFO - Pod ctest-pod-86220149 verification passed 2025-02-10 15:03:23,882 - INFO - ================================================================================ 2025-02-10 15:03:23,882 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-02-10 15:03:23,882 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-02-10 15:03:24,087 - DEBUG - Nothing to compare xmpp stats {'10.0.0.12': {'10.0.0.30': '0'}} with 2025-02-10 15:03:24,087 - INFO - Initial checks done. Running the testcase now 2025-02-10 15:03:24,088 - INFO - 2025-02-10 15:03:24,148 - DEBUG - [Pod ctest-pod-42004626] Cmd: echo ctest-pod-42004626 > /usr/share/nginx/html/index.html, Output: 2025-02-10 15:03:24,212 - DEBUG - [Pod ctest-pod-03307207] Cmd: echo ctest-pod-03307207 > /usr/share/nginx/html/index.html, Output: 2025-02-10 15:03:24,284 - DEBUG - [Pod ctest-pod-48549041] Cmd: echo ctest-pod-48549041 > /usr/share/nginx/html/index.html, Output: 2025-02-10 15:03:24,337 - DEBUG - [Pod ctest-pod-70782608] Cmd: echo ctest-pod-70782608 > /usr/share/nginx/html/index.html, Output: 2025-02-10 15:03:24,340 - DEBUG - Service ctest-nginx-svc-33662825 not present 2025-02-10 15:03:24,341 - INFO - Creating service ctest-nginx-svc-33662825 2025-02-10 15:03:24,356 - INFO - Created Service ctest-nginx-svc-33662825 2025-02-10 15:03:24,368 - WARNING - Service UUID 1ec4254d-12a3-44d1-8d72-2c8165c68360 not yet found in contrail-api 2025-02-10 15:03:25,374 - INFO - Validated that Service ctest-nginx-svc-33662825 is seen in contrail-api 2025-02-10 15:03:25,374 - DEBUG - Requesting: http://10.0.0.30:8108/Snh_LoadbalancerDatabaseList?x=1ec4254d-12a3-44d1-8d72-2c8165c68360 2025-02-10 15:03:25,379 - INFO - Service ctest-nginx-svc-33662825 with uuid 1ec4254d-12a3-44d1-8d72-2c8165c68360 found in kube manager 2025-02-10 15:03:25,379 - INFO - Service ctest-nginx-svc-33662825 verification passed 2025-02-10 15:03:26,446 - DEBUG - [Pod ctest-pod-11922631] Cmd: wget http://10.98.160.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.160.143:80 (10.98.160.143:80) ctest-pod-03307207 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-10 15:03:26,446 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd wget http://10.98.160.143:80/ -O - -T 5 -t 1 passed 2025-02-10 15:03:26,446 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd output: Connecting to 10.98.160.143:80 (10.98.160.143:80) ctest-pod-03307207 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-10 15:03:26,525 - DEBUG - [Pod ctest-pod-11922631] Cmd: wget http://10.98.160.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.160.143:80 (10.98.160.143:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-42004626 2025-02-10 15:03:26,525 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd wget http://10.98.160.143:80/ -O - -T 5 -t 1 passed 2025-02-10 15:03:26,525 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd output: Connecting to 10.98.160.143:80 (10.98.160.143:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-42004626 2025-02-10 15:03:26,525 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-42004626': 1, 'ctest-pod-03307207': 1} 2025-02-10 15:03:26,590 - DEBUG - [Pod ctest-pod-37556792] Cmd: wget http://10.98.160.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.160.143:80 (10.98.160.143:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-03307207 2025-02-10 15:03:26,590 - DEBUG - [Pod Pod ctest-pod-37556792] Cmd wget http://10.98.160.143:80/ -O - -T 5 -t 1 passed 2025-02-10 15:03:26,590 - DEBUG - [Pod Pod ctest-pod-37556792] Cmd output: Connecting to 10.98.160.143:80 (10.98.160.143:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-03307207 2025-02-10 15:03:26,682 - DEBUG - [Pod ctest-pod-37556792] Cmd: wget http://10.98.160.143:80/ -O - -T 5 -t 1 , Output: ctest-pod-42004626 Connecting to 10.98.160.143:80 (10.98.160.143:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-10 15:03:26,682 - DEBUG - [Pod Pod ctest-pod-37556792] Cmd wget http://10.98.160.143:80/ -O - -T 5 -t 1 passed 2025-02-10 15:03:26,682 - DEBUG - [Pod Pod ctest-pod-37556792] Cmd output: ctest-pod-42004626 Connecting to 10.98.160.143:80 (10.98.160.143:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-10 15:03:26,682 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-42004626': 1, 'ctest-pod-03307207': 1} 2025-02-10 15:03:26,689 - DEBUG - Network policy ingress-on-service not present 2025-02-10 15:03:26,805 - INFO - Creating Network Policy ingress-on-service 2025-02-10 15:03:26,832 - INFO - Network policy found in k8s 2025-02-10 15:03:26,843 - DEBUG - Requesting: http://10.0.0.30:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=3a537ee4-681d-4fbb-ba6d-e3824a49944a 2025-02-10 15:03:26,852 - INFO - Network Policy ingress-on-service with uuid 3a537ee4-681d-4fbb-ba6d-e3824a49944a found in kube manager 2025-02-10 15:03:26,937 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-02-10 15:03:26,945 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-02-10 15:03:26,946 - DEBUG - Requesting: http://10.0.0.30:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=3a537ee4-681d-4fbb-ba6d-e3824a49944a 2025-02-10 15:03:26,976 - WARNING - Network policy with name ingress-on-service not found in agent 2025-02-10 15:03:28,977 - DEBUG - Requesting: http://10.0.0.30:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=3a537ee4-681d-4fbb-ba6d-e3824a49944a 2025-02-10 15:03:29,009 - INFO - Network policy with name ingress-on-service found in agent 2025-02-10 15:03:29,009 - INFO - Network Policy ingress-on-service verification passed 2025-02-10 15:03:34,073 - DEBUG - [Pod ctest-pod-11922631] Cmd: wget http://10.98.160.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:03:34,073 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd wget http://10.98.160.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:03:34,073 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:03:39,129 - DEBUG - [Pod ctest-pod-11922631] Cmd: wget http://10.98.160.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:03:39,129 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd wget http://10.98.160.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:03:39,129 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:03:44,202 - DEBUG - [Pod ctest-pod-11922631] Cmd: wget http://10.98.160.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:03:44,202 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd wget http://10.98.160.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:03:44,202 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:03:49,255 - DEBUG - [Pod ctest-pod-11922631] Cmd: wget http://10.98.160.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:03:49,255 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd wget http://10.98.160.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:03:49,255 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:03:54,326 - DEBUG - [Pod ctest-pod-11922631] Cmd: wget http://10.98.160.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:03:54,327 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd wget http://10.98.160.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:03:54,327 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:03:59,401 - DEBUG - [Pod ctest-pod-11922631] Cmd: wget http://10.98.160.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:03:59,401 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd wget http://10.98.160.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:03:59,401 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:04:04,467 - DEBUG - [Pod ctest-pod-11922631] Cmd: wget http://10.98.160.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:04:04,467 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd wget http://10.98.160.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:04:04,467 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:04:09,533 - DEBUG - [Pod ctest-pod-11922631] Cmd: wget http://10.98.160.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:04:09,534 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd wget http://10.98.160.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:04:09,534 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:04:14,610 - DEBUG - [Pod ctest-pod-11922631] Cmd: wget http://10.98.160.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:04:14,610 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd wget http://10.98.160.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:04:14,610 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:04:19,674 - DEBUG - [Pod ctest-pod-11922631] Cmd: wget http://10.98.160.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:04:19,674 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd wget http://10.98.160.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:04:19,674 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:04:19,675 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-42004626': 0, 'ctest-pod-03307207': 0} 2025-02-10 15:04:19,748 - DEBUG - [Pod ctest-pod-27686373] Cmd: wget http://10.98.160.143:80/ -O - -T 5 -t 1 , Output: ctest-pod-03307207 Connecting to 10.98.160.143:80 (10.98.160.143:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-10 15:04:19,749 - DEBUG - [Pod Pod ctest-pod-27686373] Cmd wget http://10.98.160.143:80/ -O - -T 5 -t 1 passed 2025-02-10 15:04:19,749 - DEBUG - [Pod Pod ctest-pod-27686373] Cmd output: ctest-pod-03307207 Connecting to 10.98.160.143:80 (10.98.160.143:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-10 15:04:19,830 - DEBUG - [Pod ctest-pod-27686373] Cmd: wget http://10.98.160.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.160.143:80 (10.98.160.143:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-03307207 2025-02-10 15:04:19,830 - DEBUG - [Pod Pod ctest-pod-27686373] Cmd wget http://10.98.160.143:80/ -O - -T 5 -t 1 passed 2025-02-10 15:04:19,830 - DEBUG - [Pod Pod ctest-pod-27686373] Cmd output: Connecting to 10.98.160.143:80 (10.98.160.143:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-03307207 2025-02-10 15:04:19,923 - DEBUG - [Pod ctest-pod-27686373] Cmd: wget http://10.98.160.143:80/ -O - -T 5 -t 1 , Output: ctest-pod-42004626 Connecting to 10.98.160.143:80 (10.98.160.143:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-10 15:04:19,923 - DEBUG - [Pod Pod ctest-pod-27686373] Cmd wget http://10.98.160.143:80/ -O - -T 5 -t 1 passed 2025-02-10 15:04:19,924 - DEBUG - [Pod Pod ctest-pod-27686373] Cmd output: ctest-pod-42004626 Connecting to 10.98.160.143:80 (10.98.160.143:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-10 15:04:19,924 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-42004626': 1, 'ctest-pod-03307207': 2} 2025-02-10 15:04:24,997 - DEBUG - [Pod ctest-pod-37556792] Cmd: wget http://10.98.160.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:04:24,997 - DEBUG - [Pod Pod ctest-pod-37556792] Cmd wget http://10.98.160.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:04:24,997 - DEBUG - [Pod Pod ctest-pod-37556792] Cmd output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:04:30,080 - DEBUG - [Pod ctest-pod-37556792] Cmd: wget http://10.98.160.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:04:30,080 - DEBUG - [Pod Pod ctest-pod-37556792] Cmd wget http://10.98.160.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:04:30,080 - DEBUG - [Pod Pod ctest-pod-37556792] Cmd output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:04:35,160 - DEBUG - [Pod ctest-pod-37556792] Cmd: wget http://10.98.160.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:04:35,160 - DEBUG - [Pod Pod ctest-pod-37556792] Cmd wget http://10.98.160.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:04:35,160 - DEBUG - [Pod Pod ctest-pod-37556792] Cmd output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:04:40,224 - DEBUG - [Pod ctest-pod-37556792] Cmd: wget http://10.98.160.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:04:40,224 - DEBUG - [Pod Pod ctest-pod-37556792] Cmd wget http://10.98.160.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:04:40,225 - DEBUG - [Pod Pod ctest-pod-37556792] Cmd output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:04:45,285 - DEBUG - [Pod ctest-pod-37556792] Cmd: wget http://10.98.160.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:04:45,286 - DEBUG - [Pod Pod ctest-pod-37556792] Cmd wget http://10.98.160.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:04:45,286 - DEBUG - [Pod Pod ctest-pod-37556792] Cmd output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:04:50,363 - DEBUG - [Pod ctest-pod-37556792] Cmd: wget http://10.98.160.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:04:50,363 - DEBUG - [Pod Pod ctest-pod-37556792] Cmd wget http://10.98.160.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:04:50,363 - DEBUG - [Pod Pod ctest-pod-37556792] Cmd output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:04:55,475 - DEBUG - [Pod ctest-pod-37556792] Cmd: wget http://10.98.160.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:04:55,475 - DEBUG - [Pod Pod ctest-pod-37556792] Cmd wget http://10.98.160.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:04:55,475 - DEBUG - [Pod Pod ctest-pod-37556792] Cmd output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:05:00,562 - DEBUG - [Pod ctest-pod-37556792] Cmd: wget http://10.98.160.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:05:00,563 - DEBUG - [Pod Pod ctest-pod-37556792] Cmd wget http://10.98.160.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:05:00,563 - DEBUG - [Pod Pod ctest-pod-37556792] Cmd output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:05:05,629 - DEBUG - [Pod ctest-pod-37556792] Cmd: wget http://10.98.160.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:05:05,629 - DEBUG - [Pod Pod ctest-pod-37556792] Cmd wget http://10.98.160.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:05:05,629 - DEBUG - [Pod Pod ctest-pod-37556792] Cmd output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:05:10,695 - DEBUG - [Pod ctest-pod-37556792] Cmd: wget http://10.98.160.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:05:10,695 - DEBUG - [Pod Pod ctest-pod-37556792] Cmd wget http://10.98.160.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:05:10,695 - DEBUG - [Pod Pod ctest-pod-37556792] Cmd output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:05:10,695 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-42004626': 0, 'ctest-pod-03307207': 0} 2025-02-10 15:05:12,773 - DEBUG - [Pod ctest-pod-27686373] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.628 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.090 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.112 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.090/0.610/1.628 ms 2025-02-10 15:05:12,773 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-27686373 with expectation True passed 2025-02-10 15:05:14,835 - DEBUG - [Pod ctest-pod-11922631] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.551 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.086 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.101 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.086/0.579/1.551 ms 2025-02-10 15:05:14,835 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-11922631 with expectation True passed 2025-02-10 15:05:16,900 - DEBUG - [Pod ctest-pod-37556792] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.562 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.085 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.099 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.085/0.248/0.562 ms 2025-02-10 15:05:16,900 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-37556792 with expectation True passed 2025-02-10 15:05:16,965 - DEBUG - [Pod ctest-pod-27686373] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-02-10 15:05:16,965 - DEBUG - [Pod Pod ctest-pod-27686373] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-02-10 15:05:16,965 - DEBUG - [Pod Pod ctest-pod-27686373] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-02-10 15:05:16,965 - INFO - wget check of of http://10.47.255.251 from ctest-pod-27686373 passed 2025-02-10 15:05:17,032 - DEBUG - [Pod ctest-pod-27686373] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-02-10 15:05:17,032 - DEBUG - [Pod Pod ctest-pod-27686373] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-02-10 15:05:17,032 - DEBUG - [Pod Pod ctest-pod-27686373] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-02-10 15:05:17,032 - INFO - wget check of of http://10.47.255.250 from ctest-pod-27686373 passed 2025-02-10 15:05:22,111 - DEBUG - [Pod ctest-pod-11922631] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-02-10 15:05:22,111 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-02-10 15:05:22,111 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-02-10 15:05:22,111 - INFO - wget check of of http://10.47.255.250 from ctest-pod-11922631 passed 2025-02-10 15:05:27,192 - DEBUG - [Pod ctest-pod-86220149] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-02-10 15:05:27,192 - DEBUG - [Pod Pod ctest-pod-86220149] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-02-10 15:05:27,192 - DEBUG - [Pod Pod ctest-pod-86220149] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-02-10 15:05:27,192 - INFO - wget check of of http://10.47.255.251 from ctest-pod-86220149 passed 2025-02-10 15:05:27,201 - INFO - Updating Network Policy ingress-on-service 2025-02-10 15:05:32,263 - DEBUG - [Pod ctest-pod-11922631] Cmd: wget http://10.98.160.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:05:32,264 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd wget http://10.98.160.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:05:32,264 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:05:37,339 - DEBUG - [Pod ctest-pod-11922631] Cmd: wget http://10.98.160.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:05:37,339 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd wget http://10.98.160.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:05:37,339 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:05:42,394 - DEBUG - [Pod ctest-pod-11922631] Cmd: wget http://10.98.160.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:05:42,394 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd wget http://10.98.160.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:05:42,394 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:05:47,466 - DEBUG - [Pod ctest-pod-11922631] Cmd: wget http://10.98.160.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:05:47,466 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd wget http://10.98.160.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:05:47,466 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:05:52,545 - DEBUG - [Pod ctest-pod-11922631] Cmd: wget http://10.98.160.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:05:52,545 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd wget http://10.98.160.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:05:52,545 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:05:57,607 - DEBUG - [Pod ctest-pod-11922631] Cmd: wget http://10.98.160.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:05:57,607 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd wget http://10.98.160.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:05:57,607 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:06:02,695 - DEBUG - [Pod ctest-pod-11922631] Cmd: wget http://10.98.160.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:06:02,695 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd wget http://10.98.160.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:06:02,695 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:06:07,757 - DEBUG - [Pod ctest-pod-11922631] Cmd: wget http://10.98.160.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:06:07,757 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd wget http://10.98.160.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:06:07,757 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:06:12,819 - DEBUG - [Pod ctest-pod-11922631] Cmd: wget http://10.98.160.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:06:12,819 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd wget http://10.98.160.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:06:12,819 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:06:17,870 - DEBUG - [Pod ctest-pod-11922631] Cmd: wget http://10.98.160.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:06:17,870 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd wget http://10.98.160.143:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:06:17,870 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd output: Connecting to 10.98.160.143:80 (10.98.160.143:80) wget: download timed out 2025-02-10 15:06:17,870 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-42004626': 0, 'ctest-pod-03307207': 0} 2025-02-10 15:06:17,942 - DEBUG - [Pod ctest-pod-27686373] Cmd: wget http://10.98.160.143:80/ -O - -T 5 -t 1 , Output: ctest-pod-42004626 Connecting to 10.98.160.143:80 (10.98.160.143:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-10 15:06:17,942 - DEBUG - [Pod Pod ctest-pod-27686373] Cmd wget http://10.98.160.143:80/ -O - -T 5 -t 1 passed 2025-02-10 15:06:17,942 - DEBUG - [Pod Pod ctest-pod-27686373] Cmd output: ctest-pod-42004626 Connecting to 10.98.160.143:80 (10.98.160.143:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-10 15:06:18,013 - DEBUG - [Pod ctest-pod-27686373] Cmd: wget http://10.98.160.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.160.143:80 (10.98.160.143:80) ctest-pod-03307207 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-10 15:06:18,013 - DEBUG - [Pod Pod ctest-pod-27686373] Cmd wget http://10.98.160.143:80/ -O - -T 5 -t 1 passed 2025-02-10 15:06:18,013 - DEBUG - [Pod Pod ctest-pod-27686373] Cmd output: Connecting to 10.98.160.143:80 (10.98.160.143:80) ctest-pod-03307207 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-10 15:06:18,013 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-42004626': 1, 'ctest-pod-03307207': 1} 2025-02-10 15:06:18,084 - DEBUG - [Pod ctest-pod-37556792] Cmd: wget http://10.98.160.143:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.160.143:80 (10.98.160.143:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-03307207 2025-02-10 15:06:18,084 - DEBUG - [Pod Pod ctest-pod-37556792] Cmd wget http://10.98.160.143:80/ -O - -T 5 -t 1 passed 2025-02-10 15:06:18,084 - DEBUG - [Pod Pod ctest-pod-37556792] Cmd output: Connecting to 10.98.160.143:80 (10.98.160.143:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-03307207 2025-02-10 15:06:18,150 - DEBUG - [Pod ctest-pod-37556792] Cmd: wget http://10.98.160.143:80/ -O - -T 5 -t 1 , Output: ctest-pod-03307207 Connecting to 10.98.160.143:80 (10.98.160.143:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-10 15:06:18,150 - DEBUG - [Pod Pod ctest-pod-37556792] Cmd wget http://10.98.160.143:80/ -O - -T 5 -t 1 passed 2025-02-10 15:06:18,150 - DEBUG - [Pod Pod ctest-pod-37556792] Cmd output: ctest-pod-03307207 Connecting to 10.98.160.143:80 (10.98.160.143:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-10 15:06:18,207 - DEBUG - [Pod ctest-pod-37556792] Cmd: wget http://10.98.160.143:80/ -O - -T 5 -t 1 , Output: ctest-pod-42004626 Connecting to 10.98.160.143:80 (10.98.160.143:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-10 15:06:18,207 - DEBUG - [Pod Pod ctest-pod-37556792] Cmd wget http://10.98.160.143:80/ -O - -T 5 -t 1 passed 2025-02-10 15:06:18,207 - DEBUG - [Pod Pod ctest-pod-37556792] Cmd output: ctest-pod-42004626 Connecting to 10.98.160.143:80 (10.98.160.143:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-02-10 15:06:18,207 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-42004626': 1, 'ctest-pod-03307207': 2} 2025-02-10 15:06:20,284 - DEBUG - [Pod ctest-pod-27686373] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.127 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.099 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.099 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.099/0.441/1.127 ms 2025-02-10 15:06:20,284 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-27686373 with expectation True passed 2025-02-10 15:06:22,350 - DEBUG - [Pod ctest-pod-11922631] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.328 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.103 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.120 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.103/0.517/1.328 ms 2025-02-10 15:06:22,351 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-11922631 with expectation True passed 2025-02-10 15:06:24,416 - DEBUG - [Pod ctest-pod-37556792] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.402 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.102 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.100 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.100/0.534/1.402 ms 2025-02-10 15:06:24,416 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-37556792 with expectation True passed 2025-02-10 15:06:24,496 - DEBUG - [Pod ctest-pod-27686373] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-02-10 15:06:24,496 - DEBUG - [Pod Pod ctest-pod-27686373] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-02-10 15:06:24,496 - DEBUG - [Pod Pod ctest-pod-27686373] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-02-10 15:06:24,497 - INFO - wget check of of http://10.47.255.251 from ctest-pod-27686373 passed 2025-02-10 15:06:24,573 - DEBUG - [Pod ctest-pod-27686373] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-02-10 15:06:24,573 - DEBUG - [Pod Pod ctest-pod-27686373] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-02-10 15:06:24,573 - DEBUG - [Pod Pod ctest-pod-27686373] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-02-10 15:06:24,573 - INFO - wget check of of http://10.47.255.250 from ctest-pod-27686373 passed 2025-02-10 15:06:29,650 - DEBUG - [Pod ctest-pod-11922631] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-02-10 15:06:29,650 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-02-10 15:06:29,650 - DEBUG - [Pod Pod ctest-pod-11922631] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-02-10 15:06:29,650 - INFO - wget check of of http://10.47.255.250 from ctest-pod-11922631 passed 2025-02-10 15:06:29,720 - DEBUG - [Pod ctest-pod-86220149] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-02-10 15:06:29,721 - DEBUG - [Pod Pod ctest-pod-86220149] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-02-10 15:06:29,721 - DEBUG - [Pod Pod ctest-pod-86220149] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-02-10 15:06:29,721 - INFO - wget check of of http://10.47.255.251 from ctest-pod-86220149 passed 2025-02-10 15:06:29,721 - INFO - Deleting Network Policy : ingress-on-service 2025-02-10 15:06:29,721 - INFO - Deleting service : ctest-nginx-svc-33662825 2025-02-10 15:06:29,909 - DEBUG - No XMPP flaps were noticed during the test
2025-02-10 15:06:29,909 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:06]
2025-02-10 15:06:29,910 - INFO - -------------------------------------------------------------------------------- 2025-02-10 15:06:29,914 - INFO - Deleting pod ctest-new-default-00393999:ctest-pod-42004626 2025-02-10 15:06:29,915 - INFO - Deleting pod ctest-new-default-00393999:ctest-pod-03307207 2025-02-10 15:06:29,915 - INFO - Deleting pod ctest-non-default-52770776:ctest-pod-48549041 2025-02-10 15:06:29,915 - INFO - Deleting pod ctest-non-default-52770776:ctest-pod-70782608 2025-02-10 15:06:29,916 - INFO - Deleting pod ctest-new-default-00393999:ctest-pod-11922631 2025-02-10 15:06:29,916 - INFO - Deleting pod ctest-new-default-00393999:ctest-pod-27686373 2025-02-10 15:06:29,916 - INFO - Deleting pod ctest-non-default-52770776:ctest-pod-37556792 2025-02-10 15:06:29,916 - INFO - Deleting pod ctest-non-default-52770776:ctest-pod-86220149 2025-02-10 15:06:30,047 - WARNING - Pod uuid d2392130-9d80-4a30-a831-fd0678ebd1fd is still seen in agent 10.0.0.12 VM list 2025-02-10 15:06:30,048 - WARNING - Pod uuid 6abc6987-95d2-4394-87c1-e35622f9b577 is still seen in agent 10.0.0.12 VM list 2025-02-10 15:06:30,048 - WARNING - Pod uuid 68cd02ef-8b71-46ee-a565-4238cd5f7558 is still seen in agent 10.0.0.12 VM list 2025-02-10 15:06:30,048 - WARNING - Pod uuid 0c18092e-685d-4ca2-83cd-5869de8a1925 is still seen in agent 10.0.0.12 VM list 2025-02-10 15:06:30,049 - WARNING - Pod uuid 94c9ff5f-c5c5-4cfd-b6a9-ddbe09df4adb is still seen in agent 10.0.0.12 VM list 2025-02-10 15:06:30,050 - WARNING - Pod uuid 279bfd41-a300-49b9-bdee-0b4d1f2a3e9f is still seen in agent 10.0.0.12 VM list 2025-02-10 15:06:30,050 - WARNING - Pod uuid 492b3c9c-12a8-4c59-90ce-77ee770919c2 is still seen in agent 10.0.0.12 VM list 2025-02-10 15:06:30,050 - WARNING - Pod uuid 4ae18f07-98ff-4c6b-852c-156db58eea82 is still seen in agent 10.0.0.12 VM list 2025-02-10 15:06:35,084 - DEBUG - Pod 492b3c9c-12a8-4c59-90ce-77ee770919c2 is not in agent 10.0.0.12 VM list 2025-02-10 15:06:35,085 - DEBUG - Pod 6abc6987-95d2-4394-87c1-e35622f9b577 is not in agent 10.0.0.12 VM list 2025-02-10 15:06:35,086 - WARNING - Pod uuid 68cd02ef-8b71-46ee-a565-4238cd5f7558 is still seen in agent 10.0.0.12 VM list 2025-02-10 15:06:35,087 - DEBUG - Pod 0c18092e-685d-4ca2-83cd-5869de8a1925 is not in agent 10.0.0.12 VM list 2025-02-10 15:06:35,088 - WARNING - Pod uuid d2392130-9d80-4a30-a831-fd0678ebd1fd is still seen in agent 10.0.0.12 VM list 2025-02-10 15:06:35,091 - WARNING - Pod uuid 4ae18f07-98ff-4c6b-852c-156db58eea82 is still seen in agent 10.0.0.12 VM list 2025-02-10 15:06:35,091 - WARNING - Pod uuid 279bfd41-a300-49b9-bdee-0b4d1f2a3e9f is still seen in agent 10.0.0.12 VM list 2025-02-10 15:06:35,092 - DEBUG - Pod 94c9ff5f-c5c5-4cfd-b6a9-ddbe09df4adb is not in agent 10.0.0.12 VM list 2025-02-10 15:06:35,105 - DEBUG - VMI 22b1722a-e7c0-11ef-b6ee-fa163e6cd968 is removed from agent 10.0.0.12 2025-02-10 15:06:35,105 - INFO - Verified that pod ctest-pod-70782608 is removed in agent 2025-02-10 15:06:35,108 - DEBUG - VMI 22219c36-e7c0-11ef-b6ee-fa163e6cd968 is removed from agent 10.0.0.12 2025-02-10 15:06:35,108 - INFO - Verified that pod ctest-pod-48549041 is removed in agent 2025-02-10 15:06:35,109 - DEBUG - VMI 216502ec-e7c0-11ef-b6ee-fa163e6cd968 is removed from agent 10.0.0.12 2025-02-10 15:06:35,109 - INFO - Verified that pod ctest-pod-03307207 is removed in agent 2025-02-10 15:06:35,109 - DEBUG - VMI 20dff926-e7c0-11ef-b6ee-fa163e6cd968 is removed from agent 10.0.0.12 2025-02-10 15:06:35,109 - INFO - Verified that pod ctest-pod-42004626 is removed in agent 2025-02-10 15:06:40,110 - WARNING - Pod uuid 68cd02ef-8b71-46ee-a565-4238cd5f7558 is still seen in agent 10.0.0.12 VM list 2025-02-10 15:06:40,112 - WARNING - Pod uuid 279bfd41-a300-49b9-bdee-0b4d1f2a3e9f is still seen in agent 10.0.0.12 VM list 2025-02-10 15:06:40,112 - WARNING - Pod uuid 4ae18f07-98ff-4c6b-852c-156db58eea82 is still seen in agent 10.0.0.12 VM list 2025-02-10 15:06:40,113 - WARNING - Pod uuid d2392130-9d80-4a30-a831-fd0678ebd1fd is still seen in agent 10.0.0.12 VM list 2025-02-10 15:06:45,130 - WARNING - Pod uuid 68cd02ef-8b71-46ee-a565-4238cd5f7558 is still seen in agent 10.0.0.12 VM list 2025-02-10 15:06:45,132 - WARNING - Pod uuid 4ae18f07-98ff-4c6b-852c-156db58eea82 is still seen in agent 10.0.0.12 VM list 2025-02-10 15:06:45,132 - WARNING - Pod uuid d2392130-9d80-4a30-a831-fd0678ebd1fd is still seen in agent 10.0.0.12 VM list 2025-02-10 15:06:45,133 - WARNING - Pod uuid 279bfd41-a300-49b9-bdee-0b4d1f2a3e9f is still seen in agent 10.0.0.12 VM list 2025-02-10 15:06:50,151 - WARNING - Pod uuid 68cd02ef-8b71-46ee-a565-4238cd5f7558 is still seen in agent 10.0.0.12 VM list 2025-02-10 15:06:50,154 - WARNING - Pod uuid 279bfd41-a300-49b9-bdee-0b4d1f2a3e9f is still seen in agent 10.0.0.12 VM list 2025-02-10 15:06:50,155 - WARNING - Pod uuid d2392130-9d80-4a30-a831-fd0678ebd1fd is still seen in agent 10.0.0.12 VM list 2025-02-10 15:06:50,155 - WARNING - Pod uuid 4ae18f07-98ff-4c6b-852c-156db58eea82 is still seen in agent 10.0.0.12 VM list 2025-02-10 15:06:55,167 - WARNING - Pod uuid 68cd02ef-8b71-46ee-a565-4238cd5f7558 is still seen in agent 10.0.0.12 VM list 2025-02-10 15:06:55,173 - WARNING - Pod uuid 279bfd41-a300-49b9-bdee-0b4d1f2a3e9f is still seen in agent 10.0.0.12 VM list 2025-02-10 15:06:55,174 - WARNING - Pod uuid 4ae18f07-98ff-4c6b-852c-156db58eea82 is still seen in agent 10.0.0.12 VM list 2025-02-10 15:06:55,175 - WARNING - Pod uuid d2392130-9d80-4a30-a831-fd0678ebd1fd is still seen in agent 10.0.0.12 VM list 2025-02-10 15:07:00,211 - WARNING - Pod uuid d2392130-9d80-4a30-a831-fd0678ebd1fd is still seen in agent 10.0.0.12 VM list 2025-02-10 15:07:00,213 - WARNING - Pod uuid 4ae18f07-98ff-4c6b-852c-156db58eea82 is still seen in agent 10.0.0.12 VM list 2025-02-10 15:07:00,213 - WARNING - Pod uuid 279bfd41-a300-49b9-bdee-0b4d1f2a3e9f is still seen in agent 10.0.0.12 VM list 2025-02-10 15:07:00,214 - WARNING - Pod uuid 68cd02ef-8b71-46ee-a565-4238cd5f7558 is still seen in agent 10.0.0.12 VM list 2025-02-10 15:07:05,239 - DEBUG - Pod 68cd02ef-8b71-46ee-a565-4238cd5f7558 is not in agent 10.0.0.12 VM list 2025-02-10 15:07:05,241 - DEBUG - Pod d2392130-9d80-4a30-a831-fd0678ebd1fd is not in agent 10.0.0.12 VM list 2025-02-10 15:07:05,249 - DEBUG - Pod 4ae18f07-98ff-4c6b-852c-156db58eea82 is not in agent 10.0.0.12 VM list 2025-02-10 15:07:05,252 - DEBUG - Pod 279bfd41-a300-49b9-bdee-0b4d1f2a3e9f is not in agent 10.0.0.12 VM list 2025-02-10 15:07:05,267 - DEBUG - VMI 24db348c-e7c0-11ef-b6ee-fa163e6cd968 is removed from agent 10.0.0.12 2025-02-10 15:07:05,267 - INFO - Verified that pod ctest-pod-86220149 is removed in agent 2025-02-10 15:07:05,269 - DEBUG - VMI 23d6f580-e7c0-11ef-b6ee-fa163e6cd968 is removed from agent 10.0.0.12 2025-02-10 15:07:05,269 - INFO - Verified that pod ctest-pod-27686373 is removed in agent 2025-02-10 15:07:05,270 - DEBUG - VMI 2350d4be-e7c0-11ef-b6ee-fa163e6cd968 is removed from agent 10.0.0.12 2025-02-10 15:07:05,270 - INFO - Verified that pod ctest-pod-11922631 is removed in agent 2025-02-10 15:07:05,270 - DEBUG - VMI 24547e92-e7c0-11ef-b6ee-fa163e6cd968 is removed from agent 10.0.0.12 2025-02-10 15:07:05,270 - INFO - Verified that pod ctest-pod-37556792 is removed in agent 2025-02-10 15:07:05,270 - INFO - Deleting namespace ctest-non-default-52770776 2025-02-10 15:07:05,295 - DEBUG - Namespace ctest-non-default-52770776 still in k8s 2025-02-10 15:07:07,300 - DEBUG - Namespace ctest-non-default-52770776 still in k8s 2025-02-10 15:07:09,305 - DEBUG - Namespace ctest-non-default-52770776 still in k8s 2025-02-10 15:07:11,308 - DEBUG - Namespace ctest-non-default-52770776 is not in k8s 2025-02-10 15:07:11,308 - DEBUG - No need to check project deletion in contrail-api 2025-02-10 15:07:11,308 - INFO - Deleting namespace ctest-new-default-00393999 2025-02-10 15:07:11,317 - DEBUG - Namespace ctest-new-default-00393999 still in k8s 2025-02-10 15:07:13,321 - DEBUG - Namespace ctest-new-default-00393999 still in k8s 2025-02-10 15:07:15,326 - DEBUG - Namespace ctest-new-default-00393999 still in k8s 2025-02-10 15:07:17,330 - DEBUG - Namespace ctest-new-default-00393999 is not in k8s 2025-02-10 15:07:17,330 - DEBUG - No need to check project deletion in contrail-api