2025-01-06 01:50:30,912 - INFO - Using existing project ['default-domain', 'k8s-default'](caec2422-13e3-46de-adf7-2ff70936beaa) 2025-01-06 01:50:30,942 - DEBUG - Namespace ctest-new-default-41220570 not present 2025-01-06 01:50:30,953 - INFO - Created namespace ctest-new-default-41220570 2025-01-06 01:50:33,958 - DEBUG - Namespace ctest-non-default-76130852 not present 2025-01-06 01:50:33,966 - INFO - Created namespace ctest-non-default-76130852 2025-01-06 01:50:36,986 - DEBUG - Pod ctest-pod-72647304 not present 2025-01-06 01:50:36,986 - INFO - Creating Pod ctest-pod-72647304 2025-01-06 01:50:37,010 - DEBUG - Pod : ctest-pod-72647304 UUID is f30e71db-6fba-4a6e-b50f-ff083905b54b 2025-01-06 01:50:37,017 - DEBUG - Pod ctest-pod-63170351 not present 2025-01-06 01:50:37,017 - INFO - Creating Pod ctest-pod-63170351 2025-01-06 01:50:37,039 - DEBUG - Pod : ctest-pod-63170351 UUID is 704c71b4-6c64-4407-b9fe-855afe392d27 2025-01-06 01:50:37,042 - DEBUG - Pod ctest-pod-01338204 not present 2025-01-06 01:50:37,042 - INFO - Creating Pod ctest-pod-01338204 2025-01-06 01:50:37,069 - DEBUG - Pod : ctest-pod-01338204 UUID is 8a6919cc-0ca8-45c4-bad6-ec02aaceb4b5 2025-01-06 01:50:37,072 - DEBUG - Pod ctest-pod-58754705 not present 2025-01-06 01:50:37,073 - INFO - Creating Pod ctest-pod-58754705 2025-01-06 01:50:37,109 - DEBUG - Pod : ctest-pod-58754705 UUID is 78332465-33dc-4afa-9c0d-4b81d42c8252 2025-01-06 01:50:37,112 - DEBUG - Pod ctest-pod-74236358 not present 2025-01-06 01:50:37,113 - INFO - Creating Pod ctest-pod-74236358 2025-01-06 01:50:37,135 - DEBUG - Pod : ctest-pod-74236358 UUID is b52eecf8-8839-4af9-980a-ed577f8b747b 2025-01-06 01:50:37,141 - DEBUG - Pod ctest-pod-80609589 not present 2025-01-06 01:50:37,141 - INFO - Creating Pod ctest-pod-80609589 2025-01-06 01:50:37,178 - DEBUG - Node for Pod ctest-pod-80609589 not yet populated 2025-01-06 01:50:40,186 - DEBUG - Pod : ctest-pod-80609589 UUID is 50632a07-9393-4212-9ec6-a99f4aef6991 2025-01-06 01:50:40,189 - DEBUG - Pod ctest-pod-36888975 not present 2025-01-06 01:50:40,190 - INFO - Creating Pod ctest-pod-36888975 2025-01-06 01:50:40,216 - DEBUG - Pod : ctest-pod-36888975 UUID is 3f837290-d44e-47ed-b46a-99578f87da11 2025-01-06 01:50:40,223 - DEBUG - Pod ctest-pod-42331519 not present 2025-01-06 01:50:40,224 - INFO - Creating Pod ctest-pod-42331519 2025-01-06 01:50:40,247 - DEBUG - Pod : ctest-pod-42331519 UUID is ed23385c-6a06-442e-964d-33133b0ca720 2025-01-06 01:50:40,935 - INFO - Project default-domain:k8s-ctest-new-default-41220570 for Namespace ctest-new-default-41220570 is seen in contrail-api 2025-01-06 01:50:40,935 - DEBUG - Project uuid in Contrail is 52a29990-1c2a-418f-9d57-08a2474c20fc 2025-01-06 01:50:41,250 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_NamespaceDatabaseList?namespace_uuid=c3153fd8-7900-4040-a8d2-6415b36dd4ee 2025-01-06 01:50:41,259 - INFO - Namespace ctest-new-default-41220570 with uuid c3153fd8-7900-4040-a8d2-6415b36dd4ee found in kube manager 2025-01-06 01:50:41,259 - INFO - Namespace ctest-new-default-41220570 verification passed 2025-01-06 01:50:41,701 - INFO - Project default-domain:k8s-ctest-non-default-76130852 for Namespace ctest-non-default-76130852 is seen in contrail-api 2025-01-06 01:50:41,701 - DEBUG - Project uuid in Contrail is 11505a08-c83a-415d-bd13-b8032e2a58ad 2025-01-06 01:50:41,701 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_NamespaceDatabaseList?namespace_uuid=ce879d63-bab9-4e1f-80f8-0ee00329177b 2025-01-06 01:50:41,707 - INFO - Namespace ctest-non-default-76130852 with uuid ce879d63-bab9-4e1f-80f8-0ee00329177b found in kube manager 2025-01-06 01:50:41,707 - INFO - Namespace ctest-non-default-76130852 verification passed 2025-01-06 01:50:41,714 - DEBUG - Pod ctest-pod-72647304 not in running state.Currently in Pending 2025-01-06 01:50:46,724 - INFO - Pod ctest-pod-72647304 is in running state.Got IP 10.47.255.250 2025-01-06 01:50:46,785 - DEBUG - Pod ctest-pod-72647304 has vmi a2088d30-cbd0-11ef-b3e2-0242c64bad59 2025-01-06 01:50:46,785 - INFO - Verified pod ctest-pod-72647304 in contrail-api 2025-01-06 01:50:46,797 - DEBUG - VMI a2088d30-cbd0-11ef-b3e2-0242c64bad59 is active in agent 10.0.0.23 2025-01-06 01:50:46,797 - INFO - Verified Pod ctest-pod-72647304 in agent 10.0.0.23 2025-01-06 01:50:46,797 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=f30e71db-6fba-4a6e-b50f-ff083905b54b 2025-01-06 01:50:46,803 - INFO - Pod ctest-pod-72647304 with uuid f30e71db-6fba-4a6e-b50f-ff083905b54b found in kube manager 2025-01-06 01:50:46,803 - INFO - Pod ctest-pod-72647304 verification passed 2025-01-06 01:50:46,810 - DEBUG - Pod ctest-pod-63170351 not in running state.Currently in Pending 2025-01-06 01:50:51,822 - DEBUG - Pod ctest-pod-63170351 not in running state.Currently in Pending 2025-01-06 01:50:56,830 - INFO - Pod ctest-pod-63170351 is in running state.Got IP 10.47.255.249 2025-01-06 01:50:56,887 - DEBUG - Pod ctest-pod-63170351 has vmi a3165680-cbd0-11ef-b3e2-0242c64bad59 2025-01-06 01:50:56,887 - INFO - Verified pod ctest-pod-63170351 in contrail-api 2025-01-06 01:50:56,908 - DEBUG - VMI a3165680-cbd0-11ef-b3e2-0242c64bad59 is active in agent 10.0.0.23 2025-01-06 01:50:56,909 - INFO - Verified Pod ctest-pod-63170351 in agent 10.0.0.23 2025-01-06 01:50:56,909 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=704c71b4-6c64-4407-b9fe-855afe392d27 2025-01-06 01:50:56,917 - INFO - Pod ctest-pod-63170351 with uuid 704c71b4-6c64-4407-b9fe-855afe392d27 found in kube manager 2025-01-06 01:50:56,917 - INFO - Pod ctest-pod-63170351 verification passed 2025-01-06 01:50:56,925 - INFO - Pod ctest-pod-01338204 is in running state.Got IP 10.47.255.248 2025-01-06 01:50:56,983 - DEBUG - Pod ctest-pod-01338204 has vmi a42b331a-cbd0-11ef-b3e2-0242c64bad59 2025-01-06 01:50:56,983 - INFO - Verified pod ctest-pod-01338204 in contrail-api 2025-01-06 01:50:56,999 - DEBUG - VMI a42b331a-cbd0-11ef-b3e2-0242c64bad59 is active in agent 10.0.0.23 2025-01-06 01:50:56,999 - INFO - Verified Pod ctest-pod-01338204 in agent 10.0.0.23 2025-01-06 01:50:57,000 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=8a6919cc-0ca8-45c4-bad6-ec02aaceb4b5 2025-01-06 01:50:57,006 - INFO - Pod ctest-pod-01338204 with uuid 8a6919cc-0ca8-45c4-bad6-ec02aaceb4b5 found in kube manager 2025-01-06 01:50:57,006 - INFO - Pod ctest-pod-01338204 verification passed 2025-01-06 01:50:57,013 - INFO - Pod ctest-pod-58754705 is in running state.Got IP 10.47.255.247 2025-01-06 01:50:57,111 - DEBUG - Pod ctest-pod-58754705 has vmi a4ff98e4-cbd0-11ef-b3e2-0242c64bad59 2025-01-06 01:50:57,111 - INFO - Verified pod ctest-pod-58754705 in contrail-api 2025-01-06 01:50:57,124 - DEBUG - VMI a4ff98e4-cbd0-11ef-b3e2-0242c64bad59 is active in agent 10.0.0.23 2025-01-06 01:50:57,124 - INFO - Verified Pod ctest-pod-58754705 in agent 10.0.0.23 2025-01-06 01:50:57,125 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=78332465-33dc-4afa-9c0d-4b81d42c8252 2025-01-06 01:50:57,131 - INFO - Pod ctest-pod-58754705 with uuid 78332465-33dc-4afa-9c0d-4b81d42c8252 found in kube manager 2025-01-06 01:50:57,131 - INFO - Pod ctest-pod-58754705 verification passed 2025-01-06 01:50:57,140 - INFO - Pod ctest-pod-74236358 is in running state.Got IP 10.47.255.246 2025-01-06 01:50:57,237 - DEBUG - Pod ctest-pod-74236358 has vmi a60a24ca-cbd0-11ef-b3e2-0242c64bad59 2025-01-06 01:50:57,237 - INFO - Verified pod ctest-pod-74236358 in contrail-api 2025-01-06 01:50:57,251 - DEBUG - VMI a60a24ca-cbd0-11ef-b3e2-0242c64bad59 is active in agent 10.0.0.23 2025-01-06 01:50:57,251 - INFO - Verified Pod ctest-pod-74236358 in agent 10.0.0.23 2025-01-06 01:50:57,252 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=b52eecf8-8839-4af9-980a-ed577f8b747b 2025-01-06 01:50:57,257 - INFO - Pod ctest-pod-74236358 with uuid b52eecf8-8839-4af9-980a-ed577f8b747b found in kube manager 2025-01-06 01:50:57,257 - INFO - Pod ctest-pod-74236358 verification passed 2025-01-06 01:50:57,267 - DEBUG - Pod ctest-pod-36888975 not in running state.Currently in Pending 2025-01-06 01:51:02,276 - INFO - Pod ctest-pod-36888975 is in running state.Got IP 10.47.255.244 2025-01-06 01:51:02,334 - DEBUG - Pod ctest-pod-36888975 has vmi a7dc88d8-cbd0-11ef-b3e2-0242c64bad59 2025-01-06 01:51:02,334 - INFO - Verified pod ctest-pod-36888975 in contrail-api 2025-01-06 01:51:02,349 - DEBUG - VMI a7dc88d8-cbd0-11ef-b3e2-0242c64bad59 is active in agent 10.0.0.23 2025-01-06 01:51:02,349 - INFO - Verified Pod ctest-pod-36888975 in agent 10.0.0.23 2025-01-06 01:51:02,349 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=3f837290-d44e-47ed-b46a-99578f87da11 2025-01-06 01:51:02,355 - INFO - Pod ctest-pod-36888975 with uuid 3f837290-d44e-47ed-b46a-99578f87da11 found in kube manager 2025-01-06 01:51:02,355 - INFO - Pod ctest-pod-36888975 verification passed 2025-01-06 01:51:02,362 - INFO - Pod ctest-pod-80609589 is in running state.Got IP 10.47.255.245 2025-01-06 01:51:02,459 - DEBUG - Pod ctest-pod-80609589 has vmi a6e96ee6-cbd0-11ef-b3e2-0242c64bad59 2025-01-06 01:51:02,459 - INFO - Verified pod ctest-pod-80609589 in contrail-api 2025-01-06 01:51:02,472 - DEBUG - VMI a6e96ee6-cbd0-11ef-b3e2-0242c64bad59 is active in agent 10.0.0.23 2025-01-06 01:51:02,472 - INFO - Verified Pod ctest-pod-80609589 in agent 10.0.0.23 2025-01-06 01:51:02,472 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=50632a07-9393-4212-9ec6-a99f4aef6991 2025-01-06 01:51:02,477 - INFO - Pod ctest-pod-80609589 with uuid 50632a07-9393-4212-9ec6-a99f4aef6991 found in kube manager 2025-01-06 01:51:02,477 - INFO - Pod ctest-pod-80609589 verification passed 2025-01-06 01:51:02,485 - INFO - Pod ctest-pod-42331519 is in running state.Got IP 10.47.255.243 2025-01-06 01:51:02,581 - DEBUG - Pod ctest-pod-42331519 has vmi a8fd4dba-cbd0-11ef-b3e2-0242c64bad59 2025-01-06 01:51:02,581 - INFO - Verified pod ctest-pod-42331519 in contrail-api 2025-01-06 01:51:02,594 - DEBUG - VMI a8fd4dba-cbd0-11ef-b3e2-0242c64bad59 is active in agent 10.0.0.23 2025-01-06 01:51:02,594 - INFO - Verified Pod ctest-pod-42331519 in agent 10.0.0.23 2025-01-06 01:51:02,594 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=ed23385c-6a06-442e-964d-33133b0ca720 2025-01-06 01:51:02,599 - INFO - Pod ctest-pod-42331519 with uuid ed23385c-6a06-442e-964d-33133b0ca720 found in kube manager 2025-01-06 01:51:02,599 - INFO - Pod ctest-pod-42331519 verification passed 2025-01-06 01:51:02,599 - INFO - ================================================================================ 2025-01-06 01:51:02,599 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-01-06 01:51:02,600 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-01-06 01:51:02,873 - DEBUG - Nothing to compare xmpp stats {'10.0.0.23': {'10.0.0.23': '2'}} with 2025-01-06 01:51:02,873 - INFO - Initial checks done. Running the testcase now 2025-01-06 01:51:02,874 - INFO - 2025-01-06 01:51:02,959 - DEBUG - [Pod ctest-pod-72647304] Cmd: echo ctest-pod-72647304 > /usr/share/nginx/html/index.html, Output: 2025-01-06 01:51:03,070 - DEBUG - [Pod ctest-pod-63170351] Cmd: echo ctest-pod-63170351 > /usr/share/nginx/html/index.html, Output: 2025-01-06 01:51:03,160 - DEBUG - [Pod ctest-pod-01338204] Cmd: echo ctest-pod-01338204 > /usr/share/nginx/html/index.html, Output: 2025-01-06 01:51:03,263 - DEBUG - [Pod ctest-pod-58754705] Cmd: echo ctest-pod-58754705 > /usr/share/nginx/html/index.html, Output: 2025-01-06 01:51:03,267 - DEBUG - Service ctest-nginx-svc-38438862 not present 2025-01-06 01:51:03,267 - INFO - Creating service ctest-nginx-svc-38438862 2025-01-06 01:51:03,280 - INFO - Created Service ctest-nginx-svc-38438862 2025-01-06 01:51:03,289 - WARNING - Service UUID 552c15ed-0247-406e-bfab-19cc2249cbd8 not yet found in contrail-api 2025-01-06 01:51:04,313 - INFO - Validated that Service ctest-nginx-svc-38438862 is seen in contrail-api 2025-01-06 01:51:04,313 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_LoadbalancerDatabaseList?x=552c15ed-0247-406e-bfab-19cc2249cbd8 2025-01-06 01:51:04,322 - INFO - Service ctest-nginx-svc-38438862 with uuid 552c15ed-0247-406e-bfab-19cc2249cbd8 found in kube manager 2025-01-06 01:51:04,322 - INFO - Service ctest-nginx-svc-38438862 verification passed 2025-01-06 01:51:05,469 - DEBUG - [Pod ctest-pod-74236358] Cmd: wget http://10.99.96.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.96.188:80 (10.99.96.188:80) writing to stdout - 100% ctest-pod-72647304 |********************************| 19 0:00:00 ETA written to stdout 2025-01-06 01:51:05,469 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd wget http://10.99.96.188:80/ -O - -T 5 -t 1 passed 2025-01-06 01:51:05,469 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd output: Connecting to 10.99.96.188:80 (10.99.96.188:80) writing to stdout - 100% ctest-pod-72647304 |********************************| 19 0:00:00 ETA written to stdout 2025-01-06 01:51:05,585 - DEBUG - [Pod ctest-pod-74236358] Cmd: wget http://10.99.96.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.96.188:80 (10.99.96.188:80) writing to stdout ctest-pod-72647304 - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-06 01:51:05,585 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd wget http://10.99.96.188:80/ -O - -T 5 -t 1 passed 2025-01-06 01:51:05,585 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd output: Connecting to 10.99.96.188:80 (10.99.96.188:80) writing to stdout ctest-pod-72647304 - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-06 01:51:05,690 - DEBUG - [Pod ctest-pod-74236358] Cmd: wget http://10.99.96.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.96.188:80 (10.99.96.188:80) writing to stdout ctest-pod-72647304 - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-06 01:51:05,690 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd wget http://10.99.96.188:80/ -O - -T 5 -t 1 passed 2025-01-06 01:51:05,690 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd output: Connecting to 10.99.96.188:80 (10.99.96.188:80) writing to stdout ctest-pod-72647304 - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-06 01:51:05,785 - DEBUG - [Pod ctest-pod-74236358] Cmd: wget http://10.99.96.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.96.188:80 (10.99.96.188:80) writing to stdout - 100% ctest-pod-72647304 |********************************| 19 0:00:00 ETA written to stdout 2025-01-06 01:51:05,785 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd wget http://10.99.96.188:80/ -O - -T 5 -t 1 passed 2025-01-06 01:51:05,785 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd output: Connecting to 10.99.96.188:80 (10.99.96.188:80) writing to stdout - 100% ctest-pod-72647304 |********************************| 19 0:00:00 ETA written to stdout 2025-01-06 01:51:05,882 - DEBUG - [Pod ctest-pod-74236358] Cmd: wget http://10.99.96.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.96.188:80 (10.99.96.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-72647304 2025-01-06 01:51:05,883 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd wget http://10.99.96.188:80/ -O - -T 5 -t 1 passed 2025-01-06 01:51:05,883 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd output: Connecting to 10.99.96.188:80 (10.99.96.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-72647304 2025-01-06 01:51:05,967 - DEBUG - [Pod ctest-pod-74236358] Cmd: wget http://10.99.96.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.96.188:80 (10.99.96.188:80) ctest-pod-63170351 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-06 01:51:05,967 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd wget http://10.99.96.188:80/ -O - -T 5 -t 1 passed 2025-01-06 01:51:05,967 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd output: Connecting to 10.99.96.188:80 (10.99.96.188:80) ctest-pod-63170351 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-06 01:51:05,967 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-72647304': 5, 'ctest-pod-63170351': 1} 2025-01-06 01:51:06,055 - DEBUG - [Pod ctest-pod-36888975] Cmd: wget http://10.99.96.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.96.188:80 (10.99.96.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-72647304 2025-01-06 01:51:06,056 - DEBUG - [Pod Pod ctest-pod-36888975] Cmd wget http://10.99.96.188:80/ -O - -T 5 -t 1 passed 2025-01-06 01:51:06,056 - DEBUG - [Pod Pod ctest-pod-36888975] Cmd output: Connecting to 10.99.96.188:80 (10.99.96.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-72647304 2025-01-06 01:51:06,140 - DEBUG - [Pod ctest-pod-36888975] Cmd: wget http://10.99.96.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.96.188:80 (10.99.96.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-72647304 2025-01-06 01:51:06,140 - DEBUG - [Pod Pod ctest-pod-36888975] Cmd wget http://10.99.96.188:80/ -O - -T 5 -t 1 passed 2025-01-06 01:51:06,140 - DEBUG - [Pod Pod ctest-pod-36888975] Cmd output: Connecting to 10.99.96.188:80 (10.99.96.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-72647304 2025-01-06 01:51:06,223 - DEBUG - [Pod ctest-pod-36888975] Cmd: wget http://10.99.96.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.96.188:80 (10.99.96.188:80) ctest-pod-63170351 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-06 01:51:06,224 - DEBUG - [Pod Pod ctest-pod-36888975] Cmd wget http://10.99.96.188:80/ -O - -T 5 -t 1 passed 2025-01-06 01:51:06,224 - DEBUG - [Pod Pod ctest-pod-36888975] Cmd output: Connecting to 10.99.96.188:80 (10.99.96.188:80) ctest-pod-63170351 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-06 01:51:06,224 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-72647304': 2, 'ctest-pod-63170351': 1} 2025-01-06 01:51:06,229 - DEBUG - Network policy ingress-on-service not present 2025-01-06 01:51:06,229 - INFO - Creating Network Policy ingress-on-service 2025-01-06 01:51:06,243 - INFO - Network policy found in k8s 2025-01-06 01:51:06,243 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=e1d9c0fe-5069-49a2-b462-617ee5ec3d61 2025-01-06 01:51:06,254 - INFO - Network Policy ingress-on-service with uuid e1d9c0fe-5069-49a2-b462-617ee5ec3d61 found in kube manager 2025-01-06 01:51:06,291 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-01-06 01:51:06,292 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-01-06 01:51:06,292 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=e1d9c0fe-5069-49a2-b462-617ee5ec3d61 2025-01-06 01:51:06,328 - WARNING - Network policy with name ingress-on-service not found in agent 2025-01-06 01:51:08,328 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=e1d9c0fe-5069-49a2-b462-617ee5ec3d61 2025-01-06 01:51:08,363 - WARNING - Network policy with name ingress-on-service not found in agent 2025-01-06 01:51:10,364 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=e1d9c0fe-5069-49a2-b462-617ee5ec3d61 2025-01-06 01:51:10,400 - INFO - Network policy with name ingress-on-service found in agent 2025-01-06 01:51:10,400 - INFO - Network Policy ingress-on-service verification passed 2025-01-06 01:51:15,514 - DEBUG - [Pod ctest-pod-74236358] Cmd: wget http://10.99.96.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:51:15,514 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd wget http://10.99.96.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:51:15,514 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:51:20,621 - DEBUG - [Pod ctest-pod-74236358] Cmd: wget http://10.99.96.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:51:20,622 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd wget http://10.99.96.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:51:20,622 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:51:25,719 - DEBUG - [Pod ctest-pod-74236358] Cmd: wget http://10.99.96.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:51:25,719 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd wget http://10.99.96.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:51:25,719 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:51:30,802 - DEBUG - [Pod ctest-pod-74236358] Cmd: wget http://10.99.96.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:51:30,802 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd wget http://10.99.96.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:51:30,802 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:51:35,894 - DEBUG - [Pod ctest-pod-74236358] Cmd: wget http://10.99.96.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:51:35,895 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd wget http://10.99.96.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:51:35,895 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:51:40,972 - DEBUG - [Pod ctest-pod-74236358] Cmd: wget http://10.99.96.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:51:40,972 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd wget http://10.99.96.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:51:40,972 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:51:46,072 - DEBUG - [Pod ctest-pod-74236358] Cmd: wget http://10.99.96.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:51:46,072 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd wget http://10.99.96.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:51:46,072 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:51:51,164 - DEBUG - [Pod ctest-pod-74236358] Cmd: wget http://10.99.96.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:51:51,164 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd wget http://10.99.96.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:51:51,164 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:51:56,245 - DEBUG - [Pod ctest-pod-74236358] Cmd: wget http://10.99.96.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:51:56,245 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd wget http://10.99.96.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:51:56,245 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:52:01,331 - DEBUG - [Pod ctest-pod-74236358] Cmd: wget http://10.99.96.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:52:01,331 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd wget http://10.99.96.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:52:01,331 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:52:01,331 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-72647304': 0, 'ctest-pod-63170351': 0} 2025-01-06 01:52:01,425 - DEBUG - [Pod ctest-pod-80609589] Cmd: wget http://10.99.96.188:80/ -O - -T 5 -t 1 , Output: ctest-pod-72647304 Connecting to 10.99.96.188:80 (10.99.96.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-06 01:52:01,425 - DEBUG - [Pod Pod ctest-pod-80609589] Cmd wget http://10.99.96.188:80/ -O - -T 5 -t 1 passed 2025-01-06 01:52:01,425 - DEBUG - [Pod Pod ctest-pod-80609589] Cmd output: ctest-pod-72647304 Connecting to 10.99.96.188:80 (10.99.96.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-06 01:52:01,497 - DEBUG - [Pod ctest-pod-80609589] Cmd: wget http://10.99.96.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.96.188:80 (10.99.96.188:80) ctest-pod-63170351 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-06 01:52:01,497 - DEBUG - [Pod Pod ctest-pod-80609589] Cmd wget http://10.99.96.188:80/ -O - -T 5 -t 1 passed 2025-01-06 01:52:01,497 - DEBUG - [Pod Pod ctest-pod-80609589] Cmd output: Connecting to 10.99.96.188:80 (10.99.96.188:80) ctest-pod-63170351 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-06 01:52:01,497 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-72647304': 1, 'ctest-pod-63170351': 1} 2025-01-06 01:52:06,578 - DEBUG - [Pod ctest-pod-36888975] Cmd: wget http://10.99.96.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:52:06,578 - DEBUG - [Pod Pod ctest-pod-36888975] Cmd wget http://10.99.96.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:52:06,578 - DEBUG - [Pod Pod ctest-pod-36888975] Cmd output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:52:11,662 - DEBUG - [Pod ctest-pod-36888975] Cmd: wget http://10.99.96.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:52:11,663 - DEBUG - [Pod Pod ctest-pod-36888975] Cmd wget http://10.99.96.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:52:11,663 - DEBUG - [Pod Pod ctest-pod-36888975] Cmd output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:52:16,749 - DEBUG - [Pod ctest-pod-36888975] Cmd: wget http://10.99.96.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:52:16,749 - DEBUG - [Pod Pod ctest-pod-36888975] Cmd wget http://10.99.96.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:52:16,749 - DEBUG - [Pod Pod ctest-pod-36888975] Cmd output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:52:21,840 - DEBUG - [Pod ctest-pod-36888975] Cmd: wget http://10.99.96.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:52:21,840 - DEBUG - [Pod Pod ctest-pod-36888975] Cmd wget http://10.99.96.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:52:21,840 - DEBUG - [Pod Pod ctest-pod-36888975] Cmd output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:52:26,927 - DEBUG - [Pod ctest-pod-36888975] Cmd: wget http://10.99.96.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:52:26,927 - DEBUG - [Pod Pod ctest-pod-36888975] Cmd wget http://10.99.96.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:52:26,927 - DEBUG - [Pod Pod ctest-pod-36888975] Cmd output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:52:32,013 - DEBUG - [Pod ctest-pod-36888975] Cmd: wget http://10.99.96.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:52:32,013 - DEBUG - [Pod Pod ctest-pod-36888975] Cmd wget http://10.99.96.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:52:32,013 - DEBUG - [Pod Pod ctest-pod-36888975] Cmd output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:52:37,101 - DEBUG - [Pod ctest-pod-36888975] Cmd: wget http://10.99.96.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:52:37,101 - DEBUG - [Pod Pod ctest-pod-36888975] Cmd wget http://10.99.96.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:52:37,101 - DEBUG - [Pod Pod ctest-pod-36888975] Cmd output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:52:42,182 - DEBUG - [Pod ctest-pod-36888975] Cmd: wget http://10.99.96.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:52:42,183 - DEBUG - [Pod Pod ctest-pod-36888975] Cmd wget http://10.99.96.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:52:42,183 - DEBUG - [Pod Pod ctest-pod-36888975] Cmd output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:52:47,274 - DEBUG - [Pod ctest-pod-36888975] Cmd: wget http://10.99.96.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:52:47,274 - DEBUG - [Pod Pod ctest-pod-36888975] Cmd wget http://10.99.96.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:52:47,274 - DEBUG - [Pod Pod ctest-pod-36888975] Cmd output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:52:52,367 - DEBUG - [Pod ctest-pod-36888975] Cmd: wget http://10.99.96.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:52:52,368 - DEBUG - [Pod Pod ctest-pod-36888975] Cmd wget http://10.99.96.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:52:52,368 - DEBUG - [Pod Pod ctest-pod-36888975] Cmd output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:52:52,368 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-72647304': 0, 'ctest-pod-63170351': 0} 2025-01-06 01:52:54,451 - DEBUG - [Pod ctest-pod-80609589] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.459 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.059 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.110 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.059/0.209/0.459 ms 2025-01-06 01:52:54,451 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-80609589 with expectation True passed 2025-01-06 01:52:56,537 - DEBUG - [Pod ctest-pod-74236358] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.396 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.091 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.079 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.079/0.188/0.396 ms 2025-01-06 01:52:56,537 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-74236358 with expectation True passed 2025-01-06 01:52:58,611 - DEBUG - [Pod ctest-pod-36888975] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.914 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.086 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.116 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.086/0.372/0.914 ms 2025-01-06 01:52:58,611 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-36888975 with expectation True passed 2025-01-06 01:52:58,700 - DEBUG - [Pod ctest-pod-80609589] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-06 01:52:58,700 - DEBUG - [Pod Pod ctest-pod-80609589] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-01-06 01:52:58,700 - DEBUG - [Pod Pod ctest-pod-80609589] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-06 01:52:58,700 - INFO - wget check of of http://10.47.255.250 from ctest-pod-80609589 passed 2025-01-06 01:52:58,797 - DEBUG - [Pod ctest-pod-80609589] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-06 01:52:58,797 - DEBUG - [Pod Pod ctest-pod-80609589] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 passed 2025-01-06 01:52:58,797 - DEBUG - [Pod Pod ctest-pod-80609589] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-06 01:52:58,797 - INFO - wget check of of http://10.47.255.249 from ctest-pod-80609589 passed 2025-01-06 01:53:03,873 - DEBUG - [Pod ctest-pod-74236358] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2025-01-06 01:53:03,873 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2025-01-06 01:53:03,873 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2025-01-06 01:53:03,873 - INFO - wget check of of http://10.47.255.249 from ctest-pod-74236358 passed 2025-01-06 01:53:08,963 - DEBUG - [Pod ctest-pod-42331519] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-06 01:53:08,963 - DEBUG - [Pod Pod ctest-pod-42331519] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-06 01:53:08,963 - DEBUG - [Pod Pod ctest-pod-42331519] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-06 01:53:08,963 - INFO - wget check of of http://10.47.255.250 from ctest-pod-42331519 passed 2025-01-06 01:53:08,976 - INFO - Updating Network Policy ingress-on-service 2025-01-06 01:53:14,067 - DEBUG - [Pod ctest-pod-74236358] Cmd: wget http://10.99.96.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:53:14,067 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd wget http://10.99.96.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:53:14,067 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:53:19,171 - DEBUG - [Pod ctest-pod-74236358] Cmd: wget http://10.99.96.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:53:19,171 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd wget http://10.99.96.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:53:19,171 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:53:24,248 - DEBUG - [Pod ctest-pod-74236358] Cmd: wget http://10.99.96.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:53:24,248 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd wget http://10.99.96.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:53:24,248 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:53:29,329 - DEBUG - [Pod ctest-pod-74236358] Cmd: wget http://10.99.96.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:53:29,329 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd wget http://10.99.96.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:53:29,329 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:53:34,417 - DEBUG - [Pod ctest-pod-74236358] Cmd: wget http://10.99.96.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:53:34,417 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd wget http://10.99.96.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:53:34,417 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:53:39,509 - DEBUG - [Pod ctest-pod-74236358] Cmd: wget http://10.99.96.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:53:39,509 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd wget http://10.99.96.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:53:39,509 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:53:44,603 - DEBUG - [Pod ctest-pod-74236358] Cmd: wget http://10.99.96.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:53:44,604 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd wget http://10.99.96.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:53:44,604 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:53:49,695 - DEBUG - [Pod ctest-pod-74236358] Cmd: wget http://10.99.96.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:53:49,695 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd wget http://10.99.96.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:53:49,695 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:53:54,808 - DEBUG - [Pod ctest-pod-74236358] Cmd: wget http://10.99.96.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:53:54,808 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd wget http://10.99.96.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:53:54,809 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:53:59,904 - DEBUG - [Pod ctest-pod-74236358] Cmd: wget http://10.99.96.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:53:59,904 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd wget http://10.99.96.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:53:59,904 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd output: Connecting to 10.99.96.188:80 (10.99.96.188:80) wget: download timed out 2025-01-06 01:53:59,904 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-72647304': 0, 'ctest-pod-63170351': 0} 2025-01-06 01:53:59,987 - DEBUG - [Pod ctest-pod-80609589] Cmd: wget http://10.99.96.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.96.188:80 (10.99.96.188:80) ctest-pod-72647304 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-06 01:53:59,987 - DEBUG - [Pod Pod ctest-pod-80609589] Cmd wget http://10.99.96.188:80/ -O - -T 5 -t 1 passed 2025-01-06 01:53:59,987 - DEBUG - [Pod Pod ctest-pod-80609589] Cmd output: Connecting to 10.99.96.188:80 (10.99.96.188:80) ctest-pod-72647304 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-06 01:54:00,083 - DEBUG - [Pod ctest-pod-80609589] Cmd: wget http://10.99.96.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.96.188:80 (10.99.96.188:80) writing to stdout ctest-pod-72647304 - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-06 01:54:00,083 - DEBUG - [Pod Pod ctest-pod-80609589] Cmd wget http://10.99.96.188:80/ -O - -T 5 -t 1 passed 2025-01-06 01:54:00,083 - DEBUG - [Pod Pod ctest-pod-80609589] Cmd output: Connecting to 10.99.96.188:80 (10.99.96.188:80) writing to stdout ctest-pod-72647304 - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-06 01:54:00,179 - DEBUG - [Pod ctest-pod-80609589] Cmd: wget http://10.99.96.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.96.188:80 (10.99.96.188:80) ctest-pod-63170351 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-06 01:54:00,179 - DEBUG - [Pod Pod ctest-pod-80609589] Cmd wget http://10.99.96.188:80/ -O - -T 5 -t 1 passed 2025-01-06 01:54:00,179 - DEBUG - [Pod Pod ctest-pod-80609589] Cmd output: Connecting to 10.99.96.188:80 (10.99.96.188:80) ctest-pod-63170351 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-06 01:54:00,179 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-72647304': 2, 'ctest-pod-63170351': 1} 2025-01-06 01:54:00,265 - DEBUG - [Pod ctest-pod-36888975] Cmd: wget http://10.99.96.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.96.188:80 (10.99.96.188:80) ctest-pod-63170351 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-06 01:54:00,265 - DEBUG - [Pod Pod ctest-pod-36888975] Cmd wget http://10.99.96.188:80/ -O - -T 5 -t 1 passed 2025-01-06 01:54:00,265 - DEBUG - [Pod Pod ctest-pod-36888975] Cmd output: Connecting to 10.99.96.188:80 (10.99.96.188:80) ctest-pod-63170351 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-06 01:54:00,372 - DEBUG - [Pod ctest-pod-36888975] Cmd: wget http://10.99.96.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.96.188:80 (10.99.96.188:80) ctest-pod-72647304 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-06 01:54:00,372 - DEBUG - [Pod Pod ctest-pod-36888975] Cmd wget http://10.99.96.188:80/ -O - -T 5 -t 1 passed 2025-01-06 01:54:00,372 - DEBUG - [Pod Pod ctest-pod-36888975] Cmd output: Connecting to 10.99.96.188:80 (10.99.96.188:80) ctest-pod-72647304 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-06 01:54:00,372 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-72647304': 1, 'ctest-pod-63170351': 1} 2025-01-06 01:54:02,453 - DEBUG - [Pod ctest-pod-80609589] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.772 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.073 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.072 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.072/0.639/1.772 ms 2025-01-06 01:54:02,453 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-80609589 with expectation True passed 2025-01-06 01:54:04,547 - DEBUG - [Pod ctest-pod-74236358] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=1.058 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.101 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.080 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.080/0.413/1.058 ms 2025-01-06 01:54:04,547 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-74236358 with expectation True passed 2025-01-06 01:54:06,635 - DEBUG - [Pod ctest-pod-36888975] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.388 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.096 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.080 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.080/0.188/0.388 ms 2025-01-06 01:54:06,635 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-36888975 with expectation True passed 2025-01-06 01:54:06,717 - DEBUG - [Pod ctest-pod-80609589] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-06 01:54:06,717 - DEBUG - [Pod Pod ctest-pod-80609589] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-01-06 01:54:06,717 - DEBUG - [Pod Pod ctest-pod-80609589] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-06 01:54:06,717 - INFO - wget check of of http://10.47.255.250 from ctest-pod-80609589 passed 2025-01-06 01:54:06,804 - DEBUG - [Pod ctest-pod-80609589] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-06 01:54:06,804 - DEBUG - [Pod Pod ctest-pod-80609589] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 passed 2025-01-06 01:54:06,804 - DEBUG - [Pod Pod ctest-pod-80609589] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-06 01:54:06,804 - INFO - wget check of of http://10.47.255.249 from ctest-pod-80609589 passed 2025-01-06 01:54:11,884 - DEBUG - [Pod ctest-pod-74236358] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2025-01-06 01:54:11,885 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2025-01-06 01:54:11,885 - DEBUG - [Pod Pod ctest-pod-74236358] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2025-01-06 01:54:11,885 - INFO - wget check of of http://10.47.255.249 from ctest-pod-74236358 passed 2025-01-06 01:54:11,970 - DEBUG - [Pod ctest-pod-42331519] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-06 01:54:11,970 - DEBUG - [Pod Pod ctest-pod-42331519] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-01-06 01:54:11,971 - DEBUG - [Pod Pod ctest-pod-42331519] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-06 01:54:11,971 - INFO - wget check of of http://10.47.255.250 from ctest-pod-42331519 passed 2025-01-06 01:54:11,971 - INFO - Deleting Network Policy : ingress-on-service 2025-01-06 01:54:11,971 - INFO - Deleting service : ctest-nginx-svc-38438862 2025-01-06 01:54:12,587 - DEBUG - No XMPP flaps were noticed during the test
2025-01-06 01:54:12,587 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:10]
2025-01-06 01:54:12,587 - INFO - -------------------------------------------------------------------------------- 2025-01-06 01:54:12,594 - INFO - Deleting pod ctest-new-default-41220570:ctest-pod-72647304 2025-01-06 01:54:12,594 - INFO - Deleting pod ctest-new-default-41220570:ctest-pod-63170351 2025-01-06 01:54:12,594 - INFO - Deleting pod ctest-non-default-76130852:ctest-pod-01338204 2025-01-06 01:54:12,595 - INFO - Deleting pod ctest-non-default-76130852:ctest-pod-58754705 2025-01-06 01:54:12,595 - INFO - Deleting pod ctest-new-default-41220570:ctest-pod-74236358 2025-01-06 01:54:12,595 - INFO - Deleting pod ctest-new-default-41220570:ctest-pod-80609589 2025-01-06 01:54:12,596 - INFO - Deleting pod ctest-non-default-76130852:ctest-pod-36888975 2025-01-06 01:54:12,596 - INFO - Deleting pod ctest-non-default-76130852:ctest-pod-42331519 2025-01-06 01:54:12,793 - WARNING - Pod uuid 3f837290-d44e-47ed-b46a-99578f87da11 is still seen in agent 10.0.0.23 VM list 2025-01-06 01:54:12,793 - WARNING - Pod uuid 78332465-33dc-4afa-9c0d-4b81d42c8252 is still seen in agent 10.0.0.23 VM list 2025-01-06 01:54:12,794 - WARNING - Pod uuid f30e71db-6fba-4a6e-b50f-ff083905b54b is still seen in agent 10.0.0.23 VM list 2025-01-06 01:54:12,794 - WARNING - Pod uuid 704c71b4-6c64-4407-b9fe-855afe392d27 is still seen in agent 10.0.0.23 VM list 2025-01-06 01:54:12,795 - WARNING - Pod uuid b52eecf8-8839-4af9-980a-ed577f8b747b is still seen in agent 10.0.0.23 VM list 2025-01-06 01:54:12,796 - WARNING - Pod uuid 8a6919cc-0ca8-45c4-bad6-ec02aaceb4b5 is still seen in agent 10.0.0.23 VM list 2025-01-06 01:54:12,844 - WARNING - Pod uuid 50632a07-9393-4212-9ec6-a99f4aef6991 is still seen in agent 10.0.0.23 VM list 2025-01-06 01:54:12,844 - WARNING - Pod uuid ed23385c-6a06-442e-964d-33133b0ca720 is still seen in agent 10.0.0.23 VM list 2025-01-06 01:54:17,832 - WARNING - Pod uuid 3f837290-d44e-47ed-b46a-99578f87da11 is still seen in agent 10.0.0.23 VM list 2025-01-06 01:54:17,833 - DEBUG - Pod 78332465-33dc-4afa-9c0d-4b81d42c8252 is not in agent 10.0.0.23 VM list 2025-01-06 01:54:17,838 - DEBUG - Pod f30e71db-6fba-4a6e-b50f-ff083905b54b is not in agent 10.0.0.23 VM list 2025-01-06 01:54:17,844 - DEBUG - Pod 704c71b4-6c64-4407-b9fe-855afe392d27 is not in agent 10.0.0.23 VM list 2025-01-06 01:54:17,850 - WARNING - Pod uuid b52eecf8-8839-4af9-980a-ed577f8b747b is still seen in agent 10.0.0.23 VM list 2025-01-06 01:54:17,850 - WARNING - Pod uuid 8a6919cc-0ca8-45c4-bad6-ec02aaceb4b5 is still seen in agent 10.0.0.23 VM list 2025-01-06 01:54:17,860 - DEBUG - VMI a3165680-cbd0-11ef-b3e2-0242c64bad59 is removed from agent 10.0.0.23 2025-01-06 01:54:17,860 - INFO - Verified that pod ctest-pod-63170351 is removed in agent 2025-01-06 01:54:17,861 - DEBUG - VMI a2088d30-cbd0-11ef-b3e2-0242c64bad59 is removed from agent 10.0.0.23 2025-01-06 01:54:17,861 - INFO - Verified that pod ctest-pod-72647304 is removed in agent 2025-01-06 01:54:17,861 - DEBUG - VMI a4ff98e4-cbd0-11ef-b3e2-0242c64bad59 is removed from agent 10.0.0.23 2025-01-06 01:54:17,861 - INFO - Verified that pod ctest-pod-58754705 is removed in agent 2025-01-06 01:54:17,867 - WARNING - Pod uuid 50632a07-9393-4212-9ec6-a99f4aef6991 is still seen in agent 10.0.0.23 VM list 2025-01-06 01:54:17,868 - WARNING - Pod uuid ed23385c-6a06-442e-964d-33133b0ca720 is still seen in agent 10.0.0.23 VM list 2025-01-06 01:54:22,840 - WARNING - Pod uuid 3f837290-d44e-47ed-b46a-99578f87da11 is still seen in agent 10.0.0.23 VM list 2025-01-06 01:54:22,861 - WARNING - Pod uuid b52eecf8-8839-4af9-980a-ed577f8b747b is still seen in agent 10.0.0.23 VM list 2025-01-06 01:54:22,863 - DEBUG - Pod 8a6919cc-0ca8-45c4-bad6-ec02aaceb4b5 is not in agent 10.0.0.23 VM list 2025-01-06 01:54:22,868 - DEBUG - VMI a42b331a-cbd0-11ef-b3e2-0242c64bad59 is removed from agent 10.0.0.23 2025-01-06 01:54:22,868 - INFO - Verified that pod ctest-pod-01338204 is removed in agent 2025-01-06 01:54:22,879 - WARNING - Pod uuid 50632a07-9393-4212-9ec6-a99f4aef6991 is still seen in agent 10.0.0.23 VM list 2025-01-06 01:54:22,880 - WARNING - Pod uuid ed23385c-6a06-442e-964d-33133b0ca720 is still seen in agent 10.0.0.23 VM list 2025-01-06 01:54:27,848 - WARNING - Pod uuid 3f837290-d44e-47ed-b46a-99578f87da11 is still seen in agent 10.0.0.23 VM list 2025-01-06 01:54:27,869 - WARNING - Pod uuid b52eecf8-8839-4af9-980a-ed577f8b747b is still seen in agent 10.0.0.23 VM list 2025-01-06 01:54:27,891 - WARNING - Pod uuid 50632a07-9393-4212-9ec6-a99f4aef6991 is still seen in agent 10.0.0.23 VM list 2025-01-06 01:54:27,892 - WARNING - Pod uuid ed23385c-6a06-442e-964d-33133b0ca720 is still seen in agent 10.0.0.23 VM list 2025-01-06 01:54:32,857 - WARNING - Pod uuid 3f837290-d44e-47ed-b46a-99578f87da11 is still seen in agent 10.0.0.23 VM list 2025-01-06 01:54:32,877 - WARNING - Pod uuid b52eecf8-8839-4af9-980a-ed577f8b747b is still seen in agent 10.0.0.23 VM list 2025-01-06 01:54:32,904 - WARNING - Pod uuid 50632a07-9393-4212-9ec6-a99f4aef6991 is still seen in agent 10.0.0.23 VM list 2025-01-06 01:54:32,905 - WARNING - Pod uuid ed23385c-6a06-442e-964d-33133b0ca720 is still seen in agent 10.0.0.23 VM list 2025-01-06 01:54:37,865 - WARNING - Pod uuid 3f837290-d44e-47ed-b46a-99578f87da11 is still seen in agent 10.0.0.23 VM list 2025-01-06 01:54:37,885 - WARNING - Pod uuid b52eecf8-8839-4af9-980a-ed577f8b747b is still seen in agent 10.0.0.23 VM list 2025-01-06 01:54:37,916 - WARNING - Pod uuid 50632a07-9393-4212-9ec6-a99f4aef6991 is still seen in agent 10.0.0.23 VM list 2025-01-06 01:54:37,917 - WARNING - Pod uuid ed23385c-6a06-442e-964d-33133b0ca720 is still seen in agent 10.0.0.23 VM list 2025-01-06 01:54:42,874 - WARNING - Pod uuid 3f837290-d44e-47ed-b46a-99578f87da11 is still seen in agent 10.0.0.23 VM list 2025-01-06 01:54:42,897 - WARNING - Pod uuid b52eecf8-8839-4af9-980a-ed577f8b747b is still seen in agent 10.0.0.23 VM list 2025-01-06 01:54:42,938 - WARNING - Pod uuid ed23385c-6a06-442e-964d-33133b0ca720 is still seen in agent 10.0.0.23 VM list 2025-01-06 01:54:42,938 - WARNING - Pod uuid 50632a07-9393-4212-9ec6-a99f4aef6991 is still seen in agent 10.0.0.23 VM list 2025-01-06 01:54:47,882 - DEBUG - Pod 3f837290-d44e-47ed-b46a-99578f87da11 is not in agent 10.0.0.23 VM list 2025-01-06 01:54:47,889 - DEBUG - VMI a7dc88d8-cbd0-11ef-b3e2-0242c64bad59 is removed from agent 10.0.0.23 2025-01-06 01:54:47,889 - INFO - Verified that pod ctest-pod-36888975 is removed in agent 2025-01-06 01:54:47,904 - DEBUG - Pod b52eecf8-8839-4af9-980a-ed577f8b747b is not in agent 10.0.0.23 VM list 2025-01-06 01:54:47,914 - DEBUG - VMI a60a24ca-cbd0-11ef-b3e2-0242c64bad59 is removed from agent 10.0.0.23 2025-01-06 01:54:47,914 - INFO - Verified that pod ctest-pod-74236358 is removed in agent 2025-01-06 01:54:47,950 - DEBUG - Pod ed23385c-6a06-442e-964d-33133b0ca720 is not in agent 10.0.0.23 VM list 2025-01-06 01:54:47,954 - DEBUG - Pod 50632a07-9393-4212-9ec6-a99f4aef6991 is not in agent 10.0.0.23 VM list 2025-01-06 01:54:47,966 - DEBUG - VMI a8fd4dba-cbd0-11ef-b3e2-0242c64bad59 is removed from agent 10.0.0.23 2025-01-06 01:54:47,967 - INFO - Verified that pod ctest-pod-42331519 is removed in agent 2025-01-06 01:54:47,968 - DEBUG - VMI a6e96ee6-cbd0-11ef-b3e2-0242c64bad59 is removed from agent 10.0.0.23 2025-01-06 01:54:47,968 - INFO - Verified that pod ctest-pod-80609589 is removed in agent 2025-01-06 01:54:47,968 - INFO - Deleting namespace ctest-non-default-76130852 2025-01-06 01:54:47,979 - DEBUG - Namespace ctest-non-default-76130852 still in k8s 2025-01-06 01:54:49,984 - DEBUG - Namespace ctest-non-default-76130852 still in k8s 2025-01-06 01:54:51,990 - DEBUG - Namespace ctest-non-default-76130852 still in k8s 2025-01-06 01:54:53,996 - DEBUG - Namespace ctest-non-default-76130852 is not in k8s 2025-01-06 01:54:53,996 - DEBUG - No need to check project deletion in contrail-api 2025-01-06 01:54:53,996 - INFO - Deleting namespace ctest-new-default-41220570 2025-01-06 01:54:54,007 - DEBUG - Namespace ctest-new-default-41220570 still in k8s 2025-01-06 01:54:56,012 - DEBUG - Namespace ctest-new-default-41220570 still in k8s 2025-01-06 01:54:58,018 - DEBUG - Namespace ctest-new-default-41220570 still in k8s 2025-01-06 01:55:00,022 - DEBUG - Namespace ctest-new-default-41220570 is not in k8s 2025-01-06 01:55:00,023 - DEBUG - No need to check project deletion in contrail-api