2024-10-31 02:12:03,417 - INFO - Using existing project ['default-domain', 'k8s-default'](f92acdaf-6681-4608-a7cf-7f32f669307a) 2024-10-31 02:12:03,436 - DEBUG - Namespace ctest-new-default-67575730 not present 2024-10-31 02:12:03,445 - INFO - Created namespace ctest-new-default-67575730 2024-10-31 02:12:06,450 - DEBUG - Namespace ctest-non-default-91220819 not present 2024-10-31 02:12:06,466 - INFO - Created namespace ctest-non-default-91220819 2024-10-31 02:12:09,487 - DEBUG - Pod ctest-pod-93610154 not present 2024-10-31 02:12:09,487 - INFO - Creating Pod ctest-pod-93610154 2024-10-31 02:12:09,525 - DEBUG - Pod : ctest-pod-93610154 UUID is c5d66852-f78d-41d2-8789-5fb5505e8481 2024-10-31 02:12:09,529 - DEBUG - Pod ctest-pod-17950617 not present 2024-10-31 02:12:09,530 - INFO - Creating Pod ctest-pod-17950617 2024-10-31 02:12:09,561 - DEBUG - Pod : ctest-pod-17950617 UUID is 0f5039cd-35b9-4e7f-bce7-01d7bc0198c0 2024-10-31 02:12:09,563 - DEBUG - Pod ctest-pod-34843419 not present 2024-10-31 02:12:09,563 - INFO - Creating Pod ctest-pod-34843419 2024-10-31 02:12:09,594 - DEBUG - Pod : ctest-pod-34843419 UUID is 913b41bc-ba53-4121-a13a-c55ffce14ab5 2024-10-31 02:12:09,607 - DEBUG - Pod ctest-pod-88650778 not present 2024-10-31 02:12:09,607 - INFO - Creating Pod ctest-pod-88650778 2024-10-31 02:12:09,636 - DEBUG - Pod : ctest-pod-88650778 UUID is 1fa342da-6aea-4187-b4e2-bef6ce674e87 2024-10-31 02:12:09,638 - DEBUG - Pod ctest-pod-39330847 not present 2024-10-31 02:12:09,638 - INFO - Creating Pod ctest-pod-39330847 2024-10-31 02:12:09,660 - DEBUG - Pod : ctest-pod-39330847 UUID is 1e40a657-b7cb-4a1b-b5c4-d7503aa1bc59 2024-10-31 02:12:09,663 - DEBUG - Pod ctest-pod-79976811 not present 2024-10-31 02:12:09,663 - INFO - Creating Pod ctest-pod-79976811 2024-10-31 02:12:09,684 - DEBUG - Pod : ctest-pod-79976811 UUID is 4671fdb8-14f6-4f83-9dbc-6c59a97a1505 2024-10-31 02:12:09,687 - DEBUG - Pod ctest-pod-29927320 not present 2024-10-31 02:12:09,687 - INFO - Creating Pod ctest-pod-29927320 2024-10-31 02:12:09,705 - DEBUG - Pod : ctest-pod-29927320 UUID is 87299684-cf05-448f-912e-05f7d68df2a3 2024-10-31 02:12:09,709 - DEBUG - Pod ctest-pod-31457666 not present 2024-10-31 02:12:09,709 - INFO - Creating Pod ctest-pod-31457666 2024-10-31 02:12:09,736 - DEBUG - Pod : ctest-pod-31457666 UUID is e71d1720-3381-42b8-82a8-07b119e4cc3d 2024-10-31 02:12:09,942 - INFO - Project default-domain:k8s-ctest-new-default-67575730 for Namespace ctest-new-default-67575730 is seen in contrail-api 2024-10-31 02:12:09,942 - DEBUG - Project uuid in Contrail is 4c273d98-c795-465c-b3ed-2e9d25ccb182 2024-10-31 02:12:10,073 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NamespaceDatabaseList?namespace_uuid=c08fe3c2-0cfc-4b02-80c5-639f0bef0caa 2024-10-31 02:12:10,078 - INFO - Namespace ctest-new-default-67575730 with uuid c08fe3c2-0cfc-4b02-80c5-639f0bef0caa found in kube manager 2024-10-31 02:12:10,078 - INFO - Namespace ctest-new-default-67575730 verification passed 2024-10-31 02:12:10,357 - INFO - Project default-domain:k8s-ctest-non-default-91220819 for Namespace ctest-non-default-91220819 is seen in contrail-api 2024-10-31 02:12:10,357 - DEBUG - Project uuid in Contrail is 14e2f626-00e6-4129-935a-44e2a9384e07 2024-10-31 02:12:10,357 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NamespaceDatabaseList?namespace_uuid=47ed4b47-74e0-4d3c-a232-826aee199a74 2024-10-31 02:12:10,362 - INFO - Namespace ctest-non-default-91220819 with uuid 47ed4b47-74e0-4d3c-a232-826aee199a74 found in kube manager 2024-10-31 02:12:10,362 - INFO - Namespace ctest-non-default-91220819 verification passed 2024-10-31 02:12:10,368 - DEBUG - Pod ctest-pod-93610154 not in running state.Currently in Pending 2024-10-31 02:12:15,374 - DEBUG - Pod ctest-pod-93610154 not in running state.Currently in Pending 2024-10-31 02:12:20,381 - DEBUG - Pod ctest-pod-93610154 not in running state.Currently in Pending 2024-10-31 02:12:25,388 - INFO - Pod ctest-pod-93610154 is in running state.Got IP 10.47.255.251 2024-10-31 02:12:25,410 - DEBUG - Pod ctest-pod-93610154 has vmi 89fdcdae-972d-11ef-9ae2-fa163e7222e9 2024-10-31 02:12:25,410 - INFO - Verified pod ctest-pod-93610154 in contrail-api 2024-10-31 02:12:25,425 - DEBUG - VMI 89fdcdae-972d-11ef-9ae2-fa163e7222e9 is active in agent 10.0.0.58 2024-10-31 02:12:25,426 - INFO - Verified Pod ctest-pod-93610154 in agent 10.0.0.58 2024-10-31 02:12:25,426 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=c5d66852-f78d-41d2-8789-5fb5505e8481 2024-10-31 02:12:25,430 - INFO - Pod ctest-pod-93610154 with uuid c5d66852-f78d-41d2-8789-5fb5505e8481 found in kube manager 2024-10-31 02:12:25,430 - INFO - Pod ctest-pod-93610154 verification passed 2024-10-31 02:12:25,436 - INFO - Pod ctest-pod-17950617 is in running state.Got IP 10.47.255.250 2024-10-31 02:12:25,497 - DEBUG - Pod ctest-pod-17950617 has vmi 8a8ea572-972d-11ef-9ae2-fa163e7222e9 2024-10-31 02:12:25,497 - INFO - Verified pod ctest-pod-17950617 in contrail-api 2024-10-31 02:12:25,512 - DEBUG - VMI 8a8ea572-972d-11ef-9ae2-fa163e7222e9 is active in agent 10.0.0.58 2024-10-31 02:12:25,513 - INFO - Verified Pod ctest-pod-17950617 in agent 10.0.0.58 2024-10-31 02:12:25,513 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=0f5039cd-35b9-4e7f-bce7-01d7bc0198c0 2024-10-31 02:12:25,518 - INFO - Pod ctest-pod-17950617 with uuid 0f5039cd-35b9-4e7f-bce7-01d7bc0198c0 found in kube manager 2024-10-31 02:12:25,518 - INFO - Pod ctest-pod-17950617 verification passed 2024-10-31 02:12:25,523 - INFO - Pod ctest-pod-34843419 is in running state.Got IP 10.47.255.249 2024-10-31 02:12:25,542 - DEBUG - Pod ctest-pod-34843419 has vmi 8b638d00-972d-11ef-9ae2-fa163e7222e9 2024-10-31 02:12:25,543 - INFO - Verified pod ctest-pod-34843419 in contrail-api 2024-10-31 02:12:25,558 - DEBUG - VMI 8b638d00-972d-11ef-9ae2-fa163e7222e9 is active in agent 10.0.0.58 2024-10-31 02:12:25,558 - INFO - Verified Pod ctest-pod-34843419 in agent 10.0.0.58 2024-10-31 02:12:25,558 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=913b41bc-ba53-4121-a13a-c55ffce14ab5 2024-10-31 02:12:25,564 - INFO - Pod ctest-pod-34843419 with uuid 913b41bc-ba53-4121-a13a-c55ffce14ab5 found in kube manager 2024-10-31 02:12:25,564 - INFO - Pod ctest-pod-34843419 verification passed 2024-10-31 02:12:25,571 - INFO - Pod ctest-pod-88650778 is in running state.Got IP 10.47.255.248 2024-10-31 02:12:25,641 - DEBUG - Pod ctest-pod-88650778 has vmi 8bf9f664-972d-11ef-9ae2-fa163e7222e9 2024-10-31 02:12:25,641 - INFO - Verified pod ctest-pod-88650778 in contrail-api 2024-10-31 02:12:25,656 - DEBUG - VMI 8bf9f664-972d-11ef-9ae2-fa163e7222e9 is active in agent 10.0.0.58 2024-10-31 02:12:25,657 - INFO - Verified Pod ctest-pod-88650778 in agent 10.0.0.58 2024-10-31 02:12:25,657 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=1fa342da-6aea-4187-b4e2-bef6ce674e87 2024-10-31 02:12:25,662 - INFO - Pod ctest-pod-88650778 with uuid 1fa342da-6aea-4187-b4e2-bef6ce674e87 found in kube manager 2024-10-31 02:12:25,662 - INFO - Pod ctest-pod-88650778 verification passed 2024-10-31 02:12:25,668 - INFO - Pod ctest-pod-39330847 is in running state.Got IP 10.47.255.247 2024-10-31 02:12:25,729 - DEBUG - Pod ctest-pod-39330847 has vmi 8ca05f22-972d-11ef-9ae2-fa163e7222e9 2024-10-31 02:12:25,729 - INFO - Verified pod ctest-pod-39330847 in contrail-api 2024-10-31 02:12:25,743 - DEBUG - VMI 8ca05f22-972d-11ef-9ae2-fa163e7222e9 is active in agent 10.0.0.58 2024-10-31 02:12:25,743 - INFO - Verified Pod ctest-pod-39330847 in agent 10.0.0.58 2024-10-31 02:12:25,744 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=1e40a657-b7cb-4a1b-b5c4-d7503aa1bc59 2024-10-31 02:12:25,755 - INFO - Pod ctest-pod-39330847 with uuid 1e40a657-b7cb-4a1b-b5c4-d7503aa1bc59 found in kube manager 2024-10-31 02:12:25,756 - INFO - Pod ctest-pod-39330847 verification passed 2024-10-31 02:12:25,762 - INFO - Pod ctest-pod-29927320 is in running state.Got IP 10.47.255.245 2024-10-31 02:12:25,800 - DEBUG - Pod ctest-pod-29927320 has vmi 8dc14fe2-972d-11ef-9ae2-fa163e7222e9 2024-10-31 02:12:25,800 - INFO - Verified pod ctest-pod-29927320 in contrail-api 2024-10-31 02:12:25,814 - DEBUG - VMI 8dc14fe2-972d-11ef-9ae2-fa163e7222e9 is active in agent 10.0.0.58 2024-10-31 02:12:25,815 - INFO - Verified Pod ctest-pod-29927320 in agent 10.0.0.58 2024-10-31 02:12:25,815 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=87299684-cf05-448f-912e-05f7d68df2a3 2024-10-31 02:12:25,819 - INFO - Pod ctest-pod-29927320 with uuid 87299684-cf05-448f-912e-05f7d68df2a3 found in kube manager 2024-10-31 02:12:25,820 - INFO - Pod ctest-pod-29927320 verification passed 2024-10-31 02:12:25,826 - DEBUG - Pod ctest-pod-79976811 not in running state.Currently in Pending 2024-10-31 02:12:30,833 - INFO - Pod ctest-pod-79976811 is in running state.Got IP 10.47.255.246 2024-10-31 02:12:30,851 - DEBUG - Pod ctest-pod-79976811 has vmi 8d33acb4-972d-11ef-9ae2-fa163e7222e9 2024-10-31 02:12:30,851 - INFO - Verified pod ctest-pod-79976811 in contrail-api 2024-10-31 02:12:30,866 - DEBUG - VMI 8d33acb4-972d-11ef-9ae2-fa163e7222e9 is active in agent 10.0.0.58 2024-10-31 02:12:30,866 - INFO - Verified Pod ctest-pod-79976811 in agent 10.0.0.58 2024-10-31 02:12:30,866 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=4671fdb8-14f6-4f83-9dbc-6c59a97a1505 2024-10-31 02:12:30,871 - INFO - Pod ctest-pod-79976811 with uuid 4671fdb8-14f6-4f83-9dbc-6c59a97a1505 found in kube manager 2024-10-31 02:12:30,871 - INFO - Pod ctest-pod-79976811 verification passed 2024-10-31 02:12:30,876 - INFO - Pod ctest-pod-31457666 is in running state.Got IP 10.47.255.244 2024-10-31 02:12:30,940 - DEBUG - Pod ctest-pod-31457666 has vmi 8e5089aa-972d-11ef-9ae2-fa163e7222e9 2024-10-31 02:12:30,940 - INFO - Verified pod ctest-pod-31457666 in contrail-api 2024-10-31 02:12:30,955 - DEBUG - VMI 8e5089aa-972d-11ef-9ae2-fa163e7222e9 is active in agent 10.0.0.58 2024-10-31 02:12:30,956 - INFO - Verified Pod ctest-pod-31457666 in agent 10.0.0.58 2024-10-31 02:12:30,956 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=e71d1720-3381-42b8-82a8-07b119e4cc3d 2024-10-31 02:12:30,963 - INFO - Pod ctest-pod-31457666 with uuid e71d1720-3381-42b8-82a8-07b119e4cc3d found in kube manager 2024-10-31 02:12:30,963 - INFO - Pod ctest-pod-31457666 verification passed 2024-10-31 02:12:30,963 - INFO - ================================================================================ 2024-10-31 02:12:30,963 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-10-31 02:12:30,964 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-10-31 02:12:31,223 - DEBUG - Nothing to compare xmpp stats {'10.0.0.58': {'10.0.0.27': '0'}} with 2024-10-31 02:12:31,223 - INFO - Initial checks done. Running the testcase now 2024-10-31 02:12:31,223 - INFO - 2024-10-31 02:12:31,301 - DEBUG - [Pod ctest-pod-93610154] Cmd: echo ctest-pod-93610154 > /usr/share/nginx/html/index.html, Output: 2024-10-31 02:12:31,359 - DEBUG - [Pod ctest-pod-17950617] Cmd: echo ctest-pod-17950617 > /usr/share/nginx/html/index.html, Output: 2024-10-31 02:12:31,412 - DEBUG - [Pod ctest-pod-34843419] Cmd: echo ctest-pod-34843419 > /usr/share/nginx/html/index.html, Output: 2024-10-31 02:12:31,488 - DEBUG - [Pod ctest-pod-88650778] Cmd: echo ctest-pod-88650778 > /usr/share/nginx/html/index.html, Output: 2024-10-31 02:12:31,491 - DEBUG - Service ctest-nginx-svc-30958468 not present 2024-10-31 02:12:31,491 - INFO - Creating service ctest-nginx-svc-30958468 2024-10-31 02:12:31,505 - INFO - Created Service ctest-nginx-svc-30958468 2024-10-31 02:12:31,511 - WARNING - Service UUID 49eab6c1-309b-4b13-89e5-f76910fd4625 not yet found in contrail-api 2024-10-31 02:12:32,518 - INFO - Validated that Service ctest-nginx-svc-30958468 is seen in contrail-api 2024-10-31 02:12:32,519 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_LoadbalancerDatabaseList?x=49eab6c1-309b-4b13-89e5-f76910fd4625 2024-10-31 02:12:32,524 - INFO - Service ctest-nginx-svc-30958468 with uuid 49eab6c1-309b-4b13-89e5-f76910fd4625 found in kube manager 2024-10-31 02:12:32,524 - INFO - Service ctest-nginx-svc-30958468 verification passed 2024-10-31 02:12:33,603 - DEBUG - [Pod ctest-pod-39330847] Cmd: wget http://10.99.120.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.120.82:80 (10.99.120.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-17950617 2024-10-31 02:12:33,603 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd wget http://10.99.120.82:80/ -O - -T 5 -t 1 passed 2024-10-31 02:12:33,603 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd output: Connecting to 10.99.120.82:80 (10.99.120.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-17950617 2024-10-31 02:12:33,658 - DEBUG - [Pod ctest-pod-39330847] Cmd: wget http://10.99.120.82:80/ -O - -T 5 -t 1 , Output: ctest-pod-93610154 Connecting to 10.99.120.82:80 (10.99.120.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-31 02:12:33,658 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd wget http://10.99.120.82:80/ -O - -T 5 -t 1 passed 2024-10-31 02:12:33,658 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd output: ctest-pod-93610154 Connecting to 10.99.120.82:80 (10.99.120.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-31 02:12:33,658 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-93610154': 1, 'ctest-pod-17950617': 1} 2024-10-31 02:12:33,737 - DEBUG - [Pod ctest-pod-29927320] Cmd: wget http://10.99.120.82:80/ -O - -T 5 -t 1 , Output: ctest-pod-17950617 Connecting to 10.99.120.82:80 (10.99.120.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-31 02:12:33,737 - DEBUG - [Pod Pod ctest-pod-29927320] Cmd wget http://10.99.120.82:80/ -O - -T 5 -t 1 passed 2024-10-31 02:12:33,737 - DEBUG - [Pod Pod ctest-pod-29927320] Cmd output: ctest-pod-17950617 Connecting to 10.99.120.82:80 (10.99.120.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-31 02:12:33,801 - DEBUG - [Pod ctest-pod-29927320] Cmd: wget http://10.99.120.82:80/ -O - -T 5 -t 1 , Output: ctest-pod-17950617 Connecting to 10.99.120.82:80 (10.99.120.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-31 02:12:33,801 - DEBUG - [Pod Pod ctest-pod-29927320] Cmd wget http://10.99.120.82:80/ -O - -T 5 -t 1 passed 2024-10-31 02:12:33,801 - DEBUG - [Pod Pod ctest-pod-29927320] Cmd output: ctest-pod-17950617 Connecting to 10.99.120.82:80 (10.99.120.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-31 02:12:33,875 - DEBUG - [Pod ctest-pod-29927320] Cmd: wget http://10.99.120.82:80/ -O - -T 5 -t 1 , Output: ctest-pod-93610154 Connecting to 10.99.120.82:80 (10.99.120.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-31 02:12:33,875 - DEBUG - [Pod Pod ctest-pod-29927320] Cmd wget http://10.99.120.82:80/ -O - -T 5 -t 1 passed 2024-10-31 02:12:33,875 - DEBUG - [Pod Pod ctest-pod-29927320] Cmd output: ctest-pod-93610154 Connecting to 10.99.120.82:80 (10.99.120.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-31 02:12:33,876 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-93610154': 1, 'ctest-pod-17950617': 2} 2024-10-31 02:12:33,879 - DEBUG - Network policy ingress-on-service not present 2024-10-31 02:12:33,879 - INFO - Creating Network Policy ingress-on-service 2024-10-31 02:12:33,898 - INFO - Network policy found in k8s 2024-10-31 02:12:33,898 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=11eef509-9a05-48de-b30a-7bfafe9a0d3c 2024-10-31 02:12:33,905 - INFO - Network Policy ingress-on-service with uuid 11eef509-9a05-48de-b30a-7bfafe9a0d3c found in kube manager 2024-10-31 02:12:33,936 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-10-31 02:12:33,937 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-10-31 02:12:33,937 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=11eef509-9a05-48de-b30a-7bfafe9a0d3c 2024-10-31 02:12:33,970 - WARNING - Network policy with name ingress-on-service not found in agent 2024-10-31 02:12:35,971 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=11eef509-9a05-48de-b30a-7bfafe9a0d3c 2024-10-31 02:12:36,008 - INFO - Network policy with name ingress-on-service found in agent 2024-10-31 02:12:36,008 - INFO - Network Policy ingress-on-service verification passed 2024-10-31 02:12:41,068 - DEBUG - [Pod ctest-pod-39330847] Cmd: wget http://10.99.120.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:12:41,068 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd wget http://10.99.120.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:12:41,068 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:12:46,132 - DEBUG - [Pod ctest-pod-39330847] Cmd: wget http://10.99.120.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:12:46,132 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd wget http://10.99.120.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:12:46,132 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:12:51,204 - DEBUG - [Pod ctest-pod-39330847] Cmd: wget http://10.99.120.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:12:51,204 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd wget http://10.99.120.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:12:51,205 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:12:56,269 - DEBUG - [Pod ctest-pod-39330847] Cmd: wget http://10.99.120.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:12:56,269 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd wget http://10.99.120.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:12:56,269 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:13:00,680 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2024-10-31 02:13:10,739 - DEBUG - [Pod ctest-pod-39330847] Cmd: wget http://10.99.120.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:13:10,739 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd wget http://10.99.120.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:13:10,739 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:13:15,796 - DEBUG - [Pod ctest-pod-39330847] Cmd: wget http://10.99.120.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:13:15,796 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd wget http://10.99.120.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:13:15,796 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:13:20,872 - DEBUG - [Pod ctest-pod-39330847] Cmd: wget http://10.99.120.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:13:20,872 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd wget http://10.99.120.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:13:20,872 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:13:25,936 - DEBUG - [Pod ctest-pod-39330847] Cmd: wget http://10.99.120.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:13:25,936 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd wget http://10.99.120.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:13:25,936 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:13:30,988 - DEBUG - [Pod ctest-pod-39330847] Cmd: wget http://10.99.120.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:13:30,988 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd wget http://10.99.120.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:13:30,988 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:13:36,048 - DEBUG - [Pod ctest-pod-39330847] Cmd: wget http://10.99.120.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:13:36,048 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd wget http://10.99.120.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:13:36,048 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:13:36,048 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-93610154': 0, 'ctest-pod-17950617': 0} 2024-10-31 02:13:36,111 - DEBUG - [Pod ctest-pod-79976811] Cmd: wget http://10.99.120.82:80/ -O - -T 5 -t 1 , Output: ctest-pod-93610154 Connecting to 10.99.120.82:80 (10.99.120.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-31 02:13:36,111 - DEBUG - [Pod Pod ctest-pod-79976811] Cmd wget http://10.99.120.82:80/ -O - -T 5 -t 1 passed 2024-10-31 02:13:36,111 - DEBUG - [Pod Pod ctest-pod-79976811] Cmd output: ctest-pod-93610154 Connecting to 10.99.120.82:80 (10.99.120.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-31 02:13:36,178 - DEBUG - [Pod ctest-pod-79976811] Cmd: wget http://10.99.120.82:80/ -O - -T 5 -t 1 , Output: ctest-pod-93610154 Connecting to 10.99.120.82:80 (10.99.120.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-31 02:13:36,178 - DEBUG - [Pod Pod ctest-pod-79976811] Cmd wget http://10.99.120.82:80/ -O - -T 5 -t 1 passed 2024-10-31 02:13:36,178 - DEBUG - [Pod Pod ctest-pod-79976811] Cmd output: ctest-pod-93610154 Connecting to 10.99.120.82:80 (10.99.120.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-31 02:13:36,246 - DEBUG - [Pod ctest-pod-79976811] Cmd: wget http://10.99.120.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.120.82:80 (10.99.120.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-17950617 2024-10-31 02:13:36,246 - DEBUG - [Pod Pod ctest-pod-79976811] Cmd wget http://10.99.120.82:80/ -O - -T 5 -t 1 passed 2024-10-31 02:13:36,246 - DEBUG - [Pod Pod ctest-pod-79976811] Cmd output: Connecting to 10.99.120.82:80 (10.99.120.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-17950617 2024-10-31 02:13:36,246 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-93610154': 2, 'ctest-pod-17950617': 1} 2024-10-31 02:13:41,316 - DEBUG - [Pod ctest-pod-29927320] Cmd: wget http://10.99.120.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:13:41,316 - DEBUG - [Pod Pod ctest-pod-29927320] Cmd wget http://10.99.120.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:13:41,316 - DEBUG - [Pod Pod ctest-pod-29927320] Cmd output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:13:46,399 - DEBUG - [Pod ctest-pod-29927320] Cmd: wget http://10.99.120.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:13:46,399 - DEBUG - [Pod Pod ctest-pod-29927320] Cmd wget http://10.99.120.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:13:46,399 - DEBUG - [Pod Pod ctest-pod-29927320] Cmd output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:13:51,460 - DEBUG - [Pod ctest-pod-29927320] Cmd: wget http://10.99.120.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:13:51,460 - DEBUG - [Pod Pod ctest-pod-29927320] Cmd wget http://10.99.120.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:13:51,460 - DEBUG - [Pod Pod ctest-pod-29927320] Cmd output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:13:56,526 - DEBUG - [Pod ctest-pod-29927320] Cmd: wget http://10.99.120.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:13:56,527 - DEBUG - [Pod Pod ctest-pod-29927320] Cmd wget http://10.99.120.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:13:56,527 - DEBUG - [Pod Pod ctest-pod-29927320] Cmd output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:14:01,687 - DEBUG - [Pod ctest-pod-29927320] Cmd: wget http://10.99.120.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:14:01,687 - DEBUG - [Pod Pod ctest-pod-29927320] Cmd wget http://10.99.120.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:14:01,687 - DEBUG - [Pod Pod ctest-pod-29927320] Cmd output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:14:06,769 - DEBUG - [Pod ctest-pod-29927320] Cmd: wget http://10.99.120.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:14:06,769 - DEBUG - [Pod Pod ctest-pod-29927320] Cmd wget http://10.99.120.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:14:06,769 - DEBUG - [Pod Pod ctest-pod-29927320] Cmd output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:14:11,835 - DEBUG - [Pod ctest-pod-29927320] Cmd: wget http://10.99.120.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:14:11,835 - DEBUG - [Pod Pod ctest-pod-29927320] Cmd wget http://10.99.120.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:14:11,835 - DEBUG - [Pod Pod ctest-pod-29927320] Cmd output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:14:16,895 - DEBUG - [Pod ctest-pod-29927320] Cmd: wget http://10.99.120.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:14:16,896 - DEBUG - [Pod Pod ctest-pod-29927320] Cmd wget http://10.99.120.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:14:16,896 - DEBUG - [Pod Pod ctest-pod-29927320] Cmd output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:14:21,948 - DEBUG - [Pod ctest-pod-29927320] Cmd: wget http://10.99.120.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:14:21,948 - DEBUG - [Pod Pod ctest-pod-29927320] Cmd wget http://10.99.120.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:14:21,949 - DEBUG - [Pod Pod ctest-pod-29927320] Cmd output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:14:27,013 - DEBUG - [Pod ctest-pod-29927320] Cmd: wget http://10.99.120.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:14:27,014 - DEBUG - [Pod Pod ctest-pod-29927320] Cmd wget http://10.99.120.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:14:27,014 - DEBUG - [Pod Pod ctest-pod-29927320] Cmd output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:14:27,014 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-93610154': 0, 'ctest-pod-17950617': 0} 2024-10-31 02:14:29,066 - DEBUG - [Pod ctest-pod-79976811] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.798 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.067 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.088 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.067/0.317/0.798 ms 2024-10-31 02:14:29,066 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-79976811 with expectation True passed 2024-10-31 02:14:31,132 - DEBUG - [Pod ctest-pod-39330847] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.387 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.074 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.177/0.387 ms 2024-10-31 02:14:31,132 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-39330847 with expectation True passed 2024-10-31 02:14:33,186 - DEBUG - [Pod ctest-pod-29927320] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.615 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.094 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.081 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.081/0.263/0.615 ms 2024-10-31 02:14:33,186 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-29927320 with expectation True passed 2024-10-31 02:14:33,252 - DEBUG - [Pod ctest-pod-79976811] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-31 02:14:33,253 - DEBUG - [Pod Pod ctest-pod-79976811] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-10-31 02:14:33,253 - DEBUG - [Pod Pod ctest-pod-79976811] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-31 02:14:33,253 - INFO - wget check of of http://10.47.255.251 from ctest-pod-79976811 passed 2024-10-31 02:14:33,309 - DEBUG - [Pod ctest-pod-79976811] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-31 02:14:33,310 - DEBUG - [Pod Pod ctest-pod-79976811] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-10-31 02:14:33,310 - DEBUG - [Pod Pod ctest-pod-79976811] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-31 02:14:33,310 - INFO - wget check of of http://10.47.255.250 from ctest-pod-79976811 passed 2024-10-31 02:14:38,367 - DEBUG - [Pod ctest-pod-39330847] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-10-31 02:14:38,367 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-10-31 02:14:38,367 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-10-31 02:14:38,367 - INFO - wget check of of http://10.47.255.250 from ctest-pod-39330847 passed 2024-10-31 02:14:43,413 - DEBUG - [Pod ctest-pod-31457666] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-10-31 02:14:43,413 - DEBUG - [Pod Pod ctest-pod-31457666] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-10-31 02:14:43,413 - DEBUG - [Pod Pod ctest-pod-31457666] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-10-31 02:14:43,413 - INFO - wget check of of http://10.47.255.251 from ctest-pod-31457666 passed 2024-10-31 02:14:43,424 - INFO - Updating Network Policy ingress-on-service 2024-10-31 02:14:48,508 - DEBUG - [Pod ctest-pod-39330847] Cmd: wget http://10.99.120.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:14:48,508 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd wget http://10.99.120.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:14:48,508 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:14:53,577 - DEBUG - [Pod ctest-pod-39330847] Cmd: wget http://10.99.120.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:14:53,577 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd wget http://10.99.120.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:14:53,577 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:14:58,645 - DEBUG - [Pod ctest-pod-39330847] Cmd: wget http://10.99.120.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:14:58,646 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd wget http://10.99.120.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:14:58,646 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:15:03,717 - DEBUG - [Pod ctest-pod-39330847] Cmd: wget http://10.99.120.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:15:03,717 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd wget http://10.99.120.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:15:03,717 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:15:08,776 - DEBUG - [Pod ctest-pod-39330847] Cmd: wget http://10.99.120.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:15:08,776 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd wget http://10.99.120.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:15:08,776 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:15:13,847 - DEBUG - [Pod ctest-pod-39330847] Cmd: wget http://10.99.120.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:15:13,847 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd wget http://10.99.120.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:15:13,847 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:15:18,906 - DEBUG - [Pod ctest-pod-39330847] Cmd: wget http://10.99.120.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:15:18,906 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd wget http://10.99.120.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:15:18,906 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:15:23,970 - DEBUG - [Pod ctest-pod-39330847] Cmd: wget http://10.99.120.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:15:23,970 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd wget http://10.99.120.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:15:23,970 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:15:29,027 - DEBUG - [Pod ctest-pod-39330847] Cmd: wget http://10.99.120.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:15:29,027 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd wget http://10.99.120.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:15:29,027 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:15:34,101 - DEBUG - [Pod ctest-pod-39330847] Cmd: wget http://10.99.120.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:15:34,101 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd wget http://10.99.120.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:15:34,101 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd output: Connecting to 10.99.120.82:80 (10.99.120.82:80) wget: download timed out 2024-10-31 02:15:34,101 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-93610154': 0, 'ctest-pod-17950617': 0} 2024-10-31 02:15:34,174 - DEBUG - [Pod ctest-pod-79976811] Cmd: wget http://10.99.120.82:80/ -O - -T 5 -t 1 , Output: ctest-pod-17950617 Connecting to 10.99.120.82:80 (10.99.120.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-31 02:15:34,174 - DEBUG - [Pod Pod ctest-pod-79976811] Cmd wget http://10.99.120.82:80/ -O - -T 5 -t 1 passed 2024-10-31 02:15:34,174 - DEBUG - [Pod Pod ctest-pod-79976811] Cmd output: ctest-pod-17950617 Connecting to 10.99.120.82:80 (10.99.120.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-31 02:15:34,246 - DEBUG - [Pod ctest-pod-79976811] Cmd: wget http://10.99.120.82:80/ -O - -T 5 -t 1 , Output: ctest-pod-93610154 Connecting to 10.99.120.82:80 (10.99.120.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-31 02:15:34,246 - DEBUG - [Pod Pod ctest-pod-79976811] Cmd wget http://10.99.120.82:80/ -O - -T 5 -t 1 passed 2024-10-31 02:15:34,246 - DEBUG - [Pod Pod ctest-pod-79976811] Cmd output: ctest-pod-93610154 Connecting to 10.99.120.82:80 (10.99.120.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-31 02:15:34,246 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-93610154': 1, 'ctest-pod-17950617': 1} 2024-10-31 02:15:34,320 - DEBUG - [Pod ctest-pod-29927320] Cmd: wget http://10.99.120.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.120.82:80 (10.99.120.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-17950617 2024-10-31 02:15:34,320 - DEBUG - [Pod Pod ctest-pod-29927320] Cmd wget http://10.99.120.82:80/ -O - -T 5 -t 1 passed 2024-10-31 02:15:34,320 - DEBUG - [Pod Pod ctest-pod-29927320] Cmd output: Connecting to 10.99.120.82:80 (10.99.120.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-17950617 2024-10-31 02:15:34,385 - DEBUG - [Pod ctest-pod-29927320] Cmd: wget http://10.99.120.82:80/ -O - -T 5 -t 1 , Output: ctest-pod-93610154 Connecting to 10.99.120.82:80 (10.99.120.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-31 02:15:34,385 - DEBUG - [Pod Pod ctest-pod-29927320] Cmd wget http://10.99.120.82:80/ -O - -T 5 -t 1 passed 2024-10-31 02:15:34,385 - DEBUG - [Pod Pod ctest-pod-29927320] Cmd output: ctest-pod-93610154 Connecting to 10.99.120.82:80 (10.99.120.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-31 02:15:34,385 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-93610154': 1, 'ctest-pod-17950617': 1} 2024-10-31 02:15:36,440 - DEBUG - [Pod ctest-pod-79976811] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.427 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.081 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.077 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.077/0.195/0.427 ms 2024-10-31 02:15:36,440 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-79976811 with expectation True passed 2024-10-31 02:15:38,495 - DEBUG - [Pod ctest-pod-39330847] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.642 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.093 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.088 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.088/0.274/0.642 ms 2024-10-31 02:15:38,495 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-39330847 with expectation True passed 2024-10-31 02:15:40,548 - DEBUG - [Pod ctest-pod-29927320] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.826 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.075 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.082 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.075/0.327/0.826 ms 2024-10-31 02:15:40,548 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-29927320 with expectation True passed 2024-10-31 02:15:40,596 - DEBUG - [Pod ctest-pod-79976811] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-31 02:15:40,596 - DEBUG - [Pod Pod ctest-pod-79976811] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-10-31 02:15:40,596 - DEBUG - [Pod Pod ctest-pod-79976811] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-31 02:15:40,596 - INFO - wget check of of http://10.47.255.251 from ctest-pod-79976811 passed 2024-10-31 02:15:40,646 - DEBUG - [Pod ctest-pod-79976811] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-31 02:15:40,646 - DEBUG - [Pod Pod ctest-pod-79976811] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-10-31 02:15:40,646 - DEBUG - [Pod Pod ctest-pod-79976811] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-31 02:15:40,646 - INFO - wget check of of http://10.47.255.250 from ctest-pod-79976811 passed 2024-10-31 02:15:45,758 - DEBUG - [Pod ctest-pod-39330847] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-10-31 02:15:45,758 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-10-31 02:15:45,758 - DEBUG - [Pod Pod ctest-pod-39330847] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-10-31 02:15:45,758 - INFO - wget check of of http://10.47.255.250 from ctest-pod-39330847 passed 2024-10-31 02:15:45,820 - DEBUG - [Pod ctest-pod-31457666] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-31 02:15:45,821 - DEBUG - [Pod Pod ctest-pod-31457666] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-10-31 02:15:45,821 - DEBUG - [Pod Pod ctest-pod-31457666] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-31 02:15:45,821 - INFO - wget check of of http://10.47.255.251 from ctest-pod-31457666 passed 2024-10-31 02:15:45,821 - INFO - Deleting Network Policy : ingress-on-service 2024-10-31 02:15:45,822 - INFO - Deleting service : ctest-nginx-svc-30958468 2024-10-31 02:15:46,084 - DEBUG - No XMPP flaps were noticed during the test 2024-10-31 02:15:46,085 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:16] 2024-10-31 02:15:46,085 - INFO - -------------------------------------------------------------------------------- 2024-10-31 02:15:46,092 - INFO - Deleting pod ctest-new-default-67575730:ctest-pod-93610154 2024-10-31 02:15:46,093 - INFO - Deleting pod ctest-new-default-67575730:ctest-pod-17950617 2024-10-31 02:15:46,093 - INFO - Deleting pod ctest-non-default-91220819:ctest-pod-34843419 2024-10-31 02:15:46,094 - INFO - Deleting pod ctest-non-default-91220819:ctest-pod-88650778 2024-10-31 02:15:46,094 - INFO - Deleting pod ctest-new-default-67575730:ctest-pod-39330847 2024-10-31 02:15:46,095 - INFO - Deleting pod ctest-new-default-67575730:ctest-pod-79976811 2024-10-31 02:15:46,095 - INFO - Deleting pod ctest-non-default-91220819:ctest-pod-29927320 2024-10-31 02:15:46,096 - INFO - Deleting pod ctest-non-default-91220819:ctest-pod-31457666 2024-10-31 02:15:46,160 - WARNING - Pod uuid c5d66852-f78d-41d2-8789-5fb5505e8481 is still seen in agent 10.0.0.58 VM list 2024-10-31 02:15:46,241 - WARNING - Pod uuid e71d1720-3381-42b8-82a8-07b119e4cc3d is still seen in agent 10.0.0.58 VM list 2024-10-31 02:15:46,286 - WARNING - Pod uuid 4671fdb8-14f6-4f83-9dbc-6c59a97a1505 is still seen in agent 10.0.0.58 VM list 2024-10-31 02:15:46,287 - WARNING - Pod uuid 87299684-cf05-448f-912e-05f7d68df2a3 is still seen in agent 10.0.0.58 VM list 2024-10-31 02:15:46,288 - WARNING - Pod uuid 0f5039cd-35b9-4e7f-bce7-01d7bc0198c0 is still seen in agent 10.0.0.58 VM list 2024-10-31 02:15:46,288 - WARNING - Pod uuid 1fa342da-6aea-4187-b4e2-bef6ce674e87 is still seen in agent 10.0.0.58 VM list 2024-10-31 02:15:46,291 - WARNING - Pod uuid 1e40a657-b7cb-4a1b-b5c4-d7503aa1bc59 is still seen in agent 10.0.0.58 VM list 2024-10-31 02:15:46,306 - WARNING - Pod uuid 913b41bc-ba53-4121-a13a-c55ffce14ab5 is still seen in agent 10.0.0.58 VM list 2024-10-31 02:15:51,173 - DEBUG - Pod c5d66852-f78d-41d2-8789-5fb5505e8481 is not in agent 10.0.0.58 VM list 2024-10-31 02:15:51,180 - DEBUG - VMI 89fdcdae-972d-11ef-9ae2-fa163e7222e9 is removed from agent 10.0.0.58 2024-10-31 02:15:51,180 - INFO - Verified that pod ctest-pod-93610154 is removed in agent 2024-10-31 02:15:51,248 - WARNING - Pod uuid e71d1720-3381-42b8-82a8-07b119e4cc3d is still seen in agent 10.0.0.58 VM list 2024-10-31 02:15:51,314 - WARNING - Pod uuid 0f5039cd-35b9-4e7f-bce7-01d7bc0198c0 is still seen in agent 10.0.0.58 VM list 2024-10-31 02:15:51,314 - WARNING - Pod uuid 1e40a657-b7cb-4a1b-b5c4-d7503aa1bc59 is still seen in agent 10.0.0.58 VM list 2024-10-31 02:15:51,314 - WARNING - Pod uuid 87299684-cf05-448f-912e-05f7d68df2a3 is still seen in agent 10.0.0.58 VM list 2024-10-31 02:15:51,315 - DEBUG - Pod 1fa342da-6aea-4187-b4e2-bef6ce674e87 is not in agent 10.0.0.58 VM list 2024-10-31 02:15:51,316 - WARNING - Pod uuid 4671fdb8-14f6-4f83-9dbc-6c59a97a1505 is still seen in agent 10.0.0.58 VM list 2024-10-31 02:15:51,324 - DEBUG - Pod 913b41bc-ba53-4121-a13a-c55ffce14ab5 is not in agent 10.0.0.58 VM list 2024-10-31 02:15:51,327 - DEBUG - VMI 8bf9f664-972d-11ef-9ae2-fa163e7222e9 is removed from agent 10.0.0.58 2024-10-31 02:15:51,327 - INFO - Verified that pod ctest-pod-88650778 is removed in agent 2024-10-31 02:15:51,335 - DEBUG - VMI 8b638d00-972d-11ef-9ae2-fa163e7222e9 is removed from agent 10.0.0.58 2024-10-31 02:15:51,336 - INFO - Verified that pod ctest-pod-34843419 is removed in agent 2024-10-31 02:15:56,256 - WARNING - Pod uuid e71d1720-3381-42b8-82a8-07b119e4cc3d is still seen in agent 10.0.0.58 VM list 2024-10-31 02:15:56,330 - WARNING - Pod uuid 0f5039cd-35b9-4e7f-bce7-01d7bc0198c0 is still seen in agent 10.0.0.58 VM list 2024-10-31 02:15:56,332 - WARNING - Pod uuid 4671fdb8-14f6-4f83-9dbc-6c59a97a1505 is still seen in agent 10.0.0.58 VM list 2024-10-31 02:15:56,332 - WARNING - Pod uuid 1e40a657-b7cb-4a1b-b5c4-d7503aa1bc59 is still seen in agent 10.0.0.58 VM list 2024-10-31 02:15:56,969 - WARNING - Pod uuid 87299684-cf05-448f-912e-05f7d68df2a3 is still seen in agent 10.0.0.58 VM list 2024-10-31 02:16:01,264 - WARNING - Pod uuid e71d1720-3381-42b8-82a8-07b119e4cc3d is still seen in agent 10.0.0.58 VM list 2024-10-31 02:16:01,345 - WARNING - Pod uuid 0f5039cd-35b9-4e7f-bce7-01d7bc0198c0 is still seen in agent 10.0.0.58 VM list 2024-10-31 02:16:01,346 - WARNING - Pod uuid 1e40a657-b7cb-4a1b-b5c4-d7503aa1bc59 is still seen in agent 10.0.0.58 VM list 2024-10-31 02:16:01,346 - WARNING - Pod uuid 4671fdb8-14f6-4f83-9dbc-6c59a97a1505 is still seen in agent 10.0.0.58 VM list 2024-10-31 02:16:01,980 - WARNING - Pod uuid 87299684-cf05-448f-912e-05f7d68df2a3 is still seen in agent 10.0.0.58 VM list 2024-10-31 02:16:06,275 - WARNING - Pod uuid e71d1720-3381-42b8-82a8-07b119e4cc3d is still seen in agent 10.0.0.58 VM list 2024-10-31 02:16:06,358 - WARNING - Pod uuid 0f5039cd-35b9-4e7f-bce7-01d7bc0198c0 is still seen in agent 10.0.0.58 VM list 2024-10-31 02:16:06,359 - WARNING - Pod uuid 4671fdb8-14f6-4f83-9dbc-6c59a97a1505 is still seen in agent 10.0.0.58 VM list 2024-10-31 02:16:06,631 - WARNING - Pod uuid 1e40a657-b7cb-4a1b-b5c4-d7503aa1bc59 is still seen in agent 10.0.0.58 VM list 2024-10-31 02:16:06,993 - WARNING - Pod uuid 87299684-cf05-448f-912e-05f7d68df2a3 is still seen in agent 10.0.0.58 VM list 2024-10-31 02:16:11,285 - WARNING - Pod uuid e71d1720-3381-42b8-82a8-07b119e4cc3d is still seen in agent 10.0.0.58 VM list 2024-10-31 02:16:11,370 - WARNING - Pod uuid 4671fdb8-14f6-4f83-9dbc-6c59a97a1505 is still seen in agent 10.0.0.58 VM list 2024-10-31 02:16:11,371 - WARNING - Pod uuid 0f5039cd-35b9-4e7f-bce7-01d7bc0198c0 is still seen in agent 10.0.0.58 VM list 2024-10-31 02:16:11,640 - WARNING - Pod uuid 1e40a657-b7cb-4a1b-b5c4-d7503aa1bc59 is still seen in agent 10.0.0.58 VM list 2024-10-31 02:16:12,008 - WARNING - Pod uuid 87299684-cf05-448f-912e-05f7d68df2a3 is still seen in agent 10.0.0.58 VM list 2024-10-31 02:16:16,354 - WARNING - Pod uuid e71d1720-3381-42b8-82a8-07b119e4cc3d is still seen in agent 10.0.0.58 VM list 2024-10-31 02:16:16,381 - WARNING - Pod uuid 4671fdb8-14f6-4f83-9dbc-6c59a97a1505 is still seen in agent 10.0.0.58 VM list 2024-10-31 02:16:16,382 - WARNING - Pod uuid 0f5039cd-35b9-4e7f-bce7-01d7bc0198c0 is still seen in agent 10.0.0.58 VM list 2024-10-31 02:16:16,650 - WARNING - Pod uuid 1e40a657-b7cb-4a1b-b5c4-d7503aa1bc59 is still seen in agent 10.0.0.58 VM list 2024-10-31 02:16:17,016 - WARNING - Pod uuid 87299684-cf05-448f-912e-05f7d68df2a3 is still seen in agent 10.0.0.58 VM list 2024-10-31 02:16:21,361 - DEBUG - Pod e71d1720-3381-42b8-82a8-07b119e4cc3d is not in agent 10.0.0.58 VM list 2024-10-31 02:16:21,367 - DEBUG - VMI 8e5089aa-972d-11ef-9ae2-fa163e7222e9 is removed from agent 10.0.0.58 2024-10-31 02:16:21,367 - INFO - Verified that pod ctest-pod-31457666 is removed in agent 2024-10-31 02:16:21,394 - DEBUG - Pod 4671fdb8-14f6-4f83-9dbc-6c59a97a1505 is not in agent 10.0.0.58 VM list 2024-10-31 02:16:21,398 - DEBUG - Pod 0f5039cd-35b9-4e7f-bce7-01d7bc0198c0 is not in agent 10.0.0.58 VM list 2024-10-31 02:16:21,407 - DEBUG - VMI 8a8ea572-972d-11ef-9ae2-fa163e7222e9 is removed from agent 10.0.0.58 2024-10-31 02:16:21,407 - INFO - Verified that pod ctest-pod-17950617 is removed in agent 2024-10-31 02:16:21,407 - DEBUG - VMI 8d33acb4-972d-11ef-9ae2-fa163e7222e9 is removed from agent 10.0.0.58 2024-10-31 02:16:21,407 - INFO - Verified that pod ctest-pod-79976811 is removed in agent 2024-10-31 02:16:21,660 - DEBUG - Pod 1e40a657-b7cb-4a1b-b5c4-d7503aa1bc59 is not in agent 10.0.0.58 VM list 2024-10-31 02:16:21,668 - DEBUG - VMI 8ca05f22-972d-11ef-9ae2-fa163e7222e9 is removed from agent 10.0.0.58 2024-10-31 02:16:21,668 - INFO - Verified that pod ctest-pod-39330847 is removed in agent 2024-10-31 02:16:22,025 - DEBUG - Pod 87299684-cf05-448f-912e-05f7d68df2a3 is not in agent 10.0.0.58 VM list 2024-10-31 02:16:22,032 - DEBUG - VMI 8dc14fe2-972d-11ef-9ae2-fa163e7222e9 is removed from agent 10.0.0.58 2024-10-31 02:16:22,032 - INFO - Verified that pod ctest-pod-29927320 is removed in agent 2024-10-31 02:16:22,033 - INFO - Deleting namespace ctest-non-default-91220819 2024-10-31 02:16:22,052 - DEBUG - Namespace ctest-non-default-91220819 still in k8s 2024-10-31 02:16:24,057 - DEBUG - Namespace ctest-non-default-91220819 still in k8s 2024-10-31 02:16:26,064 - DEBUG - Namespace ctest-non-default-91220819 still in k8s 2024-10-31 02:16:28,069 - DEBUG - Namespace ctest-non-default-91220819 is not in k8s 2024-10-31 02:16:28,069 - DEBUG - No need to check project deletion in contrail-api 2024-10-31 02:16:28,069 - INFO - Deleting namespace ctest-new-default-67575730 2024-10-31 02:16:28,079 - DEBUG - Namespace ctest-new-default-67575730 still in k8s 2024-10-31 02:16:30,084 - DEBUG - Namespace ctest-new-default-67575730 still in k8s 2024-10-31 02:16:32,090 - DEBUG - Namespace ctest-new-default-67575730 still in k8s 2024-10-31 02:16:34,094 - DEBUG - Namespace ctest-new-default-67575730 is not in k8s 2024-10-31 02:16:34,094 - DEBUG - No need to check project deletion in contrail-api