2024-11-10 00:25:49,338 - INFO - Using existing project ['default-domain', 'k8s-default'](5f6a5984-1778-4ccf-8ba2-d4efe0e7191f) 2024-11-10 00:25:49,359 - DEBUG - Namespace ctest-new-default-68817073 not present 2024-11-10 00:25:49,375 - INFO - Created namespace ctest-new-default-68817073 2024-11-10 00:25:52,379 - DEBUG - Namespace ctest-non-default-96117000 not present 2024-11-10 00:25:52,390 - INFO - Created namespace ctest-non-default-96117000 2024-11-10 00:25:55,415 - DEBUG - Pod ctest-pod-56692671 not present 2024-11-10 00:25:55,416 - INFO - Creating Pod ctest-pod-56692671 2024-11-10 00:25:55,438 - DEBUG - Pod : ctest-pod-56692671 UUID is 14999500-cb1e-45a6-9f60-5611845da7ef 2024-11-10 00:25:55,442 - DEBUG - Pod ctest-pod-37858610 not present 2024-11-10 00:25:55,443 - INFO - Creating Pod ctest-pod-37858610 2024-11-10 00:25:55,478 - DEBUG - Pod : ctest-pod-37858610 UUID is f66ce2f9-ad1d-417d-b012-54873cab3a73 2024-11-10 00:25:55,481 - DEBUG - Pod ctest-pod-00134077 not present 2024-11-10 00:25:55,481 - INFO - Creating Pod ctest-pod-00134077 2024-11-10 00:25:55,521 - DEBUG - Pod : ctest-pod-00134077 UUID is 2eef776d-799a-40cd-85dd-c834669b3e38 2024-11-10 00:25:55,526 - DEBUG - Pod ctest-pod-81617825 not present 2024-11-10 00:25:55,526 - INFO - Creating Pod ctest-pod-81617825 2024-11-10 00:25:55,552 - DEBUG - Pod : ctest-pod-81617825 UUID is 91d330bf-1498-47cb-ab37-b9ef7def73f1 2024-11-10 00:25:55,554 - DEBUG - Pod ctest-pod-14545383 not present 2024-11-10 00:25:55,554 - INFO - Creating Pod ctest-pod-14545383 2024-11-10 00:25:55,570 - DEBUG - Pod : ctest-pod-14545383 UUID is ac73011b-3aea-4120-8e7d-c484d8223666 2024-11-10 00:25:55,572 - DEBUG - Pod ctest-pod-82869519 not present 2024-11-10 00:25:55,573 - INFO - Creating Pod ctest-pod-82869519 2024-11-10 00:25:55,598 - DEBUG - Pod : ctest-pod-82869519 UUID is 0c955cc5-ad92-402a-9566-0a04225391c8 2024-11-10 00:25:55,601 - DEBUG - Pod ctest-pod-69734019 not present 2024-11-10 00:25:55,601 - INFO - Creating Pod ctest-pod-69734019 2024-11-10 00:25:55,631 - DEBUG - Pod : ctest-pod-69734019 UUID is acd77c06-b375-4396-91e4-ba11121f465b 2024-11-10 00:25:55,634 - DEBUG - Pod ctest-pod-23364094 not present 2024-11-10 00:25:55,634 - INFO - Creating Pod ctest-pod-23364094 2024-11-10 00:25:55,656 - DEBUG - Pod : ctest-pod-23364094 UUID is 9fda7e33-175b-4c13-911c-141c2b3ade7d 2024-11-10 00:25:55,877 - INFO - Project default-domain:k8s-ctest-new-default-68817073 for Namespace ctest-new-default-68817073 is seen in contrail-api 2024-11-10 00:25:55,877 - DEBUG - Project uuid in Contrail is 9925c38c-5b37-4c04-a767-62ed89af49bf 2024-11-10 00:25:56,045 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NamespaceDatabaseList?namespace_uuid=4eac0158-562b-4663-ad89-bf0fac5f5930 2024-11-10 00:25:56,051 - INFO - Namespace ctest-new-default-68817073 with uuid 4eac0158-562b-4663-ad89-bf0fac5f5930 found in kube manager 2024-11-10 00:25:56,051 - INFO - Namespace ctest-new-default-68817073 verification passed 2024-11-10 00:25:56,425 - INFO - Project default-domain:k8s-ctest-non-default-96117000 for Namespace ctest-non-default-96117000 is seen in contrail-api 2024-11-10 00:25:56,425 - DEBUG - Project uuid in Contrail is d7088145-cd90-4e0d-8386-cfd83c30105e 2024-11-10 00:25:56,425 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NamespaceDatabaseList?namespace_uuid=c7ad251a-b973-4140-92eb-6064e7e1ef95 2024-11-10 00:25:56,438 - INFO - Namespace ctest-non-default-96117000 with uuid c7ad251a-b973-4140-92eb-6064e7e1ef95 found in kube manager 2024-11-10 00:25:56,438 - INFO - Namespace ctest-non-default-96117000 verification passed 2024-11-10 00:25:56,450 - DEBUG - Pod ctest-pod-56692671 not in running state.Currently in Pending 2024-11-10 00:26:01,456 - DEBUG - Pod ctest-pod-56692671 not in running state.Currently in Pending 2024-11-10 00:26:06,465 - INFO - Pod ctest-pod-56692671 is in running state.Got IP 10.47.255.251 2024-11-10 00:26:06,492 - DEBUG - Pod ctest-pod-56692671 has vmi 5b0c9776-9efa-11ef-82ca-fa163eaf1a2c 2024-11-10 00:26:06,492 - INFO - Verified pod ctest-pod-56692671 in contrail-api 2024-11-10 00:26:06,504 - DEBUG - VMI 5b0c9776-9efa-11ef-82ca-fa163eaf1a2c is active in agent 10.0.0.42 2024-11-10 00:26:06,505 - INFO - Verified Pod ctest-pod-56692671 in agent 10.0.0.42 2024-11-10 00:26:06,505 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=14999500-cb1e-45a6-9f60-5611845da7ef 2024-11-10 00:26:06,509 - INFO - Pod ctest-pod-56692671 with uuid 14999500-cb1e-45a6-9f60-5611845da7ef found in kube manager 2024-11-10 00:26:06,509 - INFO - Pod ctest-pod-56692671 verification passed 2024-11-10 00:26:06,514 - DEBUG - Pod ctest-pod-37858610 not in running state.Currently in Pending 2024-11-10 00:26:11,525 - INFO - Pod ctest-pod-37858610 is in running state.Got IP 10.47.255.250 2024-11-10 00:26:11,567 - DEBUG - Pod ctest-pod-37858610 has vmi 5ba5e872-9efa-11ef-82ca-fa163eaf1a2c 2024-11-10 00:26:11,567 - INFO - Verified pod ctest-pod-37858610 in contrail-api 2024-11-10 00:26:11,593 - DEBUG - VMI 5ba5e872-9efa-11ef-82ca-fa163eaf1a2c is active in agent 10.0.0.42 2024-11-10 00:26:11,594 - INFO - Verified Pod ctest-pod-37858610 in agent 10.0.0.42 2024-11-10 00:26:11,594 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=f66ce2f9-ad1d-417d-b012-54873cab3a73 2024-11-10 00:26:11,601 - INFO - Pod ctest-pod-37858610 with uuid f66ce2f9-ad1d-417d-b012-54873cab3a73 found in kube manager 2024-11-10 00:26:11,601 - INFO - Pod ctest-pod-37858610 verification passed 2024-11-10 00:26:11,615 - INFO - Pod ctest-pod-00134077 is in running state.Got IP 10.47.255.249 2024-11-10 00:26:11,689 - DEBUG - Pod ctest-pod-00134077 has vmi 5c6ba86e-9efa-11ef-82ca-fa163eaf1a2c 2024-11-10 00:26:11,689 - INFO - Verified pod ctest-pod-00134077 in contrail-api 2024-11-10 00:26:11,707 - DEBUG - VMI 5c6ba86e-9efa-11ef-82ca-fa163eaf1a2c is active in agent 10.0.0.42 2024-11-10 00:26:11,707 - INFO - Verified Pod ctest-pod-00134077 in agent 10.0.0.42 2024-11-10 00:26:11,707 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=2eef776d-799a-40cd-85dd-c834669b3e38 2024-11-10 00:26:11,712 - INFO - Pod ctest-pod-00134077 with uuid 2eef776d-799a-40cd-85dd-c834669b3e38 found in kube manager 2024-11-10 00:26:11,712 - INFO - Pod ctest-pod-00134077 verification passed 2024-11-10 00:26:11,719 - DEBUG - Pod ctest-pod-81617825 not in running state.Currently in Pending 2024-11-10 00:26:16,739 - INFO - Pod ctest-pod-81617825 is in running state.Got IP 10.47.255.248 2024-11-10 00:26:16,778 - DEBUG - Pod ctest-pod-81617825 has vmi 5d0b19da-9efa-11ef-82ca-fa163eaf1a2c 2024-11-10 00:26:16,778 - INFO - Verified pod ctest-pod-81617825 in contrail-api 2024-11-10 00:26:16,801 - DEBUG - VMI 5d0b19da-9efa-11ef-82ca-fa163eaf1a2c is active in agent 10.0.0.42 2024-11-10 00:26:16,801 - INFO - Verified Pod ctest-pod-81617825 in agent 10.0.0.42 2024-11-10 00:26:16,802 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=91d330bf-1498-47cb-ab37-b9ef7def73f1 2024-11-10 00:26:16,812 - INFO - Pod ctest-pod-81617825 with uuid 91d330bf-1498-47cb-ab37-b9ef7def73f1 found in kube manager 2024-11-10 00:26:16,813 - INFO - Pod ctest-pod-81617825 verification passed 2024-11-10 00:26:16,818 - INFO - Pod ctest-pod-14545383 is in running state.Got IP 10.47.255.247 2024-11-10 00:26:16,859 - DEBUG - Pod ctest-pod-14545383 has vmi 5daa39f2-9efa-11ef-82ca-fa163eaf1a2c 2024-11-10 00:26:16,859 - INFO - Verified pod ctest-pod-14545383 in contrail-api 2024-11-10 00:26:16,876 - DEBUG - VMI 5daa39f2-9efa-11ef-82ca-fa163eaf1a2c is active in agent 10.0.0.42 2024-11-10 00:26:16,876 - INFO - Verified Pod ctest-pod-14545383 in agent 10.0.0.42 2024-11-10 00:26:16,876 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=ac73011b-3aea-4120-8e7d-c484d8223666 2024-11-10 00:26:16,891 - INFO - Pod ctest-pod-14545383 with uuid ac73011b-3aea-4120-8e7d-c484d8223666 found in kube manager 2024-11-10 00:26:16,891 - INFO - Pod ctest-pod-14545383 verification passed 2024-11-10 00:26:16,902 - INFO - Pod ctest-pod-69734019 is in running state.Got IP 10.47.255.245 2024-11-10 00:26:16,981 - DEBUG - Pod ctest-pod-69734019 has vmi 5ec75e14-9efa-11ef-82ca-fa163eaf1a2c 2024-11-10 00:26:16,981 - INFO - Verified pod ctest-pod-69734019 in contrail-api 2024-11-10 00:26:17,001 - DEBUG - VMI 5ec75e14-9efa-11ef-82ca-fa163eaf1a2c is active in agent 10.0.0.42 2024-11-10 00:26:17,002 - INFO - Verified Pod ctest-pod-69734019 in agent 10.0.0.42 2024-11-10 00:26:17,004 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=acd77c06-b375-4396-91e4-ba11121f465b 2024-11-10 00:26:17,012 - INFO - Pod ctest-pod-69734019 with uuid acd77c06-b375-4396-91e4-ba11121f465b found in kube manager 2024-11-10 00:26:17,013 - INFO - Pod ctest-pod-69734019 verification passed 2024-11-10 00:26:17,019 - INFO - Pod ctest-pod-82869519 is in running state.Got IP 10.47.255.246 2024-11-10 00:26:17,039 - DEBUG - Pod ctest-pod-82869519 has vmi 5e354fd8-9efa-11ef-82ca-fa163eaf1a2c 2024-11-10 00:26:17,039 - INFO - Verified pod ctest-pod-82869519 in contrail-api 2024-11-10 00:26:17,055 - DEBUG - VMI 5e354fd8-9efa-11ef-82ca-fa163eaf1a2c is active in agent 10.0.0.42 2024-11-10 00:26:17,055 - INFO - Verified Pod ctest-pod-82869519 in agent 10.0.0.42 2024-11-10 00:26:17,055 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=0c955cc5-ad92-402a-9566-0a04225391c8 2024-11-10 00:26:17,060 - INFO - Pod ctest-pod-82869519 with uuid 0c955cc5-ad92-402a-9566-0a04225391c8 found in kube manager 2024-11-10 00:26:17,060 - INFO - Pod ctest-pod-82869519 verification passed 2024-11-10 00:26:17,066 - INFO - Pod ctest-pod-23364094 is in running state.Got IP 10.47.255.244 2024-11-10 00:26:17,145 - DEBUG - Pod ctest-pod-23364094 has vmi 5f5a90d0-9efa-11ef-82ca-fa163eaf1a2c 2024-11-10 00:26:17,145 - INFO - Verified pod ctest-pod-23364094 in contrail-api 2024-11-10 00:26:17,161 - DEBUG - VMI 5f5a90d0-9efa-11ef-82ca-fa163eaf1a2c is active in agent 10.0.0.42 2024-11-10 00:26:17,161 - INFO - Verified Pod ctest-pod-23364094 in agent 10.0.0.42 2024-11-10 00:26:17,161 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=9fda7e33-175b-4c13-911c-141c2b3ade7d 2024-11-10 00:26:17,179 - INFO - Pod ctest-pod-23364094 with uuid 9fda7e33-175b-4c13-911c-141c2b3ade7d found in kube manager 2024-11-10 00:26:17,180 - INFO - Pod ctest-pod-23364094 verification passed 2024-11-10 00:26:17,180 - INFO - ================================================================================ 2024-11-10 00:26:17,180 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-11-10 00:26:17,180 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-11-10 00:26:17,454 - DEBUG - Nothing to compare xmpp stats {'10.0.0.42': {'10.0.0.24': '0'}} with 2024-11-10 00:26:17,454 - INFO - Initial checks done. Running the testcase now 2024-11-10 00:26:17,454 - INFO - 2024-11-10 00:26:17,559 - DEBUG - [Pod ctest-pod-56692671] Cmd: echo ctest-pod-56692671 > /usr/share/nginx/html/index.html, Output: 2024-11-10 00:26:17,637 - DEBUG - [Pod ctest-pod-37858610] Cmd: echo ctest-pod-37858610 > /usr/share/nginx/html/index.html, Output: 2024-11-10 00:26:17,709 - DEBUG - [Pod ctest-pod-00134077] Cmd: echo ctest-pod-00134077 > /usr/share/nginx/html/index.html, Output: 2024-11-10 00:26:17,787 - DEBUG - [Pod ctest-pod-81617825] Cmd: echo ctest-pod-81617825 > /usr/share/nginx/html/index.html, Output: 2024-11-10 00:26:17,791 - DEBUG - Service ctest-nginx-svc-62889289 not present 2024-11-10 00:26:17,792 - INFO - Creating service ctest-nginx-svc-62889289 2024-11-10 00:26:17,810 - INFO - Created Service ctest-nginx-svc-62889289 2024-11-10 00:26:17,824 - WARNING - Service UUID 8b4b04c2-4d34-4bee-81d0-d7b3ab8c83a9 not yet found in contrail-api 2024-11-10 00:26:18,857 - INFO - Validated that Service ctest-nginx-svc-62889289 is seen in contrail-api 2024-11-10 00:26:18,857 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_LoadbalancerDatabaseList?x=8b4b04c2-4d34-4bee-81d0-d7b3ab8c83a9 2024-11-10 00:26:18,867 - INFO - Service ctest-nginx-svc-62889289 with uuid 8b4b04c2-4d34-4bee-81d0-d7b3ab8c83a9 found in kube manager 2024-11-10 00:26:18,867 - INFO - Service ctest-nginx-svc-62889289 verification passed 2024-11-10 00:26:19,977 - DEBUG - [Pod ctest-pod-14545383] Cmd: wget http://10.106.235.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.235.99:80 (10.106.235.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-56692671 2024-11-10 00:26:19,979 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd wget http://10.106.235.99:80/ -O - -T 5 -t 1 passed 2024-11-10 00:26:19,979 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd output: Connecting to 10.106.235.99:80 (10.106.235.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-56692671 2024-11-10 00:26:20,040 - DEBUG - [Pod ctest-pod-14545383] Cmd: wget http://10.106.235.99:80/ -O - -T 5 -t 1 , Output: ctest-pod-56692671 Connecting to 10.106.235.99:80 (10.106.235.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 00:26:20,041 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd wget http://10.106.235.99:80/ -O - -T 5 -t 1 passed 2024-11-10 00:26:20,041 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd output: ctest-pod-56692671 Connecting to 10.106.235.99:80 (10.106.235.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 00:26:20,125 - DEBUG - [Pod ctest-pod-14545383] Cmd: wget http://10.106.235.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.235.99:80 (10.106.235.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-37858610 2024-11-10 00:26:20,125 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd wget http://10.106.235.99:80/ -O - -T 5 -t 1 passed 2024-11-10 00:26:20,125 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd output: Connecting to 10.106.235.99:80 (10.106.235.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-37858610 2024-11-10 00:26:20,126 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-56692671': 2, 'ctest-pod-37858610': 1} 2024-11-10 00:26:20,209 - DEBUG - [Pod ctest-pod-69734019] Cmd: wget http://10.106.235.99:80/ -O - -T 5 -t 1 , Output: ctest-pod-37858610 Connecting to 10.106.235.99:80 (10.106.235.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 00:26:20,210 - DEBUG - [Pod Pod ctest-pod-69734019] Cmd wget http://10.106.235.99:80/ -O - -T 5 -t 1 passed 2024-11-10 00:26:20,210 - DEBUG - [Pod Pod ctest-pod-69734019] Cmd output: ctest-pod-37858610 Connecting to 10.106.235.99:80 (10.106.235.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 00:26:20,272 - DEBUG - [Pod ctest-pod-69734019] Cmd: wget http://10.106.235.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.235.99:80 (10.106.235.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-56692671 2024-11-10 00:26:20,272 - DEBUG - [Pod Pod ctest-pod-69734019] Cmd wget http://10.106.235.99:80/ -O - -T 5 -t 1 passed 2024-11-10 00:26:20,272 - DEBUG - [Pod Pod ctest-pod-69734019] Cmd output: Connecting to 10.106.235.99:80 (10.106.235.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-56692671 2024-11-10 00:26:20,273 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-56692671': 1, 'ctest-pod-37858610': 1} 2024-11-10 00:26:20,277 - DEBUG - Network policy ingress-on-service not present 2024-11-10 00:26:20,277 - INFO - Creating Network Policy ingress-on-service 2024-11-10 00:26:20,305 - INFO - Network policy found in k8s 2024-11-10 00:26:20,305 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=5f81575b-9281-463a-9aa2-ea15610e2787 2024-11-10 00:26:20,311 - INFO - Network Policy ingress-on-service with uuid 5f81575b-9281-463a-9aa2-ea15610e2787 found in kube manager 2024-11-10 00:26:20,371 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-11-10 00:26:20,371 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-11-10 00:26:20,371 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=5f81575b-9281-463a-9aa2-ea15610e2787 2024-11-10 00:26:20,423 - WARNING - Network policy with name ingress-on-service not found in agent 2024-11-10 00:26:22,424 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=5f81575b-9281-463a-9aa2-ea15610e2787 2024-11-10 00:26:22,464 - INFO - Network policy with name ingress-on-service found in agent 2024-11-10 00:26:22,465 - INFO - Network Policy ingress-on-service verification passed 2024-11-10 00:26:27,543 - DEBUG - [Pod ctest-pod-14545383] Cmd: wget http://10.106.235.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:26:27,543 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd wget http://10.106.235.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:26:27,543 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:26:32,613 - DEBUG - [Pod ctest-pod-14545383] Cmd: wget http://10.106.235.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:26:32,613 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd wget http://10.106.235.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:26:32,614 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:26:37,682 - DEBUG - [Pod ctest-pod-14545383] Cmd: wget http://10.106.235.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:26:37,682 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd wget http://10.106.235.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:26:37,682 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:26:42,746 - DEBUG - [Pod ctest-pod-14545383] Cmd: wget http://10.106.235.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:26:42,746 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd wget http://10.106.235.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:26:42,746 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:26:47,798 - DEBUG - [Pod ctest-pod-14545383] Cmd: wget http://10.106.235.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:26:47,798 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd wget http://10.106.235.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:26:47,798 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:26:52,864 - DEBUG - [Pod ctest-pod-14545383] Cmd: wget http://10.106.235.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:26:52,864 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd wget http://10.106.235.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:26:52,864 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:26:57,919 - DEBUG - [Pod ctest-pod-14545383] Cmd: wget http://10.106.235.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:26:57,919 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd wget http://10.106.235.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:26:57,919 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:27:02,986 - DEBUG - [Pod ctest-pod-14545383] Cmd: wget http://10.106.235.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:27:02,986 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd wget http://10.106.235.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:27:02,986 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:27:08,045 - DEBUG - [Pod ctest-pod-14545383] Cmd: wget http://10.106.235.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:27:08,046 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd wget http://10.106.235.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:27:08,046 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:27:13,111 - DEBUG - [Pod ctest-pod-14545383] Cmd: wget http://10.106.235.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:27:13,111 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd wget http://10.106.235.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:27:13,111 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:27:13,111 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-56692671': 0, 'ctest-pod-37858610': 0} 2024-11-10 00:27:13,168 - DEBUG - [Pod ctest-pod-82869519] Cmd: wget http://10.106.235.99:80/ -O - -T 5 -t 1 , Output: ctest-pod-56692671 Connecting to 10.106.235.99:80 (10.106.235.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 00:27:13,168 - DEBUG - [Pod Pod ctest-pod-82869519] Cmd wget http://10.106.235.99:80/ -O - -T 5 -t 1 passed 2024-11-10 00:27:13,168 - DEBUG - [Pod Pod ctest-pod-82869519] Cmd output: ctest-pod-56692671 Connecting to 10.106.235.99:80 (10.106.235.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 00:27:13,230 - DEBUG - [Pod ctest-pod-82869519] Cmd: wget http://10.106.235.99:80/ -O - -T 5 -t 1 , Output: ctest-pod-56692671 Connecting to 10.106.235.99:80 (10.106.235.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 00:27:13,230 - DEBUG - [Pod Pod ctest-pod-82869519] Cmd wget http://10.106.235.99:80/ -O - -T 5 -t 1 passed 2024-11-10 00:27:13,230 - DEBUG - [Pod Pod ctest-pod-82869519] Cmd output: ctest-pod-56692671 Connecting to 10.106.235.99:80 (10.106.235.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 00:27:13,281 - DEBUG - [Pod ctest-pod-82869519] Cmd: wget http://10.106.235.99:80/ -O - -T 5 -t 1 , Output: ctest-pod-37858610 Connecting to 10.106.235.99:80 (10.106.235.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 00:27:13,281 - DEBUG - [Pod Pod ctest-pod-82869519] Cmd wget http://10.106.235.99:80/ -O - -T 5 -t 1 passed 2024-11-10 00:27:13,281 - DEBUG - [Pod Pod ctest-pod-82869519] Cmd output: ctest-pod-37858610 Connecting to 10.106.235.99:80 (10.106.235.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 00:27:13,281 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-56692671': 2, 'ctest-pod-37858610': 1} 2024-11-10 00:27:18,343 - DEBUG - [Pod ctest-pod-69734019] Cmd: wget http://10.106.235.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:27:18,344 - DEBUG - [Pod Pod ctest-pod-69734019] Cmd wget http://10.106.235.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:27:18,344 - DEBUG - [Pod Pod ctest-pod-69734019] Cmd output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:27:23,421 - DEBUG - [Pod ctest-pod-69734019] Cmd: wget http://10.106.235.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:27:23,421 - DEBUG - [Pod Pod ctest-pod-69734019] Cmd wget http://10.106.235.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:27:23,421 - DEBUG - [Pod Pod ctest-pod-69734019] Cmd output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:27:28,502 - DEBUG - [Pod ctest-pod-69734019] Cmd: wget http://10.106.235.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:27:28,502 - DEBUG - [Pod Pod ctest-pod-69734019] Cmd wget http://10.106.235.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:27:28,502 - DEBUG - [Pod Pod ctest-pod-69734019] Cmd output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:27:33,578 - DEBUG - [Pod ctest-pod-69734019] Cmd: wget http://10.106.235.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:27:33,578 - DEBUG - [Pod Pod ctest-pod-69734019] Cmd wget http://10.106.235.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:27:33,578 - DEBUG - [Pod Pod ctest-pod-69734019] Cmd output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:27:38,644 - DEBUG - [Pod ctest-pod-69734019] Cmd: wget http://10.106.235.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:27:38,645 - DEBUG - [Pod Pod ctest-pod-69734019] Cmd wget http://10.106.235.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:27:38,645 - DEBUG - [Pod Pod ctest-pod-69734019] Cmd output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:27:43,703 - DEBUG - [Pod ctest-pod-69734019] Cmd: wget http://10.106.235.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:27:43,703 - DEBUG - [Pod Pod ctest-pod-69734019] Cmd wget http://10.106.235.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:27:43,703 - DEBUG - [Pod Pod ctest-pod-69734019] Cmd output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:27:48,805 - DEBUG - [Pod ctest-pod-69734019] Cmd: wget http://10.106.235.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:27:48,805 - DEBUG - [Pod Pod ctest-pod-69734019] Cmd wget http://10.106.235.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:27:48,805 - DEBUG - [Pod Pod ctest-pod-69734019] Cmd output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:27:53,873 - DEBUG - [Pod ctest-pod-69734019] Cmd: wget http://10.106.235.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:27:53,873 - DEBUG - [Pod Pod ctest-pod-69734019] Cmd wget http://10.106.235.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:27:53,873 - DEBUG - [Pod Pod ctest-pod-69734019] Cmd output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:27:58,938 - DEBUG - [Pod ctest-pod-69734019] Cmd: wget http://10.106.235.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:27:58,939 - DEBUG - [Pod Pod ctest-pod-69734019] Cmd wget http://10.106.235.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:27:58,939 - DEBUG - [Pod Pod ctest-pod-69734019] Cmd output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:28:03,723 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2024-11-10 00:28:13,796 - DEBUG - [Pod ctest-pod-69734019] Cmd: wget http://10.106.235.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:28:13,797 - DEBUG - [Pod Pod ctest-pod-69734019] Cmd wget http://10.106.235.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:28:13,797 - DEBUG - [Pod Pod ctest-pod-69734019] Cmd output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:28:13,797 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-56692671': 0, 'ctest-pod-37858610': 0} 2024-11-10 00:28:15,866 - DEBUG - [Pod ctest-pod-82869519] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.276 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.081 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.093 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.081/0.483/1.276 ms 2024-11-10 00:28:15,866 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-82869519 with expectation True passed 2024-11-10 00:28:18,170 - DEBUG - [Pod ctest-pod-14545383] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.171 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.075 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.088 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.075/0.444/1.171 ms 2024-11-10 00:28:18,170 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-14545383 with expectation True passed 2024-11-10 00:28:20,254 - DEBUG - [Pod ctest-pod-69734019] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.046 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.089 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.268 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.089/0.467/1.046 ms 2024-11-10 00:28:20,255 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-69734019 with expectation True passed 2024-11-10 00:28:20,330 - DEBUG - [Pod ctest-pod-82869519] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 00:28:20,330 - DEBUG - [Pod Pod ctest-pod-82869519] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-11-10 00:28:20,330 - DEBUG - [Pod Pod ctest-pod-82869519] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 00:28:20,330 - INFO - wget check of of http://10.47.255.251 from ctest-pod-82869519 passed 2024-11-10 00:28:20,388 - DEBUG - [Pod ctest-pod-82869519] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 00:28:20,389 - DEBUG - [Pod Pod ctest-pod-82869519] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-11-10 00:28:20,389 - DEBUG - [Pod Pod ctest-pod-82869519] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 00:28:20,389 - INFO - wget check of of http://10.47.255.250 from ctest-pod-82869519 passed 2024-11-10 00:28:25,465 - DEBUG - [Pod ctest-pod-14545383] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-10 00:28:25,466 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-10 00:28:25,466 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-10 00:28:25,466 - INFO - wget check of of http://10.47.255.250 from ctest-pod-14545383 passed 2024-11-10 00:28:30,538 - DEBUG - [Pod ctest-pod-23364094] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-11-10 00:28:30,538 - DEBUG - [Pod Pod ctest-pod-23364094] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-11-10 00:28:30,538 - DEBUG - [Pod Pod ctest-pod-23364094] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-11-10 00:28:30,538 - INFO - wget check of of http://10.47.255.251 from ctest-pod-23364094 passed 2024-11-10 00:28:30,555 - INFO - Updating Network Policy ingress-on-service 2024-11-10 00:28:35,730 - DEBUG - [Pod ctest-pod-14545383] Cmd: wget http://10.106.235.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:28:35,731 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd wget http://10.106.235.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:28:35,731 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:28:40,798 - DEBUG - [Pod ctest-pod-14545383] Cmd: wget http://10.106.235.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:28:40,798 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd wget http://10.106.235.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:28:40,798 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:28:45,862 - DEBUG - [Pod ctest-pod-14545383] Cmd: wget http://10.106.235.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:28:45,862 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd wget http://10.106.235.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:28:45,862 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:28:50,944 - DEBUG - [Pod ctest-pod-14545383] Cmd: wget http://10.106.235.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:28:50,944 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd wget http://10.106.235.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:28:50,944 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:28:56,001 - DEBUG - [Pod ctest-pod-14545383] Cmd: wget http://10.106.235.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:28:56,001 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd wget http://10.106.235.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:28:56,001 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:29:01,054 - DEBUG - [Pod ctest-pod-14545383] Cmd: wget http://10.106.235.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:29:01,054 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd wget http://10.106.235.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:29:01,054 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:29:06,118 - DEBUG - [Pod ctest-pod-14545383] Cmd: wget http://10.106.235.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:29:06,118 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd wget http://10.106.235.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:29:06,118 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:29:11,178 - DEBUG - [Pod ctest-pod-14545383] Cmd: wget http://10.106.235.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:29:11,178 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd wget http://10.106.235.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:29:11,178 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:29:16,244 - DEBUG - [Pod ctest-pod-14545383] Cmd: wget http://10.106.235.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:29:16,244 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd wget http://10.106.235.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:29:16,244 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:29:21,314 - DEBUG - [Pod ctest-pod-14545383] Cmd: wget http://10.106.235.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:29:21,314 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd wget http://10.106.235.99:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:29:21,314 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd output: Connecting to 10.106.235.99:80 (10.106.235.99:80) wget: download timed out 2024-11-10 00:29:21,314 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-56692671': 0, 'ctest-pod-37858610': 0} 2024-11-10 00:29:21,369 - DEBUG - [Pod ctest-pod-82869519] Cmd: wget http://10.106.235.99:80/ -O - -T 5 -t 1 , Output: ctest-pod-56692671 Connecting to 10.106.235.99:80 (10.106.235.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 00:29:21,369 - DEBUG - [Pod Pod ctest-pod-82869519] Cmd wget http://10.106.235.99:80/ -O - -T 5 -t 1 passed 2024-11-10 00:29:21,369 - DEBUG - [Pod Pod ctest-pod-82869519] Cmd output: ctest-pod-56692671 Connecting to 10.106.235.99:80 (10.106.235.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 00:29:21,750 - DEBUG - [Pod ctest-pod-82869519] Cmd: wget http://10.106.235.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.235.99:80 (10.106.235.99:80) writing to stdout ctest-pod-56692671 - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 00:29:21,750 - DEBUG - [Pod Pod ctest-pod-82869519] Cmd wget http://10.106.235.99:80/ -O - -T 5 -t 1 passed 2024-11-10 00:29:21,750 - DEBUG - [Pod Pod ctest-pod-82869519] Cmd output: Connecting to 10.106.235.99:80 (10.106.235.99:80) writing to stdout ctest-pod-56692671 - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 00:29:21,815 - DEBUG - [Pod ctest-pod-82869519] Cmd: wget http://10.106.235.99:80/ -O - -T 5 -t 1 , Output: ctest-pod-37858610 Connecting to 10.106.235.99:80 (10.106.235.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 00:29:21,815 - DEBUG - [Pod Pod ctest-pod-82869519] Cmd wget http://10.106.235.99:80/ -O - -T 5 -t 1 passed 2024-11-10 00:29:21,815 - DEBUG - [Pod Pod ctest-pod-82869519] Cmd output: ctest-pod-37858610 Connecting to 10.106.235.99:80 (10.106.235.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 00:29:21,816 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-56692671': 2, 'ctest-pod-37858610': 1} 2024-11-10 00:29:21,891 - DEBUG - [Pod ctest-pod-69734019] Cmd: wget http://10.106.235.99:80/ -O - -T 5 -t 1 , Output: ctest-pod-56692671 Connecting to 10.106.235.99:80 (10.106.235.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 00:29:21,891 - DEBUG - [Pod Pod ctest-pod-69734019] Cmd wget http://10.106.235.99:80/ -O - -T 5 -t 1 passed 2024-11-10 00:29:21,891 - DEBUG - [Pod Pod ctest-pod-69734019] Cmd output: ctest-pod-56692671 Connecting to 10.106.235.99:80 (10.106.235.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 00:29:21,958 - DEBUG - [Pod ctest-pod-69734019] Cmd: wget http://10.106.235.99:80/ -O - -T 5 -t 1 , Output: ctest-pod-56692671 Connecting to 10.106.235.99:80 (10.106.235.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 00:29:21,959 - DEBUG - [Pod Pod ctest-pod-69734019] Cmd wget http://10.106.235.99:80/ -O - -T 5 -t 1 passed 2024-11-10 00:29:21,959 - DEBUG - [Pod Pod ctest-pod-69734019] Cmd output: ctest-pod-56692671 Connecting to 10.106.235.99:80 (10.106.235.99:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 00:29:22,031 - DEBUG - [Pod ctest-pod-69734019] Cmd: wget http://10.106.235.99:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.235.99:80 (10.106.235.99:80) ctest-pod-37858610 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 00:29:22,031 - DEBUG - [Pod Pod ctest-pod-69734019] Cmd wget http://10.106.235.99:80/ -O - -T 5 -t 1 passed 2024-11-10 00:29:22,032 - DEBUG - [Pod Pod ctest-pod-69734019] Cmd output: Connecting to 10.106.235.99:80 (10.106.235.99:80) ctest-pod-37858610 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 00:29:22,032 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-56692671': 2, 'ctest-pod-37858610': 1} 2024-11-10 00:29:24,096 - DEBUG - [Pod ctest-pod-82869519] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.074 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.094 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.089 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.089/0.419/1.074 ms 2024-11-10 00:29:24,096 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-82869519 with expectation True passed 2024-11-10 00:29:26,159 - DEBUG - [Pod ctest-pod-14545383] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.529 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.090 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.117 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.090/0.245/0.529 ms 2024-11-10 00:29:26,159 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-14545383 with expectation True passed 2024-11-10 00:29:28,226 - DEBUG - [Pod ctest-pod-69734019] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.432 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.131 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.088 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.088/0.550/1.432 ms 2024-11-10 00:29:28,226 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-69734019 with expectation True passed 2024-11-10 00:29:28,284 - DEBUG - [Pod ctest-pod-82869519] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 00:29:28,284 - DEBUG - [Pod Pod ctest-pod-82869519] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-11-10 00:29:28,284 - DEBUG - [Pod Pod ctest-pod-82869519] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 00:29:28,284 - INFO - wget check of of http://10.47.255.251 from ctest-pod-82869519 passed 2024-11-10 00:29:28,343 - DEBUG - [Pod ctest-pod-82869519] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 00:29:28,344 - DEBUG - [Pod Pod ctest-pod-82869519] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-11-10 00:29:28,344 - DEBUG - [Pod Pod ctest-pod-82869519] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 00:29:28,344 - INFO - wget check of of http://10.47.255.250 from ctest-pod-82869519 passed 2024-11-10 00:29:33,403 - DEBUG - [Pod ctest-pod-14545383] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-10 00:29:33,403 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-10 00:29:33,403 - DEBUG - [Pod Pod ctest-pod-14545383] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-10 00:29:33,403 - INFO - wget check of of http://10.47.255.250 from ctest-pod-14545383 passed 2024-11-10 00:29:33,488 - DEBUG - [Pod ctest-pod-23364094] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 00:29:33,488 - DEBUG - [Pod Pod ctest-pod-23364094] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-11-10 00:29:33,488 - DEBUG - [Pod Pod ctest-pod-23364094] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 00:29:33,488 - INFO - wget check of of http://10.47.255.251 from ctest-pod-23364094 passed 2024-11-10 00:29:33,488 - INFO - Deleting Network Policy : ingress-on-service 2024-11-10 00:29:33,489 - INFO - Deleting service : ctest-nginx-svc-62889289 2024-11-10 00:29:33,729 - DEBUG - No XMPP flaps were noticed during the test 2024-11-10 00:29:33,729 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:16] 2024-11-10 00:29:33,729 - INFO - -------------------------------------------------------------------------------- 2024-11-10 00:29:33,735 - INFO - Deleting pod ctest-new-default-68817073:ctest-pod-56692671 2024-11-10 00:29:33,736 - INFO - Deleting pod ctest-new-default-68817073:ctest-pod-37858610 2024-11-10 00:29:33,736 - INFO - Deleting pod ctest-non-default-96117000:ctest-pod-00134077 2024-11-10 00:29:33,736 - INFO - Deleting pod ctest-non-default-96117000:ctest-pod-81617825 2024-11-10 00:29:33,737 - INFO - Deleting pod ctest-new-default-68817073:ctest-pod-14545383 2024-11-10 00:29:33,737 - INFO - Deleting pod ctest-new-default-68817073:ctest-pod-82869519 2024-11-10 00:29:33,737 - INFO - Deleting pod ctest-non-default-96117000:ctest-pod-69734019 2024-11-10 00:29:33,737 - INFO - Deleting pod ctest-non-default-96117000:ctest-pod-23364094 2024-11-10 00:29:33,835 - WARNING - Pod uuid 14999500-cb1e-45a6-9f60-5611845da7ef is still seen in agent 10.0.0.42 VM list 2024-11-10 00:29:33,867 - WARNING - Pod uuid ac73011b-3aea-4120-8e7d-c484d8223666 is still seen in agent 10.0.0.42 VM list 2024-11-10 00:29:33,870 - WARNING - Pod uuid acd77c06-b375-4396-91e4-ba11121f465b is still seen in agent 10.0.0.42 VM list 2024-11-10 00:29:33,870 - WARNING - Pod uuid 0c955cc5-ad92-402a-9566-0a04225391c8 is still seen in agent 10.0.0.42 VM list 2024-11-10 00:29:33,870 - WARNING - Pod uuid f66ce2f9-ad1d-417d-b012-54873cab3a73 is still seen in agent 10.0.0.42 VM list 2024-11-10 00:29:33,871 - WARNING - Pod uuid 91d330bf-1498-47cb-ab37-b9ef7def73f1 is still seen in agent 10.0.0.42 VM list 2024-11-10 00:29:33,872 - WARNING - Pod uuid 2eef776d-799a-40cd-85dd-c834669b3e38 is still seen in agent 10.0.0.42 VM list 2024-11-10 00:29:33,872 - WARNING - Pod uuid 9fda7e33-175b-4c13-911c-141c2b3ade7d is still seen in agent 10.0.0.42 VM list 2024-11-10 00:29:38,844 - DEBUG - Pod 14999500-cb1e-45a6-9f60-5611845da7ef is not in agent 10.0.0.42 VM list 2024-11-10 00:29:38,851 - DEBUG - VMI 5b0c9776-9efa-11ef-82ca-fa163eaf1a2c is removed from agent 10.0.0.42 2024-11-10 00:29:38,851 - INFO - Verified that pod ctest-pod-56692671 is removed in agent 2024-11-10 00:29:38,903 - WARNING - Pod uuid 0c955cc5-ad92-402a-9566-0a04225391c8 is still seen in agent 10.0.0.42 VM list 2024-11-10 00:29:38,903 - WARNING - Pod uuid 9fda7e33-175b-4c13-911c-141c2b3ade7d is still seen in agent 10.0.0.42 VM list 2024-11-10 00:29:38,904 - WARNING - Pod uuid acd77c06-b375-4396-91e4-ba11121f465b is still seen in agent 10.0.0.42 VM list 2024-11-10 00:29:38,905 - WARNING - Pod uuid ac73011b-3aea-4120-8e7d-c484d8223666 is still seen in agent 10.0.0.42 VM list 2024-11-10 00:29:38,905 - WARNING - Pod uuid f66ce2f9-ad1d-417d-b012-54873cab3a73 is still seen in agent 10.0.0.42 VM list 2024-11-10 00:29:38,906 - DEBUG - Pod 91d330bf-1498-47cb-ab37-b9ef7def73f1 is not in agent 10.0.0.42 VM list 2024-11-10 00:29:38,907 - DEBUG - Pod 2eef776d-799a-40cd-85dd-c834669b3e38 is not in agent 10.0.0.42 VM list 2024-11-10 00:29:38,914 - DEBUG - VMI 5d0b19da-9efa-11ef-82ca-fa163eaf1a2c is removed from agent 10.0.0.42 2024-11-10 00:29:38,914 - INFO - Verified that pod ctest-pod-81617825 is removed in agent 2024-11-10 00:29:38,917 - DEBUG - VMI 5c6ba86e-9efa-11ef-82ca-fa163eaf1a2c is removed from agent 10.0.0.42 2024-11-10 00:29:38,917 - INFO - Verified that pod ctest-pod-00134077 is removed in agent 2024-11-10 00:29:43,927 - WARNING - Pod uuid ac73011b-3aea-4120-8e7d-c484d8223666 is still seen in agent 10.0.0.42 VM list 2024-11-10 00:29:43,928 - WARNING - Pod uuid 9fda7e33-175b-4c13-911c-141c2b3ade7d is still seen in agent 10.0.0.42 VM list 2024-11-10 00:29:43,928 - WARNING - Pod uuid 0c955cc5-ad92-402a-9566-0a04225391c8 is still seen in agent 10.0.0.42 VM list 2024-11-10 00:29:43,928 - WARNING - Pod uuid acd77c06-b375-4396-91e4-ba11121f465b is still seen in agent 10.0.0.42 VM list 2024-11-10 00:29:43,929 - WARNING - Pod uuid f66ce2f9-ad1d-417d-b012-54873cab3a73 is still seen in agent 10.0.0.42 VM list 2024-11-10 00:29:48,951 - WARNING - Pod uuid 0c955cc5-ad92-402a-9566-0a04225391c8 is still seen in agent 10.0.0.42 VM list 2024-11-10 00:29:48,951 - WARNING - Pod uuid f66ce2f9-ad1d-417d-b012-54873cab3a73 is still seen in agent 10.0.0.42 VM list 2024-11-10 00:29:48,953 - WARNING - Pod uuid ac73011b-3aea-4120-8e7d-c484d8223666 is still seen in agent 10.0.0.42 VM list 2024-11-10 00:29:48,954 - WARNING - Pod uuid 9fda7e33-175b-4c13-911c-141c2b3ade7d is still seen in agent 10.0.0.42 VM list 2024-11-10 00:29:48,954 - WARNING - Pod uuid acd77c06-b375-4396-91e4-ba11121f465b is still seen in agent 10.0.0.42 VM list 2024-11-10 00:29:53,973 - WARNING - Pod uuid ac73011b-3aea-4120-8e7d-c484d8223666 is still seen in agent 10.0.0.42 VM list 2024-11-10 00:29:53,974 - WARNING - Pod uuid f66ce2f9-ad1d-417d-b012-54873cab3a73 is still seen in agent 10.0.0.42 VM list 2024-11-10 00:29:53,975 - WARNING - Pod uuid acd77c06-b375-4396-91e4-ba11121f465b is still seen in agent 10.0.0.42 VM list 2024-11-10 00:29:53,975 - WARNING - Pod uuid 0c955cc5-ad92-402a-9566-0a04225391c8 is still seen in agent 10.0.0.42 VM list 2024-11-10 00:29:53,976 - WARNING - Pod uuid 9fda7e33-175b-4c13-911c-141c2b3ade7d is still seen in agent 10.0.0.42 VM list 2024-11-10 00:29:58,998 - WARNING - Pod uuid acd77c06-b375-4396-91e4-ba11121f465b is still seen in agent 10.0.0.42 VM list 2024-11-10 00:29:59,000 - WARNING - Pod uuid 0c955cc5-ad92-402a-9566-0a04225391c8 is still seen in agent 10.0.0.42 VM list 2024-11-10 00:29:59,001 - WARNING - Pod uuid 9fda7e33-175b-4c13-911c-141c2b3ade7d is still seen in agent 10.0.0.42 VM list 2024-11-10 00:29:59,002 - WARNING - Pod uuid f66ce2f9-ad1d-417d-b012-54873cab3a73 is still seen in agent 10.0.0.42 VM list 2024-11-10 00:29:59,003 - WARNING - Pod uuid ac73011b-3aea-4120-8e7d-c484d8223666 is still seen in agent 10.0.0.42 VM list 2024-11-10 00:30:04,024 - WARNING - Pod uuid 9fda7e33-175b-4c13-911c-141c2b3ade7d is still seen in agent 10.0.0.42 VM list 2024-11-10 00:30:04,026 - WARNING - Pod uuid f66ce2f9-ad1d-417d-b012-54873cab3a73 is still seen in agent 10.0.0.42 VM list 2024-11-10 00:30:04,026 - WARNING - Pod uuid acd77c06-b375-4396-91e4-ba11121f465b is still seen in agent 10.0.0.42 VM list 2024-11-10 00:30:04,027 - WARNING - Pod uuid 0c955cc5-ad92-402a-9566-0a04225391c8 is still seen in agent 10.0.0.42 VM list 2024-11-10 00:30:04,027 - WARNING - Pod uuid ac73011b-3aea-4120-8e7d-c484d8223666 is still seen in agent 10.0.0.42 VM list 2024-11-10 00:30:09,059 - DEBUG - Pod ac73011b-3aea-4120-8e7d-c484d8223666 is not in agent 10.0.0.42 VM list 2024-11-10 00:30:09,061 - DEBUG - Pod acd77c06-b375-4396-91e4-ba11121f465b is not in agent 10.0.0.42 VM list 2024-11-10 00:30:09,064 - DEBUG - Pod 0c955cc5-ad92-402a-9566-0a04225391c8 is not in agent 10.0.0.42 VM list 2024-11-10 00:30:09,066 - DEBUG - Pod 9fda7e33-175b-4c13-911c-141c2b3ade7d is not in agent 10.0.0.42 VM list 2024-11-10 00:30:09,067 - DEBUG - Pod f66ce2f9-ad1d-417d-b012-54873cab3a73 is not in agent 10.0.0.42 VM list 2024-11-10 00:30:09,084 - DEBUG - VMI 5daa39f2-9efa-11ef-82ca-fa163eaf1a2c is removed from agent 10.0.0.42 2024-11-10 00:30:09,084 - INFO - Verified that pod ctest-pod-14545383 is removed in agent 2024-11-10 00:30:09,085 - DEBUG - VMI 5ec75e14-9efa-11ef-82ca-fa163eaf1a2c is removed from agent 10.0.0.42 2024-11-10 00:30:09,085 - INFO - Verified that pod ctest-pod-69734019 is removed in agent 2024-11-10 00:30:09,085 - DEBUG - VMI 5f5a90d0-9efa-11ef-82ca-fa163eaf1a2c is removed from agent 10.0.0.42 2024-11-10 00:30:09,085 - INFO - Verified that pod ctest-pod-23364094 is removed in agent 2024-11-10 00:30:09,086 - DEBUG - VMI 5ba5e872-9efa-11ef-82ca-fa163eaf1a2c is removed from agent 10.0.0.42 2024-11-10 00:30:09,086 - INFO - Verified that pod ctest-pod-37858610 is removed in agent 2024-11-10 00:30:09,087 - DEBUG - VMI 5e354fd8-9efa-11ef-82ca-fa163eaf1a2c is removed from agent 10.0.0.42 2024-11-10 00:30:09,087 - INFO - Verified that pod ctest-pod-82869519 is removed in agent 2024-11-10 00:30:09,087 - INFO - Deleting namespace ctest-non-default-96117000 2024-11-10 00:30:09,106 - DEBUG - Namespace ctest-non-default-96117000 still in k8s 2024-11-10 00:30:11,111 - DEBUG - Namespace ctest-non-default-96117000 still in k8s 2024-11-10 00:30:13,116 - DEBUG - Namespace ctest-non-default-96117000 still in k8s 2024-11-10 00:30:15,121 - DEBUG - Namespace ctest-non-default-96117000 is not in k8s 2024-11-10 00:30:15,121 - DEBUG - No need to check project deletion in contrail-api 2024-11-10 00:30:15,121 - INFO - Deleting namespace ctest-new-default-68817073 2024-11-10 00:30:15,137 - DEBUG - Namespace ctest-new-default-68817073 still in k8s 2024-11-10 00:30:17,141 - DEBUG - Namespace ctest-new-default-68817073 still in k8s 2024-11-10 00:30:19,151 - DEBUG - Namespace ctest-new-default-68817073 still in k8s 2024-11-10 00:30:21,156 - DEBUG - Namespace ctest-new-default-68817073 is not in k8s 2024-11-10 00:30:21,156 - DEBUG - No need to check project deletion in contrail-api