2024-09-16 02:04:18,735 - INFO - Using existing project ['default-domain', 'k8s-default'](b2a2db17-12a2-4a23-bdcd-b4abaa7cb590) 2024-09-16 02:04:18,754 - DEBUG - Namespace ctest-new-default-88328592 not present 2024-09-16 02:04:18,770 - INFO - Created namespace ctest-new-default-88328592 2024-09-16 02:04:21,774 - DEBUG - Namespace ctest-non-default-84193626 not present 2024-09-16 02:04:21,787 - INFO - Created namespace ctest-non-default-84193626 2024-09-16 02:04:24,809 - DEBUG - Pod ctest-pod-00278232 not present 2024-09-16 02:04:24,810 - INFO - Creating Pod ctest-pod-00278232 2024-09-16 02:04:24,840 - DEBUG - Pod : ctest-pod-00278232 UUID is f7e0ac14-e559-499f-a6e7-78aaca978241 2024-09-16 02:04:24,846 - DEBUG - Pod ctest-pod-61121376 not present 2024-09-16 02:04:24,846 - INFO - Creating Pod ctest-pod-61121376 2024-09-16 02:04:24,870 - DEBUG - Pod : ctest-pod-61121376 UUID is 78829825-fc2d-4870-9268-67abfc164994 2024-09-16 02:04:24,875 - DEBUG - Pod ctest-pod-18557398 not present 2024-09-16 02:04:24,875 - INFO - Creating Pod ctest-pod-18557398 2024-09-16 02:04:24,916 - DEBUG - Pod : ctest-pod-18557398 UUID is 146aa42e-b2b9-47b6-9f10-6a96a32b4808 2024-09-16 02:04:24,919 - DEBUG - Pod ctest-pod-19282497 not present 2024-09-16 02:04:24,919 - INFO - Creating Pod ctest-pod-19282497 2024-09-16 02:04:24,946 - DEBUG - Pod : ctest-pod-19282497 UUID is c4bf3033-7b23-4dfa-9947-15dacd3a6eb1 2024-09-16 02:04:24,948 - DEBUG - Pod ctest-pod-59788766 not present 2024-09-16 02:04:24,948 - INFO - Creating Pod ctest-pod-59788766 2024-09-16 02:04:24,967 - DEBUG - Pod : ctest-pod-59788766 UUID is 535389c3-faff-45fc-92cd-3cff30e798a4 2024-09-16 02:04:24,969 - DEBUG - Pod ctest-pod-48609055 not present 2024-09-16 02:04:24,970 - INFO - Creating Pod ctest-pod-48609055 2024-09-16 02:04:24,986 - DEBUG - Pod : ctest-pod-48609055 UUID is 7f8495bc-4c7b-4a21-961c-a31a931ae213 2024-09-16 02:04:24,988 - DEBUG - Pod ctest-pod-08743801 not present 2024-09-16 02:04:24,988 - INFO - Creating Pod ctest-pod-08743801 2024-09-16 02:04:25,011 - DEBUG - Pod : ctest-pod-08743801 UUID is 2893c84a-ce8d-41d1-9f92-eeeb4640d419 2024-09-16 02:04:25,014 - DEBUG - Pod ctest-pod-94532504 not present 2024-09-16 02:04:25,014 - INFO - Creating Pod ctest-pod-94532504 2024-09-16 02:04:25,077 - DEBUG - Pod : ctest-pod-94532504 UUID is 9640249e-f998-4c2a-89dd-2b4d4ce4828a 2024-09-16 02:04:25,266 - INFO - Project default-domain:k8s-ctest-new-default-88328592 for Namespace ctest-new-default-88328592 is seen in contrail-api 2024-09-16 02:04:25,267 - DEBUG - Project uuid in Contrail is 0d976ef8-d710-41c5-ae25-03f26ed5bbdb 2024-09-16 02:04:25,456 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NamespaceDatabaseList?namespace_uuid=3fb10a5d-188e-470f-b819-23cf2c2cc725 2024-09-16 02:04:25,461 - INFO - Namespace ctest-new-default-88328592 with uuid 3fb10a5d-188e-470f-b819-23cf2c2cc725 found in kube manager 2024-09-16 02:04:25,461 - INFO - Namespace ctest-new-default-88328592 verification passed 2024-09-16 02:04:25,683 - INFO - Project default-domain:k8s-ctest-non-default-84193626 for Namespace ctest-non-default-84193626 is seen in contrail-api 2024-09-16 02:04:25,683 - DEBUG - Project uuid in Contrail is 2b118343-d364-43ef-b229-10fd2e32c1b5 2024-09-16 02:04:25,683 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NamespaceDatabaseList?namespace_uuid=997b8fab-8fa0-4841-b8d4-c8fb5e8cda50 2024-09-16 02:04:25,687 - INFO - Namespace ctest-non-default-84193626 with uuid 997b8fab-8fa0-4841-b8d4-c8fb5e8cda50 found in kube manager 2024-09-16 02:04:25,688 - INFO - Namespace ctest-non-default-84193626 verification passed 2024-09-16 02:04:25,698 - DEBUG - Pod ctest-pod-00278232 not in running state.Currently in Pending 2024-09-16 02:04:30,711 - DEBUG - Pod ctest-pod-00278232 not in running state.Currently in Pending 2024-09-16 02:04:35,718 - DEBUG - Pod ctest-pod-00278232 not in running state.Currently in Pending 2024-09-16 02:04:40,731 - INFO - Pod ctest-pod-00278232 is in running state.Got IP 10.47.255.251 2024-09-16 02:04:40,749 - DEBUG - Pod ctest-pod-00278232 has vmi 0050d3ec-73d0-11ef-98bb-fa163e5e847b 2024-09-16 02:04:40,749 - INFO - Verified pod ctest-pod-00278232 in contrail-api 2024-09-16 02:04:40,782 - DEBUG - VMI 0050d3ec-73d0-11ef-98bb-fa163e5e847b is active in agent 10.0.0.33 2024-09-16 02:04:40,782 - INFO - Verified Pod ctest-pod-00278232 in agent 10.0.0.33 2024-09-16 02:04:40,782 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=f7e0ac14-e559-499f-a6e7-78aaca978241 2024-09-16 02:04:40,787 - INFO - Pod ctest-pod-00278232 with uuid f7e0ac14-e559-499f-a6e7-78aaca978241 found in kube manager 2024-09-16 02:04:40,787 - INFO - Pod ctest-pod-00278232 verification passed 2024-09-16 02:04:40,792 - INFO - Pod ctest-pod-61121376 is in running state.Got IP 10.47.255.250 2024-09-16 02:04:40,851 - DEBUG - Pod ctest-pod-61121376 has vmi 00d51b84-73d0-11ef-98bb-fa163e5e847b 2024-09-16 02:04:40,851 - INFO - Verified pod ctest-pod-61121376 in contrail-api 2024-09-16 02:04:40,878 - DEBUG - VMI 00d51b84-73d0-11ef-98bb-fa163e5e847b is active in agent 10.0.0.33 2024-09-16 02:04:40,878 - INFO - Verified Pod ctest-pod-61121376 in agent 10.0.0.33 2024-09-16 02:04:40,878 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=78829825-fc2d-4870-9268-67abfc164994 2024-09-16 02:04:40,882 - INFO - Pod ctest-pod-61121376 with uuid 78829825-fc2d-4870-9268-67abfc164994 found in kube manager 2024-09-16 02:04:40,882 - INFO - Pod ctest-pod-61121376 verification passed 2024-09-16 02:04:40,888 - DEBUG - Pod ctest-pod-18557398 not in running state.Currently in Pending 2024-09-16 02:04:45,895 - INFO - Pod ctest-pod-18557398 is in running state.Got IP 10.47.255.249 2024-09-16 02:04:45,913 - DEBUG - Pod ctest-pod-18557398 has vmi 0184b102-73d0-11ef-98bb-fa163e5e847b 2024-09-16 02:04:45,913 - INFO - Verified pod ctest-pod-18557398 in contrail-api 2024-09-16 02:04:45,939 - DEBUG - VMI 0184b102-73d0-11ef-98bb-fa163e5e847b is active in agent 10.0.0.33 2024-09-16 02:04:45,940 - INFO - Verified Pod ctest-pod-18557398 in agent 10.0.0.33 2024-09-16 02:04:45,940 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=146aa42e-b2b9-47b6-9f10-6a96a32b4808 2024-09-16 02:04:45,945 - INFO - Pod ctest-pod-18557398 with uuid 146aa42e-b2b9-47b6-9f10-6a96a32b4808 found in kube manager 2024-09-16 02:04:45,945 - INFO - Pod ctest-pod-18557398 verification passed 2024-09-16 02:04:45,950 - INFO - Pod ctest-pod-19282497 is in running state.Got IP 10.47.255.248 2024-09-16 02:04:45,969 - DEBUG - Pod ctest-pod-19282497 has vmi 021d0bc8-73d0-11ef-98bb-fa163e5e847b 2024-09-16 02:04:45,969 - INFO - Verified pod ctest-pod-19282497 in contrail-api 2024-09-16 02:04:45,995 - DEBUG - VMI 021d0bc8-73d0-11ef-98bb-fa163e5e847b is active in agent 10.0.0.33 2024-09-16 02:04:45,995 - INFO - Verified Pod ctest-pod-19282497 in agent 10.0.0.33 2024-09-16 02:04:45,995 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=c4bf3033-7b23-4dfa-9947-15dacd3a6eb1 2024-09-16 02:04:46,001 - INFO - Pod ctest-pod-19282497 with uuid c4bf3033-7b23-4dfa-9947-15dacd3a6eb1 found in kube manager 2024-09-16 02:04:46,001 - INFO - Pod ctest-pod-19282497 verification passed 2024-09-16 02:04:46,007 - INFO - Pod ctest-pod-59788766 is in running state.Got IP 10.47.255.247 2024-09-16 02:04:46,071 - DEBUG - Pod ctest-pod-59788766 has vmi 02bbe05e-73d0-11ef-98bb-fa163e5e847b 2024-09-16 02:04:46,071 - INFO - Verified pod ctest-pod-59788766 in contrail-api 2024-09-16 02:04:46,088 - DEBUG - VMI 02bbe05e-73d0-11ef-98bb-fa163e5e847b is active in agent 10.0.0.33 2024-09-16 02:04:46,088 - INFO - Verified Pod ctest-pod-59788766 in agent 10.0.0.33 2024-09-16 02:04:46,088 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=535389c3-faff-45fc-92cd-3cff30e798a4 2024-09-16 02:04:46,093 - INFO - Pod ctest-pod-59788766 with uuid 535389c3-faff-45fc-92cd-3cff30e798a4 found in kube manager 2024-09-16 02:04:46,093 - INFO - Pod ctest-pod-59788766 verification passed 2024-09-16 02:04:46,098 - INFO - Pod ctest-pod-08743801 is in running state.Got IP 10.47.255.245 2024-09-16 02:04:46,120 - DEBUG - Pod ctest-pod-08743801 has vmi 03be410e-73d0-11ef-98bb-fa163e5e847b 2024-09-16 02:04:46,120 - INFO - Verified pod ctest-pod-08743801 in contrail-api 2024-09-16 02:04:46,144 - DEBUG - VMI 03be410e-73d0-11ef-98bb-fa163e5e847b is active in agent 10.0.0.33 2024-09-16 02:04:46,144 - INFO - Verified Pod ctest-pod-08743801 in agent 10.0.0.33 2024-09-16 02:04:46,144 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=2893c84a-ce8d-41d1-9f92-eeeb4640d419 2024-09-16 02:04:46,149 - INFO - Pod ctest-pod-08743801 with uuid 2893c84a-ce8d-41d1-9f92-eeeb4640d419 found in kube manager 2024-09-16 02:04:46,149 - INFO - Pod ctest-pod-08743801 verification passed 2024-09-16 02:04:46,155 - INFO - Pod ctest-pod-48609055 is in running state.Got IP 10.47.255.246 2024-09-16 02:04:46,220 - DEBUG - Pod ctest-pod-48609055 has vmi 034168b4-73d0-11ef-98bb-fa163e5e847b 2024-09-16 02:04:46,220 - INFO - Verified pod ctest-pod-48609055 in contrail-api 2024-09-16 02:04:46,250 - DEBUG - VMI 034168b4-73d0-11ef-98bb-fa163e5e847b is active in agent 10.0.0.33 2024-09-16 02:04:46,250 - INFO - Verified Pod ctest-pod-48609055 in agent 10.0.0.33 2024-09-16 02:04:46,250 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=7f8495bc-4c7b-4a21-961c-a31a931ae213 2024-09-16 02:04:46,255 - INFO - Pod ctest-pod-48609055 with uuid 7f8495bc-4c7b-4a21-961c-a31a931ae213 found in kube manager 2024-09-16 02:04:46,255 - INFO - Pod ctest-pod-48609055 verification passed 2024-09-16 02:04:46,261 - INFO - Pod ctest-pod-94532504 is in running state.Got IP 10.47.255.244 2024-09-16 02:04:46,280 - DEBUG - Pod ctest-pod-94532504 has vmi 043193ca-73d0-11ef-98bb-fa163e5e847b 2024-09-16 02:04:46,280 - INFO - Verified pod ctest-pod-94532504 in contrail-api 2024-09-16 02:04:46,306 - DEBUG - VMI 043193ca-73d0-11ef-98bb-fa163e5e847b is active in agent 10.0.0.33 2024-09-16 02:04:46,306 - INFO - Verified Pod ctest-pod-94532504 in agent 10.0.0.33 2024-09-16 02:04:46,306 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=9640249e-f998-4c2a-89dd-2b4d4ce4828a 2024-09-16 02:04:46,311 - INFO - Pod ctest-pod-94532504 with uuid 9640249e-f998-4c2a-89dd-2b4d4ce4828a found in kube manager 2024-09-16 02:04:46,311 - INFO - Pod ctest-pod-94532504 verification passed 2024-09-16 02:04:46,311 - INFO - ================================================================================ 2024-09-16 02:04:46,311 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-09-16 02:04:46,311 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-09-16 02:04:46,613 - DEBUG - Nothing to compare xmpp stats {'10.0.0.33': {'10.0.0.24': '0'}} with 2024-09-16 02:04:46,613 - INFO - Initial checks done. Running the testcase now 2024-09-16 02:04:46,613 - INFO - 2024-09-16 02:04:46,695 - DEBUG - [Pod ctest-pod-00278232] Cmd: echo ctest-pod-00278232 > /usr/share/nginx/html/index.html, Output: 2024-09-16 02:04:46,772 - DEBUG - [Pod ctest-pod-61121376] Cmd: echo ctest-pod-61121376 > /usr/share/nginx/html/index.html, Output: 2024-09-16 02:04:46,845 - DEBUG - [Pod ctest-pod-18557398] Cmd: echo ctest-pod-18557398 > /usr/share/nginx/html/index.html, Output: 2024-09-16 02:04:46,934 - DEBUG - [Pod ctest-pod-19282497] Cmd: echo ctest-pod-19282497 > /usr/share/nginx/html/index.html, Output: 2024-09-16 02:04:46,937 - DEBUG - Service ctest-nginx-svc-06220036 not present 2024-09-16 02:04:46,937 - INFO - Creating service ctest-nginx-svc-06220036 2024-09-16 02:04:46,949 - INFO - Created Service ctest-nginx-svc-06220036 2024-09-16 02:04:46,954 - WARNING - Service UUID fc10c610-3e81-411c-b4dd-8723a3f9b5a4 not yet found in contrail-api 2024-09-16 02:04:47,962 - INFO - Validated that Service ctest-nginx-svc-06220036 is seen in contrail-api 2024-09-16 02:04:47,962 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_LoadbalancerDatabaseList?x=fc10c610-3e81-411c-b4dd-8723a3f9b5a4 2024-09-16 02:04:47,967 - INFO - Service ctest-nginx-svc-06220036 with uuid fc10c610-3e81-411c-b4dd-8723a3f9b5a4 found in kube manager 2024-09-16 02:04:47,968 - INFO - Service ctest-nginx-svc-06220036 verification passed 2024-09-16 02:04:49,123 - DEBUG - [Pod ctest-pod-59788766] Cmd: wget http://10.99.19.136:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.19.136:80 (10.99.19.136:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-61121376 2024-09-16 02:04:49,123 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd wget http://10.99.19.136:80/ -O - -T 5 -t 1 passed 2024-09-16 02:04:49,123 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd output: Connecting to 10.99.19.136:80 (10.99.19.136:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-61121376 2024-09-16 02:04:49,243 - DEBUG - [Pod ctest-pod-59788766] Cmd: wget http://10.99.19.136:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.19.136:80 (10.99.19.136:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-61121376 2024-09-16 02:04:49,243 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd wget http://10.99.19.136:80/ -O - -T 5 -t 1 passed 2024-09-16 02:04:49,243 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd output: Connecting to 10.99.19.136:80 (10.99.19.136:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-61121376 2024-09-16 02:04:49,313 - DEBUG - [Pod ctest-pod-59788766] Cmd: wget http://10.99.19.136:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.19.136:80 (10.99.19.136:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-61121376 2024-09-16 02:04:49,313 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd wget http://10.99.19.136:80/ -O - -T 5 -t 1 passed 2024-09-16 02:04:49,313 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd output: Connecting to 10.99.19.136:80 (10.99.19.136:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-61121376 2024-09-16 02:04:49,373 - DEBUG - [Pod ctest-pod-59788766] Cmd: wget http://10.99.19.136:80/ -O - -T 5 -t 1 , Output: ctest-pod-61121376 Connecting to 10.99.19.136:80 (10.99.19.136:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-16 02:04:49,373 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd wget http://10.99.19.136:80/ -O - -T 5 -t 1 passed 2024-09-16 02:04:49,373 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd output: ctest-pod-61121376 Connecting to 10.99.19.136:80 (10.99.19.136:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-16 02:04:49,438 - DEBUG - [Pod ctest-pod-59788766] Cmd: wget http://10.99.19.136:80/ -O - -T 5 -t 1 , Output: ctest-pod-00278232 Connecting to 10.99.19.136:80 (10.99.19.136:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-16 02:04:49,438 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd wget http://10.99.19.136:80/ -O - -T 5 -t 1 passed 2024-09-16 02:04:49,438 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd output: ctest-pod-00278232 Connecting to 10.99.19.136:80 (10.99.19.136:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-16 02:04:49,438 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-00278232': 1, 'ctest-pod-61121376': 4} 2024-09-16 02:04:49,504 - DEBUG - [Pod ctest-pod-08743801] Cmd: wget http://10.99.19.136:80/ -O - -T 5 -t 1 , Output: ctest-pod-00278232 Connecting to 10.99.19.136:80 (10.99.19.136:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-16 02:04:49,504 - DEBUG - [Pod Pod ctest-pod-08743801] Cmd wget http://10.99.19.136:80/ -O - -T 5 -t 1 passed 2024-09-16 02:04:49,504 - DEBUG - [Pod Pod ctest-pod-08743801] Cmd output: ctest-pod-00278232 Connecting to 10.99.19.136:80 (10.99.19.136:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-16 02:04:49,576 - DEBUG - [Pod ctest-pod-08743801] Cmd: wget http://10.99.19.136:80/ -O - -T 5 -t 1 , Output: ctest-pod-00278232 Connecting to 10.99.19.136:80 (10.99.19.136:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-16 02:04:49,576 - DEBUG - [Pod Pod ctest-pod-08743801] Cmd wget http://10.99.19.136:80/ -O - -T 5 -t 1 passed 2024-09-16 02:04:49,576 - DEBUG - [Pod Pod ctest-pod-08743801] Cmd output: ctest-pod-00278232 Connecting to 10.99.19.136:80 (10.99.19.136:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-16 02:04:49,646 - DEBUG - [Pod ctest-pod-08743801] Cmd: wget http://10.99.19.136:80/ -O - -T 5 -t 1 , Output: ctest-pod-61121376 Connecting to 10.99.19.136:80 (10.99.19.136:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-16 02:04:49,646 - DEBUG - [Pod Pod ctest-pod-08743801] Cmd wget http://10.99.19.136:80/ -O - -T 5 -t 1 passed 2024-09-16 02:04:49,646 - DEBUG - [Pod Pod ctest-pod-08743801] Cmd output: ctest-pod-61121376 Connecting to 10.99.19.136:80 (10.99.19.136:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-16 02:04:49,646 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-00278232': 2, 'ctest-pod-61121376': 1} 2024-09-16 02:04:49,649 - DEBUG - Network policy ingress-on-service not present 2024-09-16 02:04:49,649 - INFO - Creating Network Policy ingress-on-service 2024-09-16 02:04:49,663 - INFO - Network policy found in k8s 2024-09-16 02:04:49,663 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=66981684-ddf6-483f-bebb-a3643a7caeb3 2024-09-16 02:04:49,672 - INFO - Network Policy ingress-on-service with uuid 66981684-ddf6-483f-bebb-a3643a7caeb3 found in kube manager 2024-09-16 02:04:49,707 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-09-16 02:04:49,708 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-09-16 02:04:49,708 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=66981684-ddf6-483f-bebb-a3643a7caeb3 2024-09-16 02:04:49,739 - WARNING - Network policy with name ingress-on-service not found in agent 2024-09-16 02:04:51,740 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=66981684-ddf6-483f-bebb-a3643a7caeb3 2024-09-16 02:04:51,781 - INFO - Network policy with name ingress-on-service found in agent 2024-09-16 02:04:51,781 - INFO - Network Policy ingress-on-service verification passed 2024-09-16 02:04:56,886 - DEBUG - [Pod ctest-pod-59788766] Cmd: wget http://10.99.19.136:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:04:56,887 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd wget http://10.99.19.136:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:04:56,887 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:05:02,007 - DEBUG - [Pod ctest-pod-59788766] Cmd: wget http://10.99.19.136:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:05:02,007 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd wget http://10.99.19.136:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:05:02,007 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:05:07,130 - DEBUG - [Pod ctest-pod-59788766] Cmd: wget http://10.99.19.136:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:05:07,130 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd wget http://10.99.19.136:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:05:07,131 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:05:12,256 - DEBUG - [Pod ctest-pod-59788766] Cmd: wget http://10.99.19.136:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:05:12,256 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd wget http://10.99.19.136:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:05:12,256 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:05:17,392 - DEBUG - [Pod ctest-pod-59788766] Cmd: wget http://10.99.19.136:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:05:17,392 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd wget http://10.99.19.136:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:05:17,392 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:05:22,508 - DEBUG - [Pod ctest-pod-59788766] Cmd: wget http://10.99.19.136:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:05:22,508 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd wget http://10.99.19.136:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:05:22,508 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:05:27,616 - DEBUG - [Pod ctest-pod-59788766] Cmd: wget http://10.99.19.136:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:05:27,616 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd wget http://10.99.19.136:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:05:27,616 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:05:32,729 - DEBUG - [Pod ctest-pod-59788766] Cmd: wget http://10.99.19.136:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:05:32,729 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd wget http://10.99.19.136:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:05:32,729 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:05:37,843 - DEBUG - [Pod ctest-pod-59788766] Cmd: wget http://10.99.19.136:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:05:37,843 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd wget http://10.99.19.136:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:05:37,844 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:05:42,967 - DEBUG - [Pod ctest-pod-59788766] Cmd: wget http://10.99.19.136:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:05:42,967 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd wget http://10.99.19.136:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:05:42,967 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:05:42,967 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-00278232': 0, 'ctest-pod-61121376': 0} 2024-09-16 02:05:43,044 - DEBUG - [Pod ctest-pod-48609055] Cmd: wget http://10.99.19.136:80/ -O - -T 5 -t 1 , Output: ctest-pod-00278232 Connecting to 10.99.19.136:80 (10.99.19.136:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-16 02:05:43,045 - DEBUG - [Pod Pod ctest-pod-48609055] Cmd wget http://10.99.19.136:80/ -O - -T 5 -t 1 passed 2024-09-16 02:05:43,045 - DEBUG - [Pod Pod ctest-pod-48609055] Cmd output: ctest-pod-00278232 Connecting to 10.99.19.136:80 (10.99.19.136:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-16 02:05:43,105 - DEBUG - [Pod ctest-pod-48609055] Cmd: wget http://10.99.19.136:80/ -O - -T 5 -t 1 , Output: ctest-pod-61121376 Connecting to 10.99.19.136:80 (10.99.19.136:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-16 02:05:43,105 - DEBUG - [Pod Pod ctest-pod-48609055] Cmd wget http://10.99.19.136:80/ -O - -T 5 -t 1 passed 2024-09-16 02:05:43,105 - DEBUG - [Pod Pod ctest-pod-48609055] Cmd output: ctest-pod-61121376 Connecting to 10.99.19.136:80 (10.99.19.136:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-16 02:05:43,105 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-00278232': 1, 'ctest-pod-61121376': 1} 2024-09-16 02:05:48,189 - DEBUG - [Pod ctest-pod-08743801] Cmd: wget http://10.99.19.136:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:05:48,189 - DEBUG - [Pod Pod ctest-pod-08743801] Cmd wget http://10.99.19.136:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:05:48,189 - DEBUG - [Pod Pod ctest-pod-08743801] Cmd output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:05:53,312 - DEBUG - [Pod ctest-pod-08743801] Cmd: wget http://10.99.19.136:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:05:53,312 - DEBUG - [Pod Pod ctest-pod-08743801] Cmd wget http://10.99.19.136:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:05:53,312 - DEBUG - [Pod Pod ctest-pod-08743801] Cmd output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:05:58,434 - DEBUG - [Pod ctest-pod-08743801] Cmd: wget http://10.99.19.136:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:05:58,434 - DEBUG - [Pod Pod ctest-pod-08743801] Cmd wget http://10.99.19.136:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:05:58,434 - DEBUG - [Pod Pod ctest-pod-08743801] Cmd output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:06:03,536 - DEBUG - [Pod ctest-pod-08743801] Cmd: wget http://10.99.19.136:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:06:03,536 - DEBUG - [Pod Pod ctest-pod-08743801] Cmd wget http://10.99.19.136:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:06:03,536 - DEBUG - [Pod Pod ctest-pod-08743801] Cmd output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:06:08,663 - DEBUG - [Pod ctest-pod-08743801] Cmd: wget http://10.99.19.136:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:06:08,664 - DEBUG - [Pod Pod ctest-pod-08743801] Cmd wget http://10.99.19.136:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:06:08,664 - DEBUG - [Pod Pod ctest-pod-08743801] Cmd output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:06:13,766 - DEBUG - [Pod ctest-pod-08743801] Cmd: wget http://10.99.19.136:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:06:13,767 - DEBUG - [Pod Pod ctest-pod-08743801] Cmd wget http://10.99.19.136:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:06:13,767 - DEBUG - [Pod Pod ctest-pod-08743801] Cmd output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:06:18,916 - DEBUG - [Pod ctest-pod-08743801] Cmd: wget http://10.99.19.136:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:06:18,916 - DEBUG - [Pod Pod ctest-pod-08743801] Cmd wget http://10.99.19.136:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:06:18,916 - DEBUG - [Pod Pod ctest-pod-08743801] Cmd output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:06:24,002 - DEBUG - [Pod ctest-pod-08743801] Cmd: wget http://10.99.19.136:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:06:24,002 - DEBUG - [Pod Pod ctest-pod-08743801] Cmd wget http://10.99.19.136:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:06:24,002 - DEBUG - [Pod Pod ctest-pod-08743801] Cmd output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:06:29,132 - DEBUG - [Pod ctest-pod-08743801] Cmd: wget http://10.99.19.136:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:06:29,132 - DEBUG - [Pod Pod ctest-pod-08743801] Cmd wget http://10.99.19.136:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:06:29,132 - DEBUG - [Pod Pod ctest-pod-08743801] Cmd output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:06:34,245 - DEBUG - [Pod ctest-pod-08743801] Cmd: wget http://10.99.19.136:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:06:34,245 - DEBUG - [Pod Pod ctest-pod-08743801] Cmd wget http://10.99.19.136:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:06:34,245 - DEBUG - [Pod Pod ctest-pod-08743801] Cmd output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:06:34,245 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-00278232': 0, 'ctest-pod-61121376': 0} 2024-09-16 02:06:36,382 - DEBUG - [Pod ctest-pod-48609055] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.304 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.134 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.282 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.134/0.573/1.304 ms 2024-09-16 02:06:36,382 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-48609055 with expectation True passed 2024-09-16 02:06:38,501 - DEBUG - [Pod ctest-pod-59788766] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.770 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.206 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.166 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.166/0.380/0.770 ms 2024-09-16 02:06:38,501 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-59788766 with expectation True passed 2024-09-16 02:06:40,643 - DEBUG - [Pod ctest-pod-08743801] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.695 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.126 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.184 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.126/0.668/1.695 ms 2024-09-16 02:06:40,643 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-08743801 with expectation True passed 2024-09-16 02:06:40,749 - DEBUG - [Pod ctest-pod-48609055] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-16 02:06:40,749 - DEBUG - [Pod Pod ctest-pod-48609055] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-16 02:06:40,749 - DEBUG - [Pod Pod ctest-pod-48609055] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-16 02:06:40,749 - INFO - wget check of of http://10.47.255.251 from ctest-pod-48609055 passed 2024-09-16 02:06:40,848 - DEBUG - [Pod ctest-pod-48609055] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-16 02:06:40,848 - DEBUG - [Pod Pod ctest-pod-48609055] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-09-16 02:06:40,848 - DEBUG - [Pod Pod ctest-pod-48609055] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-16 02:06:40,848 - INFO - wget check of of http://10.47.255.250 from ctest-pod-48609055 passed 2024-09-16 02:06:45,921 - DEBUG - [Pod ctest-pod-59788766] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-16 02:06:45,921 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-16 02:06:45,921 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-16 02:06:45,921 - INFO - wget check of of http://10.47.255.250 from ctest-pod-59788766 passed 2024-09-16 02:06:51,061 - DEBUG - [Pod ctest-pod-94532504] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-16 02:06:51,062 - DEBUG - [Pod Pod ctest-pod-94532504] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-16 02:06:51,062 - DEBUG - [Pod Pod ctest-pod-94532504] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-16 02:06:51,062 - INFO - wget check of of http://10.47.255.251 from ctest-pod-94532504 passed 2024-09-16 02:06:51,070 - INFO - Updating Network Policy ingress-on-service 2024-09-16 02:06:56,167 - DEBUG - [Pod ctest-pod-59788766] Cmd: wget http://10.99.19.136:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:06:56,167 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd wget http://10.99.19.136:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:06:56,168 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:07:01,269 - DEBUG - [Pod ctest-pod-59788766] Cmd: wget http://10.99.19.136:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:07:01,269 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd wget http://10.99.19.136:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:07:01,269 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:07:06,358 - DEBUG - [Pod ctest-pod-59788766] Cmd: wget http://10.99.19.136:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:07:06,358 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd wget http://10.99.19.136:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:07:06,358 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:07:11,495 - DEBUG - [Pod ctest-pod-59788766] Cmd: wget http://10.99.19.136:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:07:11,495 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd wget http://10.99.19.136:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:07:11,495 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:07:16,616 - DEBUG - [Pod ctest-pod-59788766] Cmd: wget http://10.99.19.136:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:07:16,617 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd wget http://10.99.19.136:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:07:16,617 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:07:21,713 - DEBUG - [Pod ctest-pod-59788766] Cmd: wget http://10.99.19.136:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:07:21,713 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd wget http://10.99.19.136:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:07:21,713 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:07:26,866 - DEBUG - [Pod ctest-pod-59788766] Cmd: wget http://10.99.19.136:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:07:26,866 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd wget http://10.99.19.136:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:07:26,866 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:07:32,011 - DEBUG - [Pod ctest-pod-59788766] Cmd: wget http://10.99.19.136:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:07:32,011 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd wget http://10.99.19.136:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:07:32,011 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:07:37,130 - DEBUG - [Pod ctest-pod-59788766] Cmd: wget http://10.99.19.136:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:07:37,130 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd wget http://10.99.19.136:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:07:37,130 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:07:42,239 - DEBUG - [Pod ctest-pod-59788766] Cmd: wget http://10.99.19.136:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:07:42,239 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd wget http://10.99.19.136:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:07:42,239 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd output: Connecting to 10.99.19.136:80 (10.99.19.136:80) wget: download timed out 2024-09-16 02:07:42,239 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-00278232': 0, 'ctest-pod-61121376': 0} 2024-09-16 02:07:42,357 - DEBUG - [Pod ctest-pod-48609055] Cmd: wget http://10.99.19.136:80/ -O - -T 5 -t 1 , Output: ctest-pod-61121376 Connecting to 10.99.19.136:80 (10.99.19.136:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-16 02:07:42,357 - DEBUG - [Pod Pod ctest-pod-48609055] Cmd wget http://10.99.19.136:80/ -O - -T 5 -t 1 passed 2024-09-16 02:07:42,357 - DEBUG - [Pod Pod ctest-pod-48609055] Cmd output: ctest-pod-61121376 Connecting to 10.99.19.136:80 (10.99.19.136:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-16 02:07:42,453 - DEBUG - [Pod ctest-pod-48609055] Cmd: wget http://10.99.19.136:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.19.136:80 (10.99.19.136:80) writing to stdout ctest-pod-61121376 - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-16 02:07:42,453 - DEBUG - [Pod Pod ctest-pod-48609055] Cmd wget http://10.99.19.136:80/ -O - -T 5 -t 1 passed 2024-09-16 02:07:42,453 - DEBUG - [Pod Pod ctest-pod-48609055] Cmd output: Connecting to 10.99.19.136:80 (10.99.19.136:80) writing to stdout ctest-pod-61121376 - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-16 02:07:42,515 - DEBUG - [Pod ctest-pod-48609055] Cmd: wget http://10.99.19.136:80/ -O - -T 5 -t 1 , Output: ctest-pod-61121376 Connecting to 10.99.19.136:80 (10.99.19.136:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-16 02:07:42,515 - DEBUG - [Pod Pod ctest-pod-48609055] Cmd wget http://10.99.19.136:80/ -O - -T 5 -t 1 passed 2024-09-16 02:07:42,515 - DEBUG - [Pod Pod ctest-pod-48609055] Cmd output: ctest-pod-61121376 Connecting to 10.99.19.136:80 (10.99.19.136:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-16 02:07:42,583 - DEBUG - [Pod ctest-pod-48609055] Cmd: wget http://10.99.19.136:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.19.136:80 (10.99.19.136:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-61121376 2024-09-16 02:07:42,583 - DEBUG - [Pod Pod ctest-pod-48609055] Cmd wget http://10.99.19.136:80/ -O - -T 5 -t 1 passed 2024-09-16 02:07:42,584 - DEBUG - [Pod Pod ctest-pod-48609055] Cmd output: Connecting to 10.99.19.136:80 (10.99.19.136:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-61121376 2024-09-16 02:07:42,641 - DEBUG - [Pod ctest-pod-48609055] Cmd: wget http://10.99.19.136:80/ -O - -T 5 -t 1 , Output: ctest-pod-00278232 Connecting to 10.99.19.136:80 (10.99.19.136:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-16 02:07:42,641 - DEBUG - [Pod Pod ctest-pod-48609055] Cmd wget http://10.99.19.136:80/ -O - -T 5 -t 1 passed 2024-09-16 02:07:42,642 - DEBUG - [Pod Pod ctest-pod-48609055] Cmd output: ctest-pod-00278232 Connecting to 10.99.19.136:80 (10.99.19.136:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-16 02:07:42,642 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-00278232': 1, 'ctest-pod-61121376': 4} 2024-09-16 02:07:42,708 - DEBUG - [Pod ctest-pod-08743801] Cmd: wget http://10.99.19.136:80/ -O - -T 5 -t 1 , Output: ctest-pod-00278232 Connecting to 10.99.19.136:80 (10.99.19.136:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-16 02:07:42,708 - DEBUG - [Pod Pod ctest-pod-08743801] Cmd wget http://10.99.19.136:80/ -O - -T 5 -t 1 passed 2024-09-16 02:07:42,708 - DEBUG - [Pod Pod ctest-pod-08743801] Cmd output: ctest-pod-00278232 Connecting to 10.99.19.136:80 (10.99.19.136:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-16 02:07:42,784 - DEBUG - [Pod ctest-pod-08743801] Cmd: wget http://10.99.19.136:80/ -O - -T 5 -t 1 , Output: ctest-pod-61121376 Connecting to 10.99.19.136:80 (10.99.19.136:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-16 02:07:42,785 - DEBUG - [Pod Pod ctest-pod-08743801] Cmd wget http://10.99.19.136:80/ -O - -T 5 -t 1 passed 2024-09-16 02:07:42,785 - DEBUG - [Pod Pod ctest-pod-08743801] Cmd output: ctest-pod-61121376 Connecting to 10.99.19.136:80 (10.99.19.136:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-16 02:07:42,785 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-00278232': 1, 'ctest-pod-61121376': 1} 2024-09-16 02:07:44,836 - DEBUG - [Pod ctest-pod-48609055] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.353 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.152 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.170 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.152/0.225/0.353 ms 2024-09-16 02:07:44,836 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-48609055 with expectation True passed 2024-09-16 02:07:46,964 - DEBUG - [Pod ctest-pod-59788766] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=3.059 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.134 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.189 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.134/1.127/3.059 ms 2024-09-16 02:07:46,964 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-59788766 with expectation True passed 2024-09-16 02:07:49,058 - DEBUG - [Pod ctest-pod-08743801] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.567 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.158 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.186 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.158/0.637/1.567 ms 2024-09-16 02:07:49,058 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-08743801 with expectation True passed 2024-09-16 02:07:49,173 - DEBUG - [Pod ctest-pod-48609055] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-16 02:07:49,173 - DEBUG - [Pod Pod ctest-pod-48609055] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-16 02:07:49,173 - DEBUG - [Pod Pod ctest-pod-48609055] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-16 02:07:49,173 - INFO - wget check of of http://10.47.255.251 from ctest-pod-48609055 passed 2024-09-16 02:07:49,250 - DEBUG - [Pod ctest-pod-48609055] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-16 02:07:49,250 - DEBUG - [Pod Pod ctest-pod-48609055] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-09-16 02:07:49,250 - DEBUG - [Pod Pod ctest-pod-48609055] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-16 02:07:49,250 - INFO - wget check of of http://10.47.255.250 from ctest-pod-48609055 passed 2024-09-16 02:07:54,320 - DEBUG - [Pod ctest-pod-59788766] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-16 02:07:54,320 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-16 02:07:54,321 - DEBUG - [Pod Pod ctest-pod-59788766] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-16 02:07:54,321 - INFO - wget check of of http://10.47.255.250 from ctest-pod-59788766 passed 2024-09-16 02:07:54,580 - DEBUG - [Pod ctest-pod-94532504] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-16 02:07:54,580 - DEBUG - [Pod Pod ctest-pod-94532504] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-16 02:07:54,580 - DEBUG - [Pod Pod ctest-pod-94532504] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-16 02:07:54,580 - INFO - wget check of of http://10.47.255.251 from ctest-pod-94532504 passed 2024-09-16 02:07:54,580 - INFO - Deleting Network Policy : ingress-on-service 2024-09-16 02:07:54,581 - INFO - Deleting service : ctest-nginx-svc-06220036 2024-09-16 02:07:54,878 - DEBUG - No XMPP flaps were noticed during the test
2024-09-16 02:07:54,878 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:08]
2024-09-16 02:07:54,878 - INFO - -------------------------------------------------------------------------------- 2024-09-16 02:07:54,884 - INFO - Deleting pod ctest-new-default-88328592:ctest-pod-00278232 2024-09-16 02:07:54,885 - INFO - Deleting pod ctest-new-default-88328592:ctest-pod-61121376 2024-09-16 02:07:54,885 - INFO - Deleting pod ctest-non-default-84193626:ctest-pod-18557398 2024-09-16 02:07:54,886 - INFO - Deleting pod ctest-non-default-84193626:ctest-pod-19282497 2024-09-16 02:07:54,886 - INFO - Deleting pod ctest-new-default-88328592:ctest-pod-59788766 2024-09-16 02:07:54,886 - INFO - Deleting pod ctest-new-default-88328592:ctest-pod-48609055 2024-09-16 02:07:54,887 - INFO - Deleting pod ctest-non-default-84193626:ctest-pod-08743801 2024-09-16 02:07:54,887 - INFO - Deleting pod ctest-non-default-84193626:ctest-pod-94532504 2024-09-16 02:07:54,972 - WARNING - Pod uuid f7e0ac14-e559-499f-a6e7-78aaca978241 is still seen in agent 10.0.0.33 VM list 2024-09-16 02:07:55,016 - WARNING - Pod uuid c4bf3033-7b23-4dfa-9947-15dacd3a6eb1 is still seen in agent 10.0.0.33 VM list 2024-09-16 02:07:55,016 - WARNING - Pod uuid 535389c3-faff-45fc-92cd-3cff30e798a4 is still seen in agent 10.0.0.33 VM list 2024-09-16 02:07:55,017 - WARNING - Pod uuid 78829825-fc2d-4870-9268-67abfc164994 is still seen in agent 10.0.0.33 VM list 2024-09-16 02:07:55,017 - WARNING - Pod uuid 146aa42e-b2b9-47b6-9f10-6a96a32b4808 is still seen in agent 10.0.0.33 VM list 2024-09-16 02:07:55,018 - WARNING - Pod uuid 7f8495bc-4c7b-4a21-961c-a31a931ae213 is still seen in agent 10.0.0.33 VM list 2024-09-16 02:07:55,019 - WARNING - Pod uuid 9640249e-f998-4c2a-89dd-2b4d4ce4828a is still seen in agent 10.0.0.33 VM list 2024-09-16 02:07:55,019 - WARNING - Pod uuid 2893c84a-ce8d-41d1-9f92-eeeb4640d419 is still seen in agent 10.0.0.33 VM list 2024-09-16 02:08:00,004 - DEBUG - Pod f7e0ac14-e559-499f-a6e7-78aaca978241 is not in agent 10.0.0.33 VM list 2024-09-16 02:08:00,031 - DEBUG - VMI 0050d3ec-73d0-11ef-98bb-fa163e5e847b is removed from agent 10.0.0.33 2024-09-16 02:08:00,031 - INFO - Verified that pod ctest-pod-00278232 is removed in agent 2024-09-16 02:08:00,089 - DEBUG - Pod 146aa42e-b2b9-47b6-9f10-6a96a32b4808 is not in agent 10.0.0.33 VM list 2024-09-16 02:08:00,093 - WARNING - Pod uuid 2893c84a-ce8d-41d1-9f92-eeeb4640d419 is still seen in agent 10.0.0.33 VM list 2024-09-16 02:08:00,094 - WARNING - Pod uuid 9640249e-f998-4c2a-89dd-2b4d4ce4828a is still seen in agent 10.0.0.33 VM list 2024-09-16 02:08:00,094 - WARNING - Pod uuid 535389c3-faff-45fc-92cd-3cff30e798a4 is still seen in agent 10.0.0.33 VM list 2024-09-16 02:08:00,095 - DEBUG - Pod c4bf3033-7b23-4dfa-9947-15dacd3a6eb1 is not in agent 10.0.0.33 VM list 2024-09-16 02:08:00,096 - DEBUG - Pod 78829825-fc2d-4870-9268-67abfc164994 is not in agent 10.0.0.33 VM list 2024-09-16 02:08:00,097 - WARNING - Pod uuid 7f8495bc-4c7b-4a21-961c-a31a931ae213 is still seen in agent 10.0.0.33 VM list 2024-09-16 02:08:00,127 - DEBUG - VMI 0184b102-73d0-11ef-98bb-fa163e5e847b is removed from agent 10.0.0.33 2024-09-16 02:08:00,127 - INFO - Verified that pod ctest-pod-18557398 is removed in agent 2024-09-16 02:08:00,128 - DEBUG - VMI 00d51b84-73d0-11ef-98bb-fa163e5e847b is removed from agent 10.0.0.33 2024-09-16 02:08:00,128 - INFO - Verified that pod ctest-pod-61121376 is removed in agent 2024-09-16 02:08:00,129 - DEBUG - VMI 021d0bc8-73d0-11ef-98bb-fa163e5e847b is removed from agent 10.0.0.33 2024-09-16 02:08:00,129 - INFO - Verified that pod ctest-pod-19282497 is removed in agent 2024-09-16 02:08:05,142 - WARNING - Pod uuid 2893c84a-ce8d-41d1-9f92-eeeb4640d419 is still seen in agent 10.0.0.33 VM list 2024-09-16 02:08:05,144 - WARNING - Pod uuid 7f8495bc-4c7b-4a21-961c-a31a931ae213 is still seen in agent 10.0.0.33 VM list 2024-09-16 02:08:05,145 - WARNING - Pod uuid 535389c3-faff-45fc-92cd-3cff30e798a4 is still seen in agent 10.0.0.33 VM list 2024-09-16 02:08:05,146 - WARNING - Pod uuid 9640249e-f998-4c2a-89dd-2b4d4ce4828a is still seen in agent 10.0.0.33 VM list 2024-09-16 02:08:10,185 - WARNING - Pod uuid 7f8495bc-4c7b-4a21-961c-a31a931ae213 is still seen in agent 10.0.0.33 VM list 2024-09-16 02:08:10,186 - WARNING - Pod uuid 2893c84a-ce8d-41d1-9f92-eeeb4640d419 is still seen in agent 10.0.0.33 VM list 2024-09-16 02:08:10,187 - WARNING - Pod uuid 535389c3-faff-45fc-92cd-3cff30e798a4 is still seen in agent 10.0.0.33 VM list 2024-09-16 02:08:10,188 - WARNING - Pod uuid 9640249e-f998-4c2a-89dd-2b4d4ce4828a is still seen in agent 10.0.0.33 VM list 2024-09-16 02:08:15,209 - WARNING - Pod uuid 2893c84a-ce8d-41d1-9f92-eeeb4640d419 is still seen in agent 10.0.0.33 VM list 2024-09-16 02:08:15,210 - WARNING - Pod uuid 7f8495bc-4c7b-4a21-961c-a31a931ae213 is still seen in agent 10.0.0.33 VM list 2024-09-16 02:08:15,211 - WARNING - Pod uuid 9640249e-f998-4c2a-89dd-2b4d4ce4828a is still seen in agent 10.0.0.33 VM list 2024-09-16 02:08:15,212 - WARNING - Pod uuid 535389c3-faff-45fc-92cd-3cff30e798a4 is still seen in agent 10.0.0.33 VM list 2024-09-16 02:08:20,253 - WARNING - Pod uuid 2893c84a-ce8d-41d1-9f92-eeeb4640d419 is still seen in agent 10.0.0.33 VM list 2024-09-16 02:08:20,255 - WARNING - Pod uuid 9640249e-f998-4c2a-89dd-2b4d4ce4828a is still seen in agent 10.0.0.33 VM list 2024-09-16 02:08:20,255 - WARNING - Pod uuid 7f8495bc-4c7b-4a21-961c-a31a931ae213 is still seen in agent 10.0.0.33 VM list 2024-09-16 02:08:20,256 - WARNING - Pod uuid 535389c3-faff-45fc-92cd-3cff30e798a4 is still seen in agent 10.0.0.33 VM list 2024-09-16 02:08:25,286 - WARNING - Pod uuid 2893c84a-ce8d-41d1-9f92-eeeb4640d419 is still seen in agent 10.0.0.33 VM list 2024-09-16 02:08:25,287 - WARNING - Pod uuid 7f8495bc-4c7b-4a21-961c-a31a931ae213 is still seen in agent 10.0.0.33 VM list 2024-09-16 02:08:25,288 - WARNING - Pod uuid 9640249e-f998-4c2a-89dd-2b4d4ce4828a is still seen in agent 10.0.0.33 VM list 2024-09-16 02:08:25,288 - WARNING - Pod uuid 535389c3-faff-45fc-92cd-3cff30e798a4 is still seen in agent 10.0.0.33 VM list 2024-09-16 02:08:30,325 - DEBUG - Pod 7f8495bc-4c7b-4a21-961c-a31a931ae213 is not in agent 10.0.0.33 VM list 2024-09-16 02:08:30,327 - DEBUG - Pod 2893c84a-ce8d-41d1-9f92-eeeb4640d419 is not in agent 10.0.0.33 VM list 2024-09-16 02:08:30,331 - DEBUG - Pod 9640249e-f998-4c2a-89dd-2b4d4ce4828a is not in agent 10.0.0.33 VM list 2024-09-16 02:08:30,332 - DEBUG - Pod 535389c3-faff-45fc-92cd-3cff30e798a4 is not in agent 10.0.0.33 VM list 2024-09-16 02:08:30,376 - DEBUG - VMI 034168b4-73d0-11ef-98bb-fa163e5e847b is removed from agent 10.0.0.33 2024-09-16 02:08:30,376 - INFO - Verified that pod ctest-pod-48609055 is removed in agent 2024-09-16 02:08:30,377 - DEBUG - VMI 043193ca-73d0-11ef-98bb-fa163e5e847b is removed from agent 10.0.0.33 2024-09-16 02:08:30,377 - INFO - Verified that pod ctest-pod-94532504 is removed in agent 2024-09-16 02:08:30,378 - DEBUG - VMI 03be410e-73d0-11ef-98bb-fa163e5e847b is removed from agent 10.0.0.33 2024-09-16 02:08:30,378 - INFO - Verified that pod ctest-pod-08743801 is removed in agent 2024-09-16 02:08:30,379 - DEBUG - VMI 02bbe05e-73d0-11ef-98bb-fa163e5e847b is removed from agent 10.0.0.33 2024-09-16 02:08:30,379 - INFO - Verified that pod ctest-pod-59788766 is removed in agent 2024-09-16 02:08:30,379 - INFO - Deleting namespace ctest-non-default-84193626 2024-09-16 02:08:30,401 - DEBUG - Namespace ctest-non-default-84193626 still in k8s 2024-09-16 02:08:32,406 - DEBUG - Namespace ctest-non-default-84193626 still in k8s 2024-09-16 02:08:34,411 - DEBUG - Namespace ctest-non-default-84193626 still in k8s 2024-09-16 02:08:36,415 - DEBUG - Namespace ctest-non-default-84193626 is not in k8s 2024-09-16 02:08:36,415 - DEBUG - No need to check project deletion in contrail-api 2024-09-16 02:08:36,415 - INFO - Deleting namespace ctest-new-default-88328592 2024-09-16 02:08:36,423 - DEBUG - Namespace ctest-new-default-88328592 still in k8s 2024-09-16 02:08:38,429 - DEBUG - Namespace ctest-new-default-88328592 still in k8s 2024-09-16 02:08:40,433 - DEBUG - Namespace ctest-new-default-88328592 still in k8s 2024-09-16 02:08:42,437 - DEBUG - Namespace ctest-new-default-88328592 is not in k8s 2024-09-16 02:08:42,437 - DEBUG - No need to check project deletion in contrail-api