2024-08-27 03:50:56,270 - INFO - Using existing project ['default-domain', 'k8s-default'](709d09a1-42fd-48a4-8f6e-e2712fc9721d) 2024-08-27 03:50:56,294 - DEBUG - Namespace ctest-new-default-18793822 not present 2024-08-27 03:50:56,303 - INFO - Created namespace ctest-new-default-18793822 2024-08-27 03:50:59,309 - DEBUG - Namespace ctest-non-default-12822798 not present 2024-08-27 03:50:59,330 - INFO - Created namespace ctest-non-default-12822798 2024-08-27 03:51:02,358 - DEBUG - Pod ctest-pod-56292501 not present 2024-08-27 03:51:02,358 - INFO - Creating Pod ctest-pod-56292501 2024-08-27 03:51:02,402 - DEBUG - Pod : ctest-pod-56292501 UUID is 8ceab3c7-0b3e-4075-af58-b1e94ccecacb 2024-08-27 03:51:02,408 - DEBUG - Pod ctest-pod-32683664 not present 2024-08-27 03:51:02,408 - INFO - Creating Pod ctest-pod-32683664 2024-08-27 03:51:02,447 - DEBUG - Pod : ctest-pod-32683664 UUID is bb54f1c2-93f5-4ff7-ae0c-a8b9eb80b0e5 2024-08-27 03:51:02,451 - DEBUG - Pod ctest-pod-50228776 not present 2024-08-27 03:51:02,451 - INFO - Creating Pod ctest-pod-50228776 2024-08-27 03:51:02,497 - DEBUG - Pod : ctest-pod-50228776 UUID is 6d9266a7-2d2d-4bbe-bf52-fbbdd62b1337 2024-08-27 03:51:02,500 - DEBUG - Pod ctest-pod-56402437 not present 2024-08-27 03:51:02,500 - INFO - Creating Pod ctest-pod-56402437 2024-08-27 03:51:02,551 - DEBUG - Pod : ctest-pod-56402437 UUID is d9119b90-0127-42be-a930-2e52d46cf1fe 2024-08-27 03:51:02,556 - DEBUG - Pod ctest-pod-44876502 not present 2024-08-27 03:51:02,556 - INFO - Creating Pod ctest-pod-44876502 2024-08-27 03:51:02,579 - DEBUG - Pod : ctest-pod-44876502 UUID is c46df704-f8d1-4eb9-a6f0-8866acf1970b 2024-08-27 03:51:02,582 - DEBUG - Pod ctest-pod-57557232 not present 2024-08-27 03:51:02,582 - INFO - Creating Pod ctest-pod-57557232 2024-08-27 03:51:02,614 - DEBUG - Pod : ctest-pod-57557232 UUID is 5e46e001-7ddb-4980-a8b8-65993ca7dc0a 2024-08-27 03:51:02,617 - DEBUG - Pod ctest-pod-99308687 not present 2024-08-27 03:51:02,618 - INFO - Creating Pod ctest-pod-99308687 2024-08-27 03:51:02,647 - DEBUG - Pod : ctest-pod-99308687 UUID is 1147c552-5fdd-4e34-9464-d8dfc31dfa16 2024-08-27 03:51:02,650 - DEBUG - Pod ctest-pod-46836478 not present 2024-08-27 03:51:02,650 - INFO - Creating Pod ctest-pod-46836478 2024-08-27 03:51:02,671 - DEBUG - Pod : ctest-pod-46836478 UUID is bb2247b7-571c-4845-b753-94413bbe06e6 2024-08-27 03:51:02,949 - INFO - Project default-domain:k8s-ctest-new-default-18793822 for Namespace ctest-new-default-18793822 is seen in contrail-api 2024-08-27 03:51:02,950 - DEBUG - Project uuid in Contrail is ff5c4c67-2b09-43ac-9be8-dd2b82a35220 2024-08-27 03:51:03,146 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_NamespaceDatabaseList?namespace_uuid=b09bb446-cd10-4fa3-bc38-e5d81a475a9a 2024-08-27 03:51:03,152 - INFO - Namespace ctest-new-default-18793822 with uuid b09bb446-cd10-4fa3-bc38-e5d81a475a9a found in kube manager 2024-08-27 03:51:03,152 - INFO - Namespace ctest-new-default-18793822 verification passed 2024-08-27 03:51:03,349 - INFO - Project default-domain:k8s-ctest-non-default-12822798 for Namespace ctest-non-default-12822798 is seen in contrail-api 2024-08-27 03:51:03,349 - DEBUG - Project uuid in Contrail is 06251589-5ee0-4c15-85dd-b38a443bfde9 2024-08-27 03:51:03,350 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_NamespaceDatabaseList?namespace_uuid=9bddecdd-a10f-452a-896d-9d72f0bc557e 2024-08-27 03:51:03,355 - INFO - Namespace ctest-non-default-12822798 with uuid 9bddecdd-a10f-452a-896d-9d72f0bc557e found in kube manager 2024-08-27 03:51:03,355 - INFO - Namespace ctest-non-default-12822798 verification passed 2024-08-27 03:51:03,361 - DEBUG - Pod ctest-pod-56292501 not in running state.Currently in Pending 2024-08-27 03:51:08,368 - DEBUG - Pod ctest-pod-56292501 not in running state.Currently in Pending 2024-08-27 03:51:13,406 - INFO - Pod ctest-pod-56292501 is in running state.Got IP 10.47.255.251 2024-08-27 03:51:13,483 - DEBUG - Pod ctest-pod-56292501 has vmi 95327870-6427-11ef-bb44-fa163ef7f406 2024-08-27 03:51:13,483 - INFO - Verified pod ctest-pod-56292501 in contrail-api 2024-08-27 03:51:13,512 - DEBUG - VMI 95327870-6427-11ef-bb44-fa163ef7f406 is active in agent 10.0.0.49 2024-08-27 03:51:13,513 - INFO - Verified Pod ctest-pod-56292501 in agent 10.0.0.49 2024-08-27 03:51:13,513 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_VirtualMachineDatabaseList?x=8ceab3c7-0b3e-4075-af58-b1e94ccecacb 2024-08-27 03:51:13,528 - INFO - Pod ctest-pod-56292501 with uuid 8ceab3c7-0b3e-4075-af58-b1e94ccecacb found in kube manager 2024-08-27 03:51:13,529 - INFO - Pod ctest-pod-56292501 verification passed 2024-08-27 03:51:13,547 - DEBUG - Pod ctest-pod-32683664 not in running state.Currently in Pending 2024-08-27 03:51:18,564 - INFO - Pod ctest-pod-32683664 is in running state.Got IP 10.47.255.250 2024-08-27 03:51:18,596 - DEBUG - Pod ctest-pod-32683664 has vmi 95b00100-6427-11ef-bb44-fa163ef7f406 2024-08-27 03:51:18,597 - INFO - Verified pod ctest-pod-32683664 in contrail-api 2024-08-27 03:51:19,174 - DEBUG - VMI 95b00100-6427-11ef-bb44-fa163ef7f406 is active in agent 10.0.0.49 2024-08-27 03:51:19,175 - INFO - Verified Pod ctest-pod-32683664 in agent 10.0.0.49 2024-08-27 03:51:19,175 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_VirtualMachineDatabaseList?x=bb54f1c2-93f5-4ff7-ae0c-a8b9eb80b0e5 2024-08-27 03:51:19,191 - INFO - Pod ctest-pod-32683664 with uuid bb54f1c2-93f5-4ff7-ae0c-a8b9eb80b0e5 found in kube manager 2024-08-27 03:51:19,191 - INFO - Pod ctest-pod-32683664 verification passed 2024-08-27 03:51:19,210 - INFO - Pod ctest-pod-50228776 is in running state.Got IP 10.47.255.249 2024-08-27 03:51:19,235 - DEBUG - Pod ctest-pod-50228776 has vmi 9661e136-6427-11ef-bb44-fa163ef7f406 2024-08-27 03:51:19,235 - INFO - Verified pod ctest-pod-50228776 in contrail-api 2024-08-27 03:51:19,262 - DEBUG - VMI 9661e136-6427-11ef-bb44-fa163ef7f406 is active in agent 10.0.0.49 2024-08-27 03:51:19,262 - INFO - Verified Pod ctest-pod-50228776 in agent 10.0.0.49 2024-08-27 03:51:19,262 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_VirtualMachineDatabaseList?x=6d9266a7-2d2d-4bbe-bf52-fbbdd62b1337 2024-08-27 03:51:19,273 - INFO - Pod ctest-pod-50228776 with uuid 6d9266a7-2d2d-4bbe-bf52-fbbdd62b1337 found in kube manager 2024-08-27 03:51:19,273 - INFO - Pod ctest-pod-50228776 verification passed 2024-08-27 03:51:19,287 - INFO - Pod ctest-pod-56402437 is in running state.Got IP 10.47.255.248 2024-08-27 03:51:19,355 - DEBUG - Pod ctest-pod-56402437 has vmi 96e0898c-6427-11ef-bb44-fa163ef7f406 2024-08-27 03:51:19,355 - INFO - Verified pod ctest-pod-56402437 in contrail-api 2024-08-27 03:51:19,384 - DEBUG - VMI 96e0898c-6427-11ef-bb44-fa163ef7f406 is active in agent 10.0.0.49 2024-08-27 03:51:19,385 - INFO - Verified Pod ctest-pod-56402437 in agent 10.0.0.49 2024-08-27 03:51:19,385 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_VirtualMachineDatabaseList?x=d9119b90-0127-42be-a930-2e52d46cf1fe 2024-08-27 03:51:19,397 - INFO - Pod ctest-pod-56402437 with uuid d9119b90-0127-42be-a930-2e52d46cf1fe found in kube manager 2024-08-27 03:51:19,397 - INFO - Pod ctest-pod-56402437 verification passed 2024-08-27 03:51:19,414 - INFO - Pod ctest-pod-44876502 is in running state.Got IP 10.47.255.247 2024-08-27 03:51:19,439 - DEBUG - Pod ctest-pod-44876502 has vmi 97634016-6427-11ef-bb44-fa163ef7f406 2024-08-27 03:51:19,439 - INFO - Verified pod ctest-pod-44876502 in contrail-api 2024-08-27 03:51:19,460 - DEBUG - VMI 97634016-6427-11ef-bb44-fa163ef7f406 is active in agent 10.0.0.49 2024-08-27 03:51:19,461 - INFO - Verified Pod ctest-pod-44876502 in agent 10.0.0.49 2024-08-27 03:51:19,461 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_VirtualMachineDatabaseList?x=c46df704-f8d1-4eb9-a6f0-8866acf1970b 2024-08-27 03:51:19,470 - INFO - Pod ctest-pod-44876502 with uuid c46df704-f8d1-4eb9-a6f0-8866acf1970b found in kube manager 2024-08-27 03:51:19,470 - INFO - Pod ctest-pod-44876502 verification passed 2024-08-27 03:51:19,482 - INFO - Pod ctest-pod-99308687 is in running state.Got IP 10.47.255.245 2024-08-27 03:51:19,505 - DEBUG - Pod ctest-pod-99308687 has vmi 984b2c6e-6427-11ef-bb44-fa163ef7f406 2024-08-27 03:51:19,505 - INFO - Verified pod ctest-pod-99308687 in contrail-api 2024-08-27 03:51:19,528 - DEBUG - VMI 984b2c6e-6427-11ef-bb44-fa163ef7f406 is active in agent 10.0.0.49 2024-08-27 03:51:19,528 - INFO - Verified Pod ctest-pod-99308687 in agent 10.0.0.49 2024-08-27 03:51:19,529 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_VirtualMachineDatabaseList?x=1147c552-5fdd-4e34-9464-d8dfc31dfa16 2024-08-27 03:51:19,539 - INFO - Pod ctest-pod-99308687 with uuid 1147c552-5fdd-4e34-9464-d8dfc31dfa16 found in kube manager 2024-08-27 03:51:19,539 - INFO - Pod ctest-pod-99308687 verification passed 2024-08-27 03:51:19,551 - DEBUG - Pod ctest-pod-57557232 not in running state.Currently in Pending 2024-08-27 03:51:24,573 - INFO - Pod ctest-pod-57557232 is in running state.Got IP 10.47.255.246 2024-08-27 03:51:24,644 - DEBUG - Pod ctest-pod-57557232 has vmi 97d86562-6427-11ef-bb44-fa163ef7f406 2024-08-27 03:51:24,644 - INFO - Verified pod ctest-pod-57557232 in contrail-api 2024-08-27 03:51:24,679 - DEBUG - VMI 97d86562-6427-11ef-bb44-fa163ef7f406 is active in agent 10.0.0.49 2024-08-27 03:51:24,680 - INFO - Verified Pod ctest-pod-57557232 in agent 10.0.0.49 2024-08-27 03:51:24,680 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_VirtualMachineDatabaseList?x=5e46e001-7ddb-4980-a8b8-65993ca7dc0a 2024-08-27 03:51:24,694 - INFO - Pod ctest-pod-57557232 with uuid 5e46e001-7ddb-4980-a8b8-65993ca7dc0a found in kube manager 2024-08-27 03:51:24,694 - INFO - Pod ctest-pod-57557232 verification passed 2024-08-27 03:51:24,709 - INFO - Pod ctest-pod-46836478 is in running state.Got IP 10.47.255.244 2024-08-27 03:51:24,738 - DEBUG - Pod ctest-pod-46836478 has vmi 98c6e1ec-6427-11ef-bb44-fa163ef7f406 2024-08-27 03:51:24,738 - INFO - Verified pod ctest-pod-46836478 in contrail-api 2024-08-27 03:51:24,763 - DEBUG - VMI 98c6e1ec-6427-11ef-bb44-fa163ef7f406 is active in agent 10.0.0.49 2024-08-27 03:51:24,763 - INFO - Verified Pod ctest-pod-46836478 in agent 10.0.0.49 2024-08-27 03:51:24,764 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_VirtualMachineDatabaseList?x=bb2247b7-571c-4845-b753-94413bbe06e6 2024-08-27 03:51:24,778 - INFO - Pod ctest-pod-46836478 with uuid bb2247b7-571c-4845-b753-94413bbe06e6 found in kube manager 2024-08-27 03:51:24,778 - INFO - Pod ctest-pod-46836478 verification passed 2024-08-27 03:51:24,779 - INFO - ================================================================================ 2024-08-27 03:51:24,779 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-08-27 03:51:24,779 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-08-27 03:51:25,075 - DEBUG - Nothing to compare xmpp stats {'10.0.0.49': {'10.0.0.17': '0'}} with 2024-08-27 03:51:25,075 - INFO - Initial checks done. Running the testcase now 2024-08-27 03:51:25,075 - INFO - 2024-08-27 03:51:25,162 - DEBUG - [Pod ctest-pod-56292501] Cmd: echo ctest-pod-56292501 > /usr/share/nginx/html/index.html, Output: 2024-08-27 03:51:25,237 - DEBUG - [Pod ctest-pod-32683664] Cmd: echo ctest-pod-32683664 > /usr/share/nginx/html/index.html, Output: 2024-08-27 03:51:25,313 - DEBUG - [Pod ctest-pod-50228776] Cmd: echo ctest-pod-50228776 > /usr/share/nginx/html/index.html, Output: 2024-08-27 03:51:25,405 - DEBUG - [Pod ctest-pod-56402437] Cmd: echo ctest-pod-56402437 > /usr/share/nginx/html/index.html, Output: 2024-08-27 03:51:25,414 - DEBUG - Service ctest-nginx-svc-61735012 not present 2024-08-27 03:51:25,414 - INFO - Creating service ctest-nginx-svc-61735012 2024-08-27 03:51:25,445 - INFO - Created Service ctest-nginx-svc-61735012 2024-08-27 03:51:25,472 - WARNING - Service UUID 283716f3-542e-42c2-91a8-5d2549049a5a not yet found in contrail-api 2024-08-27 03:51:26,483 - INFO - Validated that Service ctest-nginx-svc-61735012 is seen in contrail-api 2024-08-27 03:51:26,484 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_LoadbalancerDatabaseList?x=283716f3-542e-42c2-91a8-5d2549049a5a 2024-08-27 03:51:26,489 - INFO - Service ctest-nginx-svc-61735012 with uuid 283716f3-542e-42c2-91a8-5d2549049a5a found in kube manager 2024-08-27 03:51:26,489 - INFO - Service ctest-nginx-svc-61735012 verification passed 2024-08-27 03:51:27,593 - DEBUG - [Pod ctest-pod-44876502] Cmd: wget http://10.109.42.1:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.1:80 (10.109.42.1:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-56292501 2024-08-27 03:51:27,593 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd wget http://10.109.42.1:80/ -O - -T 5 -t 1 passed 2024-08-27 03:51:27,593 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd output: Connecting to 10.109.42.1:80 (10.109.42.1:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-56292501 2024-08-27 03:51:27,663 - DEBUG - [Pod ctest-pod-44876502] Cmd: wget http://10.109.42.1:80/ -O - -T 5 -t 1 , Output: ctest-pod-32683664 Connecting to 10.109.42.1:80 (10.109.42.1:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 03:51:27,663 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd wget http://10.109.42.1:80/ -O - -T 5 -t 1 passed 2024-08-27 03:51:27,663 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd output: ctest-pod-32683664 Connecting to 10.109.42.1:80 (10.109.42.1:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 03:51:27,663 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-56292501': 1, 'ctest-pod-32683664': 1} 2024-08-27 03:51:27,734 - DEBUG - [Pod ctest-pod-99308687] Cmd: wget http://10.109.42.1:80/ -O - -T 5 -t 1 , Output: ctest-pod-56292501 Connecting to 10.109.42.1:80 (10.109.42.1:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 03:51:27,734 - DEBUG - [Pod Pod ctest-pod-99308687] Cmd wget http://10.109.42.1:80/ -O - -T 5 -t 1 passed 2024-08-27 03:51:27,734 - DEBUG - [Pod Pod ctest-pod-99308687] Cmd output: ctest-pod-56292501 Connecting to 10.109.42.1:80 (10.109.42.1:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 03:51:27,817 - DEBUG - [Pod ctest-pod-99308687] Cmd: wget http://10.109.42.1:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.1:80 (10.109.42.1:80) ctest-pod-56292501 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 03:51:27,818 - DEBUG - [Pod Pod ctest-pod-99308687] Cmd wget http://10.109.42.1:80/ -O - -T 5 -t 1 passed 2024-08-27 03:51:27,818 - DEBUG - [Pod Pod ctest-pod-99308687] Cmd output: Connecting to 10.109.42.1:80 (10.109.42.1:80) ctest-pod-56292501 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 03:51:27,875 - DEBUG - [Pod ctest-pod-99308687] Cmd: wget http://10.109.42.1:80/ -O - -T 5 -t 1 , Output: ctest-pod-56292501 Connecting to 10.109.42.1:80 (10.109.42.1:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 03:51:27,876 - DEBUG - [Pod Pod ctest-pod-99308687] Cmd wget http://10.109.42.1:80/ -O - -T 5 -t 1 passed 2024-08-27 03:51:27,876 - DEBUG - [Pod Pod ctest-pod-99308687] Cmd output: ctest-pod-56292501 Connecting to 10.109.42.1:80 (10.109.42.1:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 03:51:27,947 - DEBUG - [Pod ctest-pod-99308687] Cmd: wget http://10.109.42.1:80/ -O - -T 5 -t 1 , Output: ctest-pod-56292501 Connecting to 10.109.42.1:80 (10.109.42.1:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 03:51:27,948 - DEBUG - [Pod Pod ctest-pod-99308687] Cmd wget http://10.109.42.1:80/ -O - -T 5 -t 1 passed 2024-08-27 03:51:27,948 - DEBUG - [Pod Pod ctest-pod-99308687] Cmd output: ctest-pod-56292501 Connecting to 10.109.42.1:80 (10.109.42.1:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 03:51:28,035 - DEBUG - [Pod ctest-pod-99308687] Cmd: wget http://10.109.42.1:80/ -O - -T 5 -t 1 , Output: ctest-pod-32683664 Connecting to 10.109.42.1:80 (10.109.42.1:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 03:51:28,036 - DEBUG - [Pod Pod ctest-pod-99308687] Cmd wget http://10.109.42.1:80/ -O - -T 5 -t 1 passed 2024-08-27 03:51:28,036 - DEBUG - [Pod Pod ctest-pod-99308687] Cmd output: ctest-pod-32683664 Connecting to 10.109.42.1:80 (10.109.42.1:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 03:51:28,036 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-56292501': 4, 'ctest-pod-32683664': 1} 2024-08-27 03:51:28,043 - DEBUG - Network policy ingress-on-service not present 2024-08-27 03:51:28,043 - INFO - Creating Network Policy ingress-on-service 2024-08-27 03:51:28,086 - INFO - Network policy found in k8s 2024-08-27 03:51:28,087 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=1ce103b2-f7b0-4ba8-a1c4-e45c1a39b564 2024-08-27 03:51:28,123 - INFO - Network Policy ingress-on-service with uuid 1ce103b2-f7b0-4ba8-a1c4-e45c1a39b564 found in kube manager 2024-08-27 03:51:28,212 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-08-27 03:51:28,212 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-08-27 03:51:28,213 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=1ce103b2-f7b0-4ba8-a1c4-e45c1a39b564 2024-08-27 03:51:28,262 - WARNING - Network policy with name ingress-on-service not found in agent 2024-08-27 03:51:30,263 - DEBUG - Requesting: http://10.0.0.17:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=1ce103b2-f7b0-4ba8-a1c4-e45c1a39b564 2024-08-27 03:51:30,334 - INFO - Network policy with name ingress-on-service found in agent 2024-08-27 03:51:30,335 - INFO - Network Policy ingress-on-service verification passed 2024-08-27 03:51:35,406 - DEBUG - [Pod ctest-pod-44876502] Cmd: wget http://10.109.42.1:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:51:35,407 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd wget http://10.109.42.1:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:51:35,407 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:51:40,476 - DEBUG - [Pod ctest-pod-44876502] Cmd: wget http://10.109.42.1:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:51:40,477 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd wget http://10.109.42.1:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:51:40,477 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:51:45,544 - DEBUG - [Pod ctest-pod-44876502] Cmd: wget http://10.109.42.1:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:51:45,545 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd wget http://10.109.42.1:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:51:45,545 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:51:50,627 - DEBUG - [Pod ctest-pod-44876502] Cmd: wget http://10.109.42.1:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:51:50,627 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd wget http://10.109.42.1:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:51:50,627 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:51:55,707 - DEBUG - [Pod ctest-pod-44876502] Cmd: wget http://10.109.42.1:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:51:55,708 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd wget http://10.109.42.1:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:51:55,708 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:52:00,777 - DEBUG - [Pod ctest-pod-44876502] Cmd: wget http://10.109.42.1:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:52:00,777 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd wget http://10.109.42.1:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:52:00,777 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:52:05,839 - DEBUG - [Pod ctest-pod-44876502] Cmd: wget http://10.109.42.1:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:52:05,839 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd wget http://10.109.42.1:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:52:05,839 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:52:11,242 - DEBUG - [Pod ctest-pod-44876502] Cmd: wget http://10.109.42.1:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:52:11,243 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd wget http://10.109.42.1:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:52:11,243 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:52:16,315 - DEBUG - [Pod ctest-pod-44876502] Cmd: wget http://10.109.42.1:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:52:16,315 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd wget http://10.109.42.1:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:52:16,315 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:52:21,387 - DEBUG - [Pod ctest-pod-44876502] Cmd: wget http://10.109.42.1:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:52:21,387 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd wget http://10.109.42.1:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:52:21,387 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:52:21,387 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-56292501': 0, 'ctest-pod-32683664': 0} 2024-08-27 03:52:21,451 - DEBUG - [Pod ctest-pod-57557232] Cmd: wget http://10.109.42.1:80/ -O - -T 5 -t 1 , Output: ctest-pod-32683664 Connecting to 10.109.42.1:80 (10.109.42.1:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 03:52:21,451 - DEBUG - [Pod Pod ctest-pod-57557232] Cmd wget http://10.109.42.1:80/ -O - -T 5 -t 1 passed 2024-08-27 03:52:21,451 - DEBUG - [Pod Pod ctest-pod-57557232] Cmd output: ctest-pod-32683664 Connecting to 10.109.42.1:80 (10.109.42.1:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 03:52:21,514 - DEBUG - [Pod ctest-pod-57557232] Cmd: wget http://10.109.42.1:80/ -O - -T 5 -t 1 , Output: ctest-pod-56292501 Connecting to 10.109.42.1:80 (10.109.42.1:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 03:52:21,514 - DEBUG - [Pod Pod ctest-pod-57557232] Cmd wget http://10.109.42.1:80/ -O - -T 5 -t 1 passed 2024-08-27 03:52:21,514 - DEBUG - [Pod Pod ctest-pod-57557232] Cmd output: ctest-pod-56292501 Connecting to 10.109.42.1:80 (10.109.42.1:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 03:52:21,514 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-56292501': 1, 'ctest-pod-32683664': 1} 2024-08-27 03:52:26,593 - DEBUG - [Pod ctest-pod-99308687] Cmd: wget http://10.109.42.1:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:52:26,593 - DEBUG - [Pod Pod ctest-pod-99308687] Cmd wget http://10.109.42.1:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:52:26,593 - DEBUG - [Pod Pod ctest-pod-99308687] Cmd output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:52:31,667 - DEBUG - [Pod ctest-pod-99308687] Cmd: wget http://10.109.42.1:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:52:31,667 - DEBUG - [Pod Pod ctest-pod-99308687] Cmd wget http://10.109.42.1:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:52:31,667 - DEBUG - [Pod Pod ctest-pod-99308687] Cmd output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:52:36,767 - DEBUG - [Pod ctest-pod-99308687] Cmd: wget http://10.109.42.1:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:52:36,768 - DEBUG - [Pod Pod ctest-pod-99308687] Cmd wget http://10.109.42.1:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:52:36,768 - DEBUG - [Pod Pod ctest-pod-99308687] Cmd output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:52:41,832 - DEBUG - [Pod ctest-pod-99308687] Cmd: wget http://10.109.42.1:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:52:41,832 - DEBUG - [Pod Pod ctest-pod-99308687] Cmd wget http://10.109.42.1:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:52:41,832 - DEBUG - [Pod Pod ctest-pod-99308687] Cmd output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:52:46,887 - DEBUG - [Pod ctest-pod-99308687] Cmd: wget http://10.109.42.1:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:52:46,887 - DEBUG - [Pod Pod ctest-pod-99308687] Cmd wget http://10.109.42.1:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:52:46,887 - DEBUG - [Pod Pod ctest-pod-99308687] Cmd output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:52:51,964 - DEBUG - [Pod ctest-pod-99308687] Cmd: wget http://10.109.42.1:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:52:51,964 - DEBUG - [Pod Pod ctest-pod-99308687] Cmd wget http://10.109.42.1:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:52:51,964 - DEBUG - [Pod Pod ctest-pod-99308687] Cmd output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:52:57,039 - DEBUG - [Pod ctest-pod-99308687] Cmd: wget http://10.109.42.1:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:52:57,039 - DEBUG - [Pod Pod ctest-pod-99308687] Cmd wget http://10.109.42.1:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:52:57,040 - DEBUG - [Pod Pod ctest-pod-99308687] Cmd output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:53:02,105 - DEBUG - [Pod ctest-pod-99308687] Cmd: wget http://10.109.42.1:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:53:02,106 - DEBUG - [Pod Pod ctest-pod-99308687] Cmd wget http://10.109.42.1:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:53:02,106 - DEBUG - [Pod Pod ctest-pod-99308687] Cmd output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:53:07,167 - DEBUG - [Pod ctest-pod-99308687] Cmd: wget http://10.109.42.1:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:53:07,167 - DEBUG - [Pod Pod ctest-pod-99308687] Cmd wget http://10.109.42.1:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:53:07,167 - DEBUG - [Pod Pod ctest-pod-99308687] Cmd output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:53:12,255 - DEBUG - [Pod ctest-pod-99308687] Cmd: wget http://10.109.42.1:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:53:12,255 - DEBUG - [Pod Pod ctest-pod-99308687] Cmd wget http://10.109.42.1:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:53:12,255 - DEBUG - [Pod Pod ctest-pod-99308687] Cmd output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:53:12,255 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-56292501': 0, 'ctest-pod-32683664': 0} 2024-08-27 03:53:14,345 - DEBUG - [Pod ctest-pod-57557232] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.453 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.081 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.110 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.081/0.548/1.453 ms 2024-08-27 03:53:14,345 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-57557232 with expectation True passed 2024-08-27 03:53:16,419 - DEBUG - [Pod ctest-pod-44876502] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.182 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.076 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.091 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.076/0.449/1.182 ms 2024-08-27 03:53:16,419 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-44876502 with expectation True passed 2024-08-27 03:53:18,497 - DEBUG - [Pod ctest-pod-99308687] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.379 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.082 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.177/0.379 ms 2024-08-27 03:53:18,498 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-99308687 with expectation True passed 2024-08-27 03:53:18,572 - DEBUG - [Pod ctest-pod-57557232] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-27 03:53:18,572 - DEBUG - [Pod Pod ctest-pod-57557232] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-08-27 03:53:18,572 - DEBUG - [Pod Pod ctest-pod-57557232] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-27 03:53:18,572 - INFO - wget check of of http://10.47.255.251 from ctest-pod-57557232 passed 2024-08-27 03:53:18,657 - DEBUG - [Pod ctest-pod-57557232] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-27 03:53:18,657 - DEBUG - [Pod Pod ctest-pod-57557232] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-08-27 03:53:18,657 - DEBUG - [Pod Pod ctest-pod-57557232] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-27 03:53:18,657 - INFO - wget check of of http://10.47.255.250 from ctest-pod-57557232 passed 2024-08-27 03:53:23,742 - DEBUG - [Pod ctest-pod-44876502] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-27 03:53:23,743 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-27 03:53:23,743 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-27 03:53:23,743 - INFO - wget check of of http://10.47.255.250 from ctest-pod-44876502 passed 2024-08-27 03:53:28,817 - DEBUG - [Pod ctest-pod-46836478] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-08-27 03:53:28,818 - DEBUG - [Pod Pod ctest-pod-46836478] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-08-27 03:53:28,818 - DEBUG - [Pod Pod ctest-pod-46836478] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-08-27 03:53:28,818 - INFO - wget check of of http://10.47.255.251 from ctest-pod-46836478 passed 2024-08-27 03:53:28,851 - INFO - Updating Network Policy ingress-on-service 2024-08-27 03:53:34,351 - DEBUG - [Pod ctest-pod-44876502] Cmd: wget http://10.109.42.1:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:53:34,351 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd wget http://10.109.42.1:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:53:34,352 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:53:39,432 - DEBUG - [Pod ctest-pod-44876502] Cmd: wget http://10.109.42.1:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:53:39,433 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd wget http://10.109.42.1:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:53:39,433 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:53:44,507 - DEBUG - [Pod ctest-pod-44876502] Cmd: wget http://10.109.42.1:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:53:44,507 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd wget http://10.109.42.1:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:53:44,507 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:53:49,582 - DEBUG - [Pod ctest-pod-44876502] Cmd: wget http://10.109.42.1:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:53:49,582 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd wget http://10.109.42.1:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:53:49,582 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:53:54,653 - DEBUG - [Pod ctest-pod-44876502] Cmd: wget http://10.109.42.1:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:53:54,654 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd wget http://10.109.42.1:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:53:54,654 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:53:59,733 - DEBUG - [Pod ctest-pod-44876502] Cmd: wget http://10.109.42.1:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:53:59,733 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd wget http://10.109.42.1:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:53:59,733 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:54:04,827 - DEBUG - [Pod ctest-pod-44876502] Cmd: wget http://10.109.42.1:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:54:04,827 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd wget http://10.109.42.1:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:54:04,827 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:54:09,896 - DEBUG - [Pod ctest-pod-44876502] Cmd: wget http://10.109.42.1:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:54:09,897 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd wget http://10.109.42.1:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:54:09,897 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:54:14,968 - DEBUG - [Pod ctest-pod-44876502] Cmd: wget http://10.109.42.1:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:54:14,969 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd wget http://10.109.42.1:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:54:14,969 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:54:20,060 - DEBUG - [Pod ctest-pod-44876502] Cmd: wget http://10.109.42.1:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:54:20,061 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd wget http://10.109.42.1:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:54:20,061 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd output: Connecting to 10.109.42.1:80 (10.109.42.1:80) wget: download timed out 2024-08-27 03:54:20,061 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-56292501': 0, 'ctest-pod-32683664': 0} 2024-08-27 03:54:20,148 - DEBUG - [Pod ctest-pod-57557232] Cmd: wget http://10.109.42.1:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.42.1:80 (10.109.42.1:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-56292501 2024-08-27 03:54:20,149 - DEBUG - [Pod Pod ctest-pod-57557232] Cmd wget http://10.109.42.1:80/ -O - -T 5 -t 1 passed 2024-08-27 03:54:20,149 - DEBUG - [Pod Pod ctest-pod-57557232] Cmd output: Connecting to 10.109.42.1:80 (10.109.42.1:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-56292501 2024-08-27 03:54:20,245 - DEBUG - [Pod ctest-pod-57557232] Cmd: wget http://10.109.42.1:80/ -O - -T 5 -t 1 , Output: ctest-pod-32683664 Connecting to 10.109.42.1:80 (10.109.42.1:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 03:54:20,246 - DEBUG - [Pod Pod ctest-pod-57557232] Cmd wget http://10.109.42.1:80/ -O - -T 5 -t 1 passed 2024-08-27 03:54:20,246 - DEBUG - [Pod Pod ctest-pod-57557232] Cmd output: ctest-pod-32683664 Connecting to 10.109.42.1:80 (10.109.42.1:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 03:54:20,246 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-56292501': 1, 'ctest-pod-32683664': 1} 2024-08-27 03:54:20,326 - DEBUG - [Pod ctest-pod-99308687] Cmd: wget http://10.109.42.1:80/ -O - -T 5 -t 1 , Output: ctest-pod-32683664 Connecting to 10.109.42.1:80 (10.109.42.1:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 03:54:20,326 - DEBUG - [Pod Pod ctest-pod-99308687] Cmd wget http://10.109.42.1:80/ -O - -T 5 -t 1 passed 2024-08-27 03:54:20,326 - DEBUG - [Pod Pod ctest-pod-99308687] Cmd output: ctest-pod-32683664 Connecting to 10.109.42.1:80 (10.109.42.1:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 03:54:20,411 - DEBUG - [Pod ctest-pod-99308687] Cmd: wget http://10.109.42.1:80/ -O - -T 5 -t 1 , Output: ctest-pod-32683664 Connecting to 10.109.42.1:80 (10.109.42.1:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 03:54:20,411 - DEBUG - [Pod Pod ctest-pod-99308687] Cmd wget http://10.109.42.1:80/ -O - -T 5 -t 1 passed 2024-08-27 03:54:20,411 - DEBUG - [Pod Pod ctest-pod-99308687] Cmd output: ctest-pod-32683664 Connecting to 10.109.42.1:80 (10.109.42.1:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 03:54:20,493 - DEBUG - [Pod ctest-pod-99308687] Cmd: wget http://10.109.42.1:80/ -O - -T 5 -t 1 , Output: ctest-pod-56292501 Connecting to 10.109.42.1:80 (10.109.42.1:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 03:54:20,493 - DEBUG - [Pod Pod ctest-pod-99308687] Cmd wget http://10.109.42.1:80/ -O - -T 5 -t 1 passed 2024-08-27 03:54:20,493 - DEBUG - [Pod Pod ctest-pod-99308687] Cmd output: ctest-pod-56292501 Connecting to 10.109.42.1:80 (10.109.42.1:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 03:54:20,493 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-56292501': 1, 'ctest-pod-32683664': 2} 2024-08-27 03:54:22,560 - DEBUG - [Pod ctest-pod-57557232] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.393 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.107 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.073 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.073/0.191/0.393 ms 2024-08-27 03:54:22,561 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-57557232 with expectation True passed 2024-08-27 03:54:24,632 - DEBUG - [Pod ctest-pod-44876502] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.447 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.075 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.104 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.075/0.208/0.447 ms 2024-08-27 03:54:24,632 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-44876502 with expectation True passed 2024-08-27 03:54:26,713 - DEBUG - [Pod ctest-pod-99308687] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.710 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.069 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.089 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.069/0.289/0.710 ms 2024-08-27 03:54:26,713 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-99308687 with expectation True passed 2024-08-27 03:54:26,788 - DEBUG - [Pod ctest-pod-57557232] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-27 03:54:26,789 - DEBUG - [Pod Pod ctest-pod-57557232] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-08-27 03:54:26,789 - DEBUG - [Pod Pod ctest-pod-57557232] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-27 03:54:26,789 - INFO - wget check of of http://10.47.255.251 from ctest-pod-57557232 passed 2024-08-27 03:54:26,898 - DEBUG - [Pod ctest-pod-57557232] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-27 03:54:26,898 - DEBUG - [Pod Pod ctest-pod-57557232] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-08-27 03:54:26,899 - DEBUG - [Pod Pod ctest-pod-57557232] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-27 03:54:26,899 - INFO - wget check of of http://10.47.255.250 from ctest-pod-57557232 passed 2024-08-27 03:54:31,960 - DEBUG - [Pod ctest-pod-44876502] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-27 03:54:31,960 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-27 03:54:31,960 - DEBUG - [Pod Pod ctest-pod-44876502] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-27 03:54:31,961 - INFO - wget check of of http://10.47.255.250 from ctest-pod-44876502 passed 2024-08-27 03:54:32,061 - DEBUG - [Pod ctest-pod-46836478] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-27 03:54:32,062 - DEBUG - [Pod Pod ctest-pod-46836478] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-08-27 03:54:32,062 - DEBUG - [Pod Pod ctest-pod-46836478] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-27 03:54:32,062 - INFO - wget check of of http://10.47.255.251 from ctest-pod-46836478 passed 2024-08-27 03:54:32,062 - INFO - Deleting Network Policy : ingress-on-service 2024-08-27 03:54:32,064 - INFO - Deleting service : ctest-nginx-svc-61735012 2024-08-27 03:54:32,420 - DEBUG - No XMPP flaps were noticed during the test 2024-08-27 03:54:32,421 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:08] 2024-08-27 03:54:32,421 - INFO - -------------------------------------------------------------------------------- 2024-08-27 03:54:32,436 - INFO - Deleting pod ctest-new-default-18793822:ctest-pod-56292501 2024-08-27 03:54:32,437 - INFO - Deleting pod ctest-new-default-18793822:ctest-pod-32683664 2024-08-27 03:54:32,438 - INFO - Deleting pod ctest-non-default-12822798:ctest-pod-50228776 2024-08-27 03:54:32,439 - INFO - Deleting pod ctest-non-default-12822798:ctest-pod-56402437 2024-08-27 03:54:32,440 - INFO - Deleting pod ctest-new-default-18793822:ctest-pod-44876502 2024-08-27 03:54:32,440 - INFO - Deleting pod ctest-new-default-18793822:ctest-pod-57557232 2024-08-27 03:54:32,441 - INFO - Deleting pod ctest-non-default-12822798:ctest-pod-99308687 2024-08-27 03:54:32,442 - INFO - Deleting pod ctest-non-default-12822798:ctest-pod-46836478 2024-08-27 03:54:32,602 - WARNING - Pod uuid 8ceab3c7-0b3e-4075-af58-b1e94ccecacb is still seen in agent 10.0.0.49 VM list 2024-08-27 03:54:32,633 - WARNING - Pod uuid d9119b90-0127-42be-a930-2e52d46cf1fe is still seen in agent 10.0.0.49 VM list 2024-08-27 03:54:32,635 - WARNING - Pod uuid c46df704-f8d1-4eb9-a6f0-8866acf1970b is still seen in agent 10.0.0.49 VM list 2024-08-27 03:54:32,635 - WARNING - Pod uuid bb2247b7-571c-4845-b753-94413bbe06e6 is still seen in agent 10.0.0.49 VM list 2024-08-27 03:54:32,636 - WARNING - Pod uuid bb54f1c2-93f5-4ff7-ae0c-a8b9eb80b0e5 is still seen in agent 10.0.0.49 VM list 2024-08-27 03:54:32,636 - WARNING - Pod uuid 1147c552-5fdd-4e34-9464-d8dfc31dfa16 is still seen in agent 10.0.0.49 VM list 2024-08-27 03:54:32,637 - WARNING - Pod uuid 6d9266a7-2d2d-4bbe-bf52-fbbdd62b1337 is still seen in agent 10.0.0.49 VM list 2024-08-27 03:54:32,637 - WARNING - Pod uuid 5e46e001-7ddb-4980-a8b8-65993ca7dc0a is still seen in agent 10.0.0.49 VM list 2024-08-27 03:54:37,616 - DEBUG - Pod 8ceab3c7-0b3e-4075-af58-b1e94ccecacb is not in agent 10.0.0.49 VM list 2024-08-27 03:54:37,626 - DEBUG - VMI 95327870-6427-11ef-bb44-fa163ef7f406 is removed from agent 10.0.0.49 2024-08-27 03:54:37,626 - INFO - Verified that pod ctest-pod-56292501 is removed in agent 2024-08-27 03:54:37,671 - WARNING - Pod uuid 5e46e001-7ddb-4980-a8b8-65993ca7dc0a is still seen in agent 10.0.0.49 VM list 2024-08-27 03:54:37,672 - WARNING - Pod uuid bb2247b7-571c-4845-b753-94413bbe06e6 is still seen in agent 10.0.0.49 VM list 2024-08-27 03:54:37,676 - WARNING - Pod uuid 1147c552-5fdd-4e34-9464-d8dfc31dfa16 is still seen in agent 10.0.0.49 VM list 2024-08-27 03:54:37,676 - DEBUG - Pod bb54f1c2-93f5-4ff7-ae0c-a8b9eb80b0e5 is not in agent 10.0.0.49 VM list 2024-08-27 03:54:37,678 - DEBUG - Pod 6d9266a7-2d2d-4bbe-bf52-fbbdd62b1337 is not in agent 10.0.0.49 VM list 2024-08-27 03:54:37,680 - DEBUG - Pod d9119b90-0127-42be-a930-2e52d46cf1fe is not in agent 10.0.0.49 VM list 2024-08-27 03:54:37,682 - WARNING - Pod uuid c46df704-f8d1-4eb9-a6f0-8866acf1970b is still seen in agent 10.0.0.49 VM list 2024-08-27 03:54:37,697 - DEBUG - VMI 96e0898c-6427-11ef-bb44-fa163ef7f406 is removed from agent 10.0.0.49 2024-08-27 03:54:37,697 - INFO - Verified that pod ctest-pod-56402437 is removed in agent 2024-08-27 03:54:37,697 - DEBUG - VMI 9661e136-6427-11ef-bb44-fa163ef7f406 is removed from agent 10.0.0.49 2024-08-27 03:54:37,697 - INFO - Verified that pod ctest-pod-50228776 is removed in agent 2024-08-27 03:54:37,699 - DEBUG - VMI 95b00100-6427-11ef-bb44-fa163ef7f406 is removed from agent 10.0.0.49 2024-08-27 03:54:37,699 - INFO - Verified that pod ctest-pod-32683664 is removed in agent 2024-08-27 03:54:42,689 - WARNING - Pod uuid 5e46e001-7ddb-4980-a8b8-65993ca7dc0a is still seen in agent 10.0.0.49 VM list 2024-08-27 03:54:42,691 - WARNING - Pod uuid bb2247b7-571c-4845-b753-94413bbe06e6 is still seen in agent 10.0.0.49 VM list 2024-08-27 03:54:42,692 - WARNING - Pod uuid c46df704-f8d1-4eb9-a6f0-8866acf1970b is still seen in agent 10.0.0.49 VM list 2024-08-27 03:54:42,693 - WARNING - Pod uuid 1147c552-5fdd-4e34-9464-d8dfc31dfa16 is still seen in agent 10.0.0.49 VM list 2024-08-27 03:54:47,729 - WARNING - Pod uuid 5e46e001-7ddb-4980-a8b8-65993ca7dc0a is still seen in agent 10.0.0.49 VM list 2024-08-27 03:54:47,736 - WARNING - Pod uuid c46df704-f8d1-4eb9-a6f0-8866acf1970b is still seen in agent 10.0.0.49 VM list 2024-08-27 03:54:47,737 - WARNING - Pod uuid 1147c552-5fdd-4e34-9464-d8dfc31dfa16 is still seen in agent 10.0.0.49 VM list 2024-08-27 03:54:47,738 - WARNING - Pod uuid bb2247b7-571c-4845-b753-94413bbe06e6 is still seen in agent 10.0.0.49 VM list 2024-08-27 03:54:52,767 - WARNING - Pod uuid c46df704-f8d1-4eb9-a6f0-8866acf1970b is still seen in agent 10.0.0.49 VM list 2024-08-27 03:54:52,768 - WARNING - Pod uuid bb2247b7-571c-4845-b753-94413bbe06e6 is still seen in agent 10.0.0.49 VM list 2024-08-27 03:54:52,770 - WARNING - Pod uuid 5e46e001-7ddb-4980-a8b8-65993ca7dc0a is still seen in agent 10.0.0.49 VM list 2024-08-27 03:54:54,035 - WARNING - Pod uuid 1147c552-5fdd-4e34-9464-d8dfc31dfa16 is still seen in agent 10.0.0.49 VM list 2024-08-27 03:54:57,798 - WARNING - Pod uuid c46df704-f8d1-4eb9-a6f0-8866acf1970b is still seen in agent 10.0.0.49 VM list 2024-08-27 03:54:57,803 - WARNING - Pod uuid 5e46e001-7ddb-4980-a8b8-65993ca7dc0a is still seen in agent 10.0.0.49 VM list 2024-08-27 03:54:57,804 - WARNING - Pod uuid bb2247b7-571c-4845-b753-94413bbe06e6 is still seen in agent 10.0.0.49 VM list 2024-08-27 03:54:59,046 - WARNING - Pod uuid 1147c552-5fdd-4e34-9464-d8dfc31dfa16 is still seen in agent 10.0.0.49 VM list 2024-08-27 03:55:02,879 - WARNING - Pod uuid c46df704-f8d1-4eb9-a6f0-8866acf1970b is still seen in agent 10.0.0.49 VM list 2024-08-27 03:55:02,882 - WARNING - Pod uuid 5e46e001-7ddb-4980-a8b8-65993ca7dc0a is still seen in agent 10.0.0.49 VM list 2024-08-27 03:55:02,883 - WARNING - Pod uuid bb2247b7-571c-4845-b753-94413bbe06e6 is still seen in agent 10.0.0.49 VM list 2024-08-27 03:55:04,066 - WARNING - Pod uuid 1147c552-5fdd-4e34-9464-d8dfc31dfa16 is still seen in agent 10.0.0.49 VM list 2024-08-27 03:55:07,903 - DEBUG - Pod 5e46e001-7ddb-4980-a8b8-65993ca7dc0a is not in agent 10.0.0.49 VM list 2024-08-27 03:55:07,909 - DEBUG - Pod c46df704-f8d1-4eb9-a6f0-8866acf1970b is not in agent 10.0.0.49 VM list 2024-08-27 03:55:07,919 - DEBUG - Pod bb2247b7-571c-4845-b753-94413bbe06e6 is not in agent 10.0.0.49 VM list 2024-08-27 03:55:07,940 - DEBUG - VMI 97634016-6427-11ef-bb44-fa163ef7f406 is removed from agent 10.0.0.49 2024-08-27 03:55:07,940 - INFO - Verified that pod ctest-pod-44876502 is removed in agent 2024-08-27 03:55:07,948 - DEBUG - VMI 98c6e1ec-6427-11ef-bb44-fa163ef7f406 is removed from agent 10.0.0.49 2024-08-27 03:55:07,948 - INFO - Verified that pod ctest-pod-46836478 is removed in agent 2024-08-27 03:55:07,950 - DEBUG - VMI 97d86562-6427-11ef-bb44-fa163ef7f406 is removed from agent 10.0.0.49 2024-08-27 03:55:07,950 - INFO - Verified that pod ctest-pod-57557232 is removed in agent 2024-08-27 03:55:09,082 - DEBUG - Pod 1147c552-5fdd-4e34-9464-d8dfc31dfa16 is not in agent 10.0.0.49 VM list 2024-08-27 03:55:09,096 - DEBUG - VMI 984b2c6e-6427-11ef-bb44-fa163ef7f406 is removed from agent 10.0.0.49 2024-08-27 03:55:09,096 - INFO - Verified that pod ctest-pod-99308687 is removed in agent 2024-08-27 03:55:09,097 - INFO - Deleting namespace ctest-non-default-12822798 2024-08-27 03:55:09,146 - DEBUG - Namespace ctest-non-default-12822798 still in k8s 2024-08-27 03:55:11,159 - DEBUG - Namespace ctest-non-default-12822798 still in k8s 2024-08-27 03:55:13,173 - DEBUG - Namespace ctest-non-default-12822798 still in k8s 2024-08-27 03:55:15,177 - DEBUG - Namespace ctest-non-default-12822798 is not in k8s 2024-08-27 03:55:15,178 - DEBUG - No need to check project deletion in contrail-api 2024-08-27 03:55:15,178 - INFO - Deleting namespace ctest-new-default-18793822 2024-08-27 03:55:15,188 - DEBUG - Namespace ctest-new-default-18793822 still in k8s 2024-08-27 03:55:17,200 - DEBUG - Namespace ctest-new-default-18793822 still in k8s 2024-08-27 03:55:19,215 - DEBUG - Namespace ctest-new-default-18793822 still in k8s 2024-08-27 03:55:21,219 - DEBUG - Namespace ctest-new-default-18793822 is not in k8s 2024-08-27 03:55:21,220 - DEBUG - No need to check project deletion in contrail-api