2024-09-04 16:31:53,573 - INFO - Using existing project ['default-domain', 'k8s-default'](4b43bae5-bb95-4ab5-b809-eb14fb842c20) 2024-09-04 16:31:53,591 - DEBUG - Namespace ctest-new-default-26605473 not present 2024-09-04 16:31:53,599 - INFO - Created namespace ctest-new-default-26605473 2024-09-04 16:31:56,604 - DEBUG - Namespace ctest-non-default-21356343 not present 2024-09-04 16:31:56,616 - INFO - Created namespace ctest-non-default-21356343 2024-09-04 16:31:59,646 - DEBUG - Pod ctest-pod-21299650 not present 2024-09-04 16:31:59,646 - INFO - Creating Pod ctest-pod-21299650 2024-09-04 16:31:59,676 - DEBUG - Pod : ctest-pod-21299650 UUID is c06858c9-b5c3-41e3-97b5-5c830e19c398 2024-09-04 16:31:59,679 - DEBUG - Pod ctest-pod-00805145 not present 2024-09-04 16:31:59,679 - INFO - Creating Pod ctest-pod-00805145 2024-09-04 16:31:59,715 - DEBUG - Pod : ctest-pod-00805145 UUID is a761c575-4098-4901-97fe-ae8e147fcb9b 2024-09-04 16:31:59,740 - DEBUG - Pod ctest-pod-25705932 not present 2024-09-04 16:31:59,740 - INFO - Creating Pod ctest-pod-25705932 2024-09-04 16:31:59,769 - DEBUG - Pod : ctest-pod-25705932 UUID is 78f6a9f5-17c0-4404-a52b-dd3b835a9ead 2024-09-04 16:31:59,781 - DEBUG - Pod ctest-pod-39708154 not present 2024-09-04 16:31:59,782 - INFO - Creating Pod ctest-pod-39708154 2024-09-04 16:31:59,805 - DEBUG - Pod : ctest-pod-39708154 UUID is 7ee7ab56-5c36-4573-8617-748109fd1c04 2024-09-04 16:31:59,808 - DEBUG - Pod ctest-pod-81269573 not present 2024-09-04 16:31:59,809 - INFO - Creating Pod ctest-pod-81269573 2024-09-04 16:31:59,826 - DEBUG - Pod : ctest-pod-81269573 UUID is aaa1597c-b3e4-4e0c-bc96-95f61eafd12e 2024-09-04 16:31:59,828 - DEBUG - Pod ctest-pod-00164159 not present 2024-09-04 16:31:59,829 - INFO - Creating Pod ctest-pod-00164159 2024-09-04 16:31:59,852 - DEBUG - Pod : ctest-pod-00164159 UUID is b47911e3-c591-40aa-b3b7-c4f0ffc6f542 2024-09-04 16:31:59,854 - DEBUG - Pod ctest-pod-29209677 not present 2024-09-04 16:31:59,854 - INFO - Creating Pod ctest-pod-29209677 2024-09-04 16:31:59,872 - DEBUG - Pod : ctest-pod-29209677 UUID is 8f7a31d5-3bc4-4ada-ba13-b9ef6f0e1ab1 2024-09-04 16:31:59,875 - DEBUG - Pod ctest-pod-20580295 not present 2024-09-04 16:31:59,875 - INFO - Creating Pod ctest-pod-20580295 2024-09-04 16:31:59,898 - DEBUG - Pod : ctest-pod-20580295 UUID is dd11814c-e95f-4889-bc27-c463029e30bb 2024-09-04 16:32:00,066 - INFO - Project default-domain:k8s-ctest-new-default-26605473 for Namespace ctest-new-default-26605473 is seen in contrail-api 2024-09-04 16:32:00,067 - DEBUG - Project uuid in Contrail is f73d0230-d830-4cdc-9ea0-e19f98a5f917 2024-09-04 16:32:00,245 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_NamespaceDatabaseList?namespace_uuid=56461829-ebf8-4e28-9b3f-5f68059c9750 2024-09-04 16:32:00,250 - INFO - Namespace ctest-new-default-26605473 with uuid 56461829-ebf8-4e28-9b3f-5f68059c9750 found in kube manager 2024-09-04 16:32:00,250 - INFO - Namespace ctest-new-default-26605473 verification passed 2024-09-04 16:32:00,455 - INFO - Project default-domain:k8s-ctest-non-default-21356343 for Namespace ctest-non-default-21356343 is seen in contrail-api 2024-09-04 16:32:00,455 - DEBUG - Project uuid in Contrail is fcc2d15a-edfb-4b40-b31a-c6cb34973600 2024-09-04 16:32:00,455 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_NamespaceDatabaseList?namespace_uuid=81352951-872c-4cf3-b658-760df7fcf64a 2024-09-04 16:32:00,462 - INFO - Namespace ctest-non-default-21356343 with uuid 81352951-872c-4cf3-b658-760df7fcf64a found in kube manager 2024-09-04 16:32:00,462 - INFO - Namespace ctest-non-default-21356343 verification passed 2024-09-04 16:32:00,468 - DEBUG - Pod ctest-pod-21299650 not in running state.Currently in Pending 2024-09-04 16:32:05,475 - DEBUG - Pod ctest-pod-21299650 not in running state.Currently in Pending 2024-09-04 16:32:10,481 - DEBUG - Pod ctest-pod-21299650 not in running state.Currently in Pending 2024-09-04 16:32:15,487 - INFO - Pod ctest-pod-21299650 is in running state.Got IP 10.47.255.251 2024-09-04 16:32:15,501 - DEBUG - Pod ctest-pod-21299650 has vmi 364cd0b6-6adb-11ef-84a2-fa163e4bbded 2024-09-04 16:32:15,501 - INFO - Verified pod ctest-pod-21299650 in contrail-api 2024-09-04 16:32:15,517 - DEBUG - VMI 364cd0b6-6adb-11ef-84a2-fa163e4bbded is active in agent 10.0.0.23 2024-09-04 16:32:15,518 - INFO - Verified Pod ctest-pod-21299650 in agent 10.0.0.23 2024-09-04 16:32:15,518 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_VirtualMachineDatabaseList?x=c06858c9-b5c3-41e3-97b5-5c830e19c398 2024-09-04 16:32:15,524 - INFO - Pod ctest-pod-21299650 with uuid c06858c9-b5c3-41e3-97b5-5c830e19c398 found in kube manager 2024-09-04 16:32:15,524 - INFO - Pod ctest-pod-21299650 verification passed 2024-09-04 16:32:15,532 - INFO - Pod ctest-pod-00805145 is in running state.Got IP 10.47.255.250 2024-09-04 16:32:15,585 - DEBUG - Pod ctest-pod-00805145 has vmi 36c92454-6adb-11ef-84a2-fa163e4bbded 2024-09-04 16:32:15,585 - INFO - Verified pod ctest-pod-00805145 in contrail-api 2024-09-04 16:32:15,598 - DEBUG - VMI 36c92454-6adb-11ef-84a2-fa163e4bbded is active in agent 10.0.0.23 2024-09-04 16:32:15,598 - INFO - Verified Pod ctest-pod-00805145 in agent 10.0.0.23 2024-09-04 16:32:15,599 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_VirtualMachineDatabaseList?x=a761c575-4098-4901-97fe-ae8e147fcb9b 2024-09-04 16:32:15,604 - INFO - Pod ctest-pod-00805145 with uuid a761c575-4098-4901-97fe-ae8e147fcb9b found in kube manager 2024-09-04 16:32:15,606 - INFO - Pod ctest-pod-00805145 verification passed 2024-09-04 16:32:15,613 - INFO - Pod ctest-pod-25705932 is in running state.Got IP 10.47.255.249 2024-09-04 16:32:15,629 - DEBUG - Pod ctest-pod-25705932 has vmi 3767e940-6adb-11ef-84a2-fa163e4bbded 2024-09-04 16:32:15,629 - INFO - Verified pod ctest-pod-25705932 in contrail-api 2024-09-04 16:32:15,642 - DEBUG - VMI 3767e940-6adb-11ef-84a2-fa163e4bbded is active in agent 10.0.0.23 2024-09-04 16:32:15,643 - INFO - Verified Pod ctest-pod-25705932 in agent 10.0.0.23 2024-09-04 16:32:15,643 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_VirtualMachineDatabaseList?x=78f6a9f5-17c0-4404-a52b-dd3b835a9ead 2024-09-04 16:32:15,648 - INFO - Pod ctest-pod-25705932 with uuid 78f6a9f5-17c0-4404-a52b-dd3b835a9ead found in kube manager 2024-09-04 16:32:15,648 - INFO - Pod ctest-pod-25705932 verification passed 2024-09-04 16:32:15,654 - INFO - Pod ctest-pod-39708154 is in running state.Got IP 10.47.255.248 2024-09-04 16:32:15,709 - DEBUG - Pod ctest-pod-39708154 has vmi 37e37c5e-6adb-11ef-84a2-fa163e4bbded 2024-09-04 16:32:15,709 - INFO - Verified pod ctest-pod-39708154 in contrail-api 2024-09-04 16:32:15,724 - DEBUG - VMI 37e37c5e-6adb-11ef-84a2-fa163e4bbded is active in agent 10.0.0.23 2024-09-04 16:32:15,724 - INFO - Verified Pod ctest-pod-39708154 in agent 10.0.0.23 2024-09-04 16:32:15,724 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_VirtualMachineDatabaseList?x=7ee7ab56-5c36-4573-8617-748109fd1c04 2024-09-04 16:32:15,730 - INFO - Pod ctest-pod-39708154 with uuid 7ee7ab56-5c36-4573-8617-748109fd1c04 found in kube manager 2024-09-04 16:32:15,730 - INFO - Pod ctest-pod-39708154 verification passed 2024-09-04 16:32:15,736 - INFO - Pod ctest-pod-81269573 is in running state.Got IP 10.47.255.247 2024-09-04 16:32:15,790 - DEBUG - Pod ctest-pod-81269573 has vmi 386e99d8-6adb-11ef-84a2-fa163e4bbded 2024-09-04 16:32:15,790 - INFO - Verified pod ctest-pod-81269573 in contrail-api 2024-09-04 16:32:15,810 - DEBUG - VMI 386e99d8-6adb-11ef-84a2-fa163e4bbded is active in agent 10.0.0.23 2024-09-04 16:32:15,810 - INFO - Verified Pod ctest-pod-81269573 in agent 10.0.0.23 2024-09-04 16:32:15,811 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_VirtualMachineDatabaseList?x=aaa1597c-b3e4-4e0c-bc96-95f61eafd12e 2024-09-04 16:32:15,816 - INFO - Pod ctest-pod-81269573 with uuid aaa1597c-b3e4-4e0c-bc96-95f61eafd12e found in kube manager 2024-09-04 16:32:15,816 - INFO - Pod ctest-pod-81269573 verification passed 2024-09-04 16:32:15,823 - INFO - Pod ctest-pod-29209677 is in running state.Got IP 10.47.255.245 2024-09-04 16:32:15,836 - DEBUG - Pod ctest-pod-29209677 has vmi 394cfb7e-6adb-11ef-84a2-fa163e4bbded 2024-09-04 16:32:15,836 - INFO - Verified pod ctest-pod-29209677 in contrail-api 2024-09-04 16:32:15,852 - DEBUG - VMI 394cfb7e-6adb-11ef-84a2-fa163e4bbded is active in agent 10.0.0.23 2024-09-04 16:32:15,852 - INFO - Verified Pod ctest-pod-29209677 in agent 10.0.0.23 2024-09-04 16:32:15,852 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_VirtualMachineDatabaseList?x=8f7a31d5-3bc4-4ada-ba13-b9ef6f0e1ab1 2024-09-04 16:32:15,865 - INFO - Pod ctest-pod-29209677 with uuid 8f7a31d5-3bc4-4ada-ba13-b9ef6f0e1ab1 found in kube manager 2024-09-04 16:32:15,865 - INFO - Pod ctest-pod-29209677 verification passed 2024-09-04 16:32:15,871 - DEBUG - Pod ctest-pod-00164159 not in running state.Currently in Pending 2024-09-04 16:32:20,879 - INFO - Pod ctest-pod-00164159 is in running state.Got IP 10.47.255.246 2024-09-04 16:32:20,934 - DEBUG - Pod ctest-pod-00164159 has vmi 38e26a52-6adb-11ef-84a2-fa163e4bbded 2024-09-04 16:32:20,934 - INFO - Verified pod ctest-pod-00164159 in contrail-api 2024-09-04 16:32:20,947 - DEBUG - VMI 38e26a52-6adb-11ef-84a2-fa163e4bbded is active in agent 10.0.0.23 2024-09-04 16:32:20,947 - INFO - Verified Pod ctest-pod-00164159 in agent 10.0.0.23 2024-09-04 16:32:20,947 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_VirtualMachineDatabaseList?x=b47911e3-c591-40aa-b3b7-c4f0ffc6f542 2024-09-04 16:32:20,952 - INFO - Pod ctest-pod-00164159 with uuid b47911e3-c591-40aa-b3b7-c4f0ffc6f542 found in kube manager 2024-09-04 16:32:20,952 - INFO - Pod ctest-pod-00164159 verification passed 2024-09-04 16:32:20,958 - INFO - Pod ctest-pod-20580295 is in running state.Got IP 10.47.255.244 2024-09-04 16:32:20,968 - DEBUG - Pod ctest-pod-20580295 has vmi 39bb99da-6adb-11ef-84a2-fa163e4bbded 2024-09-04 16:32:20,968 - INFO - Verified pod ctest-pod-20580295 in contrail-api 2024-09-04 16:32:20,981 - DEBUG - VMI 39bb99da-6adb-11ef-84a2-fa163e4bbded is active in agent 10.0.0.23 2024-09-04 16:32:20,981 - INFO - Verified Pod ctest-pod-20580295 in agent 10.0.0.23 2024-09-04 16:32:20,981 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_VirtualMachineDatabaseList?x=dd11814c-e95f-4889-bc27-c463029e30bb 2024-09-04 16:32:20,986 - INFO - Pod ctest-pod-20580295 with uuid dd11814c-e95f-4889-bc27-c463029e30bb found in kube manager 2024-09-04 16:32:20,986 - INFO - Pod ctest-pod-20580295 verification passed 2024-09-04 16:32:20,986 - INFO - ================================================================================ 2024-09-04 16:32:20,986 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-09-04 16:32:20,986 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-09-04 16:32:21,224 - DEBUG - Nothing to compare xmpp stats {'10.0.0.23': {'10.0.0.28': '0'}} with 2024-09-04 16:32:21,224 - INFO - Initial checks done. Running the testcase now 2024-09-04 16:32:21,224 - INFO - 2024-09-04 16:32:21,291 - DEBUG - [Pod ctest-pod-21299650] Cmd: echo ctest-pod-21299650 > /usr/share/nginx/html/index.html, Output: 2024-09-04 16:32:21,356 - DEBUG - [Pod ctest-pod-00805145] Cmd: echo ctest-pod-00805145 > /usr/share/nginx/html/index.html, Output: 2024-09-04 16:32:21,417 - DEBUG - [Pod ctest-pod-25705932] Cmd: echo ctest-pod-25705932 > /usr/share/nginx/html/index.html, Output: 2024-09-04 16:32:21,475 - DEBUG - [Pod ctest-pod-39708154] Cmd: echo ctest-pod-39708154 > /usr/share/nginx/html/index.html, Output: 2024-09-04 16:32:21,479 - DEBUG - Service ctest-nginx-svc-97060677 not present 2024-09-04 16:32:21,479 - INFO - Creating service ctest-nginx-svc-97060677 2024-09-04 16:32:21,493 - INFO - Created Service ctest-nginx-svc-97060677 2024-09-04 16:32:21,511 - WARNING - Service UUID 7c5e2f21-a324-4b8e-8f10-dc35d5686aae not yet found in contrail-api 2024-09-04 16:32:22,518 - INFO - Validated that Service ctest-nginx-svc-97060677 is seen in contrail-api 2024-09-04 16:32:22,518 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_LoadbalancerDatabaseList?x=7c5e2f21-a324-4b8e-8f10-dc35d5686aae 2024-09-04 16:32:22,523 - INFO - Service ctest-nginx-svc-97060677 with uuid 7c5e2f21-a324-4b8e-8f10-dc35d5686aae found in kube manager 2024-09-04 16:32:22,523 - INFO - Service ctest-nginx-svc-97060677 verification passed 2024-09-04 16:32:23,587 - DEBUG - [Pod ctest-pod-81269573] Cmd: wget http://10.110.156.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.156.84:80 (10.110.156.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-21299650 2024-09-04 16:32:23,587 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd wget http://10.110.156.84:80/ -O - -T 5 -t 1 passed 2024-09-04 16:32:23,587 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd output: Connecting to 10.110.156.84:80 (10.110.156.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-21299650 2024-09-04 16:32:23,652 - DEBUG - [Pod ctest-pod-81269573] Cmd: wget http://10.110.156.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.156.84:80 (10.110.156.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-00805145 2024-09-04 16:32:23,652 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd wget http://10.110.156.84:80/ -O - -T 5 -t 1 passed 2024-09-04 16:32:23,652 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd output: Connecting to 10.110.156.84:80 (10.110.156.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-00805145 2024-09-04 16:32:23,652 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-21299650': 1, 'ctest-pod-00805145': 1} 2024-09-04 16:32:23,709 - DEBUG - [Pod ctest-pod-29209677] Cmd: wget http://10.110.156.84:80/ -O - -T 5 -t 1 , Output: ctest-pod-21299650 Connecting to 10.110.156.84:80 (10.110.156.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-04 16:32:23,709 - DEBUG - [Pod Pod ctest-pod-29209677] Cmd wget http://10.110.156.84:80/ -O - -T 5 -t 1 passed 2024-09-04 16:32:23,709 - DEBUG - [Pod Pod ctest-pod-29209677] Cmd output: ctest-pod-21299650 Connecting to 10.110.156.84:80 (10.110.156.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-04 16:32:23,767 - DEBUG - [Pod ctest-pod-29209677] Cmd: wget http://10.110.156.84:80/ -O - -T 5 -t 1 , Output: ctest-pod-00805145 Connecting to 10.110.156.84:80 (10.110.156.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-04 16:32:23,767 - DEBUG - [Pod Pod ctest-pod-29209677] Cmd wget http://10.110.156.84:80/ -O - -T 5 -t 1 passed 2024-09-04 16:32:23,767 - DEBUG - [Pod Pod ctest-pod-29209677] Cmd output: ctest-pod-00805145 Connecting to 10.110.156.84:80 (10.110.156.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-04 16:32:23,767 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-21299650': 1, 'ctest-pod-00805145': 1} 2024-09-04 16:32:23,773 - DEBUG - Network policy ingress-on-service not present 2024-09-04 16:32:23,773 - INFO - Creating Network Policy ingress-on-service 2024-09-04 16:32:23,802 - INFO - Network policy found in k8s 2024-09-04 16:32:23,802 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=6ba6a67a-d0bb-4952-a139-4d5b167de18b 2024-09-04 16:32:23,809 - INFO - Network Policy ingress-on-service with uuid 6ba6a67a-d0bb-4952-a139-4d5b167de18b found in kube manager 2024-09-04 16:32:23,843 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-09-04 16:32:23,843 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-09-04 16:32:23,844 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=6ba6a67a-d0bb-4952-a139-4d5b167de18b 2024-09-04 16:32:23,878 - WARNING - Network policy with name ingress-on-service not found in agent 2024-09-04 16:32:25,879 - DEBUG - Requesting: http://10.0.0.28:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=6ba6a67a-d0bb-4952-a139-4d5b167de18b 2024-09-04 16:32:25,914 - INFO - Network policy with name ingress-on-service found in agent 2024-09-04 16:32:25,914 - INFO - Network Policy ingress-on-service verification passed 2024-09-04 16:32:30,963 - DEBUG - [Pod ctest-pod-81269573] Cmd: wget http://10.110.156.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:32:30,964 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd wget http://10.110.156.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:32:30,964 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:32:36,011 - DEBUG - [Pod ctest-pod-81269573] Cmd: wget http://10.110.156.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:32:36,011 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd wget http://10.110.156.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:32:36,011 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:32:41,066 - DEBUG - [Pod ctest-pod-81269573] Cmd: wget http://10.110.156.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:32:41,066 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd wget http://10.110.156.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:32:41,066 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:32:46,130 - DEBUG - [Pod ctest-pod-81269573] Cmd: wget http://10.110.156.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:32:46,130 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd wget http://10.110.156.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:32:46,130 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:32:51,194 - DEBUG - [Pod ctest-pod-81269573] Cmd: wget http://10.110.156.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:32:51,194 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd wget http://10.110.156.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:32:51,195 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:32:56,252 - DEBUG - [Pod ctest-pod-81269573] Cmd: wget http://10.110.156.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:32:56,252 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd wget http://10.110.156.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:32:56,252 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:33:01,302 - DEBUG - [Pod ctest-pod-81269573] Cmd: wget http://10.110.156.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:33:01,303 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd wget http://10.110.156.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:33:01,303 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:33:06,371 - DEBUG - [Pod ctest-pod-81269573] Cmd: wget http://10.110.156.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:33:06,371 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd wget http://10.110.156.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:33:06,371 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:33:11,431 - DEBUG - [Pod ctest-pod-81269573] Cmd: wget http://10.110.156.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:33:11,431 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd wget http://10.110.156.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:33:11,431 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:33:16,493 - DEBUG - [Pod ctest-pod-81269573] Cmd: wget http://10.110.156.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:33:16,493 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd wget http://10.110.156.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:33:16,493 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:33:16,493 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-21299650': 0, 'ctest-pod-00805145': 0} 2024-09-04 16:33:16,570 - DEBUG - [Pod ctest-pod-00164159] Cmd: wget http://10.110.156.84:80/ -O - -T 5 -t 1 , Output: ctest-pod-21299650 Connecting to 10.110.156.84:80 (10.110.156.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-04 16:33:16,570 - DEBUG - [Pod Pod ctest-pod-00164159] Cmd wget http://10.110.156.84:80/ -O - -T 5 -t 1 passed 2024-09-04 16:33:16,570 - DEBUG - [Pod Pod ctest-pod-00164159] Cmd output: ctest-pod-21299650 Connecting to 10.110.156.84:80 (10.110.156.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-04 16:33:16,633 - DEBUG - [Pod ctest-pod-00164159] Cmd: wget http://10.110.156.84:80/ -O - -T 5 -t 1 , Output: ctest-pod-21299650 Connecting to 10.110.156.84:80 (10.110.156.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-04 16:33:16,633 - DEBUG - [Pod Pod ctest-pod-00164159] Cmd wget http://10.110.156.84:80/ -O - -T 5 -t 1 passed 2024-09-04 16:33:16,633 - DEBUG - [Pod Pod ctest-pod-00164159] Cmd output: ctest-pod-21299650 Connecting to 10.110.156.84:80 (10.110.156.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-04 16:33:16,687 - DEBUG - [Pod ctest-pod-00164159] Cmd: wget http://10.110.156.84:80/ -O - -T 5 -t 1 , Output: ctest-pod-21299650 Connecting to 10.110.156.84:80 (10.110.156.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-04 16:33:16,687 - DEBUG - [Pod Pod ctest-pod-00164159] Cmd wget http://10.110.156.84:80/ -O - -T 5 -t 1 passed 2024-09-04 16:33:16,687 - DEBUG - [Pod Pod ctest-pod-00164159] Cmd output: ctest-pod-21299650 Connecting to 10.110.156.84:80 (10.110.156.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-04 16:33:16,745 - DEBUG - [Pod ctest-pod-00164159] Cmd: wget http://10.110.156.84:80/ -O - -T 5 -t 1 , Output: ctest-pod-21299650 Connecting to 10.110.156.84:80 (10.110.156.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-04 16:33:16,745 - DEBUG - [Pod Pod ctest-pod-00164159] Cmd wget http://10.110.156.84:80/ -O - -T 5 -t 1 passed 2024-09-04 16:33:16,745 - DEBUG - [Pod Pod ctest-pod-00164159] Cmd output: ctest-pod-21299650 Connecting to 10.110.156.84:80 (10.110.156.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-04 16:33:16,807 - DEBUG - [Pod ctest-pod-00164159] Cmd: wget http://10.110.156.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.156.84:80 (10.110.156.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-21299650 2024-09-04 16:33:16,807 - DEBUG - [Pod Pod ctest-pod-00164159] Cmd wget http://10.110.156.84:80/ -O - -T 5 -t 1 passed 2024-09-04 16:33:16,808 - DEBUG - [Pod Pod ctest-pod-00164159] Cmd output: Connecting to 10.110.156.84:80 (10.110.156.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-21299650 2024-09-04 16:33:16,860 - DEBUG - [Pod ctest-pod-00164159] Cmd: wget http://10.110.156.84:80/ -O - -T 5 -t 1 , Output: ctest-pod-00805145 Connecting to 10.110.156.84:80 (10.110.156.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-04 16:33:16,860 - DEBUG - [Pod Pod ctest-pod-00164159] Cmd wget http://10.110.156.84:80/ -O - -T 5 -t 1 passed 2024-09-04 16:33:16,860 - DEBUG - [Pod Pod ctest-pod-00164159] Cmd output: ctest-pod-00805145 Connecting to 10.110.156.84:80 (10.110.156.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-04 16:33:16,860 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-21299650': 5, 'ctest-pod-00805145': 1} 2024-09-04 16:33:21,926 - DEBUG - [Pod ctest-pod-29209677] Cmd: wget http://10.110.156.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:33:21,926 - DEBUG - [Pod Pod ctest-pod-29209677] Cmd wget http://10.110.156.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:33:21,926 - DEBUG - [Pod Pod ctest-pod-29209677] Cmd output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:33:26,987 - DEBUG - [Pod ctest-pod-29209677] Cmd: wget http://10.110.156.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:33:26,987 - DEBUG - [Pod Pod ctest-pod-29209677] Cmd wget http://10.110.156.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:33:26,987 - DEBUG - [Pod Pod ctest-pod-29209677] Cmd output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:33:32,034 - DEBUG - [Pod ctest-pod-29209677] Cmd: wget http://10.110.156.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:33:32,034 - DEBUG - [Pod Pod ctest-pod-29209677] Cmd wget http://10.110.156.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:33:32,035 - DEBUG - [Pod Pod ctest-pod-29209677] Cmd output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:33:37,094 - DEBUG - [Pod ctest-pod-29209677] Cmd: wget http://10.110.156.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:33:37,094 - DEBUG - [Pod Pod ctest-pod-29209677] Cmd wget http://10.110.156.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:33:37,094 - DEBUG - [Pod Pod ctest-pod-29209677] Cmd output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:33:42,159 - DEBUG - [Pod ctest-pod-29209677] Cmd: wget http://10.110.156.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:33:42,159 - DEBUG - [Pod Pod ctest-pod-29209677] Cmd wget http://10.110.156.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:33:42,159 - DEBUG - [Pod Pod ctest-pod-29209677] Cmd output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:33:47,234 - DEBUG - [Pod ctest-pod-29209677] Cmd: wget http://10.110.156.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:33:47,234 - DEBUG - [Pod Pod ctest-pod-29209677] Cmd wget http://10.110.156.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:33:47,234 - DEBUG - [Pod Pod ctest-pod-29209677] Cmd output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:33:52,291 - DEBUG - [Pod ctest-pod-29209677] Cmd: wget http://10.110.156.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:33:52,291 - DEBUG - [Pod Pod ctest-pod-29209677] Cmd wget http://10.110.156.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:33:52,291 - DEBUG - [Pod Pod ctest-pod-29209677] Cmd output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:33:57,343 - DEBUG - [Pod ctest-pod-29209677] Cmd: wget http://10.110.156.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:33:57,343 - DEBUG - [Pod Pod ctest-pod-29209677] Cmd wget http://10.110.156.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:33:57,343 - DEBUG - [Pod Pod ctest-pod-29209677] Cmd output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:34:02,402 - DEBUG - [Pod ctest-pod-29209677] Cmd: wget http://10.110.156.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:34:02,403 - DEBUG - [Pod Pod ctest-pod-29209677] Cmd wget http://10.110.156.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:34:02,403 - DEBUG - [Pod Pod ctest-pod-29209677] Cmd output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:34:07,471 - DEBUG - [Pod ctest-pod-29209677] Cmd: wget http://10.110.156.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:34:07,471 - DEBUG - [Pod Pod ctest-pod-29209677] Cmd wget http://10.110.156.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:34:07,471 - DEBUG - [Pod Pod ctest-pod-29209677] Cmd output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:34:07,471 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-21299650': 0, 'ctest-pod-00805145': 0} 2024-09-04 16:34:09,526 - DEBUG - [Pod ctest-pod-00164159] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.791 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.067 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.081 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.067/0.313/0.791 ms 2024-09-04 16:34:09,526 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-00164159 with expectation True passed 2024-09-04 16:34:11,578 - DEBUG - [Pod ctest-pod-81269573] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.504 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.066 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.069 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.066/0.213/0.504 ms 2024-09-04 16:34:11,578 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-81269573 with expectation True passed 2024-09-04 16:34:13,634 - DEBUG - [Pod ctest-pod-29209677] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.244 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.060 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.068 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.060/0.457/1.244 ms 2024-09-04 16:34:13,634 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-29209677 with expectation True passed 2024-09-04 16:34:13,688 - DEBUG - [Pod ctest-pod-00164159] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-04 16:34:13,689 - DEBUG - [Pod Pod ctest-pod-00164159] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-04 16:34:13,689 - DEBUG - [Pod Pod ctest-pod-00164159] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-04 16:34:13,689 - INFO - wget check of of http://10.47.255.251 from ctest-pod-00164159 passed 2024-09-04 16:34:13,739 - DEBUG - [Pod ctest-pod-00164159] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-04 16:34:13,739 - DEBUG - [Pod Pod ctest-pod-00164159] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-09-04 16:34:13,739 - DEBUG - [Pod Pod ctest-pod-00164159] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-04 16:34:13,739 - INFO - wget check of of http://10.47.255.250 from ctest-pod-00164159 passed 2024-09-04 16:34:18,790 - DEBUG - [Pod ctest-pod-81269573] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-04 16:34:18,790 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-04 16:34:18,790 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-04 16:34:18,790 - INFO - wget check of of http://10.47.255.250 from ctest-pod-81269573 passed 2024-09-04 16:34:23,854 - DEBUG - [Pod ctest-pod-20580295] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-04 16:34:23,854 - DEBUG - [Pod Pod ctest-pod-20580295] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-04 16:34:23,854 - DEBUG - [Pod Pod ctest-pod-20580295] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-04 16:34:23,854 - INFO - wget check of of http://10.47.255.251 from ctest-pod-20580295 passed 2024-09-04 16:34:23,862 - INFO - Updating Network Policy ingress-on-service 2024-09-04 16:34:28,978 - DEBUG - [Pod ctest-pod-81269573] Cmd: wget http://10.110.156.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:34:28,978 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd wget http://10.110.156.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:34:28,979 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:34:34,046 - DEBUG - [Pod ctest-pod-81269573] Cmd: wget http://10.110.156.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:34:34,047 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd wget http://10.110.156.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:34:34,047 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:34:39,111 - DEBUG - [Pod ctest-pod-81269573] Cmd: wget http://10.110.156.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:34:39,111 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd wget http://10.110.156.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:34:39,111 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:34:44,162 - DEBUG - [Pod ctest-pod-81269573] Cmd: wget http://10.110.156.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:34:44,162 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd wget http://10.110.156.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:34:44,162 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:34:49,215 - DEBUG - [Pod ctest-pod-81269573] Cmd: wget http://10.110.156.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:34:49,215 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd wget http://10.110.156.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:34:49,215 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:34:54,277 - DEBUG - [Pod ctest-pod-81269573] Cmd: wget http://10.110.156.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:34:54,277 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd wget http://10.110.156.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:34:54,277 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:34:59,335 - DEBUG - [Pod ctest-pod-81269573] Cmd: wget http://10.110.156.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:34:59,336 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd wget http://10.110.156.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:34:59,336 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:35:04,398 - DEBUG - [Pod ctest-pod-81269573] Cmd: wget http://10.110.156.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:35:04,398 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd wget http://10.110.156.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:35:04,398 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:35:09,458 - DEBUG - [Pod ctest-pod-81269573] Cmd: wget http://10.110.156.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:35:09,458 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd wget http://10.110.156.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:35:09,458 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:35:14,515 - DEBUG - [Pod ctest-pod-81269573] Cmd: wget http://10.110.156.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:35:14,515 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd wget http://10.110.156.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:35:14,515 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd output: Connecting to 10.110.156.84:80 (10.110.156.84:80) wget: download timed out 2024-09-04 16:35:14,515 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-21299650': 0, 'ctest-pod-00805145': 0} 2024-09-04 16:35:14,575 - DEBUG - [Pod ctest-pod-00164159] Cmd: wget http://10.110.156.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.156.84:80 (10.110.156.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-21299650 2024-09-04 16:35:14,576 - DEBUG - [Pod Pod ctest-pod-00164159] Cmd wget http://10.110.156.84:80/ -O - -T 5 -t 1 passed 2024-09-04 16:35:14,576 - DEBUG - [Pod Pod ctest-pod-00164159] Cmd output: Connecting to 10.110.156.84:80 (10.110.156.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-21299650 2024-09-04 16:35:14,629 - DEBUG - [Pod ctest-pod-00164159] Cmd: wget http://10.110.156.84:80/ -O - -T 5 -t 1 , Output: ctest-pod-21299650 Connecting to 10.110.156.84:80 (10.110.156.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-04 16:35:14,629 - DEBUG - [Pod Pod ctest-pod-00164159] Cmd wget http://10.110.156.84:80/ -O - -T 5 -t 1 passed 2024-09-04 16:35:14,629 - DEBUG - [Pod Pod ctest-pod-00164159] Cmd output: ctest-pod-21299650 Connecting to 10.110.156.84:80 (10.110.156.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-04 16:35:14,686 - DEBUG - [Pod ctest-pod-00164159] Cmd: wget http://10.110.156.84:80/ -O - -T 5 -t 1 , Output: ctest-pod-00805145 Connecting to 10.110.156.84:80 (10.110.156.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-04 16:35:14,686 - DEBUG - [Pod Pod ctest-pod-00164159] Cmd wget http://10.110.156.84:80/ -O - -T 5 -t 1 passed 2024-09-04 16:35:14,687 - DEBUG - [Pod Pod ctest-pod-00164159] Cmd output: ctest-pod-00805145 Connecting to 10.110.156.84:80 (10.110.156.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-04 16:35:14,687 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-21299650': 2, 'ctest-pod-00805145': 1} 2024-09-04 16:35:14,755 - DEBUG - [Pod ctest-pod-29209677] Cmd: wget http://10.110.156.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.156.84:80 (10.110.156.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-00805145 2024-09-04 16:35:14,755 - DEBUG - [Pod Pod ctest-pod-29209677] Cmd wget http://10.110.156.84:80/ -O - -T 5 -t 1 passed 2024-09-04 16:35:14,755 - DEBUG - [Pod Pod ctest-pod-29209677] Cmd output: Connecting to 10.110.156.84:80 (10.110.156.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-00805145 2024-09-04 16:35:14,819 - DEBUG - [Pod ctest-pod-29209677] Cmd: wget http://10.110.156.84:80/ -O - -T 5 -t 1 , Output: ctest-pod-21299650 Connecting to 10.110.156.84:80 (10.110.156.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-04 16:35:14,819 - DEBUG - [Pod Pod ctest-pod-29209677] Cmd wget http://10.110.156.84:80/ -O - -T 5 -t 1 passed 2024-09-04 16:35:14,819 - DEBUG - [Pod Pod ctest-pod-29209677] Cmd output: ctest-pod-21299650 Connecting to 10.110.156.84:80 (10.110.156.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-04 16:35:14,819 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-21299650': 1, 'ctest-pod-00805145': 1} 2024-09-04 16:35:16,867 - DEBUG - [Pod ctest-pod-00164159] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.052 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.078 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.084 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.052/0.071/0.084 ms 2024-09-04 16:35:16,867 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-00164159 with expectation True passed 2024-09-04 16:35:18,930 - DEBUG - [Pod ctest-pod-81269573] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.366 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.059 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.080 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.059/0.168/0.366 ms 2024-09-04 16:35:18,930 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-81269573 with expectation True passed 2024-09-04 16:35:20,983 - DEBUG - [Pod ctest-pod-29209677] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.583 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.068 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.074 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.068/0.241/0.583 ms 2024-09-04 16:35:20,984 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-29209677 with expectation True passed 2024-09-04 16:35:21,045 - DEBUG - [Pod ctest-pod-00164159] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-04 16:35:21,045 - DEBUG - [Pod Pod ctest-pod-00164159] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-04 16:35:21,045 - DEBUG - [Pod Pod ctest-pod-00164159] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-04 16:35:21,045 - INFO - wget check of of http://10.47.255.251 from ctest-pod-00164159 passed 2024-09-04 16:35:21,112 - DEBUG - [Pod ctest-pod-00164159] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-04 16:35:21,112 - DEBUG - [Pod Pod ctest-pod-00164159] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-09-04 16:35:21,112 - DEBUG - [Pod Pod ctest-pod-00164159] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-04 16:35:21,112 - INFO - wget check of of http://10.47.255.250 from ctest-pod-00164159 passed 2024-09-04 16:35:26,149 - DEBUG - [Pod ctest-pod-81269573] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-04 16:35:26,149 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-04 16:35:26,149 - DEBUG - [Pod Pod ctest-pod-81269573] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-04 16:35:26,149 - INFO - wget check of of http://10.47.255.250 from ctest-pod-81269573 passed 2024-09-04 16:35:26,213 - DEBUG - [Pod ctest-pod-20580295] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-04 16:35:26,213 - DEBUG - [Pod Pod ctest-pod-20580295] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-04 16:35:26,213 - DEBUG - [Pod Pod ctest-pod-20580295] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-04 16:35:26,213 - INFO - wget check of of http://10.47.255.251 from ctest-pod-20580295 passed 2024-09-04 16:35:26,213 - INFO - Deleting Network Policy : ingress-on-service 2024-09-04 16:35:26,214 - INFO - Deleting service : ctest-nginx-svc-97060677 2024-09-04 16:35:26,457 - DEBUG - No XMPP flaps were noticed during the test
2024-09-04 16:35:26,458 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:06]
2024-09-04 16:35:26,458 - INFO - -------------------------------------------------------------------------------- 2024-09-04 16:35:26,463 - INFO - Deleting pod ctest-new-default-26605473:ctest-pod-21299650 2024-09-04 16:35:26,464 - INFO - Deleting pod ctest-new-default-26605473:ctest-pod-00805145 2024-09-04 16:35:26,465 - INFO - Deleting pod ctest-non-default-21356343:ctest-pod-25705932 2024-09-04 16:35:26,465 - INFO - Deleting pod ctest-non-default-21356343:ctest-pod-39708154 2024-09-04 16:35:26,465 - INFO - Deleting pod ctest-new-default-26605473:ctest-pod-81269573 2024-09-04 16:35:26,466 - INFO - Deleting pod ctest-new-default-26605473:ctest-pod-00164159 2024-09-04 16:35:26,466 - INFO - Deleting pod ctest-non-default-21356343:ctest-pod-29209677 2024-09-04 16:35:26,467 - INFO - Deleting pod ctest-non-default-21356343:ctest-pod-20580295 2024-09-04 16:35:26,538 - WARNING - Pod uuid c06858c9-b5c3-41e3-97b5-5c830e19c398 is still seen in agent 10.0.0.23 VM list 2024-09-04 16:35:26,568 - WARNING - Pod uuid 7ee7ab56-5c36-4573-8617-748109fd1c04 is still seen in agent 10.0.0.23 VM list 2024-09-04 16:35:26,570 - WARNING - Pod uuid b47911e3-c591-40aa-b3b7-c4f0ffc6f542 is still seen in agent 10.0.0.23 VM list 2024-09-04 16:35:26,617 - WARNING - Pod uuid 8f7a31d5-3bc4-4ada-ba13-b9ef6f0e1ab1 is still seen in agent 10.0.0.23 VM list 2024-09-04 16:35:26,618 - WARNING - Pod uuid aaa1597c-b3e4-4e0c-bc96-95f61eafd12e is still seen in agent 10.0.0.23 VM list 2024-09-04 16:35:26,618 - WARNING - Pod uuid a761c575-4098-4901-97fe-ae8e147fcb9b is still seen in agent 10.0.0.23 VM list 2024-09-04 16:35:26,620 - WARNING - Pod uuid 78f6a9f5-17c0-4404-a52b-dd3b835a9ead is still seen in agent 10.0.0.23 VM list 2024-09-04 16:35:26,621 - WARNING - Pod uuid dd11814c-e95f-4889-bc27-c463029e30bb is still seen in agent 10.0.0.23 VM list 2024-09-04 16:35:31,546 - DEBUG - Pod c06858c9-b5c3-41e3-97b5-5c830e19c398 is not in agent 10.0.0.23 VM list 2024-09-04 16:35:31,552 - DEBUG - VMI 364cd0b6-6adb-11ef-84a2-fa163e4bbded is removed from agent 10.0.0.23 2024-09-04 16:35:31,552 - INFO - Verified that pod ctest-pod-21299650 is removed in agent 2024-09-04 16:35:31,580 - DEBUG - Pod 7ee7ab56-5c36-4573-8617-748109fd1c04 is not in agent 10.0.0.23 VM list 2024-09-04 16:35:31,583 - WARNING - Pod uuid b47911e3-c591-40aa-b3b7-c4f0ffc6f542 is still seen in agent 10.0.0.23 VM list 2024-09-04 16:35:31,588 - DEBUG - VMI 37e37c5e-6adb-11ef-84a2-fa163e4bbded is removed from agent 10.0.0.23 2024-09-04 16:35:31,588 - INFO - Verified that pod ctest-pod-39708154 is removed in agent 2024-09-04 16:35:31,640 - WARNING - Pod uuid aaa1597c-b3e4-4e0c-bc96-95f61eafd12e is still seen in agent 10.0.0.23 VM list 2024-09-04 16:35:31,642 - DEBUG - Pod 78f6a9f5-17c0-4404-a52b-dd3b835a9ead is not in agent 10.0.0.23 VM list 2024-09-04 16:35:31,644 - DEBUG - Pod a761c575-4098-4901-97fe-ae8e147fcb9b is not in agent 10.0.0.23 VM list 2024-09-04 16:35:31,645 - WARNING - Pod uuid dd11814c-e95f-4889-bc27-c463029e30bb is still seen in agent 10.0.0.23 VM list 2024-09-04 16:35:31,646 - WARNING - Pod uuid 8f7a31d5-3bc4-4ada-ba13-b9ef6f0e1ab1 is still seen in agent 10.0.0.23 VM list 2024-09-04 16:35:31,654 - DEBUG - VMI 36c92454-6adb-11ef-84a2-fa163e4bbded is removed from agent 10.0.0.23 2024-09-04 16:35:31,654 - INFO - Verified that pod ctest-pod-00805145 is removed in agent 2024-09-04 16:35:31,655 - DEBUG - VMI 3767e940-6adb-11ef-84a2-fa163e4bbded is removed from agent 10.0.0.23 2024-09-04 16:35:31,655 - INFO - Verified that pod ctest-pod-25705932 is removed in agent 2024-09-04 16:35:36,590 - WARNING - Pod uuid b47911e3-c591-40aa-b3b7-c4f0ffc6f542 is still seen in agent 10.0.0.23 VM list 2024-09-04 16:35:36,650 - WARNING - Pod uuid aaa1597c-b3e4-4e0c-bc96-95f61eafd12e is still seen in agent 10.0.0.23 VM list 2024-09-04 16:35:36,657 - WARNING - Pod uuid dd11814c-e95f-4889-bc27-c463029e30bb is still seen in agent 10.0.0.23 VM list 2024-09-04 16:35:36,658 - WARNING - Pod uuid 8f7a31d5-3bc4-4ada-ba13-b9ef6f0e1ab1 is still seen in agent 10.0.0.23 VM list 2024-09-04 16:35:41,598 - WARNING - Pod uuid b47911e3-c591-40aa-b3b7-c4f0ffc6f542 is still seen in agent 10.0.0.23 VM list 2024-09-04 16:35:41,658 - WARNING - Pod uuid aaa1597c-b3e4-4e0c-bc96-95f61eafd12e is still seen in agent 10.0.0.23 VM list 2024-09-04 16:35:41,670 - WARNING - Pod uuid 8f7a31d5-3bc4-4ada-ba13-b9ef6f0e1ab1 is still seen in agent 10.0.0.23 VM list 2024-09-04 16:35:41,672 - WARNING - Pod uuid dd11814c-e95f-4889-bc27-c463029e30bb is still seen in agent 10.0.0.23 VM list 2024-09-04 16:35:46,606 - WARNING - Pod uuid b47911e3-c591-40aa-b3b7-c4f0ffc6f542 is still seen in agent 10.0.0.23 VM list 2024-09-04 16:35:46,668 - WARNING - Pod uuid aaa1597c-b3e4-4e0c-bc96-95f61eafd12e is still seen in agent 10.0.0.23 VM list 2024-09-04 16:35:46,682 - WARNING - Pod uuid 8f7a31d5-3bc4-4ada-ba13-b9ef6f0e1ab1 is still seen in agent 10.0.0.23 VM list 2024-09-04 16:35:46,684 - WARNING - Pod uuid dd11814c-e95f-4889-bc27-c463029e30bb is still seen in agent 10.0.0.23 VM list 2024-09-04 16:35:51,616 - WARNING - Pod uuid b47911e3-c591-40aa-b3b7-c4f0ffc6f542 is still seen in agent 10.0.0.23 VM list 2024-09-04 16:35:51,675 - WARNING - Pod uuid aaa1597c-b3e4-4e0c-bc96-95f61eafd12e is still seen in agent 10.0.0.23 VM list 2024-09-04 16:35:51,694 - WARNING - Pod uuid 8f7a31d5-3bc4-4ada-ba13-b9ef6f0e1ab1 is still seen in agent 10.0.0.23 VM list 2024-09-04 16:35:51,695 - WARNING - Pod uuid dd11814c-e95f-4889-bc27-c463029e30bb is still seen in agent 10.0.0.23 VM list 2024-09-04 16:35:56,625 - WARNING - Pod uuid b47911e3-c591-40aa-b3b7-c4f0ffc6f542 is still seen in agent 10.0.0.23 VM list 2024-09-04 16:35:56,684 - WARNING - Pod uuid aaa1597c-b3e4-4e0c-bc96-95f61eafd12e is still seen in agent 10.0.0.23 VM list 2024-09-04 16:35:56,709 - WARNING - Pod uuid 8f7a31d5-3bc4-4ada-ba13-b9ef6f0e1ab1 is still seen in agent 10.0.0.23 VM list 2024-09-04 16:35:56,710 - WARNING - Pod uuid dd11814c-e95f-4889-bc27-c463029e30bb is still seen in agent 10.0.0.23 VM list 2024-09-04 16:36:01,634 - DEBUG - Pod b47911e3-c591-40aa-b3b7-c4f0ffc6f542 is not in agent 10.0.0.23 VM list 2024-09-04 16:36:01,640 - DEBUG - VMI 38e26a52-6adb-11ef-84a2-fa163e4bbded is removed from agent 10.0.0.23 2024-09-04 16:36:01,640 - INFO - Verified that pod ctest-pod-00164159 is removed in agent 2024-09-04 16:36:01,692 - DEBUG - Pod aaa1597c-b3e4-4e0c-bc96-95f61eafd12e is not in agent 10.0.0.23 VM list 2024-09-04 16:36:01,698 - DEBUG - VMI 386e99d8-6adb-11ef-84a2-fa163e4bbded is removed from agent 10.0.0.23 2024-09-04 16:36:01,698 - INFO - Verified that pod ctest-pod-81269573 is removed in agent 2024-09-04 16:36:01,720 - DEBUG - Pod 8f7a31d5-3bc4-4ada-ba13-b9ef6f0e1ab1 is not in agent 10.0.0.23 VM list 2024-09-04 16:36:01,723 - DEBUG - Pod dd11814c-e95f-4889-bc27-c463029e30bb is not in agent 10.0.0.23 VM list 2024-09-04 16:36:01,731 - DEBUG - VMI 39bb99da-6adb-11ef-84a2-fa163e4bbded is removed from agent 10.0.0.23 2024-09-04 16:36:01,731 - INFO - Verified that pod ctest-pod-20580295 is removed in agent 2024-09-04 16:36:01,732 - DEBUG - VMI 394cfb7e-6adb-11ef-84a2-fa163e4bbded is removed from agent 10.0.0.23 2024-09-04 16:36:01,732 - INFO - Verified that pod ctest-pod-29209677 is removed in agent 2024-09-04 16:36:01,733 - INFO - Deleting namespace ctest-non-default-21356343 2024-09-04 16:36:01,753 - DEBUG - Namespace ctest-non-default-21356343 still in k8s 2024-09-04 16:36:03,759 - DEBUG - Namespace ctest-non-default-21356343 still in k8s 2024-09-04 16:36:05,765 - DEBUG - Namespace ctest-non-default-21356343 still in k8s 2024-09-04 16:36:07,770 - DEBUG - Namespace ctest-non-default-21356343 is not in k8s 2024-09-04 16:36:07,770 - DEBUG - No need to check project deletion in contrail-api 2024-09-04 16:36:07,770 - INFO - Deleting namespace ctest-new-default-26605473 2024-09-04 16:36:07,788 - DEBUG - Namespace ctest-new-default-26605473 still in k8s 2024-09-04 16:36:09,793 - DEBUG - Namespace ctest-new-default-26605473 still in k8s 2024-09-04 16:36:11,798 - DEBUG - Namespace ctest-new-default-26605473 still in k8s 2024-09-04 16:36:13,802 - DEBUG - Namespace ctest-new-default-26605473 is not in k8s 2024-09-04 16:36:13,802 - DEBUG - No need to check project deletion in contrail-api