2025-01-02 02:00:58,551 - INFO - Using existing project ['default-domain', 'k8s-default'](86619d0f-991a-4a01-b03d-303415542cfa) 2025-01-02 02:00:58,568 - DEBUG - Namespace ctest-new-default-69911789 not present 2025-01-02 02:00:58,578 - INFO - Created namespace ctest-new-default-69911789 2025-01-02 02:01:01,584 - DEBUG - Namespace ctest-non-default-32944550 not present 2025-01-02 02:01:01,598 - INFO - Created namespace ctest-non-default-32944550 2025-01-02 02:01:04,618 - DEBUG - Pod ctest-pod-93481025 not present 2025-01-02 02:01:04,619 - INFO - Creating Pod ctest-pod-93481025 2025-01-02 02:01:04,647 - DEBUG - Pod : ctest-pod-93481025 UUID is 0478699f-c4e2-4fa8-a8e3-dfc64008d6d0 2025-01-02 02:01:04,651 - DEBUG - Pod ctest-pod-47852454 not present 2025-01-02 02:01:04,651 - INFO - Creating Pod ctest-pod-47852454 2025-01-02 02:01:04,702 - DEBUG - Pod : ctest-pod-47852454 UUID is 7a5a8262-6a7a-4e9d-ab0e-9c5086f1bc09 2025-01-02 02:01:04,705 - DEBUG - Pod ctest-pod-41194611 not present 2025-01-02 02:01:04,705 - INFO - Creating Pod ctest-pod-41194611 2025-01-02 02:01:04,746 - DEBUG - Pod : ctest-pod-41194611 UUID is 1c27e55f-5909-426b-8ce3-fed3e26aafb5 2025-01-02 02:01:04,749 - DEBUG - Pod ctest-pod-66793918 not present 2025-01-02 02:01:04,749 - INFO - Creating Pod ctest-pod-66793918 2025-01-02 02:01:04,781 - DEBUG - Pod : ctest-pod-66793918 UUID is 65a74910-630b-4395-85ea-8b174088ca45 2025-01-02 02:01:04,784 - DEBUG - Pod ctest-pod-43910357 not present 2025-01-02 02:01:04,784 - INFO - Creating Pod ctest-pod-43910357 2025-01-02 02:01:04,807 - DEBUG - Pod : ctest-pod-43910357 UUID is 16f31014-088b-49ce-8670-05e3aa2b459b 2025-01-02 02:01:04,808 - DEBUG - Pod ctest-pod-78743409 not present 2025-01-02 02:01:04,809 - INFO - Creating Pod ctest-pod-78743409 2025-01-02 02:01:04,825 - DEBUG - Pod : ctest-pod-78743409 UUID is 6ff66893-d712-4186-adef-76125d9a99ec 2025-01-02 02:01:04,828 - DEBUG - Pod ctest-pod-49740823 not present 2025-01-02 02:01:04,828 - INFO - Creating Pod ctest-pod-49740823 2025-01-02 02:01:04,844 - DEBUG - Pod : ctest-pod-49740823 UUID is c84d3406-fbcd-4d74-b2dc-0797d9542204 2025-01-02 02:01:04,847 - DEBUG - Pod ctest-pod-66554395 not present 2025-01-02 02:01:04,847 - INFO - Creating Pod ctest-pod-66554395 2025-01-02 02:01:04,868 - DEBUG - Pod : ctest-pod-66554395 UUID is 8eea0049-639a-4a09-b92f-9299a43d02d9 2025-01-02 02:01:05,043 - INFO - Project default-domain:k8s-ctest-new-default-69911789 for Namespace ctest-new-default-69911789 is seen in contrail-api 2025-01-02 02:01:05,044 - DEBUG - Project uuid in Contrail is 9fa39729-de08-4644-84f4-182a55cb08f5 2025-01-02 02:01:05,164 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NamespaceDatabaseList?namespace_uuid=be0685a6-97a1-4760-ac0b-0ae2b37ebfcb 2025-01-02 02:01:05,168 - INFO - Namespace ctest-new-default-69911789 with uuid be0685a6-97a1-4760-ac0b-0ae2b37ebfcb found in kube manager 2025-01-02 02:01:05,168 - INFO - Namespace ctest-new-default-69911789 verification passed 2025-01-02 02:01:05,423 - INFO - Project default-domain:k8s-ctest-non-default-32944550 for Namespace ctest-non-default-32944550 is seen in contrail-api 2025-01-02 02:01:05,424 - DEBUG - Project uuid in Contrail is e76c6eb6-2883-4eed-90c3-0f7db3a492da 2025-01-02 02:01:05,424 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NamespaceDatabaseList?namespace_uuid=90931541-a70c-4a39-a287-f1604cfba2ec 2025-01-02 02:01:05,428 - INFO - Namespace ctest-non-default-32944550 with uuid 90931541-a70c-4a39-a287-f1604cfba2ec found in kube manager 2025-01-02 02:01:05,428 - INFO - Namespace ctest-non-default-32944550 verification passed 2025-01-02 02:01:05,434 - DEBUG - Pod ctest-pod-93481025 not in running state.Currently in Pending 2025-01-02 02:01:10,441 - DEBUG - Pod ctest-pod-93481025 not in running state.Currently in Pending 2025-01-02 02:01:15,447 - DEBUG - Pod ctest-pod-93481025 not in running state.Currently in Pending 2025-01-02 02:01:20,455 - INFO - Pod ctest-pod-93481025 is in running state.Got IP 10.47.255.251 2025-01-02 02:01:20,469 - DEBUG - Pod ctest-pod-93481025 has vmi 6d9a0112-c8ad-11ef-887d-fa163ec5728a 2025-01-02 02:01:20,469 - INFO - Verified pod ctest-pod-93481025 in contrail-api 2025-01-02 02:01:20,484 - DEBUG - VMI 6d9a0112-c8ad-11ef-887d-fa163ec5728a is active in agent 10.0.0.45 2025-01-02 02:01:20,484 - INFO - Verified Pod ctest-pod-93481025 in agent 10.0.0.45 2025-01-02 02:01:20,484 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=0478699f-c4e2-4fa8-a8e3-dfc64008d6d0 2025-01-02 02:01:20,488 - INFO - Pod ctest-pod-93481025 with uuid 0478699f-c4e2-4fa8-a8e3-dfc64008d6d0 found in kube manager 2025-01-02 02:01:20,488 - INFO - Pod ctest-pod-93481025 verification passed 2025-01-02 02:01:20,493 - INFO - Pod ctest-pod-47852454 is in running state.Got IP 10.47.255.250 2025-01-02 02:01:20,551 - DEBUG - Pod ctest-pod-47852454 has vmi 6e1ff6d2-c8ad-11ef-887d-fa163ec5728a 2025-01-02 02:01:20,551 - INFO - Verified pod ctest-pod-47852454 in contrail-api 2025-01-02 02:01:20,564 - DEBUG - VMI 6e1ff6d2-c8ad-11ef-887d-fa163ec5728a is active in agent 10.0.0.45 2025-01-02 02:01:20,564 - INFO - Verified Pod ctest-pod-47852454 in agent 10.0.0.45 2025-01-02 02:01:20,564 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=7a5a8262-6a7a-4e9d-ab0e-9c5086f1bc09 2025-01-02 02:01:20,568 - INFO - Pod ctest-pod-47852454 with uuid 7a5a8262-6a7a-4e9d-ab0e-9c5086f1bc09 found in kube manager 2025-01-02 02:01:20,569 - INFO - Pod ctest-pod-47852454 verification passed 2025-01-02 02:01:20,575 - INFO - Pod ctest-pod-41194611 is in running state.Got IP 10.47.255.249 2025-01-02 02:01:20,631 - DEBUG - Pod ctest-pod-41194611 has vmi 6ecc7f88-c8ad-11ef-887d-fa163ec5728a 2025-01-02 02:01:20,631 - INFO - Verified pod ctest-pod-41194611 in contrail-api 2025-01-02 02:01:20,644 - DEBUG - VMI 6ecc7f88-c8ad-11ef-887d-fa163ec5728a is active in agent 10.0.0.45 2025-01-02 02:01:20,644 - INFO - Verified Pod ctest-pod-41194611 in agent 10.0.0.45 2025-01-02 02:01:20,644 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=1c27e55f-5909-426b-8ce3-fed3e26aafb5 2025-01-02 02:01:20,648 - INFO - Pod ctest-pod-41194611 with uuid 1c27e55f-5909-426b-8ce3-fed3e26aafb5 found in kube manager 2025-01-02 02:01:20,649 - INFO - Pod ctest-pod-41194611 verification passed 2025-01-02 02:01:20,654 - INFO - Pod ctest-pod-66793918 is in running state.Got IP 10.47.255.248 2025-01-02 02:01:20,668 - DEBUG - Pod ctest-pod-66793918 has vmi 6f4ebe3a-c8ad-11ef-887d-fa163ec5728a 2025-01-02 02:01:20,668 - INFO - Verified pod ctest-pod-66793918 in contrail-api 2025-01-02 02:01:20,681 - DEBUG - VMI 6f4ebe3a-c8ad-11ef-887d-fa163ec5728a is active in agent 10.0.0.45 2025-01-02 02:01:20,681 - INFO - Verified Pod ctest-pod-66793918 in agent 10.0.0.45 2025-01-02 02:01:20,681 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=65a74910-630b-4395-85ea-8b174088ca45 2025-01-02 02:01:20,686 - INFO - Pod ctest-pod-66793918 with uuid 65a74910-630b-4395-85ea-8b174088ca45 found in kube manager 2025-01-02 02:01:20,686 - INFO - Pod ctest-pod-66793918 verification passed 2025-01-02 02:01:20,691 - DEBUG - Pod ctest-pod-43910357 not in running state.Currently in Pending 2025-01-02 02:01:25,698 - INFO - Pod ctest-pod-43910357 is in running state.Got IP 10.47.255.247 2025-01-02 02:01:25,755 - DEBUG - Pod ctest-pod-43910357 has vmi 6fe43618-c8ad-11ef-887d-fa163ec5728a 2025-01-02 02:01:25,755 - INFO - Verified pod ctest-pod-43910357 in contrail-api 2025-01-02 02:01:25,767 - DEBUG - VMI 6fe43618-c8ad-11ef-887d-fa163ec5728a is active in agent 10.0.0.45 2025-01-02 02:01:25,768 - INFO - Verified Pod ctest-pod-43910357 in agent 10.0.0.45 2025-01-02 02:01:25,768 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=16f31014-088b-49ce-8670-05e3aa2b459b 2025-01-02 02:01:25,772 - INFO - Pod ctest-pod-43910357 with uuid 16f31014-088b-49ce-8670-05e3aa2b459b found in kube manager 2025-01-02 02:01:25,772 - INFO - Pod ctest-pod-43910357 verification passed 2025-01-02 02:01:25,777 - INFO - Pod ctest-pod-49740823 is in running state.Got IP 10.47.255.245 2025-01-02 02:01:25,791 - DEBUG - Pod ctest-pod-49740823 has vmi 70da16a0-c8ad-11ef-887d-fa163ec5728a 2025-01-02 02:01:25,791 - INFO - Verified pod ctest-pod-49740823 in contrail-api 2025-01-02 02:01:25,802 - DEBUG - VMI 70da16a0-c8ad-11ef-887d-fa163ec5728a is active in agent 10.0.0.45 2025-01-02 02:01:25,802 - INFO - Verified Pod ctest-pod-49740823 in agent 10.0.0.45 2025-01-02 02:01:25,802 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=c84d3406-fbcd-4d74-b2dc-0797d9542204 2025-01-02 02:01:25,806 - INFO - Pod ctest-pod-49740823 with uuid c84d3406-fbcd-4d74-b2dc-0797d9542204 found in kube manager 2025-01-02 02:01:25,806 - INFO - Pod ctest-pod-49740823 verification passed 2025-01-02 02:01:25,811 - INFO - Pod ctest-pod-78743409 is in running state.Got IP 10.47.255.246 2025-01-02 02:01:25,866 - DEBUG - Pod ctest-pod-78743409 has vmi 705b76c4-c8ad-11ef-887d-fa163ec5728a 2025-01-02 02:01:25,866 - INFO - Verified pod ctest-pod-78743409 in contrail-api 2025-01-02 02:01:25,879 - DEBUG - VMI 705b76c4-c8ad-11ef-887d-fa163ec5728a is active in agent 10.0.0.45 2025-01-02 02:01:25,879 - INFO - Verified Pod ctest-pod-78743409 in agent 10.0.0.45 2025-01-02 02:01:25,879 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=6ff66893-d712-4186-adef-76125d9a99ec 2025-01-02 02:01:25,883 - INFO - Pod ctest-pod-78743409 with uuid 6ff66893-d712-4186-adef-76125d9a99ec found in kube manager 2025-01-02 02:01:25,883 - INFO - Pod ctest-pod-78743409 verification passed 2025-01-02 02:01:25,888 - INFO - Pod ctest-pod-66554395 is in running state.Got IP 10.47.255.244 2025-01-02 02:01:25,943 - DEBUG - Pod ctest-pod-66554395 has vmi 7154abf4-c8ad-11ef-887d-fa163ec5728a 2025-01-02 02:01:25,943 - INFO - Verified pod ctest-pod-66554395 in contrail-api 2025-01-02 02:01:25,956 - DEBUG - VMI 7154abf4-c8ad-11ef-887d-fa163ec5728a is active in agent 10.0.0.45 2025-01-02 02:01:25,956 - INFO - Verified Pod ctest-pod-66554395 in agent 10.0.0.45 2025-01-02 02:01:25,956 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=8eea0049-639a-4a09-b92f-9299a43d02d9 2025-01-02 02:01:25,961 - INFO - Pod ctest-pod-66554395 with uuid 8eea0049-639a-4a09-b92f-9299a43d02d9 found in kube manager 2025-01-02 02:01:25,961 - INFO - Pod ctest-pod-66554395 verification passed 2025-01-02 02:01:25,961 - INFO - ================================================================================ 2025-01-02 02:01:25,961 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-01-02 02:01:25,961 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-01-02 02:01:26,148 - DEBUG - Nothing to compare xmpp stats {'10.0.0.45': {'10.0.0.24': '0'}} with 2025-01-02 02:01:26,148 - INFO - Initial checks done. Running the testcase now 2025-01-02 02:01:26,148 - INFO - 2025-01-02 02:01:26,200 - DEBUG - [Pod ctest-pod-93481025] Cmd: echo ctest-pod-93481025 > /usr/share/nginx/html/index.html, Output: 2025-01-02 02:01:26,255 - DEBUG - [Pod ctest-pod-47852454] Cmd: echo ctest-pod-47852454 > /usr/share/nginx/html/index.html, Output: 2025-01-02 02:01:26,322 - DEBUG - [Pod ctest-pod-41194611] Cmd: echo ctest-pod-41194611 > /usr/share/nginx/html/index.html, Output: 2025-01-02 02:01:26,384 - DEBUG - [Pod ctest-pod-66793918] Cmd: echo ctest-pod-66793918 > /usr/share/nginx/html/index.html, Output: 2025-01-02 02:01:26,387 - DEBUG - Service ctest-nginx-svc-05839371 not present 2025-01-02 02:01:26,387 - INFO - Creating service ctest-nginx-svc-05839371 2025-01-02 02:01:26,398 - INFO - Created Service ctest-nginx-svc-05839371 2025-01-02 02:01:26,411 - WARNING - Service UUID 1d7429fd-9d9f-4e03-aed6-791d5e622683 not yet found in contrail-api 2025-01-02 02:01:27,425 - INFO - Validated that Service ctest-nginx-svc-05839371 is seen in contrail-api 2025-01-02 02:01:27,425 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_LoadbalancerDatabaseList?x=1d7429fd-9d9f-4e03-aed6-791d5e622683 2025-01-02 02:01:27,429 - INFO - Service ctest-nginx-svc-05839371 with uuid 1d7429fd-9d9f-4e03-aed6-791d5e622683 found in kube manager 2025-01-02 02:01:27,429 - INFO - Service ctest-nginx-svc-05839371 verification passed 2025-01-02 02:01:28,517 - DEBUG - [Pod ctest-pod-43910357] Cmd: wget http://10.104.175.19:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.175.19:80 (10.104.175.19:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-93481025 2025-01-02 02:01:28,517 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd wget http://10.104.175.19:80/ -O - -T 5 -t 1 passed 2025-01-02 02:01:28,517 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd output: Connecting to 10.104.175.19:80 (10.104.175.19:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-93481025 2025-01-02 02:01:28,583 - DEBUG - [Pod ctest-pod-43910357] Cmd: wget http://10.104.175.19:80/ -O - -T 5 -t 1 , Output: ctest-pod-93481025 Connecting to 10.104.175.19:80 (10.104.175.19:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 02:01:28,583 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd wget http://10.104.175.19:80/ -O - -T 5 -t 1 passed 2025-01-02 02:01:28,583 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd output: ctest-pod-93481025 Connecting to 10.104.175.19:80 (10.104.175.19:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 02:01:28,652 - DEBUG - [Pod ctest-pod-43910357] Cmd: wget http://10.104.175.19:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.175.19:80 (10.104.175.19:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-47852454 2025-01-02 02:01:28,652 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd wget http://10.104.175.19:80/ -O - -T 5 -t 1 passed 2025-01-02 02:01:28,652 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd output: Connecting to 10.104.175.19:80 (10.104.175.19:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-47852454 2025-01-02 02:01:28,652 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-93481025': 2, 'ctest-pod-47852454': 1} 2025-01-02 02:01:28,708 - DEBUG - [Pod ctest-pod-49740823] Cmd: wget http://10.104.175.19:80/ -O - -T 5 -t 1 , Output: ctest-pod-93481025 Connecting to 10.104.175.19:80 (10.104.175.19:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 02:01:28,708 - DEBUG - [Pod Pod ctest-pod-49740823] Cmd wget http://10.104.175.19:80/ -O - -T 5 -t 1 passed 2025-01-02 02:01:28,708 - DEBUG - [Pod Pod ctest-pod-49740823] Cmd output: ctest-pod-93481025 Connecting to 10.104.175.19:80 (10.104.175.19:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 02:01:28,774 - DEBUG - [Pod ctest-pod-49740823] Cmd: wget http://10.104.175.19:80/ -O - -T 5 -t 1 , Output: ctest-pod-93481025 Connecting to 10.104.175.19:80 (10.104.175.19:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 02:01:28,774 - DEBUG - [Pod Pod ctest-pod-49740823] Cmd wget http://10.104.175.19:80/ -O - -T 5 -t 1 passed 2025-01-02 02:01:28,774 - DEBUG - [Pod Pod ctest-pod-49740823] Cmd output: ctest-pod-93481025 Connecting to 10.104.175.19:80 (10.104.175.19:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 02:01:28,830 - DEBUG - [Pod ctest-pod-49740823] Cmd: wget http://10.104.175.19:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.175.19:80 (10.104.175.19:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-47852454 2025-01-02 02:01:28,830 - DEBUG - [Pod Pod ctest-pod-49740823] Cmd wget http://10.104.175.19:80/ -O - -T 5 -t 1 passed 2025-01-02 02:01:28,830 - DEBUG - [Pod Pod ctest-pod-49740823] Cmd output: Connecting to 10.104.175.19:80 (10.104.175.19:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-47852454 2025-01-02 02:01:28,830 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-93481025': 2, 'ctest-pod-47852454': 1} 2025-01-02 02:01:28,834 - DEBUG - Network policy ingress-on-service not present 2025-01-02 02:01:28,835 - INFO - Creating Network Policy ingress-on-service 2025-01-02 02:01:28,849 - INFO - Network policy found in k8s 2025-01-02 02:01:28,850 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=3fd3ec36-ae3a-423d-b5e0-cfd9cc16ef01 2025-01-02 02:01:28,855 - INFO - Network Policy ingress-on-service with uuid 3fd3ec36-ae3a-423d-b5e0-cfd9cc16ef01 found in kube manager 2025-01-02 02:01:28,886 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-01-02 02:01:28,886 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-01-02 02:01:28,887 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=3fd3ec36-ae3a-423d-b5e0-cfd9cc16ef01 2025-01-02 02:01:28,915 - WARNING - Network policy with name ingress-on-service not found in agent 2025-01-02 02:01:30,916 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=3fd3ec36-ae3a-423d-b5e0-cfd9cc16ef01 2025-01-02 02:01:30,953 - INFO - Network policy with name ingress-on-service found in agent 2025-01-02 02:01:30,953 - INFO - Network Policy ingress-on-service verification passed 2025-01-02 02:01:36,014 - DEBUG - [Pod ctest-pod-43910357] Cmd: wget http://10.104.175.19:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:01:36,014 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd wget http://10.104.175.19:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:01:36,014 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:01:41,075 - DEBUG - [Pod ctest-pod-43910357] Cmd: wget http://10.104.175.19:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:01:41,076 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd wget http://10.104.175.19:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:01:41,076 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:01:46,141 - DEBUG - [Pod ctest-pod-43910357] Cmd: wget http://10.104.175.19:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:01:46,141 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd wget http://10.104.175.19:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:01:46,141 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:01:51,209 - DEBUG - [Pod ctest-pod-43910357] Cmd: wget http://10.104.175.19:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:01:51,210 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd wget http://10.104.175.19:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:01:51,210 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:01:56,277 - DEBUG - [Pod ctest-pod-43910357] Cmd: wget http://10.104.175.19:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:01:56,278 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd wget http://10.104.175.19:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:01:56,278 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:02:01,338 - DEBUG - [Pod ctest-pod-43910357] Cmd: wget http://10.104.175.19:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:02:01,338 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd wget http://10.104.175.19:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:02:01,338 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:02:06,400 - DEBUG - [Pod ctest-pod-43910357] Cmd: wget http://10.104.175.19:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:02:06,400 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd wget http://10.104.175.19:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:02:06,400 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:02:11,468 - DEBUG - [Pod ctest-pod-43910357] Cmd: wget http://10.104.175.19:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:02:11,469 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd wget http://10.104.175.19:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:02:11,469 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:02:16,517 - DEBUG - [Pod ctest-pod-43910357] Cmd: wget http://10.104.175.19:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:02:16,517 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd wget http://10.104.175.19:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:02:16,517 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:02:21,584 - DEBUG - [Pod ctest-pod-43910357] Cmd: wget http://10.104.175.19:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:02:21,584 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd wget http://10.104.175.19:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:02:21,584 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:02:21,585 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-93481025': 0, 'ctest-pod-47852454': 0} 2025-01-02 02:02:21,663 - DEBUG - [Pod ctest-pod-78743409] Cmd: wget http://10.104.175.19:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.175.19:80 (10.104.175.19:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-47852454 2025-01-02 02:02:21,664 - DEBUG - [Pod Pod ctest-pod-78743409] Cmd wget http://10.104.175.19:80/ -O - -T 5 -t 1 passed 2025-01-02 02:02:21,664 - DEBUG - [Pod Pod ctest-pod-78743409] Cmd output: Connecting to 10.104.175.19:80 (10.104.175.19:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-47852454 2025-01-02 02:02:21,724 - DEBUG - [Pod ctest-pod-78743409] Cmd: wget http://10.104.175.19:80/ -O - -T 5 -t 1 , Output: ctest-pod-93481025 Connecting to 10.104.175.19:80 (10.104.175.19:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 02:02:21,724 - DEBUG - [Pod Pod ctest-pod-78743409] Cmd wget http://10.104.175.19:80/ -O - -T 5 -t 1 passed 2025-01-02 02:02:21,724 - DEBUG - [Pod Pod ctest-pod-78743409] Cmd output: ctest-pod-93481025 Connecting to 10.104.175.19:80 (10.104.175.19:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 02:02:21,724 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-93481025': 1, 'ctest-pod-47852454': 1} 2025-01-02 02:02:26,776 - DEBUG - [Pod ctest-pod-49740823] Cmd: wget http://10.104.175.19:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:02:26,776 - DEBUG - [Pod Pod ctest-pod-49740823] Cmd wget http://10.104.175.19:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:02:26,776 - DEBUG - [Pod Pod ctest-pod-49740823] Cmd output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:02:31,843 - DEBUG - [Pod ctest-pod-49740823] Cmd: wget http://10.104.175.19:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:02:31,843 - DEBUG - [Pod Pod ctest-pod-49740823] Cmd wget http://10.104.175.19:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:02:31,843 - DEBUG - [Pod Pod ctest-pod-49740823] Cmd output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:02:33,970 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2025-01-02 02:02:44,411 - DEBUG - [Pod ctest-pod-49740823] Cmd: wget http://10.104.175.19:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:02:44,411 - DEBUG - [Pod Pod ctest-pod-49740823] Cmd wget http://10.104.175.19:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:02:44,411 - DEBUG - [Pod Pod ctest-pod-49740823] Cmd output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:02:49,470 - DEBUG - [Pod ctest-pod-49740823] Cmd: wget http://10.104.175.19:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:02:49,470 - DEBUG - [Pod Pod ctest-pod-49740823] Cmd wget http://10.104.175.19:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:02:49,470 - DEBUG - [Pod Pod ctest-pod-49740823] Cmd output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:02:54,548 - DEBUG - [Pod ctest-pod-49740823] Cmd: wget http://10.104.175.19:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:02:54,548 - DEBUG - [Pod Pod ctest-pod-49740823] Cmd wget http://10.104.175.19:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:02:54,549 - DEBUG - [Pod Pod ctest-pod-49740823] Cmd output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:02:59,609 - DEBUG - [Pod ctest-pod-49740823] Cmd: wget http://10.104.175.19:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:02:59,609 - DEBUG - [Pod Pod ctest-pod-49740823] Cmd wget http://10.104.175.19:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:02:59,609 - DEBUG - [Pod Pod ctest-pod-49740823] Cmd output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:03:04,677 - DEBUG - [Pod ctest-pod-49740823] Cmd: wget http://10.104.175.19:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:03:04,677 - DEBUG - [Pod Pod ctest-pod-49740823] Cmd wget http://10.104.175.19:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:03:04,677 - DEBUG - [Pod Pod ctest-pod-49740823] Cmd output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:03:09,735 - DEBUG - [Pod ctest-pod-49740823] Cmd: wget http://10.104.175.19:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:03:09,735 - DEBUG - [Pod Pod ctest-pod-49740823] Cmd wget http://10.104.175.19:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:03:09,735 - DEBUG - [Pod Pod ctest-pod-49740823] Cmd output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:03:14,786 - DEBUG - [Pod ctest-pod-49740823] Cmd: wget http://10.104.175.19:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:03:14,786 - DEBUG - [Pod Pod ctest-pod-49740823] Cmd wget http://10.104.175.19:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:03:14,786 - DEBUG - [Pod Pod ctest-pod-49740823] Cmd output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:03:19,847 - DEBUG - [Pod ctest-pod-49740823] Cmd: wget http://10.104.175.19:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:03:19,847 - DEBUG - [Pod Pod ctest-pod-49740823] Cmd wget http://10.104.175.19:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:03:19,847 - DEBUG - [Pod Pod ctest-pod-49740823] Cmd output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:03:19,847 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-93481025': 0, 'ctest-pod-47852454': 0} 2025-01-02 02:03:21,902 - DEBUG - [Pod ctest-pod-78743409] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.376 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.078 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.092 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.078/0.515/1.376 ms 2025-01-02 02:03:21,902 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-78743409 with expectation True passed 2025-01-02 02:03:23,965 - DEBUG - [Pod ctest-pod-43910357] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.609 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.085 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.079 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.079/0.257/0.609 ms 2025-01-02 02:03:23,965 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-43910357 with expectation True passed 2025-01-02 02:03:26,033 - DEBUG - [Pod ctest-pod-49740823] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.022 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.100 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.397/1.022 ms 2025-01-02 02:03:26,033 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-49740823 with expectation True passed 2025-01-02 02:03:26,095 - DEBUG - [Pod ctest-pod-78743409] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-02 02:03:26,095 - DEBUG - [Pod Pod ctest-pod-78743409] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-01-02 02:03:26,095 - DEBUG - [Pod Pod ctest-pod-78743409] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-02 02:03:26,095 - INFO - wget check of of http://10.47.255.251 from ctest-pod-78743409 passed 2025-01-02 02:03:26,166 - DEBUG - [Pod ctest-pod-78743409] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-02 02:03:26,166 - DEBUG - [Pod Pod ctest-pod-78743409] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-01-02 02:03:26,166 - DEBUG - [Pod Pod ctest-pod-78743409] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-02 02:03:26,166 - INFO - wget check of of http://10.47.255.250 from ctest-pod-78743409 passed 2025-01-02 02:03:31,223 - DEBUG - [Pod ctest-pod-43910357] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-02 02:03:31,223 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-02 02:03:31,223 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-02 02:03:31,223 - INFO - wget check of of http://10.47.255.250 from ctest-pod-43910357 passed 2025-01-02 02:03:36,289 - DEBUG - [Pod ctest-pod-66554395] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-01-02 02:03:36,289 - DEBUG - [Pod Pod ctest-pod-66554395] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-01-02 02:03:36,289 - DEBUG - [Pod Pod ctest-pod-66554395] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-01-02 02:03:36,289 - INFO - wget check of of http://10.47.255.251 from ctest-pod-66554395 passed 2025-01-02 02:03:36,299 - INFO - Updating Network Policy ingress-on-service 2025-01-02 02:03:41,364 - DEBUG - [Pod ctest-pod-43910357] Cmd: wget http://10.104.175.19:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:03:41,364 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd wget http://10.104.175.19:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:03:41,364 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:03:46,418 - DEBUG - [Pod ctest-pod-43910357] Cmd: wget http://10.104.175.19:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:03:46,418 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd wget http://10.104.175.19:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:03:46,418 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:03:51,473 - DEBUG - [Pod ctest-pod-43910357] Cmd: wget http://10.104.175.19:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:03:51,474 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd wget http://10.104.175.19:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:03:51,474 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:03:56,537 - DEBUG - [Pod ctest-pod-43910357] Cmd: wget http://10.104.175.19:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:03:56,537 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd wget http://10.104.175.19:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:03:56,537 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:04:01,602 - DEBUG - [Pod ctest-pod-43910357] Cmd: wget http://10.104.175.19:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:04:01,602 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd wget http://10.104.175.19:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:04:01,602 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:04:06,672 - DEBUG - [Pod ctest-pod-43910357] Cmd: wget http://10.104.175.19:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:04:06,673 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd wget http://10.104.175.19:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:04:06,673 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:04:11,739 - DEBUG - [Pod ctest-pod-43910357] Cmd: wget http://10.104.175.19:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:04:11,739 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd wget http://10.104.175.19:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:04:11,739 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:04:16,795 - DEBUG - [Pod ctest-pod-43910357] Cmd: wget http://10.104.175.19:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:04:16,796 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd wget http://10.104.175.19:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:04:16,796 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:04:21,870 - DEBUG - [Pod ctest-pod-43910357] Cmd: wget http://10.104.175.19:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:04:21,870 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd wget http://10.104.175.19:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:04:21,870 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:04:26,925 - DEBUG - [Pod ctest-pod-43910357] Cmd: wget http://10.104.175.19:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:04:26,925 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd wget http://10.104.175.19:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:04:26,925 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd output: Connecting to 10.104.175.19:80 (10.104.175.19:80) wget: download timed out 2025-01-02 02:04:26,925 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-93481025': 0, 'ctest-pod-47852454': 0} 2025-01-02 02:04:26,980 - DEBUG - [Pod ctest-pod-78743409] Cmd: wget http://10.104.175.19:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.175.19:80 (10.104.175.19:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-47852454 2025-01-02 02:04:26,981 - DEBUG - [Pod Pod ctest-pod-78743409] Cmd wget http://10.104.175.19:80/ -O - -T 5 -t 1 passed 2025-01-02 02:04:26,981 - DEBUG - [Pod Pod ctest-pod-78743409] Cmd output: Connecting to 10.104.175.19:80 (10.104.175.19:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-47852454 2025-01-02 02:04:27,040 - DEBUG - [Pod ctest-pod-78743409] Cmd: wget http://10.104.175.19:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.175.19:80 (10.104.175.19:80) ctest-pod-93481025 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 02:04:27,040 - DEBUG - [Pod Pod ctest-pod-78743409] Cmd wget http://10.104.175.19:80/ -O - -T 5 -t 1 passed 2025-01-02 02:04:27,040 - DEBUG - [Pod Pod ctest-pod-78743409] Cmd output: Connecting to 10.104.175.19:80 (10.104.175.19:80) ctest-pod-93481025 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 02:04:27,040 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-93481025': 1, 'ctest-pod-47852454': 1} 2025-01-02 02:04:27,111 - DEBUG - [Pod ctest-pod-49740823] Cmd: wget http://10.104.175.19:80/ -O - -T 5 -t 1 , Output: ctest-pod-93481025 Connecting to 10.104.175.19:80 (10.104.175.19:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 02:04:27,111 - DEBUG - [Pod Pod ctest-pod-49740823] Cmd wget http://10.104.175.19:80/ -O - -T 5 -t 1 passed 2025-01-02 02:04:27,111 - DEBUG - [Pod Pod ctest-pod-49740823] Cmd output: ctest-pod-93481025 Connecting to 10.104.175.19:80 (10.104.175.19:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 02:04:27,187 - DEBUG - [Pod ctest-pod-49740823] Cmd: wget http://10.104.175.19:80/ -O - -T 5 -t 1 , Output: ctest-pod-93481025 Connecting to 10.104.175.19:80 (10.104.175.19:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 02:04:27,188 - DEBUG - [Pod Pod ctest-pod-49740823] Cmd wget http://10.104.175.19:80/ -O - -T 5 -t 1 passed 2025-01-02 02:04:27,188 - DEBUG - [Pod Pod ctest-pod-49740823] Cmd output: ctest-pod-93481025 Connecting to 10.104.175.19:80 (10.104.175.19:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 02:04:27,266 - DEBUG - [Pod ctest-pod-49740823] Cmd: wget http://10.104.175.19:80/ -O - -T 5 -t 1 , Output: ctest-pod-47852454 Connecting to 10.104.175.19:80 (10.104.175.19:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 02:04:27,266 - DEBUG - [Pod Pod ctest-pod-49740823] Cmd wget http://10.104.175.19:80/ -O - -T 5 -t 1 passed 2025-01-02 02:04:27,266 - DEBUG - [Pod Pod ctest-pod-49740823] Cmd output: ctest-pod-47852454 Connecting to 10.104.175.19:80 (10.104.175.19:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 02:04:27,266 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-93481025': 2, 'ctest-pod-47852454': 1} 2025-01-02 02:04:29,333 - DEBUG - [Pod ctest-pod-78743409] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.525 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.077 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.083 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.077/0.228/0.525 ms 2025-01-02 02:04:29,333 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-78743409 with expectation True passed 2025-01-02 02:04:31,402 - DEBUG - [Pod ctest-pod-43910357] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.844 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.076 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.104 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.076/0.341/0.844 ms 2025-01-02 02:04:31,402 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-43910357 with expectation True passed 2025-01-02 02:04:33,474 - DEBUG - [Pod ctest-pod-49740823] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.807 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.077 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.119 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.077/0.334/0.807 ms 2025-01-02 02:04:33,474 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-49740823 with expectation True passed 2025-01-02 02:04:33,540 - DEBUG - [Pod ctest-pod-78743409] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-02 02:04:33,540 - DEBUG - [Pod Pod ctest-pod-78743409] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-01-02 02:04:33,540 - DEBUG - [Pod Pod ctest-pod-78743409] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-02 02:04:33,540 - INFO - wget check of of http://10.47.255.251 from ctest-pod-78743409 passed 2025-01-02 02:04:33,624 - DEBUG - [Pod ctest-pod-78743409] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-02 02:04:33,624 - DEBUG - [Pod Pod ctest-pod-78743409] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-01-02 02:04:33,624 - DEBUG - [Pod Pod ctest-pod-78743409] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-02 02:04:33,624 - INFO - wget check of of http://10.47.255.250 from ctest-pod-78743409 passed 2025-01-02 02:04:38,698 - DEBUG - [Pod ctest-pod-43910357] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-02 02:04:38,698 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-02 02:04:38,698 - DEBUG - [Pod Pod ctest-pod-43910357] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-02 02:04:38,699 - INFO - wget check of of http://10.47.255.250 from ctest-pod-43910357 passed 2025-01-02 02:04:38,757 - DEBUG - [Pod ctest-pod-66554395] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-02 02:04:38,758 - DEBUG - [Pod Pod ctest-pod-66554395] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-01-02 02:04:38,758 - DEBUG - [Pod Pod ctest-pod-66554395] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-02 02:04:38,758 - INFO - wget check of of http://10.47.255.251 from ctest-pod-66554395 passed 2025-01-02 02:04:38,758 - INFO - Deleting Network Policy : ingress-on-service 2025-01-02 02:04:38,758 - INFO - Deleting service : ctest-nginx-svc-05839371 2025-01-02 02:04:38,984 - DEBUG - No XMPP flaps were noticed during the test