2025-05-29 02:01:34,706 - INFO - Using existing project ['default-domain', 'k8s-default'](1929d5e0-434e-4188-848d-a73c151b4755) 2025-05-29 02:01:34,732 - DEBUG - Namespace ctest-new-default-07741699 not present 2025-05-29 02:01:34,742 - INFO - Created namespace ctest-new-default-07741699 2025-05-29 02:01:37,747 - DEBUG - Namespace ctest-non-default-40144179 not present 2025-05-29 02:01:37,759 - INFO - Created namespace ctest-non-default-40144179 2025-05-29 02:01:40,774 - DEBUG - Pod ctest-pod-73716987 not present 2025-05-29 02:01:40,775 - INFO - Creating Pod ctest-pod-73716987 2025-05-29 02:01:40,798 - DEBUG - Pod : ctest-pod-73716987 UUID is ae18029e-7c08-4eb1-9f75-69d1dc8b4b65 2025-05-29 02:01:40,801 - DEBUG - Pod ctest-pod-11652381 not present 2025-05-29 02:01:40,802 - INFO - Creating Pod ctest-pod-11652381 2025-05-29 02:01:40,821 - DEBUG - Pod : ctest-pod-11652381 UUID is 7624c07e-dcdc-4d85-922d-19444c07cd81 2025-05-29 02:01:40,826 - DEBUG - Pod ctest-pod-88070979 not present 2025-05-29 02:01:40,827 - INFO - Creating Pod ctest-pod-88070979 2025-05-29 02:01:40,846 - DEBUG - Pod : ctest-pod-88070979 UUID is 5593d55f-25b2-43dc-9a73-585148e89cc6 2025-05-29 02:01:40,854 - DEBUG - Pod ctest-pod-02939721 not present 2025-05-29 02:01:40,855 - INFO - Creating Pod ctest-pod-02939721 2025-05-29 02:01:40,877 - DEBUG - Pod : ctest-pod-02939721 UUID is 735c55b7-d637-4d30-a94d-b5b483468e65 2025-05-29 02:01:40,882 - DEBUG - Pod ctest-pod-83802849 not present 2025-05-29 02:01:40,882 - INFO - Creating Pod ctest-pod-83802849 2025-05-29 02:01:40,908 - DEBUG - Pod : ctest-pod-83802849 UUID is 1c586c19-984a-41c5-af1b-07d5de1daed9 2025-05-29 02:01:40,914 - DEBUG - Pod ctest-pod-14562376 not present 2025-05-29 02:01:40,914 - INFO - Creating Pod ctest-pod-14562376 2025-05-29 02:01:40,936 - DEBUG - Pod : ctest-pod-14562376 UUID is 84d7fa51-1954-4f40-bbe4-c9ab284d9e6c 2025-05-29 02:01:40,940 - DEBUG - Pod ctest-pod-22855860 not present 2025-05-29 02:01:40,941 - INFO - Creating Pod ctest-pod-22855860 2025-05-29 02:01:40,972 - DEBUG - Pod : ctest-pod-22855860 UUID is 5a4e944a-acf4-4114-a735-0eead0edc2d7 2025-05-29 02:01:40,975 - DEBUG - Pod ctest-pod-56631001 not present 2025-05-29 02:01:40,976 - INFO - Creating Pod ctest-pod-56631001 2025-05-29 02:01:40,999 - DEBUG - Pod : ctest-pod-56631001 UUID is 502bc381-d434-49e1-86a4-9a34c69debed 2025-05-29 02:01:41,326 - INFO - Project default-domain:k8s-ctest-new-default-07741699 for Namespace ctest-new-default-07741699 is seen in contrail-api 2025-05-29 02:01:41,327 - DEBUG - Project uuid in Contrail is c0060ee1-c5a7-419a-8002-73a08087ac9a 2025-05-29 02:01:42,016 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NamespaceDatabaseList?namespace_uuid=75ab076f-6526-421a-97f0-d1e9f498163a 2025-05-29 02:01:42,035 - INFO - Namespace ctest-new-default-07741699 with uuid 75ab076f-6526-421a-97f0-d1e9f498163a found in kube manager 2025-05-29 02:01:42,035 - INFO - Namespace ctest-new-default-07741699 verification passed 2025-05-29 02:01:42,385 - INFO - Project default-domain:k8s-ctest-non-default-40144179 for Namespace ctest-non-default-40144179 is seen in contrail-api 2025-05-29 02:01:42,385 - DEBUG - Project uuid in Contrail is 77e017fb-450e-417e-a58e-0acb75632c89 2025-05-29 02:01:42,385 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NamespaceDatabaseList?namespace_uuid=10b01856-2779-4271-a573-60b24b8f21b2 2025-05-29 02:01:42,393 - INFO - Namespace ctest-non-default-40144179 with uuid 10b01856-2779-4271-a573-60b24b8f21b2 found in kube manager 2025-05-29 02:01:42,393 - INFO - Namespace ctest-non-default-40144179 verification passed 2025-05-29 02:01:42,401 - DEBUG - Pod ctest-pod-73716987 not in running state.Currently in Pending 2025-05-29 02:01:47,409 - DEBUG - Pod ctest-pod-73716987 not in running state.Currently in Pending 2025-05-29 02:01:52,417 - DEBUG - Pod ctest-pod-73716987 not in running state.Currently in Pending 2025-05-29 02:01:57,424 - INFO - Pod ctest-pod-73716987 is in running state.Got IP 10.47.255.250 2025-05-29 02:01:57,478 - DEBUG - Pod ctest-pod-73716987 has vmi dec655f6-3c30-11f0-936c-0242f18efb31 2025-05-29 02:01:57,478 - INFO - Verified pod ctest-pod-73716987 in contrail-api 2025-05-29 02:01:57,497 - DEBUG - VMI dec655f6-3c30-11f0-936c-0242f18efb31 is active in agent 10.0.0.33 2025-05-29 02:01:57,497 - INFO - Verified Pod ctest-pod-73716987 in agent 10.0.0.33 2025-05-29 02:01:57,497 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=ae18029e-7c08-4eb1-9f75-69d1dc8b4b65 2025-05-29 02:01:57,503 - INFO - Pod ctest-pod-73716987 with uuid ae18029e-7c08-4eb1-9f75-69d1dc8b4b65 found in kube manager 2025-05-29 02:01:57,503 - INFO - Pod ctest-pod-73716987 verification passed 2025-05-29 02:01:57,509 - INFO - Pod ctest-pod-11652381 is in running state.Got IP 10.47.255.249 2025-05-29 02:01:57,605 - DEBUG - Pod ctest-pod-11652381 has vmi df808f20-3c30-11f0-936c-0242f18efb31 2025-05-29 02:01:57,605 - INFO - Verified pod ctest-pod-11652381 in contrail-api 2025-05-29 02:01:57,622 - DEBUG - VMI df808f20-3c30-11f0-936c-0242f18efb31 is active in agent 10.0.0.33 2025-05-29 02:01:57,622 - INFO - Verified Pod ctest-pod-11652381 in agent 10.0.0.33 2025-05-29 02:01:57,623 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=7624c07e-dcdc-4d85-922d-19444c07cd81 2025-05-29 02:01:57,627 - INFO - Pod ctest-pod-11652381 with uuid 7624c07e-dcdc-4d85-922d-19444c07cd81 found in kube manager 2025-05-29 02:01:57,628 - INFO - Pod ctest-pod-11652381 verification passed 2025-05-29 02:01:57,636 - INFO - Pod ctest-pod-88070979 is in running state.Got IP 10.47.255.248 2025-05-29 02:01:57,738 - DEBUG - Pod ctest-pod-88070979 has vmi e0809e7e-3c30-11f0-936c-0242f18efb31 2025-05-29 02:01:57,738 - INFO - Verified pod ctest-pod-88070979 in contrail-api 2025-05-29 02:01:57,754 - DEBUG - VMI e0809e7e-3c30-11f0-936c-0242f18efb31 is active in agent 10.0.0.33 2025-05-29 02:01:57,754 - INFO - Verified Pod ctest-pod-88070979 in agent 10.0.0.33 2025-05-29 02:01:57,755 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=5593d55f-25b2-43dc-9a73-585148e89cc6 2025-05-29 02:01:57,760 - INFO - Pod ctest-pod-88070979 with uuid 5593d55f-25b2-43dc-9a73-585148e89cc6 found in kube manager 2025-05-29 02:01:57,761 - INFO - Pod ctest-pod-88070979 verification passed 2025-05-29 02:01:57,768 - DEBUG - Pod ctest-pod-02939721 not in running state.Currently in Pending 2025-05-29 02:02:02,775 - INFO - Pod ctest-pod-02939721 is in running state.Got IP 10.47.255.247 2025-05-29 02:02:02,828 - DEBUG - Pod ctest-pod-02939721 has vmi e136f87c-3c30-11f0-936c-0242f18efb31 2025-05-29 02:02:02,828 - INFO - Verified pod ctest-pod-02939721 in contrail-api 2025-05-29 02:02:02,841 - DEBUG - VMI e136f87c-3c30-11f0-936c-0242f18efb31 is active in agent 10.0.0.33 2025-05-29 02:02:02,842 - INFO - Verified Pod ctest-pod-02939721 in agent 10.0.0.33 2025-05-29 02:02:02,842 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=735c55b7-d637-4d30-a94d-b5b483468e65 2025-05-29 02:02:02,847 - INFO - Pod ctest-pod-02939721 with uuid 735c55b7-d637-4d30-a94d-b5b483468e65 found in kube manager 2025-05-29 02:02:02,847 - INFO - Pod ctest-pod-02939721 verification passed 2025-05-29 02:02:02,853 - INFO - Pod ctest-pod-83802849 is in running state.Got IP 10.47.255.246 2025-05-29 02:02:02,948 - DEBUG - Pod ctest-pod-83802849 has vmi e2073cd0-3c30-11f0-936c-0242f18efb31 2025-05-29 02:02:02,948 - INFO - Verified pod ctest-pod-83802849 in contrail-api 2025-05-29 02:02:02,974 - DEBUG - VMI e2073cd0-3c30-11f0-936c-0242f18efb31 is active in agent 10.0.0.33 2025-05-29 02:02:02,974 - INFO - Verified Pod ctest-pod-83802849 in agent 10.0.0.33 2025-05-29 02:02:02,974 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=1c586c19-984a-41c5-af1b-07d5de1daed9 2025-05-29 02:02:02,987 - INFO - Pod ctest-pod-83802849 with uuid 1c586c19-984a-41c5-af1b-07d5de1daed9 found in kube manager 2025-05-29 02:02:02,987 - INFO - Pod ctest-pod-83802849 verification passed 2025-05-29 02:02:02,996 - DEBUG - Pod ctest-pod-22855860 not in running state.Currently in Pending 2025-05-29 02:02:08,005 - INFO - Pod ctest-pod-22855860 is in running state.Got IP 10.47.255.244 2025-05-29 02:02:08,061 - DEBUG - Pod ctest-pod-22855860 has vmi e3a6b9ee-3c30-11f0-936c-0242f18efb31 2025-05-29 02:02:08,062 - INFO - Verified pod ctest-pod-22855860 in contrail-api 2025-05-29 02:02:08,078 - DEBUG - VMI e3a6b9ee-3c30-11f0-936c-0242f18efb31 is active in agent 10.0.0.33 2025-05-29 02:02:08,078 - INFO - Verified Pod ctest-pod-22855860 in agent 10.0.0.33 2025-05-29 02:02:08,078 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=5a4e944a-acf4-4114-a735-0eead0edc2d7 2025-05-29 02:02:08,084 - INFO - Pod ctest-pod-22855860 with uuid 5a4e944a-acf4-4114-a735-0eead0edc2d7 found in kube manager 2025-05-29 02:02:08,085 - INFO - Pod ctest-pod-22855860 verification passed 2025-05-29 02:02:08,091 - INFO - Pod ctest-pod-14562376 is in running state.Got IP 10.47.255.245 2025-05-29 02:02:08,186 - DEBUG - Pod ctest-pod-14562376 has vmi e2d7d16a-3c30-11f0-936c-0242f18efb31 2025-05-29 02:02:08,186 - INFO - Verified pod ctest-pod-14562376 in contrail-api 2025-05-29 02:02:08,199 - DEBUG - VMI e2d7d16a-3c30-11f0-936c-0242f18efb31 is active in agent 10.0.0.33 2025-05-29 02:02:08,199 - INFO - Verified Pod ctest-pod-14562376 in agent 10.0.0.33 2025-05-29 02:02:08,199 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=84d7fa51-1954-4f40-bbe4-c9ab284d9e6c 2025-05-29 02:02:08,204 - INFO - Pod ctest-pod-14562376 with uuid 84d7fa51-1954-4f40-bbe4-c9ab284d9e6c found in kube manager 2025-05-29 02:02:08,204 - INFO - Pod ctest-pod-14562376 verification passed 2025-05-29 02:02:08,210 - INFO - Pod ctest-pod-56631001 is in running state.Got IP 10.47.255.243 2025-05-29 02:02:08,311 - DEBUG - Pod ctest-pod-56631001 has vmi e480454c-3c30-11f0-936c-0242f18efb31 2025-05-29 02:02:08,311 - INFO - Verified pod ctest-pod-56631001 in contrail-api 2025-05-29 02:02:08,324 - DEBUG - VMI e480454c-3c30-11f0-936c-0242f18efb31 is active in agent 10.0.0.33 2025-05-29 02:02:08,325 - INFO - Verified Pod ctest-pod-56631001 in agent 10.0.0.33 2025-05-29 02:02:08,325 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=502bc381-d434-49e1-86a4-9a34c69debed 2025-05-29 02:02:08,330 - INFO - Pod ctest-pod-56631001 with uuid 502bc381-d434-49e1-86a4-9a34c69debed found in kube manager 2025-05-29 02:02:08,330 - INFO - Pod ctest-pod-56631001 verification passed 2025-05-29 02:02:08,330 - INFO - ================================================================================ 2025-05-29 02:02:08,330 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-05-29 02:02:08,330 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-05-29 02:02:08,587 - DEBUG - Nothing to compare xmpp stats {'10.0.0.33': {'10.0.0.33': '2'}} with 2025-05-29 02:02:08,587 - INFO - Initial checks done. Running the testcase now 2025-05-29 02:02:08,587 - INFO - 2025-05-29 02:02:08,676 - DEBUG - [Pod ctest-pod-73716987] Cmd: echo ctest-pod-73716987 > /usr/share/nginx/html/index.html, Output: 2025-05-29 02:02:08,750 - DEBUG - [Pod ctest-pod-11652381] Cmd: echo ctest-pod-11652381 > /usr/share/nginx/html/index.html, Output: 2025-05-29 02:02:08,842 - DEBUG - [Pod ctest-pod-88070979] Cmd: echo ctest-pod-88070979 > /usr/share/nginx/html/index.html, Output: 2025-05-29 02:02:08,922 - DEBUG - [Pod ctest-pod-02939721] Cmd: echo ctest-pod-02939721 > /usr/share/nginx/html/index.html, Output: 2025-05-29 02:02:08,926 - DEBUG - Service ctest-nginx-svc-04299765 not present 2025-05-29 02:02:08,926 - INFO - Creating service ctest-nginx-svc-04299765 2025-05-29 02:02:08,939 - INFO - Created Service ctest-nginx-svc-04299765 2025-05-29 02:02:08,950 - WARNING - Service UUID 3f9a7f51-1f13-41f1-931b-977a20ec609c not yet found in contrail-api 2025-05-29 02:02:09,974 - INFO - Validated that Service ctest-nginx-svc-04299765 is seen in contrail-api 2025-05-29 02:02:09,974 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_LoadbalancerDatabaseList?x=3f9a7f51-1f13-41f1-931b-977a20ec609c 2025-05-29 02:02:09,983 - INFO - Service ctest-nginx-svc-04299765 with uuid 3f9a7f51-1f13-41f1-931b-977a20ec609c found in kube manager 2025-05-29 02:02:09,983 - INFO - Service ctest-nginx-svc-04299765 verification passed 2025-05-29 02:02:11,127 - DEBUG - [Pod ctest-pod-83802849] Cmd: wget http://10.99.137.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.137.14:80 (10.99.137.14:80) writing to stdout - ctest-pod-11652381 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-29 02:02:11,127 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd wget http://10.99.137.14:80/ -O - -T 5 -t 1 passed 2025-05-29 02:02:11,127 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd output: Connecting to 10.99.137.14:80 (10.99.137.14:80) writing to stdout - ctest-pod-11652381 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-29 02:02:11,264 - DEBUG - [Pod ctest-pod-83802849] Cmd: wget http://10.99.137.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.137.14:80 (10.99.137.14:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-11652381 2025-05-29 02:02:11,264 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd wget http://10.99.137.14:80/ -O - -T 5 -t 1 passed 2025-05-29 02:02:11,264 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd output: Connecting to 10.99.137.14:80 (10.99.137.14:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-11652381 2025-05-29 02:02:11,403 - DEBUG - [Pod ctest-pod-83802849] Cmd: wget http://10.99.137.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.137.14:80 (10.99.137.14:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-11652381 2025-05-29 02:02:11,403 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd wget http://10.99.137.14:80/ -O - -T 5 -t 1 passed 2025-05-29 02:02:11,403 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd output: Connecting to 10.99.137.14:80 (10.99.137.14:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-11652381 2025-05-29 02:02:11,505 - DEBUG - [Pod ctest-pod-83802849] Cmd: wget http://10.99.137.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.137.14:80 (10.99.137.14:80) ctest-pod-73716987 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-29 02:02:11,505 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd wget http://10.99.137.14:80/ -O - -T 5 -t 1 passed 2025-05-29 02:02:11,505 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd output: Connecting to 10.99.137.14:80 (10.99.137.14:80) ctest-pod-73716987 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-29 02:02:11,505 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-73716987': 1, 'ctest-pod-11652381': 3} 2025-05-29 02:02:11,582 - DEBUG - [Pod ctest-pod-22855860] Cmd: wget http://10.99.137.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.137.14:80 (10.99.137.14:80) ctest-pod-11652381 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-29 02:02:11,582 - DEBUG - [Pod Pod ctest-pod-22855860] Cmd wget http://10.99.137.14:80/ -O - -T 5 -t 1 passed 2025-05-29 02:02:11,582 - DEBUG - [Pod Pod ctest-pod-22855860] Cmd output: Connecting to 10.99.137.14:80 (10.99.137.14:80) ctest-pod-11652381 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-29 02:02:11,663 - DEBUG - [Pod ctest-pod-22855860] Cmd: wget http://10.99.137.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.137.14:80 (10.99.137.14:80) writing to stdout ctest-pod-73716987 - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-29 02:02:11,663 - DEBUG - [Pod Pod ctest-pod-22855860] Cmd wget http://10.99.137.14:80/ -O - -T 5 -t 1 passed 2025-05-29 02:02:11,663 - DEBUG - [Pod Pod ctest-pod-22855860] Cmd output: Connecting to 10.99.137.14:80 (10.99.137.14:80) writing to stdout ctest-pod-73716987 - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-29 02:02:11,663 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-73716987': 1, 'ctest-pod-11652381': 1} 2025-05-29 02:02:11,667 - DEBUG - Network policy ingress-on-service not present 2025-05-29 02:02:11,667 - INFO - Creating Network Policy ingress-on-service 2025-05-29 02:02:11,681 - INFO - Network policy found in k8s 2025-05-29 02:02:11,681 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=8ee35051-1810-4524-b93e-40ac0d404a8e 2025-05-29 02:02:11,690 - INFO - Network Policy ingress-on-service with uuid 8ee35051-1810-4524-b93e-40ac0d404a8e found in kube manager 2025-05-29 02:02:11,725 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-05-29 02:02:11,725 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-05-29 02:02:11,725 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=8ee35051-1810-4524-b93e-40ac0d404a8e 2025-05-29 02:02:11,758 - WARNING - Network policy with name ingress-on-service not found in agent 2025-05-29 02:02:13,759 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=8ee35051-1810-4524-b93e-40ac0d404a8e 2025-05-29 02:02:13,792 - WARNING - Network policy with name ingress-on-service not found in agent 2025-05-29 02:02:15,794 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=8ee35051-1810-4524-b93e-40ac0d404a8e 2025-05-29 02:02:15,823 - INFO - Network policy with name ingress-on-service found in agent 2025-05-29 02:02:15,823 - INFO - Network Policy ingress-on-service verification passed 2025-05-29 02:02:20,893 - DEBUG - [Pod ctest-pod-83802849] Cmd: wget http://10.99.137.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:02:20,893 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd wget http://10.99.137.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:02:20,893 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:02:25,985 - DEBUG - [Pod ctest-pod-83802849] Cmd: wget http://10.99.137.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:02:25,985 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd wget http://10.99.137.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:02:25,985 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:02:31,058 - DEBUG - [Pod ctest-pod-83802849] Cmd: wget http://10.99.137.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:02:31,058 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd wget http://10.99.137.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:02:31,058 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:02:36,132 - DEBUG - [Pod ctest-pod-83802849] Cmd: wget http://10.99.137.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:02:36,132 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd wget http://10.99.137.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:02:36,132 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:02:41,205 - DEBUG - [Pod ctest-pod-83802849] Cmd: wget http://10.99.137.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:02:41,205 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd wget http://10.99.137.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:02:41,205 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:02:46,277 - DEBUG - [Pod ctest-pod-83802849] Cmd: wget http://10.99.137.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:02:46,277 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd wget http://10.99.137.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:02:46,277 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:02:51,353 - DEBUG - [Pod ctest-pod-83802849] Cmd: wget http://10.99.137.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:02:51,353 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd wget http://10.99.137.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:02:51,353 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:02:56,440 - DEBUG - [Pod ctest-pod-83802849] Cmd: wget http://10.99.137.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:02:56,440 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd wget http://10.99.137.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:02:56,440 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:03:01,511 - DEBUG - [Pod ctest-pod-83802849] Cmd: wget http://10.99.137.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:03:01,511 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd wget http://10.99.137.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:03:01,511 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:03:06,588 - DEBUG - [Pod ctest-pod-83802849] Cmd: wget http://10.99.137.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:03:06,588 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd wget http://10.99.137.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:03:06,588 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:03:06,588 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-73716987': 0, 'ctest-pod-11652381': 0} 2025-05-29 02:03:06,667 - DEBUG - [Pod ctest-pod-14562376] Cmd: wget http://10.99.137.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.137.14:80 (10.99.137.14:80) ctest-pod-11652381 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-29 02:03:06,668 - DEBUG - [Pod Pod ctest-pod-14562376] Cmd wget http://10.99.137.14:80/ -O - -T 5 -t 1 passed 2025-05-29 02:03:06,668 - DEBUG - [Pod Pod ctest-pod-14562376] Cmd output: Connecting to 10.99.137.14:80 (10.99.137.14:80) ctest-pod-11652381 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-29 02:03:06,740 - DEBUG - [Pod ctest-pod-14562376] Cmd: wget http://10.99.137.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.137.14:80 (10.99.137.14:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-73716987 2025-05-29 02:03:06,740 - DEBUG - [Pod Pod ctest-pod-14562376] Cmd wget http://10.99.137.14:80/ -O - -T 5 -t 1 passed 2025-05-29 02:03:06,740 - DEBUG - [Pod Pod ctest-pod-14562376] Cmd output: Connecting to 10.99.137.14:80 (10.99.137.14:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-73716987 2025-05-29 02:03:06,740 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-73716987': 1, 'ctest-pod-11652381': 1} 2025-05-29 02:03:11,832 - DEBUG - [Pod ctest-pod-22855860] Cmd: wget http://10.99.137.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:03:11,832 - DEBUG - [Pod Pod ctest-pod-22855860] Cmd wget http://10.99.137.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:03:11,832 - DEBUG - [Pod Pod ctest-pod-22855860] Cmd output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:03:16,911 - DEBUG - [Pod ctest-pod-22855860] Cmd: wget http://10.99.137.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:03:16,911 - DEBUG - [Pod Pod ctest-pod-22855860] Cmd wget http://10.99.137.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:03:16,911 - DEBUG - [Pod Pod ctest-pod-22855860] Cmd output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:03:21,992 - DEBUG - [Pod ctest-pod-22855860] Cmd: wget http://10.99.137.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:03:21,992 - DEBUG - [Pod Pod ctest-pod-22855860] Cmd wget http://10.99.137.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:03:21,992 - DEBUG - [Pod Pod ctest-pod-22855860] Cmd output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:03:27,088 - DEBUG - [Pod ctest-pod-22855860] Cmd: wget http://10.99.137.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:03:27,088 - DEBUG - [Pod Pod ctest-pod-22855860] Cmd wget http://10.99.137.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:03:27,088 - DEBUG - [Pod Pod ctest-pod-22855860] Cmd output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:03:32,164 - DEBUG - [Pod ctest-pod-22855860] Cmd: wget http://10.99.137.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:03:32,164 - DEBUG - [Pod Pod ctest-pod-22855860] Cmd wget http://10.99.137.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:03:32,164 - DEBUG - [Pod Pod ctest-pod-22855860] Cmd output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:03:37,247 - DEBUG - [Pod ctest-pod-22855860] Cmd: wget http://10.99.137.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:03:37,248 - DEBUG - [Pod Pod ctest-pod-22855860] Cmd wget http://10.99.137.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:03:37,248 - DEBUG - [Pod Pod ctest-pod-22855860] Cmd output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:03:42,327 - DEBUG - [Pod ctest-pod-22855860] Cmd: wget http://10.99.137.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:03:42,327 - DEBUG - [Pod Pod ctest-pod-22855860] Cmd wget http://10.99.137.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:03:42,327 - DEBUG - [Pod Pod ctest-pod-22855860] Cmd output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:03:47,397 - DEBUG - [Pod ctest-pod-22855860] Cmd: wget http://10.99.137.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:03:47,398 - DEBUG - [Pod Pod ctest-pod-22855860] Cmd wget http://10.99.137.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:03:47,398 - DEBUG - [Pod Pod ctest-pod-22855860] Cmd output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:03:52,465 - DEBUG - [Pod ctest-pod-22855860] Cmd: wget http://10.99.137.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:03:52,465 - DEBUG - [Pod Pod ctest-pod-22855860] Cmd wget http://10.99.137.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:03:52,465 - DEBUG - [Pod Pod ctest-pod-22855860] Cmd output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:03:57,543 - DEBUG - [Pod ctest-pod-22855860] Cmd: wget http://10.99.137.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:03:57,543 - DEBUG - [Pod Pod ctest-pod-22855860] Cmd wget http://10.99.137.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:03:57,543 - DEBUG - [Pod Pod ctest-pod-22855860] Cmd output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:03:57,543 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-73716987': 0, 'ctest-pod-11652381': 0} 2025-05-29 02:03:59,615 - DEBUG - [Pod ctest-pod-14562376] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.494 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.059 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.068 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.059/0.207/0.494 ms 2025-05-29 02:03:59,615 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-14562376 with expectation True passed 2025-05-29 02:04:01,688 - DEBUG - [Pod ctest-pod-83802849] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.420 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.076 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.071 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.189/0.420 ms 2025-05-29 02:04:01,688 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-83802849 with expectation True passed 2025-05-29 02:04:03,779 - DEBUG - [Pod ctest-pod-22855860] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.939 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.059 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.071 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.059/0.356/0.939 ms 2025-05-29 02:04:03,779 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-22855860 with expectation True passed 2025-05-29 02:04:03,855 - DEBUG - [Pod ctest-pod-14562376] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-29 02:04:03,855 - DEBUG - [Pod Pod ctest-pod-14562376] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-05-29 02:04:03,855 - DEBUG - [Pod Pod ctest-pod-14562376] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-29 02:04:03,855 - INFO - wget check of of http://10.47.255.250 from ctest-pod-14562376 passed 2025-05-29 02:04:04,003 - DEBUG - [Pod ctest-pod-14562376] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-29 02:04:04,003 - DEBUG - [Pod Pod ctest-pod-14562376] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 passed 2025-05-29 02:04:04,003 - DEBUG - [Pod Pod ctest-pod-14562376] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-29 02:04:04,004 - INFO - wget check of of http://10.47.255.249 from ctest-pod-14562376 passed 2025-05-29 02:04:09,089 - DEBUG - [Pod ctest-pod-83802849] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2025-05-29 02:04:09,089 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2025-05-29 02:04:09,089 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2025-05-29 02:04:09,089 - INFO - wget check of of http://10.47.255.249 from ctest-pod-83802849 passed 2025-05-29 02:04:14,185 - DEBUG - [Pod ctest-pod-56631001] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-05-29 02:04:14,185 - DEBUG - [Pod Pod ctest-pod-56631001] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-05-29 02:04:14,185 - DEBUG - [Pod Pod ctest-pod-56631001] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-05-29 02:04:14,185 - INFO - wget check of of http://10.47.255.250 from ctest-pod-56631001 passed 2025-05-29 02:04:14,196 - INFO - Updating Network Policy ingress-on-service 2025-05-29 02:04:19,288 - DEBUG - [Pod ctest-pod-83802849] Cmd: wget http://10.99.137.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:04:19,288 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd wget http://10.99.137.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:04:19,288 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:04:24,374 - DEBUG - [Pod ctest-pod-83802849] Cmd: wget http://10.99.137.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:04:24,375 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd wget http://10.99.137.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:04:24,375 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:04:29,471 - DEBUG - [Pod ctest-pod-83802849] Cmd: wget http://10.99.137.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:04:29,471 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd wget http://10.99.137.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:04:29,471 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:04:34,548 - DEBUG - [Pod ctest-pod-83802849] Cmd: wget http://10.99.137.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:04:34,548 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd wget http://10.99.137.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:04:34,548 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:04:39,618 - DEBUG - [Pod ctest-pod-83802849] Cmd: wget http://10.99.137.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:04:39,619 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd wget http://10.99.137.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:04:39,619 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:04:44,694 - DEBUG - [Pod ctest-pod-83802849] Cmd: wget http://10.99.137.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:04:44,694 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd wget http://10.99.137.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:04:44,694 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:04:49,785 - DEBUG - [Pod ctest-pod-83802849] Cmd: wget http://10.99.137.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:04:49,785 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd wget http://10.99.137.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:04:49,785 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:04:54,873 - DEBUG - [Pod ctest-pod-83802849] Cmd: wget http://10.99.137.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:04:54,873 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd wget http://10.99.137.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:04:54,873 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:04:59,946 - DEBUG - [Pod ctest-pod-83802849] Cmd: wget http://10.99.137.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:04:59,946 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd wget http://10.99.137.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:04:59,946 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:05:05,021 - DEBUG - [Pod ctest-pod-83802849] Cmd: wget http://10.99.137.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:05:05,022 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd wget http://10.99.137.14:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:05:05,022 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd output: Connecting to 10.99.137.14:80 (10.99.137.14:80) wget: download timed out 2025-05-29 02:05:05,022 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-73716987': 0, 'ctest-pod-11652381': 0} 2025-05-29 02:05:05,095 - DEBUG - [Pod ctest-pod-14562376] Cmd: wget http://10.99.137.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.137.14:80 (10.99.137.14:80) ctest-pod-73716987 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-29 02:05:05,095 - DEBUG - [Pod Pod ctest-pod-14562376] Cmd wget http://10.99.137.14:80/ -O - -T 5 -t 1 passed 2025-05-29 02:05:05,095 - DEBUG - [Pod Pod ctest-pod-14562376] Cmd output: Connecting to 10.99.137.14:80 (10.99.137.14:80) ctest-pod-73716987 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-29 02:05:05,169 - DEBUG - [Pod ctest-pod-14562376] Cmd: wget http://10.99.137.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.137.14:80 (10.99.137.14:80) ctest-pod-73716987 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-29 02:05:05,170 - DEBUG - [Pod Pod ctest-pod-14562376] Cmd wget http://10.99.137.14:80/ -O - -T 5 -t 1 passed 2025-05-29 02:05:05,170 - DEBUG - [Pod Pod ctest-pod-14562376] Cmd output: Connecting to 10.99.137.14:80 (10.99.137.14:80) ctest-pod-73716987 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-29 02:05:05,260 - DEBUG - [Pod ctest-pod-14562376] Cmd: wget http://10.99.137.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.137.14:80 (10.99.137.14:80) ctest-pod-73716987 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-29 02:05:05,261 - DEBUG - [Pod Pod ctest-pod-14562376] Cmd wget http://10.99.137.14:80/ -O - -T 5 -t 1 passed 2025-05-29 02:05:05,261 - DEBUG - [Pod Pod ctest-pod-14562376] Cmd output: Connecting to 10.99.137.14:80 (10.99.137.14:80) ctest-pod-73716987 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-29 02:05:05,334 - DEBUG - [Pod ctest-pod-14562376] Cmd: wget http://10.99.137.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.137.14:80 (10.99.137.14:80) ctest-pod-73716987 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-29 02:05:05,334 - DEBUG - [Pod Pod ctest-pod-14562376] Cmd wget http://10.99.137.14:80/ -O - -T 5 -t 1 passed 2025-05-29 02:05:05,334 - DEBUG - [Pod Pod ctest-pod-14562376] Cmd output: Connecting to 10.99.137.14:80 (10.99.137.14:80) ctest-pod-73716987 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-29 02:05:05,412 - DEBUG - [Pod ctest-pod-14562376] Cmd: wget http://10.99.137.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.137.14:80 (10.99.137.14:80) ctest-pod-11652381 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-29 02:05:05,412 - DEBUG - [Pod Pod ctest-pod-14562376] Cmd wget http://10.99.137.14:80/ -O - -T 5 -t 1 passed 2025-05-29 02:05:05,412 - DEBUG - [Pod Pod ctest-pod-14562376] Cmd output: Connecting to 10.99.137.14:80 (10.99.137.14:80) ctest-pod-11652381 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-29 02:05:05,412 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-73716987': 4, 'ctest-pod-11652381': 1} 2025-05-29 02:05:05,479 - DEBUG - [Pod ctest-pod-22855860] Cmd: wget http://10.99.137.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.137.14:80 (10.99.137.14:80) ctest-pod-11652381 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-29 02:05:05,480 - DEBUG - [Pod Pod ctest-pod-22855860] Cmd wget http://10.99.137.14:80/ -O - -T 5 -t 1 passed 2025-05-29 02:05:05,480 - DEBUG - [Pod Pod ctest-pod-22855860] Cmd output: Connecting to 10.99.137.14:80 (10.99.137.14:80) ctest-pod-11652381 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-29 02:05:05,556 - DEBUG - [Pod ctest-pod-22855860] Cmd: wget http://10.99.137.14:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.137.14:80 (10.99.137.14:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-73716987 2025-05-29 02:05:05,557 - DEBUG - [Pod Pod ctest-pod-22855860] Cmd wget http://10.99.137.14:80/ -O - -T 5 -t 1 passed 2025-05-29 02:05:05,557 - DEBUG - [Pod Pod ctest-pod-22855860] Cmd output: Connecting to 10.99.137.14:80 (10.99.137.14:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-73716987 2025-05-29 02:05:05,557 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-73716987': 1, 'ctest-pod-11652381': 1} 2025-05-29 02:05:07,633 - DEBUG - [Pod ctest-pod-14562376] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.355 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.075 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.060 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.060/0.496/1.355 ms 2025-05-29 02:05:07,634 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-14562376 with expectation True passed 2025-05-29 02:05:09,704 - DEBUG - [Pod ctest-pod-83802849] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=2.068 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.069 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.081 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.069/0.739/2.068 ms 2025-05-29 02:05:09,704 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-83802849 with expectation True passed 2025-05-29 02:05:11,784 - DEBUG - [Pod ctest-pod-22855860] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=1.286 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.058 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.061 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.058/0.468/1.286 ms 2025-05-29 02:05:11,784 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-22855860 with expectation True passed 2025-05-29 02:05:11,862 - DEBUG - [Pod ctest-pod-14562376] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-29 02:05:11,862 - DEBUG - [Pod Pod ctest-pod-14562376] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-05-29 02:05:11,862 - DEBUG - [Pod Pod ctest-pod-14562376] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-29 02:05:11,862 - INFO - wget check of of http://10.47.255.250 from ctest-pod-14562376 passed 2025-05-29 02:05:11,949 - DEBUG - [Pod ctest-pod-14562376] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-29 02:05:11,949 - DEBUG - [Pod Pod ctest-pod-14562376] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 passed 2025-05-29 02:05:11,949 - DEBUG - [Pod Pod ctest-pod-14562376] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-29 02:05:11,949 - INFO - wget check of of http://10.47.255.249 from ctest-pod-14562376 passed 2025-05-29 02:05:17,026 - DEBUG - [Pod ctest-pod-83802849] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2025-05-29 02:05:17,026 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2025-05-29 02:05:17,027 - DEBUG - [Pod Pod ctest-pod-83802849] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2025-05-29 02:05:17,027 - INFO - wget check of of http://10.47.255.249 from ctest-pod-83802849 passed 2025-05-29 02:05:17,121 - DEBUG - [Pod ctest-pod-56631001] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-29 02:05:17,121 - DEBUG - [Pod Pod ctest-pod-56631001] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-05-29 02:05:17,121 - DEBUG - [Pod Pod ctest-pod-56631001] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-29 02:05:17,121 - INFO - wget check of of http://10.47.255.250 from ctest-pod-56631001 passed 2025-05-29 02:05:17,121 - INFO - Deleting Network Policy : ingress-on-service 2025-05-29 02:05:17,122 - INFO - Deleting service : ctest-nginx-svc-04299765 2025-05-29 02:05:17,722 - DEBUG - No XMPP flaps were noticed during the test