2025-01-09 11:28:20,992 - INFO - Using existing project ['default-domain', 'k8s-default'](0d83d382-380d-4c7c-a8eb-fbb4b143bd8d) 2025-01-09 11:28:21,019 - DEBUG - Namespace ctest-new-default-19815104 not present 2025-01-09 11:28:21,027 - INFO - Created namespace ctest-new-default-19815104 2025-01-09 11:28:24,037 - DEBUG - Namespace ctest-non-default-81250293 not present 2025-01-09 11:28:24,056 - INFO - Created namespace ctest-non-default-81250293 2025-01-09 11:28:27,071 - DEBUG - Pod ctest-pod-49105426 not present 2025-01-09 11:28:27,072 - INFO - Creating Pod ctest-pod-49105426 2025-01-09 11:28:27,096 - DEBUG - Pod : ctest-pod-49105426 UUID is 37052e64-9e56-450b-b6f3-b80330ff71ab 2025-01-09 11:28:27,101 - DEBUG - Pod ctest-pod-30311767 not present 2025-01-09 11:28:27,102 - INFO - Creating Pod ctest-pod-30311767 2025-01-09 11:28:27,129 - DEBUG - Pod : ctest-pod-30311767 UUID is 2e29a5f8-21f5-45d5-bf0d-37d17c6c67b3 2025-01-09 11:28:27,132 - DEBUG - Pod ctest-pod-65536025 not present 2025-01-09 11:28:27,132 - INFO - Creating Pod ctest-pod-65536025 2025-01-09 11:28:27,176 - DEBUG - Pod : ctest-pod-65536025 UUID is 4b946861-5a8f-4ec3-97dd-f37002711800 2025-01-09 11:28:27,179 - DEBUG - Pod ctest-pod-48235813 not present 2025-01-09 11:28:27,179 - INFO - Creating Pod ctest-pod-48235813 2025-01-09 11:28:27,227 - DEBUG - Pod : ctest-pod-48235813 UUID is 26b7b90a-ce7a-4854-aec0-ecdaceb5bd03 2025-01-09 11:28:27,230 - DEBUG - Pod ctest-pod-12096466 not present 2025-01-09 11:28:27,230 - INFO - Creating Pod ctest-pod-12096466 2025-01-09 11:28:27,253 - DEBUG - Pod : ctest-pod-12096466 UUID is c4bbeea3-40a4-4160-83c1-8414a09cae15 2025-01-09 11:28:27,255 - DEBUG - Pod ctest-pod-23600442 not present 2025-01-09 11:28:27,255 - INFO - Creating Pod ctest-pod-23600442 2025-01-09 11:28:27,272 - DEBUG - Pod : ctest-pod-23600442 UUID is a348f126-8002-4ef1-938f-62ccac90b261 2025-01-09 11:28:27,274 - DEBUG - Pod ctest-pod-89008232 not present 2025-01-09 11:28:27,274 - INFO - Creating Pod ctest-pod-89008232 2025-01-09 11:28:27,289 - DEBUG - Pod : ctest-pod-89008232 UUID is 2f74d546-1115-4c9a-be6a-46605e2d1822 2025-01-09 11:28:27,291 - DEBUG - Pod ctest-pod-44761850 not present 2025-01-09 11:28:27,291 - INFO - Creating Pod ctest-pod-44761850 2025-01-09 11:28:27,317 - DEBUG - Pod : ctest-pod-44761850 UUID is 104ccc96-e0ce-4ad6-b90f-0f4c7fda67db 2025-01-09 11:28:27,505 - INFO - Project default-domain:k8s-ctest-new-default-19815104 for Namespace ctest-new-default-19815104 is seen in contrail-api 2025-01-09 11:28:27,505 - DEBUG - Project uuid in Contrail is 20dd4f3a-0b35-4ab2-b12e-f9817620cbc7 2025-01-09 11:28:27,636 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_NamespaceDatabaseList?namespace_uuid=fa926395-f01c-4704-8773-9a996bf5d438 2025-01-09 11:28:27,641 - INFO - Namespace ctest-new-default-19815104 with uuid fa926395-f01c-4704-8773-9a996bf5d438 found in kube manager 2025-01-09 11:28:27,642 - INFO - Namespace ctest-new-default-19815104 verification passed 2025-01-09 11:28:27,832 - INFO - Project default-domain:k8s-ctest-non-default-81250293 for Namespace ctest-non-default-81250293 is seen in contrail-api 2025-01-09 11:28:27,832 - DEBUG - Project uuid in Contrail is f286adde-dec6-4f59-acd4-131d6c84841e 2025-01-09 11:28:27,832 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_NamespaceDatabaseList?namespace_uuid=cb9b4397-b910-4c26-8e92-4c0db58f2e9b 2025-01-09 11:28:27,837 - INFO - Namespace ctest-non-default-81250293 with uuid cb9b4397-b910-4c26-8e92-4c0db58f2e9b found in kube manager 2025-01-09 11:28:27,837 - INFO - Namespace ctest-non-default-81250293 verification passed 2025-01-09 11:28:27,843 - DEBUG - Pod ctest-pod-49105426 not in running state.Currently in Pending 2025-01-09 11:28:32,849 - DEBUG - Pod ctest-pod-49105426 not in running state.Currently in Pending 2025-01-09 11:28:37,856 - INFO - Pod ctest-pod-49105426 is in running state.Got IP 10.47.255.251 2025-01-09 11:28:37,870 - DEBUG - Pod ctest-pod-49105426 has vmi d955bc5a-ce7c-11ef-90ad-fa163e5fe9e2 2025-01-09 11:28:37,870 - INFO - Verified pod ctest-pod-49105426 in contrail-api 2025-01-09 11:28:37,888 - DEBUG - VMI d955bc5a-ce7c-11ef-90ad-fa163e5fe9e2 is active in agent 10.0.0.33 2025-01-09 11:28:37,888 - INFO - Verified Pod ctest-pod-49105426 in agent 10.0.0.33 2025-01-09 11:28:37,888 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=37052e64-9e56-450b-b6f3-b80330ff71ab 2025-01-09 11:28:37,893 - INFO - Pod ctest-pod-49105426 with uuid 37052e64-9e56-450b-b6f3-b80330ff71ab found in kube manager 2025-01-09 11:28:37,893 - INFO - Pod ctest-pod-49105426 verification passed 2025-01-09 11:28:37,898 - INFO - Pod ctest-pod-30311767 is in running state.Got IP 10.47.255.250 2025-01-09 11:28:37,953 - DEBUG - Pod ctest-pod-30311767 has vmi d9c5108c-ce7c-11ef-90ad-fa163e5fe9e2 2025-01-09 11:28:37,954 - INFO - Verified pod ctest-pod-30311767 in contrail-api 2025-01-09 11:28:37,964 - DEBUG - VMI d9c5108c-ce7c-11ef-90ad-fa163e5fe9e2 is active in agent 10.0.0.33 2025-01-09 11:28:37,964 - INFO - Verified Pod ctest-pod-30311767 in agent 10.0.0.33 2025-01-09 11:28:37,964 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=2e29a5f8-21f5-45d5-bf0d-37d17c6c67b3 2025-01-09 11:28:37,969 - INFO - Pod ctest-pod-30311767 with uuid 2e29a5f8-21f5-45d5-bf0d-37d17c6c67b3 found in kube manager 2025-01-09 11:28:37,969 - INFO - Pod ctest-pod-30311767 verification passed 2025-01-09 11:28:37,973 - DEBUG - Pod ctest-pod-65536025 not in running state.Currently in Pending 2025-01-09 11:28:42,980 - INFO - Pod ctest-pod-65536025 is in running state.Got IP 10.47.255.249 2025-01-09 11:28:42,996 - DEBUG - Pod ctest-pod-65536025 has vmi da84d2aa-ce7c-11ef-90ad-fa163e5fe9e2 2025-01-09 11:28:42,996 - INFO - Verified pod ctest-pod-65536025 in contrail-api 2025-01-09 11:28:43,013 - DEBUG - VMI da84d2aa-ce7c-11ef-90ad-fa163e5fe9e2 is active in agent 10.0.0.33 2025-01-09 11:28:43,014 - INFO - Verified Pod ctest-pod-65536025 in agent 10.0.0.33 2025-01-09 11:28:43,014 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=4b946861-5a8f-4ec3-97dd-f37002711800 2025-01-09 11:28:43,019 - INFO - Pod ctest-pod-65536025 with uuid 4b946861-5a8f-4ec3-97dd-f37002711800 found in kube manager 2025-01-09 11:28:43,019 - INFO - Pod ctest-pod-65536025 verification passed 2025-01-09 11:28:43,024 - INFO - Pod ctest-pod-48235813 is in running state.Got IP 10.47.255.248 2025-01-09 11:28:43,081 - DEBUG - Pod ctest-pod-48235813 has vmi db02acca-ce7c-11ef-90ad-fa163e5fe9e2 2025-01-09 11:28:43,082 - INFO - Verified pod ctest-pod-48235813 in contrail-api 2025-01-09 11:28:43,095 - DEBUG - VMI db02acca-ce7c-11ef-90ad-fa163e5fe9e2 is active in agent 10.0.0.33 2025-01-09 11:28:43,095 - INFO - Verified Pod ctest-pod-48235813 in agent 10.0.0.33 2025-01-09 11:28:43,095 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=26b7b90a-ce7a-4854-aec0-ecdaceb5bd03 2025-01-09 11:28:43,101 - INFO - Pod ctest-pod-48235813 with uuid 26b7b90a-ce7a-4854-aec0-ecdaceb5bd03 found in kube manager 2025-01-09 11:28:43,101 - INFO - Pod ctest-pod-48235813 verification passed 2025-01-09 11:28:43,106 - INFO - Pod ctest-pod-12096466 is in running state.Got IP 10.47.255.247 2025-01-09 11:28:43,122 - DEBUG - Pod ctest-pod-12096466 has vmi db98686e-ce7c-11ef-90ad-fa163e5fe9e2 2025-01-09 11:28:43,122 - INFO - Verified pod ctest-pod-12096466 in contrail-api 2025-01-09 11:28:43,136 - DEBUG - VMI db98686e-ce7c-11ef-90ad-fa163e5fe9e2 is active in agent 10.0.0.33 2025-01-09 11:28:43,136 - INFO - Verified Pod ctest-pod-12096466 in agent 10.0.0.33 2025-01-09 11:28:43,136 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=c4bbeea3-40a4-4160-83c1-8414a09cae15 2025-01-09 11:28:43,141 - INFO - Pod ctest-pod-12096466 with uuid c4bbeea3-40a4-4160-83c1-8414a09cae15 found in kube manager 2025-01-09 11:28:43,141 - INFO - Pod ctest-pod-12096466 verification passed 2025-01-09 11:28:43,147 - DEBUG - Pod ctest-pod-89008232 not in running state.Currently in Pending 2025-01-09 11:28:48,153 - INFO - Pod ctest-pod-89008232 is in running state.Got IP 10.47.255.245 2025-01-09 11:28:48,209 - DEBUG - Pod ctest-pod-89008232 has vmi dc900452-ce7c-11ef-90ad-fa163e5fe9e2 2025-01-09 11:28:48,210 - INFO - Verified pod ctest-pod-89008232 in contrail-api 2025-01-09 11:28:48,225 - DEBUG - VMI dc900452-ce7c-11ef-90ad-fa163e5fe9e2 is active in agent 10.0.0.33 2025-01-09 11:28:48,225 - INFO - Verified Pod ctest-pod-89008232 in agent 10.0.0.33 2025-01-09 11:28:48,225 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=2f74d546-1115-4c9a-be6a-46605e2d1822 2025-01-09 11:28:48,230 - INFO - Pod ctest-pod-89008232 with uuid 2f74d546-1115-4c9a-be6a-46605e2d1822 found in kube manager 2025-01-09 11:28:48,230 - INFO - Pod ctest-pod-89008232 verification passed 2025-01-09 11:28:48,237 - INFO - Pod ctest-pod-23600442 is in running state.Got IP 10.47.255.246 2025-01-09 11:28:48,252 - DEBUG - Pod ctest-pod-23600442 has vmi dc1634e2-ce7c-11ef-90ad-fa163e5fe9e2 2025-01-09 11:28:48,252 - INFO - Verified pod ctest-pod-23600442 in contrail-api 2025-01-09 11:28:48,266 - DEBUG - VMI dc1634e2-ce7c-11ef-90ad-fa163e5fe9e2 is active in agent 10.0.0.33 2025-01-09 11:28:48,266 - INFO - Verified Pod ctest-pod-23600442 in agent 10.0.0.33 2025-01-09 11:28:48,266 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=a348f126-8002-4ef1-938f-62ccac90b261 2025-01-09 11:28:48,271 - INFO - Pod ctest-pod-23600442 with uuid a348f126-8002-4ef1-938f-62ccac90b261 found in kube manager 2025-01-09 11:28:48,271 - INFO - Pod ctest-pod-23600442 verification passed 2025-01-09 11:28:48,276 - INFO - Pod ctest-pod-44761850 is in running state.Got IP 10.47.255.244 2025-01-09 11:28:48,334 - DEBUG - Pod ctest-pod-44761850 has vmi dd16b89e-ce7c-11ef-90ad-fa163e5fe9e2 2025-01-09 11:28:48,334 - INFO - Verified pod ctest-pod-44761850 in contrail-api 2025-01-09 11:28:48,350 - DEBUG - VMI dd16b89e-ce7c-11ef-90ad-fa163e5fe9e2 is active in agent 10.0.0.33 2025-01-09 11:28:48,350 - INFO - Verified Pod ctest-pod-44761850 in agent 10.0.0.33 2025-01-09 11:28:48,350 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=104ccc96-e0ce-4ad6-b90f-0f4c7fda67db 2025-01-09 11:28:48,357 - INFO - Pod ctest-pod-44761850 with uuid 104ccc96-e0ce-4ad6-b90f-0f4c7fda67db found in kube manager 2025-01-09 11:28:48,357 - INFO - Pod ctest-pod-44761850 verification passed 2025-01-09 11:28:48,357 - INFO - ================================================================================ 2025-01-09 11:28:48,357 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-01-09 11:28:48,357 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-01-09 11:28:48,610 - DEBUG - Nothing to compare xmpp stats {'10.0.0.33': {'10.0.0.23': '0'}} with 2025-01-09 11:28:48,610 - INFO - Initial checks done. Running the testcase now 2025-01-09 11:28:48,610 - INFO - 2025-01-09 11:28:48,674 - DEBUG - [Pod ctest-pod-49105426] Cmd: echo ctest-pod-49105426 > /usr/share/nginx/html/index.html, Output: 2025-01-09 11:28:48,730 - DEBUG - [Pod ctest-pod-30311767] Cmd: echo ctest-pod-30311767 > /usr/share/nginx/html/index.html, Output: 2025-01-09 11:28:48,791 - DEBUG - [Pod ctest-pod-65536025] Cmd: echo ctest-pod-65536025 > /usr/share/nginx/html/index.html, Output: 2025-01-09 11:28:48,866 - DEBUG - [Pod ctest-pod-48235813] Cmd: echo ctest-pod-48235813 > /usr/share/nginx/html/index.html, Output: 2025-01-09 11:28:48,869 - DEBUG - Service ctest-nginx-svc-57190021 not present 2025-01-09 11:28:48,869 - INFO - Creating service ctest-nginx-svc-57190021 2025-01-09 11:28:48,892 - INFO - Created Service ctest-nginx-svc-57190021 2025-01-09 11:28:48,902 - WARNING - Service UUID a35f9073-f36c-41a2-9429-26390f8fcc86 not yet found in contrail-api 2025-01-09 11:28:49,910 - INFO - Validated that Service ctest-nginx-svc-57190021 is seen in contrail-api 2025-01-09 11:28:49,910 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_LoadbalancerDatabaseList?x=a35f9073-f36c-41a2-9429-26390f8fcc86 2025-01-09 11:28:49,915 - INFO - Service ctest-nginx-svc-57190021 with uuid a35f9073-f36c-41a2-9429-26390f8fcc86 found in kube manager 2025-01-09 11:28:49,915 - INFO - Service ctest-nginx-svc-57190021 verification passed 2025-01-09 11:28:51,004 - DEBUG - [Pod ctest-pod-12096466] Cmd: wget http://10.105.254.5:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.254.5:80 (10.105.254.5:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-30311767 2025-01-09 11:28:51,004 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd wget http://10.105.254.5:80/ -O - -T 5 -t 1 passed 2025-01-09 11:28:51,004 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd output: Connecting to 10.105.254.5:80 (10.105.254.5:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-30311767 2025-01-09 11:28:51,067 - DEBUG - [Pod ctest-pod-12096466] Cmd: wget http://10.105.254.5:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.254.5:80 (10.105.254.5:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-49105426 2025-01-09 11:28:51,067 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd wget http://10.105.254.5:80/ -O - -T 5 -t 1 passed 2025-01-09 11:28:51,067 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd output: Connecting to 10.105.254.5:80 (10.105.254.5:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-49105426 2025-01-09 11:28:51,067 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-49105426': 1, 'ctest-pod-30311767': 1} 2025-01-09 11:28:51,129 - DEBUG - [Pod ctest-pod-89008232] Cmd: wget http://10.105.254.5:80/ -O - -T 5 -t 1 , Output: ctest-pod-30311767 Connecting to 10.105.254.5:80 (10.105.254.5:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 11:28:51,129 - DEBUG - [Pod Pod ctest-pod-89008232] Cmd wget http://10.105.254.5:80/ -O - -T 5 -t 1 passed 2025-01-09 11:28:51,129 - DEBUG - [Pod Pod ctest-pod-89008232] Cmd output: ctest-pod-30311767 Connecting to 10.105.254.5:80 (10.105.254.5:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 11:28:51,196 - DEBUG - [Pod ctest-pod-89008232] Cmd: wget http://10.105.254.5:80/ -O - -T 5 -t 1 , Output: ctest-pod-30311767 Connecting to 10.105.254.5:80 (10.105.254.5:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 11:28:51,197 - DEBUG - [Pod Pod ctest-pod-89008232] Cmd wget http://10.105.254.5:80/ -O - -T 5 -t 1 passed 2025-01-09 11:28:51,197 - DEBUG - [Pod Pod ctest-pod-89008232] Cmd output: ctest-pod-30311767 Connecting to 10.105.254.5:80 (10.105.254.5:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 11:28:51,261 - DEBUG - [Pod ctest-pod-89008232] Cmd: wget http://10.105.254.5:80/ -O - -T 5 -t 1 , Output: ctest-pod-49105426 Connecting to 10.105.254.5:80 (10.105.254.5:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 11:28:51,261 - DEBUG - [Pod Pod ctest-pod-89008232] Cmd wget http://10.105.254.5:80/ -O - -T 5 -t 1 passed 2025-01-09 11:28:51,262 - DEBUG - [Pod Pod ctest-pod-89008232] Cmd output: ctest-pod-49105426 Connecting to 10.105.254.5:80 (10.105.254.5:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 11:28:51,262 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-49105426': 1, 'ctest-pod-30311767': 2} 2025-01-09 11:28:51,268 - DEBUG - Network policy ingress-on-service not present 2025-01-09 11:28:51,359 - INFO - Creating Network Policy ingress-on-service 2025-01-09 11:28:51,373 - INFO - Network policy found in k8s 2025-01-09 11:28:51,373 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=b026f2fc-481b-4883-8f4c-e7ab506e18da 2025-01-09 11:28:51,386 - INFO - Network Policy ingress-on-service with uuid b026f2fc-481b-4883-8f4c-e7ab506e18da found in kube manager 2025-01-09 11:28:51,420 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-01-09 11:28:51,420 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-01-09 11:28:51,420 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=b026f2fc-481b-4883-8f4c-e7ab506e18da 2025-01-09 11:28:51,451 - WARNING - Network policy with name ingress-on-service not found in agent 2025-01-09 11:28:53,452 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=b026f2fc-481b-4883-8f4c-e7ab506e18da 2025-01-09 11:28:53,485 - INFO - Network policy with name ingress-on-service found in agent 2025-01-09 11:28:53,486 - INFO - Network Policy ingress-on-service verification passed 2025-01-09 11:28:58,548 - DEBUG - [Pod ctest-pod-12096466] Cmd: wget http://10.105.254.5:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:28:58,548 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd wget http://10.105.254.5:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:28:58,548 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:29:03,623 - DEBUG - [Pod ctest-pod-12096466] Cmd: wget http://10.105.254.5:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:29:03,623 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd wget http://10.105.254.5:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:29:03,623 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:29:08,709 - DEBUG - [Pod ctest-pod-12096466] Cmd: wget http://10.105.254.5:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:29:08,709 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd wget http://10.105.254.5:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:29:08,709 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:29:13,791 - DEBUG - [Pod ctest-pod-12096466] Cmd: wget http://10.105.254.5:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:29:13,791 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd wget http://10.105.254.5:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:29:13,791 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:29:18,848 - DEBUG - [Pod ctest-pod-12096466] Cmd: wget http://10.105.254.5:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:29:18,848 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd wget http://10.105.254.5:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:29:18,848 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:29:23,923 - DEBUG - [Pod ctest-pod-12096466] Cmd: wget http://10.105.254.5:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:29:23,923 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd wget http://10.105.254.5:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:29:23,923 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:29:29,013 - DEBUG - [Pod ctest-pod-12096466] Cmd: wget http://10.105.254.5:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:29:29,013 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd wget http://10.105.254.5:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:29:29,014 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:29:34,077 - DEBUG - [Pod ctest-pod-12096466] Cmd: wget http://10.105.254.5:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:29:34,077 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd wget http://10.105.254.5:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:29:34,078 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:29:39,134 - DEBUG - [Pod ctest-pod-12096466] Cmd: wget http://10.105.254.5:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:29:39,134 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd wget http://10.105.254.5:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:29:39,134 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:29:44,202 - DEBUG - [Pod ctest-pod-12096466] Cmd: wget http://10.105.254.5:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:29:44,202 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd wget http://10.105.254.5:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:29:44,202 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:29:44,202 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-49105426': 0, 'ctest-pod-30311767': 0} 2025-01-09 11:29:44,299 - DEBUG - [Pod ctest-pod-23600442] Cmd: wget http://10.105.254.5:80/ -O - -T 5 -t 1 , Output: ctest-pod-30311767 Connecting to 10.105.254.5:80 (10.105.254.5:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 11:29:44,300 - DEBUG - [Pod Pod ctest-pod-23600442] Cmd wget http://10.105.254.5:80/ -O - -T 5 -t 1 passed 2025-01-09 11:29:44,300 - DEBUG - [Pod Pod ctest-pod-23600442] Cmd output: ctest-pod-30311767 Connecting to 10.105.254.5:80 (10.105.254.5:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 11:29:44,372 - DEBUG - [Pod ctest-pod-23600442] Cmd: wget http://10.105.254.5:80/ -O - -T 5 -t 1 , Output: ctest-pod-30311767 Connecting to 10.105.254.5:80 (10.105.254.5:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 11:29:44,372 - DEBUG - [Pod Pod ctest-pod-23600442] Cmd wget http://10.105.254.5:80/ -O - -T 5 -t 1 passed 2025-01-09 11:29:44,372 - DEBUG - [Pod Pod ctest-pod-23600442] Cmd output: ctest-pod-30311767 Connecting to 10.105.254.5:80 (10.105.254.5:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 11:29:44,438 - DEBUG - [Pod ctest-pod-23600442] Cmd: wget http://10.105.254.5:80/ -O - -T 5 -t 1 , Output: ctest-pod-30311767 Connecting to 10.105.254.5:80 (10.105.254.5:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 11:29:44,438 - DEBUG - [Pod Pod ctest-pod-23600442] Cmd wget http://10.105.254.5:80/ -O - -T 5 -t 1 passed 2025-01-09 11:29:44,438 - DEBUG - [Pod Pod ctest-pod-23600442] Cmd output: ctest-pod-30311767 Connecting to 10.105.254.5:80 (10.105.254.5:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 11:29:44,492 - DEBUG - [Pod ctest-pod-23600442] Cmd: wget http://10.105.254.5:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.254.5:80 (10.105.254.5:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-30311767 2025-01-09 11:29:44,493 - DEBUG - [Pod Pod ctest-pod-23600442] Cmd wget http://10.105.254.5:80/ -O - -T 5 -t 1 passed 2025-01-09 11:29:44,493 - DEBUG - [Pod Pod ctest-pod-23600442] Cmd output: Connecting to 10.105.254.5:80 (10.105.254.5:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-30311767 2025-01-09 11:29:44,549 - DEBUG - [Pod ctest-pod-23600442] Cmd: wget http://10.105.254.5:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.254.5:80 (10.105.254.5:80) ctest-pod-49105426 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 11:29:44,549 - DEBUG - [Pod Pod ctest-pod-23600442] Cmd wget http://10.105.254.5:80/ -O - -T 5 -t 1 passed 2025-01-09 11:29:44,549 - DEBUG - [Pod Pod ctest-pod-23600442] Cmd output: Connecting to 10.105.254.5:80 (10.105.254.5:80) ctest-pod-49105426 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 11:29:44,549 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-49105426': 1, 'ctest-pod-30311767': 4} 2025-01-09 11:29:49,616 - DEBUG - [Pod ctest-pod-89008232] Cmd: wget http://10.105.254.5:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:29:49,616 - DEBUG - [Pod Pod ctest-pod-89008232] Cmd wget http://10.105.254.5:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:29:49,616 - DEBUG - [Pod Pod ctest-pod-89008232] Cmd output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:29:54,674 - DEBUG - [Pod ctest-pod-89008232] Cmd: wget http://10.105.254.5:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:29:54,674 - DEBUG - [Pod Pod ctest-pod-89008232] Cmd wget http://10.105.254.5:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:29:54,674 - DEBUG - [Pod Pod ctest-pod-89008232] Cmd output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:29:59,734 - DEBUG - [Pod ctest-pod-89008232] Cmd: wget http://10.105.254.5:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:29:59,734 - DEBUG - [Pod Pod ctest-pod-89008232] Cmd wget http://10.105.254.5:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:29:59,734 - DEBUG - [Pod Pod ctest-pod-89008232] Cmd output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:30:04,793 - DEBUG - [Pod ctest-pod-89008232] Cmd: wget http://10.105.254.5:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:30:04,793 - DEBUG - [Pod Pod ctest-pod-89008232] Cmd wget http://10.105.254.5:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:30:04,793 - DEBUG - [Pod Pod ctest-pod-89008232] Cmd output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:30:09,858 - DEBUG - [Pod ctest-pod-89008232] Cmd: wget http://10.105.254.5:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:30:09,858 - DEBUG - [Pod Pod ctest-pod-89008232] Cmd wget http://10.105.254.5:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:30:09,858 - DEBUG - [Pod Pod ctest-pod-89008232] Cmd output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:30:14,930 - DEBUG - [Pod ctest-pod-89008232] Cmd: wget http://10.105.254.5:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:30:14,930 - DEBUG - [Pod Pod ctest-pod-89008232] Cmd wget http://10.105.254.5:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:30:14,930 - DEBUG - [Pod Pod ctest-pod-89008232] Cmd output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:30:19,978 - DEBUG - [Pod ctest-pod-89008232] Cmd: wget http://10.105.254.5:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:30:19,978 - DEBUG - [Pod Pod ctest-pod-89008232] Cmd wget http://10.105.254.5:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:30:19,978 - DEBUG - [Pod Pod ctest-pod-89008232] Cmd output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:30:25,039 - DEBUG - [Pod ctest-pod-89008232] Cmd: wget http://10.105.254.5:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:30:25,039 - DEBUG - [Pod Pod ctest-pod-89008232] Cmd wget http://10.105.254.5:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:30:25,039 - DEBUG - [Pod Pod ctest-pod-89008232] Cmd output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:30:30,110 - DEBUG - [Pod ctest-pod-89008232] Cmd: wget http://10.105.254.5:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:30:30,110 - DEBUG - [Pod Pod ctest-pod-89008232] Cmd wget http://10.105.254.5:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:30:30,110 - DEBUG - [Pod Pod ctest-pod-89008232] Cmd output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:30:31,034 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2025-01-09 11:30:41,096 - DEBUG - [Pod ctest-pod-89008232] Cmd: wget http://10.105.254.5:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:30:41,096 - DEBUG - [Pod Pod ctest-pod-89008232] Cmd wget http://10.105.254.5:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:30:41,096 - DEBUG - [Pod Pod ctest-pod-89008232] Cmd output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:30:41,096 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-49105426': 0, 'ctest-pod-30311767': 0} 2025-01-09 11:30:43,174 - DEBUG - [Pod ctest-pod-23600442] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.284 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.073 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.105 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.073/0.487/1.284 ms 2025-01-09 11:30:43,174 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-23600442 with expectation True passed 2025-01-09 11:30:45,237 - DEBUG - [Pod ctest-pod-12096466] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.813 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.080 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.321/0.813 ms 2025-01-09 11:30:45,238 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-12096466 with expectation True passed 2025-01-09 11:30:47,309 - DEBUG - [Pod ctest-pod-89008232] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.275 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.072 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.111 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.072/0.486/1.275 ms 2025-01-09 11:30:47,309 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-89008232 with expectation True passed 2025-01-09 11:30:47,384 - DEBUG - [Pod ctest-pod-23600442] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-09 11:30:47,384 - DEBUG - [Pod Pod ctest-pod-23600442] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-01-09 11:30:47,384 - DEBUG - [Pod Pod ctest-pod-23600442] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-09 11:30:47,384 - INFO - wget check of of http://10.47.255.251 from ctest-pod-23600442 passed 2025-01-09 11:30:47,442 - DEBUG - [Pod ctest-pod-23600442] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-09 11:30:47,442 - DEBUG - [Pod Pod ctest-pod-23600442] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-01-09 11:30:47,442 - DEBUG - [Pod Pod ctest-pod-23600442] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-09 11:30:47,442 - INFO - wget check of of http://10.47.255.250 from ctest-pod-23600442 passed 2025-01-09 11:30:52,510 - DEBUG - [Pod ctest-pod-12096466] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-09 11:30:52,510 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-09 11:30:52,510 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-09 11:30:52,510 - INFO - wget check of of http://10.47.255.250 from ctest-pod-12096466 passed 2025-01-09 11:30:57,565 - DEBUG - [Pod ctest-pod-44761850] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-01-09 11:30:57,565 - DEBUG - [Pod Pod ctest-pod-44761850] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-01-09 11:30:57,565 - DEBUG - [Pod Pod ctest-pod-44761850] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-01-09 11:30:57,565 - INFO - wget check of of http://10.47.255.251 from ctest-pod-44761850 passed 2025-01-09 11:30:57,577 - INFO - Updating Network Policy ingress-on-service 2025-01-09 11:31:02,649 - DEBUG - [Pod ctest-pod-12096466] Cmd: wget http://10.105.254.5:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:31:02,650 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd wget http://10.105.254.5:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:31:02,650 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:31:07,713 - DEBUG - [Pod ctest-pod-12096466] Cmd: wget http://10.105.254.5:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:31:07,713 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd wget http://10.105.254.5:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:31:07,713 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:31:12,781 - DEBUG - [Pod ctest-pod-12096466] Cmd: wget http://10.105.254.5:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:31:12,782 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd wget http://10.105.254.5:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:31:12,782 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:31:17,842 - DEBUG - [Pod ctest-pod-12096466] Cmd: wget http://10.105.254.5:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:31:17,842 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd wget http://10.105.254.5:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:31:17,842 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:31:22,909 - DEBUG - [Pod ctest-pod-12096466] Cmd: wget http://10.105.254.5:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:31:22,909 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd wget http://10.105.254.5:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:31:22,909 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:31:27,970 - DEBUG - [Pod ctest-pod-12096466] Cmd: wget http://10.105.254.5:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:31:27,970 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd wget http://10.105.254.5:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:31:27,970 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:31:33,045 - DEBUG - [Pod ctest-pod-12096466] Cmd: wget http://10.105.254.5:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:31:33,045 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd wget http://10.105.254.5:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:31:33,045 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:31:38,116 - DEBUG - [Pod ctest-pod-12096466] Cmd: wget http://10.105.254.5:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:31:38,116 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd wget http://10.105.254.5:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:31:38,116 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:31:43,164 - DEBUG - [Pod ctest-pod-12096466] Cmd: wget http://10.105.254.5:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:31:43,164 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd wget http://10.105.254.5:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:31:43,164 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:31:48,219 - DEBUG - [Pod ctest-pod-12096466] Cmd: wget http://10.105.254.5:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:31:48,219 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd wget http://10.105.254.5:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:31:48,219 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd output: Connecting to 10.105.254.5:80 (10.105.254.5:80) wget: download timed out 2025-01-09 11:31:48,219 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-49105426': 0, 'ctest-pod-30311767': 0} 2025-01-09 11:31:48,287 - DEBUG - [Pod ctest-pod-23600442] Cmd: wget http://10.105.254.5:80/ -O - -T 5 -t 1 , Output: ctest-pod-49105426 Connecting to 10.105.254.5:80 (10.105.254.5:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 11:31:48,287 - DEBUG - [Pod Pod ctest-pod-23600442] Cmd wget http://10.105.254.5:80/ -O - -T 5 -t 1 passed 2025-01-09 11:31:48,287 - DEBUG - [Pod Pod ctest-pod-23600442] Cmd output: ctest-pod-49105426 Connecting to 10.105.254.5:80 (10.105.254.5:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 11:31:48,348 - DEBUG - [Pod ctest-pod-23600442] Cmd: wget http://10.105.254.5:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.254.5:80 (10.105.254.5:80) ctest-pod-30311767 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 11:31:48,349 - DEBUG - [Pod Pod ctest-pod-23600442] Cmd wget http://10.105.254.5:80/ -O - -T 5 -t 1 passed 2025-01-09 11:31:48,349 - DEBUG - [Pod Pod ctest-pod-23600442] Cmd output: Connecting to 10.105.254.5:80 (10.105.254.5:80) ctest-pod-30311767 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 11:31:48,349 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-49105426': 1, 'ctest-pod-30311767': 1} 2025-01-09 11:31:48,411 - DEBUG - [Pod ctest-pod-89008232] Cmd: wget http://10.105.254.5:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.254.5:80 (10.105.254.5:80) ctest-pod-49105426 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 11:31:48,411 - DEBUG - [Pod Pod ctest-pod-89008232] Cmd wget http://10.105.254.5:80/ -O - -T 5 -t 1 passed 2025-01-09 11:31:48,411 - DEBUG - [Pod Pod ctest-pod-89008232] Cmd output: Connecting to 10.105.254.5:80 (10.105.254.5:80) ctest-pod-49105426 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 11:31:48,474 - DEBUG - [Pod ctest-pod-89008232] Cmd: wget http://10.105.254.5:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.254.5:80 (10.105.254.5:80) ctest-pod-30311767 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 11:31:48,474 - DEBUG - [Pod Pod ctest-pod-89008232] Cmd wget http://10.105.254.5:80/ -O - -T 5 -t 1 passed 2025-01-09 11:31:48,474 - DEBUG - [Pod Pod ctest-pod-89008232] Cmd output: Connecting to 10.105.254.5:80 (10.105.254.5:80) ctest-pod-30311767 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-09 11:31:48,474 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-49105426': 1, 'ctest-pod-30311767': 1} 2025-01-09 11:31:50,527 - DEBUG - [Pod ctest-pod-23600442] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.368 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.104 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.070/0.180/0.368 ms 2025-01-09 11:31:50,527 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-23600442 with expectation True passed 2025-01-09 11:31:52,605 - DEBUG - [Pod ctest-pod-12096466] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.768 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.069 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.081 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.069/0.306/0.768 ms 2025-01-09 11:31:52,605 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-12096466 with expectation True passed 2025-01-09 11:31:54,678 - DEBUG - [Pod ctest-pod-89008232] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.415 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.084 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.523/1.415 ms 2025-01-09 11:31:54,678 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-89008232 with expectation True passed 2025-01-09 11:31:54,734 - DEBUG - [Pod ctest-pod-23600442] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-09 11:31:54,734 - DEBUG - [Pod Pod ctest-pod-23600442] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-01-09 11:31:54,734 - DEBUG - [Pod Pod ctest-pod-23600442] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-09 11:31:54,734 - INFO - wget check of of http://10.47.255.251 from ctest-pod-23600442 passed 2025-01-09 11:31:54,791 - DEBUG - [Pod ctest-pod-23600442] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-09 11:31:54,791 - DEBUG - [Pod Pod ctest-pod-23600442] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-01-09 11:31:54,791 - DEBUG - [Pod Pod ctest-pod-23600442] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-09 11:31:54,791 - INFO - wget check of of http://10.47.255.250 from ctest-pod-23600442 passed 2025-01-09 11:31:59,844 - DEBUG - [Pod ctest-pod-12096466] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-09 11:31:59,844 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-09 11:31:59,844 - DEBUG - [Pod Pod ctest-pod-12096466] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-09 11:31:59,844 - INFO - wget check of of http://10.47.255.250 from ctest-pod-12096466 passed 2025-01-09 11:31:59,901 - DEBUG - [Pod ctest-pod-44761850] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-09 11:31:59,901 - DEBUG - [Pod Pod ctest-pod-44761850] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-01-09 11:31:59,901 - DEBUG - [Pod Pod ctest-pod-44761850] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-09 11:31:59,901 - INFO - wget check of of http://10.47.255.251 from ctest-pod-44761850 passed 2025-01-09 11:31:59,902 - INFO - Deleting Network Policy : ingress-on-service 2025-01-09 11:31:59,902 - INFO - Deleting service : ctest-nginx-svc-57190021 2025-01-09 11:32:00,146 - DEBUG - No XMPP flaps were noticed during the test