2025-06-24 14:41:49,378 - INFO - Using existing project ['default-domain', 'k8s-default'](563b9090-e59e-45a9-89eb-91f047e48757) 2025-06-24 14:41:49,396 - DEBUG - Namespace ctest-new-default-18850379 not present 2025-06-24 14:41:49,403 - INFO - Created namespace ctest-new-default-18850379 2025-06-24 14:41:52,408 - DEBUG - Namespace ctest-non-default-30018467 not present 2025-06-24 14:41:52,418 - INFO - Created namespace ctest-non-default-30018467 2025-06-24 14:41:55,435 - DEBUG - Pod ctest-pod-19987999 not present 2025-06-24 14:41:55,435 - INFO - Creating Pod ctest-pod-19987999 2025-06-24 14:41:55,473 - DEBUG - Pod : ctest-pod-19987999 UUID is 3d4a163d-ccbd-4a3a-b667-b3d65b6d3f22 2025-06-24 14:41:55,475 - DEBUG - Pod ctest-pod-25753928 not present 2025-06-24 14:41:55,476 - INFO - Creating Pod ctest-pod-25753928 2025-06-24 14:41:55,495 - DEBUG - Pod : ctest-pod-25753928 UUID is 5fb5bb9f-2a57-4d03-ac7a-0007c6ce35b4 2025-06-24 14:41:55,499 - DEBUG - Pod ctest-pod-86427172 not present 2025-06-24 14:41:55,499 - INFO - Creating Pod ctest-pod-86427172 2025-06-24 14:41:55,542 - DEBUG - Pod : ctest-pod-86427172 UUID is fdaa19dc-aa61-48d9-a517-46e77b240158 2025-06-24 14:41:55,545 - DEBUG - Pod ctest-pod-05760317 not present 2025-06-24 14:41:55,546 - INFO - Creating Pod ctest-pod-05760317 2025-06-24 14:41:55,576 - DEBUG - Pod : ctest-pod-05760317 UUID is 1d570c2e-db88-45c2-a547-f6f323ef3051 2025-06-24 14:41:55,579 - DEBUG - Pod ctest-pod-20316368 not present 2025-06-24 14:41:55,579 - INFO - Creating Pod ctest-pod-20316368 2025-06-24 14:41:55,600 - DEBUG - Pod : ctest-pod-20316368 UUID is e55005f0-2e3e-4542-876f-ba70bef9ab96 2025-06-24 14:41:55,603 - DEBUG - Pod ctest-pod-11406294 not present 2025-06-24 14:41:55,603 - INFO - Creating Pod ctest-pod-11406294 2025-06-24 14:41:55,624 - DEBUG - Pod : ctest-pod-11406294 UUID is d5cde934-9067-45f6-a2d8-dc74244df71c 2025-06-24 14:41:55,626 - DEBUG - Pod ctest-pod-30598728 not present 2025-06-24 14:41:55,626 - INFO - Creating Pod ctest-pod-30598728 2025-06-24 14:41:55,643 - DEBUG - Pod : ctest-pod-30598728 UUID is d8c05d87-058b-4e9e-8b2b-da9f3b658472 2025-06-24 14:41:55,646 - DEBUG - Pod ctest-pod-16186424 not present 2025-06-24 14:41:55,648 - INFO - Creating Pod ctest-pod-16186424 2025-06-24 14:41:55,682 - DEBUG - Pod : ctest-pod-16186424 UUID is ad3d7ee0-737c-4549-9a8d-dd6ac1351d7f 2025-06-24 14:41:55,845 - INFO - Project default-domain:k8s-ctest-new-default-18850379 for Namespace ctest-new-default-18850379 is seen in contrail-api 2025-06-24 14:41:55,846 - DEBUG - Project uuid in Contrail is c44d07ed-cb8c-4d6f-af9e-037f12d9f0ac 2025-06-24 14:41:56,004 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_NamespaceDatabaseList?namespace_uuid=6f7b1efb-838b-4da5-87a5-57102f7640b6 2025-06-24 14:41:56,013 - INFO - Namespace ctest-new-default-18850379 with uuid 6f7b1efb-838b-4da5-87a5-57102f7640b6 found in kube manager 2025-06-24 14:41:56,013 - INFO - Namespace ctest-new-default-18850379 verification passed 2025-06-24 14:41:56,205 - INFO - Project default-domain:k8s-ctest-non-default-30018467 for Namespace ctest-non-default-30018467 is seen in contrail-api 2025-06-24 14:41:56,205 - DEBUG - Project uuid in Contrail is ab9cbaa4-5b50-431f-84dd-dc470def84ec 2025-06-24 14:41:56,205 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_NamespaceDatabaseList?namespace_uuid=b7438f4b-362a-4a6a-8390-7cb6547fabd4 2025-06-24 14:41:56,213 - INFO - Namespace ctest-non-default-30018467 with uuid b7438f4b-362a-4a6a-8390-7cb6547fabd4 found in kube manager 2025-06-24 14:41:56,214 - INFO - Namespace ctest-non-default-30018467 verification passed 2025-06-24 14:41:56,219 - DEBUG - Pod ctest-pod-19987999 not in running state.Currently in Pending 2025-06-24 14:42:01,231 - DEBUG - Pod ctest-pod-19987999 not in running state.Currently in Pending 2025-06-24 14:42:06,238 - INFO - Pod ctest-pod-19987999 is in running state.Got IP 10.47.255.251 2025-06-24 14:42:06,294 - DEBUG - Pod ctest-pod-19987999 has vmi 60e87072-5109-11f0-9628-fa163e13c30c 2025-06-24 14:42:06,294 - INFO - Verified pod ctest-pod-19987999 in contrail-api 2025-06-24 14:42:06,309 - DEBUG - VMI 60e87072-5109-11f0-9628-fa163e13c30c is active in agent 10.0.0.27 2025-06-24 14:42:06,309 - INFO - Verified Pod ctest-pod-19987999 in agent 10.0.0.27 2025-06-24 14:42:06,309 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=3d4a163d-ccbd-4a3a-b667-b3d65b6d3f22 2025-06-24 14:42:06,315 - INFO - Pod ctest-pod-19987999 with uuid 3d4a163d-ccbd-4a3a-b667-b3d65b6d3f22 found in kube manager 2025-06-24 14:42:06,316 - INFO - Pod ctest-pod-19987999 verification passed 2025-06-24 14:42:06,322 - INFO - Pod ctest-pod-25753928 is in running state.Got IP 10.47.255.250 2025-06-24 14:42:06,346 - DEBUG - Pod ctest-pod-25753928 has vmi 615c03fc-5109-11f0-9628-fa163e13c30c 2025-06-24 14:42:06,346 - INFO - Verified pod ctest-pod-25753928 in contrail-api 2025-06-24 14:42:06,358 - DEBUG - VMI 615c03fc-5109-11f0-9628-fa163e13c30c is active in agent 10.0.0.27 2025-06-24 14:42:06,358 - INFO - Verified Pod ctest-pod-25753928 in agent 10.0.0.27 2025-06-24 14:42:06,358 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=5fb5bb9f-2a57-4d03-ac7a-0007c6ce35b4 2025-06-24 14:42:06,362 - INFO - Pod ctest-pod-25753928 with uuid 5fb5bb9f-2a57-4d03-ac7a-0007c6ce35b4 found in kube manager 2025-06-24 14:42:06,362 - INFO - Pod ctest-pod-25753928 verification passed 2025-06-24 14:42:06,368 - DEBUG - Pod ctest-pod-86427172 not in running state.Currently in Pending 2025-06-24 14:42:11,375 - INFO - Pod ctest-pod-86427172 is in running state.Got IP 10.47.255.249 2025-06-24 14:42:11,434 - DEBUG - Pod ctest-pod-86427172 has vmi 61f948d8-5109-11f0-9628-fa163e13c30c 2025-06-24 14:42:11,434 - INFO - Verified pod ctest-pod-86427172 in contrail-api 2025-06-24 14:42:11,449 - DEBUG - VMI 61f948d8-5109-11f0-9628-fa163e13c30c is active in agent 10.0.0.27 2025-06-24 14:42:11,449 - INFO - Verified Pod ctest-pod-86427172 in agent 10.0.0.27 2025-06-24 14:42:11,449 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=fdaa19dc-aa61-48d9-a517-46e77b240158 2025-06-24 14:42:11,453 - INFO - Pod ctest-pod-86427172 with uuid fdaa19dc-aa61-48d9-a517-46e77b240158 found in kube manager 2025-06-24 14:42:11,453 - INFO - Pod ctest-pod-86427172 verification passed 2025-06-24 14:42:11,458 - INFO - Pod ctest-pod-05760317 is in running state.Got IP 10.47.255.248 2025-06-24 14:42:11,473 - DEBUG - Pod ctest-pod-05760317 has vmi 6268b786-5109-11f0-9628-fa163e13c30c 2025-06-24 14:42:11,473 - INFO - Verified pod ctest-pod-05760317 in contrail-api 2025-06-24 14:42:11,485 - DEBUG - VMI 6268b786-5109-11f0-9628-fa163e13c30c is active in agent 10.0.0.27 2025-06-24 14:42:11,485 - INFO - Verified Pod ctest-pod-05760317 in agent 10.0.0.27 2025-06-24 14:42:11,486 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=1d570c2e-db88-45c2-a547-f6f323ef3051 2025-06-24 14:42:11,490 - INFO - Pod ctest-pod-05760317 with uuid 1d570c2e-db88-45c2-a547-f6f323ef3051 found in kube manager 2025-06-24 14:42:11,490 - INFO - Pod ctest-pod-05760317 verification passed 2025-06-24 14:42:11,495 - DEBUG - Pod ctest-pod-20316368 not in running state.Currently in Pending 2025-06-24 14:42:16,501 - INFO - Pod ctest-pod-20316368 is in running state.Got IP 10.47.255.247 2025-06-24 14:42:16,554 - DEBUG - Pod ctest-pod-20316368 has vmi 62e8fa72-5109-11f0-9628-fa163e13c30c 2025-06-24 14:42:16,554 - INFO - Verified pod ctest-pod-20316368 in contrail-api 2025-06-24 14:42:16,570 - DEBUG - VMI 62e8fa72-5109-11f0-9628-fa163e13c30c is active in agent 10.0.0.27 2025-06-24 14:42:16,570 - INFO - Verified Pod ctest-pod-20316368 in agent 10.0.0.27 2025-06-24 14:42:16,570 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=e55005f0-2e3e-4542-876f-ba70bef9ab96 2025-06-24 14:42:16,574 - INFO - Pod ctest-pod-20316368 with uuid e55005f0-2e3e-4542-876f-ba70bef9ab96 found in kube manager 2025-06-24 14:42:16,575 - INFO - Pod ctest-pod-20316368 verification passed 2025-06-24 14:42:16,581 - INFO - Pod ctest-pod-30598728 is in running state.Got IP 10.47.255.245 2025-06-24 14:42:16,592 - DEBUG - Pod ctest-pod-30598728 has vmi 63d053d6-5109-11f0-9628-fa163e13c30c 2025-06-24 14:42:16,592 - INFO - Verified pod ctest-pod-30598728 in contrail-api 2025-06-24 14:42:16,606 - DEBUG - VMI 63d053d6-5109-11f0-9628-fa163e13c30c is active in agent 10.0.0.27 2025-06-24 14:42:16,606 - INFO - Verified Pod ctest-pod-30598728 in agent 10.0.0.27 2025-06-24 14:42:16,606 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=d8c05d87-058b-4e9e-8b2b-da9f3b658472 2025-06-24 14:42:16,610 - INFO - Pod ctest-pod-30598728 with uuid d8c05d87-058b-4e9e-8b2b-da9f3b658472 found in kube manager 2025-06-24 14:42:16,610 - INFO - Pod ctest-pod-30598728 verification passed 2025-06-24 14:42:16,615 - INFO - Pod ctest-pod-11406294 is in running state.Got IP 10.47.255.246 2025-06-24 14:42:16,673 - DEBUG - Pod ctest-pod-11406294 has vmi 635aae6a-5109-11f0-9628-fa163e13c30c 2025-06-24 14:42:16,673 - INFO - Verified pod ctest-pod-11406294 in contrail-api 2025-06-24 14:42:16,688 - DEBUG - VMI 635aae6a-5109-11f0-9628-fa163e13c30c is active in agent 10.0.0.27 2025-06-24 14:42:16,688 - INFO - Verified Pod ctest-pod-11406294 in agent 10.0.0.27 2025-06-24 14:42:16,688 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=d5cde934-9067-45f6-a2d8-dc74244df71c 2025-06-24 14:42:16,692 - INFO - Pod ctest-pod-11406294 with uuid d5cde934-9067-45f6-a2d8-dc74244df71c found in kube manager 2025-06-24 14:42:16,692 - INFO - Pod ctest-pod-11406294 verification passed 2025-06-24 14:42:16,697 - INFO - Pod ctest-pod-16186424 is in running state.Got IP 10.47.255.244 2025-06-24 14:42:16,750 - DEBUG - Pod ctest-pod-16186424 has vmi 64432668-5109-11f0-9628-fa163e13c30c 2025-06-24 14:42:16,750 - INFO - Verified pod ctest-pod-16186424 in contrail-api 2025-06-24 14:42:16,766 - DEBUG - VMI 64432668-5109-11f0-9628-fa163e13c30c is active in agent 10.0.0.27 2025-06-24 14:42:16,766 - INFO - Verified Pod ctest-pod-16186424 in agent 10.0.0.27 2025-06-24 14:42:16,766 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_VirtualMachineDatabaseList?x=ad3d7ee0-737c-4549-9a8d-dd6ac1351d7f 2025-06-24 14:42:16,770 - INFO - Pod ctest-pod-16186424 with uuid ad3d7ee0-737c-4549-9a8d-dd6ac1351d7f found in kube manager 2025-06-24 14:42:16,770 - INFO - Pod ctest-pod-16186424 verification passed 2025-06-24 14:42:16,771 - INFO - ================================================================================ 2025-06-24 14:42:16,771 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-06-24 14:42:16,771 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-06-24 14:42:17,002 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.0.0.249': '0'}} with 2025-06-24 14:42:17,002 - INFO - Initial checks done. Running the testcase now 2025-06-24 14:42:17,002 - INFO - 2025-06-24 14:42:17,064 - DEBUG - [Pod ctest-pod-19987999] Cmd: echo ctest-pod-19987999 > /usr/share/nginx/html/index.html, Output: 2025-06-24 14:42:17,125 - DEBUG - [Pod ctest-pod-25753928] Cmd: echo ctest-pod-25753928 > /usr/share/nginx/html/index.html, Output: 2025-06-24 14:42:17,194 - DEBUG - [Pod ctest-pod-86427172] Cmd: echo ctest-pod-86427172 > /usr/share/nginx/html/index.html, Output: 2025-06-24 14:42:17,264 - DEBUG - [Pod ctest-pod-05760317] Cmd: echo ctest-pod-05760317 > /usr/share/nginx/html/index.html, Output: 2025-06-24 14:42:17,268 - DEBUG - Service ctest-nginx-svc-95595407 not present 2025-06-24 14:42:17,268 - INFO - Creating service ctest-nginx-svc-95595407 2025-06-24 14:42:17,289 - INFO - Created Service ctest-nginx-svc-95595407 2025-06-24 14:42:17,298 - WARNING - Service UUID 184a9a98-87e0-4bf6-a527-0691760a8e5d not yet found in contrail-api 2025-06-24 14:42:18,305 - INFO - Validated that Service ctest-nginx-svc-95595407 is seen in contrail-api 2025-06-24 14:42:18,305 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_LoadbalancerDatabaseList?x=184a9a98-87e0-4bf6-a527-0691760a8e5d 2025-06-24 14:42:18,311 - INFO - Service ctest-nginx-svc-95595407 with uuid 184a9a98-87e0-4bf6-a527-0691760a8e5d found in kube manager 2025-06-24 14:42:18,311 - INFO - Service ctest-nginx-svc-95595407 verification passed 2025-06-24 14:42:19,383 - DEBUG - [Pod ctest-pod-20316368] Cmd: wget http://10.108.46.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.46.44:80 (10.108.46.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-25753928 2025-06-24 14:42:19,383 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd wget http://10.108.46.44:80/ -O - -T 5 -t 1 passed 2025-06-24 14:42:19,383 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd output: Connecting to 10.108.46.44:80 (10.108.46.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-25753928 2025-06-24 14:42:19,431 - DEBUG - [Pod ctest-pod-20316368] Cmd: wget http://10.108.46.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.46.44:80 (10.108.46.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-19987999 2025-06-24 14:42:19,431 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd wget http://10.108.46.44:80/ -O - -T 5 -t 1 passed 2025-06-24 14:42:19,432 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd output: Connecting to 10.108.46.44:80 (10.108.46.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-19987999 2025-06-24 14:42:19,432 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-19987999': 1, 'ctest-pod-25753928': 1} 2025-06-24 14:42:19,488 - DEBUG - [Pod ctest-pod-30598728] Cmd: wget http://10.108.46.44:80/ -O - -T 5 -t 1 , Output: ctest-pod-25753928 Connecting to 10.108.46.44:80 (10.108.46.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 14:42:19,488 - DEBUG - [Pod Pod ctest-pod-30598728] Cmd wget http://10.108.46.44:80/ -O - -T 5 -t 1 passed 2025-06-24 14:42:19,488 - DEBUG - [Pod Pod ctest-pod-30598728] Cmd output: ctest-pod-25753928 Connecting to 10.108.46.44:80 (10.108.46.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 14:42:19,547 - DEBUG - [Pod ctest-pod-30598728] Cmd: wget http://10.108.46.44:80/ -O - -T 5 -t 1 , Output: ctest-pod-19987999 Connecting to 10.108.46.44:80 (10.108.46.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 14:42:19,547 - DEBUG - [Pod Pod ctest-pod-30598728] Cmd wget http://10.108.46.44:80/ -O - -T 5 -t 1 passed 2025-06-24 14:42:19,547 - DEBUG - [Pod Pod ctest-pod-30598728] Cmd output: ctest-pod-19987999 Connecting to 10.108.46.44:80 (10.108.46.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 14:42:19,547 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-19987999': 1, 'ctest-pod-25753928': 1} 2025-06-24 14:42:19,550 - DEBUG - Network policy ingress-on-service not present 2025-06-24 14:42:19,625 - INFO - Creating Network Policy ingress-on-service 2025-06-24 14:42:19,644 - INFO - Network policy found in k8s 2025-06-24 14:42:19,644 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=1c8124b6-282b-415f-8547-e32de83a3d94 2025-06-24 14:42:19,649 - INFO - Network Policy ingress-on-service with uuid 1c8124b6-282b-415f-8547-e32de83a3d94 found in kube manager 2025-06-24 14:42:19,682 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-06-24 14:42:19,682 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-06-24 14:42:19,683 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=1c8124b6-282b-415f-8547-e32de83a3d94 2025-06-24 14:42:19,713 - WARNING - Network policy with name ingress-on-service not found in agent 2025-06-24 14:42:21,714 - DEBUG - Requesting: http://10.0.0.249:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=1c8124b6-282b-415f-8547-e32de83a3d94 2025-06-24 14:42:21,745 - INFO - Network policy with name ingress-on-service found in agent 2025-06-24 14:42:21,745 - INFO - Network Policy ingress-on-service verification passed 2025-06-24 14:42:26,796 - DEBUG - [Pod ctest-pod-20316368] Cmd: wget http://10.108.46.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:42:26,796 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd wget http://10.108.46.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:42:26,796 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:42:31,852 - DEBUG - [Pod ctest-pod-20316368] Cmd: wget http://10.108.46.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:42:31,852 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd wget http://10.108.46.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:42:31,852 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:42:36,903 - DEBUG - [Pod ctest-pod-20316368] Cmd: wget http://10.108.46.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:42:36,903 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd wget http://10.108.46.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:42:36,903 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:42:41,957 - DEBUG - [Pod ctest-pod-20316368] Cmd: wget http://10.108.46.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:42:41,958 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd wget http://10.108.46.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:42:41,958 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:42:47,022 - DEBUG - [Pod ctest-pod-20316368] Cmd: wget http://10.108.46.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:42:47,022 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd wget http://10.108.46.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:42:47,022 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:42:52,075 - DEBUG - [Pod ctest-pod-20316368] Cmd: wget http://10.108.46.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:42:52,075 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd wget http://10.108.46.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:42:52,075 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:42:57,126 - DEBUG - [Pod ctest-pod-20316368] Cmd: wget http://10.108.46.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:42:57,126 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd wget http://10.108.46.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:42:57,126 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:43:02,178 - DEBUG - [Pod ctest-pod-20316368] Cmd: wget http://10.108.46.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:43:02,178 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd wget http://10.108.46.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:43:02,178 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:43:07,230 - DEBUG - [Pod ctest-pod-20316368] Cmd: wget http://10.108.46.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:43:07,230 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd wget http://10.108.46.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:43:07,230 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:43:12,293 - DEBUG - [Pod ctest-pod-20316368] Cmd: wget http://10.108.46.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:43:12,293 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd wget http://10.108.46.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:43:12,293 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:43:12,293 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-19987999': 0, 'ctest-pod-25753928': 0} 2025-06-24 14:43:12,363 - DEBUG - [Pod ctest-pod-11406294] Cmd: wget http://10.108.46.44:80/ -O - -T 5 -t 1 , Output: ctest-pod-25753928 Connecting to 10.108.46.44:80 (10.108.46.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 14:43:12,364 - DEBUG - [Pod Pod ctest-pod-11406294] Cmd wget http://10.108.46.44:80/ -O - -T 5 -t 1 passed 2025-06-24 14:43:12,364 - DEBUG - [Pod Pod ctest-pod-11406294] Cmd output: ctest-pod-25753928 Connecting to 10.108.46.44:80 (10.108.46.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 14:43:12,418 - DEBUG - [Pod ctest-pod-11406294] Cmd: wget http://10.108.46.44:80/ -O - -T 5 -t 1 , Output: ctest-pod-19987999 Connecting to 10.108.46.44:80 (10.108.46.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 14:43:12,418 - DEBUG - [Pod Pod ctest-pod-11406294] Cmd wget http://10.108.46.44:80/ -O - -T 5 -t 1 passed 2025-06-24 14:43:12,418 - DEBUG - [Pod Pod ctest-pod-11406294] Cmd output: ctest-pod-19987999 Connecting to 10.108.46.44:80 (10.108.46.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 14:43:12,418 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-19987999': 1, 'ctest-pod-25753928': 1} 2025-06-24 14:43:17,474 - DEBUG - [Pod ctest-pod-30598728] Cmd: wget http://10.108.46.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:43:17,474 - DEBUG - [Pod Pod ctest-pod-30598728] Cmd wget http://10.108.46.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:43:17,474 - DEBUG - [Pod Pod ctest-pod-30598728] Cmd output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:43:22,525 - DEBUG - [Pod ctest-pod-30598728] Cmd: wget http://10.108.46.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:43:22,525 - DEBUG - [Pod Pod ctest-pod-30598728] Cmd wget http://10.108.46.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:43:22,525 - DEBUG - [Pod Pod ctest-pod-30598728] Cmd output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:43:27,585 - DEBUG - [Pod ctest-pod-30598728] Cmd: wget http://10.108.46.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:43:27,585 - DEBUG - [Pod Pod ctest-pod-30598728] Cmd wget http://10.108.46.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:43:27,585 - DEBUG - [Pod Pod ctest-pod-30598728] Cmd output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:43:32,640 - DEBUG - [Pod ctest-pod-30598728] Cmd: wget http://10.108.46.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:43:32,640 - DEBUG - [Pod Pod ctest-pod-30598728] Cmd wget http://10.108.46.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:43:32,640 - DEBUG - [Pod Pod ctest-pod-30598728] Cmd output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:43:37,693 - DEBUG - [Pod ctest-pod-30598728] Cmd: wget http://10.108.46.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:43:37,693 - DEBUG - [Pod Pod ctest-pod-30598728] Cmd wget http://10.108.46.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:43:37,693 - DEBUG - [Pod Pod ctest-pod-30598728] Cmd output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:43:42,754 - DEBUG - [Pod ctest-pod-30598728] Cmd: wget http://10.108.46.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:43:42,754 - DEBUG - [Pod Pod ctest-pod-30598728] Cmd wget http://10.108.46.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:43:42,754 - DEBUG - [Pod Pod ctest-pod-30598728] Cmd output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:43:47,813 - DEBUG - [Pod ctest-pod-30598728] Cmd: wget http://10.108.46.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:43:47,813 - DEBUG - [Pod Pod ctest-pod-30598728] Cmd wget http://10.108.46.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:43:47,813 - DEBUG - [Pod Pod ctest-pod-30598728] Cmd output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:43:52,862 - DEBUG - [Pod ctest-pod-30598728] Cmd: wget http://10.108.46.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:43:52,862 - DEBUG - [Pod Pod ctest-pod-30598728] Cmd wget http://10.108.46.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:43:52,862 - DEBUG - [Pod Pod ctest-pod-30598728] Cmd output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:43:57,914 - DEBUG - [Pod ctest-pod-30598728] Cmd: wget http://10.108.46.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:43:57,914 - DEBUG - [Pod Pod ctest-pod-30598728] Cmd wget http://10.108.46.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:43:57,915 - DEBUG - [Pod Pod ctest-pod-30598728] Cmd output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:44:02,965 - DEBUG - [Pod ctest-pod-30598728] Cmd: wget http://10.108.46.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:44:02,966 - DEBUG - [Pod Pod ctest-pod-30598728] Cmd wget http://10.108.46.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:44:02,966 - DEBUG - [Pod Pod ctest-pod-30598728] Cmd output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:44:02,966 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-19987999': 0, 'ctest-pod-25753928': 0} 2025-06-24 14:44:05,019 - DEBUG - [Pod ctest-pod-11406294] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.505 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.079 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.101 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.079/0.228/0.505 ms 2025-06-24 14:44:05,019 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-11406294 with expectation True passed 2025-06-24 14:44:07,073 - DEBUG - [Pod ctest-pod-20316368] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.655 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.086 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.135 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.086/0.292/0.655 ms 2025-06-24 14:44:07,074 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-20316368 with expectation True passed 2025-06-24 14:44:09,132 - DEBUG - [Pod ctest-pod-30598728] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.136 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.083 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.070/0.429/1.136 ms 2025-06-24 14:44:09,132 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-30598728 with expectation True passed 2025-06-24 14:44:09,192 - DEBUG - [Pod ctest-pod-11406294] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-24 14:44:09,192 - DEBUG - [Pod Pod ctest-pod-11406294] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-06-24 14:44:09,192 - DEBUG - [Pod Pod ctest-pod-11406294] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-24 14:44:09,192 - INFO - wget check of of http://10.47.255.251 from ctest-pod-11406294 passed 2025-06-24 14:44:09,259 - DEBUG - [Pod ctest-pod-11406294] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-24 14:44:09,260 - DEBUG - [Pod Pod ctest-pod-11406294] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-06-24 14:44:09,260 - DEBUG - [Pod Pod ctest-pod-11406294] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-24 14:44:09,260 - INFO - wget check of of http://10.47.255.250 from ctest-pod-11406294 passed 2025-06-24 14:44:14,323 - DEBUG - [Pod ctest-pod-20316368] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-24 14:44:14,323 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-24 14:44:14,323 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-24 14:44:14,323 - INFO - wget check of of http://10.47.255.250 from ctest-pod-20316368 passed 2025-06-24 14:44:19,372 - DEBUG - [Pod ctest-pod-16186424] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-06-24 14:44:19,372 - DEBUG - [Pod Pod ctest-pod-16186424] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-06-24 14:44:19,372 - DEBUG - [Pod Pod ctest-pod-16186424] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-06-24 14:44:19,372 - INFO - wget check of of http://10.47.255.251 from ctest-pod-16186424 passed 2025-06-24 14:44:19,380 - INFO - Updating Network Policy ingress-on-service 2025-06-24 14:44:24,438 - DEBUG - [Pod ctest-pod-20316368] Cmd: wget http://10.108.46.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:44:24,438 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd wget http://10.108.46.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:44:24,438 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:44:29,486 - DEBUG - [Pod ctest-pod-20316368] Cmd: wget http://10.108.46.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:44:29,486 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd wget http://10.108.46.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:44:29,486 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:44:34,543 - DEBUG - [Pod ctest-pod-20316368] Cmd: wget http://10.108.46.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:44:34,543 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd wget http://10.108.46.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:44:34,543 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:44:39,595 - DEBUG - [Pod ctest-pod-20316368] Cmd: wget http://10.108.46.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:44:39,595 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd wget http://10.108.46.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:44:39,596 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:44:44,654 - DEBUG - [Pod ctest-pod-20316368] Cmd: wget http://10.108.46.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:44:44,655 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd wget http://10.108.46.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:44:44,655 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:44:49,701 - DEBUG - [Pod ctest-pod-20316368] Cmd: wget http://10.108.46.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:44:49,701 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd wget http://10.108.46.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:44:49,701 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:44:54,757 - DEBUG - [Pod ctest-pod-20316368] Cmd: wget http://10.108.46.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:44:54,757 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd wget http://10.108.46.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:44:54,757 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:44:59,810 - DEBUG - [Pod ctest-pod-20316368] Cmd: wget http://10.108.46.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:44:59,810 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd wget http://10.108.46.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:44:59,810 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:45:04,866 - DEBUG - [Pod ctest-pod-20316368] Cmd: wget http://10.108.46.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:45:04,866 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd wget http://10.108.46.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:45:04,866 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:45:07,959 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2025-06-24 14:45:18,022 - DEBUG - [Pod ctest-pod-20316368] Cmd: wget http://10.108.46.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:45:18,022 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd wget http://10.108.46.44:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:45:18,022 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd output: Connecting to 10.108.46.44:80 (10.108.46.44:80) wget: download timed out 2025-06-24 14:45:18,022 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-19987999': 0, 'ctest-pod-25753928': 0} 2025-06-24 14:45:18,076 - DEBUG - [Pod ctest-pod-11406294] Cmd: wget http://10.108.46.44:80/ -O - -T 5 -t 1 , Output: ctest-pod-19987999 Connecting to 10.108.46.44:80 (10.108.46.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 14:45:18,076 - DEBUG - [Pod Pod ctest-pod-11406294] Cmd wget http://10.108.46.44:80/ -O - -T 5 -t 1 passed 2025-06-24 14:45:18,076 - DEBUG - [Pod Pod ctest-pod-11406294] Cmd output: ctest-pod-19987999 Connecting to 10.108.46.44:80 (10.108.46.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 14:45:18,133 - DEBUG - [Pod ctest-pod-11406294] Cmd: wget http://10.108.46.44:80/ -O - -T 5 -t 1 , Output: ctest-pod-19987999 Connecting to 10.108.46.44:80 (10.108.46.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 14:45:18,134 - DEBUG - [Pod Pod ctest-pod-11406294] Cmd wget http://10.108.46.44:80/ -O - -T 5 -t 1 passed 2025-06-24 14:45:18,134 - DEBUG - [Pod Pod ctest-pod-11406294] Cmd output: ctest-pod-19987999 Connecting to 10.108.46.44:80 (10.108.46.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 14:45:18,180 - DEBUG - [Pod ctest-pod-11406294] Cmd: wget http://10.108.46.44:80/ -O - -T 5 -t 1 , Output: ctest-pod-19987999 Connecting to 10.108.46.44:80 (10.108.46.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 14:45:18,180 - DEBUG - [Pod Pod ctest-pod-11406294] Cmd wget http://10.108.46.44:80/ -O - -T 5 -t 1 passed 2025-06-24 14:45:18,180 - DEBUG - [Pod Pod ctest-pod-11406294] Cmd output: ctest-pod-19987999 Connecting to 10.108.46.44:80 (10.108.46.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 14:45:18,235 - DEBUG - [Pod ctest-pod-11406294] Cmd: wget http://10.108.46.44:80/ -O - -T 5 -t 1 , Output: ctest-pod-19987999 Connecting to 10.108.46.44:80 (10.108.46.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 14:45:18,235 - DEBUG - [Pod Pod ctest-pod-11406294] Cmd wget http://10.108.46.44:80/ -O - -T 5 -t 1 passed 2025-06-24 14:45:18,235 - DEBUG - [Pod Pod ctest-pod-11406294] Cmd output: ctest-pod-19987999 Connecting to 10.108.46.44:80 (10.108.46.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 14:45:18,299 - DEBUG - [Pod ctest-pod-11406294] Cmd: wget http://10.108.46.44:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.46.44:80 (10.108.46.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-25753928 2025-06-24 14:45:18,299 - DEBUG - [Pod Pod ctest-pod-11406294] Cmd wget http://10.108.46.44:80/ -O - -T 5 -t 1 passed 2025-06-24 14:45:18,299 - DEBUG - [Pod Pod ctest-pod-11406294] Cmd output: Connecting to 10.108.46.44:80 (10.108.46.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-25753928 2025-06-24 14:45:18,299 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-19987999': 4, 'ctest-pod-25753928': 1} 2025-06-24 14:45:18,364 - DEBUG - [Pod ctest-pod-30598728] Cmd: wget http://10.108.46.44:80/ -O - -T 5 -t 1 , Output: ctest-pod-25753928 Connecting to 10.108.46.44:80 (10.108.46.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 14:45:18,364 - DEBUG - [Pod Pod ctest-pod-30598728] Cmd wget http://10.108.46.44:80/ -O - -T 5 -t 1 passed 2025-06-24 14:45:18,364 - DEBUG - [Pod Pod ctest-pod-30598728] Cmd output: ctest-pod-25753928 Connecting to 10.108.46.44:80 (10.108.46.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 14:45:18,444 - DEBUG - [Pod ctest-pod-30598728] Cmd: wget http://10.108.46.44:80/ -O - -T 5 -t 1 , Output: ctest-pod-25753928 Connecting to 10.108.46.44:80 (10.108.46.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 14:45:18,444 - DEBUG - [Pod Pod ctest-pod-30598728] Cmd wget http://10.108.46.44:80/ -O - -T 5 -t 1 passed 2025-06-24 14:45:18,444 - DEBUG - [Pod Pod ctest-pod-30598728] Cmd output: ctest-pod-25753928 Connecting to 10.108.46.44:80 (10.108.46.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 14:45:18,500 - DEBUG - [Pod ctest-pod-30598728] Cmd: wget http://10.108.46.44:80/ -O - -T 5 -t 1 , Output: ctest-pod-19987999 Connecting to 10.108.46.44:80 (10.108.46.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 14:45:18,501 - DEBUG - [Pod Pod ctest-pod-30598728] Cmd wget http://10.108.46.44:80/ -O - -T 5 -t 1 passed 2025-06-24 14:45:18,501 - DEBUG - [Pod Pod ctest-pod-30598728] Cmd output: ctest-pod-19987999 Connecting to 10.108.46.44:80 (10.108.46.44:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-06-24 14:45:18,501 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-19987999': 1, 'ctest-pod-25753928': 2} 2025-06-24 14:45:20,561 - DEBUG - [Pod ctest-pod-11406294] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.427 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.094 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.070/0.197/0.427 ms 2025-06-24 14:45:20,561 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-11406294 with expectation True passed 2025-06-24 14:45:22,618 - DEBUG - [Pod ctest-pod-20316368] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.957 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.082 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.096 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.082/0.378/0.957 ms 2025-06-24 14:45:22,751 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-20316368 with expectation True passed 2025-06-24 14:45:24,806 - DEBUG - [Pod ctest-pod-30598728] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.604 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.088 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.070/0.254/0.604 ms 2025-06-24 14:45:24,806 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-30598728 with expectation True passed 2025-06-24 14:45:24,867 - DEBUG - [Pod ctest-pod-11406294] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-24 14:45:24,867 - DEBUG - [Pod Pod ctest-pod-11406294] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-06-24 14:45:24,867 - DEBUG - [Pod Pod ctest-pod-11406294] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-24 14:45:24,867 - INFO - wget check of of http://10.47.255.251 from ctest-pod-11406294 passed 2025-06-24 14:45:24,924 - DEBUG - [Pod ctest-pod-11406294] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-24 14:45:24,924 - DEBUG - [Pod Pod ctest-pod-11406294] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-06-24 14:45:24,924 - DEBUG - [Pod Pod ctest-pod-11406294] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-24 14:45:24,924 - INFO - wget check of of http://10.47.255.250 from ctest-pod-11406294 passed 2025-06-24 14:45:29,982 - DEBUG - [Pod ctest-pod-20316368] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-24 14:45:29,983 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-24 14:45:29,983 - DEBUG - [Pod Pod ctest-pod-20316368] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-06-24 14:45:29,983 - INFO - wget check of of http://10.47.255.250 from ctest-pod-20316368 passed 2025-06-24 14:45:30,046 - DEBUG - [Pod ctest-pod-16186424] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-24 14:45:30,046 - DEBUG - [Pod Pod ctest-pod-16186424] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-06-24 14:45:30,046 - DEBUG - [Pod Pod ctest-pod-16186424] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-06-24 14:45:30,046 - INFO - wget check of of http://10.47.255.251 from ctest-pod-16186424 passed 2025-06-24 14:45:30,046 - INFO - Deleting Network Policy : ingress-on-service 2025-06-24 14:45:30,047 - INFO - Deleting service : ctest-nginx-svc-95595407 2025-06-24 14:45:30,257 - DEBUG - No XMPP flaps were noticed during the test