2025-10-23 13:01:12,842 - INFO - Using existing project ['default-domain', 'k8s-default'](ed9b784f-9c84-4909-9f36-65cce39cbd71) 2025-10-23 13:01:12,870 - DEBUG - Namespace ctest-new-default-11091823 not present 2025-10-23 13:01:12,886 - INFO - Created namespace ctest-new-default-11091823 2025-10-23 13:01:15,890 - DEBUG - Namespace ctest-non-default-20616494 not present 2025-10-23 13:01:15,897 - INFO - Created namespace ctest-non-default-20616494 2025-10-23 13:01:18,915 - DEBUG - Pod ctest-pod-57830295 not present 2025-10-23 13:01:18,916 - INFO - Creating Pod ctest-pod-57830295 2025-10-23 13:01:18,943 - DEBUG - Pod : ctest-pod-57830295 UUID is d8c13374-b43d-432d-bf32-853ee09692e1 2025-10-23 13:01:18,947 - DEBUG - Pod ctest-pod-68096708 not present 2025-10-23 13:01:18,949 - INFO - Creating Pod ctest-pod-68096708 2025-10-23 13:01:18,979 - DEBUG - Pod : ctest-pod-68096708 UUID is 0b3f4884-b8e9-443a-bbb5-d0dcd9094467 2025-10-23 13:01:18,981 - DEBUG - Pod ctest-pod-22379992 not present 2025-10-23 13:01:18,981 - INFO - Creating Pod ctest-pod-22379992 2025-10-23 13:01:19,020 - DEBUG - Pod : ctest-pod-22379992 UUID is 2dfbd880-9300-4b71-a71e-a70a27093053 2025-10-23 13:01:19,022 - DEBUG - Pod ctest-pod-40883049 not present 2025-10-23 13:01:19,022 - INFO - Creating Pod ctest-pod-40883049 2025-10-23 13:01:19,044 - DEBUG - Pod : ctest-pod-40883049 UUID is 4b195865-097f-4359-9f63-dd644454bda9 2025-10-23 13:01:19,047 - DEBUG - Pod ctest-pod-56872778 not present 2025-10-23 13:01:19,047 - INFO - Creating Pod ctest-pod-56872778 2025-10-23 13:01:19,063 - DEBUG - Pod : ctest-pod-56872778 UUID is c3268ed9-c522-4dc6-8cd1-b5123b6a0dff 2025-10-23 13:01:19,065 - DEBUG - Pod ctest-pod-24054747 not present 2025-10-23 13:01:19,065 - INFO - Creating Pod ctest-pod-24054747 2025-10-23 13:01:19,080 - DEBUG - Pod : ctest-pod-24054747 UUID is 35808738-734c-490c-ae75-9d7e59bd6353 2025-10-23 13:01:19,082 - DEBUG - Pod ctest-pod-01911530 not present 2025-10-23 13:01:19,082 - INFO - Creating Pod ctest-pod-01911530 2025-10-23 13:01:19,098 - DEBUG - Pod : ctest-pod-01911530 UUID is a27d82eb-335e-4698-93f2-6795e7d471f8 2025-10-23 13:01:19,100 - DEBUG - Pod ctest-pod-32208154 not present 2025-10-23 13:01:19,100 - INFO - Creating Pod ctest-pod-32208154 2025-10-23 13:01:19,125 - DEBUG - Pod : ctest-pod-32208154 UUID is a5c76637-72e9-4105-a4eb-fdc4068a502a 2025-10-23 13:01:19,296 - INFO - Project default-domain:k8s-ctest-new-default-11091823 for Namespace ctest-new-default-11091823 is seen in contrail-api 2025-10-23 13:01:19,296 - DEBUG - Project uuid in Contrail is 20a2414a-cad6-446e-a642-11cb31613c7c 2025-10-23 13:01:19,465 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_NamespaceDatabaseList?namespace_uuid=b5aceac9-905f-44e3-85f5-3e541443aaca 2025-10-23 13:01:19,469 - INFO - Namespace ctest-new-default-11091823 with uuid b5aceac9-905f-44e3-85f5-3e541443aaca found in kube manager 2025-10-23 13:01:19,469 - INFO - Namespace ctest-new-default-11091823 verification passed 2025-10-23 13:01:19,634 - INFO - Project default-domain:k8s-ctest-non-default-20616494 for Namespace ctest-non-default-20616494 is seen in contrail-api 2025-10-23 13:01:19,634 - DEBUG - Project uuid in Contrail is 5b6f1b6e-4ddf-4060-9028-4c85674b6f8e 2025-10-23 13:01:19,634 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_NamespaceDatabaseList?namespace_uuid=76d07105-557a-41da-af90-fdde3e3ed5a3 2025-10-23 13:01:19,644 - INFO - Namespace ctest-non-default-20616494 with uuid 76d07105-557a-41da-af90-fdde3e3ed5a3 found in kube manager 2025-10-23 13:01:19,644 - INFO - Namespace ctest-non-default-20616494 verification passed 2025-10-23 13:01:19,650 - DEBUG - Pod ctest-pod-57830295 not in running state.Currently in Pending 2025-10-23 13:01:24,659 - DEBUG - Pod ctest-pod-57830295 not in running state.Currently in Pending 2025-10-23 13:01:29,667 - DEBUG - Pod ctest-pod-57830295 not in running state.Currently in Pending 2025-10-23 13:01:34,675 - INFO - Pod ctest-pod-57830295 is in running state.Got IP 10.47.255.251 2025-10-23 13:01:34,694 - DEBUG - Pod ctest-pod-57830295 has vmi 5ec926b8-b010-11f0-94b8-fa163e0d58b6 2025-10-23 13:01:34,695 - INFO - Verified pod ctest-pod-57830295 in contrail-api 2025-10-23 13:01:34,705 - DEBUG - VMI 5ec926b8-b010-11f0-94b8-fa163e0d58b6 is active in agent 10.0.0.19 2025-10-23 13:01:34,705 - INFO - Verified Pod ctest-pod-57830295 in agent 10.0.0.19 2025-10-23 13:01:34,705 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=d8c13374-b43d-432d-bf32-853ee09692e1 2025-10-23 13:01:34,708 - INFO - Pod ctest-pod-57830295 with uuid d8c13374-b43d-432d-bf32-853ee09692e1 found in kube manager 2025-10-23 13:01:34,708 - INFO - Pod ctest-pod-57830295 verification passed 2025-10-23 13:01:34,714 - INFO - Pod ctest-pod-68096708 is in running state.Got IP 10.47.255.250 2025-10-23 13:01:34,769 - DEBUG - Pod ctest-pod-68096708 has vmi 5f38b096-b010-11f0-94b8-fa163e0d58b6 2025-10-23 13:01:34,769 - INFO - Verified pod ctest-pod-68096708 in contrail-api 2025-10-23 13:01:34,779 - DEBUG - VMI 5f38b096-b010-11f0-94b8-fa163e0d58b6 is active in agent 10.0.0.19 2025-10-23 13:01:34,779 - INFO - Verified Pod ctest-pod-68096708 in agent 10.0.0.19 2025-10-23 13:01:34,779 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=0b3f4884-b8e9-443a-bbb5-d0dcd9094467 2025-10-23 13:01:34,783 - INFO - Pod ctest-pod-68096708 with uuid 0b3f4884-b8e9-443a-bbb5-d0dcd9094467 found in kube manager 2025-10-23 13:01:34,784 - INFO - Pod ctest-pod-68096708 verification passed 2025-10-23 13:01:34,789 - INFO - Pod ctest-pod-22379992 is in running state.Got IP 10.47.255.249 2025-10-23 13:01:34,842 - DEBUG - Pod ctest-pod-22379992 has vmi 5fc1527a-b010-11f0-94b8-fa163e0d58b6 2025-10-23 13:01:34,842 - INFO - Verified pod ctest-pod-22379992 in contrail-api 2025-10-23 13:01:34,851 - DEBUG - VMI 5fc1527a-b010-11f0-94b8-fa163e0d58b6 is active in agent 10.0.0.19 2025-10-23 13:01:34,851 - INFO - Verified Pod ctest-pod-22379992 in agent 10.0.0.19 2025-10-23 13:01:34,851 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=2dfbd880-9300-4b71-a71e-a70a27093053 2025-10-23 13:01:34,855 - INFO - Pod ctest-pod-22379992 with uuid 2dfbd880-9300-4b71-a71e-a70a27093053 found in kube manager 2025-10-23 13:01:34,855 - INFO - Pod ctest-pod-22379992 verification passed 2025-10-23 13:01:34,860 - INFO - Pod ctest-pod-40883049 is in running state.Got IP 10.47.255.248 2025-10-23 13:01:34,870 - DEBUG - Pod ctest-pod-40883049 has vmi 602d1a28-b010-11f0-94b8-fa163e0d58b6 2025-10-23 13:01:34,870 - INFO - Verified pod ctest-pod-40883049 in contrail-api 2025-10-23 13:01:34,880 - DEBUG - VMI 602d1a28-b010-11f0-94b8-fa163e0d58b6 is active in agent 10.0.0.19 2025-10-23 13:01:34,880 - INFO - Verified Pod ctest-pod-40883049 in agent 10.0.0.19 2025-10-23 13:01:34,880 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=4b195865-097f-4359-9f63-dd644454bda9 2025-10-23 13:01:34,883 - INFO - Pod ctest-pod-40883049 with uuid 4b195865-097f-4359-9f63-dd644454bda9 found in kube manager 2025-10-23 13:01:34,883 - INFO - Pod ctest-pod-40883049 verification passed 2025-10-23 13:01:34,888 - INFO - Pod ctest-pod-56872778 is in running state.Got IP 10.47.255.247 2025-10-23 13:01:34,899 - DEBUG - Pod ctest-pod-56872778 has vmi 60ae35c2-b010-11f0-94b8-fa163e0d58b6 2025-10-23 13:01:34,899 - INFO - Verified pod ctest-pod-56872778 in contrail-api 2025-10-23 13:01:34,908 - DEBUG - VMI 60ae35c2-b010-11f0-94b8-fa163e0d58b6 is active in agent 10.0.0.19 2025-10-23 13:01:34,908 - INFO - Verified Pod ctest-pod-56872778 in agent 10.0.0.19 2025-10-23 13:01:34,908 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=c3268ed9-c522-4dc6-8cd1-b5123b6a0dff 2025-10-23 13:01:34,911 - INFO - Pod ctest-pod-56872778 with uuid c3268ed9-c522-4dc6-8cd1-b5123b6a0dff found in kube manager 2025-10-23 13:01:34,911 - INFO - Pod ctest-pod-56872778 verification passed 2025-10-23 13:01:34,918 - INFO - Pod ctest-pod-01911530 is in running state.Got IP 10.47.255.245 2025-10-23 13:01:34,972 - DEBUG - Pod ctest-pod-01911530 has vmi 6177bd84-b010-11f0-94b8-fa163e0d58b6 2025-10-23 13:01:34,972 - INFO - Verified pod ctest-pod-01911530 in contrail-api 2025-10-23 13:01:34,981 - DEBUG - VMI 6177bd84-b010-11f0-94b8-fa163e0d58b6 is active in agent 10.0.0.19 2025-10-23 13:01:34,982 - INFO - Verified Pod ctest-pod-01911530 in agent 10.0.0.19 2025-10-23 13:01:34,982 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=a27d82eb-335e-4698-93f2-6795e7d471f8 2025-10-23 13:01:34,985 - INFO - Pod ctest-pod-01911530 with uuid a27d82eb-335e-4698-93f2-6795e7d471f8 found in kube manager 2025-10-23 13:01:34,985 - INFO - Pod ctest-pod-01911530 verification passed 2025-10-23 13:01:34,991 - INFO - Pod ctest-pod-24054747 is in running state.Got IP 10.47.255.246 2025-10-23 13:01:35,042 - DEBUG - Pod ctest-pod-24054747 has vmi 610f2792-b010-11f0-94b8-fa163e0d58b6 2025-10-23 13:01:35,042 - INFO - Verified pod ctest-pod-24054747 in contrail-api 2025-10-23 13:01:35,051 - DEBUG - VMI 610f2792-b010-11f0-94b8-fa163e0d58b6 is active in agent 10.0.0.19 2025-10-23 13:01:35,052 - INFO - Verified Pod ctest-pod-24054747 in agent 10.0.0.19 2025-10-23 13:01:35,052 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=35808738-734c-490c-ae75-9d7e59bd6353 2025-10-23 13:01:35,055 - INFO - Pod ctest-pod-24054747 with uuid 35808738-734c-490c-ae75-9d7e59bd6353 found in kube manager 2025-10-23 13:01:35,055 - INFO - Pod ctest-pod-24054747 verification passed 2025-10-23 13:01:35,060 - DEBUG - Pod ctest-pod-32208154 not in running state.Currently in Pending 2025-10-23 13:01:40,069 - INFO - Pod ctest-pod-32208154 is in running state.Got IP 10.47.255.244 2025-10-23 13:01:40,080 - DEBUG - Pod ctest-pod-32208154 has vmi 61e36124-b010-11f0-94b8-fa163e0d58b6 2025-10-23 13:01:40,080 - INFO - Verified pod ctest-pod-32208154 in contrail-api 2025-10-23 13:01:40,090 - DEBUG - VMI 61e36124-b010-11f0-94b8-fa163e0d58b6 is active in agent 10.0.0.19 2025-10-23 13:01:40,091 - INFO - Verified Pod ctest-pod-32208154 in agent 10.0.0.19 2025-10-23 13:01:40,091 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_VirtualMachineDatabaseList?x=a5c76637-72e9-4105-a4eb-fdc4068a502a 2025-10-23 13:01:40,096 - INFO - Pod ctest-pod-32208154 with uuid a5c76637-72e9-4105-a4eb-fdc4068a502a found in kube manager 2025-10-23 13:01:40,096 - INFO - Pod ctest-pod-32208154 verification passed 2025-10-23 13:01:40,096 - INFO - ================================================================================ 2025-10-23 13:01:40,096 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-10-23 13:01:40,096 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-10-23 13:01:40,257 - DEBUG - Nothing to compare xmpp stats {'10.0.0.19': {'10.0.0.65': '0'}} with 2025-10-23 13:01:40,257 - INFO - Initial checks done. Running the testcase now 2025-10-23 13:01:40,258 - INFO - 2025-10-23 13:01:40,327 - DEBUG - [Pod ctest-pod-57830295] Cmd: echo ctest-pod-57830295 > /usr/share/nginx/html/index.html, Output: 2025-10-23 13:01:40,374 - DEBUG - [Pod ctest-pod-68096708] Cmd: echo ctest-pod-68096708 > /usr/share/nginx/html/index.html, Output: 2025-10-23 13:01:40,440 - DEBUG - [Pod ctest-pod-22379992] Cmd: echo ctest-pod-22379992 > /usr/share/nginx/html/index.html, Output: 2025-10-23 13:01:40,498 - DEBUG - [Pod ctest-pod-40883049] Cmd: echo ctest-pod-40883049 > /usr/share/nginx/html/index.html, Output: 2025-10-23 13:01:40,501 - DEBUG - Service ctest-nginx-svc-02257683 not present 2025-10-23 13:01:40,501 - INFO - Creating service ctest-nginx-svc-02257683 2025-10-23 13:01:40,513 - INFO - Created Service ctest-nginx-svc-02257683 2025-10-23 13:01:40,519 - WARNING - Service UUID 5c9f7ac6-95d3-4172-8289-c0ecad91203a not yet found in contrail-api 2025-10-23 13:01:41,526 - INFO - Validated that Service ctest-nginx-svc-02257683 is seen in contrail-api 2025-10-23 13:01:41,526 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_LoadbalancerDatabaseList?x=5c9f7ac6-95d3-4172-8289-c0ecad91203a 2025-10-23 13:01:41,529 - INFO - Service ctest-nginx-svc-02257683 with uuid 5c9f7ac6-95d3-4172-8289-c0ecad91203a found in kube manager 2025-10-23 13:01:41,530 - INFO - Service ctest-nginx-svc-02257683 verification passed 2025-10-23 13:01:42,600 - DEBUG - [Pod ctest-pod-56872778] Cmd: wget http://10.101.89.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.89.78:80 (10.101.89.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-57830295 2025-10-23 13:01:42,600 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd wget http://10.101.89.78:80/ -O - -T 5 -t 1 passed 2025-10-23 13:01:42,600 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd output: Connecting to 10.101.89.78:80 (10.101.89.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-57830295 2025-10-23 13:01:42,650 - DEBUG - [Pod ctest-pod-56872778] Cmd: wget http://10.101.89.78:80/ -O - -T 5 -t 1 , Output: ctest-pod-57830295 Connecting to 10.101.89.78:80 (10.101.89.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-23 13:01:42,650 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd wget http://10.101.89.78:80/ -O - -T 5 -t 1 passed 2025-10-23 13:01:42,650 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd output: ctest-pod-57830295 Connecting to 10.101.89.78:80 (10.101.89.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-23 13:01:42,698 - DEBUG - [Pod ctest-pod-56872778] Cmd: wget http://10.101.89.78:80/ -O - -T 5 -t 1 , Output: ctest-pod-68096708 Connecting to 10.101.89.78:80 (10.101.89.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-23 13:01:42,698 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd wget http://10.101.89.78:80/ -O - -T 5 -t 1 passed 2025-10-23 13:01:42,698 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd output: ctest-pod-68096708 Connecting to 10.101.89.78:80 (10.101.89.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-23 13:01:42,698 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-57830295': 2, 'ctest-pod-68096708': 1} 2025-10-23 13:01:42,752 - DEBUG - [Pod ctest-pod-01911530] Cmd: wget http://10.101.89.78:80/ -O - -T 5 -t 1 , Output: ctest-pod-57830295 Connecting to 10.101.89.78:80 (10.101.89.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-23 13:01:42,752 - DEBUG - [Pod Pod ctest-pod-01911530] Cmd wget http://10.101.89.78:80/ -O - -T 5 -t 1 passed 2025-10-23 13:01:42,752 - DEBUG - [Pod Pod ctest-pod-01911530] Cmd output: ctest-pod-57830295 Connecting to 10.101.89.78:80 (10.101.89.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-23 13:01:42,801 - DEBUG - [Pod ctest-pod-01911530] Cmd: wget http://10.101.89.78:80/ -O - -T 5 -t 1 , Output: ctest-pod-68096708 Connecting to 10.101.89.78:80 (10.101.89.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-23 13:01:42,801 - DEBUG - [Pod Pod ctest-pod-01911530] Cmd wget http://10.101.89.78:80/ -O - -T 5 -t 1 passed 2025-10-23 13:01:42,801 - DEBUG - [Pod Pod ctest-pod-01911530] Cmd output: ctest-pod-68096708 Connecting to 10.101.89.78:80 (10.101.89.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-23 13:01:42,801 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-57830295': 1, 'ctest-pod-68096708': 1} 2025-10-23 13:01:42,805 - DEBUG - Network policy ingress-on-service not present 2025-10-23 13:01:42,806 - INFO - Creating Network Policy ingress-on-service 2025-10-23 13:01:42,818 - INFO - Network policy found in k8s 2025-10-23 13:01:42,818 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=13781c8e-51a0-4241-9481-d75b198a133b 2025-10-23 13:01:42,825 - INFO - Network Policy ingress-on-service with uuid 13781c8e-51a0-4241-9481-d75b198a133b found in kube manager 2025-10-23 13:01:42,850 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-10-23 13:01:42,850 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-10-23 13:01:42,850 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=13781c8e-51a0-4241-9481-d75b198a133b 2025-10-23 13:01:42,870 - WARNING - Network policy with name ingress-on-service not found in agent 2025-10-23 13:01:44,871 - DEBUG - Requesting: http://10.0.0.65:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=13781c8e-51a0-4241-9481-d75b198a133b 2025-10-23 13:01:44,894 - INFO - Network policy with name ingress-on-service found in agent 2025-10-23 13:01:44,894 - INFO - Network Policy ingress-on-service verification passed 2025-10-23 13:01:49,943 - DEBUG - [Pod ctest-pod-56872778] Cmd: wget http://10.101.89.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:01:49,944 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd wget http://10.101.89.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:01:49,944 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:01:54,995 - DEBUG - [Pod ctest-pod-56872778] Cmd: wget http://10.101.89.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:01:54,996 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd wget http://10.101.89.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:01:54,996 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:02:00,043 - DEBUG - [Pod ctest-pod-56872778] Cmd: wget http://10.101.89.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:02:00,043 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd wget http://10.101.89.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:02:00,043 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:02:05,088 - DEBUG - [Pod ctest-pod-56872778] Cmd: wget http://10.101.89.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:02:05,088 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd wget http://10.101.89.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:02:05,088 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:02:10,139 - DEBUG - [Pod ctest-pod-56872778] Cmd: wget http://10.101.89.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:02:10,139 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd wget http://10.101.89.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:02:10,139 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:02:15,187 - DEBUG - [Pod ctest-pod-56872778] Cmd: wget http://10.101.89.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:02:15,188 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd wget http://10.101.89.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:02:15,188 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:02:20,227 - DEBUG - [Pod ctest-pod-56872778] Cmd: wget http://10.101.89.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:02:20,227 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd wget http://10.101.89.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:02:20,227 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:02:25,277 - DEBUG - [Pod ctest-pod-56872778] Cmd: wget http://10.101.89.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:02:25,277 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd wget http://10.101.89.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:02:25,277 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:02:30,328 - DEBUG - [Pod ctest-pod-56872778] Cmd: wget http://10.101.89.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:02:30,328 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd wget http://10.101.89.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:02:30,328 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:02:35,383 - DEBUG - [Pod ctest-pod-56872778] Cmd: wget http://10.101.89.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:02:35,383 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd wget http://10.101.89.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:02:35,383 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:02:35,383 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-57830295': 0, 'ctest-pod-68096708': 0} 2025-10-23 13:02:35,435 - DEBUG - [Pod ctest-pod-24054747] Cmd: wget http://10.101.89.78:80/ -O - -T 5 -t 1 , Output: ctest-pod-57830295 Connecting to 10.101.89.78:80 (10.101.89.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-23 13:02:35,436 - DEBUG - [Pod Pod ctest-pod-24054747] Cmd wget http://10.101.89.78:80/ -O - -T 5 -t 1 passed 2025-10-23 13:02:35,436 - DEBUG - [Pod Pod ctest-pod-24054747] Cmd output: ctest-pod-57830295 Connecting to 10.101.89.78:80 (10.101.89.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-23 13:02:35,482 - DEBUG - [Pod ctest-pod-24054747] Cmd: wget http://10.101.89.78:80/ -O - -T 5 -t 1 , Output: ctest-pod-68096708 Connecting to 10.101.89.78:80 (10.101.89.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-23 13:02:35,482 - DEBUG - [Pod Pod ctest-pod-24054747] Cmd wget http://10.101.89.78:80/ -O - -T 5 -t 1 passed 2025-10-23 13:02:35,482 - DEBUG - [Pod Pod ctest-pod-24054747] Cmd output: ctest-pod-68096708 Connecting to 10.101.89.78:80 (10.101.89.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-23 13:02:35,482 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-57830295': 1, 'ctest-pod-68096708': 1} 2025-10-23 13:02:40,528 - DEBUG - [Pod ctest-pod-01911530] Cmd: wget http://10.101.89.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:02:40,528 - DEBUG - [Pod Pod ctest-pod-01911530] Cmd wget http://10.101.89.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:02:40,528 - DEBUG - [Pod Pod ctest-pod-01911530] Cmd output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:02:45,576 - DEBUG - [Pod ctest-pod-01911530] Cmd: wget http://10.101.89.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:02:45,576 - DEBUG - [Pod Pod ctest-pod-01911530] Cmd wget http://10.101.89.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:02:45,576 - DEBUG - [Pod Pod ctest-pod-01911530] Cmd output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:02:50,635 - DEBUG - [Pod ctest-pod-01911530] Cmd: wget http://10.101.89.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:02:50,635 - DEBUG - [Pod Pod ctest-pod-01911530] Cmd wget http://10.101.89.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:02:50,635 - DEBUG - [Pod Pod ctest-pod-01911530] Cmd output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:02:55,683 - DEBUG - [Pod ctest-pod-01911530] Cmd: wget http://10.101.89.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:02:55,683 - DEBUG - [Pod Pod ctest-pod-01911530] Cmd wget http://10.101.89.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:02:55,683 - DEBUG - [Pod Pod ctest-pod-01911530] Cmd output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:03:00,736 - DEBUG - [Pod ctest-pod-01911530] Cmd: wget http://10.101.89.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:03:00,737 - DEBUG - [Pod Pod ctest-pod-01911530] Cmd wget http://10.101.89.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:03:00,737 - DEBUG - [Pod Pod ctest-pod-01911530] Cmd output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:03:05,788 - DEBUG - [Pod ctest-pod-01911530] Cmd: wget http://10.101.89.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:03:05,788 - DEBUG - [Pod Pod ctest-pod-01911530] Cmd wget http://10.101.89.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:03:05,788 - DEBUG - [Pod Pod ctest-pod-01911530] Cmd output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:03:10,843 - DEBUG - [Pod ctest-pod-01911530] Cmd: wget http://10.101.89.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:03:10,843 - DEBUG - [Pod Pod ctest-pod-01911530] Cmd wget http://10.101.89.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:03:10,844 - DEBUG - [Pod Pod ctest-pod-01911530] Cmd output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:03:15,889 - DEBUG - [Pod ctest-pod-01911530] Cmd: wget http://10.101.89.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:03:15,889 - DEBUG - [Pod Pod ctest-pod-01911530] Cmd wget http://10.101.89.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:03:15,889 - DEBUG - [Pod Pod ctest-pod-01911530] Cmd output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:03:20,937 - DEBUG - [Pod ctest-pod-01911530] Cmd: wget http://10.101.89.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:03:20,937 - DEBUG - [Pod Pod ctest-pod-01911530] Cmd wget http://10.101.89.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:03:20,937 - DEBUG - [Pod Pod ctest-pod-01911530] Cmd output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:03:25,992 - DEBUG - [Pod ctest-pod-01911530] Cmd: wget http://10.101.89.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:03:25,992 - DEBUG - [Pod Pod ctest-pod-01911530] Cmd wget http://10.101.89.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:03:25,992 - DEBUG - [Pod Pod ctest-pod-01911530] Cmd output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:03:25,992 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-57830295': 0, 'ctest-pod-68096708': 0} 2025-10-23 13:03:28,053 - DEBUG - [Pod ctest-pod-24054747] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.732 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.058 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.092 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.058/0.294/0.732 ms 2025-10-23 13:03:28,053 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-24054747 with expectation True passed 2025-10-23 13:03:30,100 - DEBUG - [Pod ctest-pod-56872778] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.769 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.079 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.089 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.079/0.312/0.769 ms 2025-10-23 13:03:30,100 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-56872778 with expectation True passed 2025-10-23 13:03:32,144 - DEBUG - [Pod ctest-pod-01911530] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.243 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.077 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.070/0.463/1.243 ms 2025-10-23 13:03:32,144 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-01911530 with expectation True passed 2025-10-23 13:03:32,198 - DEBUG - [Pod ctest-pod-24054747] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-23 13:03:32,198 - DEBUG - [Pod Pod ctest-pod-24054747] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-10-23 13:03:32,198 - DEBUG - [Pod Pod ctest-pod-24054747] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-23 13:03:32,198 - INFO - wget check of of http://10.47.255.251 from ctest-pod-24054747 passed 2025-10-23 13:03:32,234 - DEBUG - [Pod ctest-pod-24054747] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-23 13:03:32,234 - DEBUG - [Pod Pod ctest-pod-24054747] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-10-23 13:03:32,234 - DEBUG - [Pod Pod ctest-pod-24054747] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-23 13:03:32,234 - INFO - wget check of of http://10.47.255.250 from ctest-pod-24054747 passed 2025-10-23 13:03:37,289 - DEBUG - [Pod ctest-pod-56872778] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-10-23 13:03:37,290 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-10-23 13:03:37,290 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-10-23 13:03:37,290 - INFO - wget check of of http://10.47.255.250 from ctest-pod-56872778 passed 2025-10-23 13:03:42,351 - DEBUG - [Pod ctest-pod-32208154] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-10-23 13:03:42,351 - DEBUG - [Pod Pod ctest-pod-32208154] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-10-23 13:03:42,351 - DEBUG - [Pod Pod ctest-pod-32208154] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-10-23 13:03:42,351 - INFO - wget check of of http://10.47.255.251 from ctest-pod-32208154 passed 2025-10-23 13:03:42,361 - INFO - Updating Network Policy ingress-on-service 2025-10-23 13:03:47,432 - DEBUG - [Pod ctest-pod-56872778] Cmd: wget http://10.101.89.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:03:47,432 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd wget http://10.101.89.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:03:47,432 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:03:52,480 - DEBUG - [Pod ctest-pod-56872778] Cmd: wget http://10.101.89.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:03:52,480 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd wget http://10.101.89.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:03:52,480 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:03:57,527 - DEBUG - [Pod ctest-pod-56872778] Cmd: wget http://10.101.89.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:03:57,527 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd wget http://10.101.89.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:03:57,527 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:04:02,579 - DEBUG - [Pod ctest-pod-56872778] Cmd: wget http://10.101.89.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:04:02,580 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd wget http://10.101.89.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:04:02,580 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:04:07,640 - DEBUG - [Pod ctest-pod-56872778] Cmd: wget http://10.101.89.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:04:07,640 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd wget http://10.101.89.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:04:07,640 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:04:12,701 - DEBUG - [Pod ctest-pod-56872778] Cmd: wget http://10.101.89.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:04:12,702 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd wget http://10.101.89.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:04:12,702 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:04:17,752 - DEBUG - [Pod ctest-pod-56872778] Cmd: wget http://10.101.89.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:04:17,752 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd wget http://10.101.89.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:04:17,752 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:04:22,805 - DEBUG - [Pod ctest-pod-56872778] Cmd: wget http://10.101.89.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:04:22,805 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd wget http://10.101.89.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:04:22,805 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:04:27,860 - DEBUG - [Pod ctest-pod-56872778] Cmd: wget http://10.101.89.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:04:27,860 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd wget http://10.101.89.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:04:27,860 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:04:28,705 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2025-10-23 13:04:38,770 - DEBUG - [Pod ctest-pod-56872778] Cmd: wget http://10.101.89.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:04:38,770 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd wget http://10.101.89.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:04:38,770 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd output: Connecting to 10.101.89.78:80 (10.101.89.78:80) wget: download timed out 2025-10-23 13:04:38,770 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-57830295': 0, 'ctest-pod-68096708': 0} 2025-10-23 13:04:38,835 - DEBUG - [Pod ctest-pod-24054747] Cmd: wget http://10.101.89.78:80/ -O - -T 5 -t 1 , Output: ctest-pod-57830295 Connecting to 10.101.89.78:80 (10.101.89.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-23 13:04:38,835 - DEBUG - [Pod Pod ctest-pod-24054747] Cmd wget http://10.101.89.78:80/ -O - -T 5 -t 1 passed 2025-10-23 13:04:38,835 - DEBUG - [Pod Pod ctest-pod-24054747] Cmd output: ctest-pod-57830295 Connecting to 10.101.89.78:80 (10.101.89.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-23 13:04:38,886 - DEBUG - [Pod ctest-pod-24054747] Cmd: wget http://10.101.89.78:80/ -O - -T 5 -t 1 , Output: ctest-pod-57830295 Connecting to 10.101.89.78:80 (10.101.89.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-23 13:04:38,886 - DEBUG - [Pod Pod ctest-pod-24054747] Cmd wget http://10.101.89.78:80/ -O - -T 5 -t 1 passed 2025-10-23 13:04:38,886 - DEBUG - [Pod Pod ctest-pod-24054747] Cmd output: ctest-pod-57830295 Connecting to 10.101.89.78:80 (10.101.89.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-23 13:04:38,963 - DEBUG - [Pod ctest-pod-24054747] Cmd: wget http://10.101.89.78:80/ -O - -T 5 -t 1 , Output: ctest-pod-57830295 Connecting to 10.101.89.78:80 (10.101.89.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-23 13:04:38,963 - DEBUG - [Pod Pod ctest-pod-24054747] Cmd wget http://10.101.89.78:80/ -O - -T 5 -t 1 passed 2025-10-23 13:04:38,963 - DEBUG - [Pod Pod ctest-pod-24054747] Cmd output: ctest-pod-57830295 Connecting to 10.101.89.78:80 (10.101.89.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-23 13:04:39,035 - DEBUG - [Pod ctest-pod-24054747] Cmd: wget http://10.101.89.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.89.78:80 (10.101.89.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-57830295 2025-10-23 13:04:39,035 - DEBUG - [Pod Pod ctest-pod-24054747] Cmd wget http://10.101.89.78:80/ -O - -T 5 -t 1 passed 2025-10-23 13:04:39,035 - DEBUG - [Pod Pod ctest-pod-24054747] Cmd output: Connecting to 10.101.89.78:80 (10.101.89.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-57830295 2025-10-23 13:04:39,091 - DEBUG - [Pod ctest-pod-24054747] Cmd: wget http://10.101.89.78:80/ -O - -T 5 -t 1 , Output: ctest-pod-57830295 Connecting to 10.101.89.78:80 (10.101.89.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-23 13:04:39,091 - DEBUG - [Pod Pod ctest-pod-24054747] Cmd wget http://10.101.89.78:80/ -O - -T 5 -t 1 passed 2025-10-23 13:04:39,091 - DEBUG - [Pod Pod ctest-pod-24054747] Cmd output: ctest-pod-57830295 Connecting to 10.101.89.78:80 (10.101.89.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-23 13:04:39,169 - DEBUG - [Pod ctest-pod-24054747] Cmd: wget http://10.101.89.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.89.78:80 (10.101.89.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-57830295 2025-10-23 13:04:39,169 - DEBUG - [Pod Pod ctest-pod-24054747] Cmd wget http://10.101.89.78:80/ -O - -T 5 -t 1 passed 2025-10-23 13:04:39,169 - DEBUG - [Pod Pod ctest-pod-24054747] Cmd output: Connecting to 10.101.89.78:80 (10.101.89.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-57830295 2025-10-23 13:04:39,229 - DEBUG - [Pod ctest-pod-24054747] Cmd: wget http://10.101.89.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.89.78:80 (10.101.89.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-68096708 2025-10-23 13:04:39,229 - DEBUG - [Pod Pod ctest-pod-24054747] Cmd wget http://10.101.89.78:80/ -O - -T 5 -t 1 passed 2025-10-23 13:04:39,229 - DEBUG - [Pod Pod ctest-pod-24054747] Cmd output: Connecting to 10.101.89.78:80 (10.101.89.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-68096708 2025-10-23 13:04:39,229 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-57830295': 6, 'ctest-pod-68096708': 1} 2025-10-23 13:04:39,278 - DEBUG - [Pod ctest-pod-01911530] Cmd: wget http://10.101.89.78:80/ -O - -T 5 -t 1 , Output: ctest-pod-57830295 Connecting to 10.101.89.78:80 (10.101.89.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-23 13:04:39,278 - DEBUG - [Pod Pod ctest-pod-01911530] Cmd wget http://10.101.89.78:80/ -O - -T 5 -t 1 passed 2025-10-23 13:04:39,279 - DEBUG - [Pod Pod ctest-pod-01911530] Cmd output: ctest-pod-57830295 Connecting to 10.101.89.78:80 (10.101.89.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-23 13:04:39,350 - DEBUG - [Pod ctest-pod-01911530] Cmd: wget http://10.101.89.78:80/ -O - -T 5 -t 1 , Output: ctest-pod-68096708 Connecting to 10.101.89.78:80 (10.101.89.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-23 13:04:39,350 - DEBUG - [Pod Pod ctest-pod-01911530] Cmd wget http://10.101.89.78:80/ -O - -T 5 -t 1 passed 2025-10-23 13:04:39,350 - DEBUG - [Pod Pod ctest-pod-01911530] Cmd output: ctest-pod-68096708 Connecting to 10.101.89.78:80 (10.101.89.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-10-23 13:04:39,350 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-57830295': 1, 'ctest-pod-68096708': 1} 2025-10-23 13:04:41,446 - DEBUG - [Pod ctest-pod-24054747] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.543 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.084 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.079 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.079/0.235/0.543 ms 2025-10-23 13:04:41,446 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-24054747 with expectation True passed 2025-10-23 13:04:43,499 - DEBUG - [Pod ctest-pod-56872778] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.464 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.072 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.070/0.202/0.464 ms 2025-10-23 13:04:43,499 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-56872778 with expectation True passed 2025-10-23 13:04:45,549 - DEBUG - [Pod ctest-pod-01911530] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.727 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.085 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.086 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.085/0.299/0.727 ms 2025-10-23 13:04:45,550 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-01911530 with expectation True passed 2025-10-23 13:04:45,602 - DEBUG - [Pod ctest-pod-24054747] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-23 13:04:45,602 - DEBUG - [Pod Pod ctest-pod-24054747] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-10-23 13:04:45,602 - DEBUG - [Pod Pod ctest-pod-24054747] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-23 13:04:45,602 - INFO - wget check of of http://10.47.255.251 from ctest-pod-24054747 passed 2025-10-23 13:04:45,653 - DEBUG - [Pod ctest-pod-24054747] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-23 13:04:45,653 - DEBUG - [Pod Pod ctest-pod-24054747] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-10-23 13:04:45,653 - DEBUG - [Pod Pod ctest-pod-24054747] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-23 13:04:45,653 - INFO - wget check of of http://10.47.255.250 from ctest-pod-24054747 passed 2025-10-23 13:04:50,699 - DEBUG - [Pod ctest-pod-56872778] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-10-23 13:04:50,700 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-10-23 13:04:50,700 - DEBUG - [Pod Pod ctest-pod-56872778] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-10-23 13:04:50,700 - INFO - wget check of of http://10.47.255.250 from ctest-pod-56872778 passed 2025-10-23 13:04:50,753 - DEBUG - [Pod ctest-pod-32208154] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-23 13:04:50,753 - DEBUG - [Pod Pod ctest-pod-32208154] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-10-23 13:04:50,753 - DEBUG - [Pod Pod ctest-pod-32208154] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-10-23 13:04:50,753 - INFO - wget check of of http://10.47.255.251 from ctest-pod-32208154 passed 2025-10-23 13:04:50,753 - INFO - Deleting Network Policy : ingress-on-service 2025-10-23 13:04:50,754 - INFO - Deleting service : ctest-nginx-svc-02257683 2025-10-23 13:04:50,979 - DEBUG - No XMPP flaps were noticed during the test