2025-11-05 10:08:23,038 - INFO - Using existing project ['default-domain', 'k8s-default'](d8e6bab5-0f85-4af1-9c11-4690e7c1bf89) 2025-11-05 10:08:23,065 - DEBUG - Namespace ctest-new-default-33006419 not present 2025-11-05 10:08:23,084 - INFO - Created namespace ctest-new-default-33006419 2025-11-05 10:08:26,089 - DEBUG - Namespace ctest-non-default-59733776 not present 2025-11-05 10:08:26,099 - INFO - Created namespace ctest-non-default-59733776 2025-11-05 10:08:29,118 - DEBUG - Pod ctest-pod-71696269 not present 2025-11-05 10:08:29,118 - INFO - Creating Pod ctest-pod-71696269 2025-11-05 10:08:29,157 - DEBUG - Pod : ctest-pod-71696269 UUID is 1e464b26-a080-4297-a4f7-69e9095da513 2025-11-05 10:08:29,164 - DEBUG - Pod ctest-pod-41189626 not present 2025-11-05 10:08:29,165 - INFO - Creating Pod ctest-pod-41189626 2025-11-05 10:08:29,191 - DEBUG - Pod : ctest-pod-41189626 UUID is 21583128-d0be-4ee6-8acd-5643985f22da 2025-11-05 10:08:29,203 - DEBUG - Pod ctest-pod-57416526 not present 2025-11-05 10:08:29,204 - INFO - Creating Pod ctest-pod-57416526 2025-11-05 10:08:29,241 - DEBUG - Pod : ctest-pod-57416526 UUID is 679b2377-d792-4939-89d1-a4eca1d54667 2025-11-05 10:08:29,246 - DEBUG - Pod ctest-pod-21574455 not present 2025-11-05 10:08:29,247 - INFO - Creating Pod ctest-pod-21574455 2025-11-05 10:08:29,274 - DEBUG - Pod : ctest-pod-21574455 UUID is c9e5cc36-d544-451f-aacf-a4835838e18d 2025-11-05 10:08:29,276 - DEBUG - Pod ctest-pod-73849696 not present 2025-11-05 10:08:29,277 - INFO - Creating Pod ctest-pod-73849696 2025-11-05 10:08:29,296 - DEBUG - Pod : ctest-pod-73849696 UUID is 5bea5f42-5885-48c0-8964-c8baaf276a88 2025-11-05 10:08:29,298 - DEBUG - Pod ctest-pod-00181101 not present 2025-11-05 10:08:29,299 - INFO - Creating Pod ctest-pod-00181101 2025-11-05 10:08:29,330 - DEBUG - Pod : ctest-pod-00181101 UUID is f354416a-2d4f-4413-b019-cebf42836004 2025-11-05 10:08:29,333 - DEBUG - Pod ctest-pod-05496882 not present 2025-11-05 10:08:29,333 - INFO - Creating Pod ctest-pod-05496882 2025-11-05 10:08:29,375 - DEBUG - Pod : ctest-pod-05496882 UUID is ada65ddb-ba56-4a84-851a-bb4332f1c0e9 2025-11-05 10:08:29,378 - DEBUG - Pod ctest-pod-52727389 not present 2025-11-05 10:08:29,378 - INFO - Creating Pod ctest-pod-52727389 2025-11-05 10:08:29,397 - DEBUG - Pod : ctest-pod-52727389 UUID is 3fef1862-5d35-495f-868d-0b2abf2c3c80 2025-11-05 10:08:29,654 - INFO - Project default-domain:k8s-ctest-new-default-33006419 for Namespace ctest-new-default-33006419 is seen in contrail-api 2025-11-05 10:08:29,654 - DEBUG - Project uuid in Contrail is 5df88a55-d66c-4a42-a93b-b81c69f00c16 2025-11-05 10:08:29,870 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_NamespaceDatabaseList?namespace_uuid=7873f9d4-1e92-4bb2-b666-d2a37cbd6fed 2025-11-05 10:08:29,874 - INFO - Namespace ctest-new-default-33006419 with uuid 7873f9d4-1e92-4bb2-b666-d2a37cbd6fed found in kube manager 2025-11-05 10:08:29,874 - INFO - Namespace ctest-new-default-33006419 verification passed 2025-11-05 10:08:30,133 - INFO - Project default-domain:k8s-ctest-non-default-59733776 for Namespace ctest-non-default-59733776 is seen in contrail-api 2025-11-05 10:08:30,133 - DEBUG - Project uuid in Contrail is a74b7cd2-4d8c-4724-a7f2-3b04a5c65578 2025-11-05 10:08:30,133 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_NamespaceDatabaseList?namespace_uuid=89765d43-39da-4d0a-aa39-9fb79c6626f4 2025-11-05 10:08:30,146 - INFO - Namespace ctest-non-default-59733776 with uuid 89765d43-39da-4d0a-aa39-9fb79c6626f4 found in kube manager 2025-11-05 10:08:30,146 - INFO - Namespace ctest-non-default-59733776 verification passed 2025-11-05 10:08:30,155 - DEBUG - Pod ctest-pod-71696269 not in running state.Currently in Pending 2025-11-05 10:08:35,163 - DEBUG - Pod ctest-pod-71696269 not in running state.Currently in Pending 2025-11-05 10:08:40,170 - DEBUG - Pod ctest-pod-71696269 not in running state.Currently in Pending 2025-11-05 10:08:45,178 - INFO - Pod ctest-pod-71696269 is in running state.Got IP 10.47.255.251 2025-11-05 10:08:45,192 - DEBUG - Pod ctest-pod-71696269 has vmi 61742b14-ba2f-11f0-b1a3-fa163ed95b3b 2025-11-05 10:08:45,192 - INFO - Verified pod ctest-pod-71696269 in contrail-api 2025-11-05 10:08:45,206 - DEBUG - VMI 61742b14-ba2f-11f0-b1a3-fa163ed95b3b is active in agent 10.0.0.242 2025-11-05 10:08:45,206 - INFO - Verified Pod ctest-pod-71696269 in agent 10.0.0.242 2025-11-05 10:08:45,206 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_VirtualMachineDatabaseList?x=1e464b26-a080-4297-a4f7-69e9095da513 2025-11-05 10:08:45,210 - INFO - Pod ctest-pod-71696269 with uuid 1e464b26-a080-4297-a4f7-69e9095da513 found in kube manager 2025-11-05 10:08:45,210 - INFO - Pod ctest-pod-71696269 verification passed 2025-11-05 10:08:45,217 - INFO - Pod ctest-pod-41189626 is in running state.Got IP 10.47.255.250 2025-11-05 10:08:45,273 - DEBUG - Pod ctest-pod-41189626 has vmi 61f12970-ba2f-11f0-b1a3-fa163ed95b3b 2025-11-05 10:08:45,273 - INFO - Verified pod ctest-pod-41189626 in contrail-api 2025-11-05 10:08:45,286 - DEBUG - VMI 61f12970-ba2f-11f0-b1a3-fa163ed95b3b is active in agent 10.0.0.242 2025-11-05 10:08:45,287 - INFO - Verified Pod ctest-pod-41189626 in agent 10.0.0.242 2025-11-05 10:08:45,287 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_VirtualMachineDatabaseList?x=21583128-d0be-4ee6-8acd-5643985f22da 2025-11-05 10:08:45,292 - INFO - Pod ctest-pod-41189626 with uuid 21583128-d0be-4ee6-8acd-5643985f22da found in kube manager 2025-11-05 10:08:45,292 - INFO - Pod ctest-pod-41189626 verification passed 2025-11-05 10:08:45,300 - INFO - Pod ctest-pod-57416526 is in running state.Got IP 10.47.255.249 2025-11-05 10:08:45,357 - DEBUG - Pod ctest-pod-57416526 has vmi 6291116a-ba2f-11f0-b1a3-fa163ed95b3b 2025-11-05 10:08:45,357 - INFO - Verified pod ctest-pod-57416526 in contrail-api 2025-11-05 10:08:45,369 - DEBUG - VMI 6291116a-ba2f-11f0-b1a3-fa163ed95b3b is active in agent 10.0.0.242 2025-11-05 10:08:45,370 - INFO - Verified Pod ctest-pod-57416526 in agent 10.0.0.242 2025-11-05 10:08:45,370 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_VirtualMachineDatabaseList?x=679b2377-d792-4939-89d1-a4eca1d54667 2025-11-05 10:08:45,374 - INFO - Pod ctest-pod-57416526 with uuid 679b2377-d792-4939-89d1-a4eca1d54667 found in kube manager 2025-11-05 10:08:45,374 - INFO - Pod ctest-pod-57416526 verification passed 2025-11-05 10:08:45,382 - INFO - Pod ctest-pod-21574455 is in running state.Got IP 10.47.255.248 2025-11-05 10:08:45,397 - DEBUG - Pod ctest-pod-21574455 has vmi 6309059e-ba2f-11f0-b1a3-fa163ed95b3b 2025-11-05 10:08:45,397 - INFO - Verified pod ctest-pod-21574455 in contrail-api 2025-11-05 10:08:45,407 - DEBUG - VMI 6309059e-ba2f-11f0-b1a3-fa163ed95b3b is active in agent 10.0.0.242 2025-11-05 10:08:45,407 - INFO - Verified Pod ctest-pod-21574455 in agent 10.0.0.242 2025-11-05 10:08:45,407 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_VirtualMachineDatabaseList?x=c9e5cc36-d544-451f-aacf-a4835838e18d 2025-11-05 10:08:45,412 - INFO - Pod ctest-pod-21574455 with uuid c9e5cc36-d544-451f-aacf-a4835838e18d found in kube manager 2025-11-05 10:08:45,412 - INFO - Pod ctest-pod-21574455 verification passed 2025-11-05 10:08:45,417 - INFO - Pod ctest-pod-73849696 is in running state.Got IP 10.47.255.247 2025-11-05 10:08:45,474 - DEBUG - Pod ctest-pod-73849696 has vmi 6391ee36-ba2f-11f0-b1a3-fa163ed95b3b 2025-11-05 10:08:45,474 - INFO - Verified pod ctest-pod-73849696 in contrail-api 2025-11-05 10:08:45,486 - DEBUG - VMI 6391ee36-ba2f-11f0-b1a3-fa163ed95b3b is active in agent 10.0.0.242 2025-11-05 10:08:45,486 - INFO - Verified Pod ctest-pod-73849696 in agent 10.0.0.242 2025-11-05 10:08:45,486 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_VirtualMachineDatabaseList?x=5bea5f42-5885-48c0-8964-c8baaf276a88 2025-11-05 10:08:45,490 - INFO - Pod ctest-pod-73849696 with uuid 5bea5f42-5885-48c0-8964-c8baaf276a88 found in kube manager 2025-11-05 10:08:45,490 - INFO - Pod ctest-pod-73849696 verification passed 2025-11-05 10:08:45,496 - INFO - Pod ctest-pod-05496882 is in running state.Got IP 10.47.255.245 2025-11-05 10:08:45,549 - DEBUG - Pod ctest-pod-05496882 has vmi 64813fcc-ba2f-11f0-b1a3-fa163ed95b3b 2025-11-05 10:08:45,549 - INFO - Verified pod ctest-pod-05496882 in contrail-api 2025-11-05 10:08:45,560 - DEBUG - VMI 64813fcc-ba2f-11f0-b1a3-fa163ed95b3b is active in agent 10.0.0.242 2025-11-05 10:08:45,561 - INFO - Verified Pod ctest-pod-05496882 in agent 10.0.0.242 2025-11-05 10:08:45,561 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_VirtualMachineDatabaseList?x=ada65ddb-ba56-4a84-851a-bb4332f1c0e9 2025-11-05 10:08:45,564 - INFO - Pod ctest-pod-05496882 with uuid ada65ddb-ba56-4a84-851a-bb4332f1c0e9 found in kube manager 2025-11-05 10:08:45,564 - INFO - Pod ctest-pod-05496882 verification passed 2025-11-05 10:08:45,571 - INFO - Pod ctest-pod-00181101 is in running state.Got IP 10.47.255.246 2025-11-05 10:08:45,585 - DEBUG - Pod ctest-pod-00181101 has vmi 64080936-ba2f-11f0-b1a3-fa163ed95b3b 2025-11-05 10:08:45,585 - INFO - Verified pod ctest-pod-00181101 in contrail-api 2025-11-05 10:08:45,599 - DEBUG - VMI 64080936-ba2f-11f0-b1a3-fa163ed95b3b is active in agent 10.0.0.242 2025-11-05 10:08:45,599 - INFO - Verified Pod ctest-pod-00181101 in agent 10.0.0.242 2025-11-05 10:08:45,599 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_VirtualMachineDatabaseList?x=f354416a-2d4f-4413-b019-cebf42836004 2025-11-05 10:08:45,605 - INFO - Pod ctest-pod-00181101 with uuid f354416a-2d4f-4413-b019-cebf42836004 found in kube manager 2025-11-05 10:08:45,605 - INFO - Pod ctest-pod-00181101 verification passed 2025-11-05 10:08:45,614 - DEBUG - Pod ctest-pod-52727389 not in running state.Currently in Pending 2025-11-05 10:08:50,623 - INFO - Pod ctest-pod-52727389 is in running state.Got IP 10.47.255.244 2025-11-05 10:08:50,635 - DEBUG - Pod ctest-pod-52727389 has vmi 64f136c4-ba2f-11f0-b1a3-fa163ed95b3b 2025-11-05 10:08:50,636 - INFO - Verified pod ctest-pod-52727389 in contrail-api 2025-11-05 10:08:50,648 - DEBUG - VMI 64f136c4-ba2f-11f0-b1a3-fa163ed95b3b is active in agent 10.0.0.242 2025-11-05 10:08:50,648 - INFO - Verified Pod ctest-pod-52727389 in agent 10.0.0.242 2025-11-05 10:08:50,648 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_VirtualMachineDatabaseList?x=3fef1862-5d35-495f-868d-0b2abf2c3c80 2025-11-05 10:08:50,652 - INFO - Pod ctest-pod-52727389 with uuid 3fef1862-5d35-495f-868d-0b2abf2c3c80 found in kube manager 2025-11-05 10:08:50,652 - INFO - Pod ctest-pod-52727389 verification passed 2025-11-05 10:08:50,652 - INFO - ================================================================================ 2025-11-05 10:08:50,652 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-11-05 10:08:50,652 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-11-05 10:08:50,895 - DEBUG - Nothing to compare xmpp stats {'10.0.0.242': {'10.0.0.241': '0'}} with 2025-11-05 10:08:50,895 - INFO - Initial checks done. Running the testcase now 2025-11-05 10:08:50,895 - INFO - 2025-11-05 10:08:50,948 - DEBUG - [Pod ctest-pod-71696269] Cmd: echo ctest-pod-71696269 > /usr/share/nginx/html/index.html, Output: 2025-11-05 10:08:50,997 - DEBUG - [Pod ctest-pod-41189626] Cmd: echo ctest-pod-41189626 > /usr/share/nginx/html/index.html, Output: 2025-11-05 10:08:51,051 - DEBUG - [Pod ctest-pod-57416526] Cmd: echo ctest-pod-57416526 > /usr/share/nginx/html/index.html, Output: 2025-11-05 10:08:51,108 - DEBUG - [Pod ctest-pod-21574455] Cmd: echo ctest-pod-21574455 > /usr/share/nginx/html/index.html, Output: 2025-11-05 10:08:51,111 - DEBUG - Service ctest-nginx-svc-29614218 not present 2025-11-05 10:08:51,111 - INFO - Creating service ctest-nginx-svc-29614218 2025-11-05 10:08:51,129 - INFO - Created Service ctest-nginx-svc-29614218 2025-11-05 10:08:51,136 - WARNING - Service UUID b6234d72-fd6d-42dd-b50b-e32046d985e3 not yet found in contrail-api 2025-11-05 10:08:52,142 - INFO - Validated that Service ctest-nginx-svc-29614218 is seen in contrail-api 2025-11-05 10:08:52,143 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_LoadbalancerDatabaseList?x=b6234d72-fd6d-42dd-b50b-e32046d985e3 2025-11-05 10:08:52,147 - INFO - Service ctest-nginx-svc-29614218 with uuid b6234d72-fd6d-42dd-b50b-e32046d985e3 found in kube manager 2025-11-05 10:08:52,148 - INFO - Service ctest-nginx-svc-29614218 verification passed 2025-11-05 10:08:53,240 - DEBUG - [Pod ctest-pod-73849696] Cmd: wget http://10.102.156.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.156.197:80 (10.102.156.197:80) ctest-pod-71696269 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-05 10:08:53,240 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd wget http://10.102.156.197:80/ -O - -T 5 -t 1 passed 2025-11-05 10:08:53,240 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd output: Connecting to 10.102.156.197:80 (10.102.156.197:80) ctest-pod-71696269 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-05 10:08:53,293 - DEBUG - [Pod ctest-pod-73849696] Cmd: wget http://10.102.156.197:80/ -O - -T 5 -t 1 , Output: ctest-pod-41189626 Connecting to 10.102.156.197:80 (10.102.156.197:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-05 10:08:53,293 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd wget http://10.102.156.197:80/ -O - -T 5 -t 1 passed 2025-11-05 10:08:53,293 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd output: ctest-pod-41189626 Connecting to 10.102.156.197:80 (10.102.156.197:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-05 10:08:53,293 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-71696269': 1, 'ctest-pod-41189626': 1} 2025-11-05 10:08:53,351 - DEBUG - [Pod ctest-pod-05496882] Cmd: wget http://10.102.156.197:80/ -O - -T 5 -t 1 , Output: ctest-pod-71696269 Connecting to 10.102.156.197:80 (10.102.156.197:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-05 10:08:53,352 - DEBUG - [Pod Pod ctest-pod-05496882] Cmd wget http://10.102.156.197:80/ -O - -T 5 -t 1 passed 2025-11-05 10:08:53,352 - DEBUG - [Pod Pod ctest-pod-05496882] Cmd output: ctest-pod-71696269 Connecting to 10.102.156.197:80 (10.102.156.197:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-05 10:08:53,410 - DEBUG - [Pod ctest-pod-05496882] Cmd: wget http://10.102.156.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.156.197:80 (10.102.156.197:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-41189626 2025-11-05 10:08:53,410 - DEBUG - [Pod Pod ctest-pod-05496882] Cmd wget http://10.102.156.197:80/ -O - -T 5 -t 1 passed 2025-11-05 10:08:53,410 - DEBUG - [Pod Pod ctest-pod-05496882] Cmd output: Connecting to 10.102.156.197:80 (10.102.156.197:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-41189626 2025-11-05 10:08:53,410 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-71696269': 1, 'ctest-pod-41189626': 1} 2025-11-05 10:08:53,413 - DEBUG - Network policy ingress-on-service not present 2025-11-05 10:08:53,414 - INFO - Creating Network Policy ingress-on-service 2025-11-05 10:08:53,427 - INFO - Network policy found in k8s 2025-11-05 10:08:53,427 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=77568791-4a5b-497e-b5d3-ff4fae0d05ca 2025-11-05 10:08:53,433 - INFO - Network Policy ingress-on-service with uuid 77568791-4a5b-497e-b5d3-ff4fae0d05ca found in kube manager 2025-11-05 10:08:53,458 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-11-05 10:08:53,458 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-11-05 10:08:53,459 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=77568791-4a5b-497e-b5d3-ff4fae0d05ca 2025-11-05 10:08:53,489 - WARNING - Network policy with name ingress-on-service not found in agent 2025-11-05 10:08:55,490 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=77568791-4a5b-497e-b5d3-ff4fae0d05ca 2025-11-05 10:08:55,516 - INFO - Network policy with name ingress-on-service found in agent 2025-11-05 10:08:55,517 - INFO - Network Policy ingress-on-service verification passed 2025-11-05 10:09:00,574 - DEBUG - [Pod ctest-pod-73849696] Cmd: wget http://10.102.156.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:09:00,575 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd wget http://10.102.156.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:09:00,575 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:09:05,630 - DEBUG - [Pod ctest-pod-73849696] Cmd: wget http://10.102.156.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:09:05,630 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd wget http://10.102.156.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:09:05,631 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:09:10,683 - DEBUG - [Pod ctest-pod-73849696] Cmd: wget http://10.102.156.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:09:10,683 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd wget http://10.102.156.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:09:10,683 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:09:15,731 - DEBUG - [Pod ctest-pod-73849696] Cmd: wget http://10.102.156.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:09:15,731 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd wget http://10.102.156.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:09:15,731 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:09:20,783 - DEBUG - [Pod ctest-pod-73849696] Cmd: wget http://10.102.156.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:09:20,783 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd wget http://10.102.156.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:09:20,783 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:09:25,835 - DEBUG - [Pod ctest-pod-73849696] Cmd: wget http://10.102.156.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:09:25,835 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd wget http://10.102.156.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:09:25,835 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:09:30,889 - DEBUG - [Pod ctest-pod-73849696] Cmd: wget http://10.102.156.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:09:30,889 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd wget http://10.102.156.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:09:30,889 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:09:35,945 - DEBUG - [Pod ctest-pod-73849696] Cmd: wget http://10.102.156.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:09:35,945 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd wget http://10.102.156.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:09:35,945 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:09:40,995 - DEBUG - [Pod ctest-pod-73849696] Cmd: wget http://10.102.156.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:09:40,995 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd wget http://10.102.156.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:09:40,995 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:09:46,047 - DEBUG - [Pod ctest-pod-73849696] Cmd: wget http://10.102.156.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:09:46,047 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd wget http://10.102.156.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:09:46,047 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:09:46,047 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-71696269': 0, 'ctest-pod-41189626': 0} 2025-11-05 10:09:46,101 - DEBUG - [Pod ctest-pod-00181101] Cmd: wget http://10.102.156.197:80/ -O - -T 5 -t 1 , Output: ctest-pod-41189626 Connecting to 10.102.156.197:80 (10.102.156.197:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-05 10:09:46,102 - DEBUG - [Pod Pod ctest-pod-00181101] Cmd wget http://10.102.156.197:80/ -O - -T 5 -t 1 passed 2025-11-05 10:09:46,102 - DEBUG - [Pod Pod ctest-pod-00181101] Cmd output: ctest-pod-41189626 Connecting to 10.102.156.197:80 (10.102.156.197:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-05 10:09:46,152 - DEBUG - [Pod ctest-pod-00181101] Cmd: wget http://10.102.156.197:80/ -O - -T 5 -t 1 , Output: ctest-pod-41189626 Connecting to 10.102.156.197:80 (10.102.156.197:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-05 10:09:46,152 - DEBUG - [Pod Pod ctest-pod-00181101] Cmd wget http://10.102.156.197:80/ -O - -T 5 -t 1 passed 2025-11-05 10:09:46,152 - DEBUG - [Pod Pod ctest-pod-00181101] Cmd output: ctest-pod-41189626 Connecting to 10.102.156.197:80 (10.102.156.197:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-05 10:09:46,202 - DEBUG - [Pod ctest-pod-00181101] Cmd: wget http://10.102.156.197:80/ -O - -T 5 -t 1 , Output: ctest-pod-71696269 Connecting to 10.102.156.197:80 (10.102.156.197:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-05 10:09:46,202 - DEBUG - [Pod Pod ctest-pod-00181101] Cmd wget http://10.102.156.197:80/ -O - -T 5 -t 1 passed 2025-11-05 10:09:46,202 - DEBUG - [Pod Pod ctest-pod-00181101] Cmd output: ctest-pod-71696269 Connecting to 10.102.156.197:80 (10.102.156.197:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-05 10:09:46,202 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-71696269': 1, 'ctest-pod-41189626': 2} 2025-11-05 10:09:51,250 - DEBUG - [Pod ctest-pod-05496882] Cmd: wget http://10.102.156.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:09:51,251 - DEBUG - [Pod Pod ctest-pod-05496882] Cmd wget http://10.102.156.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:09:51,251 - DEBUG - [Pod Pod ctest-pod-05496882] Cmd output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:09:56,303 - DEBUG - [Pod ctest-pod-05496882] Cmd: wget http://10.102.156.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:09:56,303 - DEBUG - [Pod Pod ctest-pod-05496882] Cmd wget http://10.102.156.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:09:56,303 - DEBUG - [Pod Pod ctest-pod-05496882] Cmd output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:10:01,363 - DEBUG - [Pod ctest-pod-05496882] Cmd: wget http://10.102.156.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:10:01,364 - DEBUG - [Pod Pod ctest-pod-05496882] Cmd wget http://10.102.156.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:10:01,364 - DEBUG - [Pod Pod ctest-pod-05496882] Cmd output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:10:06,413 - DEBUG - [Pod ctest-pod-05496882] Cmd: wget http://10.102.156.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:10:06,413 - DEBUG - [Pod Pod ctest-pod-05496882] Cmd wget http://10.102.156.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:10:06,413 - DEBUG - [Pod Pod ctest-pod-05496882] Cmd output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:10:11,469 - DEBUG - [Pod ctest-pod-05496882] Cmd: wget http://10.102.156.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:10:11,469 - DEBUG - [Pod Pod ctest-pod-05496882] Cmd wget http://10.102.156.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:10:11,469 - DEBUG - [Pod Pod ctest-pod-05496882] Cmd output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:10:16,534 - DEBUG - [Pod ctest-pod-05496882] Cmd: wget http://10.102.156.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:10:16,534 - DEBUG - [Pod Pod ctest-pod-05496882] Cmd wget http://10.102.156.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:10:16,534 - DEBUG - [Pod Pod ctest-pod-05496882] Cmd output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:10:21,600 - DEBUG - [Pod ctest-pod-05496882] Cmd: wget http://10.102.156.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:10:21,600 - DEBUG - [Pod Pod ctest-pod-05496882] Cmd wget http://10.102.156.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:10:21,600 - DEBUG - [Pod Pod ctest-pod-05496882] Cmd output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:10:26,643 - DEBUG - [Pod ctest-pod-05496882] Cmd: wget http://10.102.156.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:10:26,643 - DEBUG - [Pod Pod ctest-pod-05496882] Cmd wget http://10.102.156.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:10:26,643 - DEBUG - [Pod Pod ctest-pod-05496882] Cmd output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:10:31,700 - DEBUG - [Pod ctest-pod-05496882] Cmd: wget http://10.102.156.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:10:31,700 - DEBUG - [Pod Pod ctest-pod-05496882] Cmd wget http://10.102.156.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:10:31,700 - DEBUG - [Pod Pod ctest-pod-05496882] Cmd output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:10:36,751 - DEBUG - [Pod ctest-pod-05496882] Cmd: wget http://10.102.156.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:10:36,751 - DEBUG - [Pod Pod ctest-pod-05496882] Cmd wget http://10.102.156.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:10:36,752 - DEBUG - [Pod Pod ctest-pod-05496882] Cmd output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:10:36,752 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-71696269': 0, 'ctest-pod-41189626': 0} 2025-11-05 10:10:38,807 - DEBUG - [Pod ctest-pod-00181101] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.327 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.099 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.079 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.079/0.501/1.327 ms 2025-11-05 10:10:38,807 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-00181101 with expectation True passed 2025-11-05 10:10:40,859 - DEBUG - [Pod ctest-pod-73849696] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.354 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.086 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.170/0.354 ms 2025-11-05 10:10:40,859 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-73849696 with expectation True passed 2025-11-05 10:10:42,911 - DEBUG - [Pod ctest-pod-05496882] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.683 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.085 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.279/0.683 ms 2025-11-05 10:10:42,911 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-05496882 with expectation True passed 2025-11-05 10:10:42,964 - DEBUG - [Pod ctest-pod-00181101] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-11-05 10:10:42,964 - DEBUG - [Pod Pod ctest-pod-00181101] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-11-05 10:10:42,964 - DEBUG - [Pod Pod ctest-pod-00181101] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-11-05 10:10:42,964 - INFO - wget check of of http://10.47.255.251 from ctest-pod-00181101 passed 2025-11-05 10:10:43,017 - DEBUG - [Pod ctest-pod-00181101] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-11-05 10:10:43,017 - DEBUG - [Pod Pod ctest-pod-00181101] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-11-05 10:10:43,017 - DEBUG - [Pod Pod ctest-pod-00181101] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-11-05 10:10:43,017 - INFO - wget check of of http://10.47.255.250 from ctest-pod-00181101 passed 2025-11-05 10:10:48,080 - DEBUG - [Pod ctest-pod-73849696] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-11-05 10:10:48,080 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-11-05 10:10:48,080 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-11-05 10:10:48,080 - INFO - wget check of of http://10.47.255.250 from ctest-pod-73849696 passed 2025-11-05 10:10:53,124 - DEBUG - [Pod ctest-pod-52727389] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-11-05 10:10:53,124 - DEBUG - [Pod Pod ctest-pod-52727389] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-11-05 10:10:53,124 - DEBUG - [Pod Pod ctest-pod-52727389] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-11-05 10:10:53,125 - INFO - wget check of of http://10.47.255.251 from ctest-pod-52727389 passed 2025-11-05 10:10:53,133 - INFO - Updating Network Policy ingress-on-service 2025-11-05 10:10:58,201 - DEBUG - [Pod ctest-pod-73849696] Cmd: wget http://10.102.156.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:10:58,201 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd wget http://10.102.156.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:10:58,201 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:11:03,269 - DEBUG - [Pod ctest-pod-73849696] Cmd: wget http://10.102.156.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:11:03,269 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd wget http://10.102.156.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:11:03,269 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:11:08,329 - DEBUG - [Pod ctest-pod-73849696] Cmd: wget http://10.102.156.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:11:08,329 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd wget http://10.102.156.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:11:08,329 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:11:10,220 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2025-11-05 10:11:20,284 - DEBUG - [Pod ctest-pod-73849696] Cmd: wget http://10.102.156.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:11:20,284 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd wget http://10.102.156.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:11:20,284 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:11:25,343 - DEBUG - [Pod ctest-pod-73849696] Cmd: wget http://10.102.156.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:11:25,343 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd wget http://10.102.156.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:11:25,343 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:11:30,395 - DEBUG - [Pod ctest-pod-73849696] Cmd: wget http://10.102.156.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:11:30,395 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd wget http://10.102.156.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:11:30,395 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:11:35,448 - DEBUG - [Pod ctest-pod-73849696] Cmd: wget http://10.102.156.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:11:35,448 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd wget http://10.102.156.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:11:35,448 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:11:40,499 - DEBUG - [Pod ctest-pod-73849696] Cmd: wget http://10.102.156.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:11:40,499 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd wget http://10.102.156.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:11:40,499 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:11:45,551 - DEBUG - [Pod ctest-pod-73849696] Cmd: wget http://10.102.156.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:11:45,552 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd wget http://10.102.156.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:11:45,552 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:11:50,600 - DEBUG - [Pod ctest-pod-73849696] Cmd: wget http://10.102.156.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:11:50,600 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd wget http://10.102.156.197:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:11:50,600 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd output: Connecting to 10.102.156.197:80 (10.102.156.197:80) wget: download timed out 2025-11-05 10:11:50,600 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-71696269': 0, 'ctest-pod-41189626': 0} 2025-11-05 10:11:50,650 - DEBUG - [Pod ctest-pod-00181101] Cmd: wget http://10.102.156.197:80/ -O - -T 5 -t 1 , Output: ctest-pod-71696269 Connecting to 10.102.156.197:80 (10.102.156.197:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-05 10:11:50,650 - DEBUG - [Pod Pod ctest-pod-00181101] Cmd wget http://10.102.156.197:80/ -O - -T 5 -t 1 passed 2025-11-05 10:11:50,650 - DEBUG - [Pod Pod ctest-pod-00181101] Cmd output: ctest-pod-71696269 Connecting to 10.102.156.197:80 (10.102.156.197:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-05 10:11:50,710 - DEBUG - [Pod ctest-pod-00181101] Cmd: wget http://10.102.156.197:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.156.197:80 (10.102.156.197:80) ctest-pod-71696269 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-05 10:11:50,710 - DEBUG - [Pod Pod ctest-pod-00181101] Cmd wget http://10.102.156.197:80/ -O - -T 5 -t 1 passed 2025-11-05 10:11:50,710 - DEBUG - [Pod Pod ctest-pod-00181101] Cmd output: Connecting to 10.102.156.197:80 (10.102.156.197:80) ctest-pod-71696269 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-05 10:11:50,776 - DEBUG - [Pod ctest-pod-00181101] Cmd: wget http://10.102.156.197:80/ -O - -T 5 -t 1 , Output: ctest-pod-71696269 Connecting to 10.102.156.197:80 (10.102.156.197:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-05 10:11:50,776 - DEBUG - [Pod Pod ctest-pod-00181101] Cmd wget http://10.102.156.197:80/ -O - -T 5 -t 1 passed 2025-11-05 10:11:50,776 - DEBUG - [Pod Pod ctest-pod-00181101] Cmd output: ctest-pod-71696269 Connecting to 10.102.156.197:80 (10.102.156.197:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-05 10:11:50,830 - DEBUG - [Pod ctest-pod-00181101] Cmd: wget http://10.102.156.197:80/ -O - -T 5 -t 1 , Output: ctest-pod-41189626 Connecting to 10.102.156.197:80 (10.102.156.197:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-05 10:11:50,830 - DEBUG - [Pod Pod ctest-pod-00181101] Cmd wget http://10.102.156.197:80/ -O - -T 5 -t 1 passed 2025-11-05 10:11:50,830 - DEBUG - [Pod Pod ctest-pod-00181101] Cmd output: ctest-pod-41189626 Connecting to 10.102.156.197:80 (10.102.156.197:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-05 10:11:50,830 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-71696269': 3, 'ctest-pod-41189626': 1} 2025-11-05 10:11:50,881 - DEBUG - [Pod ctest-pod-05496882] Cmd: wget http://10.102.156.197:80/ -O - -T 5 -t 1 , Output: ctest-pod-41189626 Connecting to 10.102.156.197:80 (10.102.156.197:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-05 10:11:50,881 - DEBUG - [Pod Pod ctest-pod-05496882] Cmd wget http://10.102.156.197:80/ -O - -T 5 -t 1 passed 2025-11-05 10:11:50,881 - DEBUG - [Pod Pod ctest-pod-05496882] Cmd output: ctest-pod-41189626 Connecting to 10.102.156.197:80 (10.102.156.197:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-05 10:11:50,938 - DEBUG - [Pod ctest-pod-05496882] Cmd: wget http://10.102.156.197:80/ -O - -T 5 -t 1 , Output: ctest-pod-41189626 Connecting to 10.102.156.197:80 (10.102.156.197:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-05 10:11:50,938 - DEBUG - [Pod Pod ctest-pod-05496882] Cmd wget http://10.102.156.197:80/ -O - -T 5 -t 1 passed 2025-11-05 10:11:50,938 - DEBUG - [Pod Pod ctest-pod-05496882] Cmd output: ctest-pod-41189626 Connecting to 10.102.156.197:80 (10.102.156.197:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-05 10:11:50,994 - DEBUG - [Pod ctest-pod-05496882] Cmd: wget http://10.102.156.197:80/ -O - -T 5 -t 1 , Output: ctest-pod-71696269 Connecting to 10.102.156.197:80 (10.102.156.197:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-05 10:11:50,994 - DEBUG - [Pod Pod ctest-pod-05496882] Cmd wget http://10.102.156.197:80/ -O - -T 5 -t 1 passed 2025-11-05 10:11:50,994 - DEBUG - [Pod Pod ctest-pod-05496882] Cmd output: ctest-pod-71696269 Connecting to 10.102.156.197:80 (10.102.156.197:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-11-05 10:11:50,994 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-71696269': 1, 'ctest-pod-41189626': 2} 2025-11-05 10:11:53,044 - DEBUG - [Pod ctest-pod-00181101] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.276 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.082 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.095 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.082/0.484/1.276 ms 2025-11-05 10:11:53,044 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-00181101 with expectation True passed 2025-11-05 10:11:55,095 - DEBUG - [Pod ctest-pod-73849696] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.429 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.072 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.090 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.072/0.197/0.429 ms 2025-11-05 10:11:55,095 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-73849696 with expectation True passed 2025-11-05 10:11:57,152 - DEBUG - [Pod ctest-pod-05496882] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.845 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.068 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.100 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.068/0.337/0.845 ms 2025-11-05 10:11:57,153 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-05496882 with expectation True passed 2025-11-05 10:11:57,218 - DEBUG - [Pod ctest-pod-00181101] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-11-05 10:11:57,218 - DEBUG - [Pod Pod ctest-pod-00181101] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-11-05 10:11:57,218 - DEBUG - [Pod Pod ctest-pod-00181101] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-11-05 10:11:57,218 - INFO - wget check of of http://10.47.255.251 from ctest-pod-00181101 passed 2025-11-05 10:11:57,274 - DEBUG - [Pod ctest-pod-00181101] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-11-05 10:11:57,274 - DEBUG - [Pod Pod ctest-pod-00181101] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-11-05 10:11:57,274 - DEBUG - [Pod Pod ctest-pod-00181101] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-11-05 10:11:57,275 - INFO - wget check of of http://10.47.255.250 from ctest-pod-00181101 passed 2025-11-05 10:12:02,328 - DEBUG - [Pod ctest-pod-73849696] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-11-05 10:12:02,328 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-11-05 10:12:02,328 - DEBUG - [Pod Pod ctest-pod-73849696] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-11-05 10:12:02,328 - INFO - wget check of of http://10.47.255.250 from ctest-pod-73849696 passed 2025-11-05 10:12:02,390 - DEBUG - [Pod ctest-pod-52727389] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-11-05 10:12:02,390 - DEBUG - [Pod Pod ctest-pod-52727389] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-11-05 10:12:02,390 - DEBUG - [Pod Pod ctest-pod-52727389] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-11-05 10:12:02,390 - INFO - wget check of of http://10.47.255.251 from ctest-pod-52727389 passed 2025-11-05 10:12:02,390 - INFO - Deleting Network Policy : ingress-on-service 2025-11-05 10:12:02,391 - INFO - Deleting service : ctest-nginx-svc-29614218 2025-11-05 10:12:02,661 - DEBUG - No XMPP flaps were noticed during the test