2025-09-11 16:29:35,374 - INFO - Using existing project ['default-domain', 'k8s-default'](316efd6c-1ede-44e8-9325-4ac9cc7564c7) 2025-09-11 16:29:35,391 - DEBUG - Namespace ctest-new-default-30857303 not present 2025-09-11 16:29:35,402 - INFO - Created namespace ctest-new-default-30857303 2025-09-11 16:29:38,408 - DEBUG - Namespace ctest-non-default-36995023 not present 2025-09-11 16:29:38,421 - INFO - Created namespace ctest-non-default-36995023 2025-09-11 16:29:41,449 - DEBUG - Pod ctest-pod-15711015 not present 2025-09-11 16:29:41,449 - INFO - Creating Pod ctest-pod-15711015 2025-09-11 16:29:41,474 - DEBUG - Pod : ctest-pod-15711015 UUID is f0b8a6ed-bf66-4531-a9d3-e72a3a843284 2025-09-11 16:29:41,489 - DEBUG - Pod ctest-pod-56045559 not present 2025-09-11 16:29:41,490 - INFO - Creating Pod ctest-pod-56045559 2025-09-11 16:29:41,524 - DEBUG - Pod : ctest-pod-56045559 UUID is 8d332bef-d533-466d-a82f-2fe3cf6b6ae6 2025-09-11 16:29:41,527 - DEBUG - Pod ctest-pod-15852996 not present 2025-09-11 16:29:41,528 - INFO - Creating Pod ctest-pod-15852996 2025-09-11 16:29:41,557 - DEBUG - Pod : ctest-pod-15852996 UUID is dff1e3e9-9626-4f75-9a4b-cd137be2e449 2025-09-11 16:29:41,560 - DEBUG - Pod ctest-pod-11091559 not present 2025-09-11 16:29:41,561 - INFO - Creating Pod ctest-pod-11091559 2025-09-11 16:29:41,586 - DEBUG - Pod : ctest-pod-11091559 UUID is 95d74749-a501-4d46-bf9d-42b057b0cf70 2025-09-11 16:29:41,589 - DEBUG - Pod ctest-pod-93865693 not present 2025-09-11 16:29:41,589 - INFO - Creating Pod ctest-pod-93865693 2025-09-11 16:29:41,615 - DEBUG - Pod : ctest-pod-93865693 UUID is d9333ad8-50da-4837-9a93-8f9e39f8ffcb 2025-09-11 16:29:41,617 - DEBUG - Pod ctest-pod-92352115 not present 2025-09-11 16:29:41,618 - INFO - Creating Pod ctest-pod-92352115 2025-09-11 16:29:41,642 - DEBUG - Pod : ctest-pod-92352115 UUID is 2c87216b-a289-4821-874f-6fb8c4f3eccf 2025-09-11 16:29:41,645 - DEBUG - Pod ctest-pod-80086487 not present 2025-09-11 16:29:41,645 - INFO - Creating Pod ctest-pod-80086487 2025-09-11 16:29:41,669 - DEBUG - Pod : ctest-pod-80086487 UUID is 635ab3a2-14af-420c-a814-f1c04300d43f 2025-09-11 16:29:41,672 - DEBUG - Pod ctest-pod-61682702 not present 2025-09-11 16:29:41,673 - INFO - Creating Pod ctest-pod-61682702 2025-09-11 16:29:41,713 - DEBUG - Pod : ctest-pod-61682702 UUID is b8095768-ed9b-416b-803b-f60221d81590 2025-09-11 16:29:41,873 - INFO - Project default-domain:k8s-ctest-new-default-30857303 for Namespace ctest-new-default-30857303 is seen in contrail-api 2025-09-11 16:29:41,874 - DEBUG - Project uuid in Contrail is b74d51b5-d712-4b3c-9e15-196e2e60c74e 2025-09-11 16:29:42,052 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NamespaceDatabaseList?namespace_uuid=9c4d3bf9-ed10-4637-ae93-0dfe9cf9a20d 2025-09-11 16:29:42,056 - INFO - Namespace ctest-new-default-30857303 with uuid 9c4d3bf9-ed10-4637-ae93-0dfe9cf9a20d found in kube manager 2025-09-11 16:29:42,056 - INFO - Namespace ctest-new-default-30857303 verification passed 2025-09-11 16:29:42,249 - INFO - Project default-domain:k8s-ctest-non-default-36995023 for Namespace ctest-non-default-36995023 is seen in contrail-api 2025-09-11 16:29:42,249 - DEBUG - Project uuid in Contrail is 4a0dd669-886f-433d-8a7e-7ffa7d618d8c 2025-09-11 16:29:42,250 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NamespaceDatabaseList?namespace_uuid=e69b8ae2-b998-410a-9e01-c17b7b826f16 2025-09-11 16:29:42,253 - INFO - Namespace ctest-non-default-36995023 with uuid e69b8ae2-b998-410a-9e01-c17b7b826f16 found in kube manager 2025-09-11 16:29:42,253 - INFO - Namespace ctest-non-default-36995023 verification passed 2025-09-11 16:29:42,260 - DEBUG - Pod ctest-pod-15711015 not in running state.Currently in Pending 2025-09-11 16:29:47,268 - DEBUG - Pod ctest-pod-15711015 not in running state.Currently in Pending 2025-09-11 16:29:52,276 - INFO - Pod ctest-pod-15711015 is in running state.Got IP 10.47.255.251 2025-09-11 16:29:52,330 - DEBUG - Pod ctest-pod-15711015 has vmi 859bc64c-8f2c-11f0-959d-fa163edcc493 2025-09-11 16:29:52,330 - INFO - Verified pod ctest-pod-15711015 in contrail-api 2025-09-11 16:29:52,340 - DEBUG - VMI 859bc64c-8f2c-11f0-959d-fa163edcc493 is active in agent 10.0.0.19 2025-09-11 16:29:52,340 - INFO - Verified Pod ctest-pod-15711015 in agent 10.0.0.19 2025-09-11 16:29:52,340 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=f0b8a6ed-bf66-4531-a9d3-e72a3a843284 2025-09-11 16:29:52,344 - INFO - Pod ctest-pod-15711015 with uuid f0b8a6ed-bf66-4531-a9d3-e72a3a843284 found in kube manager 2025-09-11 16:29:52,344 - INFO - Pod ctest-pod-15711015 verification passed 2025-09-11 16:29:52,350 - DEBUG - Pod ctest-pod-56045559 not in running state.Currently in Pending 2025-09-11 16:29:57,358 - INFO - Pod ctest-pod-56045559 is in running state.Got IP 10.47.255.250 2025-09-11 16:29:57,370 - DEBUG - Pod ctest-pod-56045559 has vmi 86150778-8f2c-11f0-959d-fa163edcc493 2025-09-11 16:29:57,370 - INFO - Verified pod ctest-pod-56045559 in contrail-api 2025-09-11 16:29:57,381 - DEBUG - VMI 86150778-8f2c-11f0-959d-fa163edcc493 is active in agent 10.0.0.19 2025-09-11 16:29:57,381 - INFO - Verified Pod ctest-pod-56045559 in agent 10.0.0.19 2025-09-11 16:29:57,381 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=8d332bef-d533-466d-a82f-2fe3cf6b6ae6 2025-09-11 16:29:57,385 - INFO - Pod ctest-pod-56045559 with uuid 8d332bef-d533-466d-a82f-2fe3cf6b6ae6 found in kube manager 2025-09-11 16:29:57,385 - INFO - Pod ctest-pod-56045559 verification passed 2025-09-11 16:29:57,391 - INFO - Pod ctest-pod-15852996 is in running state.Got IP 10.47.255.249 2025-09-11 16:29:57,446 - DEBUG - Pod ctest-pod-15852996 has vmi 86b29aec-8f2c-11f0-959d-fa163edcc493 2025-09-11 16:29:57,447 - INFO - Verified pod ctest-pod-15852996 in contrail-api 2025-09-11 16:29:57,459 - DEBUG - VMI 86b29aec-8f2c-11f0-959d-fa163edcc493 is active in agent 10.0.0.19 2025-09-11 16:29:57,459 - INFO - Verified Pod ctest-pod-15852996 in agent 10.0.0.19 2025-09-11 16:29:57,459 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=dff1e3e9-9626-4f75-9a4b-cd137be2e449 2025-09-11 16:29:57,464 - INFO - Pod ctest-pod-15852996 with uuid dff1e3e9-9626-4f75-9a4b-cd137be2e449 found in kube manager 2025-09-11 16:29:57,464 - INFO - Pod ctest-pod-15852996 verification passed 2025-09-11 16:29:57,472 - INFO - Pod ctest-pod-11091559 is in running state.Got IP 10.47.255.248 2025-09-11 16:29:57,485 - DEBUG - Pod ctest-pod-11091559 has vmi 87200c08-8f2c-11f0-959d-fa163edcc493 2025-09-11 16:29:57,485 - INFO - Verified pod ctest-pod-11091559 in contrail-api 2025-09-11 16:29:57,497 - DEBUG - VMI 87200c08-8f2c-11f0-959d-fa163edcc493 is active in agent 10.0.0.19 2025-09-11 16:29:57,497 - INFO - Verified Pod ctest-pod-11091559 in agent 10.0.0.19 2025-09-11 16:29:57,497 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=95d74749-a501-4d46-bf9d-42b057b0cf70 2025-09-11 16:29:57,501 - INFO - Pod ctest-pod-11091559 with uuid 95d74749-a501-4d46-bf9d-42b057b0cf70 found in kube manager 2025-09-11 16:29:57,501 - INFO - Pod ctest-pod-11091559 verification passed 2025-09-11 16:29:57,509 - INFO - Pod ctest-pod-93865693 is in running state.Got IP 10.47.255.247 2025-09-11 16:29:57,572 - DEBUG - Pod ctest-pod-93865693 has vmi 87ab3fc6-8f2c-11f0-959d-fa163edcc493 2025-09-11 16:29:57,572 - INFO - Verified pod ctest-pod-93865693 in contrail-api 2025-09-11 16:29:57,583 - DEBUG - VMI 87ab3fc6-8f2c-11f0-959d-fa163edcc493 is active in agent 10.0.0.19 2025-09-11 16:29:57,583 - INFO - Verified Pod ctest-pod-93865693 in agent 10.0.0.19 2025-09-11 16:29:57,583 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=d9333ad8-50da-4837-9a93-8f9e39f8ffcb 2025-09-11 16:29:57,588 - INFO - Pod ctest-pod-93865693 with uuid d9333ad8-50da-4837-9a93-8f9e39f8ffcb found in kube manager 2025-09-11 16:29:57,588 - INFO - Pod ctest-pod-93865693 verification passed 2025-09-11 16:29:57,594 - DEBUG - Pod ctest-pod-80086487 not in running state.Currently in Pending 2025-09-11 16:30:02,604 - INFO - Pod ctest-pod-80086487 is in running state.Got IP 10.47.255.245 2025-09-11 16:30:02,622 - DEBUG - Pod ctest-pod-80086487 has vmi 888e359c-8f2c-11f0-959d-fa163edcc493 2025-09-11 16:30:02,622 - INFO - Verified pod ctest-pod-80086487 in contrail-api 2025-09-11 16:30:02,651 - DEBUG - VMI 888e359c-8f2c-11f0-959d-fa163edcc493 is active in agent 10.0.0.19 2025-09-11 16:30:02,651 - INFO - Verified Pod ctest-pod-80086487 in agent 10.0.0.19 2025-09-11 16:30:02,651 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=635ab3a2-14af-420c-a814-f1c04300d43f 2025-09-11 16:30:02,661 - INFO - Pod ctest-pod-80086487 with uuid 635ab3a2-14af-420c-a814-f1c04300d43f found in kube manager 2025-09-11 16:30:02,661 - INFO - Pod ctest-pod-80086487 verification passed 2025-09-11 16:30:02,670 - INFO - Pod ctest-pod-92352115 is in running state.Got IP 10.47.255.246 2025-09-11 16:30:02,738 - DEBUG - Pod ctest-pod-92352115 has vmi 881f6a2c-8f2c-11f0-959d-fa163edcc493 2025-09-11 16:30:02,739 - INFO - Verified pod ctest-pod-92352115 in contrail-api 2025-09-11 16:30:02,750 - DEBUG - VMI 881f6a2c-8f2c-11f0-959d-fa163edcc493 is active in agent 10.0.0.19 2025-09-11 16:30:02,750 - INFO - Verified Pod ctest-pod-92352115 in agent 10.0.0.19 2025-09-11 16:30:02,750 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=2c87216b-a289-4821-874f-6fb8c4f3eccf 2025-09-11 16:30:02,755 - INFO - Pod ctest-pod-92352115 with uuid 2c87216b-a289-4821-874f-6fb8c4f3eccf found in kube manager 2025-09-11 16:30:02,755 - INFO - Pod ctest-pod-92352115 verification passed 2025-09-11 16:30:02,763 - INFO - Pod ctest-pod-61682702 is in running state.Got IP 10.47.255.244 2025-09-11 16:30:02,777 - DEBUG - Pod ctest-pod-61682702 has vmi 8900ae92-8f2c-11f0-959d-fa163edcc493 2025-09-11 16:30:02,777 - INFO - Verified pod ctest-pod-61682702 in contrail-api 2025-09-11 16:30:02,790 - DEBUG - VMI 8900ae92-8f2c-11f0-959d-fa163edcc493 is active in agent 10.0.0.19 2025-09-11 16:30:02,790 - INFO - Verified Pod ctest-pod-61682702 in agent 10.0.0.19 2025-09-11 16:30:02,790 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=b8095768-ed9b-416b-803b-f60221d81590 2025-09-11 16:30:02,795 - INFO - Pod ctest-pod-61682702 with uuid b8095768-ed9b-416b-803b-f60221d81590 found in kube manager 2025-09-11 16:30:02,795 - INFO - Pod ctest-pod-61682702 verification passed 2025-09-11 16:30:02,795 - INFO - ================================================================================ 2025-09-11 16:30:02,795 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-09-11 16:30:02,795 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-09-11 16:30:03,058 - DEBUG - Nothing to compare xmpp stats {'10.0.0.19': {'10.0.0.27': '0'}} with 2025-09-11 16:30:03,058 - INFO - Initial checks done. Running the testcase now 2025-09-11 16:30:03,058 - INFO - 2025-09-11 16:30:03,105 - DEBUG - [Pod ctest-pod-15711015] Cmd: echo ctest-pod-15711015 > /usr/share/nginx/html/index.html, Output: 2025-09-11 16:30:03,159 - DEBUG - [Pod ctest-pod-56045559] Cmd: echo ctest-pod-56045559 > /usr/share/nginx/html/index.html, Output: 2025-09-11 16:30:03,222 - DEBUG - [Pod ctest-pod-15852996] Cmd: echo ctest-pod-15852996 > /usr/share/nginx/html/index.html, Output: 2025-09-11 16:30:03,277 - DEBUG - [Pod ctest-pod-11091559] Cmd: echo ctest-pod-11091559 > /usr/share/nginx/html/index.html, Output: 2025-09-11 16:30:03,280 - DEBUG - Service ctest-nginx-svc-39049636 not present 2025-09-11 16:30:03,281 - INFO - Creating service ctest-nginx-svc-39049636 2025-09-11 16:30:03,296 - INFO - Created Service ctest-nginx-svc-39049636 2025-09-11 16:30:03,311 - WARNING - Service UUID d1958f1f-23d4-42e4-8d3e-49bd290de7bf not yet found in contrail-api 2025-09-11 16:30:04,318 - INFO - Validated that Service ctest-nginx-svc-39049636 is seen in contrail-api 2025-09-11 16:30:04,318 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_LoadbalancerDatabaseList?x=d1958f1f-23d4-42e4-8d3e-49bd290de7bf 2025-09-11 16:30:04,323 - INFO - Service ctest-nginx-svc-39049636 with uuid d1958f1f-23d4-42e4-8d3e-49bd290de7bf found in kube manager 2025-09-11 16:30:04,323 - INFO - Service ctest-nginx-svc-39049636 verification passed 2025-09-11 16:30:05,403 - DEBUG - [Pod ctest-pod-93865693] Cmd: wget http://10.107.226.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.226.82:80 (10.107.226.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-56045559 2025-09-11 16:30:05,403 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd wget http://10.107.226.82:80/ -O - -T 5 -t 1 passed 2025-09-11 16:30:05,403 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd output: Connecting to 10.107.226.82:80 (10.107.226.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-56045559 2025-09-11 16:30:05,461 - DEBUG - [Pod ctest-pod-93865693] Cmd: wget http://10.107.226.82:80/ -O - -T 5 -t 1 , Output: ctest-pod-56045559 Connecting to 10.107.226.82:80 (10.107.226.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 16:30:05,462 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd wget http://10.107.226.82:80/ -O - -T 5 -t 1 passed 2025-09-11 16:30:05,462 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd output: ctest-pod-56045559 Connecting to 10.107.226.82:80 (10.107.226.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 16:30:05,534 - DEBUG - [Pod ctest-pod-93865693] Cmd: wget http://10.107.226.82:80/ -O - -T 5 -t 1 , Output: ctest-pod-56045559 Connecting to 10.107.226.82:80 (10.107.226.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 16:30:05,534 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd wget http://10.107.226.82:80/ -O - -T 5 -t 1 passed 2025-09-11 16:30:05,534 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd output: ctest-pod-56045559 Connecting to 10.107.226.82:80 (10.107.226.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 16:30:05,582 - DEBUG - [Pod ctest-pod-93865693] Cmd: wget http://10.107.226.82:80/ -O - -T 5 -t 1 , Output: ctest-pod-15711015 Connecting to 10.107.226.82:80 (10.107.226.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 16:30:05,583 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd wget http://10.107.226.82:80/ -O - -T 5 -t 1 passed 2025-09-11 16:30:05,583 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd output: ctest-pod-15711015 Connecting to 10.107.226.82:80 (10.107.226.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 16:30:05,583 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-15711015': 1, 'ctest-pod-56045559': 3} 2025-09-11 16:30:05,647 - DEBUG - [Pod ctest-pod-80086487] Cmd: wget http://10.107.226.82:80/ -O - -T 5 -t 1 , Output: ctest-pod-15711015 Connecting to 10.107.226.82:80 (10.107.226.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 16:30:05,647 - DEBUG - [Pod Pod ctest-pod-80086487] Cmd wget http://10.107.226.82:80/ -O - -T 5 -t 1 passed 2025-09-11 16:30:05,647 - DEBUG - [Pod Pod ctest-pod-80086487] Cmd output: ctest-pod-15711015 Connecting to 10.107.226.82:80 (10.107.226.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 16:30:05,707 - DEBUG - [Pod ctest-pod-80086487] Cmd: wget http://10.107.226.82:80/ -O - -T 5 -t 1 , Output: ctest-pod-56045559 Connecting to 10.107.226.82:80 (10.107.226.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 16:30:05,707 - DEBUG - [Pod Pod ctest-pod-80086487] Cmd wget http://10.107.226.82:80/ -O - -T 5 -t 1 passed 2025-09-11 16:30:05,707 - DEBUG - [Pod Pod ctest-pod-80086487] Cmd output: ctest-pod-56045559 Connecting to 10.107.226.82:80 (10.107.226.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 16:30:05,707 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-15711015': 1, 'ctest-pod-56045559': 1} 2025-09-11 16:30:05,710 - DEBUG - Network policy ingress-on-service not present 2025-09-11 16:30:05,711 - INFO - Creating Network Policy ingress-on-service 2025-09-11 16:30:05,732 - INFO - Network policy found in k8s 2025-09-11 16:30:05,733 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=e77670be-19a1-493e-992a-f81d24dd44de 2025-09-11 16:30:05,737 - INFO - Network Policy ingress-on-service with uuid e77670be-19a1-493e-992a-f81d24dd44de found in kube manager 2025-09-11 16:30:05,769 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-09-11 16:30:05,769 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-09-11 16:30:05,770 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=e77670be-19a1-493e-992a-f81d24dd44de 2025-09-11 16:30:05,794 - WARNING - Network policy with name ingress-on-service not found in agent 2025-09-11 16:30:07,795 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=e77670be-19a1-493e-992a-f81d24dd44de 2025-09-11 16:30:07,821 - INFO - Network policy with name ingress-on-service found in agent 2025-09-11 16:30:07,822 - INFO - Network Policy ingress-on-service verification passed 2025-09-11 16:30:12,884 - DEBUG - [Pod ctest-pod-93865693] Cmd: wget http://10.107.226.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:30:12,884 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd wget http://10.107.226.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:30:12,884 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:30:17,951 - DEBUG - [Pod ctest-pod-93865693] Cmd: wget http://10.107.226.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:30:17,951 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd wget http://10.107.226.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:30:17,951 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:30:23,007 - DEBUG - [Pod ctest-pod-93865693] Cmd: wget http://10.107.226.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:30:23,007 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd wget http://10.107.226.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:30:23,007 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:30:28,058 - DEBUG - [Pod ctest-pod-93865693] Cmd: wget http://10.107.226.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:30:28,058 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd wget http://10.107.226.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:30:28,058 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:30:33,115 - DEBUG - [Pod ctest-pod-93865693] Cmd: wget http://10.107.226.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:30:33,115 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd wget http://10.107.226.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:30:33,115 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:30:38,178 - DEBUG - [Pod ctest-pod-93865693] Cmd: wget http://10.107.226.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:30:38,178 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd wget http://10.107.226.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:30:38,178 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:30:43,227 - DEBUG - [Pod ctest-pod-93865693] Cmd: wget http://10.107.226.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:30:43,227 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd wget http://10.107.226.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:30:43,228 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:30:48,279 - DEBUG - [Pod ctest-pod-93865693] Cmd: wget http://10.107.226.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:30:48,279 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd wget http://10.107.226.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:30:48,279 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:30:53,330 - DEBUG - [Pod ctest-pod-93865693] Cmd: wget http://10.107.226.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:30:53,330 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd wget http://10.107.226.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:30:53,330 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:30:58,382 - DEBUG - [Pod ctest-pod-93865693] Cmd: wget http://10.107.226.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:30:58,382 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd wget http://10.107.226.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:30:58,382 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:30:58,382 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-15711015': 0, 'ctest-pod-56045559': 0} 2025-09-11 16:30:58,439 - DEBUG - [Pod ctest-pod-92352115] Cmd: wget http://10.107.226.82:80/ -O - -T 5 -t 1 , Output: ctest-pod-56045559 Connecting to 10.107.226.82:80 (10.107.226.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 16:30:58,439 - DEBUG - [Pod Pod ctest-pod-92352115] Cmd wget http://10.107.226.82:80/ -O - -T 5 -t 1 passed 2025-09-11 16:30:58,439 - DEBUG - [Pod Pod ctest-pod-92352115] Cmd output: ctest-pod-56045559 Connecting to 10.107.226.82:80 (10.107.226.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 16:30:58,512 - DEBUG - [Pod ctest-pod-92352115] Cmd: wget http://10.107.226.82:80/ -O - -T 5 -t 1 , Output: ctest-pod-56045559 Connecting to 10.107.226.82:80 (10.107.226.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 16:30:58,512 - DEBUG - [Pod Pod ctest-pod-92352115] Cmd wget http://10.107.226.82:80/ -O - -T 5 -t 1 passed 2025-09-11 16:30:58,512 - DEBUG - [Pod Pod ctest-pod-92352115] Cmd output: ctest-pod-56045559 Connecting to 10.107.226.82:80 (10.107.226.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 16:30:58,550 - DEBUG - [Pod ctest-pod-92352115] Cmd: wget http://10.107.226.82:80/ -O - -T 5 -t 1 , Output: ctest-pod-15711015 Connecting to 10.107.226.82:80 (10.107.226.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 16:30:58,550 - DEBUG - [Pod Pod ctest-pod-92352115] Cmd wget http://10.107.226.82:80/ -O - -T 5 -t 1 passed 2025-09-11 16:30:58,550 - DEBUG - [Pod Pod ctest-pod-92352115] Cmd output: ctest-pod-15711015 Connecting to 10.107.226.82:80 (10.107.226.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 16:30:58,550 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-15711015': 1, 'ctest-pod-56045559': 2} 2025-09-11 16:31:03,604 - DEBUG - [Pod ctest-pod-80086487] Cmd: wget http://10.107.226.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:31:03,604 - DEBUG - [Pod Pod ctest-pod-80086487] Cmd wget http://10.107.226.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:31:03,604 - DEBUG - [Pod Pod ctest-pod-80086487] Cmd output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:31:08,656 - DEBUG - [Pod ctest-pod-80086487] Cmd: wget http://10.107.226.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:31:08,656 - DEBUG - [Pod Pod ctest-pod-80086487] Cmd wget http://10.107.226.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:31:08,656 - DEBUG - [Pod Pod ctest-pod-80086487] Cmd output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:31:13,727 - DEBUG - [Pod ctest-pod-80086487] Cmd: wget http://10.107.226.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:31:13,727 - DEBUG - [Pod Pod ctest-pod-80086487] Cmd wget http://10.107.226.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:31:13,727 - DEBUG - [Pod Pod ctest-pod-80086487] Cmd output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:31:18,783 - DEBUG - [Pod ctest-pod-80086487] Cmd: wget http://10.107.226.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:31:18,783 - DEBUG - [Pod Pod ctest-pod-80086487] Cmd wget http://10.107.226.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:31:18,783 - DEBUG - [Pod Pod ctest-pod-80086487] Cmd output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:31:23,826 - DEBUG - [Pod ctest-pod-80086487] Cmd: wget http://10.107.226.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:31:23,826 - DEBUG - [Pod Pod ctest-pod-80086487] Cmd wget http://10.107.226.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:31:23,826 - DEBUG - [Pod Pod ctest-pod-80086487] Cmd output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:31:28,870 - DEBUG - [Pod ctest-pod-80086487] Cmd: wget http://10.107.226.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:31:28,870 - DEBUG - [Pod Pod ctest-pod-80086487] Cmd wget http://10.107.226.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:31:28,870 - DEBUG - [Pod Pod ctest-pod-80086487] Cmd output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:31:33,919 - DEBUG - [Pod ctest-pod-80086487] Cmd: wget http://10.107.226.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:31:33,919 - DEBUG - [Pod Pod ctest-pod-80086487] Cmd wget http://10.107.226.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:31:33,919 - DEBUG - [Pod Pod ctest-pod-80086487] Cmd output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:31:38,970 - DEBUG - [Pod ctest-pod-80086487] Cmd: wget http://10.107.226.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:31:38,970 - DEBUG - [Pod Pod ctest-pod-80086487] Cmd wget http://10.107.226.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:31:38,971 - DEBUG - [Pod Pod ctest-pod-80086487] Cmd output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:31:44,018 - DEBUG - [Pod ctest-pod-80086487] Cmd: wget http://10.107.226.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:31:44,018 - DEBUG - [Pod Pod ctest-pod-80086487] Cmd wget http://10.107.226.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:31:44,018 - DEBUG - [Pod Pod ctest-pod-80086487] Cmd output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:31:49,070 - DEBUG - [Pod ctest-pod-80086487] Cmd: wget http://10.107.226.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:31:49,071 - DEBUG - [Pod Pod ctest-pod-80086487] Cmd wget http://10.107.226.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:31:49,071 - DEBUG - [Pod Pod ctest-pod-80086487] Cmd output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:31:49,071 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-15711015': 0, 'ctest-pod-56045559': 0} 2025-09-11 16:31:51,119 - DEBUG - [Pod ctest-pod-92352115] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.926 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.097 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.098 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.097/0.373/0.926 ms 2025-09-11 16:31:51,119 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-92352115 with expectation True passed 2025-09-11 16:31:53,170 - DEBUG - [Pod ctest-pod-93865693] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.698 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.078 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.098 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.078/0.291/0.698 ms 2025-09-11 16:31:53,170 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-93865693 with expectation True passed 2025-09-11 16:31:55,218 - DEBUG - [Pod ctest-pod-80086487] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.804 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.075 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.096 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.075/0.325/0.804 ms 2025-09-11 16:31:55,218 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-80086487 with expectation True passed 2025-09-11 16:31:55,266 - DEBUG - [Pod ctest-pod-92352115] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-11 16:31:55,266 - DEBUG - [Pod Pod ctest-pod-92352115] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-09-11 16:31:55,266 - DEBUG - [Pod Pod ctest-pod-92352115] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-11 16:31:55,266 - INFO - wget check of of http://10.47.255.251 from ctest-pod-92352115 passed 2025-09-11 16:31:55,316 - DEBUG - [Pod ctest-pod-92352115] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-11 16:31:55,316 - DEBUG - [Pod Pod ctest-pod-92352115] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-09-11 16:31:55,316 - DEBUG - [Pod Pod ctest-pod-92352115] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-11 16:31:55,316 - INFO - wget check of of http://10.47.255.250 from ctest-pod-92352115 passed 2025-09-11 16:32:00,366 - DEBUG - [Pod ctest-pod-93865693] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-09-11 16:32:00,366 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-09-11 16:32:00,366 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-09-11 16:32:00,366 - INFO - wget check of of http://10.47.255.250 from ctest-pod-93865693 passed 2025-09-11 16:32:05,431 - DEBUG - [Pod ctest-pod-61682702] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-09-11 16:32:05,431 - DEBUG - [Pod Pod ctest-pod-61682702] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-09-11 16:32:05,432 - DEBUG - [Pod Pod ctest-pod-61682702] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-09-11 16:32:05,432 - INFO - wget check of of http://10.47.255.251 from ctest-pod-61682702 passed 2025-09-11 16:32:05,442 - INFO - Updating Network Policy ingress-on-service 2025-09-11 16:32:10,498 - DEBUG - [Pod ctest-pod-93865693] Cmd: wget http://10.107.226.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:32:10,498 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd wget http://10.107.226.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:32:10,498 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:32:15,574 - DEBUG - [Pod ctest-pod-93865693] Cmd: wget http://10.107.226.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:32:15,574 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd wget http://10.107.226.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:32:15,574 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:32:20,622 - DEBUG - [Pod ctest-pod-93865693] Cmd: wget http://10.107.226.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:32:20,622 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd wget http://10.107.226.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:32:20,622 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:32:25,666 - DEBUG - [Pod ctest-pod-93865693] Cmd: wget http://10.107.226.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:32:25,666 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd wget http://10.107.226.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:32:25,666 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:32:30,721 - DEBUG - [Pod ctest-pod-93865693] Cmd: wget http://10.107.226.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:32:30,721 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd wget http://10.107.226.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:32:30,721 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:32:31,176 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2025-09-11 16:32:41,235 - DEBUG - [Pod ctest-pod-93865693] Cmd: wget http://10.107.226.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:32:41,235 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd wget http://10.107.226.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:32:41,235 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:32:46,286 - DEBUG - [Pod ctest-pod-93865693] Cmd: wget http://10.107.226.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:32:46,286 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd wget http://10.107.226.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:32:46,286 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:32:51,338 - DEBUG - [Pod ctest-pod-93865693] Cmd: wget http://10.107.226.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:32:51,338 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd wget http://10.107.226.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:32:51,338 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:32:56,383 - DEBUG - [Pod ctest-pod-93865693] Cmd: wget http://10.107.226.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:32:56,383 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd wget http://10.107.226.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:32:56,383 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:33:01,433 - DEBUG - [Pod ctest-pod-93865693] Cmd: wget http://10.107.226.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:33:01,434 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd wget http://10.107.226.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:33:01,434 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd output: Connecting to 10.107.226.82:80 (10.107.226.82:80) wget: download timed out 2025-09-11 16:33:01,434 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-15711015': 0, 'ctest-pod-56045559': 0} 2025-09-11 16:33:01,528 - DEBUG - [Pod ctest-pod-92352115] Cmd: wget http://10.107.226.82:80/ -O - -T 5 -t 1 , Output: ctest-pod-15711015 Connecting to 10.107.226.82:80 (10.107.226.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 16:33:01,528 - DEBUG - [Pod Pod ctest-pod-92352115] Cmd wget http://10.107.226.82:80/ -O - -T 5 -t 1 passed 2025-09-11 16:33:01,529 - DEBUG - [Pod Pod ctest-pod-92352115] Cmd output: ctest-pod-15711015 Connecting to 10.107.226.82:80 (10.107.226.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 16:33:01,585 - DEBUG - [Pod ctest-pod-92352115] Cmd: wget http://10.107.226.82:80/ -O - -T 5 -t 1 , Output: ctest-pod-15711015 Connecting to 10.107.226.82:80 (10.107.226.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 16:33:01,585 - DEBUG - [Pod Pod ctest-pod-92352115] Cmd wget http://10.107.226.82:80/ -O - -T 5 -t 1 passed 2025-09-11 16:33:01,585 - DEBUG - [Pod Pod ctest-pod-92352115] Cmd output: ctest-pod-15711015 Connecting to 10.107.226.82:80 (10.107.226.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 16:33:01,640 - DEBUG - [Pod ctest-pod-92352115] Cmd: wget http://10.107.226.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.226.82:80 (10.107.226.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-56045559 2025-09-11 16:33:01,640 - DEBUG - [Pod Pod ctest-pod-92352115] Cmd wget http://10.107.226.82:80/ -O - -T 5 -t 1 passed 2025-09-11 16:33:01,640 - DEBUG - [Pod Pod ctest-pod-92352115] Cmd output: Connecting to 10.107.226.82:80 (10.107.226.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-56045559 2025-09-11 16:33:01,640 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-15711015': 2, 'ctest-pod-56045559': 1} 2025-09-11 16:33:01,693 - DEBUG - [Pod ctest-pod-80086487] Cmd: wget http://10.107.226.82:80/ -O - -T 5 -t 1 , Output: ctest-pod-56045559 Connecting to 10.107.226.82:80 (10.107.226.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 16:33:01,693 - DEBUG - [Pod Pod ctest-pod-80086487] Cmd wget http://10.107.226.82:80/ -O - -T 5 -t 1 passed 2025-09-11 16:33:01,694 - DEBUG - [Pod Pod ctest-pod-80086487] Cmd output: ctest-pod-56045559 Connecting to 10.107.226.82:80 (10.107.226.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 16:33:01,747 - DEBUG - [Pod ctest-pod-80086487] Cmd: wget http://10.107.226.82:80/ -O - -T 5 -t 1 , Output: ctest-pod-15711015 Connecting to 10.107.226.82:80 (10.107.226.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 16:33:01,748 - DEBUG - [Pod Pod ctest-pod-80086487] Cmd wget http://10.107.226.82:80/ -O - -T 5 -t 1 passed 2025-09-11 16:33:01,748 - DEBUG - [Pod Pod ctest-pod-80086487] Cmd output: ctest-pod-15711015 Connecting to 10.107.226.82:80 (10.107.226.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-09-11 16:33:01,748 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-15711015': 1, 'ctest-pod-56045559': 1} 2025-09-11 16:33:03,808 - DEBUG - [Pod ctest-pod-92352115] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.371 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.128 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.574 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.128/0.691/1.371 ms 2025-09-11 16:33:03,809 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-92352115 with expectation True passed 2025-09-11 16:33:05,866 - DEBUG - [Pod ctest-pod-93865693] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.780 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.104 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.648 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.104/0.510/0.780 ms 2025-09-11 16:33:05,866 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-93865693 with expectation True passed 2025-09-11 16:33:07,918 - DEBUG - [Pod ctest-pod-80086487] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.701 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.085 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.099 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.085/0.295/0.701 ms 2025-09-11 16:33:07,918 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-80086487 with expectation True passed 2025-09-11 16:33:07,972 - DEBUG - [Pod ctest-pod-92352115] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-11 16:33:07,972 - DEBUG - [Pod Pod ctest-pod-92352115] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-09-11 16:33:07,972 - DEBUG - [Pod Pod ctest-pod-92352115] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-11 16:33:07,972 - INFO - wget check of of http://10.47.255.251 from ctest-pod-92352115 passed 2025-09-11 16:33:08,019 - DEBUG - [Pod ctest-pod-92352115] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-11 16:33:08,019 - DEBUG - [Pod Pod ctest-pod-92352115] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-09-11 16:33:08,019 - DEBUG - [Pod Pod ctest-pod-92352115] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-11 16:33:08,019 - INFO - wget check of of http://10.47.255.250 from ctest-pod-92352115 passed 2025-09-11 16:33:13,049 - DEBUG - [Pod ctest-pod-93865693] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-09-11 16:33:13,049 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-09-11 16:33:13,049 - DEBUG - [Pod Pod ctest-pod-93865693] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-09-11 16:33:13,049 - INFO - wget check of of http://10.47.255.250 from ctest-pod-93865693 passed 2025-09-11 16:33:13,109 - DEBUG - [Pod ctest-pod-61682702] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-11 16:33:13,110 - DEBUG - [Pod Pod ctest-pod-61682702] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-09-11 16:33:13,110 - DEBUG - [Pod Pod ctest-pod-61682702] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-09-11 16:33:13,110 - INFO - wget check of of http://10.47.255.251 from ctest-pod-61682702 passed 2025-09-11 16:33:13,110 - INFO - Deleting Network Policy : ingress-on-service 2025-09-11 16:33:13,110 - INFO - Deleting service : ctest-nginx-svc-39049636 2025-09-11 16:33:13,309 - DEBUG - No XMPP flaps were noticed during the test