2025-08-12 17:07:24,425 - INFO - Using existing project ['default-domain', 'k8s-default'](f1ff473a-2bc2-4009-8fee-a44c8b627ae3) 2025-08-12 17:07:24,445 - DEBUG - Namespace ctest-new-default-65645561 not present 2025-08-12 17:07:24,453 - INFO - Created namespace ctest-new-default-65645561 2025-08-12 17:07:27,457 - DEBUG - Namespace ctest-non-default-40722670 not present 2025-08-12 17:07:27,463 - INFO - Created namespace ctest-non-default-40722670 2025-08-12 17:07:30,482 - DEBUG - Pod ctest-pod-21707654 not present 2025-08-12 17:07:30,482 - INFO - Creating Pod ctest-pod-21707654 2025-08-12 17:07:30,506 - DEBUG - Pod : ctest-pod-21707654 UUID is 59004046-82f3-4aaf-8538-6c7a95b6459f 2025-08-12 17:07:30,516 - DEBUG - Pod ctest-pod-41662177 not present 2025-08-12 17:07:30,516 - INFO - Creating Pod ctest-pod-41662177 2025-08-12 17:07:30,542 - DEBUG - Pod : ctest-pod-41662177 UUID is e5455e47-a273-403d-92b2-d904dac9fdc0 2025-08-12 17:07:30,544 - DEBUG - Pod ctest-pod-17122633 not present 2025-08-12 17:07:30,545 - INFO - Creating Pod ctest-pod-17122633 2025-08-12 17:07:30,576 - DEBUG - Pod : ctest-pod-17122633 UUID is aa6fb897-92a5-4830-b011-e2360dea9a1e 2025-08-12 17:07:30,578 - DEBUG - Pod ctest-pod-29205823 not present 2025-08-12 17:07:30,579 - INFO - Creating Pod ctest-pod-29205823 2025-08-12 17:07:30,601 - DEBUG - Pod : ctest-pod-29205823 UUID is ba3a8c97-8b02-4d57-baa8-f9405cec9c42 2025-08-12 17:07:30,605 - DEBUG - Pod ctest-pod-15739167 not present 2025-08-12 17:07:30,605 - INFO - Creating Pod ctest-pod-15739167 2025-08-12 17:07:30,621 - DEBUG - Pod : ctest-pod-15739167 UUID is f615902e-4482-4a85-9e4c-21e891d0a4cf 2025-08-12 17:07:30,623 - DEBUG - Pod ctest-pod-66889341 not present 2025-08-12 17:07:30,623 - INFO - Creating Pod ctest-pod-66889341 2025-08-12 17:07:30,646 - DEBUG - Pod : ctest-pod-66889341 UUID is 67f0f7a5-542c-423d-8629-989b1da4c049 2025-08-12 17:07:30,648 - DEBUG - Pod ctest-pod-40326669 not present 2025-08-12 17:07:30,648 - INFO - Creating Pod ctest-pod-40326669 2025-08-12 17:07:30,668 - DEBUG - Pod : ctest-pod-40326669 UUID is 9b5ad723-5e9f-4955-9137-b3a45af51678 2025-08-12 17:07:30,670 - DEBUG - Pod ctest-pod-25007642 not present 2025-08-12 17:07:30,670 - INFO - Creating Pod ctest-pod-25007642 2025-08-12 17:07:30,687 - DEBUG - Pod : ctest-pod-25007642 UUID is 8c04cd81-40fa-4260-a896-7b2af9321601 2025-08-12 17:07:30,856 - INFO - Project default-domain:k8s-ctest-new-default-65645561 for Namespace ctest-new-default-65645561 is seen in contrail-api 2025-08-12 17:07:30,856 - DEBUG - Project uuid in Contrail is 9e6cbae7-a393-4909-911b-11fd6f5bca13 2025-08-12 17:07:31,016 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_NamespaceDatabaseList?namespace_uuid=a91d77cb-6c92-4a92-91d2-bac085724b29 2025-08-12 17:07:31,022 - INFO - Namespace ctest-new-default-65645561 with uuid a91d77cb-6c92-4a92-91d2-bac085724b29 found in kube manager 2025-08-12 17:07:31,022 - INFO - Namespace ctest-new-default-65645561 verification passed 2025-08-12 17:07:31,200 - INFO - Project default-domain:k8s-ctest-non-default-40722670 for Namespace ctest-non-default-40722670 is seen in contrail-api 2025-08-12 17:07:31,200 - DEBUG - Project uuid in Contrail is f862b546-e774-451d-ad46-a3ab03be35db 2025-08-12 17:07:31,201 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_NamespaceDatabaseList?namespace_uuid=467c7786-6dd6-43bd-80f6-7d45cef6c595 2025-08-12 17:07:31,207 - INFO - Namespace ctest-non-default-40722670 with uuid 467c7786-6dd6-43bd-80f6-7d45cef6c595 found in kube manager 2025-08-12 17:07:31,207 - INFO - Namespace ctest-non-default-40722670 verification passed 2025-08-12 17:07:31,214 - DEBUG - Pod ctest-pod-21707654 not in running state.Currently in Pending 2025-08-12 17:07:36,220 - DEBUG - Pod ctest-pod-21707654 not in running state.Currently in Pending 2025-08-12 17:07:41,228 - DEBUG - Pod ctest-pod-21707654 not in running state.Currently in Pending 2025-08-12 17:07:46,240 - INFO - Pod ctest-pod-21707654 is in running state.Got IP 10.47.255.251 2025-08-12 17:07:46,292 - DEBUG - Pod ctest-pod-21707654 has vmi d59a93da-779e-11f0-ad51-fa163e357fc4 2025-08-12 17:07:46,292 - INFO - Verified pod ctest-pod-21707654 in contrail-api 2025-08-12 17:07:46,304 - DEBUG - VMI d59a93da-779e-11f0-ad51-fa163e357fc4 is active in agent 10.0.0.240 2025-08-12 17:07:46,305 - INFO - Verified Pod ctest-pod-21707654 in agent 10.0.0.240 2025-08-12 17:07:46,305 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=59004046-82f3-4aaf-8538-6c7a95b6459f 2025-08-12 17:07:46,309 - INFO - Pod ctest-pod-21707654 with uuid 59004046-82f3-4aaf-8538-6c7a95b6459f found in kube manager 2025-08-12 17:07:46,309 - INFO - Pod ctest-pod-21707654 verification passed 2025-08-12 17:07:46,314 - INFO - Pod ctest-pod-41662177 is in running state.Got IP 10.47.255.250 2025-08-12 17:07:46,325 - DEBUG - Pod ctest-pod-41662177 has vmi d6050ae4-779e-11f0-ad51-fa163e357fc4 2025-08-12 17:07:46,325 - INFO - Verified pod ctest-pod-41662177 in contrail-api 2025-08-12 17:07:46,337 - DEBUG - VMI d6050ae4-779e-11f0-ad51-fa163e357fc4 is active in agent 10.0.0.240 2025-08-12 17:07:46,337 - INFO - Verified Pod ctest-pod-41662177 in agent 10.0.0.240 2025-08-12 17:07:46,337 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=e5455e47-a273-403d-92b2-d904dac9fdc0 2025-08-12 17:07:46,341 - INFO - Pod ctest-pod-41662177 with uuid e5455e47-a273-403d-92b2-d904dac9fdc0 found in kube manager 2025-08-12 17:07:46,341 - INFO - Pod ctest-pod-41662177 verification passed 2025-08-12 17:07:46,345 - INFO - Pod ctest-pod-17122633 is in running state.Got IP 10.47.255.249 2025-08-12 17:07:46,399 - DEBUG - Pod ctest-pod-17122633 has vmi d6a5e658-779e-11f0-ad51-fa163e357fc4 2025-08-12 17:07:46,399 - INFO - Verified pod ctest-pod-17122633 in contrail-api 2025-08-12 17:07:46,411 - DEBUG - VMI d6a5e658-779e-11f0-ad51-fa163e357fc4 is active in agent 10.0.0.240 2025-08-12 17:07:46,411 - INFO - Verified Pod ctest-pod-17122633 in agent 10.0.0.240 2025-08-12 17:07:46,411 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=aa6fb897-92a5-4830-b011-e2360dea9a1e 2025-08-12 17:07:46,415 - INFO - Pod ctest-pod-17122633 with uuid aa6fb897-92a5-4830-b011-e2360dea9a1e found in kube manager 2025-08-12 17:07:46,415 - INFO - Pod ctest-pod-17122633 verification passed 2025-08-12 17:07:46,420 - INFO - Pod ctest-pod-29205823 is in running state.Got IP 10.47.255.248 2025-08-12 17:07:46,480 - DEBUG - Pod ctest-pod-29205823 has vmi d71eac64-779e-11f0-ad51-fa163e357fc4 2025-08-12 17:07:46,480 - INFO - Verified pod ctest-pod-29205823 in contrail-api 2025-08-12 17:07:46,490 - DEBUG - VMI d71eac64-779e-11f0-ad51-fa163e357fc4 is active in agent 10.0.0.240 2025-08-12 17:07:46,491 - INFO - Verified Pod ctest-pod-29205823 in agent 10.0.0.240 2025-08-12 17:07:46,491 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=ba3a8c97-8b02-4d57-baa8-f9405cec9c42 2025-08-12 17:07:46,495 - INFO - Pod ctest-pod-29205823 with uuid ba3a8c97-8b02-4d57-baa8-f9405cec9c42 found in kube manager 2025-08-12 17:07:46,495 - INFO - Pod ctest-pod-29205823 verification passed 2025-08-12 17:07:46,499 - INFO - Pod ctest-pod-15739167 is in running state.Got IP 10.47.255.247 2025-08-12 17:07:46,510 - DEBUG - Pod ctest-pod-15739167 has vmi d7a4470c-779e-11f0-ad51-fa163e357fc4 2025-08-12 17:07:46,510 - INFO - Verified pod ctest-pod-15739167 in contrail-api 2025-08-12 17:07:46,521 - DEBUG - VMI d7a4470c-779e-11f0-ad51-fa163e357fc4 is active in agent 10.0.0.240 2025-08-12 17:07:46,521 - INFO - Verified Pod ctest-pod-15739167 in agent 10.0.0.240 2025-08-12 17:07:46,521 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=f615902e-4482-4a85-9e4c-21e891d0a4cf 2025-08-12 17:07:46,525 - INFO - Pod ctest-pod-15739167 with uuid f615902e-4482-4a85-9e4c-21e891d0a4cf found in kube manager 2025-08-12 17:07:46,525 - INFO - Pod ctest-pod-15739167 verification passed 2025-08-12 17:07:46,529 - DEBUG - Pod ctest-pod-40326669 not in running state.Currently in Pending 2025-08-12 17:07:51,535 - INFO - Pod ctest-pod-40326669 is in running state.Got IP 10.47.255.245 2025-08-12 17:07:51,588 - DEBUG - Pod ctest-pod-40326669 has vmi d87def16-779e-11f0-ad51-fa163e357fc4 2025-08-12 17:07:51,588 - INFO - Verified pod ctest-pod-40326669 in contrail-api 2025-08-12 17:07:51,599 - DEBUG - VMI d87def16-779e-11f0-ad51-fa163e357fc4 is active in agent 10.0.0.240 2025-08-12 17:07:51,599 - INFO - Verified Pod ctest-pod-40326669 in agent 10.0.0.240 2025-08-12 17:07:51,599 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=9b5ad723-5e9f-4955-9137-b3a45af51678 2025-08-12 17:07:51,603 - INFO - Pod ctest-pod-40326669 with uuid 9b5ad723-5e9f-4955-9137-b3a45af51678 found in kube manager 2025-08-12 17:07:51,603 - INFO - Pod ctest-pod-40326669 verification passed 2025-08-12 17:07:51,607 - INFO - Pod ctest-pod-66889341 is in running state.Got IP 10.47.255.246 2025-08-12 17:07:51,619 - DEBUG - Pod ctest-pod-66889341 has vmi d814d3d2-779e-11f0-ad51-fa163e357fc4 2025-08-12 17:07:51,619 - INFO - Verified pod ctest-pod-66889341 in contrail-api 2025-08-12 17:07:51,629 - DEBUG - VMI d814d3d2-779e-11f0-ad51-fa163e357fc4 is active in agent 10.0.0.240 2025-08-12 17:07:51,629 - INFO - Verified Pod ctest-pod-66889341 in agent 10.0.0.240 2025-08-12 17:07:51,629 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=67f0f7a5-542c-423d-8629-989b1da4c049 2025-08-12 17:07:51,633 - INFO - Pod ctest-pod-66889341 with uuid 67f0f7a5-542c-423d-8629-989b1da4c049 found in kube manager 2025-08-12 17:07:51,633 - INFO - Pod ctest-pod-66889341 verification passed 2025-08-12 17:07:51,637 - INFO - Pod ctest-pod-25007642 is in running state.Got IP 10.47.255.244 2025-08-12 17:07:51,690 - DEBUG - Pod ctest-pod-25007642 has vmi d8e66276-779e-11f0-ad51-fa163e357fc4 2025-08-12 17:07:51,690 - INFO - Verified pod ctest-pod-25007642 in contrail-api 2025-08-12 17:07:51,701 - DEBUG - VMI d8e66276-779e-11f0-ad51-fa163e357fc4 is active in agent 10.0.0.240 2025-08-12 17:07:51,701 - INFO - Verified Pod ctest-pod-25007642 in agent 10.0.0.240 2025-08-12 17:07:51,701 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=8c04cd81-40fa-4260-a896-7b2af9321601 2025-08-12 17:07:51,705 - INFO - Pod ctest-pod-25007642 with uuid 8c04cd81-40fa-4260-a896-7b2af9321601 found in kube manager 2025-08-12 17:07:51,705 - INFO - Pod ctest-pod-25007642 verification passed 2025-08-12 17:07:51,705 - INFO - ================================================================================ 2025-08-12 17:07:51,705 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-08-12 17:07:51,705 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-08-12 17:07:51,924 - DEBUG - Nothing to compare xmpp stats {'10.0.0.240': {'10.0.0.41': '0'}} with 2025-08-12 17:07:51,924 - INFO - Initial checks done. Running the testcase now 2025-08-12 17:07:51,924 - INFO - 2025-08-12 17:07:51,976 - DEBUG - [Pod ctest-pod-21707654] Cmd: echo ctest-pod-21707654 > /usr/share/nginx/html/index.html, Output: 2025-08-12 17:07:52,023 - DEBUG - [Pod ctest-pod-41662177] Cmd: echo ctest-pod-41662177 > /usr/share/nginx/html/index.html, Output: 2025-08-12 17:07:52,053 - DEBUG - [Pod ctest-pod-17122633] Cmd: echo ctest-pod-17122633 > /usr/share/nginx/html/index.html, Output: 2025-08-12 17:07:52,104 - DEBUG - [Pod ctest-pod-29205823] Cmd: echo ctest-pod-29205823 > /usr/share/nginx/html/index.html, Output: 2025-08-12 17:07:52,107 - DEBUG - Service ctest-nginx-svc-46280550 not present 2025-08-12 17:07:52,107 - INFO - Creating service ctest-nginx-svc-46280550 2025-08-12 17:07:52,119 - INFO - Created Service ctest-nginx-svc-46280550 2025-08-12 17:07:52,135 - WARNING - Service UUID 9b808df5-5adc-47d0-9e98-348896e86048 not yet found in contrail-api 2025-08-12 17:07:53,142 - INFO - Validated that Service ctest-nginx-svc-46280550 is seen in contrail-api 2025-08-12 17:07:53,142 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_LoadbalancerDatabaseList?x=9b808df5-5adc-47d0-9e98-348896e86048 2025-08-12 17:07:53,150 - INFO - Service ctest-nginx-svc-46280550 with uuid 9b808df5-5adc-47d0-9e98-348896e86048 found in kube manager 2025-08-12 17:07:53,151 - INFO - Service ctest-nginx-svc-46280550 verification passed 2025-08-12 17:07:53,204 - DEBUG - [Pod ctest-pod-15739167] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: ctest-pod-41662177 Connecting to 10.97.47.109:80 (10.97.47.109:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-12 17:07:53,204 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 passed 2025-08-12 17:07:53,204 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd output: ctest-pod-41662177 Connecting to 10.97.47.109:80 (10.97.47.109:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-12 17:07:53,246 - DEBUG - [Pod ctest-pod-15739167] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: ctest-pod-41662177 Connecting to 10.97.47.109:80 (10.97.47.109:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-12 17:07:53,246 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 passed 2025-08-12 17:07:53,246 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd output: ctest-pod-41662177 Connecting to 10.97.47.109:80 (10.97.47.109:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-12 17:07:53,298 - DEBUG - [Pod ctest-pod-15739167] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.47.109:80 (10.97.47.109:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-41662177 2025-08-12 17:07:53,298 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 passed 2025-08-12 17:07:53,299 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd output: Connecting to 10.97.47.109:80 (10.97.47.109:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-41662177 2025-08-12 17:07:53,349 - DEBUG - [Pod ctest-pod-15739167] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: ctest-pod-41662177 Connecting to 10.97.47.109:80 (10.97.47.109:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-12 17:07:53,349 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 passed 2025-08-12 17:07:53,349 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd output: ctest-pod-41662177 Connecting to 10.97.47.109:80 (10.97.47.109:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-12 17:07:53,401 - DEBUG - [Pod ctest-pod-15739167] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: ctest-pod-41662177 Connecting to 10.97.47.109:80 (10.97.47.109:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-12 17:07:53,401 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 passed 2025-08-12 17:07:53,401 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd output: ctest-pod-41662177 Connecting to 10.97.47.109:80 (10.97.47.109:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-12 17:07:53,454 - DEBUG - [Pod ctest-pod-15739167] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.47.109:80 (10.97.47.109:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-21707654 2025-08-12 17:07:53,454 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 passed 2025-08-12 17:07:53,454 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd output: Connecting to 10.97.47.109:80 (10.97.47.109:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-21707654 2025-08-12 17:07:53,455 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-21707654': 1, 'ctest-pod-41662177': 5} 2025-08-12 17:07:53,505 - DEBUG - [Pod ctest-pod-40326669] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: ctest-pod-41662177 Connecting to 10.97.47.109:80 (10.97.47.109:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-12 17:07:53,505 - DEBUG - [Pod Pod ctest-pod-40326669] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 passed 2025-08-12 17:07:53,505 - DEBUG - [Pod Pod ctest-pod-40326669] Cmd output: ctest-pod-41662177 Connecting to 10.97.47.109:80 (10.97.47.109:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-12 17:07:53,551 - DEBUG - [Pod ctest-pod-40326669] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: ctest-pod-21707654 Connecting to 10.97.47.109:80 (10.97.47.109:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-12 17:07:53,552 - DEBUG - [Pod Pod ctest-pod-40326669] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 passed 2025-08-12 17:07:53,552 - DEBUG - [Pod Pod ctest-pod-40326669] Cmd output: ctest-pod-21707654 Connecting to 10.97.47.109:80 (10.97.47.109:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-12 17:07:53,552 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-21707654': 1, 'ctest-pod-41662177': 1} 2025-08-12 17:07:53,554 - DEBUG - Network policy ingress-on-service not present 2025-08-12 17:07:53,556 - INFO - Creating Network Policy ingress-on-service 2025-08-12 17:07:53,565 - INFO - Network policy found in k8s 2025-08-12 17:07:53,565 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=3cbc4a57-68c9-4466-9534-3aca257a9a04 2025-08-12 17:07:53,572 - INFO - Network Policy ingress-on-service with uuid 3cbc4a57-68c9-4466-9534-3aca257a9a04 found in kube manager 2025-08-12 17:07:53,655 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-08-12 17:07:53,655 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-08-12 17:07:53,656 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=3cbc4a57-68c9-4466-9534-3aca257a9a04 2025-08-12 17:07:53,682 - WARNING - Network policy with name ingress-on-service not found in agent 2025-08-12 17:07:55,683 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=3cbc4a57-68c9-4466-9534-3aca257a9a04 2025-08-12 17:07:55,712 - INFO - Network policy with name ingress-on-service found in agent 2025-08-12 17:07:55,712 - INFO - Network Policy ingress-on-service verification passed 2025-08-12 17:08:00,750 - DEBUG - [Pod ctest-pod-15739167] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:08:00,750 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:08:00,751 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:08:05,809 - DEBUG - [Pod ctest-pod-15739167] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:08:05,809 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:08:05,809 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:08:10,857 - DEBUG - [Pod ctest-pod-15739167] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:08:10,857 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:08:10,857 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:08:15,901 - DEBUG - [Pod ctest-pod-15739167] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:08:15,901 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:08:15,901 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:08:20,945 - DEBUG - [Pod ctest-pod-15739167] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:08:20,945 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:08:20,945 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:08:25,993 - DEBUG - [Pod ctest-pod-15739167] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:08:25,993 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:08:25,993 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:08:31,041 - DEBUG - [Pod ctest-pod-15739167] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:08:31,041 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:08:31,041 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:08:36,082 - DEBUG - [Pod ctest-pod-15739167] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:08:36,082 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:08:36,083 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:08:41,120 - DEBUG - [Pod ctest-pod-15739167] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:08:41,121 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:08:41,121 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:08:46,165 - DEBUG - [Pod ctest-pod-15739167] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:08:46,165 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:08:46,166 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:08:46,166 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-21707654': 0, 'ctest-pod-41662177': 0} 2025-08-12 17:08:46,230 - DEBUG - [Pod ctest-pod-66889341] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: ctest-pod-41662177 Connecting to 10.97.47.109:80 (10.97.47.109:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-12 17:08:46,230 - DEBUG - [Pod Pod ctest-pod-66889341] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 passed 2025-08-12 17:08:46,230 - DEBUG - [Pod Pod ctest-pod-66889341] Cmd output: ctest-pod-41662177 Connecting to 10.97.47.109:80 (10.97.47.109:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-12 17:08:46,286 - DEBUG - [Pod ctest-pod-66889341] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.47.109:80 (10.97.47.109:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-41662177 2025-08-12 17:08:46,287 - DEBUG - [Pod Pod ctest-pod-66889341] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 passed 2025-08-12 17:08:46,287 - DEBUG - [Pod Pod ctest-pod-66889341] Cmd output: Connecting to 10.97.47.109:80 (10.97.47.109:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-41662177 2025-08-12 17:08:46,352 - DEBUG - [Pod ctest-pod-66889341] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: ctest-pod-41662177 Connecting to 10.97.47.109:80 (10.97.47.109:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-12 17:08:46,352 - DEBUG - [Pod Pod ctest-pod-66889341] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 passed 2025-08-12 17:08:46,352 - DEBUG - [Pod Pod ctest-pod-66889341] Cmd output: ctest-pod-41662177 Connecting to 10.97.47.109:80 (10.97.47.109:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-12 17:08:46,407 - DEBUG - [Pod ctest-pod-66889341] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: ctest-pod-41662177 Connecting to 10.97.47.109:80 (10.97.47.109:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-12 17:08:46,407 - DEBUG - [Pod Pod ctest-pod-66889341] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 passed 2025-08-12 17:08:46,407 - DEBUG - [Pod Pod ctest-pod-66889341] Cmd output: ctest-pod-41662177 Connecting to 10.97.47.109:80 (10.97.47.109:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-12 17:08:46,456 - DEBUG - [Pod ctest-pod-66889341] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: ctest-pod-21707654 Connecting to 10.97.47.109:80 (10.97.47.109:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-12 17:08:46,456 - DEBUG - [Pod Pod ctest-pod-66889341] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 passed 2025-08-12 17:08:46,456 - DEBUG - [Pod Pod ctest-pod-66889341] Cmd output: ctest-pod-21707654 Connecting to 10.97.47.109:80 (10.97.47.109:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-12 17:08:46,456 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-21707654': 1, 'ctest-pod-41662177': 4} 2025-08-12 17:08:51,076 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2025-08-12 17:09:01,137 - DEBUG - [Pod ctest-pod-40326669] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:09:01,138 - DEBUG - [Pod Pod ctest-pod-40326669] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:09:01,138 - DEBUG - [Pod Pod ctest-pod-40326669] Cmd output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:09:06,190 - DEBUG - [Pod ctest-pod-40326669] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:09:06,191 - DEBUG - [Pod Pod ctest-pod-40326669] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:09:06,191 - DEBUG - [Pod Pod ctest-pod-40326669] Cmd output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:09:11,233 - DEBUG - [Pod ctest-pod-40326669] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:09:11,233 - DEBUG - [Pod Pod ctest-pod-40326669] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:09:11,233 - DEBUG - [Pod Pod ctest-pod-40326669] Cmd output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:09:16,285 - DEBUG - [Pod ctest-pod-40326669] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:09:16,285 - DEBUG - [Pod Pod ctest-pod-40326669] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:09:16,285 - DEBUG - [Pod Pod ctest-pod-40326669] Cmd output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:09:21,329 - DEBUG - [Pod ctest-pod-40326669] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:09:21,329 - DEBUG - [Pod Pod ctest-pod-40326669] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:09:21,330 - DEBUG - [Pod Pod ctest-pod-40326669] Cmd output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:09:26,373 - DEBUG - [Pod ctest-pod-40326669] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:09:26,373 - DEBUG - [Pod Pod ctest-pod-40326669] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:09:26,373 - DEBUG - [Pod Pod ctest-pod-40326669] Cmd output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:09:31,421 - DEBUG - [Pod ctest-pod-40326669] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:09:31,421 - DEBUG - [Pod Pod ctest-pod-40326669] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:09:31,421 - DEBUG - [Pod Pod ctest-pod-40326669] Cmd output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:09:36,465 - DEBUG - [Pod ctest-pod-40326669] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:09:36,465 - DEBUG - [Pod Pod ctest-pod-40326669] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:09:36,466 - DEBUG - [Pod Pod ctest-pod-40326669] Cmd output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:09:41,520 - DEBUG - [Pod ctest-pod-40326669] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:09:41,520 - DEBUG - [Pod Pod ctest-pod-40326669] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:09:41,520 - DEBUG - [Pod Pod ctest-pod-40326669] Cmd output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:09:46,570 - DEBUG - [Pod ctest-pod-40326669] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:09:46,570 - DEBUG - [Pod Pod ctest-pod-40326669] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:09:46,570 - DEBUG - [Pod Pod ctest-pod-40326669] Cmd output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:09:46,570 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-21707654': 0, 'ctest-pod-41662177': 0} 2025-08-12 17:09:48,613 - DEBUG - [Pod ctest-pod-66889341] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.120 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.082 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.082 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.082/0.428/1.120 ms 2025-08-12 17:09:48,613 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-66889341 with expectation True passed 2025-08-12 17:09:50,657 - DEBUG - [Pod ctest-pod-15739167] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.614 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.066 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.082 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.066/0.254/0.614 ms 2025-08-12 17:09:50,657 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-15739167 with expectation True passed 2025-08-12 17:09:52,701 - DEBUG - [Pod ctest-pod-40326669] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.695 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.065 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.090 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.065/0.283/0.695 ms 2025-08-12 17:09:52,702 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-40326669 with expectation True passed 2025-08-12 17:09:52,751 - DEBUG - [Pod ctest-pod-66889341] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-08-12 17:09:52,751 - DEBUG - [Pod Pod ctest-pod-66889341] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-08-12 17:09:52,751 - DEBUG - [Pod Pod ctest-pod-66889341] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-08-12 17:09:52,751 - INFO - wget check of of http://10.47.255.251 from ctest-pod-66889341 passed 2025-08-12 17:09:52,805 - DEBUG - [Pod ctest-pod-66889341] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-08-12 17:09:52,805 - DEBUG - [Pod Pod ctest-pod-66889341] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-08-12 17:09:52,805 - DEBUG - [Pod Pod ctest-pod-66889341] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-08-12 17:09:52,805 - INFO - wget check of of http://10.47.255.250 from ctest-pod-66889341 passed 2025-08-12 17:09:57,853 - DEBUG - [Pod ctest-pod-15739167] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-08-12 17:09:57,854 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-08-12 17:09:57,854 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-08-12 17:09:57,854 - INFO - wget check of of http://10.47.255.250 from ctest-pod-15739167 passed 2025-08-12 17:10:02,911 - DEBUG - [Pod ctest-pod-25007642] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-08-12 17:10:02,911 - DEBUG - [Pod Pod ctest-pod-25007642] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-08-12 17:10:02,911 - DEBUG - [Pod Pod ctest-pod-25007642] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-08-12 17:10:02,911 - INFO - wget check of of http://10.47.255.251 from ctest-pod-25007642 passed 2025-08-12 17:10:02,918 - INFO - Updating Network Policy ingress-on-service 2025-08-12 17:10:07,978 - DEBUG - [Pod ctest-pod-15739167] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:10:07,979 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:10:07,979 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:10:13,021 - DEBUG - [Pod ctest-pod-15739167] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:10:13,021 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:10:13,021 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:10:18,069 - DEBUG - [Pod ctest-pod-15739167] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:10:18,069 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:10:18,069 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:10:23,117 - DEBUG - [Pod ctest-pod-15739167] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:10:23,117 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:10:23,118 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:10:28,164 - DEBUG - [Pod ctest-pod-15739167] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:10:28,164 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:10:28,164 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:10:33,213 - DEBUG - [Pod ctest-pod-15739167] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:10:33,213 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:10:33,213 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:10:38,257 - DEBUG - [Pod ctest-pod-15739167] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:10:38,257 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:10:38,257 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:10:43,305 - DEBUG - [Pod ctest-pod-15739167] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:10:43,305 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:10:43,305 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:10:48,349 - DEBUG - [Pod ctest-pod-15739167] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:10:48,349 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:10:48,349 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:10:53,394 - DEBUG - [Pod ctest-pod-15739167] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:10:53,394 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:10:53,394 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd output: Connecting to 10.97.47.109:80 (10.97.47.109:80) wget: download timed out 2025-08-12 17:10:53,394 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-21707654': 0, 'ctest-pod-41662177': 0} 2025-08-12 17:10:53,447 - DEBUG - [Pod ctest-pod-66889341] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.47.109:80 (10.97.47.109:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-41662177 2025-08-12 17:10:53,447 - DEBUG - [Pod Pod ctest-pod-66889341] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 passed 2025-08-12 17:10:53,447 - DEBUG - [Pod Pod ctest-pod-66889341] Cmd output: Connecting to 10.97.47.109:80 (10.97.47.109:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-41662177 2025-08-12 17:10:53,495 - DEBUG - [Pod ctest-pod-66889341] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: ctest-pod-21707654 Connecting to 10.97.47.109:80 (10.97.47.109:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-12 17:10:53,495 - DEBUG - [Pod Pod ctest-pod-66889341] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 passed 2025-08-12 17:10:53,495 - DEBUG - [Pod Pod ctest-pod-66889341] Cmd output: ctest-pod-21707654 Connecting to 10.97.47.109:80 (10.97.47.109:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-12 17:10:53,495 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-21707654': 1, 'ctest-pod-41662177': 1} 2025-08-12 17:10:53,543 - DEBUG - [Pod ctest-pod-40326669] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.47.109:80 (10.97.47.109:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-41662177 2025-08-12 17:10:53,543 - DEBUG - [Pod Pod ctest-pod-40326669] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 passed 2025-08-12 17:10:53,543 - DEBUG - [Pod Pod ctest-pod-40326669] Cmd output: Connecting to 10.97.47.109:80 (10.97.47.109:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-41662177 2025-08-12 17:10:53,592 - DEBUG - [Pod ctest-pod-40326669] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: ctest-pod-41662177 Connecting to 10.97.47.109:80 (10.97.47.109:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-12 17:10:53,592 - DEBUG - [Pod Pod ctest-pod-40326669] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 passed 2025-08-12 17:10:53,592 - DEBUG - [Pod Pod ctest-pod-40326669] Cmd output: ctest-pod-41662177 Connecting to 10.97.47.109:80 (10.97.47.109:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-08-12 17:10:53,643 - DEBUG - [Pod ctest-pod-40326669] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.47.109:80 (10.97.47.109:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-41662177 2025-08-12 17:10:53,643 - DEBUG - [Pod Pod ctest-pod-40326669] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 passed 2025-08-12 17:10:53,643 - DEBUG - [Pod Pod ctest-pod-40326669] Cmd output: Connecting to 10.97.47.109:80 (10.97.47.109:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-41662177 2025-08-12 17:10:53,679 - DEBUG - [Pod ctest-pod-40326669] Cmd: wget http://10.97.47.109:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.47.109:80 (10.97.47.109:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-21707654 2025-08-12 17:10:53,680 - DEBUG - [Pod Pod ctest-pod-40326669] Cmd wget http://10.97.47.109:80/ -O - -T 5 -t 1 passed 2025-08-12 17:10:53,680 - DEBUG - [Pod Pod ctest-pod-40326669] Cmd output: Connecting to 10.97.47.109:80 (10.97.47.109:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-21707654 2025-08-12 17:10:53,680 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-21707654': 1, 'ctest-pod-41662177': 3} 2025-08-12 17:10:55,729 - DEBUG - [Pod ctest-pod-66889341] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.463 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.072 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.073 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.072/0.202/0.463 ms 2025-08-12 17:10:55,729 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-66889341 with expectation True passed 2025-08-12 17:10:57,774 - DEBUG - [Pod ctest-pod-15739167] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.322 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.088 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.160/0.322 ms 2025-08-12 17:10:57,774 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-15739167 with expectation True passed 2025-08-12 17:10:59,822 - DEBUG - [Pod ctest-pod-40326669] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.475 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.083 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.072 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.072/0.543/1.475 ms 2025-08-12 17:10:59,823 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-40326669 with expectation True passed 2025-08-12 17:10:59,883 - DEBUG - [Pod ctest-pod-66889341] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-08-12 17:10:59,884 - DEBUG - [Pod Pod ctest-pod-66889341] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-08-12 17:10:59,884 - DEBUG - [Pod Pod ctest-pod-66889341] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-08-12 17:10:59,884 - INFO - wget check of of http://10.47.255.251 from ctest-pod-66889341 passed 2025-08-12 17:10:59,937 - DEBUG - [Pod ctest-pod-66889341] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-08-12 17:10:59,937 - DEBUG - [Pod Pod ctest-pod-66889341] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-08-12 17:10:59,937 - DEBUG - [Pod Pod ctest-pod-66889341] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-08-12 17:10:59,937 - INFO - wget check of of http://10.47.255.250 from ctest-pod-66889341 passed 2025-08-12 17:11:04,990 - DEBUG - [Pod ctest-pod-15739167] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-08-12 17:11:04,990 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-08-12 17:11:04,990 - DEBUG - [Pod Pod ctest-pod-15739167] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-08-12 17:11:04,990 - INFO - wget check of of http://10.47.255.250 from ctest-pod-15739167 passed 2025-08-12 17:11:05,043 - DEBUG - [Pod ctest-pod-25007642] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-08-12 17:11:05,043 - DEBUG - [Pod Pod ctest-pod-25007642] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-08-12 17:11:05,043 - DEBUG - [Pod Pod ctest-pod-25007642] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-08-12 17:11:05,043 - INFO - wget check of of http://10.47.255.251 from ctest-pod-25007642 passed 2025-08-12 17:11:05,044 - INFO - Deleting Network Policy : ingress-on-service 2025-08-12 17:11:05,044 - INFO - Deleting service : ctest-nginx-svc-46280550 2025-08-12 17:11:05,268 - DEBUG - No XMPP flaps were noticed during the test