2024-12-26 01:57:30,049 - INFO - Using existing project ['default-domain', 'k8s-default'](7b9d6612-636e-45a4-b096-91de2e3e4176) 2024-12-26 01:57:30,070 - DEBUG - Namespace ctest-new-default-48315055 not present 2024-12-26 01:57:30,079 - INFO - Created namespace ctest-new-default-48315055 2024-12-26 01:57:33,090 - DEBUG - Namespace ctest-non-default-22664744 not present 2024-12-26 01:57:33,109 - INFO - Created namespace ctest-non-default-22664744 2024-12-26 01:57:36,152 - DEBUG - Pod ctest-pod-91204233 not present 2024-12-26 01:57:36,154 - INFO - Creating Pod ctest-pod-91204233 2024-12-26 01:57:36,229 - DEBUG - Pod : ctest-pod-91204233 UUID is 2cb25af1-d36d-4aac-9103-592e76661099 2024-12-26 01:57:36,234 - DEBUG - Pod ctest-pod-11571612 not present 2024-12-26 01:57:36,234 - INFO - Creating Pod ctest-pod-11571612 2024-12-26 01:57:36,273 - DEBUG - Pod : ctest-pod-11571612 UUID is 1b5ba2b0-2a8d-4e74-bf77-890e988f8560 2024-12-26 01:57:36,276 - DEBUG - Pod ctest-pod-13341534 not present 2024-12-26 01:57:36,276 - INFO - Creating Pod ctest-pod-13341534 2024-12-26 01:57:36,323 - DEBUG - Pod : ctest-pod-13341534 UUID is dd47fd7a-3a10-44ac-8e19-dd975b32b17a 2024-12-26 01:57:36,327 - DEBUG - Pod ctest-pod-26787244 not present 2024-12-26 01:57:36,327 - INFO - Creating Pod ctest-pod-26787244 2024-12-26 01:57:36,363 - DEBUG - Pod : ctest-pod-26787244 UUID is 196d5949-2813-47b3-870e-18631c25e138 2024-12-26 01:57:36,370 - DEBUG - Pod ctest-pod-67520701 not present 2024-12-26 01:57:36,370 - INFO - Creating Pod ctest-pod-67520701 2024-12-26 01:57:36,393 - DEBUG - Pod : ctest-pod-67520701 UUID is 7dbe803c-adb2-4c2c-9a8f-b4e42a8c9145 2024-12-26 01:57:36,395 - DEBUG - Pod ctest-pod-72827882 not present 2024-12-26 01:57:36,395 - INFO - Creating Pod ctest-pod-72827882 2024-12-26 01:57:36,418 - DEBUG - Pod : ctest-pod-72827882 UUID is 9e4ed414-da4d-4a32-8e66-d2df8f4072c8 2024-12-26 01:57:36,421 - DEBUG - Pod ctest-pod-40848456 not present 2024-12-26 01:57:36,421 - INFO - Creating Pod ctest-pod-40848456 2024-12-26 01:57:36,448 - DEBUG - Pod : ctest-pod-40848456 UUID is eb7280bd-5365-412a-a8a3-d91a298428f0 2024-12-26 01:57:36,460 - DEBUG - Pod ctest-pod-37897406 not present 2024-12-26 01:57:36,460 - INFO - Creating Pod ctest-pod-37897406 2024-12-26 01:57:36,489 - DEBUG - Pod : ctest-pod-37897406 UUID is 41ab2fa0-d233-4dc6-a48e-7d775208d07e 2024-12-26 01:57:36,685 - INFO - Project default-domain:k8s-ctest-new-default-48315055 for Namespace ctest-new-default-48315055 is seen in contrail-api 2024-12-26 01:57:36,686 - DEBUG - Project uuid in Contrail is c8534b90-975b-43c1-a52e-478cde9ce4ff 2024-12-26 01:57:36,920 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NamespaceDatabaseList?namespace_uuid=f3c8eaaf-ddc9-4285-a0be-09dadc45f47e 2024-12-26 01:57:36,928 - INFO - Namespace ctest-new-default-48315055 with uuid f3c8eaaf-ddc9-4285-a0be-09dadc45f47e found in kube manager 2024-12-26 01:57:36,929 - INFO - Namespace ctest-new-default-48315055 verification passed 2024-12-26 01:57:37,238 - INFO - Project default-domain:k8s-ctest-non-default-22664744 for Namespace ctest-non-default-22664744 is seen in contrail-api 2024-12-26 01:57:37,238 - DEBUG - Project uuid in Contrail is 1ce3cd99-a89d-4f45-93ac-bd64da15bbfe 2024-12-26 01:57:37,238 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NamespaceDatabaseList?namespace_uuid=94c65d4d-90e2-4a6c-9e80-109a1931dd89 2024-12-26 01:57:37,247 - INFO - Namespace ctest-non-default-22664744 with uuid 94c65d4d-90e2-4a6c-9e80-109a1931dd89 found in kube manager 2024-12-26 01:57:37,248 - INFO - Namespace ctest-non-default-22664744 verification passed 2024-12-26 01:57:37,256 - DEBUG - Pod ctest-pod-91204233 not in running state.Currently in Pending 2024-12-26 01:57:42,264 - DEBUG - Pod ctest-pod-91204233 not in running state.Currently in Pending 2024-12-26 01:57:47,287 - INFO - Pod ctest-pod-91204233 is in running state.Got IP 10.47.255.251 2024-12-26 01:57:47,383 - DEBUG - Pod ctest-pod-91204233 has vmi c8873008-c32c-11ef-bc92-fa163e49fbb2 2024-12-26 01:57:47,383 - INFO - Verified pod ctest-pod-91204233 in contrail-api 2024-12-26 01:57:47,399 - DEBUG - VMI c8873008-c32c-11ef-bc92-fa163e49fbb2 is active in agent 10.0.0.30 2024-12-26 01:57:47,400 - INFO - Verified Pod ctest-pod-91204233 in agent 10.0.0.30 2024-12-26 01:57:47,400 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=2cb25af1-d36d-4aac-9103-592e76661099 2024-12-26 01:57:47,408 - INFO - Pod ctest-pod-91204233 with uuid 2cb25af1-d36d-4aac-9103-592e76661099 found in kube manager 2024-12-26 01:57:47,408 - INFO - Pod ctest-pod-91204233 verification passed 2024-12-26 01:57:47,416 - DEBUG - Pod ctest-pod-11571612 not in running state.Currently in Pending 2024-12-26 01:57:52,428 - INFO - Pod ctest-pod-11571612 is in running state.Got IP 10.47.255.250 2024-12-26 01:57:52,459 - DEBUG - Pod ctest-pod-11571612 has vmi c9169d42-c32c-11ef-bc92-fa163e49fbb2 2024-12-26 01:57:52,459 - INFO - Verified pod ctest-pod-11571612 in contrail-api 2024-12-26 01:57:52,482 - DEBUG - VMI c9169d42-c32c-11ef-bc92-fa163e49fbb2 is active in agent 10.0.0.30 2024-12-26 01:57:52,482 - INFO - Verified Pod ctest-pod-11571612 in agent 10.0.0.30 2024-12-26 01:57:52,482 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=1b5ba2b0-2a8d-4e74-bf77-890e988f8560 2024-12-26 01:57:52,495 - INFO - Pod ctest-pod-11571612 with uuid 1b5ba2b0-2a8d-4e74-bf77-890e988f8560 found in kube manager 2024-12-26 01:57:52,495 - INFO - Pod ctest-pod-11571612 verification passed 2024-12-26 01:57:52,504 - INFO - Pod ctest-pod-13341534 is in running state.Got IP 10.47.255.249 2024-12-26 01:57:52,526 - DEBUG - Pod ctest-pod-13341534 has vmi c9c050a8-c32c-11ef-bc92-fa163e49fbb2 2024-12-26 01:57:52,526 - INFO - Verified pod ctest-pod-13341534 in contrail-api 2024-12-26 01:57:52,543 - DEBUG - VMI c9c050a8-c32c-11ef-bc92-fa163e49fbb2 is active in agent 10.0.0.30 2024-12-26 01:57:52,543 - INFO - Verified Pod ctest-pod-13341534 in agent 10.0.0.30 2024-12-26 01:57:52,543 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=dd47fd7a-3a10-44ac-8e19-dd975b32b17a 2024-12-26 01:57:52,551 - INFO - Pod ctest-pod-13341534 with uuid dd47fd7a-3a10-44ac-8e19-dd975b32b17a found in kube manager 2024-12-26 01:57:52,551 - INFO - Pod ctest-pod-13341534 verification passed 2024-12-26 01:57:52,561 - INFO - Pod ctest-pod-26787244 is in running state.Got IP 10.47.255.248 2024-12-26 01:57:52,622 - DEBUG - Pod ctest-pod-26787244 has vmi ca496384-c32c-11ef-bc92-fa163e49fbb2 2024-12-26 01:57:52,623 - INFO - Verified pod ctest-pod-26787244 in contrail-api 2024-12-26 01:57:52,643 - DEBUG - VMI ca496384-c32c-11ef-bc92-fa163e49fbb2 is active in agent 10.0.0.30 2024-12-26 01:57:52,643 - INFO - Verified Pod ctest-pod-26787244 in agent 10.0.0.30 2024-12-26 01:57:52,643 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=196d5949-2813-47b3-870e-18631c25e138 2024-12-26 01:57:52,653 - INFO - Pod ctest-pod-26787244 with uuid 196d5949-2813-47b3-870e-18631c25e138 found in kube manager 2024-12-26 01:57:52,653 - INFO - Pod ctest-pod-26787244 verification passed 2024-12-26 01:57:52,660 - INFO - Pod ctest-pod-67520701 is in running state.Got IP 10.47.255.247 2024-12-26 01:57:52,686 - DEBUG - Pod ctest-pod-67520701 has vmi cad90912-c32c-11ef-bc92-fa163e49fbb2 2024-12-26 01:57:52,687 - INFO - Verified pod ctest-pod-67520701 in contrail-api 2024-12-26 01:57:52,705 - DEBUG - VMI cad90912-c32c-11ef-bc92-fa163e49fbb2 is active in agent 10.0.0.30 2024-12-26 01:57:52,705 - INFO - Verified Pod ctest-pod-67520701 in agent 10.0.0.30 2024-12-26 01:57:52,705 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=7dbe803c-adb2-4c2c-9a8f-b4e42a8c9145 2024-12-26 01:57:52,716 - INFO - Pod ctest-pod-67520701 with uuid 7dbe803c-adb2-4c2c-9a8f-b4e42a8c9145 found in kube manager 2024-12-26 01:57:52,716 - INFO - Pod ctest-pod-67520701 verification passed 2024-12-26 01:57:52,729 - DEBUG - Pod ctest-pod-40848456 not in running state.Currently in Pending 2024-12-26 01:57:57,743 - INFO - Pod ctest-pod-40848456 is in running state.Got IP 10.47.255.245 2024-12-26 01:57:57,769 - DEBUG - Pod ctest-pod-40848456 has vmi cbd07c38-c32c-11ef-bc92-fa163e49fbb2 2024-12-26 01:57:57,769 - INFO - Verified pod ctest-pod-40848456 in contrail-api 2024-12-26 01:57:57,786 - DEBUG - VMI cbd07c38-c32c-11ef-bc92-fa163e49fbb2 is active in agent 10.0.0.30 2024-12-26 01:57:57,786 - INFO - Verified Pod ctest-pod-40848456 in agent 10.0.0.30 2024-12-26 01:57:57,786 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=eb7280bd-5365-412a-a8a3-d91a298428f0 2024-12-26 01:57:57,794 - INFO - Pod ctest-pod-40848456 with uuid eb7280bd-5365-412a-a8a3-d91a298428f0 found in kube manager 2024-12-26 01:57:57,795 - INFO - Pod ctest-pod-40848456 verification passed 2024-12-26 01:57:57,806 - INFO - Pod ctest-pod-72827882 is in running state.Got IP 10.47.255.246 2024-12-26 01:57:57,875 - DEBUG - Pod ctest-pod-72827882 has vmi cb55392e-c32c-11ef-bc92-fa163e49fbb2 2024-12-26 01:57:57,875 - INFO - Verified pod ctest-pod-72827882 in contrail-api 2024-12-26 01:57:57,897 - DEBUG - VMI cb55392e-c32c-11ef-bc92-fa163e49fbb2 is active in agent 10.0.0.30 2024-12-26 01:57:57,897 - INFO - Verified Pod ctest-pod-72827882 in agent 10.0.0.30 2024-12-26 01:57:57,897 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=9e4ed414-da4d-4a32-8e66-d2df8f4072c8 2024-12-26 01:57:57,907 - INFO - Pod ctest-pod-72827882 with uuid 9e4ed414-da4d-4a32-8e66-d2df8f4072c8 found in kube manager 2024-12-26 01:57:57,907 - INFO - Pod ctest-pod-72827882 verification passed 2024-12-26 01:57:57,918 - INFO - Pod ctest-pod-37897406 is in running state.Got IP 10.47.255.244 2024-12-26 01:57:57,955 - DEBUG - Pod ctest-pod-37897406 has vmi cc5177d4-c32c-11ef-bc92-fa163e49fbb2 2024-12-26 01:57:57,956 - INFO - Verified pod ctest-pod-37897406 in contrail-api 2024-12-26 01:57:57,973 - DEBUG - VMI cc5177d4-c32c-11ef-bc92-fa163e49fbb2 is active in agent 10.0.0.30 2024-12-26 01:57:57,973 - INFO - Verified Pod ctest-pod-37897406 in agent 10.0.0.30 2024-12-26 01:57:57,973 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=41ab2fa0-d233-4dc6-a48e-7d775208d07e 2024-12-26 01:57:57,984 - INFO - Pod ctest-pod-37897406 with uuid 41ab2fa0-d233-4dc6-a48e-7d775208d07e found in kube manager 2024-12-26 01:57:57,984 - INFO - Pod ctest-pod-37897406 verification passed 2024-12-26 01:57:57,985 - INFO - ================================================================================ 2024-12-26 01:57:57,985 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-12-26 01:57:57,985 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-12-26 01:57:58,334 - DEBUG - Nothing to compare xmpp stats {'10.0.0.30': {'10.0.0.12': '0'}} with 2024-12-26 01:57:58,335 - INFO - Initial checks done. Running the testcase now 2024-12-26 01:57:58,335 - INFO - 2024-12-26 01:57:58,424 - DEBUG - [Pod ctest-pod-91204233] Cmd: echo ctest-pod-91204233 > /usr/share/nginx/html/index.html, Output: 2024-12-26 01:57:58,518 - DEBUG - [Pod ctest-pod-11571612] Cmd: echo ctest-pod-11571612 > /usr/share/nginx/html/index.html, Output: 2024-12-26 01:57:58,599 - DEBUG - [Pod ctest-pod-13341534] Cmd: echo ctest-pod-13341534 > /usr/share/nginx/html/index.html, Output: 2024-12-26 01:57:58,683 - DEBUG - [Pod ctest-pod-26787244] Cmd: echo ctest-pod-26787244 > /usr/share/nginx/html/index.html, Output: 2024-12-26 01:57:58,690 - DEBUG - Service ctest-nginx-svc-25526378 not present 2024-12-26 01:57:58,691 - INFO - Creating service ctest-nginx-svc-25526378 2024-12-26 01:57:58,733 - INFO - Created Service ctest-nginx-svc-25526378 2024-12-26 01:57:58,760 - WARNING - Service UUID cc98e5a9-7b1d-41cc-a637-49ca4202b566 not yet found in contrail-api 2024-12-26 01:57:59,770 - INFO - Validated that Service ctest-nginx-svc-25526378 is seen in contrail-api 2024-12-26 01:57:59,770 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_LoadbalancerDatabaseList?x=cc98e5a9-7b1d-41cc-a637-49ca4202b566 2024-12-26 01:57:59,791 - INFO - Service ctest-nginx-svc-25526378 with uuid cc98e5a9-7b1d-41cc-a637-49ca4202b566 found in kube manager 2024-12-26 01:57:59,791 - INFO - Service ctest-nginx-svc-25526378 verification passed 2024-12-26 01:58:00,876 - DEBUG - [Pod ctest-pod-67520701] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.52.250:80 (10.101.52.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-11571612 2024-12-26 01:58:00,876 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 passed 2024-12-26 01:58:00,876 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd output: Connecting to 10.101.52.250:80 (10.101.52.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-11571612 2024-12-26 01:58:00,937 - DEBUG - [Pod ctest-pod-67520701] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.52.250:80 (10.101.52.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-11571612 2024-12-26 01:58:00,937 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 passed 2024-12-26 01:58:00,937 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd output: Connecting to 10.101.52.250:80 (10.101.52.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-11571612 2024-12-26 01:58:00,982 - DEBUG - [Pod ctest-pod-67520701] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: ctest-pod-11571612 Connecting to 10.101.52.250:80 (10.101.52.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-12-26 01:58:00,983 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 passed 2024-12-26 01:58:00,983 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd output: ctest-pod-11571612 Connecting to 10.101.52.250:80 (10.101.52.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-12-26 01:58:01,031 - DEBUG - [Pod ctest-pod-67520701] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: ctest-pod-11571612 Connecting to 10.101.52.250:80 (10.101.52.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-12-26 01:58:01,031 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 passed 2024-12-26 01:58:01,031 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd output: ctest-pod-11571612 Connecting to 10.101.52.250:80 (10.101.52.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-12-26 01:58:01,099 - DEBUG - [Pod ctest-pod-67520701] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: ctest-pod-11571612 Connecting to 10.101.52.250:80 (10.101.52.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-12-26 01:58:01,099 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 passed 2024-12-26 01:58:01,099 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd output: ctest-pod-11571612 Connecting to 10.101.52.250:80 (10.101.52.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-12-26 01:58:01,161 - DEBUG - [Pod ctest-pod-67520701] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: ctest-pod-11571612 Connecting to 10.101.52.250:80 (10.101.52.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-12-26 01:58:01,162 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 passed 2024-12-26 01:58:01,162 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd output: ctest-pod-11571612 Connecting to 10.101.52.250:80 (10.101.52.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-12-26 01:58:01,230 - DEBUG - [Pod ctest-pod-67520701] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: ctest-pod-11571612 Connecting to 10.101.52.250:80 (10.101.52.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-12-26 01:58:01,230 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 passed 2024-12-26 01:58:01,231 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd output: ctest-pod-11571612 Connecting to 10.101.52.250:80 (10.101.52.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-12-26 01:58:01,309 - DEBUG - [Pod ctest-pod-67520701] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.52.250:80 (10.101.52.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-91204233 2024-12-26 01:58:01,309 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 passed 2024-12-26 01:58:01,309 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd output: Connecting to 10.101.52.250:80 (10.101.52.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-91204233 2024-12-26 01:58:01,309 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-91204233': 1, 'ctest-pod-11571612': 7} 2024-12-26 01:58:01,376 - DEBUG - [Pod ctest-pod-40848456] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: ctest-pod-91204233 Connecting to 10.101.52.250:80 (10.101.52.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-12-26 01:58:01,376 - DEBUG - [Pod Pod ctest-pod-40848456] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 passed 2024-12-26 01:58:01,376 - DEBUG - [Pod Pod ctest-pod-40848456] Cmd output: ctest-pod-91204233 Connecting to 10.101.52.250:80 (10.101.52.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-12-26 01:58:01,448 - DEBUG - [Pod ctest-pod-40848456] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.52.250:80 (10.101.52.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-11571612 2024-12-26 01:58:01,448 - DEBUG - [Pod Pod ctest-pod-40848456] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 passed 2024-12-26 01:58:01,448 - DEBUG - [Pod Pod ctest-pod-40848456] Cmd output: Connecting to 10.101.52.250:80 (10.101.52.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-11571612 2024-12-26 01:58:01,448 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-91204233': 1, 'ctest-pod-11571612': 1} 2024-12-26 01:58:01,456 - DEBUG - Network policy ingress-on-service not present 2024-12-26 01:58:01,457 - INFO - Creating Network Policy ingress-on-service 2024-12-26 01:58:01,488 - INFO - Network policy found in k8s 2024-12-26 01:58:01,488 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=f5dafdc0-0096-4380-83a1-199a641d6520 2024-12-26 01:58:01,505 - INFO - Network Policy ingress-on-service with uuid f5dafdc0-0096-4380-83a1-199a641d6520 found in kube manager 2024-12-26 01:58:01,573 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-12-26 01:58:01,573 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-12-26 01:58:01,574 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=f5dafdc0-0096-4380-83a1-199a641d6520 2024-12-26 01:58:01,625 - WARNING - Network policy with name ingress-on-service not found in agent 2024-12-26 01:58:03,626 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=f5dafdc0-0096-4380-83a1-199a641d6520 2024-12-26 01:58:03,694 - INFO - Network policy with name ingress-on-service found in agent 2024-12-26 01:58:03,695 - INFO - Network Policy ingress-on-service verification passed 2024-12-26 01:58:08,775 - DEBUG - [Pod ctest-pod-67520701] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:58:08,775 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:58:08,775 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:58:13,856 - DEBUG - [Pod ctest-pod-67520701] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:58:13,857 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:58:13,857 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:58:18,933 - DEBUG - [Pod ctest-pod-67520701] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:58:18,933 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:58:18,933 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:58:24,006 - DEBUG - [Pod ctest-pod-67520701] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:58:24,007 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:58:24,007 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:58:29,099 - DEBUG - [Pod ctest-pod-67520701] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:58:29,100 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:58:29,100 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:58:34,183 - DEBUG - [Pod ctest-pod-67520701] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:58:34,183 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:58:34,183 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:58:39,264 - DEBUG - [Pod ctest-pod-67520701] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:58:39,264 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:58:39,264 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:58:44,323 - DEBUG - [Pod ctest-pod-67520701] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:58:44,323 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:58:44,323 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:58:49,403 - DEBUG - [Pod ctest-pod-67520701] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:58:49,404 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:58:49,404 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:58:54,489 - DEBUG - [Pod ctest-pod-67520701] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:58:54,489 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:58:54,489 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:58:54,489 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-91204233': 0, 'ctest-pod-11571612': 0} 2024-12-26 01:58:54,552 - DEBUG - [Pod ctest-pod-72827882] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: ctest-pod-11571612 Connecting to 10.101.52.250:80 (10.101.52.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-12-26 01:58:54,553 - DEBUG - [Pod Pod ctest-pod-72827882] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 passed 2024-12-26 01:58:54,553 - DEBUG - [Pod Pod ctest-pod-72827882] Cmd output: ctest-pod-11571612 Connecting to 10.101.52.250:80 (10.101.52.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-12-26 01:58:54,630 - DEBUG - [Pod ctest-pod-72827882] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.52.250:80 (10.101.52.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-11571612 2024-12-26 01:58:54,630 - DEBUG - [Pod Pod ctest-pod-72827882] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 passed 2024-12-26 01:58:54,630 - DEBUG - [Pod Pod ctest-pod-72827882] Cmd output: Connecting to 10.101.52.250:80 (10.101.52.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-11571612 2024-12-26 01:58:54,706 - DEBUG - [Pod ctest-pod-72827882] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: ctest-pod-11571612 Connecting to 10.101.52.250:80 (10.101.52.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-12-26 01:58:54,706 - DEBUG - [Pod Pod ctest-pod-72827882] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 passed 2024-12-26 01:58:54,706 - DEBUG - [Pod Pod ctest-pod-72827882] Cmd output: ctest-pod-11571612 Connecting to 10.101.52.250:80 (10.101.52.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-12-26 01:58:54,785 - DEBUG - [Pod ctest-pod-72827882] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: ctest-pod-91204233 Connecting to 10.101.52.250:80 (10.101.52.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-12-26 01:58:54,786 - DEBUG - [Pod Pod ctest-pod-72827882] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 passed 2024-12-26 01:58:54,786 - DEBUG - [Pod Pod ctest-pod-72827882] Cmd output: ctest-pod-91204233 Connecting to 10.101.52.250:80 (10.101.52.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-12-26 01:58:54,786 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-91204233': 1, 'ctest-pod-11571612': 3} 2024-12-26 01:58:59,877 - DEBUG - [Pod ctest-pod-40848456] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:58:59,877 - DEBUG - [Pod Pod ctest-pod-40848456] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:58:59,877 - DEBUG - [Pod Pod ctest-pod-40848456] Cmd output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:59:04,962 - DEBUG - [Pod ctest-pod-40848456] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:59:04,963 - DEBUG - [Pod Pod ctest-pod-40848456] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:59:04,963 - DEBUG - [Pod Pod ctest-pod-40848456] Cmd output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:59:10,052 - DEBUG - [Pod ctest-pod-40848456] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:59:10,052 - DEBUG - [Pod Pod ctest-pod-40848456] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:59:10,052 - DEBUG - [Pod Pod ctest-pod-40848456] Cmd output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:59:15,128 - DEBUG - [Pod ctest-pod-40848456] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:59:15,128 - DEBUG - [Pod Pod ctest-pod-40848456] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:59:15,128 - DEBUG - [Pod Pod ctest-pod-40848456] Cmd output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:59:20,189 - DEBUG - [Pod ctest-pod-40848456] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:59:20,189 - DEBUG - [Pod Pod ctest-pod-40848456] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:59:20,189 - DEBUG - [Pod Pod ctest-pod-40848456] Cmd output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:59:25,334 - DEBUG - [Pod ctest-pod-40848456] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:59:25,334 - DEBUG - [Pod Pod ctest-pod-40848456] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:59:25,334 - DEBUG - [Pod Pod ctest-pod-40848456] Cmd output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:59:30,424 - DEBUG - [Pod ctest-pod-40848456] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:59:30,424 - DEBUG - [Pod Pod ctest-pod-40848456] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:59:30,425 - DEBUG - [Pod Pod ctest-pod-40848456] Cmd output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:59:35,501 - DEBUG - [Pod ctest-pod-40848456] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:59:35,501 - DEBUG - [Pod Pod ctest-pod-40848456] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:59:35,501 - DEBUG - [Pod Pod ctest-pod-40848456] Cmd output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:59:40,581 - DEBUG - [Pod ctest-pod-40848456] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:59:40,581 - DEBUG - [Pod Pod ctest-pod-40848456] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:59:40,581 - DEBUG - [Pod Pod ctest-pod-40848456] Cmd output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:59:45,671 - DEBUG - [Pod ctest-pod-40848456] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:59:45,671 - DEBUG - [Pod Pod ctest-pod-40848456] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:59:45,671 - DEBUG - [Pod Pod ctest-pod-40848456] Cmd output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 01:59:45,672 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-91204233': 0, 'ctest-pod-11571612': 0} 2024-12-26 01:59:47,758 - DEBUG - [Pod ctest-pod-72827882] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.436 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.090 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.070/0.532/1.436 ms 2024-12-26 01:59:47,758 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-72827882 with expectation True passed 2024-12-26 01:59:49,840 - DEBUG - [Pod ctest-pod-67520701] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.385 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.097 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.517/1.385 ms 2024-12-26 01:59:49,840 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-67520701 with expectation True passed 2024-12-26 01:59:51,458 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2024-12-26 01:59:58,552 - DEBUG - [Pod ctest-pod-40848456] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.238 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.078 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.105 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.078/0.473/1.238 ms 2024-12-26 01:59:58,552 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-40848456 with expectation True passed 2024-12-26 01:59:58,634 - DEBUG - [Pod ctest-pod-72827882] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-12-26 01:59:58,635 - DEBUG - [Pod Pod ctest-pod-72827882] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-12-26 01:59:58,635 - DEBUG - [Pod Pod ctest-pod-72827882] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-12-26 01:59:58,635 - INFO - wget check of of http://10.47.255.251 from ctest-pod-72827882 passed 2024-12-26 01:59:58,723 - DEBUG - [Pod ctest-pod-72827882] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-12-26 01:59:58,724 - DEBUG - [Pod Pod ctest-pod-72827882] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-12-26 01:59:58,724 - DEBUG - [Pod Pod ctest-pod-72827882] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-12-26 01:59:58,724 - INFO - wget check of of http://10.47.255.250 from ctest-pod-72827882 passed 2024-12-26 02:00:03,804 - DEBUG - [Pod ctest-pod-67520701] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-12-26 02:00:03,804 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-12-26 02:00:03,805 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-12-26 02:00:03,805 - INFO - wget check of of http://10.47.255.250 from ctest-pod-67520701 passed 2024-12-26 02:00:08,878 - DEBUG - [Pod ctest-pod-37897406] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-12-26 02:00:08,878 - DEBUG - [Pod Pod ctest-pod-37897406] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-12-26 02:00:08,879 - DEBUG - [Pod Pod ctest-pod-37897406] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-12-26 02:00:08,879 - INFO - wget check of of http://10.47.255.251 from ctest-pod-37897406 passed 2024-12-26 02:00:08,913 - INFO - Updating Network Policy ingress-on-service 2024-12-26 02:00:14,014 - DEBUG - [Pod ctest-pod-67520701] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 02:00:14,014 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 02:00:14,014 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 02:00:19,087 - DEBUG - [Pod ctest-pod-67520701] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 02:00:19,087 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 02:00:19,087 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 02:00:24,155 - DEBUG - [Pod ctest-pod-67520701] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 02:00:24,156 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 02:00:24,156 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 02:00:29,237 - DEBUG - [Pod ctest-pod-67520701] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 02:00:29,238 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 02:00:29,238 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 02:00:34,315 - DEBUG - [Pod ctest-pod-67520701] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 02:00:34,315 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 02:00:34,315 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 02:00:39,397 - DEBUG - [Pod ctest-pod-67520701] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 02:00:39,397 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 02:00:39,397 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 02:00:44,472 - DEBUG - [Pod ctest-pod-67520701] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 02:00:44,472 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 02:00:44,473 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 02:00:49,586 - DEBUG - [Pod ctest-pod-67520701] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 02:00:49,586 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 02:00:49,586 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 02:00:54,659 - DEBUG - [Pod ctest-pod-67520701] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 02:00:54,660 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 02:00:54,660 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 02:00:59,745 - DEBUG - [Pod ctest-pod-67520701] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 02:00:59,745 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 02:00:59,745 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd output: Connecting to 10.101.52.250:80 (10.101.52.250:80) wget: download timed out 2024-12-26 02:00:59,746 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-91204233': 0, 'ctest-pod-11571612': 0} 2024-12-26 02:00:59,829 - DEBUG - [Pod ctest-pod-72827882] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.52.250:80 (10.101.52.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-91204233 2024-12-26 02:00:59,829 - DEBUG - [Pod Pod ctest-pod-72827882] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 passed 2024-12-26 02:00:59,829 - DEBUG - [Pod Pod ctest-pod-72827882] Cmd output: Connecting to 10.101.52.250:80 (10.101.52.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-91204233 2024-12-26 02:00:59,941 - DEBUG - [Pod ctest-pod-72827882] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: ctest-pod-11571612 Connecting to 10.101.52.250:80 (10.101.52.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-12-26 02:00:59,941 - DEBUG - [Pod Pod ctest-pod-72827882] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 passed 2024-12-26 02:00:59,942 - DEBUG - [Pod Pod ctest-pod-72827882] Cmd output: ctest-pod-11571612 Connecting to 10.101.52.250:80 (10.101.52.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-12-26 02:00:59,942 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-91204233': 1, 'ctest-pod-11571612': 1} 2024-12-26 02:01:00,015 - DEBUG - [Pod ctest-pod-40848456] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.52.250:80 (10.101.52.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-11571612 2024-12-26 02:01:00,015 - DEBUG - [Pod Pod ctest-pod-40848456] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 passed 2024-12-26 02:01:00,015 - DEBUG - [Pod Pod ctest-pod-40848456] Cmd output: Connecting to 10.101.52.250:80 (10.101.52.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-11571612 2024-12-26 02:01:00,102 - DEBUG - [Pod ctest-pod-40848456] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: ctest-pod-11571612 Connecting to 10.101.52.250:80 (10.101.52.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-12-26 02:01:00,103 - DEBUG - [Pod Pod ctest-pod-40848456] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 passed 2024-12-26 02:01:00,103 - DEBUG - [Pod Pod ctest-pod-40848456] Cmd output: ctest-pod-11571612 Connecting to 10.101.52.250:80 (10.101.52.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-12-26 02:01:00,166 - DEBUG - [Pod ctest-pod-40848456] Cmd: wget http://10.101.52.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.52.250:80 (10.101.52.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-91204233 2024-12-26 02:01:00,166 - DEBUG - [Pod Pod ctest-pod-40848456] Cmd wget http://10.101.52.250:80/ -O - -T 5 -t 1 passed 2024-12-26 02:01:00,167 - DEBUG - [Pod Pod ctest-pod-40848456] Cmd output: Connecting to 10.101.52.250:80 (10.101.52.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-91204233 2024-12-26 02:01:00,167 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-91204233': 1, 'ctest-pod-11571612': 2} 2024-12-26 02:01:02,221 - DEBUG - [Pod ctest-pod-72827882] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.268 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.079 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.083 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.079/0.476/1.268 ms 2024-12-26 02:01:02,221 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-72827882 with expectation True passed 2024-12-26 02:01:04,310 - DEBUG - [Pod ctest-pod-67520701] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.096 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.076 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.083 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.076/0.418/1.096 ms 2024-12-26 02:01:04,311 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-67520701 with expectation True passed 2024-12-26 02:01:06,383 - DEBUG - [Pod ctest-pod-40848456] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.523 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.147 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.081 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.081/0.583/1.523 ms 2024-12-26 02:01:06,384 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-40848456 with expectation True passed 2024-12-26 02:01:06,478 - DEBUG - [Pod ctest-pod-72827882] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-12-26 02:01:06,479 - DEBUG - [Pod Pod ctest-pod-72827882] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-12-26 02:01:06,479 - DEBUG - [Pod Pod ctest-pod-72827882] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-12-26 02:01:06,479 - INFO - wget check of of http://10.47.255.251 from ctest-pod-72827882 passed 2024-12-26 02:01:06,555 - DEBUG - [Pod ctest-pod-72827882] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-12-26 02:01:06,555 - DEBUG - [Pod Pod ctest-pod-72827882] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-12-26 02:01:06,555 - DEBUG - [Pod Pod ctest-pod-72827882] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-12-26 02:01:06,556 - INFO - wget check of of http://10.47.255.250 from ctest-pod-72827882 passed 2024-12-26 02:01:11,645 - DEBUG - [Pod ctest-pod-67520701] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-12-26 02:01:11,645 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-12-26 02:01:11,645 - DEBUG - [Pod Pod ctest-pod-67520701] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-12-26 02:01:11,645 - INFO - wget check of of http://10.47.255.250 from ctest-pod-67520701 passed 2024-12-26 02:01:11,727 - DEBUG - [Pod ctest-pod-37897406] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-12-26 02:01:11,728 - DEBUG - [Pod Pod ctest-pod-37897406] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-12-26 02:01:11,728 - DEBUG - [Pod Pod ctest-pod-37897406] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-12-26 02:01:11,728 - INFO - wget check of of http://10.47.255.251 from ctest-pod-37897406 passed 2024-12-26 02:01:11,728 - INFO - Deleting Network Policy : ingress-on-service 2024-12-26 02:01:11,729 - INFO - Deleting service : ctest-nginx-svc-25526378 2024-12-26 02:01:12,056 - DEBUG - No XMPP flaps were noticed during the test