2024-11-10 15:29:38,437 - INFO - Using existing project ['default-domain', 'k8s-default'](84193a5d-b555-4113-bfb5-83481175fb2f) 2024-11-10 15:29:38,455 - DEBUG - Namespace ctest-new-default-39710457 not present 2024-11-10 15:29:38,467 - INFO - Created namespace ctest-new-default-39710457 2024-11-10 15:29:41,470 - DEBUG - Namespace ctest-non-default-63561385 not present 2024-11-10 15:29:41,478 - INFO - Created namespace ctest-non-default-63561385 2024-11-10 15:29:44,502 - DEBUG - Pod ctest-pod-69706422 not present 2024-11-10 15:29:44,502 - INFO - Creating Pod ctest-pod-69706422 2024-11-10 15:29:44,536 - DEBUG - Pod : ctest-pod-69706422 UUID is 35b864fc-39f8-4021-a97b-b05c0e2ccc34 2024-11-10 15:29:44,539 - DEBUG - Pod ctest-pod-11690645 not present 2024-11-10 15:29:44,539 - INFO - Creating Pod ctest-pod-11690645 2024-11-10 15:29:44,586 - DEBUG - Pod : ctest-pod-11690645 UUID is 28aa6e40-5248-4d5f-8dcc-f281cfe1b4a7 2024-11-10 15:29:44,589 - DEBUG - Pod ctest-pod-28078512 not present 2024-11-10 15:29:44,589 - INFO - Creating Pod ctest-pod-28078512 2024-11-10 15:29:44,642 - DEBUG - Pod : ctest-pod-28078512 UUID is fedf6cda-80f3-4167-a36f-b889f656a969 2024-11-10 15:29:44,645 - DEBUG - Pod ctest-pod-79683116 not present 2024-11-10 15:29:44,646 - INFO - Creating Pod ctest-pod-79683116 2024-11-10 15:29:44,689 - DEBUG - Pod : ctest-pod-79683116 UUID is 0d8b8ded-f8ef-4234-ba97-3dfab0e2a205 2024-11-10 15:29:44,692 - DEBUG - Pod ctest-pod-67690102 not present 2024-11-10 15:29:44,692 - INFO - Creating Pod ctest-pod-67690102 2024-11-10 15:29:44,725 - DEBUG - Pod : ctest-pod-67690102 UUID is b2d7b3a1-6139-4917-82dd-04476bc8316b 2024-11-10 15:29:44,730 - DEBUG - Pod ctest-pod-44617808 not present 2024-11-10 15:29:44,731 - INFO - Creating Pod ctest-pod-44617808 2024-11-10 15:29:44,751 - DEBUG - Pod : ctest-pod-44617808 UUID is 106cb0bd-532a-4153-86f0-781e969492f2 2024-11-10 15:29:44,753 - DEBUG - Pod ctest-pod-99878915 not present 2024-11-10 15:29:44,753 - INFO - Creating Pod ctest-pod-99878915 2024-11-10 15:29:44,770 - DEBUG - Pod : ctest-pod-99878915 UUID is dfc9f1b9-b5aa-4eab-87e7-80c676f7f165 2024-11-10 15:29:44,774 - DEBUG - Pod ctest-pod-75858715 not present 2024-11-10 15:29:44,774 - INFO - Creating Pod ctest-pod-75858715 2024-11-10 15:29:44,813 - DEBUG - Pod : ctest-pod-75858715 UUID is ab83b38c-2c6e-471a-b677-6d12fffce29d 2024-11-10 15:29:45,034 - INFO - Project default-domain:k8s-ctest-new-default-39710457 for Namespace ctest-new-default-39710457 is seen in contrail-api 2024-11-10 15:29:45,034 - DEBUG - Project uuid in Contrail is 5c48f546-b65f-4ad6-a681-66dc98e14498 2024-11-10 15:29:45,342 - DEBUG - Requesting: http://10.0.0.32:8108/Snh_NamespaceDatabaseList?namespace_uuid=2d8ae594-0725-4dcc-9002-7e6e31095900 2024-11-10 15:29:45,347 - INFO - Namespace ctest-new-default-39710457 with uuid 2d8ae594-0725-4dcc-9002-7e6e31095900 found in kube manager 2024-11-10 15:29:45,347 - INFO - Namespace ctest-new-default-39710457 verification passed 2024-11-10 15:29:45,589 - INFO - Project default-domain:k8s-ctest-non-default-63561385 for Namespace ctest-non-default-63561385 is seen in contrail-api 2024-11-10 15:29:45,592 - DEBUG - Project uuid in Contrail is 86bf3a62-c128-4c4a-9da8-46a87ed29ade 2024-11-10 15:29:45,593 - DEBUG - Requesting: http://10.0.0.32:8108/Snh_NamespaceDatabaseList?namespace_uuid=33683cd2-cb6c-4324-ae3c-0a31251ae116 2024-11-10 15:29:45,601 - INFO - Namespace ctest-non-default-63561385 with uuid 33683cd2-cb6c-4324-ae3c-0a31251ae116 found in kube manager 2024-11-10 15:29:45,601 - INFO - Namespace ctest-non-default-63561385 verification passed 2024-11-10 15:29:45,608 - DEBUG - Pod ctest-pod-69706422 not in running state.Currently in Pending 2024-11-10 15:29:50,615 - DEBUG - Pod ctest-pod-69706422 not in running state.Currently in Pending 2024-11-10 15:29:55,622 - DEBUG - Pod ctest-pod-69706422 not in running state.Currently in Pending 2024-11-10 15:30:00,629 - INFO - Pod ctest-pod-69706422 is in running state.Got IP 10.47.255.251 2024-11-10 15:30:00,693 - DEBUG - Pod ctest-pod-69706422 has vmi 9e071fc8-9f78-11ef-bf7a-fa163e02da00 2024-11-10 15:30:00,693 - INFO - Verified pod ctest-pod-69706422 in contrail-api 2024-11-10 15:30:00,710 - DEBUG - VMI 9e071fc8-9f78-11ef-bf7a-fa163e02da00 is active in agent 10.0.0.23 2024-11-10 15:30:00,710 - INFO - Verified Pod ctest-pod-69706422 in agent 10.0.0.23 2024-11-10 15:30:00,710 - DEBUG - Requesting: http://10.0.0.32:8108/Snh_VirtualMachineDatabaseList?x=35b864fc-39f8-4021-a97b-b05c0e2ccc34 2024-11-10 15:30:00,715 - INFO - Pod ctest-pod-69706422 with uuid 35b864fc-39f8-4021-a97b-b05c0e2ccc34 found in kube manager 2024-11-10 15:30:00,715 - INFO - Pod ctest-pod-69706422 verification passed 2024-11-10 15:30:00,720 - INFO - Pod ctest-pod-11690645 is in running state.Got IP 10.47.255.250 2024-11-10 15:30:00,741 - DEBUG - Pod ctest-pod-11690645 has vmi 9ea6e922-9f78-11ef-bf7a-fa163e02da00 2024-11-10 15:30:00,741 - INFO - Verified pod ctest-pod-11690645 in contrail-api 2024-11-10 15:30:00,755 - DEBUG - VMI 9ea6e922-9f78-11ef-bf7a-fa163e02da00 is active in agent 10.0.0.23 2024-11-10 15:30:00,755 - INFO - Verified Pod ctest-pod-11690645 in agent 10.0.0.23 2024-11-10 15:30:00,755 - DEBUG - Requesting: http://10.0.0.32:8108/Snh_VirtualMachineDatabaseList?x=28aa6e40-5248-4d5f-8dcc-f281cfe1b4a7 2024-11-10 15:30:00,760 - INFO - Pod ctest-pod-11690645 with uuid 28aa6e40-5248-4d5f-8dcc-f281cfe1b4a7 found in kube manager 2024-11-10 15:30:00,760 - INFO - Pod ctest-pod-11690645 verification passed 2024-11-10 15:30:00,767 - INFO - Pod ctest-pod-28078512 is in running state.Got IP 10.47.255.249 2024-11-10 15:30:00,829 - DEBUG - Pod ctest-pod-28078512 has vmi 9f63d316-9f78-11ef-bf7a-fa163e02da00 2024-11-10 15:30:00,829 - INFO - Verified pod ctest-pod-28078512 in contrail-api 2024-11-10 15:30:00,843 - DEBUG - VMI 9f63d316-9f78-11ef-bf7a-fa163e02da00 is active in agent 10.0.0.23 2024-11-10 15:30:00,844 - INFO - Verified Pod ctest-pod-28078512 in agent 10.0.0.23 2024-11-10 15:30:00,844 - DEBUG - Requesting: http://10.0.0.32:8108/Snh_VirtualMachineDatabaseList?x=fedf6cda-80f3-4167-a36f-b889f656a969 2024-11-10 15:30:00,849 - INFO - Pod ctest-pod-28078512 with uuid fedf6cda-80f3-4167-a36f-b889f656a969 found in kube manager 2024-11-10 15:30:00,849 - INFO - Pod ctest-pod-28078512 verification passed 2024-11-10 15:30:00,855 - INFO - Pod ctest-pod-79683116 is in running state.Got IP 10.47.255.248 2024-11-10 15:30:00,917 - DEBUG - Pod ctest-pod-79683116 has vmi 9fe5e0fe-9f78-11ef-bf7a-fa163e02da00 2024-11-10 15:30:00,917 - INFO - Verified pod ctest-pod-79683116 in contrail-api 2024-11-10 15:30:00,932 - DEBUG - VMI 9fe5e0fe-9f78-11ef-bf7a-fa163e02da00 is active in agent 10.0.0.23 2024-11-10 15:30:00,932 - INFO - Verified Pod ctest-pod-79683116 in agent 10.0.0.23 2024-11-10 15:30:00,932 - DEBUG - Requesting: http://10.0.0.32:8108/Snh_VirtualMachineDatabaseList?x=0d8b8ded-f8ef-4234-ba97-3dfab0e2a205 2024-11-10 15:30:00,937 - INFO - Pod ctest-pod-79683116 with uuid 0d8b8ded-f8ef-4234-ba97-3dfab0e2a205 found in kube manager 2024-11-10 15:30:00,937 - INFO - Pod ctest-pod-79683116 verification passed 2024-11-10 15:30:00,943 - DEBUG - Pod ctest-pod-67690102 not in running state.Currently in Pending 2024-11-10 15:30:05,949 - INFO - Pod ctest-pod-67690102 is in running state.Got IP 10.47.255.247 2024-11-10 15:30:05,970 - DEBUG - Pod ctest-pod-67690102 has vmi a07ec558-9f78-11ef-bf7a-fa163e02da00 2024-11-10 15:30:05,970 - INFO - Verified pod ctest-pod-67690102 in contrail-api 2024-11-10 15:30:05,985 - DEBUG - VMI a07ec558-9f78-11ef-bf7a-fa163e02da00 is active in agent 10.0.0.23 2024-11-10 15:30:05,985 - INFO - Verified Pod ctest-pod-67690102 in agent 10.0.0.23 2024-11-10 15:30:05,985 - DEBUG - Requesting: http://10.0.0.32:8108/Snh_VirtualMachineDatabaseList?x=b2d7b3a1-6139-4917-82dd-04476bc8316b 2024-11-10 15:30:05,990 - INFO - Pod ctest-pod-67690102 with uuid b2d7b3a1-6139-4917-82dd-04476bc8316b found in kube manager 2024-11-10 15:30:05,991 - INFO - Pod ctest-pod-67690102 verification passed 2024-11-10 15:30:05,996 - INFO - Pod ctest-pod-99878915 is in running state.Got IP 10.47.255.245 2024-11-10 15:30:06,057 - DEBUG - Pod ctest-pod-99878915 has vmi a182a578-9f78-11ef-bf7a-fa163e02da00 2024-11-10 15:30:06,057 - INFO - Verified pod ctest-pod-99878915 in contrail-api 2024-11-10 15:30:06,072 - DEBUG - VMI a182a578-9f78-11ef-bf7a-fa163e02da00 is active in agent 10.0.0.23 2024-11-10 15:30:06,072 - INFO - Verified Pod ctest-pod-99878915 in agent 10.0.0.23 2024-11-10 15:30:06,073 - DEBUG - Requesting: http://10.0.0.32:8108/Snh_VirtualMachineDatabaseList?x=dfc9f1b9-b5aa-4eab-87e7-80c676f7f165 2024-11-10 15:30:06,078 - INFO - Pod ctest-pod-99878915 with uuid dfc9f1b9-b5aa-4eab-87e7-80c676f7f165 found in kube manager 2024-11-10 15:30:06,078 - INFO - Pod ctest-pod-99878915 verification passed 2024-11-10 15:30:06,084 - INFO - Pod ctest-pod-44617808 is in running state.Got IP 10.47.255.246 2024-11-10 15:30:06,106 - DEBUG - Pod ctest-pod-44617808 has vmi a102bd90-9f78-11ef-bf7a-fa163e02da00 2024-11-10 15:30:06,106 - INFO - Verified pod ctest-pod-44617808 in contrail-api 2024-11-10 15:30:06,122 - DEBUG - VMI a102bd90-9f78-11ef-bf7a-fa163e02da00 is active in agent 10.0.0.23 2024-11-10 15:30:06,123 - INFO - Verified Pod ctest-pod-44617808 in agent 10.0.0.23 2024-11-10 15:30:06,123 - DEBUG - Requesting: http://10.0.0.32:8108/Snh_VirtualMachineDatabaseList?x=106cb0bd-532a-4153-86f0-781e969492f2 2024-11-10 15:30:06,129 - INFO - Pod ctest-pod-44617808 with uuid 106cb0bd-532a-4153-86f0-781e969492f2 found in kube manager 2024-11-10 15:30:06,129 - INFO - Pod ctest-pod-44617808 verification passed 2024-11-10 15:30:06,135 - INFO - Pod ctest-pod-75858715 is in running state.Got IP 10.47.255.244 2024-11-10 15:30:06,198 - DEBUG - Pod ctest-pod-75858715 has vmi a20483b8-9f78-11ef-bf7a-fa163e02da00 2024-11-10 15:30:06,198 - INFO - Verified pod ctest-pod-75858715 in contrail-api 2024-11-10 15:30:06,212 - DEBUG - VMI a20483b8-9f78-11ef-bf7a-fa163e02da00 is active in agent 10.0.0.23 2024-11-10 15:30:06,213 - INFO - Verified Pod ctest-pod-75858715 in agent 10.0.0.23 2024-11-10 15:30:06,213 - DEBUG - Requesting: http://10.0.0.32:8108/Snh_VirtualMachineDatabaseList?x=ab83b38c-2c6e-471a-b677-6d12fffce29d 2024-11-10 15:30:06,218 - INFO - Pod ctest-pod-75858715 with uuid ab83b38c-2c6e-471a-b677-6d12fffce29d found in kube manager 2024-11-10 15:30:06,218 - INFO - Pod ctest-pod-75858715 verification passed 2024-11-10 15:30:06,218 - INFO - ================================================================================ 2024-11-10 15:30:06,218 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-11-10 15:30:06,218 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-11-10 15:30:06,419 - DEBUG - Nothing to compare xmpp stats {'10.0.0.23': {'10.0.0.32': '0'}} with 2024-11-10 15:30:06,420 - INFO - Initial checks done. Running the testcase now 2024-11-10 15:30:06,420 - INFO - 2024-11-10 15:30:06,477 - DEBUG - [Pod ctest-pod-69706422] Cmd: echo ctest-pod-69706422 > /usr/share/nginx/html/index.html, Output: 2024-11-10 15:30:06,529 - DEBUG - [Pod ctest-pod-11690645] Cmd: echo ctest-pod-11690645 > /usr/share/nginx/html/index.html, Output: 2024-11-10 15:30:06,589 - DEBUG - [Pod ctest-pod-28078512] Cmd: echo ctest-pod-28078512 > /usr/share/nginx/html/index.html, Output: 2024-11-10 15:30:06,653 - DEBUG - [Pod ctest-pod-79683116] Cmd: echo ctest-pod-79683116 > /usr/share/nginx/html/index.html, Output: 2024-11-10 15:30:06,656 - DEBUG - Service ctest-nginx-svc-53155365 not present 2024-11-10 15:30:06,657 - INFO - Creating service ctest-nginx-svc-53155365 2024-11-10 15:30:06,693 - INFO - Created Service ctest-nginx-svc-53155365 2024-11-10 15:30:06,702 - WARNING - Service UUID 06375cab-6c6a-40ed-88d7-7a0eb9219512 not yet found in contrail-api 2024-11-10 15:30:07,713 - INFO - Validated that Service ctest-nginx-svc-53155365 is seen in contrail-api 2024-11-10 15:30:07,713 - DEBUG - Requesting: http://10.0.0.32:8108/Snh_LoadbalancerDatabaseList?x=06375cab-6c6a-40ed-88d7-7a0eb9219512 2024-11-10 15:30:07,718 - INFO - Service ctest-nginx-svc-53155365 with uuid 06375cab-6c6a-40ed-88d7-7a0eb9219512 found in kube manager 2024-11-10 15:30:07,718 - INFO - Service ctest-nginx-svc-53155365 verification passed 2024-11-10 15:30:08,783 - DEBUG - [Pod ctest-pod-67690102] Cmd: wget http://10.109.163.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.163.244:80 (10.109.163.244:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-69706422 2024-11-10 15:30:08,784 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd wget http://10.109.163.244:80/ -O - -T 5 -t 1 passed 2024-11-10 15:30:08,784 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd output: Connecting to 10.109.163.244:80 (10.109.163.244:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-69706422 2024-11-10 15:30:08,843 - DEBUG - [Pod ctest-pod-67690102] Cmd: wget http://10.109.163.244:80/ -O - -T 5 -t 1 , Output: ctest-pod-69706422 Connecting to 10.109.163.244:80 (10.109.163.244:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 15:30:08,843 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd wget http://10.109.163.244:80/ -O - -T 5 -t 1 passed 2024-11-10 15:30:08,843 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd output: ctest-pod-69706422 Connecting to 10.109.163.244:80 (10.109.163.244:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 15:30:08,920 - DEBUG - [Pod ctest-pod-67690102] Cmd: wget http://10.109.163.244:80/ -O - -T 5 -t 1 , Output: ctest-pod-69706422 Connecting to 10.109.163.244:80 (10.109.163.244:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 15:30:08,920 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd wget http://10.109.163.244:80/ -O - -T 5 -t 1 passed 2024-11-10 15:30:08,920 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd output: ctest-pod-69706422 Connecting to 10.109.163.244:80 (10.109.163.244:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 15:30:08,980 - DEBUG - [Pod ctest-pod-67690102] Cmd: wget http://10.109.163.244:80/ -O - -T 5 -t 1 , Output: ctest-pod-69706422 Connecting to 10.109.163.244:80 (10.109.163.244:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 15:30:08,980 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd wget http://10.109.163.244:80/ -O - -T 5 -t 1 passed 2024-11-10 15:30:08,980 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd output: ctest-pod-69706422 Connecting to 10.109.163.244:80 (10.109.163.244:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 15:30:09,045 - DEBUG - [Pod ctest-pod-67690102] Cmd: wget http://10.109.163.244:80/ -O - -T 5 -t 1 , Output: ctest-pod-11690645 Connecting to 10.109.163.244:80 (10.109.163.244:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 15:30:09,045 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd wget http://10.109.163.244:80/ -O - -T 5 -t 1 passed 2024-11-10 15:30:09,045 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd output: ctest-pod-11690645 Connecting to 10.109.163.244:80 (10.109.163.244:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 15:30:09,045 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-69706422': 4, 'ctest-pod-11690645': 1} 2024-11-10 15:30:09,145 - DEBUG - [Pod ctest-pod-99878915] Cmd: wget http://10.109.163.244:80/ -O - -T 5 -t 1 , Output: ctest-pod-69706422 Connecting to 10.109.163.244:80 (10.109.163.244:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 15:30:09,145 - DEBUG - [Pod Pod ctest-pod-99878915] Cmd wget http://10.109.163.244:80/ -O - -T 5 -t 1 passed 2024-11-10 15:30:09,145 - DEBUG - [Pod Pod ctest-pod-99878915] Cmd output: ctest-pod-69706422 Connecting to 10.109.163.244:80 (10.109.163.244:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 15:30:09,199 - DEBUG - [Pod ctest-pod-99878915] Cmd: wget http://10.109.163.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.163.244:80 (10.109.163.244:80) ctest-pod-69706422 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 15:30:09,199 - DEBUG - [Pod Pod ctest-pod-99878915] Cmd wget http://10.109.163.244:80/ -O - -T 5 -t 1 passed 2024-11-10 15:30:09,199 - DEBUG - [Pod Pod ctest-pod-99878915] Cmd output: Connecting to 10.109.163.244:80 (10.109.163.244:80) ctest-pod-69706422 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 15:30:09,261 - DEBUG - [Pod ctest-pod-99878915] Cmd: wget http://10.109.163.244:80/ -O - -T 5 -t 1 , Output: ctest-pod-11690645 Connecting to 10.109.163.244:80 (10.109.163.244:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 15:30:09,261 - DEBUG - [Pod Pod ctest-pod-99878915] Cmd wget http://10.109.163.244:80/ -O - -T 5 -t 1 passed 2024-11-10 15:30:09,261 - DEBUG - [Pod Pod ctest-pod-99878915] Cmd output: ctest-pod-11690645 Connecting to 10.109.163.244:80 (10.109.163.244:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 15:30:09,261 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-69706422': 2, 'ctest-pod-11690645': 1} 2024-11-10 15:30:09,265 - DEBUG - Network policy ingress-on-service not present 2024-11-10 15:30:09,265 - INFO - Creating Network Policy ingress-on-service 2024-11-10 15:30:09,276 - INFO - Network policy found in k8s 2024-11-10 15:30:09,276 - DEBUG - Requesting: http://10.0.0.32:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=6e4a5790-7670-4c72-9d28-085fc62f4b9b 2024-11-10 15:30:09,286 - INFO - Network Policy ingress-on-service with uuid 6e4a5790-7670-4c72-9d28-085fc62f4b9b found in kube manager 2024-11-10 15:30:09,333 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-11-10 15:30:09,333 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-11-10 15:30:09,333 - DEBUG - Requesting: http://10.0.0.32:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=6e4a5790-7670-4c72-9d28-085fc62f4b9b 2024-11-10 15:30:09,364 - WARNING - Network policy with name ingress-on-service not found in agent 2024-11-10 15:30:11,364 - DEBUG - Requesting: http://10.0.0.32:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=6e4a5790-7670-4c72-9d28-085fc62f4b9b 2024-11-10 15:30:11,398 - INFO - Network policy with name ingress-on-service found in agent 2024-11-10 15:30:11,398 - INFO - Network Policy ingress-on-service verification passed 2024-11-10 15:30:16,455 - DEBUG - [Pod ctest-pod-67690102] Cmd: wget http://10.109.163.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:30:16,455 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd wget http://10.109.163.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:30:16,455 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:30:21,522 - DEBUG - [Pod ctest-pod-67690102] Cmd: wget http://10.109.163.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:30:21,523 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd wget http://10.109.163.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:30:21,523 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:30:26,584 - DEBUG - [Pod ctest-pod-67690102] Cmd: wget http://10.109.163.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:30:26,584 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd wget http://10.109.163.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:30:26,584 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:30:31,644 - DEBUG - [Pod ctest-pod-67690102] Cmd: wget http://10.109.163.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:30:31,645 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd wget http://10.109.163.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:30:31,645 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:30:36,704 - DEBUG - [Pod ctest-pod-67690102] Cmd: wget http://10.109.163.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:30:36,704 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd wget http://10.109.163.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:30:36,704 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:30:41,767 - DEBUG - [Pod ctest-pod-67690102] Cmd: wget http://10.109.163.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:30:41,767 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd wget http://10.109.163.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:30:41,767 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:30:46,823 - DEBUG - [Pod ctest-pod-67690102] Cmd: wget http://10.109.163.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:30:46,824 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd wget http://10.109.163.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:30:46,824 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:30:51,874 - DEBUG - [Pod ctest-pod-67690102] Cmd: wget http://10.109.163.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:30:51,874 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd wget http://10.109.163.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:30:51,874 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:30:56,927 - DEBUG - [Pod ctest-pod-67690102] Cmd: wget http://10.109.163.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:30:56,927 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd wget http://10.109.163.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:30:56,927 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:31:01,978 - DEBUG - [Pod ctest-pod-67690102] Cmd: wget http://10.109.163.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:31:01,978 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd wget http://10.109.163.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:31:01,978 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:31:01,978 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-69706422': 0, 'ctest-pod-11690645': 0} 2024-11-10 15:31:02,041 - DEBUG - [Pod ctest-pod-44617808] Cmd: wget http://10.109.163.244:80/ -O - -T 5 -t 1 , Output: ctest-pod-69706422 Connecting to 10.109.163.244:80 (10.109.163.244:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 15:31:02,041 - DEBUG - [Pod Pod ctest-pod-44617808] Cmd wget http://10.109.163.244:80/ -O - -T 5 -t 1 passed 2024-11-10 15:31:02,042 - DEBUG - [Pod Pod ctest-pod-44617808] Cmd output: ctest-pod-69706422 Connecting to 10.109.163.244:80 (10.109.163.244:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 15:31:02,104 - DEBUG - [Pod ctest-pod-44617808] Cmd: wget http://10.109.163.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.163.244:80 (10.109.163.244:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-11690645 2024-11-10 15:31:02,104 - DEBUG - [Pod Pod ctest-pod-44617808] Cmd wget http://10.109.163.244:80/ -O - -T 5 -t 1 passed 2024-11-10 15:31:02,104 - DEBUG - [Pod Pod ctest-pod-44617808] Cmd output: Connecting to 10.109.163.244:80 (10.109.163.244:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-11690645 2024-11-10 15:31:02,104 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-69706422': 1, 'ctest-pod-11690645': 1} 2024-11-10 15:31:07,167 - DEBUG - [Pod ctest-pod-99878915] Cmd: wget http://10.109.163.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:31:07,167 - DEBUG - [Pod Pod ctest-pod-99878915] Cmd wget http://10.109.163.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:31:07,167 - DEBUG - [Pod Pod ctest-pod-99878915] Cmd output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:31:12,230 - DEBUG - [Pod ctest-pod-99878915] Cmd: wget http://10.109.163.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:31:12,230 - DEBUG - [Pod Pod ctest-pod-99878915] Cmd wget http://10.109.163.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:31:12,230 - DEBUG - [Pod Pod ctest-pod-99878915] Cmd output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:31:17,304 - DEBUG - [Pod ctest-pod-99878915] Cmd: wget http://10.109.163.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:31:17,304 - DEBUG - [Pod Pod ctest-pod-99878915] Cmd wget http://10.109.163.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:31:17,304 - DEBUG - [Pod Pod ctest-pod-99878915] Cmd output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:31:22,368 - DEBUG - [Pod ctest-pod-99878915] Cmd: wget http://10.109.163.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:31:22,368 - DEBUG - [Pod Pod ctest-pod-99878915] Cmd wget http://10.109.163.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:31:22,368 - DEBUG - [Pod Pod ctest-pod-99878915] Cmd output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:31:27,438 - DEBUG - [Pod ctest-pod-99878915] Cmd: wget http://10.109.163.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:31:27,438 - DEBUG - [Pod Pod ctest-pod-99878915] Cmd wget http://10.109.163.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:31:27,438 - DEBUG - [Pod Pod ctest-pod-99878915] Cmd output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:31:32,527 - DEBUG - [Pod ctest-pod-99878915] Cmd: wget http://10.109.163.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:31:32,527 - DEBUG - [Pod Pod ctest-pod-99878915] Cmd wget http://10.109.163.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:31:32,527 - DEBUG - [Pod Pod ctest-pod-99878915] Cmd output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:31:37,584 - DEBUG - [Pod ctest-pod-99878915] Cmd: wget http://10.109.163.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:31:37,584 - DEBUG - [Pod Pod ctest-pod-99878915] Cmd wget http://10.109.163.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:31:37,585 - DEBUG - [Pod Pod ctest-pod-99878915] Cmd output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:31:42,654 - DEBUG - [Pod ctest-pod-99878915] Cmd: wget http://10.109.163.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:31:42,654 - DEBUG - [Pod Pod ctest-pod-99878915] Cmd wget http://10.109.163.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:31:42,654 - DEBUG - [Pod Pod ctest-pod-99878915] Cmd output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:31:47,711 - DEBUG - [Pod ctest-pod-99878915] Cmd: wget http://10.109.163.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:31:47,711 - DEBUG - [Pod Pod ctest-pod-99878915] Cmd wget http://10.109.163.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:31:47,712 - DEBUG - [Pod Pod ctest-pod-99878915] Cmd output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:31:52,777 - DEBUG - [Pod ctest-pod-99878915] Cmd: wget http://10.109.163.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:31:52,777 - DEBUG - [Pod Pod ctest-pod-99878915] Cmd wget http://10.109.163.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:31:52,777 - DEBUG - [Pod Pod ctest-pod-99878915] Cmd output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:31:52,777 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-69706422': 0, 'ctest-pod-11690645': 0} 2024-11-10 15:31:54,850 - DEBUG - [Pod ctest-pod-44617808] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.318 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.080 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.084 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.080/0.494/1.318 ms 2024-11-10 15:31:54,850 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-44617808 with expectation True passed 2024-11-10 15:31:56,906 - DEBUG - [Pod ctest-pod-67690102] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.624 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.086 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.087 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.086/0.265/0.624 ms 2024-11-10 15:31:56,906 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-67690102 with expectation True passed 2024-11-10 15:31:58,962 - DEBUG - [Pod ctest-pod-99878915] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.436 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.077 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.083 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.077/0.198/0.436 ms 2024-11-10 15:31:58,962 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-99878915 with expectation True passed 2024-11-10 15:31:59,028 - DEBUG - [Pod ctest-pod-44617808] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 15:31:59,028 - DEBUG - [Pod Pod ctest-pod-44617808] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-11-10 15:31:59,028 - DEBUG - [Pod Pod ctest-pod-44617808] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 15:31:59,028 - INFO - wget check of of http://10.47.255.251 from ctest-pod-44617808 passed 2024-11-10 15:31:59,108 - DEBUG - [Pod ctest-pod-44617808] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 15:31:59,108 - DEBUG - [Pod Pod ctest-pod-44617808] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-11-10 15:31:59,108 - DEBUG - [Pod Pod ctest-pod-44617808] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 15:31:59,108 - INFO - wget check of of http://10.47.255.250 from ctest-pod-44617808 passed 2024-11-10 15:32:04,171 - DEBUG - [Pod ctest-pod-67690102] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-10 15:32:04,171 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-10 15:32:04,171 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-10 15:32:04,172 - INFO - wget check of of http://10.47.255.250 from ctest-pod-67690102 passed 2024-11-10 15:32:09,239 - DEBUG - [Pod ctest-pod-75858715] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-11-10 15:32:09,239 - DEBUG - [Pod Pod ctest-pod-75858715] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-11-10 15:32:09,239 - DEBUG - [Pod Pod ctest-pod-75858715] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-11-10 15:32:09,239 - INFO - wget check of of http://10.47.255.251 from ctest-pod-75858715 passed 2024-11-10 15:32:09,249 - INFO - Updating Network Policy ingress-on-service 2024-11-10 15:32:14,328 - DEBUG - [Pod ctest-pod-67690102] Cmd: wget http://10.109.163.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:32:14,329 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd wget http://10.109.163.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:32:14,329 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:32:19,474 - DEBUG - [Pod ctest-pod-67690102] Cmd: wget http://10.109.163.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:32:19,475 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd wget http://10.109.163.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:32:19,475 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:32:24,535 - DEBUG - [Pod ctest-pod-67690102] Cmd: wget http://10.109.163.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:32:24,535 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd wget http://10.109.163.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:32:24,535 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:32:29,598 - DEBUG - [Pod ctest-pod-67690102] Cmd: wget http://10.109.163.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:32:29,598 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd wget http://10.109.163.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:32:29,599 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:32:34,664 - DEBUG - [Pod ctest-pod-67690102] Cmd: wget http://10.109.163.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:32:34,664 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd wget http://10.109.163.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:32:34,664 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:32:39,728 - DEBUG - [Pod ctest-pod-67690102] Cmd: wget http://10.109.163.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:32:39,728 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd wget http://10.109.163.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:32:39,728 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:32:44,802 - DEBUG - [Pod ctest-pod-67690102] Cmd: wget http://10.109.163.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:32:44,803 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd wget http://10.109.163.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:32:44,803 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:32:49,879 - DEBUG - [Pod ctest-pod-67690102] Cmd: wget http://10.109.163.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:32:49,879 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd wget http://10.109.163.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:32:49,879 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:32:54,967 - DEBUG - [Pod ctest-pod-67690102] Cmd: wget http://10.109.163.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:32:54,967 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd wget http://10.109.163.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:32:54,967 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:33:00,034 - DEBUG - [Pod ctest-pod-67690102] Cmd: wget http://10.109.163.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:33:00,034 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd wget http://10.109.163.244:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:33:00,035 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd output: Connecting to 10.109.163.244:80 (10.109.163.244:80) wget: download timed out 2024-11-10 15:33:00,035 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-69706422': 0, 'ctest-pod-11690645': 0} 2024-11-10 15:33:00,115 - DEBUG - [Pod ctest-pod-44617808] Cmd: wget http://10.109.163.244:80/ -O - -T 5 -t 1 , Output: ctest-pod-69706422 Connecting to 10.109.163.244:80 (10.109.163.244:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 15:33:00,116 - DEBUG - [Pod Pod ctest-pod-44617808] Cmd wget http://10.109.163.244:80/ -O - -T 5 -t 1 passed 2024-11-10 15:33:00,116 - DEBUG - [Pod Pod ctest-pod-44617808] Cmd output: ctest-pod-69706422 Connecting to 10.109.163.244:80 (10.109.163.244:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 15:33:00,183 - DEBUG - [Pod ctest-pod-44617808] Cmd: wget http://10.109.163.244:80/ -O - -T 5 -t 1 , Output: ctest-pod-69706422 Connecting to 10.109.163.244:80 (10.109.163.244:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 15:33:00,184 - DEBUG - [Pod Pod ctest-pod-44617808] Cmd wget http://10.109.163.244:80/ -O - -T 5 -t 1 passed 2024-11-10 15:33:00,184 - DEBUG - [Pod Pod ctest-pod-44617808] Cmd output: ctest-pod-69706422 Connecting to 10.109.163.244:80 (10.109.163.244:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 15:33:00,248 - DEBUG - [Pod ctest-pod-44617808] Cmd: wget http://10.109.163.244:80/ -O - -T 5 -t 1 , Output: ctest-pod-69706422 Connecting to 10.109.163.244:80 (10.109.163.244:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 15:33:00,248 - DEBUG - [Pod Pod ctest-pod-44617808] Cmd wget http://10.109.163.244:80/ -O - -T 5 -t 1 passed 2024-11-10 15:33:00,248 - DEBUG - [Pod Pod ctest-pod-44617808] Cmd output: ctest-pod-69706422 Connecting to 10.109.163.244:80 (10.109.163.244:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 15:33:00,312 - DEBUG - [Pod ctest-pod-44617808] Cmd: wget http://10.109.163.244:80/ -O - -T 5 -t 1 , Output: ctest-pod-11690645 Connecting to 10.109.163.244:80 (10.109.163.244:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 15:33:00,312 - DEBUG - [Pod Pod ctest-pod-44617808] Cmd wget http://10.109.163.244:80/ -O - -T 5 -t 1 passed 2024-11-10 15:33:00,312 - DEBUG - [Pod Pod ctest-pod-44617808] Cmd output: ctest-pod-11690645 Connecting to 10.109.163.244:80 (10.109.163.244:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 15:33:00,312 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-69706422': 3, 'ctest-pod-11690645': 1} 2024-11-10 15:33:00,376 - DEBUG - [Pod ctest-pod-99878915] Cmd: wget http://10.109.163.244:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.163.244:80 (10.109.163.244:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-11690645 2024-11-10 15:33:00,376 - DEBUG - [Pod Pod ctest-pod-99878915] Cmd wget http://10.109.163.244:80/ -O - -T 5 -t 1 passed 2024-11-10 15:33:00,376 - DEBUG - [Pod Pod ctest-pod-99878915] Cmd output: Connecting to 10.109.163.244:80 (10.109.163.244:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-11690645 2024-11-10 15:33:00,441 - DEBUG - [Pod ctest-pod-99878915] Cmd: wget http://10.109.163.244:80/ -O - -T 5 -t 1 , Output: ctest-pod-69706422 Connecting to 10.109.163.244:80 (10.109.163.244:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 15:33:00,441 - DEBUG - [Pod Pod ctest-pod-99878915] Cmd wget http://10.109.163.244:80/ -O - -T 5 -t 1 passed 2024-11-10 15:33:00,441 - DEBUG - [Pod Pod ctest-pod-99878915] Cmd output: ctest-pod-69706422 Connecting to 10.109.163.244:80 (10.109.163.244:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-10 15:33:00,441 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-69706422': 1, 'ctest-pod-11690645': 1} 2024-11-10 15:33:02,506 - DEBUG - [Pod ctest-pod-44617808] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.232 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.090 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.094 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.090/0.472/1.232 ms 2024-11-10 15:33:02,506 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-44617808 with expectation True passed 2024-11-10 15:33:04,570 - DEBUG - [Pod ctest-pod-67690102] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.470 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.108 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.098 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.098/0.225/0.470 ms 2024-11-10 15:33:04,570 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-67690102 with expectation True passed 2024-11-10 15:33:06,631 - DEBUG - [Pod ctest-pod-99878915] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.633 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.095 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.266/0.633 ms 2024-11-10 15:33:06,631 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-99878915 with expectation True passed 2024-11-10 15:33:06,685 - DEBUG - [Pod ctest-pod-44617808] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 15:33:06,686 - DEBUG - [Pod Pod ctest-pod-44617808] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-11-10 15:33:06,686 - DEBUG - [Pod Pod ctest-pod-44617808] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 15:33:06,686 - INFO - wget check of of http://10.47.255.251 from ctest-pod-44617808 passed 2024-11-10 15:33:06,766 - DEBUG - [Pod ctest-pod-44617808] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 15:33:06,766 - DEBUG - [Pod Pod ctest-pod-44617808] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-11-10 15:33:06,766 - DEBUG - [Pod Pod ctest-pod-44617808] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 15:33:06,766 - INFO - wget check of of http://10.47.255.250 from ctest-pod-44617808 passed 2024-11-10 15:33:11,837 - DEBUG - [Pod ctest-pod-67690102] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-10 15:33:11,837 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-10 15:33:11,837 - DEBUG - [Pod Pod ctest-pod-67690102] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-10 15:33:11,837 - INFO - wget check of of http://10.47.255.250 from ctest-pod-67690102 passed 2024-11-10 15:33:11,906 - DEBUG - [Pod ctest-pod-75858715] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 15:33:11,906 - DEBUG - [Pod Pod ctest-pod-75858715] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-11-10 15:33:11,906 - DEBUG - [Pod Pod ctest-pod-75858715] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-10 15:33:11,906 - INFO - wget check of of http://10.47.255.251 from ctest-pod-75858715 passed 2024-11-10 15:33:11,906 - INFO - Deleting Network Policy : ingress-on-service 2024-11-10 15:33:11,907 - INFO - Deleting service : ctest-nginx-svc-53155365 2024-11-10 15:33:12,276 - DEBUG - No XMPP flaps were noticed during the test