2025-04-28 01:37:42,575 - INFO - Using existing project ['default-domain', 'k8s-default'](0733e2f9-9fd9-4bde-88bf-9b7afd4a8fa5) 2025-04-28 01:37:42,600 - DEBUG - Namespace ctest-new-default-62706730 not present 2025-04-28 01:37:42,606 - INFO - Created namespace ctest-new-default-62706730 2025-04-28 01:37:45,610 - DEBUG - Namespace ctest-non-default-46326464 not present 2025-04-28 01:37:45,616 - INFO - Created namespace ctest-non-default-46326464 2025-04-28 01:37:48,633 - DEBUG - Pod ctest-pod-77670450 not present 2025-04-28 01:37:48,633 - INFO - Creating Pod ctest-pod-77670450 2025-04-28 01:37:48,653 - DEBUG - Pod : ctest-pod-77670450 UUID is a42c8e37-52ae-4b22-a037-6b14c6ac6d7e 2025-04-28 01:37:48,656 - DEBUG - Pod ctest-pod-26765879 not present 2025-04-28 01:37:48,656 - INFO - Creating Pod ctest-pod-26765879 2025-04-28 01:37:48,673 - DEBUG - Pod : ctest-pod-26765879 UUID is b1068fcd-5b85-4282-9a8d-02f5a9b14ffb 2025-04-28 01:37:48,681 - DEBUG - Pod ctest-pod-80003030 not present 2025-04-28 01:37:48,681 - INFO - Creating Pod ctest-pod-80003030 2025-04-28 01:37:48,704 - DEBUG - Pod : ctest-pod-80003030 UUID is 32a46b7e-78e9-4346-a314-04d75182b531 2025-04-28 01:37:48,707 - DEBUG - Pod ctest-pod-71532304 not present 2025-04-28 01:37:48,707 - INFO - Creating Pod ctest-pod-71532304 2025-04-28 01:37:48,724 - DEBUG - Pod : ctest-pod-71532304 UUID is 13cf0d34-9673-4918-b21b-19fa40fc8d52 2025-04-28 01:37:48,732 - DEBUG - Pod ctest-pod-10429126 not present 2025-04-28 01:37:48,733 - INFO - Creating Pod ctest-pod-10429126 2025-04-28 01:37:48,775 - DEBUG - Pod : ctest-pod-10429126 UUID is db55897a-e8c7-4948-9519-91793aae53af 2025-04-28 01:37:48,779 - DEBUG - Pod ctest-pod-10907943 not present 2025-04-28 01:37:48,779 - INFO - Creating Pod ctest-pod-10907943 2025-04-28 01:37:48,815 - DEBUG - Pod : ctest-pod-10907943 UUID is 29ff0b56-6fc6-4236-9cc0-6828680dadfb 2025-04-28 01:37:48,820 - DEBUG - Pod ctest-pod-48299649 not present 2025-04-28 01:37:48,821 - INFO - Creating Pod ctest-pod-48299649 2025-04-28 01:37:48,846 - DEBUG - Pod : ctest-pod-48299649 UUID is d12464bf-c6ec-4c11-8449-df177b061eab 2025-04-28 01:37:48,850 - DEBUG - Pod ctest-pod-07542115 not present 2025-04-28 01:37:48,850 - INFO - Creating Pod ctest-pod-07542115 2025-04-28 01:37:48,866 - DEBUG - Pod : ctest-pod-07542115 UUID is b5484090-1008-4a54-a1ac-dff59f958ec9 2025-04-28 01:37:49,167 - INFO - Project default-domain:k8s-ctest-new-default-62706730 for Namespace ctest-new-default-62706730 is seen in contrail-api 2025-04-28 01:37:49,167 - DEBUG - Project uuid in Contrail is 6c65692f-4193-4875-a293-81cf757843f2 2025-04-28 01:37:49,555 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=cb75ef30-1e58-47a8-b622-bc0c991707bb 2025-04-28 01:37:49,601 - INFO - Namespace ctest-new-default-62706730 with uuid cb75ef30-1e58-47a8-b622-bc0c991707bb found in kube manager 2025-04-28 01:37:49,602 - INFO - Namespace ctest-new-default-62706730 verification passed 2025-04-28 01:37:49,967 - INFO - Project default-domain:k8s-ctest-non-default-46326464 for Namespace ctest-non-default-46326464 is seen in contrail-api 2025-04-28 01:37:49,967 - DEBUG - Project uuid in Contrail is 40d43be5-bff8-48ed-956b-9b8cf8bb3bbf 2025-04-28 01:37:49,967 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=e79a119b-fbac-470c-9c3c-bf68429dfdb5 2025-04-28 01:37:49,971 - INFO - Namespace ctest-non-default-46326464 with uuid e79a119b-fbac-470c-9c3c-bf68429dfdb5 found in kube manager 2025-04-28 01:37:49,971 - INFO - Namespace ctest-non-default-46326464 verification passed 2025-04-28 01:37:49,977 - DEBUG - Pod ctest-pod-77670450 not in running state.Currently in Pending 2025-04-28 01:37:54,986 - DEBUG - Pod ctest-pod-77670450 not in running state.Currently in Pending 2025-04-28 01:37:59,993 - DEBUG - Pod ctest-pod-77670450 not in running state.Currently in Pending 2025-04-28 01:38:05,002 - INFO - Pod ctest-pod-77670450 is in running state.Got IP 10.47.255.250 2025-04-28 01:38:05,067 - DEBUG - Pod ctest-pod-77670450 has vmi 6620114a-23d1-11f0-a40e-0242efa707d2 2025-04-28 01:38:05,068 - INFO - Verified pod ctest-pod-77670450 in contrail-api 2025-04-28 01:38:05,083 - DEBUG - VMI 6620114a-23d1-11f0-a40e-0242efa707d2 is active in agent 10.0.0.22 2025-04-28 01:38:05,083 - INFO - Verified Pod ctest-pod-77670450 in agent 10.0.0.22 2025-04-28 01:38:05,083 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=a42c8e37-52ae-4b22-a037-6b14c6ac6d7e 2025-04-28 01:38:05,088 - INFO - Pod ctest-pod-77670450 with uuid a42c8e37-52ae-4b22-a037-6b14c6ac6d7e found in kube manager 2025-04-28 01:38:05,088 - INFO - Pod ctest-pod-77670450 verification passed 2025-04-28 01:38:05,095 - INFO - Pod ctest-pod-26765879 is in running state.Got IP 10.47.255.249 2025-04-28 01:38:05,190 - DEBUG - Pod ctest-pod-26765879 has vmi 66cfc4fa-23d1-11f0-a40e-0242efa707d2 2025-04-28 01:38:05,190 - INFO - Verified pod ctest-pod-26765879 in contrail-api 2025-04-28 01:38:05,202 - DEBUG - VMI 66cfc4fa-23d1-11f0-a40e-0242efa707d2 is active in agent 10.0.0.22 2025-04-28 01:38:05,202 - INFO - Verified Pod ctest-pod-26765879 in agent 10.0.0.22 2025-04-28 01:38:05,202 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=b1068fcd-5b85-4282-9a8d-02f5a9b14ffb 2025-04-28 01:38:05,206 - INFO - Pod ctest-pod-26765879 with uuid b1068fcd-5b85-4282-9a8d-02f5a9b14ffb found in kube manager 2025-04-28 01:38:05,206 - INFO - Pod ctest-pod-26765879 verification passed 2025-04-28 01:38:05,213 - DEBUG - Pod ctest-pod-80003030 not in running state.Currently in Pending 2025-04-28 01:38:10,219 - INFO - Pod ctest-pod-80003030 is in running state.Got IP 10.47.255.248 2025-04-28 01:38:10,273 - DEBUG - Pod ctest-pod-80003030 has vmi 67c8848c-23d1-11f0-a40e-0242efa707d2 2025-04-28 01:38:10,273 - INFO - Verified pod ctest-pod-80003030 in contrail-api 2025-04-28 01:38:10,284 - DEBUG - VMI 67c8848c-23d1-11f0-a40e-0242efa707d2 is active in agent 10.0.0.22 2025-04-28 01:38:10,284 - INFO - Verified Pod ctest-pod-80003030 in agent 10.0.0.22 2025-04-28 01:38:10,284 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=32a46b7e-78e9-4346-a314-04d75182b531 2025-04-28 01:38:10,288 - INFO - Pod ctest-pod-80003030 with uuid 32a46b7e-78e9-4346-a314-04d75182b531 found in kube manager 2025-04-28 01:38:10,288 - INFO - Pod ctest-pod-80003030 verification passed 2025-04-28 01:38:10,293 - INFO - Pod ctest-pod-71532304 is in running state.Got IP 10.47.255.247 2025-04-28 01:38:10,386 - DEBUG - Pod ctest-pod-71532304 has vmi 687b3744-23d1-11f0-a40e-0242efa707d2 2025-04-28 01:38:10,386 - INFO - Verified pod ctest-pod-71532304 in contrail-api 2025-04-28 01:38:10,407 - DEBUG - VMI 687b3744-23d1-11f0-a40e-0242efa707d2 is active in agent 10.0.0.22 2025-04-28 01:38:10,408 - INFO - Verified Pod ctest-pod-71532304 in agent 10.0.0.22 2025-04-28 01:38:10,408 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=13cf0d34-9673-4918-b21b-19fa40fc8d52 2025-04-28 01:38:10,414 - INFO - Pod ctest-pod-71532304 with uuid 13cf0d34-9673-4918-b21b-19fa40fc8d52 found in kube manager 2025-04-28 01:38:10,414 - INFO - Pod ctest-pod-71532304 verification passed 2025-04-28 01:38:10,421 - INFO - Pod ctest-pod-10429126 is in running state.Got IP 10.47.255.246 2025-04-28 01:38:10,519 - DEBUG - Pod ctest-pod-10429126 has vmi 694312be-23d1-11f0-a40e-0242efa707d2 2025-04-28 01:38:10,519 - INFO - Verified pod ctest-pod-10429126 in contrail-api 2025-04-28 01:38:10,530 - DEBUG - VMI 694312be-23d1-11f0-a40e-0242efa707d2 is active in agent 10.0.0.22 2025-04-28 01:38:10,530 - INFO - Verified Pod ctest-pod-10429126 in agent 10.0.0.22 2025-04-28 01:38:10,530 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=db55897a-e8c7-4948-9519-91793aae53af 2025-04-28 01:38:10,534 - INFO - Pod ctest-pod-10429126 with uuid db55897a-e8c7-4948-9519-91793aae53af found in kube manager 2025-04-28 01:38:10,534 - INFO - Pod ctest-pod-10429126 verification passed 2025-04-28 01:38:10,540 - INFO - Pod ctest-pod-48299649 is in running state.Got IP 10.47.255.244 2025-04-28 01:38:10,634 - DEBUG - Pod ctest-pod-48299649 has vmi 6ad0db34-23d1-11f0-a40e-0242efa707d2 2025-04-28 01:38:10,634 - INFO - Verified pod ctest-pod-48299649 in contrail-api 2025-04-28 01:38:10,645 - DEBUG - VMI 6ad0db34-23d1-11f0-a40e-0242efa707d2 is active in agent 10.0.0.22 2025-04-28 01:38:10,645 - INFO - Verified Pod ctest-pod-48299649 in agent 10.0.0.22 2025-04-28 01:38:10,645 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=d12464bf-c6ec-4c11-8449-df177b061eab 2025-04-28 01:38:10,649 - INFO - Pod ctest-pod-48299649 with uuid d12464bf-c6ec-4c11-8449-df177b061eab found in kube manager 2025-04-28 01:38:10,649 - INFO - Pod ctest-pod-48299649 verification passed 2025-04-28 01:38:10,654 - INFO - Pod ctest-pod-10907943 is in running state.Got IP 10.47.255.245 2025-04-28 01:38:10,747 - DEBUG - Pod ctest-pod-10907943 has vmi 6a074bfc-23d1-11f0-a40e-0242efa707d2 2025-04-28 01:38:10,747 - INFO - Verified pod ctest-pod-10907943 in contrail-api 2025-04-28 01:38:10,758 - DEBUG - VMI 6a074bfc-23d1-11f0-a40e-0242efa707d2 is active in agent 10.0.0.22 2025-04-28 01:38:10,759 - INFO - Verified Pod ctest-pod-10907943 in agent 10.0.0.22 2025-04-28 01:38:10,759 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=29ff0b56-6fc6-4236-9cc0-6828680dadfb 2025-04-28 01:38:10,763 - INFO - Pod ctest-pod-10907943 with uuid 29ff0b56-6fc6-4236-9cc0-6828680dadfb found in kube manager 2025-04-28 01:38:10,763 - INFO - Pod ctest-pod-10907943 verification passed 2025-04-28 01:38:10,768 - INFO - Pod ctest-pod-07542115 is in running state.Got IP 10.47.255.243 2025-04-28 01:38:10,861 - DEBUG - Pod ctest-pod-07542115 has vmi 6ba0c448-23d1-11f0-a40e-0242efa707d2 2025-04-28 01:38:10,861 - INFO - Verified pod ctest-pod-07542115 in contrail-api 2025-04-28 01:38:10,872 - DEBUG - VMI 6ba0c448-23d1-11f0-a40e-0242efa707d2 is active in agent 10.0.0.22 2025-04-28 01:38:10,872 - INFO - Verified Pod ctest-pod-07542115 in agent 10.0.0.22 2025-04-28 01:38:10,872 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=b5484090-1008-4a54-a1ac-dff59f958ec9 2025-04-28 01:38:10,876 - INFO - Pod ctest-pod-07542115 with uuid b5484090-1008-4a54-a1ac-dff59f958ec9 found in kube manager 2025-04-28 01:38:10,876 - INFO - Pod ctest-pod-07542115 verification passed 2025-04-28 01:38:10,876 - INFO - ================================================================================ 2025-04-28 01:38:10,876 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-04-28 01:38:10,876 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-04-28 01:38:11,117 - DEBUG - Nothing to compare xmpp stats {'10.0.0.22': {'10.0.0.22': '3'}} with 2025-04-28 01:38:11,118 - INFO - Initial checks done. Running the testcase now 2025-04-28 01:38:11,118 - INFO - 2025-04-28 01:38:11,182 - DEBUG - [Pod ctest-pod-77670450] Cmd: echo ctest-pod-77670450 > /usr/share/nginx/html/index.html, Output: 2025-04-28 01:38:11,253 - DEBUG - [Pod ctest-pod-26765879] Cmd: echo ctest-pod-26765879 > /usr/share/nginx/html/index.html, Output: 2025-04-28 01:38:11,320 - DEBUG - [Pod ctest-pod-80003030] Cmd: echo ctest-pod-80003030 > /usr/share/nginx/html/index.html, Output: 2025-04-28 01:38:11,390 - DEBUG - [Pod ctest-pod-71532304] Cmd: echo ctest-pod-71532304 > /usr/share/nginx/html/index.html, Output: 2025-04-28 01:38:11,394 - DEBUG - Service ctest-nginx-svc-97983410 not present 2025-04-28 01:38:11,394 - INFO - Creating service ctest-nginx-svc-97983410 2025-04-28 01:38:11,405 - INFO - Created Service ctest-nginx-svc-97983410 2025-04-28 01:38:11,411 - WARNING - Service UUID f6c6866f-5694-4811-b3e8-cdbde758c43d not yet found in contrail-api 2025-04-28 01:38:12,418 - INFO - Validated that Service ctest-nginx-svc-97983410 is seen in contrail-api 2025-04-28 01:38:12,418 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_LoadbalancerDatabaseList?x=f6c6866f-5694-4811-b3e8-cdbde758c43d 2025-04-28 01:38:12,425 - INFO - Service ctest-nginx-svc-97983410 with uuid f6c6866f-5694-4811-b3e8-cdbde758c43d found in kube manager 2025-04-28 01:38:12,425 - INFO - Service ctest-nginx-svc-97983410 verification passed 2025-04-28 01:38:13,582 - DEBUG - [Pod ctest-pod-10429126] Cmd: wget http://10.98.159.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.159.87:80 (10.98.159.87:80) writing to stdout ctest-pod-77670450 - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-28 01:38:13,582 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd wget http://10.98.159.87:80/ -O - -T 5 -t 1 passed 2025-04-28 01:38:13,583 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd output: Connecting to 10.98.159.87:80 (10.98.159.87:80) writing to stdout ctest-pod-77670450 - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-28 01:38:13,651 - DEBUG - [Pod ctest-pod-10429126] Cmd: wget http://10.98.159.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.159.87:80 (10.98.159.87:80) ctest-pod-77670450 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-28 01:38:13,651 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd wget http://10.98.159.87:80/ -O - -T 5 -t 1 passed 2025-04-28 01:38:13,651 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd output: Connecting to 10.98.159.87:80 (10.98.159.87:80) ctest-pod-77670450 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-28 01:38:13,716 - DEBUG - [Pod ctest-pod-10429126] Cmd: wget http://10.98.159.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.159.87:80 (10.98.159.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-77670450 2025-04-28 01:38:13,716 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd wget http://10.98.159.87:80/ -O - -T 5 -t 1 passed 2025-04-28 01:38:13,716 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd output: Connecting to 10.98.159.87:80 (10.98.159.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-77670450 2025-04-28 01:38:13,780 - DEBUG - [Pod ctest-pod-10429126] Cmd: wget http://10.98.159.87:80/ -O - -T 5 -t 1 , Output: ctest-pod-77670450 Connecting to 10.98.159.87:80 (10.98.159.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-28 01:38:13,780 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd wget http://10.98.159.87:80/ -O - -T 5 -t 1 passed 2025-04-28 01:38:13,780 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd output: ctest-pod-77670450 Connecting to 10.98.159.87:80 (10.98.159.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-28 01:38:13,858 - DEBUG - [Pod ctest-pod-10429126] Cmd: wget http://10.98.159.87:80/ -O - -T 5 -t 1 , Output: ctest-pod-26765879 Connecting to 10.98.159.87:80 (10.98.159.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-28 01:38:13,859 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd wget http://10.98.159.87:80/ -O - -T 5 -t 1 passed 2025-04-28 01:38:13,859 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd output: ctest-pod-26765879 Connecting to 10.98.159.87:80 (10.98.159.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-28 01:38:13,859 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-77670450': 4, 'ctest-pod-26765879': 1} 2025-04-28 01:38:13,943 - DEBUG - [Pod ctest-pod-48299649] Cmd: wget http://10.98.159.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.159.87:80 (10.98.159.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-77670450 2025-04-28 01:38:13,944 - DEBUG - [Pod Pod ctest-pod-48299649] Cmd wget http://10.98.159.87:80/ -O - -T 5 -t 1 passed 2025-04-28 01:38:13,944 - DEBUG - [Pod Pod ctest-pod-48299649] Cmd output: Connecting to 10.98.159.87:80 (10.98.159.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-77670450 2025-04-28 01:38:14,009 - DEBUG - [Pod ctest-pod-48299649] Cmd: wget http://10.98.159.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.159.87:80 (10.98.159.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA ctest-pod-26765879 written to stdout 2025-04-28 01:38:14,009 - DEBUG - [Pod Pod ctest-pod-48299649] Cmd wget http://10.98.159.87:80/ -O - -T 5 -t 1 passed 2025-04-28 01:38:14,010 - DEBUG - [Pod Pod ctest-pod-48299649] Cmd output: Connecting to 10.98.159.87:80 (10.98.159.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA ctest-pod-26765879 written to stdout 2025-04-28 01:38:14,010 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-77670450': 1, 'ctest-pod-26765879': 1} 2025-04-28 01:38:14,013 - DEBUG - Network policy ingress-on-service not present 2025-04-28 01:38:14,013 - INFO - Creating Network Policy ingress-on-service 2025-04-28 01:38:14,026 - INFO - Network policy found in k8s 2025-04-28 01:38:14,026 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=9d829c26-cdfa-4709-8e22-26579f744d0a 2025-04-28 01:38:14,031 - INFO - Network Policy ingress-on-service with uuid 9d829c26-cdfa-4709-8e22-26579f744d0a found in kube manager 2025-04-28 01:38:14,119 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-04-28 01:38:14,120 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-04-28 01:38:14,120 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=9d829c26-cdfa-4709-8e22-26579f744d0a 2025-04-28 01:38:14,146 - WARNING - Network policy with name ingress-on-service not found in agent 2025-04-28 01:38:16,147 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=9d829c26-cdfa-4709-8e22-26579f744d0a 2025-04-28 01:38:16,182 - WARNING - Network policy with name ingress-on-service not found in agent 2025-04-28 01:38:18,183 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=9d829c26-cdfa-4709-8e22-26579f744d0a 2025-04-28 01:38:18,209 - INFO - Network policy with name ingress-on-service found in agent 2025-04-28 01:38:18,209 - INFO - Network Policy ingress-on-service verification passed 2025-04-28 01:38:23,285 - DEBUG - [Pod ctest-pod-10429126] Cmd: wget http://10.98.159.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:38:23,285 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd wget http://10.98.159.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:38:23,285 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:38:28,370 - DEBUG - [Pod ctest-pod-10429126] Cmd: wget http://10.98.159.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:38:28,370 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd wget http://10.98.159.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:38:28,370 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:38:33,456 - DEBUG - [Pod ctest-pod-10429126] Cmd: wget http://10.98.159.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:38:33,456 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd wget http://10.98.159.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:38:33,456 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:38:38,521 - DEBUG - [Pod ctest-pod-10429126] Cmd: wget http://10.98.159.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:38:38,522 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd wget http://10.98.159.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:38:38,522 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:38:43,583 - DEBUG - [Pod ctest-pod-10429126] Cmd: wget http://10.98.159.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:38:43,584 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd wget http://10.98.159.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:38:43,584 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:38:48,656 - DEBUG - [Pod ctest-pod-10429126] Cmd: wget http://10.98.159.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:38:48,656 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd wget http://10.98.159.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:38:48,656 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:38:53,716 - DEBUG - [Pod ctest-pod-10429126] Cmd: wget http://10.98.159.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:38:53,716 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd wget http://10.98.159.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:38:53,716 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:38:58,786 - DEBUG - [Pod ctest-pod-10429126] Cmd: wget http://10.98.159.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:38:58,786 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd wget http://10.98.159.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:38:58,786 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:39:03,857 - DEBUG - [Pod ctest-pod-10429126] Cmd: wget http://10.98.159.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:39:03,857 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd wget http://10.98.159.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:39:03,858 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:39:08,927 - DEBUG - [Pod ctest-pod-10429126] Cmd: wget http://10.98.159.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:39:08,927 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd wget http://10.98.159.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:39:08,927 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:39:08,927 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-77670450': 0, 'ctest-pod-26765879': 0} 2025-04-28 01:39:08,999 - DEBUG - [Pod ctest-pod-10907943] Cmd: wget http://10.98.159.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.159.87:80 (10.98.159.87:80) ctest-pod-26765879 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-28 01:39:08,999 - DEBUG - [Pod Pod ctest-pod-10907943] Cmd wget http://10.98.159.87:80/ -O - -T 5 -t 1 passed 2025-04-28 01:39:08,999 - DEBUG - [Pod Pod ctest-pod-10907943] Cmd output: Connecting to 10.98.159.87:80 (10.98.159.87:80) ctest-pod-26765879 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-28 01:39:09,067 - DEBUG - [Pod ctest-pod-10907943] Cmd: wget http://10.98.159.87:80/ -O - -T 5 -t 1 , Output: ctest-pod-77670450 Connecting to 10.98.159.87:80 (10.98.159.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-28 01:39:09,067 - DEBUG - [Pod Pod ctest-pod-10907943] Cmd wget http://10.98.159.87:80/ -O - -T 5 -t 1 passed 2025-04-28 01:39:09,067 - DEBUG - [Pod Pod ctest-pod-10907943] Cmd output: ctest-pod-77670450 Connecting to 10.98.159.87:80 (10.98.159.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-28 01:39:09,067 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-77670450': 1, 'ctest-pod-26765879': 1} 2025-04-28 01:39:14,130 - DEBUG - [Pod ctest-pod-48299649] Cmd: wget http://10.98.159.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:39:14,130 - DEBUG - [Pod Pod ctest-pod-48299649] Cmd wget http://10.98.159.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:39:14,130 - DEBUG - [Pod Pod ctest-pod-48299649] Cmd output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:39:19,196 - DEBUG - [Pod ctest-pod-48299649] Cmd: wget http://10.98.159.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:39:19,197 - DEBUG - [Pod Pod ctest-pod-48299649] Cmd wget http://10.98.159.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:39:19,197 - DEBUG - [Pod Pod ctest-pod-48299649] Cmd output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:39:24,268 - DEBUG - [Pod ctest-pod-48299649] Cmd: wget http://10.98.159.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:39:24,268 - DEBUG - [Pod Pod ctest-pod-48299649] Cmd wget http://10.98.159.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:39:24,268 - DEBUG - [Pod Pod ctest-pod-48299649] Cmd output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:39:29,384 - DEBUG - [Pod ctest-pod-48299649] Cmd: wget http://10.98.159.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:39:29,384 - DEBUG - [Pod Pod ctest-pod-48299649] Cmd wget http://10.98.159.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:39:29,384 - DEBUG - [Pod Pod ctest-pod-48299649] Cmd output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:39:34,458 - DEBUG - [Pod ctest-pod-48299649] Cmd: wget http://10.98.159.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:39:34,458 - DEBUG - [Pod Pod ctest-pod-48299649] Cmd wget http://10.98.159.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:39:34,458 - DEBUG - [Pod Pod ctest-pod-48299649] Cmd output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:39:39,532 - DEBUG - [Pod ctest-pod-48299649] Cmd: wget http://10.98.159.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:39:39,532 - DEBUG - [Pod Pod ctest-pod-48299649] Cmd wget http://10.98.159.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:39:39,532 - DEBUG - [Pod Pod ctest-pod-48299649] Cmd output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:39:44,608 - DEBUG - [Pod ctest-pod-48299649] Cmd: wget http://10.98.159.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:39:44,608 - DEBUG - [Pod Pod ctest-pod-48299649] Cmd wget http://10.98.159.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:39:44,608 - DEBUG - [Pod Pod ctest-pod-48299649] Cmd output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:39:49,682 - DEBUG - [Pod ctest-pod-48299649] Cmd: wget http://10.98.159.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:39:49,682 - DEBUG - [Pod Pod ctest-pod-48299649] Cmd wget http://10.98.159.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:39:49,682 - DEBUG - [Pod Pod ctest-pod-48299649] Cmd output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:39:54,752 - DEBUG - [Pod ctest-pod-48299649] Cmd: wget http://10.98.159.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:39:54,752 - DEBUG - [Pod Pod ctest-pod-48299649] Cmd wget http://10.98.159.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:39:54,752 - DEBUG - [Pod Pod ctest-pod-48299649] Cmd output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:39:59,816 - DEBUG - [Pod ctest-pod-48299649] Cmd: wget http://10.98.159.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:39:59,816 - DEBUG - [Pod Pod ctest-pod-48299649] Cmd wget http://10.98.159.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:39:59,816 - DEBUG - [Pod Pod ctest-pod-48299649] Cmd output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:39:59,816 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-77670450': 0, 'ctest-pod-26765879': 0} 2025-04-28 01:40:01,888 - DEBUG - [Pod ctest-pod-10907943] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.754 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.052 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.066 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.052/0.290/0.754 ms 2025-04-28 01:40:01,888 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-10907943 with expectation True passed 2025-04-28 01:40:03,958 - DEBUG - [Pod ctest-pod-10429126] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.785 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.053 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.062 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.053/0.300/0.785 ms 2025-04-28 01:40:03,958 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-10429126 with expectation True passed 2025-04-28 01:40:06,032 - DEBUG - [Pod ctest-pod-48299649] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.832 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.078 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.098 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.078/0.336/0.832 ms 2025-04-28 01:40:06,032 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-48299649 with expectation True passed 2025-04-28 01:40:06,104 - DEBUG - [Pod ctest-pod-10907943] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-28 01:40:06,104 - DEBUG - [Pod Pod ctest-pod-10907943] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-04-28 01:40:06,105 - DEBUG - [Pod Pod ctest-pod-10907943] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-28 01:40:06,105 - INFO - wget check of of http://10.47.255.250 from ctest-pod-10907943 passed 2025-04-28 01:40:06,174 - DEBUG - [Pod ctest-pod-10907943] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-28 01:40:06,175 - DEBUG - [Pod Pod ctest-pod-10907943] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 passed 2025-04-28 01:40:06,175 - DEBUG - [Pod Pod ctest-pod-10907943] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-28 01:40:06,175 - INFO - wget check of of http://10.47.255.249 from ctest-pod-10907943 passed 2025-04-28 01:40:11,239 - DEBUG - [Pod ctest-pod-10429126] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2025-04-28 01:40:11,239 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2025-04-28 01:40:11,239 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2025-04-28 01:40:11,239 - INFO - wget check of of http://10.47.255.249 from ctest-pod-10429126 passed 2025-04-28 01:40:16,305 - DEBUG - [Pod ctest-pod-07542115] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-04-28 01:40:16,305 - DEBUG - [Pod Pod ctest-pod-07542115] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-04-28 01:40:16,305 - DEBUG - [Pod Pod ctest-pod-07542115] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-04-28 01:40:16,305 - INFO - wget check of of http://10.47.255.250 from ctest-pod-07542115 passed 2025-04-28 01:40:16,317 - INFO - Updating Network Policy ingress-on-service 2025-04-28 01:40:21,396 - DEBUG - [Pod ctest-pod-10429126] Cmd: wget http://10.98.159.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:40:21,396 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd wget http://10.98.159.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:40:21,396 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:40:26,460 - DEBUG - [Pod ctest-pod-10429126] Cmd: wget http://10.98.159.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:40:26,460 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd wget http://10.98.159.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:40:26,460 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:40:31,580 - DEBUG - [Pod ctest-pod-10429126] Cmd: wget http://10.98.159.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:40:31,580 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd wget http://10.98.159.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:40:31,580 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:40:36,655 - DEBUG - [Pod ctest-pod-10429126] Cmd: wget http://10.98.159.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:40:36,655 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd wget http://10.98.159.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:40:36,655 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:40:41,726 - DEBUG - [Pod ctest-pod-10429126] Cmd: wget http://10.98.159.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:40:41,727 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd wget http://10.98.159.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:40:41,727 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:40:46,810 - DEBUG - [Pod ctest-pod-10429126] Cmd: wget http://10.98.159.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:40:46,810 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd wget http://10.98.159.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:40:46,810 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:40:51,894 - DEBUG - [Pod ctest-pod-10429126] Cmd: wget http://10.98.159.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:40:51,894 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd wget http://10.98.159.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:40:51,894 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:40:56,984 - DEBUG - [Pod ctest-pod-10429126] Cmd: wget http://10.98.159.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:40:56,985 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd wget http://10.98.159.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:40:56,985 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:41:02,048 - DEBUG - [Pod ctest-pod-10429126] Cmd: wget http://10.98.159.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:41:02,048 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd wget http://10.98.159.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:41:02,048 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:41:07,119 - DEBUG - [Pod ctest-pod-10429126] Cmd: wget http://10.98.159.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:41:07,119 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd wget http://10.98.159.87:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:41:07,120 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd output: Connecting to 10.98.159.87:80 (10.98.159.87:80) wget: download timed out 2025-04-28 01:41:07,120 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-77670450': 0, 'ctest-pod-26765879': 0} 2025-04-28 01:41:07,198 - DEBUG - [Pod ctest-pod-10907943] Cmd: wget http://10.98.159.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.159.87:80 (10.98.159.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-26765879 2025-04-28 01:41:07,198 - DEBUG - [Pod Pod ctest-pod-10907943] Cmd wget http://10.98.159.87:80/ -O - -T 5 -t 1 passed 2025-04-28 01:41:07,198 - DEBUG - [Pod Pod ctest-pod-10907943] Cmd output: Connecting to 10.98.159.87:80 (10.98.159.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-26765879 2025-04-28 01:41:07,265 - DEBUG - [Pod ctest-pod-10907943] Cmd: wget http://10.98.159.87:80/ -O - -T 5 -t 1 , Output: ctest-pod-77670450 Connecting to 10.98.159.87:80 (10.98.159.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-28 01:41:07,265 - DEBUG - [Pod Pod ctest-pod-10907943] Cmd wget http://10.98.159.87:80/ -O - -T 5 -t 1 passed 2025-04-28 01:41:07,265 - DEBUG - [Pod Pod ctest-pod-10907943] Cmd output: ctest-pod-77670450 Connecting to 10.98.159.87:80 (10.98.159.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-28 01:41:07,265 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-77670450': 1, 'ctest-pod-26765879': 1} 2025-04-28 01:41:07,334 - DEBUG - [Pod ctest-pod-48299649] Cmd: wget http://10.98.159.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.159.87:80 (10.98.159.87:80) ctest-pod-77670450 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-28 01:41:07,334 - DEBUG - [Pod Pod ctest-pod-48299649] Cmd wget http://10.98.159.87:80/ -O - -T 5 -t 1 passed 2025-04-28 01:41:07,334 - DEBUG - [Pod Pod ctest-pod-48299649] Cmd output: Connecting to 10.98.159.87:80 (10.98.159.87:80) ctest-pod-77670450 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-28 01:41:07,406 - DEBUG - [Pod ctest-pod-48299649] Cmd: wget http://10.98.159.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.159.87:80 (10.98.159.87:80) ctest-pod-77670450 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-28 01:41:07,406 - DEBUG - [Pod Pod ctest-pod-48299649] Cmd wget http://10.98.159.87:80/ -O - -T 5 -t 1 passed 2025-04-28 01:41:07,406 - DEBUG - [Pod Pod ctest-pod-48299649] Cmd output: Connecting to 10.98.159.87:80 (10.98.159.87:80) ctest-pod-77670450 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-28 01:41:07,472 - DEBUG - [Pod ctest-pod-48299649] Cmd: wget http://10.98.159.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.159.87:80 (10.98.159.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-77670450 2025-04-28 01:41:07,472 - DEBUG - [Pod Pod ctest-pod-48299649] Cmd wget http://10.98.159.87:80/ -O - -T 5 -t 1 passed 2025-04-28 01:41:07,473 - DEBUG - [Pod Pod ctest-pod-48299649] Cmd output: Connecting to 10.98.159.87:80 (10.98.159.87:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-77670450 2025-04-28 01:41:07,551 - DEBUG - [Pod ctest-pod-48299649] Cmd: wget http://10.98.159.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.159.87:80 (10.98.159.87:80) ctest-pod-77670450 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-28 01:41:07,552 - DEBUG - [Pod Pod ctest-pod-48299649] Cmd wget http://10.98.159.87:80/ -O - -T 5 -t 1 passed 2025-04-28 01:41:07,552 - DEBUG - [Pod Pod ctest-pod-48299649] Cmd output: Connecting to 10.98.159.87:80 (10.98.159.87:80) ctest-pod-77670450 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-28 01:41:07,633 - DEBUG - [Pod ctest-pod-48299649] Cmd: wget http://10.98.159.87:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.159.87:80 (10.98.159.87:80) ctest-pod-26765879 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-28 01:41:07,634 - DEBUG - [Pod Pod ctest-pod-48299649] Cmd wget http://10.98.159.87:80/ -O - -T 5 -t 1 passed 2025-04-28 01:41:07,634 - DEBUG - [Pod Pod ctest-pod-48299649] Cmd output: Connecting to 10.98.159.87:80 (10.98.159.87:80) ctest-pod-26765879 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-04-28 01:41:07,634 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-77670450': 4, 'ctest-pod-26765879': 1} 2025-04-28 01:41:09,710 - DEBUG - [Pod ctest-pod-10907943] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.651 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.049 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.051 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.049/0.250/0.651 ms 2025-04-28 01:41:09,710 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-10907943 with expectation True passed 2025-04-28 01:41:11,789 - DEBUG - [Pod ctest-pod-10429126] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=1.632 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.051 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.073 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.051/0.585/1.632 ms 2025-04-28 01:41:11,789 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-10429126 with expectation True passed 2025-04-28 01:41:13,865 - DEBUG - [Pod ctest-pod-48299649] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.404 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.061 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.066 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.061/0.177/0.404 ms 2025-04-28 01:41:13,865 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-48299649 with expectation True passed 2025-04-28 01:41:14,038 - DEBUG - [Pod ctest-pod-10907943] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-28 01:41:14,038 - DEBUG - [Pod Pod ctest-pod-10907943] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-04-28 01:41:14,038 - DEBUG - [Pod Pod ctest-pod-10907943] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-28 01:41:14,038 - INFO - wget check of of http://10.47.255.250 from ctest-pod-10907943 passed 2025-04-28 01:41:14,119 - DEBUG - [Pod ctest-pod-10907943] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-28 01:41:14,119 - DEBUG - [Pod Pod ctest-pod-10907943] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 passed 2025-04-28 01:41:14,119 - DEBUG - [Pod Pod ctest-pod-10907943] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-28 01:41:14,119 - INFO - wget check of of http://10.47.255.249 from ctest-pod-10907943 passed 2025-04-28 01:41:19,188 - DEBUG - [Pod ctest-pod-10429126] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2025-04-28 01:41:19,188 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2025-04-28 01:41:19,188 - DEBUG - [Pod Pod ctest-pod-10429126] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2025-04-28 01:41:19,188 - INFO - wget check of of http://10.47.255.249 from ctest-pod-10429126 passed 2025-04-28 01:41:19,259 - DEBUG - [Pod ctest-pod-07542115] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-28 01:41:19,259 - DEBUG - [Pod Pod ctest-pod-07542115] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-04-28 01:41:19,260 - DEBUG - [Pod Pod ctest-pod-07542115] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-04-28 01:41:19,260 - INFO - wget check of of http://10.47.255.250 from ctest-pod-07542115 passed 2025-04-28 01:41:19,260 - INFO - Deleting Network Policy : ingress-on-service 2025-04-28 01:41:19,260 - INFO - Deleting service : ctest-nginx-svc-97983410 2025-04-28 01:41:19,737 - DEBUG - No XMPP flaps were noticed during the test