2024-10-25 16:58:08,033 - INFO - Using existing project ['default-domain', 'k8s-default'](f4cc8171-aaab-4c57-ad89-b5047c1bb448) 2024-10-25 16:58:08,057 - DEBUG - Namespace ctest-new-default-13582465 not present 2024-10-25 16:58:08,082 - INFO - Created namespace ctest-new-default-13582465 2024-10-25 16:58:11,088 - DEBUG - Namespace ctest-non-default-61868654 not present 2024-10-25 16:58:11,105 - INFO - Created namespace ctest-non-default-61868654 2024-10-25 16:58:14,121 - DEBUG - Pod ctest-pod-44428971 not present 2024-10-25 16:58:14,122 - INFO - Creating Pod ctest-pod-44428971 2024-10-25 16:58:14,152 - DEBUG - Pod : ctest-pod-44428971 UUID is 270fcd4e-4c62-4d65-89b9-3ee0a67fca8a 2024-10-25 16:58:14,168 - DEBUG - Pod ctest-pod-39245976 not present 2024-10-25 16:58:14,169 - INFO - Creating Pod ctest-pod-39245976 2024-10-25 16:58:14,206 - DEBUG - Pod : ctest-pod-39245976 UUID is 95d1f00f-6ad8-410e-b67d-df466603f63e 2024-10-25 16:58:14,213 - DEBUG - Pod ctest-pod-89979937 not present 2024-10-25 16:58:14,214 - INFO - Creating Pod ctest-pod-89979937 2024-10-25 16:58:14,235 - DEBUG - Pod : ctest-pod-89979937 UUID is 34da2e5c-9bae-4ee6-b8c7-3fe7278d4519 2024-10-25 16:58:14,238 - DEBUG - Pod ctest-pod-78928809 not present 2024-10-25 16:58:14,238 - INFO - Creating Pod ctest-pod-78928809 2024-10-25 16:58:14,286 - DEBUG - Pod : ctest-pod-78928809 UUID is 54a33163-c5fc-4d24-90be-eeace64f6208 2024-10-25 16:58:14,289 - DEBUG - Pod ctest-pod-15444014 not present 2024-10-25 16:58:14,289 - INFO - Creating Pod ctest-pod-15444014 2024-10-25 16:58:14,312 - DEBUG - Pod : ctest-pod-15444014 UUID is 85a8281c-9462-4888-8189-31a8b4416023 2024-10-25 16:58:14,315 - DEBUG - Pod ctest-pod-97001651 not present 2024-10-25 16:58:14,315 - INFO - Creating Pod ctest-pod-97001651 2024-10-25 16:58:14,337 - DEBUG - Pod : ctest-pod-97001651 UUID is 972eee5d-c456-4625-b795-f1221513b948 2024-10-25 16:58:14,341 - DEBUG - Pod ctest-pod-18876825 not present 2024-10-25 16:58:14,341 - INFO - Creating Pod ctest-pod-18876825 2024-10-25 16:58:14,362 - DEBUG - Pod : ctest-pod-18876825 UUID is ee2ece6a-b4bc-4d4d-a9d5-d0d1719e2eb8 2024-10-25 16:58:14,365 - DEBUG - Pod ctest-pod-71294308 not present 2024-10-25 16:58:14,365 - INFO - Creating Pod ctest-pod-71294308 2024-10-25 16:58:14,387 - DEBUG - Pod : ctest-pod-71294308 UUID is 7df05a5c-733b-4283-b174-1aea71a9782e 2024-10-25 16:58:14,596 - INFO - Project default-domain:k8s-ctest-new-default-13582465 for Namespace ctest-new-default-13582465 is seen in contrail-api 2024-10-25 16:58:14,596 - DEBUG - Project uuid in Contrail is 12345adf-b094-4a2c-b632-8506d80e494f 2024-10-25 16:58:14,792 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=8a13412b-c376-4b73-9492-b549495bbf91 2024-10-25 16:58:14,797 - INFO - Namespace ctest-new-default-13582465 with uuid 8a13412b-c376-4b73-9492-b549495bbf91 found in kube manager 2024-10-25 16:58:14,797 - INFO - Namespace ctest-new-default-13582465 verification passed 2024-10-25 16:58:14,976 - INFO - Project default-domain:k8s-ctest-non-default-61868654 for Namespace ctest-non-default-61868654 is seen in contrail-api 2024-10-25 16:58:14,977 - DEBUG - Project uuid in Contrail is c1e54fe8-1624-4e1f-b6a0-e322e703448d 2024-10-25 16:58:14,977 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=0a233492-eb9b-476b-868f-a8661a522caa 2024-10-25 16:58:14,983 - INFO - Namespace ctest-non-default-61868654 with uuid 0a233492-eb9b-476b-868f-a8661a522caa found in kube manager 2024-10-25 16:58:14,984 - INFO - Namespace ctest-non-default-61868654 verification passed 2024-10-25 16:58:14,992 - DEBUG - Pod ctest-pod-44428971 not in running state.Currently in Pending 2024-10-25 16:58:20,005 - DEBUG - Pod ctest-pod-44428971 not in running state.Currently in Pending 2024-10-25 16:58:25,013 - INFO - Pod ctest-pod-44428971 is in running state.Got IP 10.47.255.251 2024-10-25 16:58:25,089 - DEBUG - Pod ctest-pod-44428971 has vmi 54255e52-92f2-11ef-83e4-fa163eb33011 2024-10-25 16:58:25,089 - INFO - Verified pod ctest-pod-44428971 in contrail-api 2024-10-25 16:58:25,111 - DEBUG - VMI 54255e52-92f2-11ef-83e4-fa163eb33011 is active in agent 10.0.0.42 2024-10-25 16:58:25,112 - INFO - Verified Pod ctest-pod-44428971 in agent 10.0.0.42 2024-10-25 16:58:25,113 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=270fcd4e-4c62-4d65-89b9-3ee0a67fca8a 2024-10-25 16:58:25,140 - INFO - Pod ctest-pod-44428971 with uuid 270fcd4e-4c62-4d65-89b9-3ee0a67fca8a found in kube manager 2024-10-25 16:58:25,140 - INFO - Pod ctest-pod-44428971 verification passed 2024-10-25 16:58:25,147 - DEBUG - Pod ctest-pod-39245976 not in running state.Currently in Pending 2024-10-25 16:58:30,155 - INFO - Pod ctest-pod-39245976 is in running state.Got IP 10.47.255.250 2024-10-25 16:58:30,176 - DEBUG - Pod ctest-pod-39245976 has vmi 54bdbfda-92f2-11ef-83e4-fa163eb33011 2024-10-25 16:58:30,176 - INFO - Verified pod ctest-pod-39245976 in contrail-api 2024-10-25 16:58:30,195 - DEBUG - VMI 54bdbfda-92f2-11ef-83e4-fa163eb33011 is active in agent 10.0.0.42 2024-10-25 16:58:30,196 - INFO - Verified Pod ctest-pod-39245976 in agent 10.0.0.42 2024-10-25 16:58:30,196 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=95d1f00f-6ad8-410e-b67d-df466603f63e 2024-10-25 16:58:30,203 - INFO - Pod ctest-pod-39245976 with uuid 95d1f00f-6ad8-410e-b67d-df466603f63e found in kube manager 2024-10-25 16:58:30,203 - INFO - Pod ctest-pod-39245976 verification passed 2024-10-25 16:58:30,210 - INFO - Pod ctest-pod-89979937 is in running state.Got IP 10.47.255.249 2024-10-25 16:58:30,273 - DEBUG - Pod ctest-pod-89979937 has vmi 55887b12-92f2-11ef-83e4-fa163eb33011 2024-10-25 16:58:30,273 - INFO - Verified pod ctest-pod-89979937 in contrail-api 2024-10-25 16:58:30,290 - DEBUG - VMI 55887b12-92f2-11ef-83e4-fa163eb33011 is active in agent 10.0.0.42 2024-10-25 16:58:30,291 - INFO - Verified Pod ctest-pod-89979937 in agent 10.0.0.42 2024-10-25 16:58:30,291 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=34da2e5c-9bae-4ee6-b8c7-3fe7278d4519 2024-10-25 16:58:30,297 - INFO - Pod ctest-pod-89979937 with uuid 34da2e5c-9bae-4ee6-b8c7-3fe7278d4519 found in kube manager 2024-10-25 16:58:30,297 - INFO - Pod ctest-pod-89979937 verification passed 2024-10-25 16:58:30,303 - INFO - Pod ctest-pod-78928809 is in running state.Got IP 10.47.255.248 2024-10-25 16:58:30,325 - DEBUG - Pod ctest-pod-78928809 has vmi 56280fb0-92f2-11ef-83e4-fa163eb33011 2024-10-25 16:58:30,326 - INFO - Verified pod ctest-pod-78928809 in contrail-api 2024-10-25 16:58:30,339 - DEBUG - VMI 56280fb0-92f2-11ef-83e4-fa163eb33011 is active in agent 10.0.0.42 2024-10-25 16:58:30,340 - INFO - Verified Pod ctest-pod-78928809 in agent 10.0.0.42 2024-10-25 16:58:30,340 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=54a33163-c5fc-4d24-90be-eeace64f6208 2024-10-25 16:58:30,346 - INFO - Pod ctest-pod-78928809 with uuid 54a33163-c5fc-4d24-90be-eeace64f6208 found in kube manager 2024-10-25 16:58:30,346 - INFO - Pod ctest-pod-78928809 verification passed 2024-10-25 16:58:30,352 - INFO - Pod ctest-pod-15444014 is in running state.Got IP 10.47.255.247 2024-10-25 16:58:30,413 - DEBUG - Pod ctest-pod-15444014 has vmi 56c8ee30-92f2-11ef-83e4-fa163eb33011 2024-10-25 16:58:30,413 - INFO - Verified pod ctest-pod-15444014 in contrail-api 2024-10-25 16:58:30,429 - DEBUG - VMI 56c8ee30-92f2-11ef-83e4-fa163eb33011 is active in agent 10.0.0.42 2024-10-25 16:58:30,429 - INFO - Verified Pod ctest-pod-15444014 in agent 10.0.0.42 2024-10-25 16:58:30,429 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=85a8281c-9462-4888-8189-31a8b4416023 2024-10-25 16:58:30,435 - INFO - Pod ctest-pod-15444014 with uuid 85a8281c-9462-4888-8189-31a8b4416023 found in kube manager 2024-10-25 16:58:30,435 - INFO - Pod ctest-pod-15444014 verification passed 2024-10-25 16:58:30,442 - INFO - Pod ctest-pod-18876825 is in running state.Got IP 10.47.255.245 2024-10-25 16:58:30,505 - DEBUG - Pod ctest-pod-18876825 has vmi 57ed77e0-92f2-11ef-83e4-fa163eb33011 2024-10-25 16:58:30,505 - INFO - Verified pod ctest-pod-18876825 in contrail-api 2024-10-25 16:58:30,521 - DEBUG - VMI 57ed77e0-92f2-11ef-83e4-fa163eb33011 is active in agent 10.0.0.42 2024-10-25 16:58:30,521 - INFO - Verified Pod ctest-pod-18876825 in agent 10.0.0.42 2024-10-25 16:58:30,521 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=ee2ece6a-b4bc-4d4d-a9d5-d0d1719e2eb8 2024-10-25 16:58:30,527 - INFO - Pod ctest-pod-18876825 with uuid ee2ece6a-b4bc-4d4d-a9d5-d0d1719e2eb8 found in kube manager 2024-10-25 16:58:30,527 - INFO - Pod ctest-pod-18876825 verification passed 2024-10-25 16:58:30,533 - INFO - Pod ctest-pod-97001651 is in running state.Got IP 10.47.255.246 2024-10-25 16:58:30,555 - DEBUG - Pod ctest-pod-97001651 has vmi 5756fac2-92f2-11ef-83e4-fa163eb33011 2024-10-25 16:58:30,555 - INFO - Verified pod ctest-pod-97001651 in contrail-api 2024-10-25 16:58:30,572 - DEBUG - VMI 5756fac2-92f2-11ef-83e4-fa163eb33011 is active in agent 10.0.0.42 2024-10-25 16:58:30,573 - INFO - Verified Pod ctest-pod-97001651 in agent 10.0.0.42 2024-10-25 16:58:30,573 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=972eee5d-c456-4625-b795-f1221513b948 2024-10-25 16:58:30,580 - INFO - Pod ctest-pod-97001651 with uuid 972eee5d-c456-4625-b795-f1221513b948 found in kube manager 2024-10-25 16:58:30,580 - INFO - Pod ctest-pod-97001651 verification passed 2024-10-25 16:58:30,587 - DEBUG - Pod ctest-pod-71294308 not in running state.Currently in Pending 2024-10-25 16:58:35,594 - INFO - Pod ctest-pod-71294308 is in running state.Got IP 10.47.255.244 2024-10-25 16:58:35,657 - DEBUG - Pod ctest-pod-71294308 has vmi 588d585a-92f2-11ef-83e4-fa163eb33011 2024-10-25 16:58:35,657 - INFO - Verified pod ctest-pod-71294308 in contrail-api 2024-10-25 16:58:35,672 - DEBUG - VMI 588d585a-92f2-11ef-83e4-fa163eb33011 is active in agent 10.0.0.42 2024-10-25 16:58:35,672 - INFO - Verified Pod ctest-pod-71294308 in agent 10.0.0.42 2024-10-25 16:58:35,672 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=7df05a5c-733b-4283-b174-1aea71a9782e 2024-10-25 16:58:35,679 - INFO - Pod ctest-pod-71294308 with uuid 7df05a5c-733b-4283-b174-1aea71a9782e found in kube manager 2024-10-25 16:58:35,679 - INFO - Pod ctest-pod-71294308 verification passed 2024-10-25 16:58:35,679 - INFO - ================================================================================ 2024-10-25 16:58:35,679 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-10-25 16:58:35,680 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-10-25 16:58:35,937 - DEBUG - Nothing to compare xmpp stats {'10.0.0.42': {'10.0.0.22': '0'}} with 2024-10-25 16:58:35,937 - INFO - Initial checks done. Running the testcase now 2024-10-25 16:58:35,937 - INFO - 2024-10-25 16:58:36,003 - DEBUG - [Pod ctest-pod-44428971] Cmd: echo ctest-pod-44428971 > /usr/share/nginx/html/index.html, Output: 2024-10-25 16:58:36,064 - DEBUG - [Pod ctest-pod-39245976] Cmd: echo ctest-pod-39245976 > /usr/share/nginx/html/index.html, Output: 2024-10-25 16:58:36,124 - DEBUG - [Pod ctest-pod-89979937] Cmd: echo ctest-pod-89979937 > /usr/share/nginx/html/index.html, Output: 2024-10-25 16:58:36,198 - DEBUG - [Pod ctest-pod-78928809] Cmd: echo ctest-pod-78928809 > /usr/share/nginx/html/index.html, Output: 2024-10-25 16:58:36,201 - DEBUG - Service ctest-nginx-svc-79458642 not present 2024-10-25 16:58:36,201 - INFO - Creating service ctest-nginx-svc-79458642 2024-10-25 16:58:36,215 - INFO - Created Service ctest-nginx-svc-79458642 2024-10-25 16:58:36,222 - WARNING - Service UUID 84ff5943-5764-49c3-95a1-8f93b1ffafd8 not yet found in contrail-api 2024-10-25 16:58:37,233 - INFO - Validated that Service ctest-nginx-svc-79458642 is seen in contrail-api 2024-10-25 16:58:37,233 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_LoadbalancerDatabaseList?x=84ff5943-5764-49c3-95a1-8f93b1ffafd8 2024-10-25 16:58:37,241 - INFO - Service ctest-nginx-svc-79458642 with uuid 84ff5943-5764-49c3-95a1-8f93b1ffafd8 found in kube manager 2024-10-25 16:58:37,242 - INFO - Service ctest-nginx-svc-79458642 verification passed 2024-10-25 16:58:38,327 - DEBUG - [Pod ctest-pod-15444014] Cmd: wget http://10.110.141.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.141.82:80 (10.110.141.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-44428971 2024-10-25 16:58:38,327 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd wget http://10.110.141.82:80/ -O - -T 5 -t 1 passed 2024-10-25 16:58:38,327 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd output: Connecting to 10.110.141.82:80 (10.110.141.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-44428971 2024-10-25 16:58:38,391 - DEBUG - [Pod ctest-pod-15444014] Cmd: wget http://10.110.141.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.141.82:80 (10.110.141.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-44428971 2024-10-25 16:58:38,391 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd wget http://10.110.141.82:80/ -O - -T 5 -t 1 passed 2024-10-25 16:58:38,391 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd output: Connecting to 10.110.141.82:80 (10.110.141.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-44428971 2024-10-25 16:58:38,455 - DEBUG - [Pod ctest-pod-15444014] Cmd: wget http://10.110.141.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.141.82:80 (10.110.141.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-39245976 2024-10-25 16:58:38,455 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd wget http://10.110.141.82:80/ -O - -T 5 -t 1 passed 2024-10-25 16:58:38,455 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd output: Connecting to 10.110.141.82:80 (10.110.141.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-39245976 2024-10-25 16:58:38,455 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-44428971': 2, 'ctest-pod-39245976': 1} 2024-10-25 16:58:38,514 - DEBUG - [Pod ctest-pod-18876825] Cmd: wget http://10.110.141.82:80/ -O - -T 5 -t 1 , Output: ctest-pod-39245976 Connecting to 10.110.141.82:80 (10.110.141.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-25 16:58:38,514 - DEBUG - [Pod Pod ctest-pod-18876825] Cmd wget http://10.110.141.82:80/ -O - -T 5 -t 1 passed 2024-10-25 16:58:38,514 - DEBUG - [Pod Pod ctest-pod-18876825] Cmd output: ctest-pod-39245976 Connecting to 10.110.141.82:80 (10.110.141.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-25 16:58:38,573 - DEBUG - [Pod ctest-pod-18876825] Cmd: wget http://10.110.141.82:80/ -O - -T 5 -t 1 , Output: ctest-pod-44428971 Connecting to 10.110.141.82:80 (10.110.141.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-25 16:58:38,573 - DEBUG - [Pod Pod ctest-pod-18876825] Cmd wget http://10.110.141.82:80/ -O - -T 5 -t 1 passed 2024-10-25 16:58:38,573 - DEBUG - [Pod Pod ctest-pod-18876825] Cmd output: ctest-pod-44428971 Connecting to 10.110.141.82:80 (10.110.141.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-25 16:58:38,573 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-44428971': 1, 'ctest-pod-39245976': 1} 2024-10-25 16:58:38,577 - DEBUG - Network policy ingress-on-service not present 2024-10-25 16:58:38,579 - INFO - Creating Network Policy ingress-on-service 2024-10-25 16:58:38,591 - INFO - Network policy found in k8s 2024-10-25 16:58:38,591 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=e29c5700-c700-4530-81bb-efe95297f352 2024-10-25 16:58:38,598 - INFO - Network Policy ingress-on-service with uuid e29c5700-c700-4530-81bb-efe95297f352 found in kube manager 2024-10-25 16:58:38,634 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-10-25 16:58:38,634 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-10-25 16:58:38,634 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=e29c5700-c700-4530-81bb-efe95297f352 2024-10-25 16:58:38,670 - WARNING - Network policy with name ingress-on-service not found in agent 2024-10-25 16:58:40,671 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=e29c5700-c700-4530-81bb-efe95297f352 2024-10-25 16:58:40,703 - INFO - Network policy with name ingress-on-service found in agent 2024-10-25 16:58:40,704 - INFO - Network Policy ingress-on-service verification passed 2024-10-25 16:58:45,758 - DEBUG - [Pod ctest-pod-15444014] Cmd: wget http://10.110.141.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 16:58:45,759 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd wget http://10.110.141.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 16:58:45,759 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 16:58:50,819 - DEBUG - [Pod ctest-pod-15444014] Cmd: wget http://10.110.141.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 16:58:50,819 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd wget http://10.110.141.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 16:58:50,819 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 16:58:55,877 - DEBUG - [Pod ctest-pod-15444014] Cmd: wget http://10.110.141.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 16:58:55,877 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd wget http://10.110.141.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 16:58:55,877 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 16:59:00,926 - DEBUG - [Pod ctest-pod-15444014] Cmd: wget http://10.110.141.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 16:59:00,926 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd wget http://10.110.141.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 16:59:00,926 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 16:59:05,987 - DEBUG - [Pod ctest-pod-15444014] Cmd: wget http://10.110.141.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 16:59:05,987 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd wget http://10.110.141.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 16:59:05,987 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 16:59:11,042 - DEBUG - [Pod ctest-pod-15444014] Cmd: wget http://10.110.141.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 16:59:11,043 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd wget http://10.110.141.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 16:59:11,043 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 16:59:16,106 - DEBUG - [Pod ctest-pod-15444014] Cmd: wget http://10.110.141.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 16:59:16,107 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd wget http://10.110.141.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 16:59:16,107 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 16:59:21,166 - DEBUG - [Pod ctest-pod-15444014] Cmd: wget http://10.110.141.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 16:59:21,166 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd wget http://10.110.141.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 16:59:21,166 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 16:59:26,222 - DEBUG - [Pod ctest-pod-15444014] Cmd: wget http://10.110.141.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 16:59:26,222 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd wget http://10.110.141.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 16:59:26,222 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 16:59:31,294 - DEBUG - [Pod ctest-pod-15444014] Cmd: wget http://10.110.141.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 16:59:31,294 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd wget http://10.110.141.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 16:59:31,295 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 16:59:31,295 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-44428971': 0, 'ctest-pod-39245976': 0} 2024-10-25 16:59:31,348 - DEBUG - [Pod ctest-pod-97001651] Cmd: wget http://10.110.141.82:80/ -O - -T 5 -t 1 , Output: ctest-pod-39245976 Connecting to 10.110.141.82:80 (10.110.141.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-25 16:59:31,348 - DEBUG - [Pod Pod ctest-pod-97001651] Cmd wget http://10.110.141.82:80/ -O - -T 5 -t 1 passed 2024-10-25 16:59:31,348 - DEBUG - [Pod Pod ctest-pod-97001651] Cmd output: ctest-pod-39245976 Connecting to 10.110.141.82:80 (10.110.141.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-25 16:59:31,388 - DEBUG - [Pod ctest-pod-97001651] Cmd: wget http://10.110.141.82:80/ -O - -T 5 -t 1 , Output: ctest-pod-39245976 Connecting to 10.110.141.82:80 (10.110.141.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-25 16:59:31,388 - DEBUG - [Pod Pod ctest-pod-97001651] Cmd wget http://10.110.141.82:80/ -O - -T 5 -t 1 passed 2024-10-25 16:59:31,388 - DEBUG - [Pod Pod ctest-pod-97001651] Cmd output: ctest-pod-39245976 Connecting to 10.110.141.82:80 (10.110.141.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-25 16:59:31,445 - DEBUG - [Pod ctest-pod-97001651] Cmd: wget http://10.110.141.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.141.82:80 (10.110.141.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-39245976 2024-10-25 16:59:31,445 - DEBUG - [Pod Pod ctest-pod-97001651] Cmd wget http://10.110.141.82:80/ -O - -T 5 -t 1 passed 2024-10-25 16:59:31,445 - DEBUG - [Pod Pod ctest-pod-97001651] Cmd output: Connecting to 10.110.141.82:80 (10.110.141.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-39245976 2024-10-25 16:59:31,502 - DEBUG - [Pod ctest-pod-97001651] Cmd: wget http://10.110.141.82:80/ -O - -T 5 -t 1 , Output: ctest-pod-44428971 Connecting to 10.110.141.82:80 (10.110.141.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-25 16:59:31,502 - DEBUG - [Pod Pod ctest-pod-97001651] Cmd wget http://10.110.141.82:80/ -O - -T 5 -t 1 passed 2024-10-25 16:59:31,502 - DEBUG - [Pod Pod ctest-pod-97001651] Cmd output: ctest-pod-44428971 Connecting to 10.110.141.82:80 (10.110.141.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-25 16:59:31,502 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-44428971': 1, 'ctest-pod-39245976': 3} 2024-10-25 16:59:36,555 - DEBUG - [Pod ctest-pod-18876825] Cmd: wget http://10.110.141.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 16:59:36,555 - DEBUG - [Pod Pod ctest-pod-18876825] Cmd wget http://10.110.141.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 16:59:36,555 - DEBUG - [Pod Pod ctest-pod-18876825] Cmd output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 16:59:41,607 - DEBUG - [Pod ctest-pod-18876825] Cmd: wget http://10.110.141.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 16:59:41,608 - DEBUG - [Pod Pod ctest-pod-18876825] Cmd wget http://10.110.141.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 16:59:41,608 - DEBUG - [Pod Pod ctest-pod-18876825] Cmd output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 16:59:46,684 - DEBUG - [Pod ctest-pod-18876825] Cmd: wget http://10.110.141.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 16:59:46,684 - DEBUG - [Pod Pod ctest-pod-18876825] Cmd wget http://10.110.141.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 16:59:46,684 - DEBUG - [Pod Pod ctest-pod-18876825] Cmd output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 16:59:51,744 - DEBUG - [Pod ctest-pod-18876825] Cmd: wget http://10.110.141.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 16:59:51,744 - DEBUG - [Pod Pod ctest-pod-18876825] Cmd wget http://10.110.141.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 16:59:51,744 - DEBUG - [Pod Pod ctest-pod-18876825] Cmd output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 16:59:56,808 - DEBUG - [Pod ctest-pod-18876825] Cmd: wget http://10.110.141.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 16:59:56,808 - DEBUG - [Pod Pod ctest-pod-18876825] Cmd wget http://10.110.141.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 16:59:56,808 - DEBUG - [Pod Pod ctest-pod-18876825] Cmd output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 17:00:01,867 - DEBUG - [Pod ctest-pod-18876825] Cmd: wget http://10.110.141.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 17:00:01,867 - DEBUG - [Pod Pod ctest-pod-18876825] Cmd wget http://10.110.141.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 17:00:01,867 - DEBUG - [Pod Pod ctest-pod-18876825] Cmd output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 17:00:06,933 - DEBUG - [Pod ctest-pod-18876825] Cmd: wget http://10.110.141.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 17:00:06,933 - DEBUG - [Pod Pod ctest-pod-18876825] Cmd wget http://10.110.141.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 17:00:06,933 - DEBUG - [Pod Pod ctest-pod-18876825] Cmd output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 17:00:11,982 - DEBUG - [Pod ctest-pod-18876825] Cmd: wget http://10.110.141.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 17:00:11,982 - DEBUG - [Pod Pod ctest-pod-18876825] Cmd wget http://10.110.141.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 17:00:11,982 - DEBUG - [Pod Pod ctest-pod-18876825] Cmd output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 17:00:17,051 - DEBUG - [Pod ctest-pod-18876825] Cmd: wget http://10.110.141.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 17:00:17,051 - DEBUG - [Pod Pod ctest-pod-18876825] Cmd wget http://10.110.141.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 17:00:17,051 - DEBUG - [Pod Pod ctest-pod-18876825] Cmd output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 17:00:22,110 - DEBUG - [Pod ctest-pod-18876825] Cmd: wget http://10.110.141.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 17:00:22,110 - DEBUG - [Pod Pod ctest-pod-18876825] Cmd wget http://10.110.141.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 17:00:22,110 - DEBUG - [Pod Pod ctest-pod-18876825] Cmd output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 17:00:22,110 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-44428971': 0, 'ctest-pod-39245976': 0} 2024-10-25 17:00:24,170 - DEBUG - [Pod ctest-pod-97001651] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.938 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.069 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.099 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.069/0.368/0.938 ms 2024-10-25 17:00:24,170 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-97001651 with expectation True passed 2024-10-25 17:00:26,241 - DEBUG - [Pod ctest-pod-15444014] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.510 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.079 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.087 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.079/0.558/1.510 ms 2024-10-25 17:00:26,241 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-15444014 with expectation True passed 2024-10-25 17:00:28,299 - DEBUG - [Pod ctest-pod-18876825] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.370 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.082 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.074 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.074/0.175/0.370 ms 2024-10-25 17:00:28,299 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-18876825 with expectation True passed 2024-10-25 17:00:28,350 - DEBUG - [Pod ctest-pod-97001651] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-25 17:00:28,350 - DEBUG - [Pod Pod ctest-pod-97001651] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-10-25 17:00:28,350 - DEBUG - [Pod Pod ctest-pod-97001651] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-25 17:00:28,350 - INFO - wget check of of http://10.47.255.251 from ctest-pod-97001651 passed 2024-10-25 17:00:28,412 - DEBUG - [Pod ctest-pod-97001651] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-25 17:00:28,413 - DEBUG - [Pod Pod ctest-pod-97001651] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-10-25 17:00:28,413 - DEBUG - [Pod Pod ctest-pod-97001651] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-25 17:00:28,413 - INFO - wget check of of http://10.47.255.250 from ctest-pod-97001651 passed 2024-10-25 17:00:33,470 - DEBUG - [Pod ctest-pod-15444014] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-10-25 17:00:33,470 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-10-25 17:00:33,470 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-10-25 17:00:33,470 - INFO - wget check of of http://10.47.255.250 from ctest-pod-15444014 passed 2024-10-25 17:00:38,539 - DEBUG - [Pod ctest-pod-71294308] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-10-25 17:00:38,539 - DEBUG - [Pod Pod ctest-pod-71294308] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-10-25 17:00:38,539 - DEBUG - [Pod Pod ctest-pod-71294308] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-10-25 17:00:38,539 - INFO - wget check of of http://10.47.255.251 from ctest-pod-71294308 passed 2024-10-25 17:00:38,553 - INFO - Updating Network Policy ingress-on-service 2024-10-25 17:00:43,640 - DEBUG - [Pod ctest-pod-15444014] Cmd: wget http://10.110.141.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 17:00:43,640 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd wget http://10.110.141.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 17:00:43,640 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 17:00:48,704 - DEBUG - [Pod ctest-pod-15444014] Cmd: wget http://10.110.141.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 17:00:48,704 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd wget http://10.110.141.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 17:00:48,704 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 17:00:53,779 - DEBUG - [Pod ctest-pod-15444014] Cmd: wget http://10.110.141.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 17:00:53,779 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd wget http://10.110.141.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 17:00:53,779 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 17:00:58,838 - DEBUG - [Pod ctest-pod-15444014] Cmd: wget http://10.110.141.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 17:00:58,838 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd wget http://10.110.141.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 17:00:58,838 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 17:01:03,907 - DEBUG - [Pod ctest-pod-15444014] Cmd: wget http://10.110.141.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 17:01:03,907 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd wget http://10.110.141.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 17:01:03,907 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 17:01:08,964 - DEBUG - [Pod ctest-pod-15444014] Cmd: wget http://10.110.141.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 17:01:08,964 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd wget http://10.110.141.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 17:01:08,964 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 17:01:11,252 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2024-10-25 17:01:21,331 - DEBUG - [Pod ctest-pod-15444014] Cmd: wget http://10.110.141.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 17:01:21,332 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd wget http://10.110.141.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 17:01:21,332 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 17:01:26,389 - DEBUG - [Pod ctest-pod-15444014] Cmd: wget http://10.110.141.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 17:01:26,389 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd wget http://10.110.141.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 17:01:26,389 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 17:01:31,455 - DEBUG - [Pod ctest-pod-15444014] Cmd: wget http://10.110.141.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 17:01:31,455 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd wget http://10.110.141.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 17:01:31,455 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 17:01:36,514 - DEBUG - [Pod ctest-pod-15444014] Cmd: wget http://10.110.141.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 17:01:36,514 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd wget http://10.110.141.82:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 17:01:36,514 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd output: Connecting to 10.110.141.82:80 (10.110.141.82:80) wget: download timed out 2024-10-25 17:01:36,515 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-44428971': 0, 'ctest-pod-39245976': 0} 2024-10-25 17:01:36,572 - DEBUG - [Pod ctest-pod-97001651] Cmd: wget http://10.110.141.82:80/ -O - -T 5 -t 1 , Output: ctest-pod-39245976 Connecting to 10.110.141.82:80 (10.110.141.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-25 17:01:36,573 - DEBUG - [Pod Pod ctest-pod-97001651] Cmd wget http://10.110.141.82:80/ -O - -T 5 -t 1 passed 2024-10-25 17:01:36,573 - DEBUG - [Pod Pod ctest-pod-97001651] Cmd output: ctest-pod-39245976 Connecting to 10.110.141.82:80 (10.110.141.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-25 17:01:36,635 - DEBUG - [Pod ctest-pod-97001651] Cmd: wget http://10.110.141.82:80/ -O - -T 5 -t 1 , Output: ctest-pod-44428971 Connecting to 10.110.141.82:80 (10.110.141.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-25 17:01:36,635 - DEBUG - [Pod Pod ctest-pod-97001651] Cmd wget http://10.110.141.82:80/ -O - -T 5 -t 1 passed 2024-10-25 17:01:36,635 - DEBUG - [Pod Pod ctest-pod-97001651] Cmd output: ctest-pod-44428971 Connecting to 10.110.141.82:80 (10.110.141.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-25 17:01:36,635 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-44428971': 1, 'ctest-pod-39245976': 1} 2024-10-25 17:01:36,701 - DEBUG - [Pod ctest-pod-18876825] Cmd: wget http://10.110.141.82:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.141.82:80 (10.110.141.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-44428971 2024-10-25 17:01:36,701 - DEBUG - [Pod Pod ctest-pod-18876825] Cmd wget http://10.110.141.82:80/ -O - -T 5 -t 1 passed 2024-10-25 17:01:36,701 - DEBUG - [Pod Pod ctest-pod-18876825] Cmd output: Connecting to 10.110.141.82:80 (10.110.141.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-44428971 2024-10-25 17:01:36,769 - DEBUG - [Pod ctest-pod-18876825] Cmd: wget http://10.110.141.82:80/ -O - -T 5 -t 1 , Output: ctest-pod-39245976 Connecting to 10.110.141.82:80 (10.110.141.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-25 17:01:36,769 - DEBUG - [Pod Pod ctest-pod-18876825] Cmd wget http://10.110.141.82:80/ -O - -T 5 -t 1 passed 2024-10-25 17:01:36,769 - DEBUG - [Pod Pod ctest-pod-18876825] Cmd output: ctest-pod-39245976 Connecting to 10.110.141.82:80 (10.110.141.82:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-25 17:01:36,769 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-44428971': 1, 'ctest-pod-39245976': 1} 2024-10-25 17:01:38,831 - DEBUG - [Pod ctest-pod-97001651] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.555 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.074 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.074 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.074/0.234/0.555 ms 2024-10-25 17:01:38,831 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-97001651 with expectation True passed 2024-10-25 17:01:40,891 - DEBUG - [Pod ctest-pod-15444014] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.987 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.068 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.074 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.068/0.376/0.987 ms 2024-10-25 17:01:40,891 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-15444014 with expectation True passed 2024-10-25 17:01:42,943 - DEBUG - [Pod ctest-pod-18876825] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.598 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.078 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.074 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.074/0.250/0.598 ms 2024-10-25 17:01:42,943 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-18876825 with expectation True passed 2024-10-25 17:01:43,003 - DEBUG - [Pod ctest-pod-97001651] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-25 17:01:43,003 - DEBUG - [Pod Pod ctest-pod-97001651] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-10-25 17:01:43,003 - DEBUG - [Pod Pod ctest-pod-97001651] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-25 17:01:43,003 - INFO - wget check of of http://10.47.255.251 from ctest-pod-97001651 passed 2024-10-25 17:01:43,072 - DEBUG - [Pod ctest-pod-97001651] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-25 17:01:43,072 - DEBUG - [Pod Pod ctest-pod-97001651] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-10-25 17:01:43,072 - DEBUG - [Pod Pod ctest-pod-97001651] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-25 17:01:43,072 - INFO - wget check of of http://10.47.255.250 from ctest-pod-97001651 passed 2024-10-25 17:01:48,127 - DEBUG - [Pod ctest-pod-15444014] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-10-25 17:01:48,127 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-10-25 17:01:48,127 - DEBUG - [Pod Pod ctest-pod-15444014] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-10-25 17:01:48,127 - INFO - wget check of of http://10.47.255.250 from ctest-pod-15444014 passed 2024-10-25 17:01:48,184 - DEBUG - [Pod ctest-pod-71294308] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-25 17:01:48,184 - DEBUG - [Pod Pod ctest-pod-71294308] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-10-25 17:01:48,184 - DEBUG - [Pod Pod ctest-pod-71294308] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-25 17:01:48,184 - INFO - wget check of of http://10.47.255.251 from ctest-pod-71294308 passed 2024-10-25 17:01:48,184 - INFO - Deleting Network Policy : ingress-on-service 2024-10-25 17:01:48,185 - INFO - Deleting service : ctest-nginx-svc-79458642 2024-10-25 17:01:48,448 - DEBUG - No XMPP flaps were noticed during the test