2024-10-17 02:15:53,308 - INFO - Using existing project ['default-domain', 'k8s-default'](efbe11c4-9524-4a96-b83b-c7f850cc946c) 2024-10-17 02:15:53,333 - DEBUG - Namespace ctest-new-default-76973704 not present 2024-10-17 02:15:53,341 - INFO - Created namespace ctest-new-default-76973704 2024-10-17 02:15:56,345 - DEBUG - Namespace ctest-non-default-82456968 not present 2024-10-17 02:15:56,354 - INFO - Created namespace ctest-non-default-82456968 2024-10-17 02:15:59,374 - DEBUG - Pod ctest-pod-62055189 not present 2024-10-17 02:15:59,374 - INFO - Creating Pod ctest-pod-62055189 2024-10-17 02:15:59,404 - DEBUG - Pod : ctest-pod-62055189 UUID is f6236272-629e-438a-9097-cdd6c3bd22c1 2024-10-17 02:15:59,407 - DEBUG - Pod ctest-pod-94003329 not present 2024-10-17 02:15:59,407 - INFO - Creating Pod ctest-pod-94003329 2024-10-17 02:15:59,425 - DEBUG - Pod : ctest-pod-94003329 UUID is e6ada84e-1bdd-43ba-9be1-477bac436ffe 2024-10-17 02:15:59,431 - DEBUG - Pod ctest-pod-12029327 not present 2024-10-17 02:15:59,431 - INFO - Creating Pod ctest-pod-12029327 2024-10-17 02:15:59,452 - DEBUG - Pod : ctest-pod-12029327 UUID is 00fe2b59-da46-44f4-b27f-b3cc9ea8c724 2024-10-17 02:15:59,455 - DEBUG - Pod ctest-pod-20358057 not present 2024-10-17 02:15:59,456 - INFO - Creating Pod ctest-pod-20358057 2024-10-17 02:15:59,474 - DEBUG - Pod : ctest-pod-20358057 UUID is a898f0fe-f665-4bda-973f-83f6f63c0273 2024-10-17 02:15:59,478 - DEBUG - Pod ctest-pod-76662257 not present 2024-10-17 02:15:59,478 - INFO - Creating Pod ctest-pod-76662257 2024-10-17 02:15:59,498 - DEBUG - Pod : ctest-pod-76662257 UUID is db94b0d3-2e4a-45d7-8810-884033b28aa8 2024-10-17 02:15:59,500 - DEBUG - Pod ctest-pod-27974883 not present 2024-10-17 02:15:59,501 - INFO - Creating Pod ctest-pod-27974883 2024-10-17 02:15:59,525 - DEBUG - Pod : ctest-pod-27974883 UUID is 88b208aa-afb0-4ff5-b59a-c2782bec4651 2024-10-17 02:15:59,530 - DEBUG - Pod ctest-pod-13368137 not present 2024-10-17 02:15:59,531 - INFO - Creating Pod ctest-pod-13368137 2024-10-17 02:15:59,550 - DEBUG - Pod : ctest-pod-13368137 UUID is 5645e7d3-30fc-43e5-85b8-ae2c9d043e06 2024-10-17 02:15:59,556 - DEBUG - Pod ctest-pod-85380238 not present 2024-10-17 02:15:59,556 - INFO - Creating Pod ctest-pod-85380238 2024-10-17 02:15:59,577 - DEBUG - Pod : ctest-pod-85380238 UUID is 949ace1b-07dc-44b5-bf86-929d9b58029a 2024-10-17 02:15:59,891 - INFO - Project default-domain:k8s-ctest-new-default-76973704 for Namespace ctest-new-default-76973704 is seen in contrail-api 2024-10-17 02:15:59,891 - DEBUG - Project uuid in Contrail is aff7ae2e-e0d4-4d93-8a2f-a93c79336e73 2024-10-17 02:16:00,094 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NamespaceDatabaseList?namespace_uuid=6c35ab39-4c2f-4ec6-afa9-cc634d2812e7 2024-10-17 02:16:00,103 - INFO - Namespace ctest-new-default-76973704 with uuid 6c35ab39-4c2f-4ec6-afa9-cc634d2812e7 found in kube manager 2024-10-17 02:16:00,103 - INFO - Namespace ctest-new-default-76973704 verification passed 2024-10-17 02:16:00,589 - INFO - Project default-domain:k8s-ctest-non-default-82456968 for Namespace ctest-non-default-82456968 is seen in contrail-api 2024-10-17 02:16:00,589 - DEBUG - Project uuid in Contrail is f4e7ec9a-e24b-4aac-8938-7d7f89042692 2024-10-17 02:16:00,589 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NamespaceDatabaseList?namespace_uuid=6f984439-e400-4c9c-9429-0e721f706d7a 2024-10-17 02:16:00,611 - INFO - Namespace ctest-non-default-82456968 with uuid 6f984439-e400-4c9c-9429-0e721f706d7a found in kube manager 2024-10-17 02:16:00,612 - INFO - Namespace ctest-non-default-82456968 verification passed 2024-10-17 02:16:00,620 - DEBUG - Pod ctest-pod-62055189 not in running state.Currently in Pending 2024-10-17 02:16:05,627 - DEBUG - Pod ctest-pod-62055189 not in running state.Currently in Pending 2024-10-17 02:16:10,637 - INFO - Pod ctest-pod-62055189 is in running state.Got IP 10.47.255.250 2024-10-17 02:16:10,708 - DEBUG - Pod ctest-pod-62055189 has vmi c1fc9b3c-8c2d-11ef-af0e-0242c3fd91ad 2024-10-17 02:16:10,708 - INFO - Verified pod ctest-pod-62055189 in contrail-api 2024-10-17 02:16:10,720 - DEBUG - VMI c1fc9b3c-8c2d-11ef-af0e-0242c3fd91ad is active in agent 10.0.0.33 2024-10-17 02:16:10,720 - INFO - Verified Pod ctest-pod-62055189 in agent 10.0.0.33 2024-10-17 02:16:10,721 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=f6236272-629e-438a-9097-cdd6c3bd22c1 2024-10-17 02:16:10,731 - INFO - Pod ctest-pod-62055189 with uuid f6236272-629e-438a-9097-cdd6c3bd22c1 found in kube manager 2024-10-17 02:16:10,732 - INFO - Pod ctest-pod-62055189 verification passed 2024-10-17 02:16:10,745 - DEBUG - Pod ctest-pod-94003329 not in running state.Currently in Pending 2024-10-17 02:16:15,755 - INFO - Pod ctest-pod-94003329 is in running state.Got IP 10.47.255.249 2024-10-17 02:16:15,823 - DEBUG - Pod ctest-pod-94003329 has vmi c2b596c8-8c2d-11ef-af0e-0242c3fd91ad 2024-10-17 02:16:15,823 - INFO - Verified pod ctest-pod-94003329 in contrail-api 2024-10-17 02:16:15,836 - DEBUG - VMI c2b596c8-8c2d-11ef-af0e-0242c3fd91ad is active in agent 10.0.0.33 2024-10-17 02:16:15,836 - INFO - Verified Pod ctest-pod-94003329 in agent 10.0.0.33 2024-10-17 02:16:15,836 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=e6ada84e-1bdd-43ba-9be1-477bac436ffe 2024-10-17 02:16:15,841 - INFO - Pod ctest-pod-94003329 with uuid e6ada84e-1bdd-43ba-9be1-477bac436ffe found in kube manager 2024-10-17 02:16:15,841 - INFO - Pod ctest-pod-94003329 verification passed 2024-10-17 02:16:15,916 - DEBUG - Pod ctest-pod-12029327 not in running state.Currently in Pending 2024-10-17 02:16:20,923 - INFO - Pod ctest-pod-12029327 is in running state.Got IP 10.47.255.248 2024-10-17 02:16:20,982 - DEBUG - Pod ctest-pod-12029327 has vmi c3bed624-8c2d-11ef-af0e-0242c3fd91ad 2024-10-17 02:16:20,982 - INFO - Verified pod ctest-pod-12029327 in contrail-api 2024-10-17 02:16:20,995 - DEBUG - VMI c3bed624-8c2d-11ef-af0e-0242c3fd91ad is active in agent 10.0.0.33 2024-10-17 02:16:20,995 - INFO - Verified Pod ctest-pod-12029327 in agent 10.0.0.33 2024-10-17 02:16:20,996 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=00fe2b59-da46-44f4-b27f-b3cc9ea8c724 2024-10-17 02:16:21,001 - INFO - Pod ctest-pod-12029327 with uuid 00fe2b59-da46-44f4-b27f-b3cc9ea8c724 found in kube manager 2024-10-17 02:16:21,001 - INFO - Pod ctest-pod-12029327 verification passed 2024-10-17 02:16:21,007 - INFO - Pod ctest-pod-20358057 is in running state.Got IP 10.47.255.247 2024-10-17 02:16:21,106 - DEBUG - Pod ctest-pod-20358057 has vmi c47a86f8-8c2d-11ef-af0e-0242c3fd91ad 2024-10-17 02:16:21,106 - INFO - Verified pod ctest-pod-20358057 in contrail-api 2024-10-17 02:16:21,121 - DEBUG - VMI c47a86f8-8c2d-11ef-af0e-0242c3fd91ad is active in agent 10.0.0.33 2024-10-17 02:16:21,121 - INFO - Verified Pod ctest-pod-20358057 in agent 10.0.0.33 2024-10-17 02:16:21,121 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=a898f0fe-f665-4bda-973f-83f6f63c0273 2024-10-17 02:16:21,126 - INFO - Pod ctest-pod-20358057 with uuid a898f0fe-f665-4bda-973f-83f6f63c0273 found in kube manager 2024-10-17 02:16:21,126 - INFO - Pod ctest-pod-20358057 verification passed 2024-10-17 02:16:21,132 - INFO - Pod ctest-pod-76662257 is in running state.Got IP 10.47.255.246 2024-10-17 02:16:21,231 - DEBUG - Pod ctest-pod-76662257 has vmi c55d62ca-8c2d-11ef-af0e-0242c3fd91ad 2024-10-17 02:16:21,231 - INFO - Verified pod ctest-pod-76662257 in contrail-api 2024-10-17 02:16:21,242 - DEBUG - VMI c55d62ca-8c2d-11ef-af0e-0242c3fd91ad is active in agent 10.0.0.33 2024-10-17 02:16:21,242 - INFO - Verified Pod ctest-pod-76662257 in agent 10.0.0.33 2024-10-17 02:16:21,242 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=db94b0d3-2e4a-45d7-8810-884033b28aa8 2024-10-17 02:16:21,247 - INFO - Pod ctest-pod-76662257 with uuid db94b0d3-2e4a-45d7-8810-884033b28aa8 found in kube manager 2024-10-17 02:16:21,247 - INFO - Pod ctest-pod-76662257 verification passed 2024-10-17 02:16:21,254 - DEBUG - Pod ctest-pod-13368137 not in running state.Currently in Pending 2024-10-17 02:16:26,265 - INFO - Pod ctest-pod-13368137 is in running state.Got IP 10.47.255.244 2024-10-17 02:16:26,326 - DEBUG - Pod ctest-pod-13368137 has vmi c712cf60-8c2d-11ef-af0e-0242c3fd91ad 2024-10-17 02:16:26,326 - INFO - Verified pod ctest-pod-13368137 in contrail-api 2024-10-17 02:16:26,338 - DEBUG - VMI c712cf60-8c2d-11ef-af0e-0242c3fd91ad is active in agent 10.0.0.33 2024-10-17 02:16:26,339 - INFO - Verified Pod ctest-pod-13368137 in agent 10.0.0.33 2024-10-17 02:16:26,339 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=5645e7d3-30fc-43e5-85b8-ae2c9d043e06 2024-10-17 02:16:26,343 - INFO - Pod ctest-pod-13368137 with uuid 5645e7d3-30fc-43e5-85b8-ae2c9d043e06 found in kube manager 2024-10-17 02:16:26,343 - INFO - Pod ctest-pod-13368137 verification passed 2024-10-17 02:16:26,349 - INFO - Pod ctest-pod-27974883 is in running state.Got IP 10.47.255.245 2024-10-17 02:16:26,446 - DEBUG - Pod ctest-pod-27974883 has vmi c635a5d6-8c2d-11ef-af0e-0242c3fd91ad 2024-10-17 02:16:26,446 - INFO - Verified pod ctest-pod-27974883 in contrail-api 2024-10-17 02:16:26,457 - DEBUG - VMI c635a5d6-8c2d-11ef-af0e-0242c3fd91ad is active in agent 10.0.0.33 2024-10-17 02:16:26,457 - INFO - Verified Pod ctest-pod-27974883 in agent 10.0.0.33 2024-10-17 02:16:26,458 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=88b208aa-afb0-4ff5-b59a-c2782bec4651 2024-10-17 02:16:26,462 - INFO - Pod ctest-pod-27974883 with uuid 88b208aa-afb0-4ff5-b59a-c2782bec4651 found in kube manager 2024-10-17 02:16:26,462 - INFO - Pod ctest-pod-27974883 verification passed 2024-10-17 02:16:26,468 - INFO - Pod ctest-pod-85380238 is in running state.Got IP 10.47.255.243 2024-10-17 02:16:26,568 - DEBUG - Pod ctest-pod-85380238 has vmi c7ef582c-8c2d-11ef-af0e-0242c3fd91ad 2024-10-17 02:16:26,568 - INFO - Verified pod ctest-pod-85380238 in contrail-api 2024-10-17 02:16:26,579 - DEBUG - VMI c7ef582c-8c2d-11ef-af0e-0242c3fd91ad is active in agent 10.0.0.33 2024-10-17 02:16:26,580 - INFO - Verified Pod ctest-pod-85380238 in agent 10.0.0.33 2024-10-17 02:16:26,580 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=949ace1b-07dc-44b5-bf86-929d9b58029a 2024-10-17 02:16:26,585 - INFO - Pod ctest-pod-85380238 with uuid 949ace1b-07dc-44b5-bf86-929d9b58029a found in kube manager 2024-10-17 02:16:26,585 - INFO - Pod ctest-pod-85380238 verification passed 2024-10-17 02:16:26,585 - INFO - ================================================================================ 2024-10-17 02:16:26,585 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-10-17 02:16:26,585 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-10-17 02:16:26,846 - DEBUG - Nothing to compare xmpp stats {'10.0.0.33': {'10.0.0.33': '2'}} with 2024-10-17 02:16:26,847 - INFO - Initial checks done. Running the testcase now 2024-10-17 02:16:26,847 - INFO - 2024-10-17 02:16:26,933 - DEBUG - [Pod ctest-pod-62055189] Cmd: echo ctest-pod-62055189 > /usr/share/nginx/html/index.html, Output: 2024-10-17 02:16:27,016 - DEBUG - [Pod ctest-pod-94003329] Cmd: echo ctest-pod-94003329 > /usr/share/nginx/html/index.html, Output: 2024-10-17 02:16:27,100 - DEBUG - [Pod ctest-pod-12029327] Cmd: echo ctest-pod-12029327 > /usr/share/nginx/html/index.html, Output: 2024-10-17 02:16:27,175 - DEBUG - [Pod ctest-pod-20358057] Cmd: echo ctest-pod-20358057 > /usr/share/nginx/html/index.html, Output: 2024-10-17 02:16:27,179 - DEBUG - Service ctest-nginx-svc-20828203 not present 2024-10-17 02:16:27,179 - INFO - Creating service ctest-nginx-svc-20828203 2024-10-17 02:16:27,197 - INFO - Created Service ctest-nginx-svc-20828203 2024-10-17 02:16:27,207 - WARNING - Service UUID 3e8472e2-bc2d-446e-8531-f8249f0a6ada not yet found in contrail-api 2024-10-17 02:16:28,217 - INFO - Validated that Service ctest-nginx-svc-20828203 is seen in contrail-api 2024-10-17 02:16:28,217 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_LoadbalancerDatabaseList?x=3e8472e2-bc2d-446e-8531-f8249f0a6ada 2024-10-17 02:16:28,224 - INFO - Service ctest-nginx-svc-20828203 with uuid 3e8472e2-bc2d-446e-8531-f8249f0a6ada found in kube manager 2024-10-17 02:16:28,224 - INFO - Service ctest-nginx-svc-20828203 verification passed 2024-10-17 02:16:29,364 - DEBUG - [Pod ctest-pod-76662257] Cmd: wget http://10.108.238.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.238.54:80 (10.108.238.54:80) writing to stdout ctest-pod-94003329 - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-17 02:16:29,364 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd wget http://10.108.238.54:80/ -O - -T 5 -t 1 passed 2024-10-17 02:16:29,364 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd output: Connecting to 10.108.238.54:80 (10.108.238.54:80) writing to stdout ctest-pod-94003329 - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-17 02:16:29,449 - DEBUG - [Pod ctest-pod-76662257] Cmd: wget http://10.108.238.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.238.54:80 (10.108.238.54:80) writing to stdout ctest-pod-94003329 - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-17 02:16:29,449 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd wget http://10.108.238.54:80/ -O - -T 5 -t 1 passed 2024-10-17 02:16:29,449 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd output: Connecting to 10.108.238.54:80 (10.108.238.54:80) writing to stdout ctest-pod-94003329 - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-17 02:16:29,542 - DEBUG - [Pod ctest-pod-76662257] Cmd: wget http://10.108.238.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.238.54:80 (10.108.238.54:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-94003329 2024-10-17 02:16:29,542 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd wget http://10.108.238.54:80/ -O - -T 5 -t 1 passed 2024-10-17 02:16:29,542 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd output: Connecting to 10.108.238.54:80 (10.108.238.54:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-94003329 2024-10-17 02:16:29,666 - DEBUG - [Pod ctest-pod-76662257] Cmd: wget http://10.108.238.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.238.54:80 (10.108.238.54:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-94003329 2024-10-17 02:16:29,666 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd wget http://10.108.238.54:80/ -O - -T 5 -t 1 passed 2024-10-17 02:16:29,666 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd output: Connecting to 10.108.238.54:80 (10.108.238.54:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-94003329 2024-10-17 02:16:29,741 - DEBUG - [Pod ctest-pod-76662257] Cmd: wget http://10.108.238.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.238.54:80 (10.108.238.54:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-94003329 2024-10-17 02:16:29,741 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd wget http://10.108.238.54:80/ -O - -T 5 -t 1 passed 2024-10-17 02:16:29,741 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd output: Connecting to 10.108.238.54:80 (10.108.238.54:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-94003329 2024-10-17 02:16:29,820 - DEBUG - [Pod ctest-pod-76662257] Cmd: wget http://10.108.238.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.238.54:80 (10.108.238.54:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-62055189 2024-10-17 02:16:29,820 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd wget http://10.108.238.54:80/ -O - -T 5 -t 1 passed 2024-10-17 02:16:29,821 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd output: Connecting to 10.108.238.54:80 (10.108.238.54:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-62055189 2024-10-17 02:16:29,821 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-62055189': 1, 'ctest-pod-94003329': 5} 2024-10-17 02:16:29,896 - DEBUG - [Pod ctest-pod-13368137] Cmd: wget http://10.108.238.54:80/ -O - -T 5 -t 1 , Output: ctest-pod-94003329 Connecting to 10.108.238.54:80 (10.108.238.54:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-17 02:16:29,896 - DEBUG - [Pod Pod ctest-pod-13368137] Cmd wget http://10.108.238.54:80/ -O - -T 5 -t 1 passed 2024-10-17 02:16:29,896 - DEBUG - [Pod Pod ctest-pod-13368137] Cmd output: ctest-pod-94003329 Connecting to 10.108.238.54:80 (10.108.238.54:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-17 02:16:29,985 - DEBUG - [Pod ctest-pod-13368137] Cmd: wget http://10.108.238.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.238.54:80 (10.108.238.54:80) ctest-pod-62055189 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-17 02:16:29,986 - DEBUG - [Pod Pod ctest-pod-13368137] Cmd wget http://10.108.238.54:80/ -O - -T 5 -t 1 passed 2024-10-17 02:16:29,986 - DEBUG - [Pod Pod ctest-pod-13368137] Cmd output: Connecting to 10.108.238.54:80 (10.108.238.54:80) ctest-pod-62055189 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-17 02:16:29,986 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-62055189': 1, 'ctest-pod-94003329': 1} 2024-10-17 02:16:29,989 - DEBUG - Network policy ingress-on-service not present 2024-10-17 02:16:29,990 - INFO - Creating Network Policy ingress-on-service 2024-10-17 02:16:30,000 - INFO - Network policy found in k8s 2024-10-17 02:16:30,000 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=f76e0c86-d915-4438-bc56-600263befc7b 2024-10-17 02:16:30,006 - INFO - Network Policy ingress-on-service with uuid f76e0c86-d915-4438-bc56-600263befc7b found in kube manager 2024-10-17 02:16:30,039 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-10-17 02:16:30,040 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-10-17 02:16:30,040 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=f76e0c86-d915-4438-bc56-600263befc7b 2024-10-17 02:16:30,068 - WARNING - Network policy with name ingress-on-service not found in agent 2024-10-17 02:16:32,069 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=f76e0c86-d915-4438-bc56-600263befc7b 2024-10-17 02:16:32,097 - WARNING - Network policy with name ingress-on-service not found in agent 2024-10-17 02:16:34,098 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=f76e0c86-d915-4438-bc56-600263befc7b 2024-10-17 02:16:34,127 - INFO - Network policy with name ingress-on-service found in agent 2024-10-17 02:16:34,128 - INFO - Network Policy ingress-on-service verification passed 2024-10-17 02:16:39,202 - DEBUG - [Pod ctest-pod-76662257] Cmd: wget http://10.108.238.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:16:39,202 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd wget http://10.108.238.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:16:39,202 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:16:44,273 - DEBUG - [Pod ctest-pod-76662257] Cmd: wget http://10.108.238.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:16:44,274 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd wget http://10.108.238.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:16:44,274 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:16:49,349 - DEBUG - [Pod ctest-pod-76662257] Cmd: wget http://10.108.238.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:16:49,349 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd wget http://10.108.238.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:16:49,349 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:16:54,424 - DEBUG - [Pod ctest-pod-76662257] Cmd: wget http://10.108.238.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:16:54,424 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd wget http://10.108.238.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:16:54,424 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:16:59,499 - DEBUG - [Pod ctest-pod-76662257] Cmd: wget http://10.108.238.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:16:59,499 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd wget http://10.108.238.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:16:59,499 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:17:04,587 - DEBUG - [Pod ctest-pod-76662257] Cmd: wget http://10.108.238.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:17:04,587 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd wget http://10.108.238.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:17:04,587 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:17:09,658 - DEBUG - [Pod ctest-pod-76662257] Cmd: wget http://10.108.238.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:17:09,658 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd wget http://10.108.238.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:17:09,658 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:17:14,741 - DEBUG - [Pod ctest-pod-76662257] Cmd: wget http://10.108.238.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:17:14,741 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd wget http://10.108.238.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:17:14,741 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:17:19,837 - DEBUG - [Pod ctest-pod-76662257] Cmd: wget http://10.108.238.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:17:19,837 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd wget http://10.108.238.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:17:19,837 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:17:24,907 - DEBUG - [Pod ctest-pod-76662257] Cmd: wget http://10.108.238.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:17:24,907 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd wget http://10.108.238.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:17:24,907 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:17:24,907 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-62055189': 0, 'ctest-pod-94003329': 0} 2024-10-17 02:17:24,978 - DEBUG - [Pod ctest-pod-27974883] Cmd: wget http://10.108.238.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.238.54:80 (10.108.238.54:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-94003329 2024-10-17 02:17:24,978 - DEBUG - [Pod Pod ctest-pod-27974883] Cmd wget http://10.108.238.54:80/ -O - -T 5 -t 1 passed 2024-10-17 02:17:24,978 - DEBUG - [Pod Pod ctest-pod-27974883] Cmd output: Connecting to 10.108.238.54:80 (10.108.238.54:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-94003329 2024-10-17 02:17:25,054 - DEBUG - [Pod ctest-pod-27974883] Cmd: wget http://10.108.238.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.238.54:80 (10.108.238.54:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-62055189 2024-10-17 02:17:25,054 - DEBUG - [Pod Pod ctest-pod-27974883] Cmd wget http://10.108.238.54:80/ -O - -T 5 -t 1 passed 2024-10-17 02:17:25,054 - DEBUG - [Pod Pod ctest-pod-27974883] Cmd output: Connecting to 10.108.238.54:80 (10.108.238.54:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-62055189 2024-10-17 02:17:25,054 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-62055189': 1, 'ctest-pod-94003329': 1} 2024-10-17 02:17:30,152 - DEBUG - [Pod ctest-pod-13368137] Cmd: wget http://10.108.238.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:17:30,152 - DEBUG - [Pod Pod ctest-pod-13368137] Cmd wget http://10.108.238.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:17:30,152 - DEBUG - [Pod Pod ctest-pod-13368137] Cmd output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:17:35,242 - DEBUG - [Pod ctest-pod-13368137] Cmd: wget http://10.108.238.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:17:35,243 - DEBUG - [Pod Pod ctest-pod-13368137] Cmd wget http://10.108.238.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:17:35,243 - DEBUG - [Pod Pod ctest-pod-13368137] Cmd output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:17:40,316 - DEBUG - [Pod ctest-pod-13368137] Cmd: wget http://10.108.238.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:17:40,317 - DEBUG - [Pod Pod ctest-pod-13368137] Cmd wget http://10.108.238.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:17:40,317 - DEBUG - [Pod Pod ctest-pod-13368137] Cmd output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:17:45,425 - DEBUG - [Pod ctest-pod-13368137] Cmd: wget http://10.108.238.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:17:45,425 - DEBUG - [Pod Pod ctest-pod-13368137] Cmd wget http://10.108.238.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:17:45,425 - DEBUG - [Pod Pod ctest-pod-13368137] Cmd output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:17:50,494 - DEBUG - [Pod ctest-pod-13368137] Cmd: wget http://10.108.238.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:17:50,495 - DEBUG - [Pod Pod ctest-pod-13368137] Cmd wget http://10.108.238.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:17:50,495 - DEBUG - [Pod Pod ctest-pod-13368137] Cmd output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:17:55,576 - DEBUG - [Pod ctest-pod-13368137] Cmd: wget http://10.108.238.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:17:55,576 - DEBUG - [Pod Pod ctest-pod-13368137] Cmd wget http://10.108.238.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:17:55,577 - DEBUG - [Pod Pod ctest-pod-13368137] Cmd output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:18:00,662 - DEBUG - [Pod ctest-pod-13368137] Cmd: wget http://10.108.238.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:18:00,662 - DEBUG - [Pod Pod ctest-pod-13368137] Cmd wget http://10.108.238.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:18:00,662 - DEBUG - [Pod Pod ctest-pod-13368137] Cmd output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:18:05,755 - DEBUG - [Pod ctest-pod-13368137] Cmd: wget http://10.108.238.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:18:05,755 - DEBUG - [Pod Pod ctest-pod-13368137] Cmd wget http://10.108.238.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:18:05,755 - DEBUG - [Pod Pod ctest-pod-13368137] Cmd output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:18:10,829 - DEBUG - [Pod ctest-pod-13368137] Cmd: wget http://10.108.238.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:18:10,830 - DEBUG - [Pod Pod ctest-pod-13368137] Cmd wget http://10.108.238.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:18:10,830 - DEBUG - [Pod Pod ctest-pod-13368137] Cmd output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:18:15,900 - DEBUG - [Pod ctest-pod-13368137] Cmd: wget http://10.108.238.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:18:15,900 - DEBUG - [Pod Pod ctest-pod-13368137] Cmd wget http://10.108.238.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:18:15,900 - DEBUG - [Pod Pod ctest-pod-13368137] Cmd output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:18:15,900 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-62055189': 0, 'ctest-pod-94003329': 0} 2024-10-17 02:18:17,992 - DEBUG - [Pod ctest-pod-27974883] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.367 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.065 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.090 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.065/0.174/0.367 ms 2024-10-17 02:18:17,992 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-27974883 with expectation True passed 2024-10-17 02:18:20,076 - DEBUG - [Pod ctest-pod-76662257] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=1.335 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.059 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.066 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.059/0.486/1.335 ms 2024-10-17 02:18:20,076 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-76662257 with expectation True passed 2024-10-17 02:18:22,149 - DEBUG - [Pod ctest-pod-13368137] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=1.723 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.066 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.091 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.066/0.626/1.723 ms 2024-10-17 02:18:22,149 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-13368137 with expectation True passed 2024-10-17 02:18:22,228 - DEBUG - [Pod ctest-pod-27974883] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-17 02:18:22,228 - DEBUG - [Pod Pod ctest-pod-27974883] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-10-17 02:18:22,228 - DEBUG - [Pod Pod ctest-pod-27974883] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-17 02:18:22,228 - INFO - wget check of of http://10.47.255.250 from ctest-pod-27974883 passed 2024-10-17 02:18:22,310 - DEBUG - [Pod ctest-pod-27974883] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-17 02:18:22,310 - DEBUG - [Pod Pod ctest-pod-27974883] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 passed 2024-10-17 02:18:22,310 - DEBUG - [Pod Pod ctest-pod-27974883] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-17 02:18:22,310 - INFO - wget check of of http://10.47.255.249 from ctest-pod-27974883 passed 2024-10-17 02:18:27,415 - DEBUG - [Pod ctest-pod-76662257] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2024-10-17 02:18:27,415 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2024-10-17 02:18:27,415 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2024-10-17 02:18:27,415 - INFO - wget check of of http://10.47.255.249 from ctest-pod-76662257 passed 2024-10-17 02:18:32,487 - DEBUG - [Pod ctest-pod-85380238] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-10-17 02:18:32,487 - DEBUG - [Pod Pod ctest-pod-85380238] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-10-17 02:18:32,487 - DEBUG - [Pod Pod ctest-pod-85380238] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-10-17 02:18:32,488 - INFO - wget check of of http://10.47.255.250 from ctest-pod-85380238 passed 2024-10-17 02:18:32,498 - INFO - Updating Network Policy ingress-on-service 2024-10-17 02:18:37,619 - DEBUG - [Pod ctest-pod-76662257] Cmd: wget http://10.108.238.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:18:37,619 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd wget http://10.108.238.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:18:37,619 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:18:42,702 - DEBUG - [Pod ctest-pod-76662257] Cmd: wget http://10.108.238.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:18:42,703 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd wget http://10.108.238.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:18:42,703 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:18:47,792 - DEBUG - [Pod ctest-pod-76662257] Cmd: wget http://10.108.238.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:18:47,793 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd wget http://10.108.238.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:18:47,793 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:18:52,867 - DEBUG - [Pod ctest-pod-76662257] Cmd: wget http://10.108.238.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:18:52,867 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd wget http://10.108.238.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:18:52,867 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:18:57,941 - DEBUG - [Pod ctest-pod-76662257] Cmd: wget http://10.108.238.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:18:57,941 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd wget http://10.108.238.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:18:57,941 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:19:03,038 - DEBUG - [Pod ctest-pod-76662257] Cmd: wget http://10.108.238.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:19:03,038 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd wget http://10.108.238.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:19:03,038 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:19:08,112 - DEBUG - [Pod ctest-pod-76662257] Cmd: wget http://10.108.238.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:19:08,112 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd wget http://10.108.238.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:19:08,112 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:19:13,187 - DEBUG - [Pod ctest-pod-76662257] Cmd: wget http://10.108.238.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:19:13,187 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd wget http://10.108.238.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:19:13,187 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:19:18,290 - DEBUG - [Pod ctest-pod-76662257] Cmd: wget http://10.108.238.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:19:18,290 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd wget http://10.108.238.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:19:18,290 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:19:23,376 - DEBUG - [Pod ctest-pod-76662257] Cmd: wget http://10.108.238.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:19:23,377 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd wget http://10.108.238.54:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:19:23,377 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd output: Connecting to 10.108.238.54:80 (10.108.238.54:80) wget: download timed out 2024-10-17 02:19:23,377 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-62055189': 0, 'ctest-pod-94003329': 0} 2024-10-17 02:19:23,449 - DEBUG - [Pod ctest-pod-27974883] Cmd: wget http://10.108.238.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.238.54:80 (10.108.238.54:80) writing to stdout - 100% ctest-pod-94003329 |********************************| 19 0:00:00 ETA written to stdout 2024-10-17 02:19:23,449 - DEBUG - [Pod Pod ctest-pod-27974883] Cmd wget http://10.108.238.54:80/ -O - -T 5 -t 1 passed 2024-10-17 02:19:23,449 - DEBUG - [Pod Pod ctest-pod-27974883] Cmd output: Connecting to 10.108.238.54:80 (10.108.238.54:80) writing to stdout - 100% ctest-pod-94003329 |********************************| 19 0:00:00 ETA written to stdout 2024-10-17 02:19:23,519 - DEBUG - [Pod ctest-pod-27974883] Cmd: wget http://10.108.238.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.238.54:80 (10.108.238.54:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-62055189 2024-10-17 02:19:23,520 - DEBUG - [Pod Pod ctest-pod-27974883] Cmd wget http://10.108.238.54:80/ -O - -T 5 -t 1 passed 2024-10-17 02:19:23,520 - DEBUG - [Pod Pod ctest-pod-27974883] Cmd output: Connecting to 10.108.238.54:80 (10.108.238.54:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-62055189 2024-10-17 02:19:23,520 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-62055189': 1, 'ctest-pod-94003329': 1} 2024-10-17 02:19:23,583 - DEBUG - [Pod ctest-pod-13368137] Cmd: wget http://10.108.238.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.238.54:80 (10.108.238.54:80) ctest-pod-62055189 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-17 02:19:23,583 - DEBUG - [Pod Pod ctest-pod-13368137] Cmd wget http://10.108.238.54:80/ -O - -T 5 -t 1 passed 2024-10-17 02:19:23,583 - DEBUG - [Pod Pod ctest-pod-13368137] Cmd output: Connecting to 10.108.238.54:80 (10.108.238.54:80) ctest-pod-62055189 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-17 02:19:23,654 - DEBUG - [Pod ctest-pod-13368137] Cmd: wget http://10.108.238.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.238.54:80 (10.108.238.54:80) ctest-pod-62055189 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-17 02:19:23,654 - DEBUG - [Pod Pod ctest-pod-13368137] Cmd wget http://10.108.238.54:80/ -O - -T 5 -t 1 passed 2024-10-17 02:19:23,654 - DEBUG - [Pod Pod ctest-pod-13368137] Cmd output: Connecting to 10.108.238.54:80 (10.108.238.54:80) ctest-pod-62055189 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-17 02:19:23,724 - DEBUG - [Pod ctest-pod-13368137] Cmd: wget http://10.108.238.54:80/ -O - -T 5 -t 1 , Output: ctest-pod-62055189 Connecting to 10.108.238.54:80 (10.108.238.54:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-17 02:19:23,724 - DEBUG - [Pod Pod ctest-pod-13368137] Cmd wget http://10.108.238.54:80/ -O - -T 5 -t 1 passed 2024-10-17 02:19:23,724 - DEBUG - [Pod Pod ctest-pod-13368137] Cmd output: ctest-pod-62055189 Connecting to 10.108.238.54:80 (10.108.238.54:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-17 02:19:23,789 - DEBUG - [Pod ctest-pod-13368137] Cmd: wget http://10.108.238.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.238.54:80 (10.108.238.54:80) ctest-pod-62055189 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-17 02:19:23,789 - DEBUG - [Pod Pod ctest-pod-13368137] Cmd wget http://10.108.238.54:80/ -O - -T 5 -t 1 passed 2024-10-17 02:19:23,789 - DEBUG - [Pod Pod ctest-pod-13368137] Cmd output: Connecting to 10.108.238.54:80 (10.108.238.54:80) ctest-pod-62055189 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-17 02:19:23,864 - DEBUG - [Pod ctest-pod-13368137] Cmd: wget http://10.108.238.54:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.238.54:80 (10.108.238.54:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-94003329 2024-10-17 02:19:23,864 - DEBUG - [Pod Pod ctest-pod-13368137] Cmd wget http://10.108.238.54:80/ -O - -T 5 -t 1 passed 2024-10-17 02:19:23,864 - DEBUG - [Pod Pod ctest-pod-13368137] Cmd output: Connecting to 10.108.238.54:80 (10.108.238.54:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-94003329 2024-10-17 02:19:23,864 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-62055189': 4, 'ctest-pod-94003329': 1} 2024-10-17 02:19:25,942 - DEBUG - [Pod ctest-pod-27974883] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.856 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.083 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.070/0.336/0.856 ms 2024-10-17 02:19:25,942 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-27974883 with expectation True passed 2024-10-17 02:19:28,013 - DEBUG - [Pod ctest-pod-76662257] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=2.068 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.061 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.077 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.061/0.735/2.068 ms 2024-10-17 02:19:28,014 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-76662257 with expectation True passed 2024-10-17 02:19:30,080 - DEBUG - [Pod ctest-pod-13368137] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=1.795 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.073 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.056 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.056/0.641/1.795 ms 2024-10-17 02:19:30,080 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-13368137 with expectation True passed 2024-10-17 02:19:30,162 - DEBUG - [Pod ctest-pod-27974883] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-17 02:19:30,162 - DEBUG - [Pod Pod ctest-pod-27974883] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-10-17 02:19:30,162 - DEBUG - [Pod Pod ctest-pod-27974883] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-17 02:19:30,162 - INFO - wget check of of http://10.47.255.250 from ctest-pod-27974883 passed 2024-10-17 02:19:30,233 - DEBUG - [Pod ctest-pod-27974883] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-17 02:19:30,233 - DEBUG - [Pod Pod ctest-pod-27974883] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 passed 2024-10-17 02:19:30,233 - DEBUG - [Pod Pod ctest-pod-27974883] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-17 02:19:30,233 - INFO - wget check of of http://10.47.255.249 from ctest-pod-27974883 passed 2024-10-17 02:19:35,312 - DEBUG - [Pod ctest-pod-76662257] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2024-10-17 02:19:35,312 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2024-10-17 02:19:35,312 - DEBUG - [Pod Pod ctest-pod-76662257] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2024-10-17 02:19:35,312 - INFO - wget check of of http://10.47.255.249 from ctest-pod-76662257 passed 2024-10-17 02:19:35,375 - DEBUG - [Pod ctest-pod-85380238] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-17 02:19:35,376 - DEBUG - [Pod Pod ctest-pod-85380238] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-10-17 02:19:35,376 - DEBUG - [Pod Pod ctest-pod-85380238] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-17 02:19:35,376 - INFO - wget check of of http://10.47.255.250 from ctest-pod-85380238 passed 2024-10-17 02:19:35,376 - INFO - Deleting Network Policy : ingress-on-service 2024-10-17 02:19:35,377 - INFO - Deleting service : ctest-nginx-svc-20828203 2024-10-17 02:19:35,890 - DEBUG - No XMPP flaps were noticed during the test