2024-11-07 02:06:34,039 - INFO - Using existing project ['default-domain', 'k8s-default'](57cd70f6-9a73-492f-b0d7-a10b3c9a8598) 2024-11-07 02:06:34,067 - DEBUG - Namespace ctest-new-default-04934243 not present 2024-11-07 02:06:34,075 - INFO - Created namespace ctest-new-default-04934243 2024-11-07 02:06:37,079 - DEBUG - Namespace ctest-non-default-43802443 not present 2024-11-07 02:06:37,091 - INFO - Created namespace ctest-non-default-43802443 2024-11-07 02:06:40,107 - DEBUG - Pod ctest-pod-46485602 not present 2024-11-07 02:06:40,107 - INFO - Creating Pod ctest-pod-46485602 2024-11-07 02:06:40,131 - DEBUG - Pod : ctest-pod-46485602 UUID is 2ece5269-54bc-4e61-b7fc-4771489d9ca1 2024-11-07 02:06:40,135 - DEBUG - Pod ctest-pod-60088228 not present 2024-11-07 02:06:40,135 - INFO - Creating Pod ctest-pod-60088228 2024-11-07 02:06:40,153 - DEBUG - Pod : ctest-pod-60088228 UUID is b4439ebd-d0a0-436c-9ac6-1372e0df627c 2024-11-07 02:06:40,157 - DEBUG - Pod ctest-pod-95346407 not present 2024-11-07 02:06:40,157 - INFO - Creating Pod ctest-pod-95346407 2024-11-07 02:06:40,176 - DEBUG - Pod : ctest-pod-95346407 UUID is 51f3a41b-894d-4870-8401-078f991b1053 2024-11-07 02:06:40,179 - DEBUG - Pod ctest-pod-27362253 not present 2024-11-07 02:06:40,179 - INFO - Creating Pod ctest-pod-27362253 2024-11-07 02:06:40,197 - DEBUG - Pod : ctest-pod-27362253 UUID is 72d28acd-b825-4fbe-80e0-9cf90cbfdcd6 2024-11-07 02:06:40,200 - DEBUG - Pod ctest-pod-27394338 not present 2024-11-07 02:06:40,201 - INFO - Creating Pod ctest-pod-27394338 2024-11-07 02:06:40,218 - DEBUG - Pod : ctest-pod-27394338 UUID is 40fa94e7-be96-4301-85a6-03c1cc7d5f5c 2024-11-07 02:06:40,221 - DEBUG - Pod ctest-pod-60423636 not present 2024-11-07 02:06:40,221 - INFO - Creating Pod ctest-pod-60423636 2024-11-07 02:06:40,250 - DEBUG - Pod : ctest-pod-60423636 UUID is 282a53d5-e51c-443a-8560-ffdec1e9804b 2024-11-07 02:06:40,253 - DEBUG - Pod ctest-pod-06552240 not present 2024-11-07 02:06:40,254 - INFO - Creating Pod ctest-pod-06552240 2024-11-07 02:06:40,279 - DEBUG - Pod : ctest-pod-06552240 UUID is a79a97af-8a39-41fe-896c-181c4fed9afc 2024-11-07 02:06:40,284 - DEBUG - Pod ctest-pod-93213006 not present 2024-11-07 02:06:40,284 - INFO - Creating Pod ctest-pod-93213006 2024-11-07 02:06:40,308 - DEBUG - Pod : ctest-pod-93213006 UUID is 38b535ce-f007-40cf-ac73-64f077af1a4c 2024-11-07 02:06:40,609 - INFO - Project default-domain:k8s-ctest-new-default-04934243 for Namespace ctest-new-default-04934243 is seen in contrail-api 2024-11-07 02:06:40,610 - DEBUG - Project uuid in Contrail is 7e11a58e-32bd-48f6-b362-ef2374e743cc 2024-11-07 02:06:40,837 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_NamespaceDatabaseList?namespace_uuid=3d73c5d2-ee64-4661-bd0d-d9efa098e7fb 2024-11-07 02:06:40,843 - INFO - Namespace ctest-new-default-04934243 with uuid 3d73c5d2-ee64-4661-bd0d-d9efa098e7fb found in kube manager 2024-11-07 02:06:40,843 - INFO - Namespace ctest-new-default-04934243 verification passed 2024-11-07 02:06:41,415 - INFO - Project default-domain:k8s-ctest-non-default-43802443 for Namespace ctest-non-default-43802443 is seen in contrail-api 2024-11-07 02:06:41,416 - DEBUG - Project uuid in Contrail is 94199143-47f2-4667-806f-863632e68021 2024-11-07 02:06:41,416 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_NamespaceDatabaseList?namespace_uuid=b1c79e03-30b4-4a9b-b6bd-e2c31fd88d77 2024-11-07 02:06:41,461 - INFO - Namespace ctest-non-default-43802443 with uuid b1c79e03-30b4-4a9b-b6bd-e2c31fd88d77 found in kube manager 2024-11-07 02:06:41,461 - INFO - Namespace ctest-non-default-43802443 verification passed 2024-11-07 02:06:41,468 - DEBUG - Pod ctest-pod-46485602 not in running state.Currently in Pending 2024-11-07 02:06:46,476 - DEBUG - Pod ctest-pod-46485602 not in running state.Currently in Pending 2024-11-07 02:06:51,483 - DEBUG - Pod ctest-pod-46485602 not in running state.Currently in Pending 2024-11-07 02:06:56,490 - INFO - Pod ctest-pod-46485602 is in running state.Got IP 10.47.255.250 2024-11-07 02:06:56,548 - DEBUG - Pod ctest-pod-46485602 has vmi ef5ba84a-9cac-11ef-9e47-024261271ebb 2024-11-07 02:06:56,548 - INFO - Verified pod ctest-pod-46485602 in contrail-api 2024-11-07 02:06:56,576 - DEBUG - VMI ef5ba84a-9cac-11ef-9e47-024261271ebb is active in agent 10.0.0.29 2024-11-07 02:06:56,576 - INFO - Verified Pod ctest-pod-46485602 in agent 10.0.0.29 2024-11-07 02:06:56,577 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=2ece5269-54bc-4e61-b7fc-4771489d9ca1 2024-11-07 02:06:56,584 - INFO - Pod ctest-pod-46485602 with uuid 2ece5269-54bc-4e61-b7fc-4771489d9ca1 found in kube manager 2024-11-07 02:06:56,584 - INFO - Pod ctest-pod-46485602 verification passed 2024-11-07 02:06:56,592 - INFO - Pod ctest-pod-60088228 is in running state.Got IP 10.47.255.249 2024-11-07 02:06:56,660 - DEBUG - Pod ctest-pod-60088228 has vmi f04c71bc-9cac-11ef-9e47-024261271ebb 2024-11-07 02:06:56,660 - INFO - Verified pod ctest-pod-60088228 in contrail-api 2024-11-07 02:06:56,673 - DEBUG - VMI f04c71bc-9cac-11ef-9e47-024261271ebb is active in agent 10.0.0.29 2024-11-07 02:06:56,674 - INFO - Verified Pod ctest-pod-60088228 in agent 10.0.0.29 2024-11-07 02:06:56,675 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=b4439ebd-d0a0-436c-9ac6-1372e0df627c 2024-11-07 02:06:56,686 - INFO - Pod ctest-pod-60088228 with uuid b4439ebd-d0a0-436c-9ac6-1372e0df627c found in kube manager 2024-11-07 02:06:56,686 - INFO - Pod ctest-pod-60088228 verification passed 2024-11-07 02:06:56,695 - DEBUG - Pod ctest-pod-95346407 not in running state.Currently in Pending 2024-11-07 02:07:01,922 - INFO - Pod ctest-pod-95346407 is in running state.Got IP 10.47.255.248 2024-11-07 02:07:01,990 - DEBUG - Pod ctest-pod-95346407 has vmi f187ea0c-9cac-11ef-9e47-024261271ebb 2024-11-07 02:07:01,990 - INFO - Verified pod ctest-pod-95346407 in contrail-api 2024-11-07 02:07:02,002 - DEBUG - VMI f187ea0c-9cac-11ef-9e47-024261271ebb is active in agent 10.0.0.29 2024-11-07 02:07:02,002 - INFO - Verified Pod ctest-pod-95346407 in agent 10.0.0.29 2024-11-07 02:07:02,002 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=51f3a41b-894d-4870-8401-078f991b1053 2024-11-07 02:07:02,007 - INFO - Pod ctest-pod-95346407 with uuid 51f3a41b-894d-4870-8401-078f991b1053 found in kube manager 2024-11-07 02:07:02,008 - INFO - Pod ctest-pod-95346407 verification passed 2024-11-07 02:07:02,016 - INFO - Pod ctest-pod-27362253 is in running state.Got IP 10.47.255.247 2024-11-07 02:07:02,116 - DEBUG - Pod ctest-pod-27362253 has vmi f24ae624-9cac-11ef-9e47-024261271ebb 2024-11-07 02:07:02,117 - INFO - Verified pod ctest-pod-27362253 in contrail-api 2024-11-07 02:07:02,129 - DEBUG - VMI f24ae624-9cac-11ef-9e47-024261271ebb is active in agent 10.0.0.29 2024-11-07 02:07:02,129 - INFO - Verified Pod ctest-pod-27362253 in agent 10.0.0.29 2024-11-07 02:07:02,129 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=72d28acd-b825-4fbe-80e0-9cf90cbfdcd6 2024-11-07 02:07:02,135 - INFO - Pod ctest-pod-27362253 with uuid 72d28acd-b825-4fbe-80e0-9cf90cbfdcd6 found in kube manager 2024-11-07 02:07:02,135 - INFO - Pod ctest-pod-27362253 verification passed 2024-11-07 02:07:02,141 - INFO - Pod ctest-pod-27394338 is in running state.Got IP 10.47.255.246 2024-11-07 02:07:02,249 - DEBUG - Pod ctest-pod-27394338 has vmi f325e7ba-9cac-11ef-9e47-024261271ebb 2024-11-07 02:07:02,250 - INFO - Verified pod ctest-pod-27394338 in contrail-api 2024-11-07 02:07:02,265 - DEBUG - VMI f325e7ba-9cac-11ef-9e47-024261271ebb is active in agent 10.0.0.29 2024-11-07 02:07:02,265 - INFO - Verified Pod ctest-pod-27394338 in agent 10.0.0.29 2024-11-07 02:07:02,266 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=40fa94e7-be96-4301-85a6-03c1cc7d5f5c 2024-11-07 02:07:02,282 - INFO - Pod ctest-pod-27394338 with uuid 40fa94e7-be96-4301-85a6-03c1cc7d5f5c found in kube manager 2024-11-07 02:07:02,282 - INFO - Pod ctest-pod-27394338 verification passed 2024-11-07 02:07:02,289 - INFO - Pod ctest-pod-06552240 is in running state.Got IP 10.47.255.244 2024-11-07 02:07:02,354 - DEBUG - Pod ctest-pod-06552240 has vmi f4de2e5a-9cac-11ef-9e47-024261271ebb 2024-11-07 02:07:02,355 - INFO - Verified pod ctest-pod-06552240 in contrail-api 2024-11-07 02:07:02,366 - DEBUG - VMI f4de2e5a-9cac-11ef-9e47-024261271ebb is active in agent 10.0.0.29 2024-11-07 02:07:02,366 - INFO - Verified Pod ctest-pod-06552240 in agent 10.0.0.29 2024-11-07 02:07:02,366 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=a79a97af-8a39-41fe-896c-181c4fed9afc 2024-11-07 02:07:02,371 - INFO - Pod ctest-pod-06552240 with uuid a79a97af-8a39-41fe-896c-181c4fed9afc found in kube manager 2024-11-07 02:07:02,371 - INFO - Pod ctest-pod-06552240 verification passed 2024-11-07 02:07:02,378 - INFO - Pod ctest-pod-60423636 is in running state.Got IP 10.47.255.245 2024-11-07 02:07:02,476 - DEBUG - Pod ctest-pod-60423636 has vmi f3f5519e-9cac-11ef-9e47-024261271ebb 2024-11-07 02:07:02,477 - INFO - Verified pod ctest-pod-60423636 in contrail-api 2024-11-07 02:07:02,490 - DEBUG - VMI f3f5519e-9cac-11ef-9e47-024261271ebb is active in agent 10.0.0.29 2024-11-07 02:07:02,490 - INFO - Verified Pod ctest-pod-60423636 in agent 10.0.0.29 2024-11-07 02:07:02,490 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=282a53d5-e51c-443a-8560-ffdec1e9804b 2024-11-07 02:07:02,495 - INFO - Pod ctest-pod-60423636 with uuid 282a53d5-e51c-443a-8560-ffdec1e9804b found in kube manager 2024-11-07 02:07:02,495 - INFO - Pod ctest-pod-60423636 verification passed 2024-11-07 02:07:02,501 - INFO - Pod ctest-pod-93213006 is in running state.Got IP 10.47.255.243 2024-11-07 02:07:02,599 - DEBUG - Pod ctest-pod-93213006 has vmi f5d23acc-9cac-11ef-9e47-024261271ebb 2024-11-07 02:07:02,600 - INFO - Verified pod ctest-pod-93213006 in contrail-api 2024-11-07 02:07:02,615 - DEBUG - VMI f5d23acc-9cac-11ef-9e47-024261271ebb is active in agent 10.0.0.29 2024-11-07 02:07:02,616 - INFO - Verified Pod ctest-pod-93213006 in agent 10.0.0.29 2024-11-07 02:07:02,616 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=38b535ce-f007-40cf-ac73-64f077af1a4c 2024-11-07 02:07:02,622 - INFO - Pod ctest-pod-93213006 with uuid 38b535ce-f007-40cf-ac73-64f077af1a4c found in kube manager 2024-11-07 02:07:02,622 - INFO - Pod ctest-pod-93213006 verification passed 2024-11-07 02:07:02,623 - INFO - ================================================================================ 2024-11-07 02:07:02,623 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-11-07 02:07:02,623 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-11-07 02:07:02,918 - DEBUG - Nothing to compare xmpp stats {'10.0.0.29': {'10.0.0.29': '2'}} with 2024-11-07 02:07:02,918 - INFO - Initial checks done. Running the testcase now 2024-11-07 02:07:02,919 - INFO - 2024-11-07 02:07:03,013 - DEBUG - [Pod ctest-pod-46485602] Cmd: echo ctest-pod-46485602 > /usr/share/nginx/html/index.html, Output: 2024-11-07 02:07:03,098 - DEBUG - [Pod ctest-pod-60088228] Cmd: echo ctest-pod-60088228 > /usr/share/nginx/html/index.html, Output: 2024-11-07 02:07:03,193 - DEBUG - [Pod ctest-pod-95346407] Cmd: echo ctest-pod-95346407 > /usr/share/nginx/html/index.html, Output: 2024-11-07 02:07:03,278 - DEBUG - [Pod ctest-pod-27362253] Cmd: echo ctest-pod-27362253 > /usr/share/nginx/html/index.html, Output: 2024-11-07 02:07:03,288 - DEBUG - Service ctest-nginx-svc-16800540 not present 2024-11-07 02:07:03,288 - INFO - Creating service ctest-nginx-svc-16800540 2024-11-07 02:07:03,311 - INFO - Created Service ctest-nginx-svc-16800540 2024-11-07 02:07:03,326 - WARNING - Service UUID 5bb8264b-884b-4ce8-90c7-972ca2ce8531 not yet found in contrail-api 2024-11-07 02:07:04,337 - INFO - Validated that Service ctest-nginx-svc-16800540 is seen in contrail-api 2024-11-07 02:07:04,337 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_LoadbalancerDatabaseList?x=5bb8264b-884b-4ce8-90c7-972ca2ce8531 2024-11-07 02:07:04,341 - INFO - Service ctest-nginx-svc-16800540 with uuid 5bb8264b-884b-4ce8-90c7-972ca2ce8531 found in kube manager 2024-11-07 02:07:04,341 - INFO - Service ctest-nginx-svc-16800540 verification passed 2024-11-07 02:07:05,443 - DEBUG - [Pod ctest-pod-27394338] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) writing to stdout - 100% |********************************| 19ctest-pod-60088228 0:00:00 ETA written to stdout 2024-11-07 02:07:05,443 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 passed 2024-11-07 02:07:05,443 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) writing to stdout - 100% |********************************| 19ctest-pod-60088228 0:00:00 ETA written to stdout 2024-11-07 02:07:05,530 - DEBUG - [Pod ctest-pod-27394338] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) writing to stdout ctest-pod-60088228 - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-07 02:07:05,530 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 passed 2024-11-07 02:07:05,530 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) writing to stdout ctest-pod-60088228 - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-07 02:07:05,608 - DEBUG - [Pod ctest-pod-27394338] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) writing to stdout ctest-pod-60088228 - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-07 02:07:05,608 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 passed 2024-11-07 02:07:05,608 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) writing to stdout ctest-pod-60088228 - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-07 02:07:05,685 - DEBUG - [Pod ctest-pod-27394338] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-60088228 2024-11-07 02:07:05,685 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 passed 2024-11-07 02:07:05,685 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-60088228 2024-11-07 02:07:05,786 - DEBUG - [Pod ctest-pod-27394338] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) writing to stdout ctest-pod-60088228 - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-07 02:07:05,786 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 passed 2024-11-07 02:07:05,786 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) writing to stdout ctest-pod-60088228 - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-07 02:07:05,860 - DEBUG - [Pod ctest-pod-27394338] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) ctest-pod-46485602 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-07 02:07:05,860 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 passed 2024-11-07 02:07:05,860 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) ctest-pod-46485602 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-07 02:07:05,860 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-46485602': 1, 'ctest-pod-60088228': 5} 2024-11-07 02:07:05,946 - DEBUG - [Pod ctest-pod-06552240] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-60088228 2024-11-07 02:07:05,946 - DEBUG - [Pod Pod ctest-pod-06552240] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 passed 2024-11-07 02:07:05,946 - DEBUG - [Pod Pod ctest-pod-06552240] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-60088228 2024-11-07 02:07:06,031 - DEBUG - [Pod ctest-pod-06552240] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: ctest-pod-46485602 Connecting to 10.96.39.124:80 (10.96.39.124:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-07 02:07:06,031 - DEBUG - [Pod Pod ctest-pod-06552240] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 passed 2024-11-07 02:07:06,031 - DEBUG - [Pod Pod ctest-pod-06552240] Cmd output: ctest-pod-46485602 Connecting to 10.96.39.124:80 (10.96.39.124:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-07 02:07:06,031 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-46485602': 1, 'ctest-pod-60088228': 1} 2024-11-07 02:07:06,035 - DEBUG - Network policy ingress-on-service not present 2024-11-07 02:07:06,038 - INFO - Creating Network Policy ingress-on-service 2024-11-07 02:07:06,051 - INFO - Network policy found in k8s 2024-11-07 02:07:06,052 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=c4a553c3-3a8a-486d-b2a9-0cb27428cf67 2024-11-07 02:07:06,058 - INFO - Network Policy ingress-on-service with uuid c4a553c3-3a8a-486d-b2a9-0cb27428cf67 found in kube manager 2024-11-07 02:07:06,086 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-11-07 02:07:06,087 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-11-07 02:07:06,087 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=c4a553c3-3a8a-486d-b2a9-0cb27428cf67 2024-11-07 02:07:06,115 - WARNING - Network policy with name ingress-on-service not found in agent 2024-11-07 02:07:08,116 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=c4a553c3-3a8a-486d-b2a9-0cb27428cf67 2024-11-07 02:07:08,147 - WARNING - Network policy with name ingress-on-service not found in agent 2024-11-07 02:07:10,148 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=c4a553c3-3a8a-486d-b2a9-0cb27428cf67 2024-11-07 02:07:10,175 - INFO - Network policy with name ingress-on-service found in agent 2024-11-07 02:07:10,176 - INFO - Network Policy ingress-on-service verification passed 2024-11-07 02:07:15,247 - DEBUG - [Pod ctest-pod-27394338] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:07:15,247 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:07:15,247 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:07:20,328 - DEBUG - [Pod ctest-pod-27394338] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:07:20,328 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:07:20,328 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:07:25,412 - DEBUG - [Pod ctest-pod-27394338] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:07:25,413 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:07:25,413 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:07:30,487 - DEBUG - [Pod ctest-pod-27394338] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:07:30,488 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:07:30,488 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:07:35,561 - DEBUG - [Pod ctest-pod-27394338] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:07:35,561 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:07:35,561 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:07:40,634 - DEBUG - [Pod ctest-pod-27394338] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:07:40,635 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:07:40,635 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:07:45,728 - DEBUG - [Pod ctest-pod-27394338] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:07:45,728 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:07:45,728 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:07:50,803 - DEBUG - [Pod ctest-pod-27394338] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:07:50,803 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:07:50,803 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:07:55,877 - DEBUG - [Pod ctest-pod-27394338] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:07:55,878 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:07:55,878 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:08:00,953 - DEBUG - [Pod ctest-pod-27394338] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:08:00,953 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:08:00,953 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:08:00,953 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-46485602': 0, 'ctest-pod-60088228': 0} 2024-11-07 02:08:01,022 - DEBUG - [Pod ctest-pod-60423636] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-60088228 2024-11-07 02:08:01,022 - DEBUG - [Pod Pod ctest-pod-60423636] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 passed 2024-11-07 02:08:01,022 - DEBUG - [Pod Pod ctest-pod-60423636] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-60088228 2024-11-07 02:08:01,097 - DEBUG - [Pod ctest-pod-60423636] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) ctest-pod-60088228 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-07 02:08:01,097 - DEBUG - [Pod Pod ctest-pod-60423636] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 passed 2024-11-07 02:08:01,097 - DEBUG - [Pod Pod ctest-pod-60423636] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) ctest-pod-60088228 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-07 02:08:01,169 - DEBUG - [Pod ctest-pod-60423636] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) ctest-pod-60088228 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-07 02:08:01,169 - DEBUG - [Pod Pod ctest-pod-60423636] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 passed 2024-11-07 02:08:01,169 - DEBUG - [Pod Pod ctest-pod-60423636] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) ctest-pod-60088228 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-07 02:08:01,243 - DEBUG - [Pod ctest-pod-60423636] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-60088228 2024-11-07 02:08:01,243 - DEBUG - [Pod Pod ctest-pod-60423636] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 passed 2024-11-07 02:08:01,243 - DEBUG - [Pod Pod ctest-pod-60423636] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-60088228 2024-11-07 02:08:01,313 - DEBUG - [Pod ctest-pod-60423636] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-46485602 2024-11-07 02:08:01,313 - DEBUG - [Pod Pod ctest-pod-60423636] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 passed 2024-11-07 02:08:01,313 - DEBUG - [Pod Pod ctest-pod-60423636] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-46485602 2024-11-07 02:08:01,313 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-46485602': 1, 'ctest-pod-60088228': 4} 2024-11-07 02:08:06,385 - DEBUG - [Pod ctest-pod-06552240] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:08:06,385 - DEBUG - [Pod Pod ctest-pod-06552240] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:08:06,385 - DEBUG - [Pod Pod ctest-pod-06552240] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:08:11,450 - DEBUG - [Pod ctest-pod-06552240] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:08:11,450 - DEBUG - [Pod Pod ctest-pod-06552240] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:08:11,450 - DEBUG - [Pod Pod ctest-pod-06552240] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:08:16,534 - DEBUG - [Pod ctest-pod-06552240] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:08:16,534 - DEBUG - [Pod Pod ctest-pod-06552240] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:08:16,534 - DEBUG - [Pod Pod ctest-pod-06552240] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:08:21,607 - DEBUG - [Pod ctest-pod-06552240] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:08:21,607 - DEBUG - [Pod Pod ctest-pod-06552240] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:08:21,607 - DEBUG - [Pod Pod ctest-pod-06552240] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:08:26,696 - DEBUG - [Pod ctest-pod-06552240] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:08:26,696 - DEBUG - [Pod Pod ctest-pod-06552240] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:08:26,696 - DEBUG - [Pod Pod ctest-pod-06552240] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:08:31,784 - DEBUG - [Pod ctest-pod-06552240] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:08:31,785 - DEBUG - [Pod Pod ctest-pod-06552240] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:08:31,785 - DEBUG - [Pod Pod ctest-pod-06552240] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:08:36,859 - DEBUG - [Pod ctest-pod-06552240] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:08:36,860 - DEBUG - [Pod Pod ctest-pod-06552240] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:08:36,860 - DEBUG - [Pod Pod ctest-pod-06552240] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:08:41,961 - DEBUG - [Pod ctest-pod-06552240] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:08:41,961 - DEBUG - [Pod Pod ctest-pod-06552240] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:08:41,961 - DEBUG - [Pod Pod ctest-pod-06552240] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:08:47,045 - DEBUG - [Pod ctest-pod-06552240] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:08:47,046 - DEBUG - [Pod Pod ctest-pod-06552240] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:08:47,046 - DEBUG - [Pod Pod ctest-pod-06552240] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:08:52,142 - DEBUG - [Pod ctest-pod-06552240] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:08:52,142 - DEBUG - [Pod Pod ctest-pod-06552240] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:08:52,142 - DEBUG - [Pod Pod ctest-pod-06552240] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:08:52,142 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-46485602': 0, 'ctest-pod-60088228': 0} 2024-11-07 02:08:54,215 - DEBUG - [Pod ctest-pod-60423636] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.401 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.063 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.064 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.063/0.176/0.401 ms 2024-11-07 02:08:54,215 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-60423636 with expectation True passed 2024-11-07 02:08:56,338 - DEBUG - [Pod ctest-pod-27394338] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=1.827 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.062 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.079 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.062/0.656/1.827 ms 2024-11-07 02:08:56,338 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-27394338 with expectation True passed 2024-11-07 02:08:58,430 - DEBUG - [Pod ctest-pod-06552240] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=2.064 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.062 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.076 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.062/0.734/2.064 ms 2024-11-07 02:08:58,430 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-06552240 with expectation True passed 2024-11-07 02:08:58,506 - DEBUG - [Pod ctest-pod-60423636] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-07 02:08:58,506 - DEBUG - [Pod Pod ctest-pod-60423636] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-11-07 02:08:58,506 - DEBUG - [Pod Pod ctest-pod-60423636] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-07 02:08:58,506 - INFO - wget check of of http://10.47.255.250 from ctest-pod-60423636 passed 2024-11-07 02:08:58,601 - DEBUG - [Pod ctest-pod-60423636] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-07 02:08:58,601 - DEBUG - [Pod Pod ctest-pod-60423636] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 passed 2024-11-07 02:08:58,601 - DEBUG - [Pod Pod ctest-pod-60423636] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-07 02:08:58,601 - INFO - wget check of of http://10.47.255.249 from ctest-pod-60423636 passed 2024-11-07 02:09:03,680 - DEBUG - [Pod ctest-pod-27394338] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2024-11-07 02:09:03,680 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2024-11-07 02:09:03,680 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2024-11-07 02:09:03,680 - INFO - wget check of of http://10.47.255.249 from ctest-pod-27394338 passed 2024-11-07 02:09:08,770 - DEBUG - [Pod ctest-pod-93213006] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-07 02:09:08,771 - DEBUG - [Pod Pod ctest-pod-93213006] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-07 02:09:08,771 - DEBUG - [Pod Pod ctest-pod-93213006] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-11-07 02:09:08,771 - INFO - wget check of of http://10.47.255.250 from ctest-pod-93213006 passed 2024-11-07 02:09:08,781 - INFO - Updating Network Policy ingress-on-service 2024-11-07 02:09:13,869 - DEBUG - [Pod ctest-pod-27394338] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:09:13,869 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:09:13,869 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:09:18,943 - DEBUG - [Pod ctest-pod-27394338] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:09:18,944 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:09:18,944 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:09:24,020 - DEBUG - [Pod ctest-pod-27394338] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:09:24,020 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:09:24,020 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:09:29,086 - DEBUG - [Pod ctest-pod-27394338] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:09:29,086 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:09:29,086 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:09:34,157 - DEBUG - [Pod ctest-pod-27394338] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:09:34,157 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:09:34,158 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:09:39,242 - DEBUG - [Pod ctest-pod-27394338] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:09:39,242 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:09:39,242 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:09:44,319 - DEBUG - [Pod ctest-pod-27394338] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:09:44,319 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:09:44,320 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:09:49,396 - DEBUG - [Pod ctest-pod-27394338] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:09:49,396 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:09:49,396 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:09:54,466 - DEBUG - [Pod ctest-pod-27394338] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:09:54,466 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:09:54,466 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:09:59,542 - DEBUG - [Pod ctest-pod-27394338] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:09:59,543 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:09:59,543 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) wget: download timed out 2024-11-07 02:09:59,543 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-46485602': 0, 'ctest-pod-60088228': 0} 2024-11-07 02:09:59,620 - DEBUG - [Pod ctest-pod-60423636] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) ctest-pod-46485602 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-07 02:09:59,620 - DEBUG - [Pod Pod ctest-pod-60423636] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 passed 2024-11-07 02:09:59,620 - DEBUG - [Pod Pod ctest-pod-60423636] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) ctest-pod-46485602 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-07 02:09:59,700 - DEBUG - [Pod ctest-pod-60423636] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-46485602 2024-11-07 02:09:59,700 - DEBUG - [Pod Pod ctest-pod-60423636] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 passed 2024-11-07 02:09:59,700 - DEBUG - [Pod Pod ctest-pod-60423636] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-46485602 2024-11-07 02:09:59,766 - DEBUG - [Pod ctest-pod-60423636] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) ctest-pod-60088228 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-07 02:09:59,766 - DEBUG - [Pod Pod ctest-pod-60423636] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 passed 2024-11-07 02:09:59,766 - DEBUG - [Pod Pod ctest-pod-60423636] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) ctest-pod-60088228 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-07 02:09:59,767 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-46485602': 2, 'ctest-pod-60088228': 1} 2024-11-07 02:09:59,834 - DEBUG - [Pod ctest-pod-06552240] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: ctest-pod-60088228 Connecting to 10.96.39.124:80 (10.96.39.124:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-07 02:09:59,834 - DEBUG - [Pod Pod ctest-pod-06552240] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 passed 2024-11-07 02:09:59,834 - DEBUG - [Pod Pod ctest-pod-06552240] Cmd output: ctest-pod-60088228 Connecting to 10.96.39.124:80 (10.96.39.124:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-07 02:09:59,908 - DEBUG - [Pod ctest-pod-06552240] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) ctest-pod-60088228 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-07 02:09:59,908 - DEBUG - [Pod Pod ctest-pod-06552240] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 passed 2024-11-07 02:09:59,908 - DEBUG - [Pod Pod ctest-pod-06552240] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) ctest-pod-60088228 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-07 02:09:59,997 - DEBUG - [Pod ctest-pod-06552240] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-60088228 2024-11-07 02:09:59,997 - DEBUG - [Pod Pod ctest-pod-06552240] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 passed 2024-11-07 02:09:59,997 - DEBUG - [Pod Pod ctest-pod-06552240] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-60088228 2024-11-07 02:10:00,070 - DEBUG - [Pod ctest-pod-06552240] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-60088228 2024-11-07 02:10:00,070 - DEBUG - [Pod Pod ctest-pod-06552240] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 passed 2024-11-07 02:10:00,070 - DEBUG - [Pod Pod ctest-pod-06552240] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-60088228 2024-11-07 02:10:00,153 - DEBUG - [Pod ctest-pod-06552240] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-60088228 2024-11-07 02:10:00,153 - DEBUG - [Pod Pod ctest-pod-06552240] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 passed 2024-11-07 02:10:00,153 - DEBUG - [Pod Pod ctest-pod-06552240] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-60088228 2024-11-07 02:10:00,239 - DEBUG - [Pod ctest-pod-06552240] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: ctest-pod-60088228 Connecting to 10.96.39.124:80 (10.96.39.124:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-07 02:10:00,239 - DEBUG - [Pod Pod ctest-pod-06552240] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 passed 2024-11-07 02:10:00,240 - DEBUG - [Pod Pod ctest-pod-06552240] Cmd output: ctest-pod-60088228 Connecting to 10.96.39.124:80 (10.96.39.124:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-07 02:10:00,315 - DEBUG - [Pod ctest-pod-06552240] Cmd: wget http://10.96.39.124:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.39.124:80 (10.96.39.124:80) ctest-pod-46485602 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-07 02:10:00,315 - DEBUG - [Pod Pod ctest-pod-06552240] Cmd wget http://10.96.39.124:80/ -O - -T 5 -t 1 passed 2024-11-07 02:10:00,315 - DEBUG - [Pod Pod ctest-pod-06552240] Cmd output: Connecting to 10.96.39.124:80 (10.96.39.124:80) ctest-pod-46485602 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-11-07 02:10:00,315 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-46485602': 1, 'ctest-pod-60088228': 6} 2024-11-07 02:10:02,391 - DEBUG - [Pod ctest-pod-60423636] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.094 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.079 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.077 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.077/0.416/1.094 ms 2024-11-07 02:10:02,391 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-60423636 with expectation True passed 2024-11-07 02:10:04,483 - DEBUG - [Pod ctest-pod-27394338] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=2.310 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.057 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.102 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.057/0.823/2.310 ms 2024-11-07 02:10:04,483 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-27394338 with expectation True passed 2024-11-07 02:10:06,557 - DEBUG - [Pod ctest-pod-06552240] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.741 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.090 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.073 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.073/0.301/0.741 ms 2024-11-07 02:10:06,557 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-06552240 with expectation True passed 2024-11-07 02:10:06,632 - DEBUG - [Pod ctest-pod-60423636] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-07 02:10:06,632 - DEBUG - [Pod Pod ctest-pod-60423636] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-11-07 02:10:06,632 - DEBUG - [Pod Pod ctest-pod-60423636] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-07 02:10:06,632 - INFO - wget check of of http://10.47.255.250 from ctest-pod-60423636 passed 2024-11-07 02:10:06,699 - DEBUG - [Pod ctest-pod-60423636] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-07 02:10:06,699 - DEBUG - [Pod Pod ctest-pod-60423636] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 passed 2024-11-07 02:10:06,699 - DEBUG - [Pod Pod ctest-pod-60423636] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-07 02:10:06,699 - INFO - wget check of of http://10.47.255.249 from ctest-pod-60423636 passed 2024-11-07 02:10:11,770 - DEBUG - [Pod ctest-pod-27394338] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2024-11-07 02:10:11,770 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2024-11-07 02:10:11,770 - DEBUG - [Pod Pod ctest-pod-27394338] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2024-11-07 02:10:11,770 - INFO - wget check of of http://10.47.255.249 from ctest-pod-27394338 passed 2024-11-07 02:10:11,837 - DEBUG - [Pod ctest-pod-93213006] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-07 02:10:11,838 - DEBUG - [Pod Pod ctest-pod-93213006] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-11-07 02:10:11,838 - DEBUG - [Pod Pod ctest-pod-93213006] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-11-07 02:10:11,838 - INFO - wget check of of http://10.47.255.250 from ctest-pod-93213006 passed 2024-11-07 02:10:11,839 - INFO - Deleting Network Policy : ingress-on-service 2024-11-07 02:10:11,840 - INFO - Deleting service : ctest-nginx-svc-16800540 2024-11-07 02:10:12,384 - DEBUG - No XMPP flaps were noticed during the test

2024-11-07 02:10:12,385 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:10]

2024-11-07 02:10:12,385 - INFO - -------------------------------------------------------------------------------- 2024-11-07 02:10:12,390 - INFO - Deleting pod ctest-new-default-04934243:ctest-pod-46485602 2024-11-07 02:10:12,391 - INFO - Deleting pod ctest-new-default-04934243:ctest-pod-60088228 2024-11-07 02:10:12,391 - INFO - Deleting pod ctest-non-default-43802443:ctest-pod-95346407 2024-11-07 02:10:12,391 - INFO - Deleting pod ctest-non-default-43802443:ctest-pod-27362253 2024-11-07 02:10:12,392 - INFO - Deleting pod ctest-new-default-04934243:ctest-pod-27394338 2024-11-07 02:10:12,392 - INFO - Deleting pod ctest-new-default-04934243:ctest-pod-60423636 2024-11-07 02:10:12,392 - INFO - Deleting pod ctest-non-default-43802443:ctest-pod-06552240 2024-11-07 02:10:12,393 - INFO - Deleting pod ctest-non-default-43802443:ctest-pod-93213006 2024-11-07 02:10:12,513 - WARNING - Pod uuid 2ece5269-54bc-4e61-b7fc-4771489d9ca1 is still seen in agent 10.0.0.29 VM list 2024-11-07 02:10:12,515 - WARNING - Pod uuid b4439ebd-d0a0-436c-9ac6-1372e0df627c is still seen in agent 10.0.0.29 VM list 2024-11-07 02:10:12,531 - WARNING - Pod uuid a79a97af-8a39-41fe-896c-181c4fed9afc is still seen in agent 10.0.0.29 VM list 2024-11-07 02:10:12,531 - WARNING - Pod uuid 282a53d5-e51c-443a-8560-ffdec1e9804b is still seen in agent 10.0.0.29 VM list 2024-11-07 02:10:12,555 - WARNING - Pod uuid 72d28acd-b825-4fbe-80e0-9cf90cbfdcd6 is still seen in agent 10.0.0.29 VM list 2024-11-07 02:10:12,560 - WARNING - Pod uuid 40fa94e7-be96-4301-85a6-03c1cc7d5f5c is still seen in agent 10.0.0.29 VM list 2024-11-07 02:10:12,561 - WARNING - Pod uuid 51f3a41b-894d-4870-8401-078f991b1053 is still seen in agent 10.0.0.29 VM list 2024-11-07 02:10:12,561 - WARNING - Pod uuid 38b535ce-f007-40cf-ac73-64f077af1a4c is still seen in agent 10.0.0.29 VM list 2024-11-07 02:10:17,524 - WARNING - Pod uuid b4439ebd-d0a0-436c-9ac6-1372e0df627c is still seen in agent 10.0.0.29 VM list 2024-11-07 02:10:17,525 - DEBUG - Pod 2ece5269-54bc-4e61-b7fc-4771489d9ca1 is not in agent 10.0.0.29 VM list 2024-11-07 02:10:17,531 - DEBUG - VMI ef5ba84a-9cac-11ef-9e47-024261271ebb is removed from agent 10.0.0.29 2024-11-07 02:10:17,531 - INFO - Verified that pod ctest-pod-46485602 is removed in agent 2024-11-07 02:10:17,540 - WARNING - Pod uuid a79a97af-8a39-41fe-896c-181c4fed9afc is still seen in agent 10.0.0.29 VM list 2024-11-07 02:10:17,541 - WARNING - Pod uuid 282a53d5-e51c-443a-8560-ffdec1e9804b is still seen in agent 10.0.0.29 VM list 2024-11-07 02:10:17,567 - DEBUG - Pod 72d28acd-b825-4fbe-80e0-9cf90cbfdcd6 is not in agent 10.0.0.29 VM list 2024-11-07 02:10:17,580 - WARNING - Pod uuid 40fa94e7-be96-4301-85a6-03c1cc7d5f5c is still seen in agent 10.0.0.29 VM list 2024-11-07 02:10:17,582 - DEBUG - VMI f24ae624-9cac-11ef-9e47-024261271ebb is removed from agent 10.0.0.29 2024-11-07 02:10:17,582 - INFO - Verified that pod ctest-pod-27362253 is removed in agent 2024-11-07 02:10:17,582 - WARNING - Pod uuid 38b535ce-f007-40cf-ac73-64f077af1a4c is still seen in agent 10.0.0.29 VM list 2024-11-07 02:10:17,583 - DEBUG - Pod 51f3a41b-894d-4870-8401-078f991b1053 is not in agent 10.0.0.29 VM list 2024-11-07 02:10:17,589 - DEBUG - VMI f187ea0c-9cac-11ef-9e47-024261271ebb is removed from agent 10.0.0.29 2024-11-07 02:10:17,589 - INFO - Verified that pod ctest-pod-95346407 is removed in agent 2024-11-07 02:10:22,531 - WARNING - Pod uuid b4439ebd-d0a0-436c-9ac6-1372e0df627c is still seen in agent 10.0.0.29 VM list 2024-11-07 02:10:22,550 - WARNING - Pod uuid 282a53d5-e51c-443a-8560-ffdec1e9804b is still seen in agent 10.0.0.29 VM list 2024-11-07 02:10:22,551 - WARNING - Pod uuid a79a97af-8a39-41fe-896c-181c4fed9afc is still seen in agent 10.0.0.29 VM list 2024-11-07 02:10:22,591 - WARNING - Pod uuid 38b535ce-f007-40cf-ac73-64f077af1a4c is still seen in agent 10.0.0.29 VM list 2024-11-07 02:10:22,592 - WARNING - Pod uuid 40fa94e7-be96-4301-85a6-03c1cc7d5f5c is still seen in agent 10.0.0.29 VM list 2024-11-07 02:10:27,538 - WARNING - Pod uuid b4439ebd-d0a0-436c-9ac6-1372e0df627c is still seen in agent 10.0.0.29 VM list 2024-11-07 02:10:27,560 - WARNING - Pod uuid 282a53d5-e51c-443a-8560-ffdec1e9804b is still seen in agent 10.0.0.29 VM list 2024-11-07 02:10:27,561 - WARNING - Pod uuid a79a97af-8a39-41fe-896c-181c4fed9afc is still seen in agent 10.0.0.29 VM list 2024-11-07 02:10:27,601 - WARNING - Pod uuid 38b535ce-f007-40cf-ac73-64f077af1a4c is still seen in agent 10.0.0.29 VM list 2024-11-07 02:10:27,602 - WARNING - Pod uuid 40fa94e7-be96-4301-85a6-03c1cc7d5f5c is still seen in agent 10.0.0.29 VM list 2024-11-07 02:10:32,547 - WARNING - Pod uuid b4439ebd-d0a0-436c-9ac6-1372e0df627c is still seen in agent 10.0.0.29 VM list 2024-11-07 02:10:32,571 - WARNING - Pod uuid 282a53d5-e51c-443a-8560-ffdec1e9804b is still seen in agent 10.0.0.29 VM list 2024-11-07 02:10:32,572 - WARNING - Pod uuid a79a97af-8a39-41fe-896c-181c4fed9afc is still seen in agent 10.0.0.29 VM list 2024-11-07 02:10:32,612 - WARNING - Pod uuid 38b535ce-f007-40cf-ac73-64f077af1a4c is still seen in agent 10.0.0.29 VM list 2024-11-07 02:10:32,613 - WARNING - Pod uuid 40fa94e7-be96-4301-85a6-03c1cc7d5f5c is still seen in agent 10.0.0.29 VM list 2024-11-07 02:10:37,553 - WARNING - Pod uuid b4439ebd-d0a0-436c-9ac6-1372e0df627c is still seen in agent 10.0.0.29 VM list 2024-11-07 02:10:37,584 - WARNING - Pod uuid a79a97af-8a39-41fe-896c-181c4fed9afc is still seen in agent 10.0.0.29 VM list 2024-11-07 02:10:37,584 - WARNING - Pod uuid 282a53d5-e51c-443a-8560-ffdec1e9804b is still seen in agent 10.0.0.29 VM list 2024-11-07 02:10:37,624 - WARNING - Pod uuid 40fa94e7-be96-4301-85a6-03c1cc7d5f5c is still seen in agent 10.0.0.29 VM list 2024-11-07 02:10:37,625 - WARNING - Pod uuid 38b535ce-f007-40cf-ac73-64f077af1a4c is still seen in agent 10.0.0.29 VM list 2024-11-07 02:10:42,560 - WARNING - Pod uuid b4439ebd-d0a0-436c-9ac6-1372e0df627c is still seen in agent 10.0.0.29 VM list 2024-11-07 02:10:42,606 - WARNING - Pod uuid 282a53d5-e51c-443a-8560-ffdec1e9804b is still seen in agent 10.0.0.29 VM list 2024-11-07 02:10:42,607 - WARNING - Pod uuid a79a97af-8a39-41fe-896c-181c4fed9afc is still seen in agent 10.0.0.29 VM list 2024-11-07 02:10:42,643 - WARNING - Pod uuid 38b535ce-f007-40cf-ac73-64f077af1a4c is still seen in agent 10.0.0.29 VM list 2024-11-07 02:10:42,644 - WARNING - Pod uuid 40fa94e7-be96-4301-85a6-03c1cc7d5f5c is still seen in agent 10.0.0.29 VM list 2024-11-07 02:10:47,567 - DEBUG - Pod b4439ebd-d0a0-436c-9ac6-1372e0df627c is not in agent 10.0.0.29 VM list 2024-11-07 02:10:47,574 - DEBUG - VMI f04c71bc-9cac-11ef-9e47-024261271ebb is removed from agent 10.0.0.29 2024-11-07 02:10:47,574 - INFO - Verified that pod ctest-pod-60088228 is removed in agent 2024-11-07 02:10:47,617 - DEBUG - Pod a79a97af-8a39-41fe-896c-181c4fed9afc is not in agent 10.0.0.29 VM list 2024-11-07 02:10:47,623 - DEBUG - Pod 282a53d5-e51c-443a-8560-ffdec1e9804b is not in agent 10.0.0.29 VM list 2024-11-07 02:10:47,626 - DEBUG - VMI f4de2e5a-9cac-11ef-9e47-024261271ebb is removed from agent 10.0.0.29 2024-11-07 02:10:47,626 - INFO - Verified that pod ctest-pod-06552240 is removed in agent 2024-11-07 02:10:47,630 - DEBUG - VMI f3f5519e-9cac-11ef-9e47-024261271ebb is removed from agent 10.0.0.29 2024-11-07 02:10:47,630 - INFO - Verified that pod ctest-pod-60423636 is removed in agent 2024-11-07 02:10:47,654 - DEBUG - Pod 40fa94e7-be96-4301-85a6-03c1cc7d5f5c is not in agent 10.0.0.29 VM list 2024-11-07 02:10:47,656 - DEBUG - Pod 38b535ce-f007-40cf-ac73-64f077af1a4c is not in agent 10.0.0.29 VM list 2024-11-07 02:10:47,664 - DEBUG - VMI f325e7ba-9cac-11ef-9e47-024261271ebb is removed from agent 10.0.0.29 2024-11-07 02:10:47,664 - INFO - Verified that pod ctest-pod-27394338 is removed in agent 2024-11-07 02:10:47,665 - DEBUG - VMI f5d23acc-9cac-11ef-9e47-024261271ebb is removed from agent 10.0.0.29 2024-11-07 02:10:47,665 - INFO - Verified that pod ctest-pod-93213006 is removed in agent 2024-11-07 02:10:47,665 - INFO - Deleting namespace ctest-non-default-43802443 2024-11-07 02:10:47,675 - DEBUG - Namespace ctest-non-default-43802443 still in k8s 2024-11-07 02:10:49,681 - DEBUG - Namespace ctest-non-default-43802443 still in k8s 2024-11-07 02:10:51,686 - DEBUG - Namespace ctest-non-default-43802443 still in k8s 2024-11-07 02:10:53,690 - DEBUG - Namespace ctest-non-default-43802443 is not in k8s 2024-11-07 02:10:53,690 - DEBUG - No need to check project deletion in contrail-api 2024-11-07 02:10:53,690 - INFO - Deleting namespace ctest-new-default-04934243 2024-11-07 02:10:53,704 - DEBUG - Namespace ctest-new-default-04934243 still in k8s 2024-11-07 02:10:55,709 - DEBUG - Namespace ctest-new-default-04934243 still in k8s 2024-11-07 02:10:57,715 - DEBUG - Namespace ctest-new-default-04934243 still in k8s 2024-11-07 02:10:59,720 - DEBUG - Namespace ctest-new-default-04934243 is not in k8s 2024-11-07 02:10:59,720 - DEBUG - No need to check project deletion in contrail-api