2024-10-28 01:52:41,358 - INFO - Using existing project ['default-domain', 'k8s-default'](a5908ba5-9d71-46bb-83fa-28493f0adc03) 2024-10-28 01:52:41,386 - DEBUG - Namespace ctest-new-default-99499365 not present 2024-10-28 01:52:41,398 - INFO - Created namespace ctest-new-default-99499365 2024-10-28 01:52:44,403 - DEBUG - Namespace ctest-non-default-78442212 not present 2024-10-28 01:52:44,413 - INFO - Created namespace ctest-non-default-78442212 2024-10-28 01:52:47,433 - DEBUG - Pod ctest-pod-91584451 not present 2024-10-28 01:52:47,434 - INFO - Creating Pod ctest-pod-91584451 2024-10-28 01:52:47,459 - DEBUG - Pod : ctest-pod-91584451 UUID is 61b3affe-b6dc-4726-b8cb-caf70fbc51e5 2024-10-28 01:52:47,464 - DEBUG - Pod ctest-pod-87852359 not present 2024-10-28 01:52:47,464 - INFO - Creating Pod ctest-pod-87852359 2024-10-28 01:52:47,485 - DEBUG - Pod : ctest-pod-87852359 UUID is b30c98e0-8ab2-420c-ab3a-922f54552a14 2024-10-28 01:52:47,494 - DEBUG - Pod ctest-pod-22733180 not present 2024-10-28 01:52:47,495 - INFO - Creating Pod ctest-pod-22733180 2024-10-28 01:52:47,518 - DEBUG - Pod : ctest-pod-22733180 UUID is 546198af-85f6-4e9e-a794-06f9170d0539 2024-10-28 01:52:47,523 - DEBUG - Pod ctest-pod-66749219 not present 2024-10-28 01:52:47,523 - INFO - Creating Pod ctest-pod-66749219 2024-10-28 01:52:47,549 - DEBUG - Pod : ctest-pod-66749219 UUID is d18a029f-b5fd-41b6-bbb7-6bbffe505d3c 2024-10-28 01:52:47,554 - DEBUG - Pod ctest-pod-08280230 not present 2024-10-28 01:52:47,555 - INFO - Creating Pod ctest-pod-08280230 2024-10-28 01:52:47,583 - DEBUG - Pod : ctest-pod-08280230 UUID is 8ed23183-1092-4e5e-834e-018a31680876 2024-10-28 01:52:47,588 - DEBUG - Pod ctest-pod-12234574 not present 2024-10-28 01:52:47,588 - INFO - Creating Pod ctest-pod-12234574 2024-10-28 01:52:47,619 - DEBUG - Pod : ctest-pod-12234574 UUID is 06ff3838-97be-45f9-93a3-ed9c7a05cc33 2024-10-28 01:52:47,622 - DEBUG - Pod ctest-pod-27670065 not present 2024-10-28 01:52:47,623 - INFO - Creating Pod ctest-pod-27670065 2024-10-28 01:52:47,657 - DEBUG - Pod : ctest-pod-27670065 UUID is be871133-df68-4c52-9936-c3040ac2603f 2024-10-28 01:52:47,668 - DEBUG - Pod ctest-pod-11907252 not present 2024-10-28 01:52:47,668 - INFO - Creating Pod ctest-pod-11907252 2024-10-28 01:52:47,690 - DEBUG - Pod : ctest-pod-11907252 UUID is 2339be5e-a2e9-494c-a3a8-13c14fb30df8 2024-10-28 01:52:48,077 - INFO - Project default-domain:k8s-ctest-new-default-99499365 for Namespace ctest-new-default-99499365 is seen in contrail-api 2024-10-28 01:52:48,077 - DEBUG - Project uuid in Contrail is a223b560-a164-4f66-baa9-f26b1f6f89e2 2024-10-28 01:52:48,518 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=d13af359-7aca-4a89-8cef-82be3145978b 2024-10-28 01:52:48,566 - INFO - Namespace ctest-new-default-99499365 with uuid d13af359-7aca-4a89-8cef-82be3145978b found in kube manager 2024-10-28 01:52:48,566 - INFO - Namespace ctest-new-default-99499365 verification passed 2024-10-28 01:52:49,166 - INFO - Project default-domain:k8s-ctest-non-default-78442212 for Namespace ctest-non-default-78442212 is seen in contrail-api 2024-10-28 01:52:49,166 - DEBUG - Project uuid in Contrail is 19580f0b-364a-488e-980b-7b6ab68dfb9d 2024-10-28 01:52:49,166 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=3326f3d4-5a6b-4e24-914b-0ac310aadb7c 2024-10-28 01:52:49,172 - INFO - Namespace ctest-non-default-78442212 with uuid 3326f3d4-5a6b-4e24-914b-0ac310aadb7c found in kube manager 2024-10-28 01:52:49,172 - INFO - Namespace ctest-non-default-78442212 verification passed 2024-10-28 01:52:49,179 - DEBUG - Pod ctest-pod-91584451 not in running state.Currently in Pending 2024-10-28 01:52:54,187 - DEBUG - Pod ctest-pod-91584451 not in running state.Currently in Pending 2024-10-28 01:52:59,198 - INFO - Pod ctest-pod-91584451 is in running state.Got IP 10.47.255.250 2024-10-28 01:52:59,265 - DEBUG - Pod ctest-pod-91584451 has vmi 573d8b08-94cf-11ef-bc8e-0242a74f58e7 2024-10-28 01:52:59,265 - INFO - Verified pod ctest-pod-91584451 in contrail-api 2024-10-28 01:52:59,290 - DEBUG - VMI 573d8b08-94cf-11ef-bc8e-0242a74f58e7 is active in agent 10.0.0.22 2024-10-28 01:52:59,291 - INFO - Verified Pod ctest-pod-91584451 in agent 10.0.0.22 2024-10-28 01:52:59,291 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=61b3affe-b6dc-4726-b8cb-caf70fbc51e5 2024-10-28 01:52:59,302 - INFO - Pod ctest-pod-91584451 with uuid 61b3affe-b6dc-4726-b8cb-caf70fbc51e5 found in kube manager 2024-10-28 01:52:59,303 - INFO - Pod ctest-pod-91584451 verification passed 2024-10-28 01:52:59,309 - DEBUG - Pod ctest-pod-87852359 not in running state.Currently in Pending 2024-10-28 01:53:04,319 - DEBUG - Pod ctest-pod-87852359 not in running state.Currently in Pending 2024-10-28 01:53:09,327 - INFO - Pod ctest-pod-87852359 is in running state.Got IP 10.47.255.249 2024-10-28 01:53:09,396 - DEBUG - Pod ctest-pod-87852359 has vmi 5811a51e-94cf-11ef-bc8e-0242a74f58e7 2024-10-28 01:53:09,396 - INFO - Verified pod ctest-pod-87852359 in contrail-api 2024-10-28 01:53:09,413 - DEBUG - VMI 5811a51e-94cf-11ef-bc8e-0242a74f58e7 is active in agent 10.0.0.22 2024-10-28 01:53:09,413 - INFO - Verified Pod ctest-pod-87852359 in agent 10.0.0.22 2024-10-28 01:53:09,413 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=b30c98e0-8ab2-420c-ab3a-922f54552a14 2024-10-28 01:53:09,420 - INFO - Pod ctest-pod-87852359 with uuid b30c98e0-8ab2-420c-ab3a-922f54552a14 found in kube manager 2024-10-28 01:53:09,420 - INFO - Pod ctest-pod-87852359 verification passed 2024-10-28 01:53:09,430 - INFO - Pod ctest-pod-22733180 is in running state.Got IP 10.47.255.248 2024-10-28 01:53:09,530 - DEBUG - Pod ctest-pod-22733180 has vmi 5937a484-94cf-11ef-bc8e-0242a74f58e7 2024-10-28 01:53:09,530 - INFO - Verified pod ctest-pod-22733180 in contrail-api 2024-10-28 01:53:09,546 - DEBUG - VMI 5937a484-94cf-11ef-bc8e-0242a74f58e7 is active in agent 10.0.0.22 2024-10-28 01:53:09,546 - INFO - Verified Pod ctest-pod-22733180 in agent 10.0.0.22 2024-10-28 01:53:09,546 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=546198af-85f6-4e9e-a794-06f9170d0539 2024-10-28 01:53:09,552 - INFO - Pod ctest-pod-22733180 with uuid 546198af-85f6-4e9e-a794-06f9170d0539 found in kube manager 2024-10-28 01:53:09,552 - INFO - Pod ctest-pod-22733180 verification passed 2024-10-28 01:53:09,560 - INFO - Pod ctest-pod-66749219 is in running state.Got IP 10.47.255.247 2024-10-28 01:53:09,668 - DEBUG - Pod ctest-pod-66749219 has vmi 59fccf7a-94cf-11ef-bc8e-0242a74f58e7 2024-10-28 01:53:09,668 - INFO - Verified pod ctest-pod-66749219 in contrail-api 2024-10-28 01:53:09,684 - DEBUG - VMI 59fccf7a-94cf-11ef-bc8e-0242a74f58e7 is active in agent 10.0.0.22 2024-10-28 01:53:09,684 - INFO - Verified Pod ctest-pod-66749219 in agent 10.0.0.22 2024-10-28 01:53:09,685 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=d18a029f-b5fd-41b6-bbb7-6bbffe505d3c 2024-10-28 01:53:09,690 - INFO - Pod ctest-pod-66749219 with uuid d18a029f-b5fd-41b6-bbb7-6bbffe505d3c found in kube manager 2024-10-28 01:53:09,691 - INFO - Pod ctest-pod-66749219 verification passed 2024-10-28 01:53:09,698 - INFO - Pod ctest-pod-08280230 is in running state.Got IP 10.47.255.246 2024-10-28 01:53:09,799 - DEBUG - Pod ctest-pod-08280230 has vmi 5ae26e2c-94cf-11ef-bc8e-0242a74f58e7 2024-10-28 01:53:09,799 - INFO - Verified pod ctest-pod-08280230 in contrail-api 2024-10-28 01:53:09,817 - DEBUG - VMI 5ae26e2c-94cf-11ef-bc8e-0242a74f58e7 is active in agent 10.0.0.22 2024-10-28 01:53:09,817 - INFO - Verified Pod ctest-pod-08280230 in agent 10.0.0.22 2024-10-28 01:53:09,817 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=8ed23183-1092-4e5e-834e-018a31680876 2024-10-28 01:53:09,825 - INFO - Pod ctest-pod-08280230 with uuid 8ed23183-1092-4e5e-834e-018a31680876 found in kube manager 2024-10-28 01:53:09,825 - INFO - Pod ctest-pod-08280230 verification passed 2024-10-28 01:53:09,836 - INFO - Pod ctest-pod-27670065 is in running state.Got IP 10.47.255.244 2024-10-28 01:53:09,907 - DEBUG - Pod ctest-pod-27670065 has vmi 5cc6800c-94cf-11ef-bc8e-0242a74f58e7 2024-10-28 01:53:09,907 - INFO - Verified pod ctest-pod-27670065 in contrail-api 2024-10-28 01:53:09,923 - DEBUG - VMI 5cc6800c-94cf-11ef-bc8e-0242a74f58e7 is active in agent 10.0.0.22 2024-10-28 01:53:09,924 - INFO - Verified Pod ctest-pod-27670065 in agent 10.0.0.22 2024-10-28 01:53:09,924 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=be871133-df68-4c52-9936-c3040ac2603f 2024-10-28 01:53:09,932 - INFO - Pod ctest-pod-27670065 with uuid be871133-df68-4c52-9936-c3040ac2603f found in kube manager 2024-10-28 01:53:09,932 - INFO - Pod ctest-pod-27670065 verification passed 2024-10-28 01:53:09,943 - INFO - Pod ctest-pod-12234574 is in running state.Got IP 10.47.255.245 2024-10-28 01:53:10,021 - DEBUG - Pod ctest-pod-12234574 has vmi 5bdf6c3a-94cf-11ef-bc8e-0242a74f58e7 2024-10-28 01:53:10,021 - INFO - Verified pod ctest-pod-12234574 in contrail-api 2024-10-28 01:53:10,037 - DEBUG - VMI 5bdf6c3a-94cf-11ef-bc8e-0242a74f58e7 is active in agent 10.0.0.22 2024-10-28 01:53:10,038 - INFO - Verified Pod ctest-pod-12234574 in agent 10.0.0.22 2024-10-28 01:53:10,038 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=06ff3838-97be-45f9-93a3-ed9c7a05cc33 2024-10-28 01:53:10,046 - INFO - Pod ctest-pod-12234574 with uuid 06ff3838-97be-45f9-93a3-ed9c7a05cc33 found in kube manager 2024-10-28 01:53:10,046 - INFO - Pod ctest-pod-12234574 verification passed 2024-10-28 01:53:10,053 - INFO - Pod ctest-pod-11907252 is in running state.Got IP 10.47.255.243 2024-10-28 01:53:10,153 - DEBUG - Pod ctest-pod-11907252 has vmi 5da75014-94cf-11ef-bc8e-0242a74f58e7 2024-10-28 01:53:10,153 - INFO - Verified pod ctest-pod-11907252 in contrail-api 2024-10-28 01:53:10,167 - DEBUG - VMI 5da75014-94cf-11ef-bc8e-0242a74f58e7 is active in agent 10.0.0.22 2024-10-28 01:53:10,168 - INFO - Verified Pod ctest-pod-11907252 in agent 10.0.0.22 2024-10-28 01:53:10,168 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=2339be5e-a2e9-494c-a3a8-13c14fb30df8 2024-10-28 01:53:10,175 - INFO - Pod ctest-pod-11907252 with uuid 2339be5e-a2e9-494c-a3a8-13c14fb30df8 found in kube manager 2024-10-28 01:53:10,175 - INFO - Pod ctest-pod-11907252 verification passed 2024-10-28 01:53:10,175 - INFO - ================================================================================ 2024-10-28 01:53:10,175 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-10-28 01:53:10,176 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-10-28 01:53:10,458 - DEBUG - Nothing to compare xmpp stats {'10.0.0.22': {'10.0.0.22': '2'}} with 2024-10-28 01:53:10,458 - INFO - Initial checks done. Running the testcase now 2024-10-28 01:53:10,458 - INFO - 2024-10-28 01:53:10,541 - DEBUG - [Pod ctest-pod-91584451] Cmd: echo ctest-pod-91584451 > /usr/share/nginx/html/index.html, Output: 2024-10-28 01:53:10,621 - DEBUG - [Pod ctest-pod-87852359] Cmd: echo ctest-pod-87852359 > /usr/share/nginx/html/index.html, Output: 2024-10-28 01:53:10,715 - DEBUG - [Pod ctest-pod-22733180] Cmd: echo ctest-pod-22733180 > /usr/share/nginx/html/index.html, Output: 2024-10-28 01:53:10,807 - DEBUG - [Pod ctest-pod-66749219] Cmd: echo ctest-pod-66749219 > /usr/share/nginx/html/index.html, Output: 2024-10-28 01:53:10,813 - DEBUG - Service ctest-nginx-svc-45373801 not present 2024-10-28 01:53:10,814 - INFO - Creating service ctest-nginx-svc-45373801 2024-10-28 01:53:10,830 - INFO - Created Service ctest-nginx-svc-45373801 2024-10-28 01:53:10,843 - WARNING - Service UUID 685e5211-1750-4f78-8376-2d47a80b314d not yet found in contrail-api 2024-10-28 01:53:11,863 - INFO - Validated that Service ctest-nginx-svc-45373801 is seen in contrail-api 2024-10-28 01:53:11,863 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_LoadbalancerDatabaseList?x=685e5211-1750-4f78-8376-2d47a80b314d 2024-10-28 01:53:11,870 - INFO - Service ctest-nginx-svc-45373801 with uuid 685e5211-1750-4f78-8376-2d47a80b314d found in kube manager 2024-10-28 01:53:11,870 - INFO - Service ctest-nginx-svc-45373801 verification passed 2024-10-28 01:53:13,024 - DEBUG - [Pod ctest-pod-08280230] Cmd: wget http://10.101.116.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.116.34:80 (10.101.116.34:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-87852359 2024-10-28 01:53:13,024 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd wget http://10.101.116.34:80/ -O - -T 5 -t 1 passed 2024-10-28 01:53:13,024 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd output: Connecting to 10.101.116.34:80 (10.101.116.34:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-87852359 2024-10-28 01:53:13,106 - DEBUG - [Pod ctest-pod-08280230] Cmd: wget http://10.101.116.34:80/ -O - -T 5 -t 1 , Output: ctest-pod-87852359 Connecting to 10.101.116.34:80 (10.101.116.34:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-28 01:53:13,106 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd wget http://10.101.116.34:80/ -O - -T 5 -t 1 passed 2024-10-28 01:53:13,107 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd output: ctest-pod-87852359 Connecting to 10.101.116.34:80 (10.101.116.34:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-28 01:53:13,193 - DEBUG - [Pod ctest-pod-08280230] Cmd: wget http://10.101.116.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.116.34:80 (10.101.116.34:80) writing to stdout ctest-pod-87852359 - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-28 01:53:13,193 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd wget http://10.101.116.34:80/ -O - -T 5 -t 1 passed 2024-10-28 01:53:13,193 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd output: Connecting to 10.101.116.34:80 (10.101.116.34:80) writing to stdout ctest-pod-87852359 - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-28 01:53:13,292 - DEBUG - [Pod ctest-pod-08280230] Cmd: wget http://10.101.116.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.116.34:80 (10.101.116.34:80) writing to stdout ctest-pod-87852359 - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-28 01:53:13,292 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd wget http://10.101.116.34:80/ -O - -T 5 -t 1 passed 2024-10-28 01:53:13,292 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd output: Connecting to 10.101.116.34:80 (10.101.116.34:80) writing to stdout ctest-pod-87852359 - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-28 01:53:13,381 - DEBUG - [Pod ctest-pod-08280230] Cmd: wget http://10.101.116.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.116.34:80 (10.101.116.34:80) writing to stdout - ctest-pod-91584451 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-28 01:53:13,381 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd wget http://10.101.116.34:80/ -O - -T 5 -t 1 passed 2024-10-28 01:53:13,381 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd output: Connecting to 10.101.116.34:80 (10.101.116.34:80) writing to stdout - ctest-pod-91584451 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-28 01:53:13,381 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-91584451': 1, 'ctest-pod-87852359': 4} 2024-10-28 01:53:13,477 - DEBUG - [Pod ctest-pod-27670065] Cmd: wget http://10.101.116.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.116.34:80 (10.101.116.34:80) ctest-pod-91584451 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-28 01:53:13,477 - DEBUG - [Pod Pod ctest-pod-27670065] Cmd wget http://10.101.116.34:80/ -O - -T 5 -t 1 passed 2024-10-28 01:53:13,477 - DEBUG - [Pod Pod ctest-pod-27670065] Cmd output: Connecting to 10.101.116.34:80 (10.101.116.34:80) ctest-pod-91584451 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-28 01:53:13,551 - DEBUG - [Pod ctest-pod-27670065] Cmd: wget http://10.101.116.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.116.34:80 (10.101.116.34:80) ctest-pod-91584451 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-28 01:53:13,552 - DEBUG - [Pod Pod ctest-pod-27670065] Cmd wget http://10.101.116.34:80/ -O - -T 5 -t 1 passed 2024-10-28 01:53:13,552 - DEBUG - [Pod Pod ctest-pod-27670065] Cmd output: Connecting to 10.101.116.34:80 (10.101.116.34:80) ctest-pod-91584451 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-28 01:53:13,645 - DEBUG - [Pod ctest-pod-27670065] Cmd: wget http://10.101.116.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.116.34:80 (10.101.116.34:80) writing to stdout ctest-pod-87852359 - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-28 01:53:13,645 - DEBUG - [Pod Pod ctest-pod-27670065] Cmd wget http://10.101.116.34:80/ -O - -T 5 -t 1 passed 2024-10-28 01:53:13,645 - DEBUG - [Pod Pod ctest-pod-27670065] Cmd output: Connecting to 10.101.116.34:80 (10.101.116.34:80) writing to stdout ctest-pod-87852359 - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-28 01:53:13,645 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-91584451': 2, 'ctest-pod-87852359': 1} 2024-10-28 01:53:13,651 - DEBUG - Network policy ingress-on-service not present 2024-10-28 01:53:13,653 - INFO - Creating Network Policy ingress-on-service 2024-10-28 01:53:13,669 - INFO - Network policy found in k8s 2024-10-28 01:53:13,669 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=acbd5612-a43b-42a1-99b1-21ecd824e086 2024-10-28 01:53:13,682 - INFO - Network Policy ingress-on-service with uuid acbd5612-a43b-42a1-99b1-21ecd824e086 found in kube manager 2024-10-28 01:53:13,720 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-10-28 01:53:13,721 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-10-28 01:53:13,721 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=acbd5612-a43b-42a1-99b1-21ecd824e086 2024-10-28 01:53:13,756 - WARNING - Network policy with name ingress-on-service not found in agent 2024-10-28 01:53:15,758 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=acbd5612-a43b-42a1-99b1-21ecd824e086 2024-10-28 01:53:15,788 - WARNING - Network policy with name ingress-on-service not found in agent 2024-10-28 01:53:17,789 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=acbd5612-a43b-42a1-99b1-21ecd824e086 2024-10-28 01:53:17,821 - INFO - Network policy with name ingress-on-service found in agent 2024-10-28 01:53:17,822 - INFO - Network Policy ingress-on-service verification passed 2024-10-28 01:53:22,903 - DEBUG - [Pod ctest-pod-08280230] Cmd: wget http://10.101.116.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:53:22,904 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd wget http://10.101.116.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:53:22,904 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:53:27,991 - DEBUG - [Pod ctest-pod-08280230] Cmd: wget http://10.101.116.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:53:27,992 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd wget http://10.101.116.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:53:27,992 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:53:33,072 - DEBUG - [Pod ctest-pod-08280230] Cmd: wget http://10.101.116.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:53:33,072 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd wget http://10.101.116.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:53:33,072 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:53:38,167 - DEBUG - [Pod ctest-pod-08280230] Cmd: wget http://10.101.116.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:53:38,167 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd wget http://10.101.116.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:53:38,167 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:53:43,247 - DEBUG - [Pod ctest-pod-08280230] Cmd: wget http://10.101.116.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:53:43,247 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd wget http://10.101.116.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:53:43,248 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:53:48,331 - DEBUG - [Pod ctest-pod-08280230] Cmd: wget http://10.101.116.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:53:48,331 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd wget http://10.101.116.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:53:48,331 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:53:53,424 - DEBUG - [Pod ctest-pod-08280230] Cmd: wget http://10.101.116.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:53:53,425 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd wget http://10.101.116.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:53:53,425 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:53:58,528 - DEBUG - [Pod ctest-pod-08280230] Cmd: wget http://10.101.116.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:53:58,528 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd wget http://10.101.116.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:53:58,528 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:54:03,621 - DEBUG - [Pod ctest-pod-08280230] Cmd: wget http://10.101.116.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:54:03,621 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd wget http://10.101.116.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:54:03,621 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:54:08,707 - DEBUG - [Pod ctest-pod-08280230] Cmd: wget http://10.101.116.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:54:08,707 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd wget http://10.101.116.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:54:08,707 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:54:08,707 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-91584451': 0, 'ctest-pod-87852359': 0} 2024-10-28 01:54:08,790 - DEBUG - [Pod ctest-pod-12234574] Cmd: wget http://10.101.116.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.116.34:80 (10.101.116.34:80) ctest-pod-87852359 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-28 01:54:08,790 - DEBUG - [Pod Pod ctest-pod-12234574] Cmd wget http://10.101.116.34:80/ -O - -T 5 -t 1 passed 2024-10-28 01:54:08,790 - DEBUG - [Pod Pod ctest-pod-12234574] Cmd output: Connecting to 10.101.116.34:80 (10.101.116.34:80) ctest-pod-87852359 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-28 01:54:08,873 - DEBUG - [Pod ctest-pod-12234574] Cmd: wget http://10.101.116.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.116.34:80 (10.101.116.34:80) ctest-pod-91584451 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-28 01:54:08,873 - DEBUG - [Pod Pod ctest-pod-12234574] Cmd wget http://10.101.116.34:80/ -O - -T 5 -t 1 passed 2024-10-28 01:54:08,873 - DEBUG - [Pod Pod ctest-pod-12234574] Cmd output: Connecting to 10.101.116.34:80 (10.101.116.34:80) ctest-pod-91584451 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-28 01:54:08,873 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-91584451': 1, 'ctest-pod-87852359': 1} 2024-10-28 01:54:13,973 - DEBUG - [Pod ctest-pod-27670065] Cmd: wget http://10.101.116.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:54:13,974 - DEBUG - [Pod Pod ctest-pod-27670065] Cmd wget http://10.101.116.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:54:13,974 - DEBUG - [Pod Pod ctest-pod-27670065] Cmd output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:54:19,075 - DEBUG - [Pod ctest-pod-27670065] Cmd: wget http://10.101.116.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:54:19,075 - DEBUG - [Pod Pod ctest-pod-27670065] Cmd wget http://10.101.116.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:54:19,075 - DEBUG - [Pod Pod ctest-pod-27670065] Cmd output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:54:24,169 - DEBUG - [Pod ctest-pod-27670065] Cmd: wget http://10.101.116.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:54:24,170 - DEBUG - [Pod Pod ctest-pod-27670065] Cmd wget http://10.101.116.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:54:24,170 - DEBUG - [Pod Pod ctest-pod-27670065] Cmd output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:54:29,272 - DEBUG - [Pod ctest-pod-27670065] Cmd: wget http://10.101.116.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:54:29,272 - DEBUG - [Pod Pod ctest-pod-27670065] Cmd wget http://10.101.116.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:54:29,272 - DEBUG - [Pod Pod ctest-pod-27670065] Cmd output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:54:34,390 - DEBUG - [Pod ctest-pod-27670065] Cmd: wget http://10.101.116.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:54:34,390 - DEBUG - [Pod Pod ctest-pod-27670065] Cmd wget http://10.101.116.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:54:34,390 - DEBUG - [Pod Pod ctest-pod-27670065] Cmd output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:54:39,503 - DEBUG - [Pod ctest-pod-27670065] Cmd: wget http://10.101.116.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:54:39,503 - DEBUG - [Pod Pod ctest-pod-27670065] Cmd wget http://10.101.116.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:54:39,503 - DEBUG - [Pod Pod ctest-pod-27670065] Cmd output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:54:44,598 - DEBUG - [Pod ctest-pod-27670065] Cmd: wget http://10.101.116.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:54:44,598 - DEBUG - [Pod Pod ctest-pod-27670065] Cmd wget http://10.101.116.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:54:44,598 - DEBUG - [Pod Pod ctest-pod-27670065] Cmd output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:54:49,727 - DEBUG - [Pod ctest-pod-27670065] Cmd: wget http://10.101.116.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:54:49,727 - DEBUG - [Pod Pod ctest-pod-27670065] Cmd wget http://10.101.116.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:54:49,727 - DEBUG - [Pod Pod ctest-pod-27670065] Cmd output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:54:54,825 - DEBUG - [Pod ctest-pod-27670065] Cmd: wget http://10.101.116.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:54:54,825 - DEBUG - [Pod Pod ctest-pod-27670065] Cmd wget http://10.101.116.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:54:54,825 - DEBUG - [Pod Pod ctest-pod-27670065] Cmd output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:54:59,915 - DEBUG - [Pod ctest-pod-27670065] Cmd: wget http://10.101.116.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:54:59,915 - DEBUG - [Pod Pod ctest-pod-27670065] Cmd wget http://10.101.116.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:54:59,915 - DEBUG - [Pod Pod ctest-pod-27670065] Cmd output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:54:59,915 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-91584451': 0, 'ctest-pod-87852359': 0} 2024-10-28 01:55:02,014 - DEBUG - [Pod ctest-pod-12234574] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.819 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.115 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.150 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.115/0.694/1.819 ms 2024-10-28 01:55:02,014 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-12234574 with expectation True passed 2024-10-28 01:55:04,123 - DEBUG - [Pod ctest-pod-08280230] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=1.966 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.085 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.136 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.085/0.729/1.966 ms 2024-10-28 01:55:04,123 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-08280230 with expectation True passed 2024-10-28 01:55:06,211 - DEBUG - [Pod ctest-pod-27670065] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=1.045 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.125 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.149 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.125/0.439/1.045 ms 2024-10-28 01:55:06,211 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-27670065 with expectation True passed 2024-10-28 01:55:06,301 - DEBUG - [Pod ctest-pod-12234574] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-28 01:55:06,301 - DEBUG - [Pod Pod ctest-pod-12234574] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-10-28 01:55:06,301 - DEBUG - [Pod Pod ctest-pod-12234574] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-28 01:55:06,301 - INFO - wget check of of http://10.47.255.250 from ctest-pod-12234574 passed 2024-10-28 01:55:06,394 - DEBUG - [Pod ctest-pod-12234574] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-28 01:55:06,394 - DEBUG - [Pod Pod ctest-pod-12234574] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 passed 2024-10-28 01:55:06,394 - DEBUG - [Pod Pod ctest-pod-12234574] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-28 01:55:06,394 - INFO - wget check of of http://10.47.255.249 from ctest-pod-12234574 passed 2024-10-28 01:55:11,493 - DEBUG - [Pod ctest-pod-08280230] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2024-10-28 01:55:11,493 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2024-10-28 01:55:11,493 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2024-10-28 01:55:11,493 - INFO - wget check of of http://10.47.255.249 from ctest-pod-08280230 passed 2024-10-28 01:55:16,597 - DEBUG - [Pod ctest-pod-11907252] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-10-28 01:55:16,597 - DEBUG - [Pod Pod ctest-pod-11907252] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-10-28 01:55:16,597 - DEBUG - [Pod Pod ctest-pod-11907252] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-10-28 01:55:16,597 - INFO - wget check of of http://10.47.255.250 from ctest-pod-11907252 passed 2024-10-28 01:55:16,609 - INFO - Updating Network Policy ingress-on-service 2024-10-28 01:55:21,720 - DEBUG - [Pod ctest-pod-08280230] Cmd: wget http://10.101.116.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:55:21,720 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd wget http://10.101.116.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:55:21,720 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:55:26,813 - DEBUG - [Pod ctest-pod-08280230] Cmd: wget http://10.101.116.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:55:26,814 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd wget http://10.101.116.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:55:26,814 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:55:31,900 - DEBUG - [Pod ctest-pod-08280230] Cmd: wget http://10.101.116.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:55:31,900 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd wget http://10.101.116.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:55:31,900 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:55:37,006 - DEBUG - [Pod ctest-pod-08280230] Cmd: wget http://10.101.116.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:55:37,006 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd wget http://10.101.116.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:55:37,006 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:55:42,119 - DEBUG - [Pod ctest-pod-08280230] Cmd: wget http://10.101.116.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:55:42,119 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd wget http://10.101.116.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:55:42,119 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:55:47,212 - DEBUG - [Pod ctest-pod-08280230] Cmd: wget http://10.101.116.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:55:47,212 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd wget http://10.101.116.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:55:47,212 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:55:52,311 - DEBUG - [Pod ctest-pod-08280230] Cmd: wget http://10.101.116.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:55:52,311 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd wget http://10.101.116.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:55:52,311 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:55:57,405 - DEBUG - [Pod ctest-pod-08280230] Cmd: wget http://10.101.116.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:55:57,405 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd wget http://10.101.116.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:55:57,405 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:56:02,496 - DEBUG - [Pod ctest-pod-08280230] Cmd: wget http://10.101.116.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:56:02,496 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd wget http://10.101.116.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:56:02,496 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:56:07,608 - DEBUG - [Pod ctest-pod-08280230] Cmd: wget http://10.101.116.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:56:07,609 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd wget http://10.101.116.34:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:56:07,609 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd output: Connecting to 10.101.116.34:80 (10.101.116.34:80) wget: download timed out 2024-10-28 01:56:07,609 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-91584451': 0, 'ctest-pod-87852359': 0} 2024-10-28 01:56:07,704 - DEBUG - [Pod ctest-pod-12234574] Cmd: wget http://10.101.116.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.116.34:80 (10.101.116.34:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-87852359 2024-10-28 01:56:07,705 - DEBUG - [Pod Pod ctest-pod-12234574] Cmd wget http://10.101.116.34:80/ -O - -T 5 -t 1 passed 2024-10-28 01:56:07,705 - DEBUG - [Pod Pod ctest-pod-12234574] Cmd output: Connecting to 10.101.116.34:80 (10.101.116.34:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-87852359 2024-10-28 01:56:07,800 - DEBUG - [Pod ctest-pod-12234574] Cmd: wget http://10.101.116.34:80/ -O - -T 5 -t 1 , Output: ctest-pod-87852359 Connecting to 10.101.116.34:80 (10.101.116.34:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-28 01:56:07,801 - DEBUG - [Pod Pod ctest-pod-12234574] Cmd wget http://10.101.116.34:80/ -O - -T 5 -t 1 passed 2024-10-28 01:56:07,801 - DEBUG - [Pod Pod ctest-pod-12234574] Cmd output: ctest-pod-87852359 Connecting to 10.101.116.34:80 (10.101.116.34:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-28 01:56:07,922 - DEBUG - [Pod ctest-pod-12234574] Cmd: wget http://10.101.116.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.116.34:80 (10.101.116.34:80) ctest-pod-91584451 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-28 01:56:07,922 - DEBUG - [Pod Pod ctest-pod-12234574] Cmd wget http://10.101.116.34:80/ -O - -T 5 -t 1 passed 2024-10-28 01:56:07,922 - DEBUG - [Pod Pod ctest-pod-12234574] Cmd output: Connecting to 10.101.116.34:80 (10.101.116.34:80) ctest-pod-91584451 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-28 01:56:07,922 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-91584451': 1, 'ctest-pod-87852359': 2} 2024-10-28 01:56:08,007 - DEBUG - [Pod ctest-pod-27670065] Cmd: wget http://10.101.116.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.116.34:80 (10.101.116.34:80) ctest-pod-87852359 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-28 01:56:08,007 - DEBUG - [Pod Pod ctest-pod-27670065] Cmd wget http://10.101.116.34:80/ -O - -T 5 -t 1 passed 2024-10-28 01:56:08,007 - DEBUG - [Pod Pod ctest-pod-27670065] Cmd output: Connecting to 10.101.116.34:80 (10.101.116.34:80) ctest-pod-87852359 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-28 01:56:08,087 - DEBUG - [Pod ctest-pod-27670065] Cmd: wget http://10.101.116.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.116.34:80 (10.101.116.34:80) writing to stdout ctest-pod-87852359 - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-28 01:56:08,087 - DEBUG - [Pod Pod ctest-pod-27670065] Cmd wget http://10.101.116.34:80/ -O - -T 5 -t 1 passed 2024-10-28 01:56:08,087 - DEBUG - [Pod Pod ctest-pod-27670065] Cmd output: Connecting to 10.101.116.34:80 (10.101.116.34:80) writing to stdout ctest-pod-87852359 - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-28 01:56:08,182 - DEBUG - [Pod ctest-pod-27670065] Cmd: wget http://10.101.116.34:80/ -O - -T 5 -t 1 , Output: Connecting to 10.101.116.34:80 (10.101.116.34:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-91584451 2024-10-28 01:56:08,182 - DEBUG - [Pod Pod ctest-pod-27670065] Cmd wget http://10.101.116.34:80/ -O - -T 5 -t 1 passed 2024-10-28 01:56:08,182 - DEBUG - [Pod Pod ctest-pod-27670065] Cmd output: Connecting to 10.101.116.34:80 (10.101.116.34:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-91584451 2024-10-28 01:56:08,182 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-91584451': 1, 'ctest-pod-87852359': 2} 2024-10-28 01:56:10,263 - DEBUG - [Pod ctest-pod-12234574] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.491 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.084 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.085 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.084/0.220/0.491 ms 2024-10-28 01:56:10,263 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-12234574 with expectation True passed 2024-10-28 01:56:12,360 - DEBUG - [Pod ctest-pod-08280230] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.849 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.082 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.334/0.849 ms 2024-10-28 01:56:12,360 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-08280230 with expectation True passed 2024-10-28 01:56:14,469 - DEBUG - [Pod ctest-pod-27670065] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.542 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.072 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.084 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.072/0.232/0.542 ms 2024-10-28 01:56:14,469 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-27670065 with expectation True passed 2024-10-28 01:56:14,556 - DEBUG - [Pod ctest-pod-12234574] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-28 01:56:14,556 - DEBUG - [Pod Pod ctest-pod-12234574] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-10-28 01:56:14,556 - DEBUG - [Pod Pod ctest-pod-12234574] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-28 01:56:14,556 - INFO - wget check of of http://10.47.255.250 from ctest-pod-12234574 passed 2024-10-28 01:56:14,655 - DEBUG - [Pod ctest-pod-12234574] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-28 01:56:14,655 - DEBUG - [Pod Pod ctest-pod-12234574] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 passed 2024-10-28 01:56:14,655 - DEBUG - [Pod Pod ctest-pod-12234574] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-28 01:56:14,655 - INFO - wget check of of http://10.47.255.249 from ctest-pod-12234574 passed 2024-10-28 01:56:19,750 - DEBUG - [Pod ctest-pod-08280230] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2024-10-28 01:56:19,750 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2024-10-28 01:56:19,750 - DEBUG - [Pod Pod ctest-pod-08280230] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2024-10-28 01:56:19,750 - INFO - wget check of of http://10.47.255.249 from ctest-pod-08280230 passed 2024-10-28 01:56:19,848 - DEBUG - [Pod ctest-pod-11907252] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-28 01:56:19,848 - DEBUG - [Pod Pod ctest-pod-11907252] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-10-28 01:56:19,848 - DEBUG - [Pod Pod ctest-pod-11907252] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-28 01:56:19,848 - INFO - wget check of of http://10.47.255.250 from ctest-pod-11907252 passed 2024-10-28 01:56:19,848 - INFO - Deleting Network Policy : ingress-on-service 2024-10-28 01:56:19,849 - INFO - Deleting service : ctest-nginx-svc-45373801 2024-10-28 01:56:20,439 - DEBUG - No XMPP flaps were noticed during the test 2024-10-28 01:56:20,439 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:10] 2024-10-28 01:56:20,439 - INFO - -------------------------------------------------------------------------------- 2024-10-28 01:56:20,445 - INFO - Deleting pod ctest-new-default-99499365:ctest-pod-91584451 2024-10-28 01:56:20,446 - INFO - Deleting pod ctest-new-default-99499365:ctest-pod-87852359 2024-10-28 01:56:20,447 - INFO - Deleting pod ctest-non-default-78442212:ctest-pod-22733180 2024-10-28 01:56:20,448 - INFO - Deleting pod ctest-non-default-78442212:ctest-pod-66749219 2024-10-28 01:56:20,448 - INFO - Deleting pod ctest-new-default-99499365:ctest-pod-08280230 2024-10-28 01:56:20,449 - INFO - Deleting pod ctest-new-default-99499365:ctest-pod-12234574 2024-10-28 01:56:20,452 - INFO - Deleting pod ctest-non-default-78442212:ctest-pod-27670065 2024-10-28 01:56:20,452 - INFO - Deleting pod ctest-non-default-78442212:ctest-pod-11907252 2024-10-28 01:56:20,659 - WARNING - Pod uuid 61b3affe-b6dc-4726-b8cb-caf70fbc51e5 is still seen in agent 10.0.0.22 VM list 2024-10-28 01:56:20,686 - WARNING - Pod uuid 2339be5e-a2e9-494c-a3a8-13c14fb30df8 is still seen in agent 10.0.0.22 VM list 2024-10-28 01:56:20,687 - WARNING - Pod uuid 546198af-85f6-4e9e-a794-06f9170d0539 is still seen in agent 10.0.0.22 VM list 2024-10-28 01:56:20,687 - WARNING - Pod uuid be871133-df68-4c52-9936-c3040ac2603f is still seen in agent 10.0.0.22 VM list 2024-10-28 01:56:20,688 - WARNING - Pod uuid 06ff3838-97be-45f9-93a3-ed9c7a05cc33 is still seen in agent 10.0.0.22 VM list 2024-10-28 01:56:20,689 - WARNING - Pod uuid b30c98e0-8ab2-420c-ab3a-922f54552a14 is still seen in agent 10.0.0.22 VM list 2024-10-28 01:56:20,690 - WARNING - Pod uuid d18a029f-b5fd-41b6-bbb7-6bbffe505d3c is still seen in agent 10.0.0.22 VM list 2024-10-28 01:56:20,691 - WARNING - Pod uuid 8ed23183-1092-4e5e-834e-018a31680876 is still seen in agent 10.0.0.22 VM list 2024-10-28 01:56:25,669 - DEBUG - Pod 61b3affe-b6dc-4726-b8cb-caf70fbc51e5 is not in agent 10.0.0.22 VM list 2024-10-28 01:56:25,676 - DEBUG - VMI 573d8b08-94cf-11ef-bc8e-0242a74f58e7 is removed from agent 10.0.0.22 2024-10-28 01:56:25,676 - INFO - Verified that pod ctest-pod-91584451 is removed in agent 2024-10-28 01:56:25,711 - DEBUG - Pod 546198af-85f6-4e9e-a794-06f9170d0539 is not in agent 10.0.0.22 VM list 2024-10-28 01:56:25,713 - WARNING - Pod uuid 2339be5e-a2e9-494c-a3a8-13c14fb30df8 is still seen in agent 10.0.0.22 VM list 2024-10-28 01:56:25,740 - WARNING - Pod uuid be871133-df68-4c52-9936-c3040ac2603f is still seen in agent 10.0.0.22 VM list 2024-10-28 01:56:25,741 - WARNING - Pod uuid 06ff3838-97be-45f9-93a3-ed9c7a05cc33 is still seen in agent 10.0.0.22 VM list 2024-10-28 01:56:25,742 - WARNING - Pod uuid b30c98e0-8ab2-420c-ab3a-922f54552a14 is still seen in agent 10.0.0.22 VM list 2024-10-28 01:56:25,743 - WARNING - Pod uuid 8ed23183-1092-4e5e-834e-018a31680876 is still seen in agent 10.0.0.22 VM list 2024-10-28 01:56:25,744 - DEBUG - Pod d18a029f-b5fd-41b6-bbb7-6bbffe505d3c is not in agent 10.0.0.22 VM list 2024-10-28 01:56:25,747 - DEBUG - VMI 5937a484-94cf-11ef-bc8e-0242a74f58e7 is removed from agent 10.0.0.22 2024-10-28 01:56:25,747 - INFO - Verified that pod ctest-pod-22733180 is removed in agent 2024-10-28 01:56:25,753 - DEBUG - VMI 59fccf7a-94cf-11ef-bc8e-0242a74f58e7 is removed from agent 10.0.0.22 2024-10-28 01:56:25,753 - INFO - Verified that pod ctest-pod-66749219 is removed in agent 2024-10-28 01:56:30,722 - WARNING - Pod uuid 2339be5e-a2e9-494c-a3a8-13c14fb30df8 is still seen in agent 10.0.0.22 VM list 2024-10-28 01:56:30,761 - WARNING - Pod uuid be871133-df68-4c52-9936-c3040ac2603f is still seen in agent 10.0.0.22 VM list 2024-10-28 01:56:30,763 - WARNING - Pod uuid b30c98e0-8ab2-420c-ab3a-922f54552a14 is still seen in agent 10.0.0.22 VM list 2024-10-28 01:56:30,764 - WARNING - Pod uuid 06ff3838-97be-45f9-93a3-ed9c7a05cc33 is still seen in agent 10.0.0.22 VM list 2024-10-28 01:56:30,764 - WARNING - Pod uuid 8ed23183-1092-4e5e-834e-018a31680876 is still seen in agent 10.0.0.22 VM list 2024-10-28 01:56:35,730 - WARNING - Pod uuid 2339be5e-a2e9-494c-a3a8-13c14fb30df8 is still seen in agent 10.0.0.22 VM list 2024-10-28 01:56:35,782 - WARNING - Pod uuid 06ff3838-97be-45f9-93a3-ed9c7a05cc33 is still seen in agent 10.0.0.22 VM list 2024-10-28 01:56:35,782 - WARNING - Pod uuid b30c98e0-8ab2-420c-ab3a-922f54552a14 is still seen in agent 10.0.0.22 VM list 2024-10-28 01:56:35,783 - WARNING - Pod uuid be871133-df68-4c52-9936-c3040ac2603f is still seen in agent 10.0.0.22 VM list 2024-10-28 01:56:35,784 - WARNING - Pod uuid 8ed23183-1092-4e5e-834e-018a31680876 is still seen in agent 10.0.0.22 VM list 2024-10-28 01:56:40,738 - WARNING - Pod uuid 2339be5e-a2e9-494c-a3a8-13c14fb30df8 is still seen in agent 10.0.0.22 VM list 2024-10-28 01:56:40,804 - WARNING - Pod uuid 06ff3838-97be-45f9-93a3-ed9c7a05cc33 is still seen in agent 10.0.0.22 VM list 2024-10-28 01:56:40,806 - WARNING - Pod uuid be871133-df68-4c52-9936-c3040ac2603f is still seen in agent 10.0.0.22 VM list 2024-10-28 01:56:40,807 - WARNING - Pod uuid 8ed23183-1092-4e5e-834e-018a31680876 is still seen in agent 10.0.0.22 VM list 2024-10-28 01:56:40,807 - WARNING - Pod uuid b30c98e0-8ab2-420c-ab3a-922f54552a14 is still seen in agent 10.0.0.22 VM list 2024-10-28 01:56:45,746 - WARNING - Pod uuid 2339be5e-a2e9-494c-a3a8-13c14fb30df8 is still seen in agent 10.0.0.22 VM list 2024-10-28 01:56:45,824 - WARNING - Pod uuid 06ff3838-97be-45f9-93a3-ed9c7a05cc33 is still seen in agent 10.0.0.22 VM list 2024-10-28 01:56:45,826 - WARNING - Pod uuid be871133-df68-4c52-9936-c3040ac2603f is still seen in agent 10.0.0.22 VM list 2024-10-28 01:56:45,826 - WARNING - Pod uuid 8ed23183-1092-4e5e-834e-018a31680876 is still seen in agent 10.0.0.22 VM list 2024-10-28 01:56:45,827 - WARNING - Pod uuid b30c98e0-8ab2-420c-ab3a-922f54552a14 is still seen in agent 10.0.0.22 VM list 2024-10-28 01:56:50,764 - WARNING - Pod uuid 2339be5e-a2e9-494c-a3a8-13c14fb30df8 is still seen in agent 10.0.0.22 VM list 2024-10-28 01:56:50,870 - DEBUG - Pod b30c98e0-8ab2-420c-ab3a-922f54552a14 is not in agent 10.0.0.22 VM list 2024-10-28 01:56:50,872 - WARNING - Pod uuid 8ed23183-1092-4e5e-834e-018a31680876 is still seen in agent 10.0.0.22 VM list 2024-10-28 01:56:50,873 - WARNING - Pod uuid be871133-df68-4c52-9936-c3040ac2603f is still seen in agent 10.0.0.22 VM list 2024-10-28 01:56:50,873 - WARNING - Pod uuid 06ff3838-97be-45f9-93a3-ed9c7a05cc33 is still seen in agent 10.0.0.22 VM list 2024-10-28 01:56:50,946 - DEBUG - VMI 5811a51e-94cf-11ef-bc8e-0242a74f58e7 is removed from agent 10.0.0.22 2024-10-28 01:56:50,946 - INFO - Verified that pod ctest-pod-87852359 is removed in agent 2024-10-28 01:56:55,782 - DEBUG - Pod 2339be5e-a2e9-494c-a3a8-13c14fb30df8 is not in agent 10.0.0.22 VM list 2024-10-28 01:56:55,788 - DEBUG - VMI 5da75014-94cf-11ef-bc8e-0242a74f58e7 is removed from agent 10.0.0.22 2024-10-28 01:56:55,788 - INFO - Verified that pod ctest-pod-11907252 is removed in agent 2024-10-28 01:56:55,888 - DEBUG - Pod 06ff3838-97be-45f9-93a3-ed9c7a05cc33 is not in agent 10.0.0.22 VM list 2024-10-28 01:56:55,892 - DEBUG - Pod be871133-df68-4c52-9936-c3040ac2603f is not in agent 10.0.0.22 VM list 2024-10-28 01:56:55,894 - DEBUG - Pod 8ed23183-1092-4e5e-834e-018a31680876 is not in agent 10.0.0.22 VM list 2024-10-28 01:56:55,906 - DEBUG - VMI 5ae26e2c-94cf-11ef-bc8e-0242a74f58e7 is removed from agent 10.0.0.22 2024-10-28 01:56:55,906 - INFO - Verified that pod ctest-pod-08280230 is removed in agent 2024-10-28 01:56:55,907 - DEBUG - VMI 5bdf6c3a-94cf-11ef-bc8e-0242a74f58e7 is removed from agent 10.0.0.22 2024-10-28 01:56:55,907 - INFO - Verified that pod ctest-pod-12234574 is removed in agent 2024-10-28 01:56:55,908 - DEBUG - VMI 5cc6800c-94cf-11ef-bc8e-0242a74f58e7 is removed from agent 10.0.0.22 2024-10-28 01:56:55,908 - INFO - Verified that pod ctest-pod-27670065 is removed in agent 2024-10-28 01:56:55,908 - INFO - Deleting namespace ctest-non-default-78442212 2024-10-28 01:56:55,920 - DEBUG - Namespace ctest-non-default-78442212 still in k8s 2024-10-28 01:56:57,926 - DEBUG - Namespace ctest-non-default-78442212 still in k8s 2024-10-28 01:56:59,935 - DEBUG - Namespace ctest-non-default-78442212 still in k8s 2024-10-28 01:57:01,940 - DEBUG - Namespace ctest-non-default-78442212 is not in k8s 2024-10-28 01:57:01,940 - DEBUG - No need to check project deletion in contrail-api 2024-10-28 01:57:01,940 - INFO - Deleting namespace ctest-new-default-99499365 2024-10-28 01:57:01,952 - DEBUG - Namespace ctest-new-default-99499365 still in k8s 2024-10-28 01:57:03,957 - DEBUG - Namespace ctest-new-default-99499365 still in k8s 2024-10-28 01:57:05,962 - DEBUG - Namespace ctest-new-default-99499365 still in k8s 2024-10-28 01:57:07,967 - DEBUG - Namespace ctest-new-default-99499365 is not in k8s 2024-10-28 01:57:07,967 - DEBUG - No need to check project deletion in contrail-api