2025-01-15 12:54:59,097 - INFO - Using existing project ['default-domain', 'k8s-default'](7136929b-774b-4c57-9c2c-dd4571923c7c)
2025-01-15 12:54:59,121 - DEBUG - Namespace ctest-new-default-92034699 not present
2025-01-15 12:54:59,132 - INFO - Created namespace ctest-new-default-92034699
2025-01-15 12:55:02,140 - DEBUG - Namespace ctest-non-default-62646507 not present
2025-01-15 12:55:02,149 - INFO - Created namespace ctest-non-default-62646507
2025-01-15 12:55:05,175 - DEBUG - Pod ctest-pod-34932020 not present
2025-01-15 12:55:05,175 - INFO - Creating Pod ctest-pod-34932020
2025-01-15 12:55:05,231 - DEBUG - Pod : ctest-pod-34932020 UUID is e9b21818-2470-40ec-8724-372878c9e36f
2025-01-15 12:55:05,241 - DEBUG - Pod ctest-pod-99391706 not present
2025-01-15 12:55:05,241 - INFO - Creating Pod ctest-pod-99391706
2025-01-15 12:55:05,274 - DEBUG - Pod : ctest-pod-99391706 UUID is 128e20a8-e976-48a7-a9a9-b73f4a2122b3
2025-01-15 12:55:05,277 - DEBUG - Pod ctest-pod-34981172 not present
2025-01-15 12:55:05,277 - INFO - Creating Pod ctest-pod-34981172
2025-01-15 12:55:05,298 - DEBUG - Pod : ctest-pod-34981172 UUID is 499b01be-fa45-44da-8151-a29e08c14d7f
2025-01-15 12:55:05,302 - DEBUG - Pod ctest-pod-37301705 not present
2025-01-15 12:55:05,303 - INFO - Creating Pod ctest-pod-37301705
2025-01-15 12:55:05,357 - DEBUG - Pod : ctest-pod-37301705 UUID is 7b38c442-dee6-4ec9-930b-afb659829a75
2025-01-15 12:55:05,360 - DEBUG - Pod ctest-pod-00019904 not present
2025-01-15 12:55:05,360 - INFO - Creating Pod ctest-pod-00019904
2025-01-15 12:55:05,382 - DEBUG - Pod : ctest-pod-00019904 UUID is 3b879235-326e-43a5-a976-27a4071f36e0
2025-01-15 12:55:05,384 - DEBUG - Pod ctest-pod-42336827 not present
2025-01-15 12:55:05,384 - INFO - Creating Pod ctest-pod-42336827
2025-01-15 12:55:05,402 - DEBUG - Pod : ctest-pod-42336827 UUID is 5d178d16-a671-4ea6-a570-00060533730f
2025-01-15 12:55:05,411 - DEBUG - Pod ctest-pod-51188433 not present
2025-01-15 12:55:05,412 - INFO - Creating Pod ctest-pod-51188433
2025-01-15 12:55:05,433 - DEBUG - Pod : ctest-pod-51188433 UUID is 39e4e676-b0cf-41ac-b6ed-19ce86981a70
2025-01-15 12:55:05,436 - DEBUG - Pod ctest-pod-64326283 not present
2025-01-15 12:55:05,436 - INFO - Creating Pod ctest-pod-64326283
2025-01-15 12:55:05,458 - DEBUG - Pod : ctest-pod-64326283 UUID is 28bfde15-014c-4b9f-999f-4f996860b54b
2025-01-15 12:55:05,664 - INFO - Project default-domain:k8s-ctest-new-default-92034699 for Namespace ctest-new-default-92034699 is seen in contrail-api
2025-01-15 12:55:05,665 - DEBUG - Project uuid in Contrail is b719b046-6707-4183-8736-eade3cb84656
2025-01-15 12:55:05,842 - DEBUG - Requesting: http://10.0.0.32:8108/Snh_NamespaceDatabaseList?namespace_uuid=653f78fd-cf03-4bc1-9ac2-07c8c05e8ab3
2025-01-15 12:55:05,851 - INFO - Namespace ctest-new-default-92034699 with uuid 653f78fd-cf03-4bc1-9ac2-07c8c05e8ab3 found in kube manager
2025-01-15 12:55:05,851 - INFO - Namespace ctest-new-default-92034699 verification passed
2025-01-15 12:55:06,131 - INFO - Project default-domain:k8s-ctest-non-default-62646507 for Namespace ctest-non-default-62646507 is seen in contrail-api
2025-01-15 12:55:06,131 - DEBUG - Project uuid in Contrail is 3874b7f7-3378-4122-8efd-13287ff5f188
2025-01-15 12:55:06,132 - DEBUG - Requesting: http://10.0.0.32:8108/Snh_NamespaceDatabaseList?namespace_uuid=5304b390-c5e4-4873-91f8-b53a0b67f4ef
2025-01-15 12:55:06,139 - INFO - Namespace ctest-non-default-62646507 with uuid 5304b390-c5e4-4873-91f8-b53a0b67f4ef found in kube manager
2025-01-15 12:55:06,139 - INFO - Namespace ctest-non-default-62646507 verification passed
2025-01-15 12:55:06,146 - DEBUG - Pod ctest-pod-34932020 not in running state.Currently in Pending
2025-01-15 12:55:11,165 - DEBUG - Pod ctest-pod-34932020 not in running state.Currently in Pending
2025-01-15 12:55:16,172 - INFO - Pod ctest-pod-34932020 is in running state.Got IP 10.47.255.251
2025-01-15 12:55:16,194 - DEBUG - Pod ctest-pod-34932020 has vmi f2414780-d33f-11ef-9308-fa163e1b59c2
2025-01-15 12:55:16,194 - INFO - Verified pod ctest-pod-34932020 in contrail-api
2025-01-15 12:55:16,207 - DEBUG - VMI f2414780-d33f-11ef-9308-fa163e1b59c2 is active in agent 10.0.0.40
2025-01-15 12:55:16,208 - INFO - Verified Pod ctest-pod-34932020 in agent 10.0.0.40
2025-01-15 12:55:16,208 - DEBUG - Requesting: http://10.0.0.32:8108/Snh_VirtualMachineDatabaseList?x=e9b21818-2470-40ec-8724-372878c9e36f
2025-01-15 12:55:16,213 - INFO - Pod ctest-pod-34932020 with uuid e9b21818-2470-40ec-8724-372878c9e36f found in kube manager
2025-01-15 12:55:16,213 - INFO - Pod ctest-pod-34932020 verification passed
2025-01-15 12:55:16,221 - DEBUG - Pod ctest-pod-99391706 not in running state.Currently in Pending
2025-01-15 12:55:21,228 - INFO - Pod ctest-pod-99391706 is in running state.Got IP 10.47.255.250
2025-01-15 12:55:21,244 - DEBUG - Pod ctest-pod-99391706 has vmi f2db7ada-d33f-11ef-9308-fa163e1b59c2
2025-01-15 12:55:21,244 - INFO - Verified pod ctest-pod-99391706 in contrail-api
2025-01-15 12:55:21,258 - DEBUG - VMI f2db7ada-d33f-11ef-9308-fa163e1b59c2 is active in agent 10.0.0.40
2025-01-15 12:55:21,258 - INFO - Verified Pod ctest-pod-99391706 in agent 10.0.0.40
2025-01-15 12:55:21,258 - DEBUG - Requesting: http://10.0.0.32:8108/Snh_VirtualMachineDatabaseList?x=128e20a8-e976-48a7-a9a9-b73f4a2122b3
2025-01-15 12:55:21,264 - INFO - Pod ctest-pod-99391706 with uuid 128e20a8-e976-48a7-a9a9-b73f4a2122b3 found in kube manager
2025-01-15 12:55:21,264 - INFO - Pod ctest-pod-99391706 verification passed
2025-01-15 12:55:21,270 - INFO - Pod ctest-pod-34981172 is in running state.Got IP 10.47.255.249
2025-01-15 12:55:21,338 - DEBUG - Pod ctest-pod-34981172 has vmi f39adcc2-d33f-11ef-9308-fa163e1b59c2
2025-01-15 12:55:21,340 - INFO - Verified pod ctest-pod-34981172 in contrail-api
2025-01-15 12:55:21,357 - DEBUG - VMI f39adcc2-d33f-11ef-9308-fa163e1b59c2 is active in agent 10.0.0.40
2025-01-15 12:55:21,357 - INFO - Verified Pod ctest-pod-34981172 in agent 10.0.0.40
2025-01-15 12:55:21,358 - DEBUG - Requesting: http://10.0.0.32:8108/Snh_VirtualMachineDatabaseList?x=499b01be-fa45-44da-8151-a29e08c14d7f
2025-01-15 12:55:21,364 - INFO - Pod ctest-pod-34981172 with uuid 499b01be-fa45-44da-8151-a29e08c14d7f found in kube manager
2025-01-15 12:55:21,364 - INFO - Pod ctest-pod-34981172 verification passed
2025-01-15 12:55:21,374 - INFO - Pod ctest-pod-37301705 is in running state.Got IP 10.47.255.248
2025-01-15 12:55:21,395 - DEBUG - Pod ctest-pod-37301705 has vmi f42d5034-d33f-11ef-9308-fa163e1b59c2
2025-01-15 12:55:21,395 - INFO - Verified pod ctest-pod-37301705 in contrail-api
2025-01-15 12:55:21,410 - DEBUG - VMI f42d5034-d33f-11ef-9308-fa163e1b59c2 is active in agent 10.0.0.40
2025-01-15 12:55:21,413 - INFO - Verified Pod ctest-pod-37301705 in agent 10.0.0.40
2025-01-15 12:55:21,414 - DEBUG - Requesting: http://10.0.0.32:8108/Snh_VirtualMachineDatabaseList?x=7b38c442-dee6-4ec9-930b-afb659829a75
2025-01-15 12:55:21,421 - INFO - Pod ctest-pod-37301705 with uuid 7b38c442-dee6-4ec9-930b-afb659829a75 found in kube manager
2025-01-15 12:55:21,421 - INFO - Pod ctest-pod-37301705 verification passed
2025-01-15 12:55:21,430 - INFO - Pod ctest-pod-00019904 is in running state.Got IP 10.47.255.247
2025-01-15 12:55:21,500 - DEBUG - Pod ctest-pod-00019904 has vmi f4de6af4-d33f-11ef-9308-fa163e1b59c2
2025-01-15 12:55:21,500 - INFO - Verified pod ctest-pod-00019904 in contrail-api
2025-01-15 12:55:21,515 - DEBUG - VMI f4de6af4-d33f-11ef-9308-fa163e1b59c2 is active in agent 10.0.0.40
2025-01-15 12:55:21,515 - INFO - Verified Pod ctest-pod-00019904 in agent 10.0.0.40
2025-01-15 12:55:21,515 - DEBUG - Requesting: http://10.0.0.32:8108/Snh_VirtualMachineDatabaseList?x=3b879235-326e-43a5-a976-27a4071f36e0
2025-01-15 12:55:21,521 - INFO - Pod ctest-pod-00019904 with uuid 3b879235-326e-43a5-a976-27a4071f36e0 found in kube manager
2025-01-15 12:55:21,521 - INFO - Pod ctest-pod-00019904 verification passed
2025-01-15 12:55:21,529 - INFO - Pod ctest-pod-51188433 is in running state.Got IP 10.47.255.245
2025-01-15 12:55:21,549 - DEBUG - Pod ctest-pod-51188433 has vmi f5f5b424-d33f-11ef-9308-fa163e1b59c2
2025-01-15 12:55:21,549 - INFO - Verified pod ctest-pod-51188433 in contrail-api
2025-01-15 12:55:21,566 - DEBUG - VMI f5f5b424-d33f-11ef-9308-fa163e1b59c2 is active in agent 10.0.0.40
2025-01-15 12:55:21,566 - INFO - Verified Pod ctest-pod-51188433 in agent 10.0.0.40
2025-01-15 12:55:21,566 - DEBUG - Requesting: http://10.0.0.32:8108/Snh_VirtualMachineDatabaseList?x=39e4e676-b0cf-41ac-b6ed-19ce86981a70
2025-01-15 12:55:21,573 - INFO - Pod ctest-pod-51188433 with uuid 39e4e676-b0cf-41ac-b6ed-19ce86981a70 found in kube manager
2025-01-15 12:55:21,573 - INFO - Pod ctest-pod-51188433 verification passed
2025-01-15 12:55:21,579 - DEBUG - Pod ctest-pod-42336827 not in running state.Currently in Pending
2025-01-15 12:55:26,588 - INFO - Pod ctest-pod-42336827 is in running state.Got IP 10.47.255.246
2025-01-15 12:55:26,651 - DEBUG - Pod ctest-pod-42336827 has vmi f5686c5e-d33f-11ef-9308-fa163e1b59c2
2025-01-15 12:55:26,652 - INFO - Verified pod ctest-pod-42336827 in contrail-api
2025-01-15 12:55:26,667 - DEBUG - VMI f5686c5e-d33f-11ef-9308-fa163e1b59c2 is active in agent 10.0.0.40
2025-01-15 12:55:26,668 - INFO - Verified Pod ctest-pod-42336827 in agent 10.0.0.40
2025-01-15 12:55:26,668 - DEBUG - Requesting: http://10.0.0.32:8108/Snh_VirtualMachineDatabaseList?x=5d178d16-a671-4ea6-a570-00060533730f
2025-01-15 12:55:26,673 - INFO - Pod ctest-pod-42336827 with uuid 5d178d16-a671-4ea6-a570-00060533730f found in kube manager
2025-01-15 12:55:26,674 - INFO - Pod ctest-pod-42336827 verification passed
2025-01-15 12:55:26,679 - INFO - Pod ctest-pod-64326283 is in running state.Got IP 10.47.255.244
2025-01-15 12:55:26,695 - DEBUG - Pod ctest-pod-64326283 has vmi f67fa120-d33f-11ef-9308-fa163e1b59c2
2025-01-15 12:55:26,695 - INFO - Verified pod ctest-pod-64326283 in contrail-api
2025-01-15 12:55:26,713 - DEBUG - VMI f67fa120-d33f-11ef-9308-fa163e1b59c2 is active in agent 10.0.0.40
2025-01-15 12:55:26,713 - INFO - Verified Pod ctest-pod-64326283 in agent 10.0.0.40
2025-01-15 12:55:26,713 - DEBUG - Requesting: http://10.0.0.32:8108/Snh_VirtualMachineDatabaseList?x=28bfde15-014c-4b9f-999f-4f996860b54b
2025-01-15 12:55:26,719 - INFO - Pod ctest-pod-64326283 with uuid 28bfde15-014c-4b9f-999f-4f996860b54b found in kube manager
2025-01-15 12:55:26,719 - INFO - Pod ctest-pod-64326283 verification passed
2025-01-15 12:55:26,719 - INFO - ================================================================================
2025-01-15 12:55:26,719 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-01-15 12:55:26,719 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-01-15 12:55:26,979 - DEBUG - Nothing to compare xmpp stats {'10.0.0.40': {'10.0.0.32': '0'}} with
2025-01-15 12:55:26,980 - INFO - Initial checks done. Running the testcase now
2025-01-15 12:55:26,980 - INFO -
2025-01-15 12:55:27,036 - DEBUG - [Pod ctest-pod-34932020] Cmd: echo ctest-pod-34932020 > /usr/share/nginx/html/index.html, Output:
2025-01-15 12:55:27,104 - DEBUG - [Pod ctest-pod-99391706] Cmd: echo ctest-pod-99391706 > /usr/share/nginx/html/index.html, Output:
2025-01-15 12:55:27,163 - DEBUG - [Pod ctest-pod-34981172] Cmd: echo ctest-pod-34981172 > /usr/share/nginx/html/index.html, Output:
2025-01-15 12:55:27,216 - DEBUG - [Pod ctest-pod-37301705] Cmd: echo ctest-pod-37301705 > /usr/share/nginx/html/index.html, Output:
2025-01-15 12:55:27,219 - DEBUG - Service ctest-nginx-svc-26889063 not present
2025-01-15 12:55:27,220 - INFO - Creating service ctest-nginx-svc-26889063
2025-01-15 12:55:27,248 - INFO - Created Service ctest-nginx-svc-26889063
2025-01-15 12:55:27,256 - WARNING - Service UUID 95a3fecb-034a-43a7-8228-f5ee4ba32539 not yet found in contrail-api
2025-01-15 12:55:28,265 - INFO - Validated that Service ctest-nginx-svc-26889063 is seen in contrail-api
2025-01-15 12:55:28,265 - DEBUG - Requesting: http://10.0.0.32:8108/Snh_LoadbalancerDatabaseList?x=95a3fecb-034a-43a7-8228-f5ee4ba32539
2025-01-15 12:55:28,271 - INFO - Service ctest-nginx-svc-26889063 with uuid 95a3fecb-034a-43a7-8228-f5ee4ba32539 found in kube manager
2025-01-15 12:55:28,271 - INFO - Service ctest-nginx-svc-26889063 verification passed
2025-01-15 12:55:29,352 - DEBUG - [Pod ctest-pod-00019904] Cmd: wget http://10.109.172.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-99391706
2025-01-15 12:55:29,352 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd wget http://10.109.172.24:80/ -O - -T 5 -t 1 passed
2025-01-15 12:55:29,352 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-99391706
2025-01-15 12:55:29,426 - DEBUG - [Pod ctest-pod-00019904] Cmd: wget http://10.109.172.24:80/ -O - -T 5 -t 1 , Output: ctest-pod-99391706
Connecting to 10.109.172.24:80 (10.109.172.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 12:55:29,426 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd wget http://10.109.172.24:80/ -O - -T 5 -t 1 passed
2025-01-15 12:55:29,426 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd output: ctest-pod-99391706
Connecting to 10.109.172.24:80 (10.109.172.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 12:55:29,499 - DEBUG - [Pod ctest-pod-00019904] Cmd: wget http://10.109.172.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-99391706
2025-01-15 12:55:29,500 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd wget http://10.109.172.24:80/ -O - -T 5 -t 1 passed
2025-01-15 12:55:29,500 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-99391706
2025-01-15 12:55:29,573 - DEBUG - [Pod ctest-pod-00019904] Cmd: wget http://10.109.172.24:80/ -O - -T 5 -t 1 , Output: ctest-pod-34932020
Connecting to 10.109.172.24:80 (10.109.172.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 12:55:29,573 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd wget http://10.109.172.24:80/ -O - -T 5 -t 1 passed
2025-01-15 12:55:29,573 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd output: ctest-pod-34932020
Connecting to 10.109.172.24:80 (10.109.172.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 12:55:29,573 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-34932020': 1, 'ctest-pod-99391706': 3}
2025-01-15 12:55:29,650 - DEBUG - [Pod ctest-pod-51188433] Cmd: wget http://10.109.172.24:80/ -O - -T 5 -t 1 , Output: ctest-pod-34932020
Connecting to 10.109.172.24:80 (10.109.172.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 12:55:29,650 - DEBUG - [Pod Pod ctest-pod-51188433] Cmd wget http://10.109.172.24:80/ -O - -T 5 -t 1 passed
2025-01-15 12:55:29,650 - DEBUG - [Pod Pod ctest-pod-51188433] Cmd output: ctest-pod-34932020
Connecting to 10.109.172.24:80 (10.109.172.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 12:55:29,757 - DEBUG - [Pod ctest-pod-51188433] Cmd: wget http://10.109.172.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-34932020
2025-01-15 12:55:29,757 - DEBUG - [Pod Pod ctest-pod-51188433] Cmd wget http://10.109.172.24:80/ -O - -T 5 -t 1 passed
2025-01-15 12:55:29,757 - DEBUG - [Pod Pod ctest-pod-51188433] Cmd output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-34932020
2025-01-15 12:55:29,812 - DEBUG - [Pod ctest-pod-51188433] Cmd: wget http://10.109.172.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-99391706
2025-01-15 12:55:29,812 - DEBUG - [Pod Pod ctest-pod-51188433] Cmd wget http://10.109.172.24:80/ -O - -T 5 -t 1 passed
2025-01-15 12:55:29,812 - DEBUG - [Pod Pod ctest-pod-51188433] Cmd output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-99391706
2025-01-15 12:55:29,812 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-34932020': 2, 'ctest-pod-99391706': 1}
2025-01-15 12:55:29,816 - DEBUG - Network policy ingress-on-service not present
2025-01-15 12:55:29,816 - INFO - Creating Network Policy ingress-on-service
2025-01-15 12:55:29,841 - INFO - Network policy found in k8s
2025-01-15 12:55:29,841 - DEBUG - Requesting: http://10.0.0.32:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=0a7d3b2e-b371-4f8a-9d74-51cdc255a938
2025-01-15 12:55:29,852 - INFO - Network Policy ingress-on-service with uuid 0a7d3b2e-b371-4f8a-9d74-51cdc255a938 found in kube manager
2025-01-15 12:55:29,887 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-01-15 12:55:29,887 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-01-15 12:55:29,887 - DEBUG - Requesting: http://10.0.0.32:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=0a7d3b2e-b371-4f8a-9d74-51cdc255a938
2025-01-15 12:55:29,924 - WARNING - Network policy with name ingress-on-service not found in agent
2025-01-15 12:55:31,924 - DEBUG - Requesting: http://10.0.0.32:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=0a7d3b2e-b371-4f8a-9d74-51cdc255a938
2025-01-15 12:55:31,960 - INFO - Network policy with name ingress-on-service found in agent
2025-01-15 12:55:31,960 - INFO - Network Policy ingress-on-service verification passed
2025-01-15 12:55:37,024 - DEBUG - [Pod ctest-pod-00019904] Cmd: wget http://10.109.172.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:55:37,024 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd wget http://10.109.172.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:55:37,024 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:55:42,096 - DEBUG - [Pod ctest-pod-00019904] Cmd: wget http://10.109.172.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:55:42,096 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd wget http://10.109.172.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:55:42,096 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:55:47,165 - DEBUG - [Pod ctest-pod-00019904] Cmd: wget http://10.109.172.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:55:47,165 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd wget http://10.109.172.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:55:47,165 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:55:52,234 - DEBUG - [Pod ctest-pod-00019904] Cmd: wget http://10.109.172.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:55:52,234 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd wget http://10.109.172.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:55:52,234 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:55:57,637 - DEBUG - [Pod ctest-pod-00019904] Cmd: wget http://10.109.172.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:55:57,638 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd wget http://10.109.172.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:55:57,638 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:56:02,703 - DEBUG - [Pod ctest-pod-00019904] Cmd: wget http://10.109.172.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:56:02,703 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd wget http://10.109.172.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:56:02,704 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:56:07,768 - DEBUG - [Pod ctest-pod-00019904] Cmd: wget http://10.109.172.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:56:07,768 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd wget http://10.109.172.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:56:07,768 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:56:12,832 - DEBUG - [Pod ctest-pod-00019904] Cmd: wget http://10.109.172.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:56:12,832 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd wget http://10.109.172.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:56:12,832 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:56:17,886 - DEBUG - [Pod ctest-pod-00019904] Cmd: wget http://10.109.172.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:56:17,887 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd wget http://10.109.172.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:56:17,887 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:56:22,959 - DEBUG - [Pod ctest-pod-00019904] Cmd: wget http://10.109.172.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:56:22,959 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd wget http://10.109.172.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:56:22,959 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:56:22,959 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-34932020': 0, 'ctest-pod-99391706': 0}
2025-01-15 12:56:23,038 - DEBUG - [Pod ctest-pod-42336827] Cmd: wget http://10.109.172.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-99391706
2025-01-15 12:56:23,038 - DEBUG - [Pod Pod ctest-pod-42336827] Cmd wget http://10.109.172.24:80/ -O - -T 5 -t 1 passed
2025-01-15 12:56:23,038 - DEBUG - [Pod Pod ctest-pod-42336827] Cmd output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-99391706
2025-01-15 12:56:23,096 - DEBUG - [Pod ctest-pod-42336827] Cmd: wget http://10.109.172.24:80/ -O - -T 5 -t 1 , Output: ctest-pod-34932020
Connecting to 10.109.172.24:80 (10.109.172.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 12:56:23,096 - DEBUG - [Pod Pod ctest-pod-42336827] Cmd wget http://10.109.172.24:80/ -O - -T 5 -t 1 passed
2025-01-15 12:56:23,096 - DEBUG - [Pod Pod ctest-pod-42336827] Cmd output: ctest-pod-34932020
Connecting to 10.109.172.24:80 (10.109.172.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 12:56:23,096 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-34932020': 1, 'ctest-pod-99391706': 1}
2025-01-15 12:56:28,149 - DEBUG - [Pod ctest-pod-51188433] Cmd: wget http://10.109.172.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:56:28,149 - DEBUG - [Pod Pod ctest-pod-51188433] Cmd wget http://10.109.172.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:56:28,149 - DEBUG - [Pod Pod ctest-pod-51188433] Cmd output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:56:33,216 - DEBUG - [Pod ctest-pod-51188433] Cmd: wget http://10.109.172.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:56:33,216 - DEBUG - [Pod Pod ctest-pod-51188433] Cmd wget http://10.109.172.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:56:33,216 - DEBUG - [Pod Pod ctest-pod-51188433] Cmd output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:56:38,273 - DEBUG - [Pod ctest-pod-51188433] Cmd: wget http://10.109.172.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:56:38,273 - DEBUG - [Pod Pod ctest-pod-51188433] Cmd wget http://10.109.172.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:56:38,273 - DEBUG - [Pod Pod ctest-pod-51188433] Cmd output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:56:43,350 - DEBUG - [Pod ctest-pod-51188433] Cmd: wget http://10.109.172.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:56:43,350 - DEBUG - [Pod Pod ctest-pod-51188433] Cmd wget http://10.109.172.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:56:43,350 - DEBUG - [Pod Pod ctest-pod-51188433] Cmd output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:56:48,422 - DEBUG - [Pod ctest-pod-51188433] Cmd: wget http://10.109.172.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:56:48,422 - DEBUG - [Pod Pod ctest-pod-51188433] Cmd wget http://10.109.172.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:56:48,422 - DEBUG - [Pod Pod ctest-pod-51188433] Cmd output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:56:53,480 - DEBUG - [Pod ctest-pod-51188433] Cmd: wget http://10.109.172.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:56:53,480 - DEBUG - [Pod Pod ctest-pod-51188433] Cmd wget http://10.109.172.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:56:53,480 - DEBUG - [Pod Pod ctest-pod-51188433] Cmd output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:56:56,202 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2025-01-15 12:57:06,580 - DEBUG - [Pod ctest-pod-51188433] Cmd: wget http://10.109.172.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:57:06,580 - DEBUG - [Pod Pod ctest-pod-51188433] Cmd wget http://10.109.172.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:57:06,580 - DEBUG - [Pod Pod ctest-pod-51188433] Cmd output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:57:11,633 - DEBUG - [Pod ctest-pod-51188433] Cmd: wget http://10.109.172.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:57:11,633 - DEBUG - [Pod Pod ctest-pod-51188433] Cmd wget http://10.109.172.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:57:11,633 - DEBUG - [Pod Pod ctest-pod-51188433] Cmd output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:57:16,688 - DEBUG - [Pod ctest-pod-51188433] Cmd: wget http://10.109.172.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:57:16,689 - DEBUG - [Pod Pod ctest-pod-51188433] Cmd wget http://10.109.172.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:57:16,689 - DEBUG - [Pod Pod ctest-pod-51188433] Cmd output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:57:21,774 - DEBUG - [Pod ctest-pod-51188433] Cmd: wget http://10.109.172.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:57:21,774 - DEBUG - [Pod Pod ctest-pod-51188433] Cmd wget http://10.109.172.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:57:21,774 - DEBUG - [Pod Pod ctest-pod-51188433] Cmd output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:57:21,774 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-34932020': 0, 'ctest-pod-99391706': 0}
2025-01-15 12:57:23,838 - DEBUG - [Pod ctest-pod-42336827] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.101 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.198 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.093 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.093/0.464/1.101 ms
2025-01-15 12:57:23,838 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-42336827 with expectation True passed
2025-01-15 12:57:25,905 - DEBUG - [Pod ctest-pod-00019904] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.005 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.069 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.170 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.069/0.414/1.005 ms
2025-01-15 12:57:25,905 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-00019904 with expectation True passed
2025-01-15 12:57:27,977 - DEBUG - [Pod ctest-pod-51188433] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.754 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.097 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.100 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.097/0.317/0.754 ms
2025-01-15 12:57:27,977 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-51188433 with expectation True passed
2025-01-15 12:57:28,055 - DEBUG - [Pod ctest-pod-42336827] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-15 12:57:28,056 - DEBUG - [Pod Pod ctest-pod-42336827] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-01-15 12:57:28,056 - DEBUG - [Pod Pod ctest-pod-42336827] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-15 12:57:28,056 - INFO - wget check of of http://10.47.255.251 from ctest-pod-42336827 passed
2025-01-15 12:57:28,117 - DEBUG - [Pod ctest-pod-42336827] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-15 12:57:28,117 - DEBUG - [Pod Pod ctest-pod-42336827] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-01-15 12:57:28,117 - DEBUG - [Pod Pod ctest-pod-42336827] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-15 12:57:28,117 - INFO - wget check of of http://10.47.255.250 from ctest-pod-42336827 passed
2025-01-15 12:57:33,192 - DEBUG - [Pod ctest-pod-00019904] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-01-15 12:57:33,192 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-01-15 12:57:33,192 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-01-15 12:57:33,192 - INFO - wget check of of http://10.47.255.250 from ctest-pod-00019904 passed
2025-01-15 12:57:38,264 - DEBUG - [Pod ctest-pod-64326283] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-01-15 12:57:38,265 - DEBUG - [Pod Pod ctest-pod-64326283] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-01-15 12:57:38,265 - DEBUG - [Pod Pod ctest-pod-64326283] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-01-15 12:57:38,265 - INFO - wget check of of http://10.47.255.251 from ctest-pod-64326283 passed
2025-01-15 12:57:38,276 - INFO - Updating Network Policy ingress-on-service
2025-01-15 12:57:43,362 - DEBUG - [Pod ctest-pod-00019904] Cmd: wget http://10.109.172.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:57:43,362 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd wget http://10.109.172.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:57:43,362 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:57:48,440 - DEBUG - [Pod ctest-pod-00019904] Cmd: wget http://10.109.172.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:57:48,441 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd wget http://10.109.172.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:57:48,441 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:57:53,507 - DEBUG - [Pod ctest-pod-00019904] Cmd: wget http://10.109.172.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:57:53,508 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd wget http://10.109.172.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:57:53,508 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:57:58,567 - DEBUG - [Pod ctest-pod-00019904] Cmd: wget http://10.109.172.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:57:58,567 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd wget http://10.109.172.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:57:58,567 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:58:03,626 - DEBUG - [Pod ctest-pod-00019904] Cmd: wget http://10.109.172.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:58:03,626 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd wget http://10.109.172.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:58:03,626 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:58:08,690 - DEBUG - [Pod ctest-pod-00019904] Cmd: wget http://10.109.172.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:58:08,690 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd wget http://10.109.172.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:58:08,690 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:58:13,753 - DEBUG - [Pod ctest-pod-00019904] Cmd: wget http://10.109.172.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:58:13,753 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd wget http://10.109.172.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:58:13,753 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:58:18,827 - DEBUG - [Pod ctest-pod-00019904] Cmd: wget http://10.109.172.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:58:18,827 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd wget http://10.109.172.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:58:18,828 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:58:23,898 - DEBUG - [Pod ctest-pod-00019904] Cmd: wget http://10.109.172.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:58:23,899 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd wget http://10.109.172.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:58:23,899 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:58:28,970 - DEBUG - [Pod ctest-pod-00019904] Cmd: wget http://10.109.172.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:58:28,971 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd wget http://10.109.172.24:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:58:28,971 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
wget: download timed out
2025-01-15 12:58:28,971 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-34932020': 0, 'ctest-pod-99391706': 0}
2025-01-15 12:58:29,035 - DEBUG - [Pod ctest-pod-42336827] Cmd: wget http://10.109.172.24:80/ -O - -T 5 -t 1 , Output: ctest-pod-34932020
Connecting to 10.109.172.24:80 (10.109.172.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 12:58:29,036 - DEBUG - [Pod Pod ctest-pod-42336827] Cmd wget http://10.109.172.24:80/ -O - -T 5 -t 1 passed
2025-01-15 12:58:29,036 - DEBUG - [Pod Pod ctest-pod-42336827] Cmd output: ctest-pod-34932020
Connecting to 10.109.172.24:80 (10.109.172.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 12:58:29,098 - DEBUG - [Pod ctest-pod-42336827] Cmd: wget http://10.109.172.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-34932020
2025-01-15 12:58:29,098 - DEBUG - [Pod Pod ctest-pod-42336827] Cmd wget http://10.109.172.24:80/ -O - -T 5 -t 1 passed
2025-01-15 12:58:29,098 - DEBUG - [Pod Pod ctest-pod-42336827] Cmd output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-34932020
2025-01-15 12:58:29,177 - DEBUG - [Pod ctest-pod-42336827] Cmd: wget http://10.109.172.24:80/ -O - -T 5 -t 1 , Output: ctest-pod-99391706
Connecting to 10.109.172.24:80 (10.109.172.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 12:58:29,178 - DEBUG - [Pod Pod ctest-pod-42336827] Cmd wget http://10.109.172.24:80/ -O - -T 5 -t 1 passed
2025-01-15 12:58:29,178 - DEBUG - [Pod Pod ctest-pod-42336827] Cmd output: ctest-pod-99391706
Connecting to 10.109.172.24:80 (10.109.172.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 12:58:29,178 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-34932020': 2, 'ctest-pod-99391706': 1}
2025-01-15 12:58:29,249 - DEBUG - [Pod ctest-pod-51188433] Cmd: wget http://10.109.172.24:80/ -O - -T 5 -t 1 , Output: ctest-pod-34932020
Connecting to 10.109.172.24:80 (10.109.172.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 12:58:29,249 - DEBUG - [Pod Pod ctest-pod-51188433] Cmd wget http://10.109.172.24:80/ -O - -T 5 -t 1 passed
2025-01-15 12:58:29,249 - DEBUG - [Pod Pod ctest-pod-51188433] Cmd output: ctest-pod-34932020
Connecting to 10.109.172.24:80 (10.109.172.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 12:58:29,329 - DEBUG - [Pod ctest-pod-51188433] Cmd: wget http://10.109.172.24:80/ -O - -T 5 -t 1 , Output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-34932020
2025-01-15 12:58:29,329 - DEBUG - [Pod Pod ctest-pod-51188433] Cmd wget http://10.109.172.24:80/ -O - -T 5 -t 1 passed
2025-01-15 12:58:29,329 - DEBUG - [Pod Pod ctest-pod-51188433] Cmd output: Connecting to 10.109.172.24:80 (10.109.172.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-34932020
2025-01-15 12:58:29,394 - DEBUG - [Pod ctest-pod-51188433] Cmd: wget http://10.109.172.24:80/ -O - -T 5 -t 1 , Output: ctest-pod-99391706
Connecting to 10.109.172.24:80 (10.109.172.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 12:58:29,394 - DEBUG - [Pod Pod ctest-pod-51188433] Cmd wget http://10.109.172.24:80/ -O - -T 5 -t 1 passed
2025-01-15 12:58:29,394 - DEBUG - [Pod Pod ctest-pod-51188433] Cmd output: ctest-pod-99391706
Connecting to 10.109.172.24:80 (10.109.172.24:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-01-15 12:58:29,394 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-34932020': 2, 'ctest-pod-99391706': 1}
2025-01-15 12:58:31,455 - DEBUG - [Pod ctest-pod-42336827] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.400 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.074 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.112 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.074/0.195/0.400 ms
2025-01-15 12:58:31,455 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-42336827 with expectation True passed
2025-01-15 12:58:33,528 - DEBUG - [Pod ctest-pod-00019904] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.970 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.074 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.082 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.074/0.708/1.970 ms
2025-01-15 12:58:33,528 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-00019904 with expectation True passed
2025-01-15 12:58:35,592 - DEBUG - [Pod ctest-pod-51188433] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.749 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.080 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.096 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.080/0.308/0.749 ms
2025-01-15 12:58:35,593 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-51188433 with expectation True passed
2025-01-15 12:58:35,658 - DEBUG - [Pod ctest-pod-42336827] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-15 12:58:35,659 - DEBUG - [Pod Pod ctest-pod-42336827] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-01-15 12:58:35,659 - DEBUG - [Pod Pod ctest-pod-42336827] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-15 12:58:35,659 - INFO - wget check of of http://10.47.255.251 from ctest-pod-42336827 passed
2025-01-15 12:58:35,730 - DEBUG - [Pod ctest-pod-42336827] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-15 12:58:35,730 - DEBUG - [Pod Pod ctest-pod-42336827] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-01-15 12:58:35,730 - DEBUG - [Pod Pod ctest-pod-42336827] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-15 12:58:35,730 - INFO - wget check of of http://10.47.255.250 from ctest-pod-42336827 passed
2025-01-15 12:58:40,798 - DEBUG - [Pod ctest-pod-00019904] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-01-15 12:58:40,798 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-01-15 12:58:40,798 - DEBUG - [Pod Pod ctest-pod-00019904] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-01-15 12:58:40,798 - INFO - wget check of of http://10.47.255.250 from ctest-pod-00019904 passed
2025-01-15 12:58:40,857 - DEBUG - [Pod ctest-pod-64326283] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-15 12:58:40,857 - DEBUG - [Pod Pod ctest-pod-64326283] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-01-15 12:58:40,857 - DEBUG - [Pod Pod ctest-pod-64326283] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-01-15 12:58:40,857 - INFO - wget check of of http://10.47.255.251 from ctest-pod-64326283 passed
2025-01-15 12:58:40,858 - INFO - Deleting Network Policy : ingress-on-service
2025-01-15 12:58:40,859 - INFO - Deleting service : ctest-nginx-svc-26889063
2025-01-15 12:58:41,128 - DEBUG - No XMPP flaps were noticed during the test
2025-01-15 12:58:41,129 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:15]
2025-01-15 12:58:41,129 - INFO - --------------------------------------------------------------------------------
2025-01-15 12:58:41,134 - INFO - Deleting pod ctest-new-default-92034699:ctest-pod-34932020
2025-01-15 12:58:41,135 - INFO - Deleting pod ctest-new-default-92034699:ctest-pod-99391706
2025-01-15 12:58:41,135 - INFO - Deleting pod ctest-non-default-62646507:ctest-pod-34981172
2025-01-15 12:58:41,136 - INFO - Deleting pod ctest-non-default-62646507:ctest-pod-37301705
2025-01-15 12:58:41,136 - INFO - Deleting pod ctest-new-default-92034699:ctest-pod-00019904
2025-01-15 12:58:41,136 - INFO - Deleting pod ctest-new-default-92034699:ctest-pod-42336827
2025-01-15 12:58:41,137 - INFO - Deleting pod ctest-non-default-62646507:ctest-pod-51188433
2025-01-15 12:58:41,137 - INFO - Deleting pod ctest-non-default-62646507:ctest-pod-64326283
2025-01-15 12:58:41,264 - WARNING - Pod uuid e9b21818-2470-40ec-8724-372878c9e36f is still seen in agent 10.0.0.40 VM list
2025-01-15 12:58:41,382 - WARNING - Pod uuid 499b01be-fa45-44da-8151-a29e08c14d7f is still seen in agent 10.0.0.40 VM list
2025-01-15 12:58:41,384 - WARNING - Pod uuid 39e4e676-b0cf-41ac-b6ed-19ce86981a70 is still seen in agent 10.0.0.40 VM list
2025-01-15 12:58:41,384 - WARNING - Pod uuid 5d178d16-a671-4ea6-a570-00060533730f is still seen in agent 10.0.0.40 VM list
2025-01-15 12:58:41,384 - WARNING - Pod uuid 128e20a8-e976-48a7-a9a9-b73f4a2122b3 is still seen in agent 10.0.0.40 VM list
2025-01-15 12:58:41,385 - WARNING - Pod uuid 7b38c442-dee6-4ec9-930b-afb659829a75 is still seen in agent 10.0.0.40 VM list
2025-01-15 12:58:41,385 - WARNING - Pod uuid 28bfde15-014c-4b9f-999f-4f996860b54b is still seen in agent 10.0.0.40 VM list
2025-01-15 12:58:41,448 - WARNING - Pod uuid 3b879235-326e-43a5-a976-27a4071f36e0 is still seen in agent 10.0.0.40 VM list
2025-01-15 12:58:46,273 - DEBUG - Pod e9b21818-2470-40ec-8724-372878c9e36f is not in agent 10.0.0.40 VM list
2025-01-15 12:58:46,280 - DEBUG - VMI f2414780-d33f-11ef-9308-fa163e1b59c2 is removed from agent 10.0.0.40
2025-01-15 12:58:46,280 - INFO - Verified that pod ctest-pod-34932020 is removed in agent
2025-01-15 12:58:46,409 - DEBUG - Pod 7b38c442-dee6-4ec9-930b-afb659829a75 is not in agent 10.0.0.40 VM list
2025-01-15 12:58:46,410 - DEBUG - Pod 128e20a8-e976-48a7-a9a9-b73f4a2122b3 is not in agent 10.0.0.40 VM list
2025-01-15 12:58:46,412 - WARNING - Pod uuid 5d178d16-a671-4ea6-a570-00060533730f is still seen in agent 10.0.0.40 VM list
2025-01-15 12:58:46,415 - WARNING - Pod uuid 28bfde15-014c-4b9f-999f-4f996860b54b is still seen in agent 10.0.0.40 VM list
2025-01-15 12:58:46,416 - WARNING - Pod uuid 39e4e676-b0cf-41ac-b6ed-19ce86981a70 is still seen in agent 10.0.0.40 VM list
2025-01-15 12:58:46,416 - DEBUG - Pod 499b01be-fa45-44da-8151-a29e08c14d7f is not in agent 10.0.0.40 VM list
2025-01-15 12:58:46,427 - DEBUG - VMI f42d5034-d33f-11ef-9308-fa163e1b59c2 is removed from agent 10.0.0.40
2025-01-15 12:58:46,427 - INFO - Verified that pod ctest-pod-37301705 is removed in agent
2025-01-15 12:58:46,429 - DEBUG - VMI f39adcc2-d33f-11ef-9308-fa163e1b59c2 is removed from agent 10.0.0.40
2025-01-15 12:58:46,429 - INFO - Verified that pod ctest-pod-34981172 is removed in agent
2025-01-15 12:58:46,429 - DEBUG - VMI f2db7ada-d33f-11ef-9308-fa163e1b59c2 is removed from agent 10.0.0.40
2025-01-15 12:58:46,429 - INFO - Verified that pod ctest-pod-99391706 is removed in agent
2025-01-15 12:58:46,456 - WARNING - Pod uuid 3b879235-326e-43a5-a976-27a4071f36e0 is still seen in agent 10.0.0.40 VM list
2025-01-15 12:58:51,437 - WARNING - Pod uuid 28bfde15-014c-4b9f-999f-4f996860b54b is still seen in agent 10.0.0.40 VM list
2025-01-15 12:58:51,439 - WARNING - Pod uuid 39e4e676-b0cf-41ac-b6ed-19ce86981a70 is still seen in agent 10.0.0.40 VM list
2025-01-15 12:58:51,439 - WARNING - Pod uuid 5d178d16-a671-4ea6-a570-00060533730f is still seen in agent 10.0.0.40 VM list
2025-01-15 12:58:51,469 - WARNING - Pod uuid 3b879235-326e-43a5-a976-27a4071f36e0 is still seen in agent 10.0.0.40 VM list
2025-01-15 12:58:56,454 - WARNING - Pod uuid 28bfde15-014c-4b9f-999f-4f996860b54b is still seen in agent 10.0.0.40 VM list
2025-01-15 12:58:56,455 - WARNING - Pod uuid 5d178d16-a671-4ea6-a570-00060533730f is still seen in agent 10.0.0.40 VM list
2025-01-15 12:58:56,456 - WARNING - Pod uuid 39e4e676-b0cf-41ac-b6ed-19ce86981a70 is still seen in agent 10.0.0.40 VM list
2025-01-15 12:58:56,477 - WARNING - Pod uuid 3b879235-326e-43a5-a976-27a4071f36e0 is still seen in agent 10.0.0.40 VM list
2025-01-15 12:59:01,472 - WARNING - Pod uuid 28bfde15-014c-4b9f-999f-4f996860b54b is still seen in agent 10.0.0.40 VM list
2025-01-15 12:59:01,474 - WARNING - Pod uuid 39e4e676-b0cf-41ac-b6ed-19ce86981a70 is still seen in agent 10.0.0.40 VM list
2025-01-15 12:59:01,475 - WARNING - Pod uuid 5d178d16-a671-4ea6-a570-00060533730f is still seen in agent 10.0.0.40 VM list
2025-01-15 12:59:01,485 - WARNING - Pod uuid 3b879235-326e-43a5-a976-27a4071f36e0 is still seen in agent 10.0.0.40 VM list
2025-01-15 12:59:06,490 - WARNING - Pod uuid 28bfde15-014c-4b9f-999f-4f996860b54b is still seen in agent 10.0.0.40 VM list
2025-01-15 12:59:06,491 - WARNING - Pod uuid 39e4e676-b0cf-41ac-b6ed-19ce86981a70 is still seen in agent 10.0.0.40 VM list
2025-01-15 12:59:06,493 - WARNING - Pod uuid 5d178d16-a671-4ea6-a570-00060533730f is still seen in agent 10.0.0.40 VM list
2025-01-15 12:59:06,494 - WARNING - Pod uuid 3b879235-326e-43a5-a976-27a4071f36e0 is still seen in agent 10.0.0.40 VM list
2025-01-15 12:59:11,559 - WARNING - Pod uuid 28bfde15-014c-4b9f-999f-4f996860b54b is still seen in agent 10.0.0.40 VM list
2025-01-15 12:59:11,561 - WARNING - Pod uuid 5d178d16-a671-4ea6-a570-00060533730f is still seen in agent 10.0.0.40 VM list
2025-01-15 12:59:11,562 - WARNING - Pod uuid 3b879235-326e-43a5-a976-27a4071f36e0 is still seen in agent 10.0.0.40 VM list
2025-01-15 12:59:11,562 - WARNING - Pod uuid 39e4e676-b0cf-41ac-b6ed-19ce86981a70 is still seen in agent 10.0.0.40 VM list
2025-01-15 12:59:16,570 - DEBUG - Pod 28bfde15-014c-4b9f-999f-4f996860b54b is not in agent 10.0.0.40 VM list
2025-01-15 12:59:16,575 - DEBUG - Pod 5d178d16-a671-4ea6-a570-00060533730f is not in agent 10.0.0.40 VM list
2025-01-15 12:59:16,579 - DEBUG - Pod 3b879235-326e-43a5-a976-27a4071f36e0 is not in agent 10.0.0.40 VM list
2025-01-15 12:59:16,580 - DEBUG - Pod 39e4e676-b0cf-41ac-b6ed-19ce86981a70 is not in agent 10.0.0.40 VM list
2025-01-15 12:59:16,582 - DEBUG - VMI f67fa120-d33f-11ef-9308-fa163e1b59c2 is removed from agent 10.0.0.40
2025-01-15 12:59:16,582 - INFO - Verified that pod ctest-pod-64326283 is removed in agent
2025-01-15 12:59:16,591 - DEBUG - VMI f5686c5e-d33f-11ef-9308-fa163e1b59c2 is removed from agent 10.0.0.40
2025-01-15 12:59:16,591 - INFO - Verified that pod ctest-pod-42336827 is removed in agent
2025-01-15 12:59:16,593 - DEBUG - VMI f5f5b424-d33f-11ef-9308-fa163e1b59c2 is removed from agent 10.0.0.40
2025-01-15 12:59:16,593 - INFO - Verified that pod ctest-pod-51188433 is removed in agent
2025-01-15 12:59:16,594 - DEBUG - VMI f4de6af4-d33f-11ef-9308-fa163e1b59c2 is removed from agent 10.0.0.40
2025-01-15 12:59:16,594 - INFO - Verified that pod ctest-pod-00019904 is removed in agent
2025-01-15 12:59:16,594 - INFO - Deleting namespace ctest-non-default-62646507
2025-01-15 12:59:16,607 - DEBUG - Namespace ctest-non-default-62646507 still in k8s
2025-01-15 12:59:18,613 - DEBUG - Namespace ctest-non-default-62646507 still in k8s
2025-01-15 12:59:20,619 - DEBUG - Namespace ctest-non-default-62646507 still in k8s
2025-01-15 12:59:22,624 - DEBUG - Namespace ctest-non-default-62646507 is not in k8s
2025-01-15 12:59:22,624 - DEBUG - No need to check project deletion in contrail-api
2025-01-15 12:59:22,624 - INFO - Deleting namespace ctest-new-default-92034699
2025-01-15 12:59:22,633 - DEBUG - Namespace ctest-new-default-92034699 still in k8s
2025-01-15 12:59:24,638 - DEBUG - Namespace ctest-new-default-92034699 still in k8s
2025-01-15 12:59:26,652 - DEBUG - Namespace ctest-new-default-92034699 still in k8s
2025-01-15 12:59:28,656 - DEBUG - Namespace ctest-new-default-92034699 is not in k8s
2025-01-15 12:59:28,656 - DEBUG - No need to check project deletion in contrail-api