2024-11-10 20:46:24,895 - INFO - Using existing project ['default-domain', 'k8s-default'](091c8b77-872e-4563-8fd9-72440d7fcec2)
2024-11-10 20:46:24,913 - DEBUG - Namespace ctest-new-default-67088327 not present
2024-11-10 20:46:24,921 - INFO - Created namespace ctest-new-default-67088327
2024-11-10 20:46:27,926 - DEBUG - Namespace ctest-non-default-29857301 not present
2024-11-10 20:46:27,942 - INFO - Created namespace ctest-non-default-29857301
2024-11-10 20:46:30,965 - DEBUG - Pod ctest-pod-48615901 not present
2024-11-10 20:46:30,965 - INFO - Creating Pod ctest-pod-48615901
2024-11-10 20:46:31,039 - DEBUG - Pod : ctest-pod-48615901 UUID is 16f9383f-5f9d-46b2-a42b-ced897c69519
2024-11-10 20:46:31,042 - DEBUG - Pod ctest-pod-76737397 not present
2024-11-10 20:46:31,042 - INFO - Creating Pod ctest-pod-76737397
2024-11-10 20:46:31,092 - DEBUG - Pod : ctest-pod-76737397 UUID is 8f7d8666-4ba8-48cd-80c4-4d55b5cf4da2
2024-11-10 20:46:31,099 - DEBUG - Pod ctest-pod-37510248 not present
2024-11-10 20:46:31,100 - INFO - Creating Pod ctest-pod-37510248
2024-11-10 20:46:31,125 - DEBUG - Pod : ctest-pod-37510248 UUID is 111d2901-7063-4abf-91b2-18e6230f3d6e
2024-11-10 20:46:31,127 - DEBUG - Pod ctest-pod-07050198 not present
2024-11-10 20:46:31,127 - INFO - Creating Pod ctest-pod-07050198
2024-11-10 20:46:31,154 - DEBUG - Pod : ctest-pod-07050198 UUID is e21c1054-077d-46a8-a9ca-61d1d73375b3
2024-11-10 20:46:31,157 - DEBUG - Pod ctest-pod-07896918 not present
2024-11-10 20:46:31,157 - INFO - Creating Pod ctest-pod-07896918
2024-11-10 20:46:31,174 - DEBUG - Pod : ctest-pod-07896918 UUID is d0fa8629-2b4d-45cf-abf6-3402433ed899
2024-11-10 20:46:31,176 - DEBUG - Pod ctest-pod-64429342 not present
2024-11-10 20:46:31,176 - INFO - Creating Pod ctest-pod-64429342
2024-11-10 20:46:31,192 - DEBUG - Pod : ctest-pod-64429342 UUID is 18850fea-3cb1-4944-9051-313c98b69422
2024-11-10 20:46:31,194 - DEBUG - Pod ctest-pod-98303090 not present
2024-11-10 20:46:31,194 - INFO - Creating Pod ctest-pod-98303090
2024-11-10 20:46:31,217 - DEBUG - Pod : ctest-pod-98303090 UUID is 3901d6ee-6137-49df-855f-1f9609f45e62
2024-11-10 20:46:31,222 - DEBUG - Pod ctest-pod-66933120 not present
2024-11-10 20:46:31,222 - INFO - Creating Pod ctest-pod-66933120
2024-11-10 20:46:31,240 - DEBUG - Pod : ctest-pod-66933120 UUID is 924de86a-c10f-47d8-b458-10666e2bf8e6
2024-11-10 20:46:31,473 - INFO - Project default-domain:k8s-ctest-new-default-67088327 for Namespace ctest-new-default-67088327 is seen in contrail-api
2024-11-10 20:46:31,473 - DEBUG - Project uuid in Contrail is 27ebfb30-372f-4412-845b-abf03f39745d
2024-11-10 20:46:31,677 - DEBUG - Requesting: http://10.0.0.42:8108/Snh_NamespaceDatabaseList?namespace_uuid=fc75bca4-f93e-4330-8485-83d9ef0cfce7
2024-11-10 20:46:31,681 - INFO - Namespace ctest-new-default-67088327 with uuid fc75bca4-f93e-4330-8485-83d9ef0cfce7 found in kube manager
2024-11-10 20:46:31,681 - INFO - Namespace ctest-new-default-67088327 verification passed
2024-11-10 20:46:31,841 - INFO - Project default-domain:k8s-ctest-non-default-29857301 for Namespace ctest-non-default-29857301 is seen in contrail-api
2024-11-10 20:46:31,841 - DEBUG - Project uuid in Contrail is 57c7713f-a723-4fb2-8748-fb1dc1969b88
2024-11-10 20:46:31,841 - DEBUG - Requesting: http://10.0.0.42:8108/Snh_NamespaceDatabaseList?namespace_uuid=697d6edc-25f7-4603-af95-78f90ea3d576
2024-11-10 20:46:31,846 - INFO - Namespace ctest-non-default-29857301 with uuid 697d6edc-25f7-4603-af95-78f90ea3d576 found in kube manager
2024-11-10 20:46:31,846 - INFO - Namespace ctest-non-default-29857301 verification passed
2024-11-10 20:46:31,852 - DEBUG - Pod ctest-pod-48615901 not in running state.Currently in Pending
2024-11-10 20:46:36,873 - DEBUG - Pod ctest-pod-48615901 not in running state.Currently in Pending
2024-11-10 20:46:41,882 - INFO - Pod ctest-pod-48615901 is in running state.Got IP 10.47.255.251
2024-11-10 20:46:41,902 - DEBUG - Pod ctest-pod-48615901 has vmi de983a00-9fa4-11ef-9cd5-fa163e659e94
2024-11-10 20:46:41,902 - INFO - Verified pod ctest-pod-48615901 in contrail-api
2024-11-10 20:46:41,914 - DEBUG - VMI de983a00-9fa4-11ef-9cd5-fa163e659e94 is active in agent 10.0.0.38
2024-11-10 20:46:41,914 - INFO - Verified Pod ctest-pod-48615901 in agent 10.0.0.38
2024-11-10 20:46:41,915 - DEBUG - Requesting: http://10.0.0.42:8108/Snh_VirtualMachineDatabaseList?x=16f9383f-5f9d-46b2-a42b-ced897c69519
2024-11-10 20:46:41,919 - INFO - Pod ctest-pod-48615901 with uuid 16f9383f-5f9d-46b2-a42b-ced897c69519 found in kube manager
2024-11-10 20:46:41,919 - INFO - Pod ctest-pod-48615901 verification passed
2024-11-10 20:46:41,924 - DEBUG - Pod ctest-pod-76737397 not in running state.Currently in Pending
2024-11-10 20:46:46,930 - INFO - Pod ctest-pod-76737397 is in running state.Got IP 10.47.255.250
2024-11-10 20:46:46,996 - DEBUG - Pod ctest-pod-76737397 has vmi df19ebf4-9fa4-11ef-9cd5-fa163e659e94
2024-11-10 20:46:46,996 - INFO - Verified pod ctest-pod-76737397 in contrail-api
2024-11-10 20:46:47,014 - DEBUG - VMI df19ebf4-9fa4-11ef-9cd5-fa163e659e94 is active in agent 10.0.0.38
2024-11-10 20:46:47,015 - INFO - Verified Pod ctest-pod-76737397 in agent 10.0.0.38
2024-11-10 20:46:47,016 - DEBUG - Requesting: http://10.0.0.42:8108/Snh_VirtualMachineDatabaseList?x=8f7d8666-4ba8-48cd-80c4-4d55b5cf4da2
2024-11-10 20:46:47,021 - INFO - Pod ctest-pod-76737397 with uuid 8f7d8666-4ba8-48cd-80c4-4d55b5cf4da2 found in kube manager
2024-11-10 20:46:47,021 - INFO - Pod ctest-pod-76737397 verification passed
2024-11-10 20:46:47,026 - INFO - Pod ctest-pod-37510248 is in running state.Got IP 10.47.255.249
2024-11-10 20:46:47,084 - DEBUG - Pod ctest-pod-37510248 has vmi dfc925ce-9fa4-11ef-9cd5-fa163e659e94
2024-11-10 20:46:47,085 - INFO - Verified pod ctest-pod-37510248 in contrail-api
2024-11-10 20:46:47,098 - DEBUG - VMI dfc925ce-9fa4-11ef-9cd5-fa163e659e94 is active in agent 10.0.0.38
2024-11-10 20:46:47,098 - INFO - Verified Pod ctest-pod-37510248 in agent 10.0.0.38
2024-11-10 20:46:47,098 - DEBUG - Requesting: http://10.0.0.42:8108/Snh_VirtualMachineDatabaseList?x=111d2901-7063-4abf-91b2-18e6230f3d6e
2024-11-10 20:46:47,103 - INFO - Pod ctest-pod-37510248 with uuid 111d2901-7063-4abf-91b2-18e6230f3d6e found in kube manager
2024-11-10 20:46:47,103 - INFO - Pod ctest-pod-37510248 verification passed
2024-11-10 20:46:47,108 - DEBUG - Pod ctest-pod-07050198 not in running state.Currently in Pending
2024-11-10 20:46:52,119 - INFO - Pod ctest-pod-07050198 is in running state.Got IP 10.47.255.248
2024-11-10 20:46:52,184 - DEBUG - Pod ctest-pod-07050198 has vmi e056c154-9fa4-11ef-9cd5-fa163e659e94
2024-11-10 20:46:52,184 - INFO - Verified pod ctest-pod-07050198 in contrail-api
2024-11-10 20:46:52,203 - DEBUG - VMI e056c154-9fa4-11ef-9cd5-fa163e659e94 is active in agent 10.0.0.38
2024-11-10 20:46:52,204 - INFO - Verified Pod ctest-pod-07050198 in agent 10.0.0.38
2024-11-10 20:46:52,204 - DEBUG - Requesting: http://10.0.0.42:8108/Snh_VirtualMachineDatabaseList?x=e21c1054-077d-46a8-a9ca-61d1d73375b3
2024-11-10 20:46:52,209 - INFO - Pod ctest-pod-07050198 with uuid e21c1054-077d-46a8-a9ca-61d1d73375b3 found in kube manager
2024-11-10 20:46:52,210 - INFO - Pod ctest-pod-07050198 verification passed
2024-11-10 20:46:52,215 - INFO - Pod ctest-pod-07896918 is in running state.Got IP 10.47.255.247
2024-11-10 20:46:52,250 - DEBUG - Pod ctest-pod-07896918 has vmi e0db7f2a-9fa4-11ef-9cd5-fa163e659e94
2024-11-10 20:46:52,250 - INFO - Verified pod ctest-pod-07896918 in contrail-api
2024-11-10 20:46:52,281 - DEBUG - VMI e0db7f2a-9fa4-11ef-9cd5-fa163e659e94 is active in agent 10.0.0.38
2024-11-10 20:46:52,282 - INFO - Verified Pod ctest-pod-07896918 in agent 10.0.0.38
2024-11-10 20:46:52,282 - DEBUG - Requesting: http://10.0.0.42:8108/Snh_VirtualMachineDatabaseList?x=d0fa8629-2b4d-45cf-abf6-3402433ed899
2024-11-10 20:46:52,296 - INFO - Pod ctest-pod-07896918 with uuid d0fa8629-2b4d-45cf-abf6-3402433ed899 found in kube manager
2024-11-10 20:46:52,296 - INFO - Pod ctest-pod-07896918 verification passed
2024-11-10 20:46:52,309 - INFO - Pod ctest-pod-98303090 is in running state.Got IP 10.47.255.245
2024-11-10 20:46:52,393 - DEBUG - Pod ctest-pod-98303090 has vmi e1d4a33e-9fa4-11ef-9cd5-fa163e659e94
2024-11-10 20:46:52,393 - INFO - Verified pod ctest-pod-98303090 in contrail-api
2024-11-10 20:46:52,408 - DEBUG - VMI e1d4a33e-9fa4-11ef-9cd5-fa163e659e94 is active in agent 10.0.0.38
2024-11-10 20:46:52,409 - INFO - Verified Pod ctest-pod-98303090 in agent 10.0.0.38
2024-11-10 20:46:52,409 - DEBUG - Requesting: http://10.0.0.42:8108/Snh_VirtualMachineDatabaseList?x=3901d6ee-6137-49df-855f-1f9609f45e62
2024-11-10 20:46:52,420 - INFO - Pod ctest-pod-98303090 with uuid 3901d6ee-6137-49df-855f-1f9609f45e62 found in kube manager
2024-11-10 20:46:52,420 - INFO - Pod ctest-pod-98303090 verification passed
2024-11-10 20:46:52,429 - INFO - Pod ctest-pod-64429342 is in running state.Got IP 10.47.255.246
2024-11-10 20:46:52,468 - DEBUG - Pod ctest-pod-64429342 has vmi e14b08e0-9fa4-11ef-9cd5-fa163e659e94
2024-11-10 20:46:52,468 - INFO - Verified pod ctest-pod-64429342 in contrail-api
2024-11-10 20:46:52,906 - DEBUG - VMI e14b08e0-9fa4-11ef-9cd5-fa163e659e94 is active in agent 10.0.0.38
2024-11-10 20:46:52,907 - INFO - Verified Pod ctest-pod-64429342 in agent 10.0.0.38
2024-11-10 20:46:52,907 - DEBUG - Requesting: http://10.0.0.42:8108/Snh_VirtualMachineDatabaseList?x=18850fea-3cb1-4944-9051-313c98b69422
2024-11-10 20:46:52,939 - INFO - Pod ctest-pod-64429342 with uuid 18850fea-3cb1-4944-9051-313c98b69422 found in kube manager
2024-11-10 20:46:52,940 - INFO - Pod ctest-pod-64429342 verification passed
2024-11-10 20:46:52,959 - INFO - Pod ctest-pod-66933120 is in running state.Got IP 10.47.255.244
2024-11-10 20:46:53,059 - DEBUG - Pod ctest-pod-66933120 has vmi e24c5000-9fa4-11ef-9cd5-fa163e659e94
2024-11-10 20:46:53,060 - INFO - Verified pod ctest-pod-66933120 in contrail-api
2024-11-10 20:46:53,074 - DEBUG - VMI e24c5000-9fa4-11ef-9cd5-fa163e659e94 is active in agent 10.0.0.38
2024-11-10 20:46:53,074 - INFO - Verified Pod ctest-pod-66933120 in agent 10.0.0.38
2024-11-10 20:46:53,074 - DEBUG - Requesting: http://10.0.0.42:8108/Snh_VirtualMachineDatabaseList?x=924de86a-c10f-47d8-b458-10666e2bf8e6
2024-11-10 20:46:53,084 - INFO - Pod ctest-pod-66933120 with uuid 924de86a-c10f-47d8-b458-10666e2bf8e6 found in kube manager
2024-11-10 20:46:53,084 - INFO - Pod ctest-pod-66933120 verification passed
2024-11-10 20:46:53,084 - INFO - ================================================================================
2024-11-10 20:46:53,084 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2024-11-10 20:46:53,084 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2024-11-10 20:46:53,331 - DEBUG - Nothing to compare xmpp stats {'10.0.0.38': {'10.0.0.42': '0'}} with
2024-11-10 20:46:53,332 - INFO - Initial checks done. Running the testcase now
2024-11-10 20:46:53,332 - INFO -
2024-11-10 20:46:53,404 - DEBUG - [Pod ctest-pod-48615901] Cmd: echo ctest-pod-48615901 > /usr/share/nginx/html/index.html, Output:
2024-11-10 20:46:53,478 - DEBUG - [Pod ctest-pod-76737397] Cmd: echo ctest-pod-76737397 > /usr/share/nginx/html/index.html, Output:
2024-11-10 20:46:53,550 - DEBUG - [Pod ctest-pod-37510248] Cmd: echo ctest-pod-37510248 > /usr/share/nginx/html/index.html, Output:
2024-11-10 20:46:53,622 - DEBUG - [Pod ctest-pod-07050198] Cmd: echo ctest-pod-07050198 > /usr/share/nginx/html/index.html, Output:
2024-11-10 20:46:53,625 - DEBUG - Service ctest-nginx-svc-28029101 not present
2024-11-10 20:46:53,625 - INFO - Creating service ctest-nginx-svc-28029101
2024-11-10 20:46:53,642 - INFO - Created Service ctest-nginx-svc-28029101
2024-11-10 20:46:53,650 - WARNING - Service UUID 7202fafc-ca7f-4f31-a6e6-2ba2783595e3 not yet found in contrail-api
2024-11-10 20:46:54,657 - INFO - Validated that Service ctest-nginx-svc-28029101 is seen in contrail-api
2024-11-10 20:46:54,658 - DEBUG - Requesting: http://10.0.0.42:8108/Snh_LoadbalancerDatabaseList?x=7202fafc-ca7f-4f31-a6e6-2ba2783595e3
2024-11-10 20:46:54,663 - INFO - Service ctest-nginx-svc-28029101 with uuid 7202fafc-ca7f-4f31-a6e6-2ba2783595e3 found in kube manager
2024-11-10 20:46:54,663 - INFO - Service ctest-nginx-svc-28029101 verification passed
2024-11-10 20:46:55,726 - DEBUG - [Pod ctest-pod-07896918] Cmd: wget http://10.98.126.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-76737397
2024-11-10 20:46:55,726 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd wget http://10.98.126.204:80/ -O - -T 5 -t 1 passed
2024-11-10 20:46:55,726 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-76737397
2024-11-10 20:46:55,806 - DEBUG - [Pod ctest-pod-07896918] Cmd: wget http://10.98.126.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-48615901
2024-11-10 20:46:55,806 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd wget http://10.98.126.204:80/ -O - -T 5 -t 1 passed
2024-11-10 20:46:55,806 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-48615901
2024-11-10 20:46:55,806 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-48615901': 1, 'ctest-pod-76737397': 1}
2024-11-10 20:46:55,879 - DEBUG - [Pod ctest-pod-98303090] Cmd: wget http://10.98.126.204:80/ -O - -T 5 -t 1 , Output: ctest-pod-76737397
Connecting to 10.98.126.204:80 (10.98.126.204:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-10 20:46:55,879 - DEBUG - [Pod Pod ctest-pod-98303090] Cmd wget http://10.98.126.204:80/ -O - -T 5 -t 1 passed
2024-11-10 20:46:55,879 - DEBUG - [Pod Pod ctest-pod-98303090] Cmd output: ctest-pod-76737397
Connecting to 10.98.126.204:80 (10.98.126.204:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-10 20:46:55,938 - DEBUG - [Pod ctest-pod-98303090] Cmd: wget http://10.98.126.204:80/ -O - -T 5 -t 1 , Output: ctest-pod-48615901
Connecting to 10.98.126.204:80 (10.98.126.204:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-10 20:46:55,938 - DEBUG - [Pod Pod ctest-pod-98303090] Cmd wget http://10.98.126.204:80/ -O - -T 5 -t 1 passed
2024-11-10 20:46:55,938 - DEBUG - [Pod Pod ctest-pod-98303090] Cmd output: ctest-pod-48615901
Connecting to 10.98.126.204:80 (10.98.126.204:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-10 20:46:55,939 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-48615901': 1, 'ctest-pod-76737397': 1}
2024-11-10 20:46:55,942 - DEBUG - Network policy ingress-on-service not present
2024-11-10 20:46:55,943 - INFO - Creating Network Policy ingress-on-service
2024-11-10 20:46:55,958 - INFO - Network policy found in k8s
2024-11-10 20:46:55,958 - DEBUG - Requesting: http://10.0.0.42:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=713f4aae-5b31-4077-887d-a1b82cbcf03a
2024-11-10 20:46:55,972 - INFO - Network Policy ingress-on-service with uuid 713f4aae-5b31-4077-887d-a1b82cbcf03a found in kube manager
2024-11-10 20:46:56,016 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2024-11-10 20:46:56,016 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2024-11-10 20:46:56,016 - DEBUG - Requesting: http://10.0.0.42:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=713f4aae-5b31-4077-887d-a1b82cbcf03a
2024-11-10 20:46:56,049 - WARNING - Network policy with name ingress-on-service not found in agent
2024-11-10 20:46:58,050 - DEBUG - Requesting: http://10.0.0.42:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=713f4aae-5b31-4077-887d-a1b82cbcf03a
2024-11-10 20:46:58,084 - INFO - Network policy with name ingress-on-service found in agent
2024-11-10 20:46:58,084 - INFO - Network Policy ingress-on-service verification passed
2024-11-10 20:47:03,150 - DEBUG - [Pod ctest-pod-07896918] Cmd: wget http://10.98.126.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:47:03,151 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd wget http://10.98.126.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:47:03,151 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:47:08,207 - DEBUG - [Pod ctest-pod-07896918] Cmd: wget http://10.98.126.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:47:08,207 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd wget http://10.98.126.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:47:08,207 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:47:13,285 - DEBUG - [Pod ctest-pod-07896918] Cmd: wget http://10.98.126.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:47:13,285 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd wget http://10.98.126.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:47:13,285 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:47:18,353 - DEBUG - [Pod ctest-pod-07896918] Cmd: wget http://10.98.126.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:47:18,353 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd wget http://10.98.126.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:47:18,353 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:47:23,423 - DEBUG - [Pod ctest-pod-07896918] Cmd: wget http://10.98.126.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:47:23,423 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd wget http://10.98.126.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:47:23,423 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:47:28,503 - DEBUG - [Pod ctest-pod-07896918] Cmd: wget http://10.98.126.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:47:28,503 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd wget http://10.98.126.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:47:28,503 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:47:33,553 - DEBUG - [Pod ctest-pod-07896918] Cmd: wget http://10.98.126.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:47:33,554 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd wget http://10.98.126.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:47:33,554 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:47:39,033 - DEBUG - [Pod ctest-pod-07896918] Cmd: wget http://10.98.126.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:47:39,033 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd wget http://10.98.126.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:47:39,033 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:47:44,097 - DEBUG - [Pod ctest-pod-07896918] Cmd: wget http://10.98.126.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:47:44,097 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd wget http://10.98.126.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:47:44,097 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:47:49,149 - DEBUG - [Pod ctest-pod-07896918] Cmd: wget http://10.98.126.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:47:49,150 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd wget http://10.98.126.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:47:49,150 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:47:49,150 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-48615901': 0, 'ctest-pod-76737397': 0}
2024-11-10 20:47:49,219 - DEBUG - [Pod ctest-pod-64429342] Cmd: wget http://10.98.126.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-76737397
2024-11-10 20:47:49,219 - DEBUG - [Pod Pod ctest-pod-64429342] Cmd wget http://10.98.126.204:80/ -O - -T 5 -t 1 passed
2024-11-10 20:47:49,219 - DEBUG - [Pod Pod ctest-pod-64429342] Cmd output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-76737397
2024-11-10 20:47:49,290 - DEBUG - [Pod ctest-pod-64429342] Cmd: wget http://10.98.126.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
ctest-pod-76737397
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-10 20:47:49,291 - DEBUG - [Pod Pod ctest-pod-64429342] Cmd wget http://10.98.126.204:80/ -O - -T 5 -t 1 passed
2024-11-10 20:47:49,291 - DEBUG - [Pod Pod ctest-pod-64429342] Cmd output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
ctest-pod-76737397
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-10 20:47:49,344 - DEBUG - [Pod ctest-pod-64429342] Cmd: wget http://10.98.126.204:80/ -O - -T 5 -t 1 , Output: ctest-pod-76737397
Connecting to 10.98.126.204:80 (10.98.126.204:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-10 20:47:49,345 - DEBUG - [Pod Pod ctest-pod-64429342] Cmd wget http://10.98.126.204:80/ -O - -T 5 -t 1 passed
2024-11-10 20:47:49,345 - DEBUG - [Pod Pod ctest-pod-64429342] Cmd output: ctest-pod-76737397
Connecting to 10.98.126.204:80 (10.98.126.204:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-10 20:47:49,408 - DEBUG - [Pod ctest-pod-64429342] Cmd: wget http://10.98.126.204:80/ -O - -T 5 -t 1 , Output: ctest-pod-48615901
Connecting to 10.98.126.204:80 (10.98.126.204:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-10 20:47:49,408 - DEBUG - [Pod Pod ctest-pod-64429342] Cmd wget http://10.98.126.204:80/ -O - -T 5 -t 1 passed
2024-11-10 20:47:49,408 - DEBUG - [Pod Pod ctest-pod-64429342] Cmd output: ctest-pod-48615901
Connecting to 10.98.126.204:80 (10.98.126.204:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-10 20:47:49,408 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-48615901': 1, 'ctest-pod-76737397': 3}
2024-11-10 20:47:54,466 - DEBUG - [Pod ctest-pod-98303090] Cmd: wget http://10.98.126.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:47:54,466 - DEBUG - [Pod Pod ctest-pod-98303090] Cmd wget http://10.98.126.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:47:54,466 - DEBUG - [Pod Pod ctest-pod-98303090] Cmd output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:47:59,537 - DEBUG - [Pod ctest-pod-98303090] Cmd: wget http://10.98.126.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:47:59,537 - DEBUG - [Pod Pod ctest-pod-98303090] Cmd wget http://10.98.126.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:47:59,537 - DEBUG - [Pod Pod ctest-pod-98303090] Cmd output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:48:04,639 - DEBUG - [Pod ctest-pod-98303090] Cmd: wget http://10.98.126.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:48:04,639 - DEBUG - [Pod Pod ctest-pod-98303090] Cmd wget http://10.98.126.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:48:04,639 - DEBUG - [Pod Pod ctest-pod-98303090] Cmd output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:48:09,745 - DEBUG - [Pod ctest-pod-98303090] Cmd: wget http://10.98.126.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:48:09,745 - DEBUG - [Pod Pod ctest-pod-98303090] Cmd wget http://10.98.126.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:48:09,745 - DEBUG - [Pod Pod ctest-pod-98303090] Cmd output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:48:14,810 - DEBUG - [Pod ctest-pod-98303090] Cmd: wget http://10.98.126.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:48:14,810 - DEBUG - [Pod Pod ctest-pod-98303090] Cmd wget http://10.98.126.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:48:14,810 - DEBUG - [Pod Pod ctest-pod-98303090] Cmd output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:48:19,890 - DEBUG - [Pod ctest-pod-98303090] Cmd: wget http://10.98.126.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:48:19,890 - DEBUG - [Pod Pod ctest-pod-98303090] Cmd wget http://10.98.126.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:48:19,890 - DEBUG - [Pod Pod ctest-pod-98303090] Cmd output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:48:24,956 - DEBUG - [Pod ctest-pod-98303090] Cmd: wget http://10.98.126.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:48:24,956 - DEBUG - [Pod Pod ctest-pod-98303090] Cmd wget http://10.98.126.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:48:24,956 - DEBUG - [Pod Pod ctest-pod-98303090] Cmd output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:48:30,048 - DEBUG - [Pod ctest-pod-98303090] Cmd: wget http://10.98.126.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:48:30,048 - DEBUG - [Pod Pod ctest-pod-98303090] Cmd wget http://10.98.126.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:48:30,048 - DEBUG - [Pod Pod ctest-pod-98303090] Cmd output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:48:35,116 - DEBUG - [Pod ctest-pod-98303090] Cmd: wget http://10.98.126.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:48:35,116 - DEBUG - [Pod Pod ctest-pod-98303090] Cmd wget http://10.98.126.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:48:35,117 - DEBUG - [Pod Pod ctest-pod-98303090] Cmd output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:48:40,194 - DEBUG - [Pod ctest-pod-98303090] Cmd: wget http://10.98.126.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:48:40,195 - DEBUG - [Pod Pod ctest-pod-98303090] Cmd wget http://10.98.126.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:48:40,195 - DEBUG - [Pod Pod ctest-pod-98303090] Cmd output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:48:40,195 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-48615901': 0, 'ctest-pod-76737397': 0}
2024-11-10 20:48:42,613 - DEBUG - [Pod ctest-pod-64429342] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.961 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.115 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.112 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.112/0.396/0.961 ms
2024-11-10 20:48:42,613 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-64429342 with expectation True passed
2024-11-10 20:48:44,687 - DEBUG - [Pod ctest-pod-07896918] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.127 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.098 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.107 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.098/0.444/1.127 ms
2024-11-10 20:48:44,687 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-07896918 with expectation True passed
2024-11-10 20:48:46,752 - DEBUG - [Pod ctest-pod-98303090] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.785 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.081 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.120 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.081/0.662/1.785 ms
2024-11-10 20:48:46,752 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-98303090 with expectation True passed
2024-11-10 20:48:46,835 - DEBUG - [Pod ctest-pod-64429342] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-11-10 20:48:46,835 - DEBUG - [Pod Pod ctest-pod-64429342] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-11-10 20:48:46,835 - DEBUG - [Pod Pod ctest-pod-64429342] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-11-10 20:48:46,835 - INFO - wget check of of http://10.47.255.251 from ctest-pod-64429342 passed
2024-11-10 20:48:46,920 - DEBUG - [Pod ctest-pod-64429342] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-11-10 20:48:46,920 - DEBUG - [Pod Pod ctest-pod-64429342] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-11-10 20:48:46,920 - DEBUG - [Pod Pod ctest-pod-64429342] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-11-10 20:48:46,920 - INFO - wget check of of http://10.47.255.250 from ctest-pod-64429342 passed
2024-11-10 20:48:52,023 - DEBUG - [Pod ctest-pod-07896918] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-11-10 20:48:52,023 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-11-10 20:48:52,023 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-11-10 20:48:52,023 - INFO - wget check of of http://10.47.255.250 from ctest-pod-07896918 passed
2024-11-10 20:48:55,762 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2024-11-10 20:49:06,148 - DEBUG - [Pod ctest-pod-66933120] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-11-10 20:49:06,148 - DEBUG - [Pod Pod ctest-pod-66933120] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-11-10 20:49:06,148 - DEBUG - [Pod Pod ctest-pod-66933120] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-11-10 20:49:06,148 - INFO - wget check of of http://10.47.255.251 from ctest-pod-66933120 passed
2024-11-10 20:49:06,163 - INFO - Updating Network Policy ingress-on-service
2024-11-10 20:49:11,261 - DEBUG - [Pod ctest-pod-07896918] Cmd: wget http://10.98.126.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:49:11,261 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd wget http://10.98.126.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:49:11,261 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:49:16,335 - DEBUG - [Pod ctest-pod-07896918] Cmd: wget http://10.98.126.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:49:16,335 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd wget http://10.98.126.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:49:16,335 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:49:21,419 - DEBUG - [Pod ctest-pod-07896918] Cmd: wget http://10.98.126.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:49:21,419 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd wget http://10.98.126.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:49:21,419 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:49:26,486 - DEBUG - [Pod ctest-pod-07896918] Cmd: wget http://10.98.126.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:49:26,486 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd wget http://10.98.126.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:49:26,486 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:49:31,563 - DEBUG - [Pod ctest-pod-07896918] Cmd: wget http://10.98.126.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:49:31,563 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd wget http://10.98.126.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:49:31,563 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:49:36,613 - DEBUG - [Pod ctest-pod-07896918] Cmd: wget http://10.98.126.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:49:36,613 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd wget http://10.98.126.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:49:36,613 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:49:41,684 - DEBUG - [Pod ctest-pod-07896918] Cmd: wget http://10.98.126.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:49:41,685 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd wget http://10.98.126.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:49:41,685 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:49:46,757 - DEBUG - [Pod ctest-pod-07896918] Cmd: wget http://10.98.126.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:49:46,757 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd wget http://10.98.126.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:49:46,757 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:49:51,822 - DEBUG - [Pod ctest-pod-07896918] Cmd: wget http://10.98.126.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:49:51,822 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd wget http://10.98.126.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:49:51,822 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:49:56,900 - DEBUG - [Pod ctest-pod-07896918] Cmd: wget http://10.98.126.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:49:56,900 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd wget http://10.98.126.204:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:49:56,900 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
wget: download timed out
2024-11-10 20:49:56,900 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-48615901': 0, 'ctest-pod-76737397': 0}
2024-11-10 20:49:56,987 - DEBUG - [Pod ctest-pod-64429342] Cmd: wget http://10.98.126.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-48615901
2024-11-10 20:49:56,987 - DEBUG - [Pod Pod ctest-pod-64429342] Cmd wget http://10.98.126.204:80/ -O - -T 5 -t 1 passed
2024-11-10 20:49:56,988 - DEBUG - [Pod Pod ctest-pod-64429342] Cmd output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-48615901
2024-11-10 20:49:57,046 - DEBUG - [Pod ctest-pod-64429342] Cmd: wget http://10.98.126.204:80/ -O - -T 5 -t 1 , Output: ctest-pod-48615901
Connecting to 10.98.126.204:80 (10.98.126.204:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-10 20:49:57,046 - DEBUG - [Pod Pod ctest-pod-64429342] Cmd wget http://10.98.126.204:80/ -O - -T 5 -t 1 passed
2024-11-10 20:49:57,046 - DEBUG - [Pod Pod ctest-pod-64429342] Cmd output: ctest-pod-48615901
Connecting to 10.98.126.204:80 (10.98.126.204:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-10 20:49:57,106 - DEBUG - [Pod ctest-pod-64429342] Cmd: wget http://10.98.126.204:80/ -O - -T 5 -t 1 , Output: ctest-pod-76737397
Connecting to 10.98.126.204:80 (10.98.126.204:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-10 20:49:57,107 - DEBUG - [Pod Pod ctest-pod-64429342] Cmd wget http://10.98.126.204:80/ -O - -T 5 -t 1 passed
2024-11-10 20:49:57,107 - DEBUG - [Pod Pod ctest-pod-64429342] Cmd output: ctest-pod-76737397
Connecting to 10.98.126.204:80 (10.98.126.204:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-10 20:49:57,107 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-48615901': 2, 'ctest-pod-76737397': 1}
2024-11-10 20:49:57,178 - DEBUG - [Pod ctest-pod-98303090] Cmd: wget http://10.98.126.204:80/ -O - -T 5 -t 1 , Output: ctest-pod-48615901
Connecting to 10.98.126.204:80 (10.98.126.204:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-10 20:49:57,179 - DEBUG - [Pod Pod ctest-pod-98303090] Cmd wget http://10.98.126.204:80/ -O - -T 5 -t 1 passed
2024-11-10 20:49:57,179 - DEBUG - [Pod Pod ctest-pod-98303090] Cmd output: ctest-pod-48615901
Connecting to 10.98.126.204:80 (10.98.126.204:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-11-10 20:49:57,240 - DEBUG - [Pod ctest-pod-98303090] Cmd: wget http://10.98.126.204:80/ -O - -T 5 -t 1 , Output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-76737397
2024-11-10 20:49:57,240 - DEBUG - [Pod Pod ctest-pod-98303090] Cmd wget http://10.98.126.204:80/ -O - -T 5 -t 1 passed
2024-11-10 20:49:57,240 - DEBUG - [Pod Pod ctest-pod-98303090] Cmd output: Connecting to 10.98.126.204:80 (10.98.126.204:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-76737397
2024-11-10 20:49:57,240 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-48615901': 1, 'ctest-pod-76737397': 1}
2024-11-10 20:49:59,302 - DEBUG - [Pod ctest-pod-64429342] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.663 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.080 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.090 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.080/0.277/0.663 ms
2024-11-10 20:49:59,303 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-64429342 with expectation True passed
2024-11-10 20:50:01,375 - DEBUG - [Pod ctest-pod-07896918] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.452 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.098 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.096 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.096/0.548/1.452 ms
2024-11-10 20:50:01,375 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-07896918 with expectation True passed
2024-11-10 20:50:03,435 - DEBUG - [Pod ctest-pod-98303090] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.425 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.113 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.141 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.113/0.226/0.425 ms
2024-11-10 20:50:03,435 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-98303090 with expectation True passed
2024-11-10 20:50:03,503 - DEBUG - [Pod ctest-pod-64429342] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-11-10 20:50:03,503 - DEBUG - [Pod Pod ctest-pod-64429342] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-11-10 20:50:03,503 - DEBUG - [Pod Pod ctest-pod-64429342] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-11-10 20:50:03,503 - INFO - wget check of of http://10.47.255.251 from ctest-pod-64429342 passed
2024-11-10 20:50:03,598 - DEBUG - [Pod ctest-pod-64429342] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-11-10 20:50:03,598 - DEBUG - [Pod Pod ctest-pod-64429342] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-11-10 20:50:03,598 - DEBUG - [Pod Pod ctest-pod-64429342] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-11-10 20:50:03,598 - INFO - wget check of of http://10.47.255.250 from ctest-pod-64429342 passed
2024-11-10 20:50:08,670 - DEBUG - [Pod ctest-pod-07896918] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-11-10 20:50:08,670 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-11-10 20:50:08,670 - DEBUG - [Pod Pod ctest-pod-07896918] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-11-10 20:50:08,670 - INFO - wget check of of http://10.47.255.250 from ctest-pod-07896918 passed
2024-11-10 20:50:08,733 - DEBUG - [Pod ctest-pod-66933120] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-11-10 20:50:08,733 - DEBUG - [Pod Pod ctest-pod-66933120] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-11-10 20:50:08,733 - DEBUG - [Pod Pod ctest-pod-66933120] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-11-10 20:50:08,733 - INFO - wget check of of http://10.47.255.251 from ctest-pod-66933120 passed
2024-11-10 20:50:08,733 - INFO - Deleting Network Policy : ingress-on-service
2024-11-10 20:50:08,734 - INFO - Deleting service : ctest-nginx-svc-28029101
2024-11-10 20:50:08,927 - DEBUG - No XMPP flaps were noticed during the test
2024-11-10 20:50:08,927 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:15]
2024-11-10 20:50:08,927 - INFO - --------------------------------------------------------------------------------
2024-11-10 20:50:08,935 - INFO - Deleting pod ctest-new-default-67088327:ctest-pod-48615901
2024-11-10 20:50:08,935 - INFO - Deleting pod ctest-new-default-67088327:ctest-pod-76737397
2024-11-10 20:50:08,936 - INFO - Deleting pod ctest-non-default-29857301:ctest-pod-37510248
2024-11-10 20:50:08,936 - INFO - Deleting pod ctest-non-default-29857301:ctest-pod-07050198
2024-11-10 20:50:08,937 - INFO - Deleting pod ctest-new-default-67088327:ctest-pod-07896918
2024-11-10 20:50:08,937 - INFO - Deleting pod ctest-new-default-67088327:ctest-pod-64429342
2024-11-10 20:50:08,937 - INFO - Deleting pod ctest-non-default-29857301:ctest-pod-98303090
2024-11-10 20:50:08,938 - INFO - Deleting pod ctest-non-default-29857301:ctest-pod-66933120
2024-11-10 20:50:09,111 - WARNING - Pod uuid 16f9383f-5f9d-46b2-a42b-ced897c69519 is still seen in agent 10.0.0.38 VM list
2024-11-10 20:50:09,112 - WARNING - Pod uuid 3901d6ee-6137-49df-855f-1f9609f45e62 is still seen in agent 10.0.0.38 VM list
2024-11-10 20:50:09,113 - WARNING - Pod uuid 111d2901-7063-4abf-91b2-18e6230f3d6e is still seen in agent 10.0.0.38 VM list
2024-11-10 20:50:09,114 - WARNING - Pod uuid e21c1054-077d-46a8-a9ca-61d1d73375b3 is still seen in agent 10.0.0.38 VM list
2024-11-10 20:50:09,114 - WARNING - Pod uuid 18850fea-3cb1-4944-9051-313c98b69422 is still seen in agent 10.0.0.38 VM list
2024-11-10 20:50:09,115 - WARNING - Pod uuid 8f7d8666-4ba8-48cd-80c4-4d55b5cf4da2 is still seen in agent 10.0.0.38 VM list
2024-11-10 20:50:09,115 - WARNING - Pod uuid d0fa8629-2b4d-45cf-abf6-3402433ed899 is still seen in agent 10.0.0.38 VM list
2024-11-10 20:50:09,115 - WARNING - Pod uuid 924de86a-c10f-47d8-b458-10666e2bf8e6 is still seen in agent 10.0.0.38 VM list
2024-11-10 20:50:14,144 - DEBUG - Pod e21c1054-077d-46a8-a9ca-61d1d73375b3 is not in agent 10.0.0.38 VM list
2024-11-10 20:50:14,145 - DEBUG - Pod 16f9383f-5f9d-46b2-a42b-ced897c69519 is not in agent 10.0.0.38 VM list
2024-11-10 20:50:14,149 - WARNING - Pod uuid 924de86a-c10f-47d8-b458-10666e2bf8e6 is still seen in agent 10.0.0.38 VM list
2024-11-10 20:50:14,150 - DEBUG - Pod 8f7d8666-4ba8-48cd-80c4-4d55b5cf4da2 is not in agent 10.0.0.38 VM list
2024-11-10 20:50:14,151 - WARNING - Pod uuid d0fa8629-2b4d-45cf-abf6-3402433ed899 is still seen in agent 10.0.0.38 VM list
2024-11-10 20:50:14,151 - WARNING - Pod uuid 18850fea-3cb1-4944-9051-313c98b69422 is still seen in agent 10.0.0.38 VM list
2024-11-10 20:50:14,151 - WARNING - Pod uuid 3901d6ee-6137-49df-855f-1f9609f45e62 is still seen in agent 10.0.0.38 VM list
2024-11-10 20:50:14,152 - DEBUG - Pod 111d2901-7063-4abf-91b2-18e6230f3d6e is not in agent 10.0.0.38 VM list
2024-11-10 20:50:14,165 - DEBUG - VMI de983a00-9fa4-11ef-9cd5-fa163e659e94 is removed from agent 10.0.0.38
2024-11-10 20:50:14,165 - INFO - Verified that pod ctest-pod-48615901 is removed in agent
2024-11-10 20:50:14,165 - DEBUG - VMI e056c154-9fa4-11ef-9cd5-fa163e659e94 is removed from agent 10.0.0.38
2024-11-10 20:50:14,165 - INFO - Verified that pod ctest-pod-07050198 is removed in agent
2024-11-10 20:50:14,167 - DEBUG - VMI df19ebf4-9fa4-11ef-9cd5-fa163e659e94 is removed from agent 10.0.0.38
2024-11-10 20:50:14,167 - INFO - Verified that pod ctest-pod-76737397 is removed in agent
2024-11-10 20:50:14,167 - DEBUG - VMI dfc925ce-9fa4-11ef-9cd5-fa163e659e94 is removed from agent 10.0.0.38
2024-11-10 20:50:14,167 - INFO - Verified that pod ctest-pod-37510248 is removed in agent
2024-11-10 20:50:19,168 - WARNING - Pod uuid 18850fea-3cb1-4944-9051-313c98b69422 is still seen in agent 10.0.0.38 VM list
2024-11-10 20:50:19,169 - WARNING - Pod uuid 3901d6ee-6137-49df-855f-1f9609f45e62 is still seen in agent 10.0.0.38 VM list
2024-11-10 20:50:19,170 - WARNING - Pod uuid d0fa8629-2b4d-45cf-abf6-3402433ed899 is still seen in agent 10.0.0.38 VM list
2024-11-10 20:50:19,170 - WARNING - Pod uuid 924de86a-c10f-47d8-b458-10666e2bf8e6 is still seen in agent 10.0.0.38 VM list
2024-11-10 20:50:24,189 - WARNING - Pod uuid 3901d6ee-6137-49df-855f-1f9609f45e62 is still seen in agent 10.0.0.38 VM list
2024-11-10 20:50:24,190 - WARNING - Pod uuid 18850fea-3cb1-4944-9051-313c98b69422 is still seen in agent 10.0.0.38 VM list
2024-11-10 20:50:24,192 - WARNING - Pod uuid d0fa8629-2b4d-45cf-abf6-3402433ed899 is still seen in agent 10.0.0.38 VM list
2024-11-10 20:50:24,193 - WARNING - Pod uuid 924de86a-c10f-47d8-b458-10666e2bf8e6 is still seen in agent 10.0.0.38 VM list
2024-11-10 20:50:29,212 - WARNING - Pod uuid d0fa8629-2b4d-45cf-abf6-3402433ed899 is still seen in agent 10.0.0.38 VM list
2024-11-10 20:50:29,212 - WARNING - Pod uuid 924de86a-c10f-47d8-b458-10666e2bf8e6 is still seen in agent 10.0.0.38 VM list
2024-11-10 20:50:29,213 - WARNING - Pod uuid 3901d6ee-6137-49df-855f-1f9609f45e62 is still seen in agent 10.0.0.38 VM list
2024-11-10 20:50:29,213 - WARNING - Pod uuid 18850fea-3cb1-4944-9051-313c98b69422 is still seen in agent 10.0.0.38 VM list
2024-11-10 20:50:34,225 - WARNING - Pod uuid 924de86a-c10f-47d8-b458-10666e2bf8e6 is still seen in agent 10.0.0.38 VM list
2024-11-10 20:50:34,231 - WARNING - Pod uuid 3901d6ee-6137-49df-855f-1f9609f45e62 is still seen in agent 10.0.0.38 VM list
2024-11-10 20:50:34,232 - WARNING - Pod uuid d0fa8629-2b4d-45cf-abf6-3402433ed899 is still seen in agent 10.0.0.38 VM list
2024-11-10 20:50:34,233 - WARNING - Pod uuid 18850fea-3cb1-4944-9051-313c98b69422 is still seen in agent 10.0.0.38 VM list
2024-11-10 20:50:39,273 - WARNING - Pod uuid 3901d6ee-6137-49df-855f-1f9609f45e62 is still seen in agent 10.0.0.38 VM list
2024-11-10 20:50:39,274 - WARNING - Pod uuid 924de86a-c10f-47d8-b458-10666e2bf8e6 is still seen in agent 10.0.0.38 VM list
2024-11-10 20:50:39,275 - WARNING - Pod uuid 18850fea-3cb1-4944-9051-313c98b69422 is still seen in agent 10.0.0.38 VM list
2024-11-10 20:50:39,276 - WARNING - Pod uuid d0fa8629-2b4d-45cf-abf6-3402433ed899 is still seen in agent 10.0.0.38 VM list
2024-11-10 20:50:44,293 - DEBUG - Pod 3901d6ee-6137-49df-855f-1f9609f45e62 is not in agent 10.0.0.38 VM list
2024-11-10 20:50:44,296 - DEBUG - Pod d0fa8629-2b4d-45cf-abf6-3402433ed899 is not in agent 10.0.0.38 VM list
2024-11-10 20:50:44,297 - DEBUG - Pod 18850fea-3cb1-4944-9051-313c98b69422 is not in agent 10.0.0.38 VM list
2024-11-10 20:50:44,299 - DEBUG - Pod 924de86a-c10f-47d8-b458-10666e2bf8e6 is not in agent 10.0.0.38 VM list
2024-11-10 20:50:44,312 - DEBUG - VMI e14b08e0-9fa4-11ef-9cd5-fa163e659e94 is removed from agent 10.0.0.38
2024-11-10 20:50:44,312 - INFO - Verified that pod ctest-pod-64429342 is removed in agent
2024-11-10 20:50:44,314 - DEBUG - VMI e24c5000-9fa4-11ef-9cd5-fa163e659e94 is removed from agent 10.0.0.38
2024-11-10 20:50:44,314 - INFO - Verified that pod ctest-pod-66933120 is removed in agent
2024-11-10 20:50:44,315 - DEBUG - VMI e1d4a33e-9fa4-11ef-9cd5-fa163e659e94 is removed from agent 10.0.0.38
2024-11-10 20:50:44,315 - INFO - Verified that pod ctest-pod-98303090 is removed in agent
2024-11-10 20:50:44,315 - DEBUG - VMI e0db7f2a-9fa4-11ef-9cd5-fa163e659e94 is removed from agent 10.0.0.38
2024-11-10 20:50:44,315 - INFO - Verified that pod ctest-pod-07896918 is removed in agent
2024-11-10 20:50:44,315 - INFO - Deleting namespace ctest-non-default-29857301
2024-11-10 20:50:44,341 - DEBUG - Namespace ctest-non-default-29857301 still in k8s
2024-11-10 20:50:46,346 - DEBUG - Namespace ctest-non-default-29857301 still in k8s
2024-11-10 20:50:48,350 - DEBUG - Namespace ctest-non-default-29857301 still in k8s
2024-11-10 20:50:50,355 - DEBUG - Namespace ctest-non-default-29857301 is not in k8s
2024-11-10 20:50:50,355 - DEBUG - No need to check project deletion in contrail-api
2024-11-10 20:50:50,355 - INFO - Deleting namespace ctest-new-default-67088327
2024-11-10 20:50:50,366 - DEBUG - Namespace ctest-new-default-67088327 still in k8s
2024-11-10 20:50:52,370 - DEBUG - Namespace ctest-new-default-67088327 still in k8s
2024-11-10 20:50:54,376 - DEBUG - Namespace ctest-new-default-67088327 still in k8s
2024-11-10 20:50:56,380 - DEBUG - Namespace ctest-new-default-67088327 is not in k8s
2024-11-10 20:50:56,380 - DEBUG - No need to check project deletion in contrail-api