2024-10-29 22:07:03,381 - INFO - Using existing project ['default-domain', 'k8s-default'](491a6cc0-a449-4515-afc4-3d402b50497c)
2024-10-29 22:07:03,404 - DEBUG - Namespace ctest-new-default-76728485 not present
2024-10-29 22:07:03,411 - INFO - Created namespace ctest-new-default-76728485
2024-10-29 22:07:06,418 - DEBUG - Namespace ctest-non-default-15548439 not present
2024-10-29 22:07:06,429 - INFO - Created namespace ctest-non-default-15548439
2024-10-29 22:07:09,453 - DEBUG - Pod ctest-pod-03657627 not present
2024-10-29 22:07:09,453 - INFO - Creating Pod ctest-pod-03657627
2024-10-29 22:07:09,474 - DEBUG - Pod : ctest-pod-03657627 UUID is e08820ca-0049-4ff4-9946-425519414201
2024-10-29 22:07:09,477 - DEBUG - Pod ctest-pod-25327635 not present
2024-10-29 22:07:09,477 - INFO - Creating Pod ctest-pod-25327635
2024-10-29 22:07:09,495 - DEBUG - Pod : ctest-pod-25327635 UUID is c6ca202f-80de-42a6-8281-f7fed2677f76
2024-10-29 22:07:09,497 - DEBUG - Pod ctest-pod-19309966 not present
2024-10-29 22:07:09,497 - INFO - Creating Pod ctest-pod-19309966
2024-10-29 22:07:09,519 - DEBUG - Pod : ctest-pod-19309966 UUID is 3c72f2c2-c6d0-4e23-8091-454eeb6302e1
2024-10-29 22:07:09,524 - DEBUG - Pod ctest-pod-34780615 not present
2024-10-29 22:07:09,525 - INFO - Creating Pod ctest-pod-34780615
2024-10-29 22:07:09,549 - DEBUG - Pod : ctest-pod-34780615 UUID is 200bb975-e5ea-4852-aa1d-93625ba01e4c
2024-10-29 22:07:09,567 - DEBUG - Pod ctest-pod-66560114 not present
2024-10-29 22:07:09,567 - INFO - Creating Pod ctest-pod-66560114
2024-10-29 22:07:09,588 - DEBUG - Pod : ctest-pod-66560114 UUID is 3d4531a4-9c62-4163-8560-3dae5c530273
2024-10-29 22:07:09,590 - DEBUG - Pod ctest-pod-93745239 not present
2024-10-29 22:07:09,590 - INFO - Creating Pod ctest-pod-93745239
2024-10-29 22:07:09,610 - DEBUG - Pod : ctest-pod-93745239 UUID is c2265a30-6342-4ff8-a6d9-57ca5e22be1d
2024-10-29 22:07:09,612 - DEBUG - Pod ctest-pod-00548959 not present
2024-10-29 22:07:09,613 - INFO - Creating Pod ctest-pod-00548959
2024-10-29 22:07:09,631 - DEBUG - Pod : ctest-pod-00548959 UUID is 51c0dc7b-ba92-4388-b0fc-8dd3d78cd9d6
2024-10-29 22:07:09,632 - DEBUG - Pod ctest-pod-19482207 not present
2024-10-29 22:07:09,633 - INFO - Creating Pod ctest-pod-19482207
2024-10-29 22:07:09,648 - DEBUG - Pod : ctest-pod-19482207 UUID is 4f97be5a-00b3-4358-b21c-7c1eda2c9982
2024-10-29 22:07:09,832 - INFO - Project default-domain:k8s-ctest-new-default-76728485 for Namespace ctest-new-default-76728485 is seen in contrail-api
2024-10-29 22:07:09,832 - DEBUG - Project uuid in Contrail is 2bdd7df1-82cc-42e2-a640-4d070688c933
2024-10-29 22:07:09,965 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NamespaceDatabaseList?namespace_uuid=c7e593f2-8b82-4019-826f-a8c48cdad870
2024-10-29 22:07:09,971 - INFO - Namespace ctest-new-default-76728485 with uuid c7e593f2-8b82-4019-826f-a8c48cdad870 found in kube manager
2024-10-29 22:07:09,971 - INFO - Namespace ctest-new-default-76728485 verification passed
2024-10-29 22:07:10,270 - INFO - Project default-domain:k8s-ctest-non-default-15548439 for Namespace ctest-non-default-15548439 is seen in contrail-api
2024-10-29 22:07:10,271 - DEBUG - Project uuid in Contrail is 3da65c68-abe0-48c7-93fa-7451ea860930
2024-10-29 22:07:10,271 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NamespaceDatabaseList?namespace_uuid=763d2407-60b0-4195-9230-b5f759c72850
2024-10-29 22:07:10,276 - INFO - Namespace ctest-non-default-15548439 with uuid 763d2407-60b0-4195-9230-b5f759c72850 found in kube manager
2024-10-29 22:07:10,276 - INFO - Namespace ctest-non-default-15548439 verification passed
2024-10-29 22:07:10,285 - DEBUG - Pod ctest-pod-03657627 not in running state.Currently in Pending
2024-10-29 22:07:15,292 - DEBUG - Pod ctest-pod-03657627 not in running state.Currently in Pending
2024-10-29 22:07:20,299 - INFO - Pod ctest-pod-03657627 is in running state.Got IP 10.47.255.251
2024-10-29 22:07:20,316 - DEBUG - Pod ctest-pod-03657627 has vmi 258f88da-9642-11ef-ab01-fa163e9b7eff
2024-10-29 22:07:20,316 - INFO - Verified pod ctest-pod-03657627 in contrail-api
2024-10-29 22:07:20,330 - DEBUG - VMI 258f88da-9642-11ef-ab01-fa163e9b7eff is active in agent 10.0.0.24
2024-10-29 22:07:20,330 - INFO - Verified Pod ctest-pod-03657627 in agent 10.0.0.24
2024-10-29 22:07:20,331 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=e08820ca-0049-4ff4-9946-425519414201
2024-10-29 22:07:20,335 - INFO - Pod ctest-pod-03657627 with uuid e08820ca-0049-4ff4-9946-425519414201 found in kube manager
2024-10-29 22:07:20,336 - INFO - Pod ctest-pod-03657627 verification passed
2024-10-29 22:07:20,344 - DEBUG - Pod ctest-pod-25327635 not in running state.Currently in Pending
2024-10-29 22:07:25,362 - INFO - Pod ctest-pod-25327635 is in running state.Got IP 10.47.255.250
2024-10-29 22:07:25,381 - DEBUG - Pod ctest-pod-25327635 has vmi 261cc268-9642-11ef-ab01-fa163e9b7eff
2024-10-29 22:07:25,381 - INFO - Verified pod ctest-pod-25327635 in contrail-api
2024-10-29 22:07:25,400 - DEBUG - VMI 261cc268-9642-11ef-ab01-fa163e9b7eff is active in agent 10.0.0.24
2024-10-29 22:07:25,400 - INFO - Verified Pod ctest-pod-25327635 in agent 10.0.0.24
2024-10-29 22:07:25,400 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=c6ca202f-80de-42a6-8281-f7fed2677f76
2024-10-29 22:07:25,405 - INFO - Pod ctest-pod-25327635 with uuid c6ca202f-80de-42a6-8281-f7fed2677f76 found in kube manager
2024-10-29 22:07:25,405 - INFO - Pod ctest-pod-25327635 verification passed
2024-10-29 22:07:25,410 - INFO - Pod ctest-pod-19309966 is in running state.Got IP 10.47.255.249
2024-10-29 22:07:25,471 - DEBUG - Pod ctest-pod-19309966 has vmi 26c8e0a2-9642-11ef-ab01-fa163e9b7eff
2024-10-29 22:07:25,471 - INFO - Verified pod ctest-pod-19309966 in contrail-api
2024-10-29 22:07:25,487 - DEBUG - VMI 26c8e0a2-9642-11ef-ab01-fa163e9b7eff is active in agent 10.0.0.24
2024-10-29 22:07:25,488 - INFO - Verified Pod ctest-pod-19309966 in agent 10.0.0.24
2024-10-29 22:07:25,488 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=3c72f2c2-c6d0-4e23-8091-454eeb6302e1
2024-10-29 22:07:25,493 - INFO - Pod ctest-pod-19309966 with uuid 3c72f2c2-c6d0-4e23-8091-454eeb6302e1 found in kube manager
2024-10-29 22:07:25,493 - INFO - Pod ctest-pod-19309966 verification passed
2024-10-29 22:07:25,498 - INFO - Pod ctest-pod-34780615 is in running state.Got IP 10.47.255.248
2024-10-29 22:07:25,562 - DEBUG - Pod ctest-pod-34780615 has vmi 2749703c-9642-11ef-ab01-fa163e9b7eff
2024-10-29 22:07:25,562 - INFO - Verified pod ctest-pod-34780615 in contrail-api
2024-10-29 22:07:25,580 - DEBUG - VMI 2749703c-9642-11ef-ab01-fa163e9b7eff is active in agent 10.0.0.24
2024-10-29 22:07:25,580 - INFO - Verified Pod ctest-pod-34780615 in agent 10.0.0.24
2024-10-29 22:07:25,580 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=200bb975-e5ea-4852-aa1d-93625ba01e4c
2024-10-29 22:07:25,585 - INFO - Pod ctest-pod-34780615 with uuid 200bb975-e5ea-4852-aa1d-93625ba01e4c found in kube manager
2024-10-29 22:07:25,585 - INFO - Pod ctest-pod-34780615 verification passed
2024-10-29 22:07:25,590 - INFO - Pod ctest-pod-66560114 is in running state.Got IP 10.47.255.247
2024-10-29 22:07:25,608 - DEBUG - Pod ctest-pod-66560114 has vmi 27d5ad9a-9642-11ef-ab01-fa163e9b7eff
2024-10-29 22:07:25,608 - INFO - Verified pod ctest-pod-66560114 in contrail-api
2024-10-29 22:07:25,623 - DEBUG - VMI 27d5ad9a-9642-11ef-ab01-fa163e9b7eff is active in agent 10.0.0.24
2024-10-29 22:07:25,623 - INFO - Verified Pod ctest-pod-66560114 in agent 10.0.0.24
2024-10-29 22:07:25,623 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=3d4531a4-9c62-4163-8560-3dae5c530273
2024-10-29 22:07:25,627 - INFO - Pod ctest-pod-66560114 with uuid 3d4531a4-9c62-4163-8560-3dae5c530273 found in kube manager
2024-10-29 22:07:25,628 - INFO - Pod ctest-pod-66560114 verification passed
2024-10-29 22:07:25,632 - INFO - Pod ctest-pod-00548959 is in running state.Got IP 10.47.255.245
2024-10-29 22:07:25,695 - DEBUG - Pod ctest-pod-00548959 has vmi 28cc558c-9642-11ef-ab01-fa163e9b7eff
2024-10-29 22:07:25,695 - INFO - Verified pod ctest-pod-00548959 in contrail-api
2024-10-29 22:07:25,715 - DEBUG - VMI 28cc558c-9642-11ef-ab01-fa163e9b7eff is active in agent 10.0.0.24
2024-10-29 22:07:25,715 - INFO - Verified Pod ctest-pod-00548959 in agent 10.0.0.24
2024-10-29 22:07:25,716 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=51c0dc7b-ba92-4388-b0fc-8dd3d78cd9d6
2024-10-29 22:07:25,720 - INFO - Pod ctest-pod-00548959 with uuid 51c0dc7b-ba92-4388-b0fc-8dd3d78cd9d6 found in kube manager
2024-10-29 22:07:25,721 - INFO - Pod ctest-pod-00548959 verification passed
2024-10-29 22:07:25,730 - INFO - Pod ctest-pod-93745239 is in running state.Got IP 10.47.255.246
2024-10-29 22:07:25,755 - DEBUG - Pod ctest-pod-93745239 has vmi 2851a742-9642-11ef-ab01-fa163e9b7eff
2024-10-29 22:07:25,755 - INFO - Verified pod ctest-pod-93745239 in contrail-api
2024-10-29 22:07:25,772 - DEBUG - VMI 2851a742-9642-11ef-ab01-fa163e9b7eff is active in agent 10.0.0.24
2024-10-29 22:07:25,772 - INFO - Verified Pod ctest-pod-93745239 in agent 10.0.0.24
2024-10-29 22:07:25,773 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=c2265a30-6342-4ff8-a6d9-57ca5e22be1d
2024-10-29 22:07:25,777 - INFO - Pod ctest-pod-93745239 with uuid c2265a30-6342-4ff8-a6d9-57ca5e22be1d found in kube manager
2024-10-29 22:07:25,777 - INFO - Pod ctest-pod-93745239 verification passed
2024-10-29 22:07:25,784 - INFO - Pod ctest-pod-19482207 is in running state.Got IP 10.47.255.244
2024-10-29 22:07:25,845 - DEBUG - Pod ctest-pod-19482207 has vmi 294b32ee-9642-11ef-ab01-fa163e9b7eff
2024-10-29 22:07:25,845 - INFO - Verified pod ctest-pod-19482207 in contrail-api
2024-10-29 22:07:25,861 - DEBUG - VMI 294b32ee-9642-11ef-ab01-fa163e9b7eff is active in agent 10.0.0.24
2024-10-29 22:07:25,862 - INFO - Verified Pod ctest-pod-19482207 in agent 10.0.0.24
2024-10-29 22:07:25,862 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=4f97be5a-00b3-4358-b21c-7c1eda2c9982
2024-10-29 22:07:25,867 - INFO - Pod ctest-pod-19482207 with uuid 4f97be5a-00b3-4358-b21c-7c1eda2c9982 found in kube manager
2024-10-29 22:07:25,867 - INFO - Pod ctest-pod-19482207 verification passed
2024-10-29 22:07:25,868 - INFO - ================================================================================
2024-10-29 22:07:25,868 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2024-10-29 22:07:25,869 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2024-10-29 22:07:26,100 - DEBUG - Nothing to compare xmpp stats {'10.0.0.24': {'10.0.0.12': '0'}} with
2024-10-29 22:07:26,100 - INFO - Initial checks done. Running the testcase now
2024-10-29 22:07:26,100 - INFO -
2024-10-29 22:07:26,168 - DEBUG - [Pod ctest-pod-03657627] Cmd: echo ctest-pod-03657627 > /usr/share/nginx/html/index.html, Output:
2024-10-29 22:07:26,235 - DEBUG - [Pod ctest-pod-25327635] Cmd: echo ctest-pod-25327635 > /usr/share/nginx/html/index.html, Output:
2024-10-29 22:07:26,307 - DEBUG - [Pod ctest-pod-19309966] Cmd: echo ctest-pod-19309966 > /usr/share/nginx/html/index.html, Output:
2024-10-29 22:07:26,367 - DEBUG - [Pod ctest-pod-34780615] Cmd: echo ctest-pod-34780615 > /usr/share/nginx/html/index.html, Output:
2024-10-29 22:07:26,370 - DEBUG - Service ctest-nginx-svc-38485974 not present
2024-10-29 22:07:26,370 - INFO - Creating service ctest-nginx-svc-38485974
2024-10-29 22:07:26,383 - INFO - Created Service ctest-nginx-svc-38485974
2024-10-29 22:07:26,402 - WARNING - Service UUID fe33f403-efc2-4088-acd3-54209ffe60cd not yet found in contrail-api
2024-10-29 22:07:27,410 - INFO - Validated that Service ctest-nginx-svc-38485974 is seen in contrail-api
2024-10-29 22:07:27,411 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_LoadbalancerDatabaseList?x=fe33f403-efc2-4088-acd3-54209ffe60cd
2024-10-29 22:07:27,422 - INFO - Service ctest-nginx-svc-38485974 with uuid fe33f403-efc2-4088-acd3-54209ffe60cd found in kube manager
2024-10-29 22:07:27,423 - INFO - Service ctest-nginx-svc-38485974 verification passed
2024-10-29 22:07:28,530 - DEBUG - [Pod ctest-pod-66560114] Cmd: wget http://10.107.64.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
ctest-pod-25327635
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-29 22:07:28,530 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd wget http://10.107.64.69:80/ -O - -T 5 -t 1 passed
2024-10-29 22:07:28,530 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
ctest-pod-25327635
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-29 22:07:28,615 - DEBUG - [Pod ctest-pod-66560114] Cmd: wget http://10.107.64.69:80/ -O - -T 5 -t 1 , Output: ctest-pod-25327635
Connecting to 10.107.64.69:80 (10.107.64.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-29 22:07:28,616 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd wget http://10.107.64.69:80/ -O - -T 5 -t 1 passed
2024-10-29 22:07:28,616 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd output: ctest-pod-25327635
Connecting to 10.107.64.69:80 (10.107.64.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-29 22:07:28,674 - DEBUG - [Pod ctest-pod-66560114] Cmd: wget http://10.107.64.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-25327635
2024-10-29 22:07:28,674 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd wget http://10.107.64.69:80/ -O - -T 5 -t 1 passed
2024-10-29 22:07:28,674 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-25327635
2024-10-29 22:07:28,740 - DEBUG - [Pod ctest-pod-66560114] Cmd: wget http://10.107.64.69:80/ -O - -T 5 -t 1 , Output: ctest-pod-03657627
Connecting to 10.107.64.69:80 (10.107.64.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-29 22:07:28,740 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd wget http://10.107.64.69:80/ -O - -T 5 -t 1 passed
2024-10-29 22:07:28,740 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd output: ctest-pod-03657627
Connecting to 10.107.64.69:80 (10.107.64.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-29 22:07:28,740 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-03657627': 1, 'ctest-pod-25327635': 3}
2024-10-29 22:07:28,825 - DEBUG - [Pod ctest-pod-00548959] Cmd: wget http://10.107.64.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-03657627
2024-10-29 22:07:28,825 - DEBUG - [Pod Pod ctest-pod-00548959] Cmd wget http://10.107.64.69:80/ -O - -T 5 -t 1 passed
2024-10-29 22:07:28,825 - DEBUG - [Pod Pod ctest-pod-00548959] Cmd output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-03657627
2024-10-29 22:07:28,905 - DEBUG - [Pod ctest-pod-00548959] Cmd: wget http://10.107.64.69:80/ -O - -T 5 -t 1 , Output: ctest-pod-25327635
Connecting to 10.107.64.69:80 (10.107.64.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-29 22:07:28,917 - DEBUG - [Pod Pod ctest-pod-00548959] Cmd wget http://10.107.64.69:80/ -O - -T 5 -t 1 passed
2024-10-29 22:07:28,917 - DEBUG - [Pod Pod ctest-pod-00548959] Cmd output: ctest-pod-25327635
Connecting to 10.107.64.69:80 (10.107.64.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-29 22:07:28,917 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-03657627': 1, 'ctest-pod-25327635': 1}
2024-10-29 22:07:28,920 - DEBUG - Network policy ingress-on-service not present
2024-10-29 22:07:28,921 - INFO - Creating Network Policy ingress-on-service
2024-10-29 22:07:29,003 - INFO - Network policy found in k8s
2024-10-29 22:07:29,003 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=6a66d750-0498-40e2-9f9c-8eddbb2fa922
2024-10-29 22:07:29,012 - INFO - Network Policy ingress-on-service with uuid 6a66d750-0498-40e2-9f9c-8eddbb2fa922 found in kube manager
2024-10-29 22:07:29,049 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2024-10-29 22:07:29,049 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2024-10-29 22:07:29,050 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=6a66d750-0498-40e2-9f9c-8eddbb2fa922
2024-10-29 22:07:29,084 - WARNING - Network policy with name ingress-on-service not found in agent
2024-10-29 22:07:31,085 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=6a66d750-0498-40e2-9f9c-8eddbb2fa922
2024-10-29 22:07:31,118 - INFO - Network policy with name ingress-on-service found in agent
2024-10-29 22:07:31,118 - INFO - Network Policy ingress-on-service verification passed
2024-10-29 22:07:36,184 - DEBUG - [Pod ctest-pod-66560114] Cmd: wget http://10.107.64.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:07:36,184 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd wget http://10.107.64.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:07:36,184 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:07:41,239 - DEBUG - [Pod ctest-pod-66560114] Cmd: wget http://10.107.64.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:07:41,240 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd wget http://10.107.64.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:07:41,240 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:07:46,307 - DEBUG - [Pod ctest-pod-66560114] Cmd: wget http://10.107.64.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:07:46,307 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd wget http://10.107.64.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:07:46,307 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:07:51,372 - DEBUG - [Pod ctest-pod-66560114] Cmd: wget http://10.107.64.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:07:51,372 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd wget http://10.107.64.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:07:51,372 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:07:56,801 - DEBUG - [Pod ctest-pod-66560114] Cmd: wget http://10.107.64.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:07:56,801 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd wget http://10.107.64.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:07:56,801 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:08:01,873 - DEBUG - [Pod ctest-pod-66560114] Cmd: wget http://10.107.64.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:08:01,873 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd wget http://10.107.64.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:08:01,874 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:08:06,942 - DEBUG - [Pod ctest-pod-66560114] Cmd: wget http://10.107.64.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:08:06,943 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd wget http://10.107.64.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:08:06,943 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:08:12,016 - DEBUG - [Pod ctest-pod-66560114] Cmd: wget http://10.107.64.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:08:12,016 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd wget http://10.107.64.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:08:12,016 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:08:17,085 - DEBUG - [Pod ctest-pod-66560114] Cmd: wget http://10.107.64.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:08:17,086 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd wget http://10.107.64.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:08:17,086 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:08:22,140 - DEBUG - [Pod ctest-pod-66560114] Cmd: wget http://10.107.64.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:08:22,140 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd wget http://10.107.64.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:08:22,140 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:08:22,140 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-03657627': 0, 'ctest-pod-25327635': 0}
2024-10-29 22:08:22,228 - DEBUG - [Pod ctest-pod-93745239] Cmd: wget http://10.107.64.69:80/ -O - -T 5 -t 1 , Output: ctest-pod-25327635
Connecting to 10.107.64.69:80 (10.107.64.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-29 22:08:22,228 - DEBUG - [Pod Pod ctest-pod-93745239] Cmd wget http://10.107.64.69:80/ -O - -T 5 -t 1 passed
2024-10-29 22:08:22,228 - DEBUG - [Pod Pod ctest-pod-93745239] Cmd output: ctest-pod-25327635
Connecting to 10.107.64.69:80 (10.107.64.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-29 22:08:22,310 - DEBUG - [Pod ctest-pod-93745239] Cmd: wget http://10.107.64.69:80/ -O - -T 5 -t 1 , Output: ctest-pod-03657627
Connecting to 10.107.64.69:80 (10.107.64.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-29 22:08:22,310 - DEBUG - [Pod Pod ctest-pod-93745239] Cmd wget http://10.107.64.69:80/ -O - -T 5 -t 1 passed
2024-10-29 22:08:22,310 - DEBUG - [Pod Pod ctest-pod-93745239] Cmd output: ctest-pod-03657627
Connecting to 10.107.64.69:80 (10.107.64.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-29 22:08:22,310 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-03657627': 1, 'ctest-pod-25327635': 1}
2024-10-29 22:08:27,380 - DEBUG - [Pod ctest-pod-00548959] Cmd: wget http://10.107.64.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:08:27,380 - DEBUG - [Pod Pod ctest-pod-00548959] Cmd wget http://10.107.64.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:08:27,380 - DEBUG - [Pod Pod ctest-pod-00548959] Cmd output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:08:32,456 - DEBUG - [Pod ctest-pod-00548959] Cmd: wget http://10.107.64.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:08:32,457 - DEBUG - [Pod Pod ctest-pod-00548959] Cmd wget http://10.107.64.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:08:32,457 - DEBUG - [Pod Pod ctest-pod-00548959] Cmd output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:08:37,519 - DEBUG - [Pod ctest-pod-00548959] Cmd: wget http://10.107.64.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:08:37,520 - DEBUG - [Pod Pod ctest-pod-00548959] Cmd wget http://10.107.64.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:08:37,520 - DEBUG - [Pod Pod ctest-pod-00548959] Cmd output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:08:42,600 - DEBUG - [Pod ctest-pod-00548959] Cmd: wget http://10.107.64.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:08:42,600 - DEBUG - [Pod Pod ctest-pod-00548959] Cmd wget http://10.107.64.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:08:42,600 - DEBUG - [Pod Pod ctest-pod-00548959] Cmd output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:08:47,658 - DEBUG - [Pod ctest-pod-00548959] Cmd: wget http://10.107.64.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:08:47,658 - DEBUG - [Pod Pod ctest-pod-00548959] Cmd wget http://10.107.64.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:08:47,659 - DEBUG - [Pod Pod ctest-pod-00548959] Cmd output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:08:52,883 - DEBUG - [Pod ctest-pod-00548959] Cmd: wget http://10.107.64.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:08:52,884 - DEBUG - [Pod Pod ctest-pod-00548959] Cmd wget http://10.107.64.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:08:52,884 - DEBUG - [Pod Pod ctest-pod-00548959] Cmd output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:08:57,948 - DEBUG - [Pod ctest-pod-00548959] Cmd: wget http://10.107.64.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:08:57,948 - DEBUG - [Pod Pod ctest-pod-00548959] Cmd wget http://10.107.64.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:08:57,948 - DEBUG - [Pod Pod ctest-pod-00548959] Cmd output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:09:03,023 - DEBUG - [Pod ctest-pod-00548959] Cmd: wget http://10.107.64.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:09:03,023 - DEBUG - [Pod Pod ctest-pod-00548959] Cmd wget http://10.107.64.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:09:03,023 - DEBUG - [Pod Pod ctest-pod-00548959] Cmd output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:09:08,090 - DEBUG - [Pod ctest-pod-00548959] Cmd: wget http://10.107.64.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:09:08,090 - DEBUG - [Pod Pod ctest-pod-00548959] Cmd wget http://10.107.64.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:09:08,090 - DEBUG - [Pod Pod ctest-pod-00548959] Cmd output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:09:13,151 - DEBUG - [Pod ctest-pod-00548959] Cmd: wget http://10.107.64.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:09:13,151 - DEBUG - [Pod Pod ctest-pod-00548959] Cmd wget http://10.107.64.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:09:13,151 - DEBUG - [Pod Pod ctest-pod-00548959] Cmd output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:09:13,151 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-03657627': 0, 'ctest-pod-25327635': 0}
2024-10-29 22:09:15,217 - DEBUG - [Pod ctest-pod-93745239] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.230 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.087 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.104 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.087/0.473/1.230 ms
2024-10-29 22:09:15,218 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-93745239 with expectation True passed
2024-10-29 22:09:17,286 - DEBUG - [Pod ctest-pod-66560114] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.455 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.083 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.147 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.083/0.561/1.455 ms
2024-10-29 22:09:17,286 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-66560114 with expectation True passed
2024-10-29 22:09:19,353 - DEBUG - [Pod ctest-pod-00548959] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.123 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.086 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.088 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.086/0.432/1.123 ms
2024-10-29 22:09:19,353 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-00548959 with expectation True passed
2024-10-29 22:09:19,422 - DEBUG - [Pod ctest-pod-93745239] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-29 22:09:19,422 - DEBUG - [Pod Pod ctest-pod-93745239] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-10-29 22:09:19,422 - DEBUG - [Pod Pod ctest-pod-93745239] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-29 22:09:19,422 - INFO - wget check of of http://10.47.255.251 from ctest-pod-93745239 passed
2024-10-29 22:09:19,495 - DEBUG - [Pod ctest-pod-93745239] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-29 22:09:19,495 - DEBUG - [Pod Pod ctest-pod-93745239] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-10-29 22:09:19,495 - DEBUG - [Pod Pod ctest-pod-93745239] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-29 22:09:19,495 - INFO - wget check of of http://10.47.255.250 from ctest-pod-93745239 passed
2024-10-29 22:09:24,572 - DEBUG - [Pod ctest-pod-66560114] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-10-29 22:09:24,572 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-10-29 22:09:24,572 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-10-29 22:09:24,572 - INFO - wget check of of http://10.47.255.250 from ctest-pod-66560114 passed
2024-10-29 22:09:29,636 - DEBUG - [Pod ctest-pod-19482207] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-10-29 22:09:29,636 - DEBUG - [Pod Pod ctest-pod-19482207] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-10-29 22:09:29,636 - DEBUG - [Pod Pod ctest-pod-19482207] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-10-29 22:09:29,636 - INFO - wget check of of http://10.47.255.251 from ctest-pod-19482207 passed
2024-10-29 22:09:29,652 - INFO - Updating Network Policy ingress-on-service
2024-10-29 22:09:34,730 - DEBUG - [Pod ctest-pod-66560114] Cmd: wget http://10.107.64.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:09:34,730 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd wget http://10.107.64.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:09:34,730 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:09:39,796 - DEBUG - [Pod ctest-pod-66560114] Cmd: wget http://10.107.64.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:09:39,796 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd wget http://10.107.64.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:09:39,796 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:09:44,848 - DEBUG - [Pod ctest-pod-66560114] Cmd: wget http://10.107.64.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:09:44,848 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd wget http://10.107.64.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:09:44,848 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:09:49,912 - DEBUG - [Pod ctest-pod-66560114] Cmd: wget http://10.107.64.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:09:49,912 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd wget http://10.107.64.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:09:49,912 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:09:54,975 - DEBUG - [Pod ctest-pod-66560114] Cmd: wget http://10.107.64.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:09:54,975 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd wget http://10.107.64.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:09:54,975 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:10:00,053 - DEBUG - [Pod ctest-pod-66560114] Cmd: wget http://10.107.64.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:10:00,053 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd wget http://10.107.64.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:10:00,053 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:10:05,120 - DEBUG - [Pod ctest-pod-66560114] Cmd: wget http://10.107.64.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:10:05,120 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd wget http://10.107.64.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:10:05,120 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:10:10,185 - DEBUG - [Pod ctest-pod-66560114] Cmd: wget http://10.107.64.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:10:10,185 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd wget http://10.107.64.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:10:10,185 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:10:15,243 - DEBUG - [Pod ctest-pod-66560114] Cmd: wget http://10.107.64.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:10:15,243 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd wget http://10.107.64.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:10:15,243 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:10:20,311 - DEBUG - [Pod ctest-pod-66560114] Cmd: wget http://10.107.64.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:10:20,312 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd wget http://10.107.64.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:10:20,312 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
wget: download timed out
2024-10-29 22:10:20,312 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-03657627': 0, 'ctest-pod-25327635': 0}
2024-10-29 22:10:20,391 - DEBUG - [Pod ctest-pod-93745239] Cmd: wget http://10.107.64.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-25327635
2024-10-29 22:10:20,391 - DEBUG - [Pod Pod ctest-pod-93745239] Cmd wget http://10.107.64.69:80/ -O - -T 5 -t 1 passed
2024-10-29 22:10:20,391 - DEBUG - [Pod Pod ctest-pod-93745239] Cmd output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-25327635
2024-10-29 22:10:20,468 - DEBUG - [Pod ctest-pod-93745239] Cmd: wget http://10.107.64.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-25327635
2024-10-29 22:10:20,468 - DEBUG - [Pod Pod ctest-pod-93745239] Cmd wget http://10.107.64.69:80/ -O - -T 5 -t 1 passed
2024-10-29 22:10:20,468 - DEBUG - [Pod Pod ctest-pod-93745239] Cmd output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-25327635
2024-10-29 22:10:20,542 - DEBUG - [Pod ctest-pod-93745239] Cmd: wget http://10.107.64.69:80/ -O - -T 5 -t 1 , Output: ctest-pod-03657627
Connecting to 10.107.64.69:80 (10.107.64.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-29 22:10:20,542 - DEBUG - [Pod Pod ctest-pod-93745239] Cmd wget http://10.107.64.69:80/ -O - -T 5 -t 1 passed
2024-10-29 22:10:20,543 - DEBUG - [Pod Pod ctest-pod-93745239] Cmd output: ctest-pod-03657627
Connecting to 10.107.64.69:80 (10.107.64.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-29 22:10:20,543 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-03657627': 1, 'ctest-pod-25327635': 2}
2024-10-29 22:10:20,609 - DEBUG - [Pod ctest-pod-00548959] Cmd: wget http://10.107.64.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
ctest-pod-25327635
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-29 22:10:20,609 - DEBUG - [Pod Pod ctest-pod-00548959] Cmd wget http://10.107.64.69:80/ -O - -T 5 -t 1 passed
2024-10-29 22:10:20,609 - DEBUG - [Pod Pod ctest-pod-00548959] Cmd output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
ctest-pod-25327635
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-29 22:10:20,669 - DEBUG - [Pod ctest-pod-00548959] Cmd: wget http://10.107.64.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-25327635
2024-10-29 22:10:20,669 - DEBUG - [Pod Pod ctest-pod-00548959] Cmd wget http://10.107.64.69:80/ -O - -T 5 -t 1 passed
2024-10-29 22:10:20,669 - DEBUG - [Pod Pod ctest-pod-00548959] Cmd output: Connecting to 10.107.64.69:80 (10.107.64.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-25327635
2024-10-29 22:10:20,742 - DEBUG - [Pod ctest-pod-00548959] Cmd: wget http://10.107.64.69:80/ -O - -T 5 -t 1 , Output: ctest-pod-03657627
Connecting to 10.107.64.69:80 (10.107.64.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-29 22:10:20,742 - DEBUG - [Pod Pod ctest-pod-00548959] Cmd wget http://10.107.64.69:80/ -O - -T 5 -t 1 passed
2024-10-29 22:10:20,742 - DEBUG - [Pod Pod ctest-pod-00548959] Cmd output: ctest-pod-03657627
Connecting to 10.107.64.69:80 (10.107.64.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-29 22:10:20,742 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-03657627': 1, 'ctest-pod-25327635': 2}
2024-10-29 22:10:22,822 - DEBUG - [Pod ctest-pod-93745239] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.780 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.087 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.107 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.087/0.324/0.780 ms
2024-10-29 22:10:22,822 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-93745239 with expectation True passed
2024-10-29 22:10:24,896 - DEBUG - [Pod ctest-pod-66560114] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.903 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.088 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.121 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.088/0.370/0.903 ms
2024-10-29 22:10:24,897 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-66560114 with expectation True passed
2024-10-29 22:10:26,960 - DEBUG - [Pod ctest-pod-00548959] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.645 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.118 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.111 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.111/0.291/0.645 ms
2024-10-29 22:10:26,960 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-00548959 with expectation True passed
2024-10-29 22:10:27,036 - DEBUG - [Pod ctest-pod-93745239] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-29 22:10:27,036 - DEBUG - [Pod Pod ctest-pod-93745239] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-10-29 22:10:27,036 - DEBUG - [Pod Pod ctest-pod-93745239] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-29 22:10:27,036 - INFO - wget check of of http://10.47.255.251 from ctest-pod-93745239 passed
2024-10-29 22:10:27,110 - DEBUG - [Pod ctest-pod-93745239] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-29 22:10:27,110 - DEBUG - [Pod Pod ctest-pod-93745239] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-10-29 22:10:27,110 - DEBUG - [Pod Pod ctest-pod-93745239] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-29 22:10:27,110 - INFO - wget check of of http://10.47.255.250 from ctest-pod-93745239 passed
2024-10-29 22:10:32,190 - DEBUG - [Pod ctest-pod-66560114] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-10-29 22:10:32,190 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-10-29 22:10:32,190 - DEBUG - [Pod Pod ctest-pod-66560114] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-10-29 22:10:32,190 - INFO - wget check of of http://10.47.255.250 from ctest-pod-66560114 passed
2024-10-29 22:10:32,286 - DEBUG - [Pod ctest-pod-19482207] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-29 22:10:32,286 - DEBUG - [Pod Pod ctest-pod-19482207] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-10-29 22:10:32,286 - DEBUG - [Pod Pod ctest-pod-19482207] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-29 22:10:32,286 - INFO - wget check of of http://10.47.255.251 from ctest-pod-19482207 passed
2024-10-29 22:10:32,286 - INFO - Deleting Network Policy : ingress-on-service
2024-10-29 22:10:32,287 - INFO - Deleting service : ctest-nginx-svc-38485974
2024-10-29 22:10:32,631 - DEBUG - No XMPP flaps were noticed during the test
2024-10-29 22:10:32,631 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:07]
2024-10-29 22:10:32,631 - INFO - --------------------------------------------------------------------------------
2024-10-29 22:10:32,636 - INFO - Deleting pod ctest-new-default-76728485:ctest-pod-03657627
2024-10-29 22:10:32,637 - INFO - Deleting pod ctest-new-default-76728485:ctest-pod-25327635
2024-10-29 22:10:32,637 - INFO - Deleting pod ctest-non-default-15548439:ctest-pod-19309966
2024-10-29 22:10:32,638 - INFO - Deleting pod ctest-non-default-15548439:ctest-pod-34780615
2024-10-29 22:10:32,638 - INFO - Deleting pod ctest-new-default-76728485:ctest-pod-66560114
2024-10-29 22:10:32,638 - INFO - Deleting pod ctest-new-default-76728485:ctest-pod-93745239
2024-10-29 22:10:32,638 - INFO - Deleting pod ctest-non-default-15548439:ctest-pod-00548959
2024-10-29 22:10:32,639 - INFO - Deleting pod ctest-non-default-15548439:ctest-pod-19482207
2024-10-29 22:10:32,767 - WARNING - Pod uuid c2265a30-6342-4ff8-a6d9-57ca5e22be1d is still seen in agent 10.0.0.24 VM list
2024-10-29 22:10:32,768 - WARNING - Pod uuid 3d4531a4-9c62-4163-8560-3dae5c530273 is still seen in agent 10.0.0.24 VM list
2024-10-29 22:10:32,770 - WARNING - Pod uuid 200bb975-e5ea-4852-aa1d-93625ba01e4c is still seen in agent 10.0.0.24 VM list
2024-10-29 22:10:32,770 - WARNING - Pod uuid e08820ca-0049-4ff4-9946-425519414201 is still seen in agent 10.0.0.24 VM list
2024-10-29 22:10:32,771 - WARNING - Pod uuid 3c72f2c2-c6d0-4e23-8091-454eeb6302e1 is still seen in agent 10.0.0.24 VM list
2024-10-29 22:10:32,771 - WARNING - Pod uuid 4f97be5a-00b3-4358-b21c-7c1eda2c9982 is still seen in agent 10.0.0.24 VM list
2024-10-29 22:10:32,772 - WARNING - Pod uuid 51c0dc7b-ba92-4388-b0fc-8dd3d78cd9d6 is still seen in agent 10.0.0.24 VM list
2024-10-29 22:10:32,775 - WARNING - Pod uuid c6ca202f-80de-42a6-8281-f7fed2677f76 is still seen in agent 10.0.0.24 VM list
2024-10-29 22:10:37,803 - WARNING - Pod uuid 4f97be5a-00b3-4358-b21c-7c1eda2c9982 is still seen in agent 10.0.0.24 VM list
2024-10-29 22:10:37,803 - DEBUG - Pod c6ca202f-80de-42a6-8281-f7fed2677f76 is not in agent 10.0.0.24 VM list
2024-10-29 22:10:37,805 - WARNING - Pod uuid 51c0dc7b-ba92-4388-b0fc-8dd3d78cd9d6 is still seen in agent 10.0.0.24 VM list
2024-10-29 22:10:37,805 - DEBUG - Pod 3c72f2c2-c6d0-4e23-8091-454eeb6302e1 is not in agent 10.0.0.24 VM list
2024-10-29 22:10:37,806 - DEBUG - Pod e08820ca-0049-4ff4-9946-425519414201 is not in agent 10.0.0.24 VM list
2024-10-29 22:10:37,808 - WARNING - Pod uuid c2265a30-6342-4ff8-a6d9-57ca5e22be1d is still seen in agent 10.0.0.24 VM list
2024-10-29 22:10:37,810 - WARNING - Pod uuid 3d4531a4-9c62-4163-8560-3dae5c530273 is still seen in agent 10.0.0.24 VM list
2024-10-29 22:10:37,810 - DEBUG - Pod 200bb975-e5ea-4852-aa1d-93625ba01e4c is not in agent 10.0.0.24 VM list
2024-10-29 22:10:37,826 - DEBUG - VMI 2749703c-9642-11ef-ab01-fa163e9b7eff is removed from agent 10.0.0.24
2024-10-29 22:10:37,826 - INFO - Verified that pod ctest-pod-34780615 is removed in agent
2024-10-29 22:10:37,827 - DEBUG - VMI 258f88da-9642-11ef-ab01-fa163e9b7eff is removed from agent 10.0.0.24
2024-10-29 22:10:37,827 - INFO - Verified that pod ctest-pod-03657627 is removed in agent
2024-10-29 22:10:37,827 - DEBUG - VMI 26c8e0a2-9642-11ef-ab01-fa163e9b7eff is removed from agent 10.0.0.24
2024-10-29 22:10:37,828 - INFO - Verified that pod ctest-pod-19309966 is removed in agent
2024-10-29 22:10:37,828 - DEBUG - VMI 261cc268-9642-11ef-ab01-fa163e9b7eff is removed from agent 10.0.0.24
2024-10-29 22:10:37,828 - INFO - Verified that pod ctest-pod-25327635 is removed in agent
2024-10-29 22:10:42,815 - WARNING - Pod uuid 51c0dc7b-ba92-4388-b0fc-8dd3d78cd9d6 is still seen in agent 10.0.0.24 VM list
2024-10-29 22:10:42,816 - WARNING - Pod uuid 4f97be5a-00b3-4358-b21c-7c1eda2c9982 is still seen in agent 10.0.0.24 VM list
2024-10-29 22:10:42,832 - WARNING - Pod uuid c2265a30-6342-4ff8-a6d9-57ca5e22be1d is still seen in agent 10.0.0.24 VM list
2024-10-29 22:10:42,833 - WARNING - Pod uuid 3d4531a4-9c62-4163-8560-3dae5c530273 is still seen in agent 10.0.0.24 VM list
2024-10-29 22:10:47,827 - WARNING - Pod uuid 51c0dc7b-ba92-4388-b0fc-8dd3d78cd9d6 is still seen in agent 10.0.0.24 VM list
2024-10-29 22:10:47,828 - WARNING - Pod uuid 4f97be5a-00b3-4358-b21c-7c1eda2c9982 is still seen in agent 10.0.0.24 VM list
2024-10-29 22:10:47,844 - WARNING - Pod uuid c2265a30-6342-4ff8-a6d9-57ca5e22be1d is still seen in agent 10.0.0.24 VM list
2024-10-29 22:10:47,844 - WARNING - Pod uuid 3d4531a4-9c62-4163-8560-3dae5c530273 is still seen in agent 10.0.0.24 VM list
2024-10-29 22:10:52,840 - WARNING - Pod uuid 4f97be5a-00b3-4358-b21c-7c1eda2c9982 is still seen in agent 10.0.0.24 VM list
2024-10-29 22:10:52,841 - WARNING - Pod uuid 51c0dc7b-ba92-4388-b0fc-8dd3d78cd9d6 is still seen in agent 10.0.0.24 VM list
2024-10-29 22:10:52,855 - WARNING - Pod uuid c2265a30-6342-4ff8-a6d9-57ca5e22be1d is still seen in agent 10.0.0.24 VM list
2024-10-29 22:10:52,856 - WARNING - Pod uuid 3d4531a4-9c62-4163-8560-3dae5c530273 is still seen in agent 10.0.0.24 VM list
2024-10-29 22:10:57,850 - WARNING - Pod uuid 4f97be5a-00b3-4358-b21c-7c1eda2c9982 is still seen in agent 10.0.0.24 VM list
2024-10-29 22:10:57,853 - WARNING - Pod uuid 51c0dc7b-ba92-4388-b0fc-8dd3d78cd9d6 is still seen in agent 10.0.0.24 VM list
2024-10-29 22:10:57,866 - WARNING - Pod uuid c2265a30-6342-4ff8-a6d9-57ca5e22be1d is still seen in agent 10.0.0.24 VM list
2024-10-29 22:10:57,867 - WARNING - Pod uuid 3d4531a4-9c62-4163-8560-3dae5c530273 is still seen in agent 10.0.0.24 VM list
2024-10-29 22:11:02,862 - WARNING - Pod uuid 51c0dc7b-ba92-4388-b0fc-8dd3d78cd9d6 is still seen in agent 10.0.0.24 VM list
2024-10-29 22:11:02,863 - WARNING - Pod uuid 4f97be5a-00b3-4358-b21c-7c1eda2c9982 is still seen in agent 10.0.0.24 VM list
2024-10-29 22:11:02,880 - WARNING - Pod uuid c2265a30-6342-4ff8-a6d9-57ca5e22be1d is still seen in agent 10.0.0.24 VM list
2024-10-29 22:11:02,881 - WARNING - Pod uuid 3d4531a4-9c62-4163-8560-3dae5c530273 is still seen in agent 10.0.0.24 VM list
2024-10-29 22:11:07,874 - DEBUG - Pod 4f97be5a-00b3-4358-b21c-7c1eda2c9982 is not in agent 10.0.0.24 VM list
2024-10-29 22:11:07,876 - DEBUG - Pod 51c0dc7b-ba92-4388-b0fc-8dd3d78cd9d6 is not in agent 10.0.0.24 VM list
2024-10-29 22:11:07,891 - DEBUG - Pod 3d4531a4-9c62-4163-8560-3dae5c530273 is not in agent 10.0.0.24 VM list
2024-10-29 22:11:07,893 - DEBUG - VMI 28cc558c-9642-11ef-ab01-fa163e9b7eff is removed from agent 10.0.0.24
2024-10-29 22:11:07,893 - INFO - Verified that pod ctest-pod-00548959 is removed in agent
2024-10-29 22:11:07,894 - DEBUG - VMI 294b32ee-9642-11ef-ab01-fa163e9b7eff is removed from agent 10.0.0.24
2024-10-29 22:11:07,894 - INFO - Verified that pod ctest-pod-19482207 is removed in agent
2024-10-29 22:11:07,895 - DEBUG - Pod c2265a30-6342-4ff8-a6d9-57ca5e22be1d is not in agent 10.0.0.24 VM list
2024-10-29 22:11:07,906 - DEBUG - VMI 2851a742-9642-11ef-ab01-fa163e9b7eff is removed from agent 10.0.0.24
2024-10-29 22:11:07,906 - INFO - Verified that pod ctest-pod-93745239 is removed in agent
2024-10-29 22:11:07,907 - DEBUG - VMI 27d5ad9a-9642-11ef-ab01-fa163e9b7eff is removed from agent 10.0.0.24
2024-10-29 22:11:07,907 - INFO - Verified that pod ctest-pod-66560114 is removed in agent
2024-10-29 22:11:07,907 - INFO - Deleting namespace ctest-non-default-15548439
2024-10-29 22:11:07,919 - DEBUG - Namespace ctest-non-default-15548439 still in k8s
2024-10-29 22:11:09,926 - DEBUG - Namespace ctest-non-default-15548439 still in k8s
2024-10-29 22:11:11,931 - DEBUG - Namespace ctest-non-default-15548439 still in k8s
2024-10-29 22:11:13,936 - DEBUG - Namespace ctest-non-default-15548439 is not in k8s
2024-10-29 22:11:13,936 - DEBUG - No need to check project deletion in contrail-api
2024-10-29 22:11:13,936 - INFO - Deleting namespace ctest-new-default-76728485
2024-10-29 22:11:13,946 - DEBUG - Namespace ctest-new-default-76728485 still in k8s
2024-10-29 22:11:15,952 - DEBUG - Namespace ctest-new-default-76728485 still in k8s
2024-10-29 22:11:17,957 - DEBUG - Namespace ctest-new-default-76728485 still in k8s
2024-10-29 22:11:19,961 - DEBUG - Namespace ctest-new-default-76728485 is not in k8s
2024-10-29 22:11:19,961 - DEBUG - No need to check project deletion in contrail-api