2025-02-10 17:24:30,141 - INFO - Using existing project ['default-domain', 'k8s-default'](3967d2f2-7fb5-4d81-afe9-77649094f7c3)
2025-02-10 17:24:30,162 - DEBUG - Namespace ctest-new-default-52540862 not present
2025-02-10 17:24:30,171 - INFO - Created namespace ctest-new-default-52540862
2025-02-10 17:24:33,175 - DEBUG - Namespace ctest-non-default-55835878 not present
2025-02-10 17:24:33,192 - INFO - Created namespace ctest-non-default-55835878
2025-02-10 17:24:36,218 - DEBUG - Pod ctest-pod-89135456 not present
2025-02-10 17:24:36,218 - INFO - Creating Pod ctest-pod-89135456
2025-02-10 17:24:36,268 - DEBUG - Pod : ctest-pod-89135456 UUID is 07ed440b-c6dc-47ca-bdd4-63deaa00612b
2025-02-10 17:24:36,272 - DEBUG - Pod ctest-pod-46987356 not present
2025-02-10 17:24:36,272 - INFO - Creating Pod ctest-pod-46987356
2025-02-10 17:24:36,289 - DEBUG - Pod : ctest-pod-46987356 UUID is 9e46784a-b224-4cfc-bf83-cabcd60cef32
2025-02-10 17:24:36,291 - DEBUG - Pod ctest-pod-79458694 not present
2025-02-10 17:24:36,291 - INFO - Creating Pod ctest-pod-79458694
2025-02-10 17:24:36,334 - DEBUG - Pod : ctest-pod-79458694 UUID is c116bcb8-8656-4c9a-a28d-5d4c5f8e4981
2025-02-10 17:24:36,337 - DEBUG - Pod ctest-pod-37564693 not present
2025-02-10 17:24:36,338 - INFO - Creating Pod ctest-pod-37564693
2025-02-10 17:24:36,365 - DEBUG - Pod : ctest-pod-37564693 UUID is 691e012b-ed15-4279-a7ab-042e024df110
2025-02-10 17:24:36,368 - DEBUG - Pod ctest-pod-12061999 not present
2025-02-10 17:24:36,368 - INFO - Creating Pod ctest-pod-12061999
2025-02-10 17:24:36,385 - DEBUG - Pod : ctest-pod-12061999 UUID is cf98f913-2120-49b0-aa63-5b9321e50a18
2025-02-10 17:24:36,388 - DEBUG - Pod ctest-pod-84504513 not present
2025-02-10 17:24:36,388 - INFO - Creating Pod ctest-pod-84504513
2025-02-10 17:24:36,410 - DEBUG - Pod : ctest-pod-84504513 UUID is 5a9bb2ef-0eff-499e-961c-c673ec039454
2025-02-10 17:24:36,417 - DEBUG - Pod ctest-pod-59095385 not present
2025-02-10 17:24:36,417 - INFO - Creating Pod ctest-pod-59095385
2025-02-10 17:24:36,438 - DEBUG - Pod : ctest-pod-59095385 UUID is 59bed2db-dbb3-4e14-9a1a-8ba859da2760
2025-02-10 17:24:36,440 - DEBUG - Pod ctest-pod-34782324 not present
2025-02-10 17:24:36,440 - INFO - Creating Pod ctest-pod-34782324
2025-02-10 17:24:36,484 - DEBUG - Pod : ctest-pod-34782324 UUID is 506c038a-705b-4c59-9e8c-4c8ffed7c778
2025-02-10 17:24:36,683 - INFO - Project default-domain:k8s-ctest-new-default-52540862 for Namespace ctest-new-default-52540862 is seen in contrail-api
2025-02-10 17:24:36,683 - DEBUG - Project uuid in Contrail is 90f3dde7-8e75-43d3-96cf-ebf425360801
2025-02-10 17:24:36,866 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=bab15574-e43e-447f-8476-302f4320c374
2025-02-10 17:24:36,880 - INFO - Namespace ctest-new-default-52540862 with uuid bab15574-e43e-447f-8476-302f4320c374 found in kube manager
2025-02-10 17:24:36,880 - INFO - Namespace ctest-new-default-52540862 verification passed
2025-02-10 17:24:37,089 - INFO - Project default-domain:k8s-ctest-non-default-55835878 for Namespace ctest-non-default-55835878 is seen in contrail-api
2025-02-10 17:24:37,089 - DEBUG - Project uuid in Contrail is 6e35544a-c8f6-4703-9942-f36d2656b1b4
2025-02-10 17:24:37,089 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=356cbbdf-8a6b-4d60-8edd-b07b2fde41bc
2025-02-10 17:24:37,094 - INFO - Namespace ctest-non-default-55835878 with uuid 356cbbdf-8a6b-4d60-8edd-b07b2fde41bc found in kube manager
2025-02-10 17:24:37,094 - INFO - Namespace ctest-non-default-55835878 verification passed
2025-02-10 17:24:37,104 - DEBUG - Pod ctest-pod-89135456 not in running state.Currently in Pending
2025-02-10 17:24:42,110 - DEBUG - Pod ctest-pod-89135456 not in running state.Currently in Pending
2025-02-10 17:24:47,117 - DEBUG - Pod ctest-pod-89135456 not in running state.Currently in Pending
2025-02-10 17:24:52,123 - INFO - Pod ctest-pod-89135456 is in running state.Got IP 10.47.255.251
2025-02-10 17:24:52,181 - DEBUG - Pod ctest-pod-89135456 has vmi e79458a6-e7d3-11ef-b0d5-fa163e44080b
2025-02-10 17:24:52,181 - INFO - Verified pod ctest-pod-89135456 in contrail-api
2025-02-10 17:24:52,197 - DEBUG - VMI e79458a6-e7d3-11ef-b0d5-fa163e44080b is active in agent 10.0.0.44
2025-02-10 17:24:52,197 - INFO - Verified Pod ctest-pod-89135456 in agent 10.0.0.44
2025-02-10 17:24:52,198 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=07ed440b-c6dc-47ca-bdd4-63deaa00612b
2025-02-10 17:24:52,202 - INFO - Pod ctest-pod-89135456 with uuid 07ed440b-c6dc-47ca-bdd4-63deaa00612b found in kube manager
2025-02-10 17:24:52,202 - INFO - Pod ctest-pod-89135456 verification passed
2025-02-10 17:24:52,208 - INFO - Pod ctest-pod-46987356 is in running state.Got IP 10.47.255.250
2025-02-10 17:24:52,223 - DEBUG - Pod ctest-pod-46987356 has vmi e822cbae-e7d3-11ef-b0d5-fa163e44080b
2025-02-10 17:24:52,223 - INFO - Verified pod ctest-pod-46987356 in contrail-api
2025-02-10 17:24:52,236 - DEBUG - VMI e822cbae-e7d3-11ef-b0d5-fa163e44080b is active in agent 10.0.0.44
2025-02-10 17:24:52,237 - INFO - Verified Pod ctest-pod-46987356 in agent 10.0.0.44
2025-02-10 17:24:52,237 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=9e46784a-b224-4cfc-bf83-cabcd60cef32
2025-02-10 17:24:52,241 - INFO - Pod ctest-pod-46987356 with uuid 9e46784a-b224-4cfc-bf83-cabcd60cef32 found in kube manager
2025-02-10 17:24:52,241 - INFO - Pod ctest-pod-46987356 verification passed
2025-02-10 17:24:52,246 - INFO - Pod ctest-pod-79458694 is in running state.Got IP 10.47.255.249
2025-02-10 17:24:52,301 - DEBUG - Pod ctest-pod-79458694 has vmi e8c8c3d8-e7d3-11ef-b0d5-fa163e44080b
2025-02-10 17:24:52,301 - INFO - Verified pod ctest-pod-79458694 in contrail-api
2025-02-10 17:24:52,318 - DEBUG - VMI e8c8c3d8-e7d3-11ef-b0d5-fa163e44080b is active in agent 10.0.0.44
2025-02-10 17:24:52,318 - INFO - Verified Pod ctest-pod-79458694 in agent 10.0.0.44
2025-02-10 17:24:52,318 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=c116bcb8-8656-4c9a-a28d-5d4c5f8e4981
2025-02-10 17:24:52,323 - INFO - Pod ctest-pod-79458694 with uuid c116bcb8-8656-4c9a-a28d-5d4c5f8e4981 found in kube manager
2025-02-10 17:24:52,323 - INFO - Pod ctest-pod-79458694 verification passed
2025-02-10 17:24:52,330 - INFO - Pod ctest-pod-37564693 is in running state.Got IP 10.47.255.248
2025-02-10 17:24:52,388 - DEBUG - Pod ctest-pod-37564693 has vmi e953d39c-e7d3-11ef-b0d5-fa163e44080b
2025-02-10 17:24:52,389 - INFO - Verified pod ctest-pod-37564693 in contrail-api
2025-02-10 17:24:52,404 - DEBUG - VMI e953d39c-e7d3-11ef-b0d5-fa163e44080b is active in agent 10.0.0.44
2025-02-10 17:24:52,404 - INFO - Verified Pod ctest-pod-37564693 in agent 10.0.0.44
2025-02-10 17:24:52,404 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=691e012b-ed15-4279-a7ab-042e024df110
2025-02-10 17:24:52,409 - INFO - Pod ctest-pod-37564693 with uuid 691e012b-ed15-4279-a7ab-042e024df110 found in kube manager
2025-02-10 17:24:52,409 - INFO - Pod ctest-pod-37564693 verification passed
2025-02-10 17:24:52,414 - DEBUG - Pod ctest-pod-12061999 not in running state.Currently in Pending
2025-02-10 17:24:57,422 - INFO - Pod ctest-pod-12061999 is in running state.Got IP 10.47.255.247
2025-02-10 17:24:57,438 - DEBUG - Pod ctest-pod-12061999 has vmi e9ec7db8-e7d3-11ef-b0d5-fa163e44080b
2025-02-10 17:24:57,438 - INFO - Verified pod ctest-pod-12061999 in contrail-api
2025-02-10 17:24:57,456 - DEBUG - VMI e9ec7db8-e7d3-11ef-b0d5-fa163e44080b is active in agent 10.0.0.44
2025-02-10 17:24:57,456 - INFO - Verified Pod ctest-pod-12061999 in agent 10.0.0.44
2025-02-10 17:24:57,456 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=cf98f913-2120-49b0-aa63-5b9321e50a18
2025-02-10 17:24:57,462 - INFO - Pod ctest-pod-12061999 with uuid cf98f913-2120-49b0-aa63-5b9321e50a18 found in kube manager
2025-02-10 17:24:57,462 - INFO - Pod ctest-pod-12061999 verification passed
2025-02-10 17:24:57,468 - INFO - Pod ctest-pod-59095385 is in running state.Got IP 10.47.255.245
2025-02-10 17:24:57,524 - DEBUG - Pod ctest-pod-59095385 has vmi eaee56e6-e7d3-11ef-b0d5-fa163e44080b
2025-02-10 17:24:57,525 - INFO - Verified pod ctest-pod-59095385 in contrail-api
2025-02-10 17:24:57,539 - DEBUG - VMI eaee56e6-e7d3-11ef-b0d5-fa163e44080b is active in agent 10.0.0.44
2025-02-10 17:24:57,539 - INFO - Verified Pod ctest-pod-59095385 in agent 10.0.0.44
2025-02-10 17:24:57,540 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=59bed2db-dbb3-4e14-9a1a-8ba859da2760
2025-02-10 17:24:57,544 - INFO - Pod ctest-pod-59095385 with uuid 59bed2db-dbb3-4e14-9a1a-8ba859da2760 found in kube manager
2025-02-10 17:24:57,544 - INFO - Pod ctest-pod-59095385 verification passed
2025-02-10 17:24:57,612 - INFO - Pod ctest-pod-84504513 is in running state.Got IP 10.47.255.246
2025-02-10 17:24:57,626 - DEBUG - Pod ctest-pod-84504513 has vmi ea6a653e-e7d3-11ef-b0d5-fa163e44080b
2025-02-10 17:24:57,626 - INFO - Verified pod ctest-pod-84504513 in contrail-api
2025-02-10 17:24:57,642 - DEBUG - VMI ea6a653e-e7d3-11ef-b0d5-fa163e44080b is active in agent 10.0.0.44
2025-02-10 17:24:57,642 - INFO - Verified Pod ctest-pod-84504513 in agent 10.0.0.44
2025-02-10 17:24:57,642 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=5a9bb2ef-0eff-499e-961c-c673ec039454
2025-02-10 17:24:57,648 - INFO - Pod ctest-pod-84504513 with uuid 5a9bb2ef-0eff-499e-961c-c673ec039454 found in kube manager
2025-02-10 17:24:57,649 - INFO - Pod ctest-pod-84504513 verification passed
2025-02-10 17:24:57,656 - INFO - Pod ctest-pod-34782324 is in running state.Got IP 10.47.255.244
2025-02-10 17:24:57,716 - DEBUG - Pod ctest-pod-34782324 has vmi eb70a984-e7d3-11ef-b0d5-fa163e44080b
2025-02-10 17:24:57,717 - INFO - Verified pod ctest-pod-34782324 in contrail-api
2025-02-10 17:24:57,732 - DEBUG - VMI eb70a984-e7d3-11ef-b0d5-fa163e44080b is active in agent 10.0.0.44
2025-02-10 17:24:57,732 - INFO - Verified Pod ctest-pod-34782324 in agent 10.0.0.44
2025-02-10 17:24:57,732 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=506c038a-705b-4c59-9e8c-4c8ffed7c778
2025-02-10 17:24:57,737 - INFO - Pod ctest-pod-34782324 with uuid 506c038a-705b-4c59-9e8c-4c8ffed7c778 found in kube manager
2025-02-10 17:24:57,737 - INFO - Pod ctest-pod-34782324 verification passed
2025-02-10 17:24:57,737 - INFO - ================================================================================
2025-02-10 17:24:57,737 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-02-10 17:24:57,737 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-02-10 17:24:57,976 - DEBUG - Nothing to compare xmpp stats {'10.0.0.44': {'10.0.0.22': '0'}} with
2025-02-10 17:24:57,976 - INFO - Initial checks done. Running the testcase now
2025-02-10 17:24:57,976 - INFO -
2025-02-10 17:24:58,032 - DEBUG - [Pod ctest-pod-89135456] Cmd: echo ctest-pod-89135456 > /usr/share/nginx/html/index.html, Output:
2025-02-10 17:24:58,083 - DEBUG - [Pod ctest-pod-46987356] Cmd: echo ctest-pod-46987356 > /usr/share/nginx/html/index.html, Output:
2025-02-10 17:24:58,155 - DEBUG - [Pod ctest-pod-79458694] Cmd: echo ctest-pod-79458694 > /usr/share/nginx/html/index.html, Output:
2025-02-10 17:24:58,239 - DEBUG - [Pod ctest-pod-37564693] Cmd: echo ctest-pod-37564693 > /usr/share/nginx/html/index.html, Output:
2025-02-10 17:24:58,243 - DEBUG - Service ctest-nginx-svc-38778311 not present
2025-02-10 17:24:58,243 - INFO - Creating service ctest-nginx-svc-38778311
2025-02-10 17:24:58,275 - INFO - Created Service ctest-nginx-svc-38778311
2025-02-10 17:24:58,280 - WARNING - Service UUID 7eb43cf2-ba9b-447b-b372-bd320adb88b4 not yet found in contrail-api
2025-02-10 17:24:59,291 - INFO - Validated that Service ctest-nginx-svc-38778311 is seen in contrail-api
2025-02-10 17:24:59,291 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_LoadbalancerDatabaseList?x=7eb43cf2-ba9b-447b-b372-bd320adb88b4
2025-02-10 17:24:59,297 - INFO - Service ctest-nginx-svc-38778311 with uuid 7eb43cf2-ba9b-447b-b372-bd320adb88b4 found in kube manager
2025-02-10 17:24:59,298 - INFO - Service ctest-nginx-svc-38778311 verification passed
2025-02-10 17:25:00,397 - DEBUG - [Pod ctest-pod-12061999] Cmd: wget http://10.111.61.226:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-89135456
2025-02-10 17:25:00,397 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd wget http://10.111.61.226:80/ -O - -T 5 -t 1 passed
2025-02-10 17:25:00,397 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-89135456
2025-02-10 17:25:00,462 - DEBUG - [Pod ctest-pod-12061999] Cmd: wget http://10.111.61.226:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-89135456
2025-02-10 17:25:00,463 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd wget http://10.111.61.226:80/ -O - -T 5 -t 1 passed
2025-02-10 17:25:00,463 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-89135456
2025-02-10 17:25:00,519 - DEBUG - [Pod ctest-pod-12061999] Cmd: wget http://10.111.61.226:80/ -O - -T 5 -t 1 , Output: ctest-pod-46987356
Connecting to 10.111.61.226:80 (10.111.61.226:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-10 17:25:00,520 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd wget http://10.111.61.226:80/ -O - -T 5 -t 1 passed
2025-02-10 17:25:00,520 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd output: ctest-pod-46987356
Connecting to 10.111.61.226:80 (10.111.61.226:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-10 17:25:00,520 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-89135456': 2, 'ctest-pod-46987356': 1}
2025-02-10 17:25:00,580 - DEBUG - [Pod ctest-pod-59095385] Cmd: wget http://10.111.61.226:80/ -O - -T 5 -t 1 , Output: ctest-pod-89135456
Connecting to 10.111.61.226:80 (10.111.61.226:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-10 17:25:00,581 - DEBUG - [Pod Pod ctest-pod-59095385] Cmd wget http://10.111.61.226:80/ -O - -T 5 -t 1 passed
2025-02-10 17:25:00,581 - DEBUG - [Pod Pod ctest-pod-59095385] Cmd output: ctest-pod-89135456
Connecting to 10.111.61.226:80 (10.111.61.226:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-10 17:25:00,652 - DEBUG - [Pod ctest-pod-59095385] Cmd: wget http://10.111.61.226:80/ -O - -T 5 -t 1 , Output: ctest-pod-46987356
Connecting to 10.111.61.226:80 (10.111.61.226:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-10 17:25:00,652 - DEBUG - [Pod Pod ctest-pod-59095385] Cmd wget http://10.111.61.226:80/ -O - -T 5 -t 1 passed
2025-02-10 17:25:00,652 - DEBUG - [Pod Pod ctest-pod-59095385] Cmd output: ctest-pod-46987356
Connecting to 10.111.61.226:80 (10.111.61.226:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-10 17:25:00,652 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-89135456': 1, 'ctest-pod-46987356': 1}
2025-02-10 17:25:00,656 - DEBUG - Network policy ingress-on-service not present
2025-02-10 17:25:00,656 - INFO - Creating Network Policy ingress-on-service
2025-02-10 17:25:00,672 - INFO - Network policy found in k8s
2025-02-10 17:25:00,672 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=8a9f0e7c-b32b-45cc-9316-b8dd48749899
2025-02-10 17:25:00,683 - INFO - Network Policy ingress-on-service with uuid 8a9f0e7c-b32b-45cc-9316-b8dd48749899 found in kube manager
2025-02-10 17:25:00,726 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-02-10 17:25:00,726 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-02-10 17:25:00,726 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=8a9f0e7c-b32b-45cc-9316-b8dd48749899
2025-02-10 17:25:00,756 - WARNING - Network policy with name ingress-on-service not found in agent
2025-02-10 17:25:02,757 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=8a9f0e7c-b32b-45cc-9316-b8dd48749899
2025-02-10 17:25:02,790 - INFO - Network policy with name ingress-on-service found in agent
2025-02-10 17:25:02,790 - INFO - Network Policy ingress-on-service verification passed
2025-02-10 17:25:07,846 - DEBUG - [Pod ctest-pod-12061999] Cmd: wget http://10.111.61.226:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:25:07,846 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd wget http://10.111.61.226:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:25:07,846 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:25:12,909 - DEBUG - [Pod ctest-pod-12061999] Cmd: wget http://10.111.61.226:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:25:12,910 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd wget http://10.111.61.226:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:25:12,910 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:25:17,966 - DEBUG - [Pod ctest-pod-12061999] Cmd: wget http://10.111.61.226:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:25:17,967 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd wget http://10.111.61.226:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:25:17,967 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:25:23,013 - DEBUG - [Pod ctest-pod-12061999] Cmd: wget http://10.111.61.226:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:25:23,014 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd wget http://10.111.61.226:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:25:23,014 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:25:28,082 - DEBUG - [Pod ctest-pod-12061999] Cmd: wget http://10.111.61.226:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:25:28,082 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd wget http://10.111.61.226:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:25:28,082 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:25:33,132 - DEBUG - [Pod ctest-pod-12061999] Cmd: wget http://10.111.61.226:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:25:33,133 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd wget http://10.111.61.226:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:25:33,133 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:25:38,198 - DEBUG - [Pod ctest-pod-12061999] Cmd: wget http://10.111.61.226:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:25:38,199 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd wget http://10.111.61.226:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:25:38,199 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:25:43,271 - DEBUG - [Pod ctest-pod-12061999] Cmd: wget http://10.111.61.226:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:25:43,271 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd wget http://10.111.61.226:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:25:43,271 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:25:48,335 - DEBUG - [Pod ctest-pod-12061999] Cmd: wget http://10.111.61.226:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:25:48,335 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd wget http://10.111.61.226:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:25:48,335 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:25:53,402 - DEBUG - [Pod ctest-pod-12061999] Cmd: wget http://10.111.61.226:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:25:53,402 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd wget http://10.111.61.226:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:25:53,402 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:25:53,403 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-89135456': 0, 'ctest-pod-46987356': 0}
2025-02-10 17:25:53,477 - DEBUG - [Pod ctest-pod-84504513] Cmd: wget http://10.111.61.226:80/ -O - -T 5 -t 1 , Output: ctest-pod-89135456
Connecting to 10.111.61.226:80 (10.111.61.226:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-10 17:25:53,477 - DEBUG - [Pod Pod ctest-pod-84504513] Cmd wget http://10.111.61.226:80/ -O - -T 5 -t 1 passed
2025-02-10 17:25:53,478 - DEBUG - [Pod Pod ctest-pod-84504513] Cmd output: ctest-pod-89135456
Connecting to 10.111.61.226:80 (10.111.61.226:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-10 17:25:53,547 - DEBUG - [Pod ctest-pod-84504513] Cmd: wget http://10.111.61.226:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
ctest-pod-46987356
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-10 17:25:53,547 - DEBUG - [Pod Pod ctest-pod-84504513] Cmd wget http://10.111.61.226:80/ -O - -T 5 -t 1 passed
2025-02-10 17:25:53,547 - DEBUG - [Pod Pod ctest-pod-84504513] Cmd output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
ctest-pod-46987356
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-10 17:25:53,547 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-89135456': 1, 'ctest-pod-46987356': 1}
2025-02-10 17:25:58,602 - DEBUG - [Pod ctest-pod-59095385] Cmd: wget http://10.111.61.226:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:25:58,602 - DEBUG - [Pod Pod ctest-pod-59095385] Cmd wget http://10.111.61.226:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:25:58,602 - DEBUG - [Pod Pod ctest-pod-59095385] Cmd output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:26:03,661 - DEBUG - [Pod ctest-pod-59095385] Cmd: wget http://10.111.61.226:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:26:03,661 - DEBUG - [Pod Pod ctest-pod-59095385] Cmd wget http://10.111.61.226:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:26:03,661 - DEBUG - [Pod Pod ctest-pod-59095385] Cmd output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:26:08,718 - DEBUG - [Pod ctest-pod-59095385] Cmd: wget http://10.111.61.226:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:26:08,718 - DEBUG - [Pod Pod ctest-pod-59095385] Cmd wget http://10.111.61.226:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:26:08,718 - DEBUG - [Pod Pod ctest-pod-59095385] Cmd output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:26:11,566 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2025-02-10 17:26:21,947 - DEBUG - [Pod ctest-pod-59095385] Cmd: wget http://10.111.61.226:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:26:21,947 - DEBUG - [Pod Pod ctest-pod-59095385] Cmd wget http://10.111.61.226:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:26:21,948 - DEBUG - [Pod Pod ctest-pod-59095385] Cmd output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:26:26,998 - DEBUG - [Pod ctest-pod-59095385] Cmd: wget http://10.111.61.226:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:26:26,998 - DEBUG - [Pod Pod ctest-pod-59095385] Cmd wget http://10.111.61.226:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:26:26,998 - DEBUG - [Pod Pod ctest-pod-59095385] Cmd output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:26:32,070 - DEBUG - [Pod ctest-pod-59095385] Cmd: wget http://10.111.61.226:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:26:32,070 - DEBUG - [Pod Pod ctest-pod-59095385] Cmd wget http://10.111.61.226:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:26:32,070 - DEBUG - [Pod Pod ctest-pod-59095385] Cmd output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:26:37,136 - DEBUG - [Pod ctest-pod-59095385] Cmd: wget http://10.111.61.226:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:26:37,136 - DEBUG - [Pod Pod ctest-pod-59095385] Cmd wget http://10.111.61.226:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:26:37,136 - DEBUG - [Pod Pod ctest-pod-59095385] Cmd output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:26:42,212 - DEBUG - [Pod ctest-pod-59095385] Cmd: wget http://10.111.61.226:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:26:42,212 - DEBUG - [Pod Pod ctest-pod-59095385] Cmd wget http://10.111.61.226:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:26:42,212 - DEBUG - [Pod Pod ctest-pod-59095385] Cmd output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:26:47,294 - DEBUG - [Pod ctest-pod-59095385] Cmd: wget http://10.111.61.226:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:26:47,294 - DEBUG - [Pod Pod ctest-pod-59095385] Cmd wget http://10.111.61.226:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:26:47,294 - DEBUG - [Pod Pod ctest-pod-59095385] Cmd output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:26:52,368 - DEBUG - [Pod ctest-pod-59095385] Cmd: wget http://10.111.61.226:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:26:52,368 - DEBUG - [Pod Pod ctest-pod-59095385] Cmd wget http://10.111.61.226:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:26:52,368 - DEBUG - [Pod Pod ctest-pod-59095385] Cmd output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:26:52,368 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-89135456': 0, 'ctest-pod-46987356': 0}
2025-02-10 17:26:54,434 - DEBUG - [Pod ctest-pod-84504513] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.773 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.075 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.091 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.075/0.313/0.773 ms
2025-02-10 17:26:54,434 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-84504513 with expectation True passed
2025-02-10 17:26:56,486 - DEBUG - [Pod ctest-pod-12061999] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.792 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.076 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.077 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.076/0.648/1.792 ms
2025-02-10 17:26:56,486 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-12061999 with expectation True passed
2025-02-10 17:26:58,542 - DEBUG - [Pod ctest-pod-59095385] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.178 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.072 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.077 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.072/0.442/1.178 ms
2025-02-10 17:26:58,542 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-59095385 with expectation True passed
2025-02-10 17:26:58,613 - DEBUG - [Pod ctest-pod-84504513] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-10 17:26:58,613 - DEBUG - [Pod Pod ctest-pod-84504513] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-02-10 17:26:58,613 - DEBUG - [Pod Pod ctest-pod-84504513] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-10 17:26:58,613 - INFO - wget check of of http://10.47.255.251 from ctest-pod-84504513 passed
2025-02-10 17:26:58,673 - DEBUG - [Pod ctest-pod-84504513] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-10 17:26:58,673 - DEBUG - [Pod Pod ctest-pod-84504513] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-02-10 17:26:58,673 - DEBUG - [Pod Pod ctest-pod-84504513] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-10 17:26:58,673 - INFO - wget check of of http://10.47.255.250 from ctest-pod-84504513 passed
2025-02-10 17:27:03,740 - DEBUG - [Pod ctest-pod-12061999] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-02-10 17:27:03,740 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-02-10 17:27:03,740 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-02-10 17:27:03,741 - INFO - wget check of of http://10.47.255.250 from ctest-pod-12061999 passed
2025-02-10 17:27:08,788 - DEBUG - [Pod ctest-pod-34782324] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-02-10 17:27:08,788 - DEBUG - [Pod Pod ctest-pod-34782324] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-02-10 17:27:08,788 - DEBUG - [Pod Pod ctest-pod-34782324] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-02-10 17:27:08,788 - INFO - wget check of of http://10.47.255.251 from ctest-pod-34782324 passed
2025-02-10 17:27:08,797 - INFO - Updating Network Policy ingress-on-service
2025-02-10 17:27:13,853 - DEBUG - [Pod ctest-pod-12061999] Cmd: wget http://10.111.61.226:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:27:13,854 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd wget http://10.111.61.226:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:27:13,854 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:27:18,918 - DEBUG - [Pod ctest-pod-12061999] Cmd: wget http://10.111.61.226:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:27:18,918 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd wget http://10.111.61.226:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:27:18,918 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:27:23,985 - DEBUG - [Pod ctest-pod-12061999] Cmd: wget http://10.111.61.226:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:27:23,985 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd wget http://10.111.61.226:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:27:23,985 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:27:29,054 - DEBUG - [Pod ctest-pod-12061999] Cmd: wget http://10.111.61.226:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:27:29,054 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd wget http://10.111.61.226:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:27:29,054 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:27:34,122 - DEBUG - [Pod ctest-pod-12061999] Cmd: wget http://10.111.61.226:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:27:34,122 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd wget http://10.111.61.226:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:27:34,122 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:27:39,194 - DEBUG - [Pod ctest-pod-12061999] Cmd: wget http://10.111.61.226:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:27:39,194 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd wget http://10.111.61.226:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:27:39,194 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:27:44,254 - DEBUG - [Pod ctest-pod-12061999] Cmd: wget http://10.111.61.226:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:27:44,254 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd wget http://10.111.61.226:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:27:44,254 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:27:49,307 - DEBUG - [Pod ctest-pod-12061999] Cmd: wget http://10.111.61.226:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:27:49,307 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd wget http://10.111.61.226:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:27:49,307 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:27:54,382 - DEBUG - [Pod ctest-pod-12061999] Cmd: wget http://10.111.61.226:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:27:54,382 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd wget http://10.111.61.226:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:27:54,383 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:27:59,450 - DEBUG - [Pod ctest-pod-12061999] Cmd: wget http://10.111.61.226:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:27:59,450 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd wget http://10.111.61.226:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:27:59,450 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
wget: download timed out
2025-02-10 17:27:59,450 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-89135456': 0, 'ctest-pod-46987356': 0}
2025-02-10 17:27:59,526 - DEBUG - [Pod ctest-pod-84504513] Cmd: wget http://10.111.61.226:80/ -O - -T 5 -t 1 , Output: ctest-pod-89135456
Connecting to 10.111.61.226:80 (10.111.61.226:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-10 17:27:59,527 - DEBUG - [Pod Pod ctest-pod-84504513] Cmd wget http://10.111.61.226:80/ -O - -T 5 -t 1 passed
2025-02-10 17:27:59,527 - DEBUG - [Pod Pod ctest-pod-84504513] Cmd output: ctest-pod-89135456
Connecting to 10.111.61.226:80 (10.111.61.226:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-10 17:27:59,595 - DEBUG - [Pod ctest-pod-84504513] Cmd: wget http://10.111.61.226:80/ -O - -T 5 -t 1 , Output: ctest-pod-89135456
Connecting to 10.111.61.226:80 (10.111.61.226:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-10 17:27:59,595 - DEBUG - [Pod Pod ctest-pod-84504513] Cmd wget http://10.111.61.226:80/ -O - -T 5 -t 1 passed
2025-02-10 17:27:59,595 - DEBUG - [Pod Pod ctest-pod-84504513] Cmd output: ctest-pod-89135456
Connecting to 10.111.61.226:80 (10.111.61.226:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-10 17:27:59,675 - DEBUG - [Pod ctest-pod-84504513] Cmd: wget http://10.111.61.226:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
ctest-pod-89135456
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-10 17:27:59,675 - DEBUG - [Pod Pod ctest-pod-84504513] Cmd wget http://10.111.61.226:80/ -O - -T 5 -t 1 passed
2025-02-10 17:27:59,675 - DEBUG - [Pod Pod ctest-pod-84504513] Cmd output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
ctest-pod-89135456
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-10 17:27:59,743 - DEBUG - [Pod ctest-pod-84504513] Cmd: wget http://10.111.61.226:80/ -O - -T 5 -t 1 , Output: ctest-pod-89135456
Connecting to 10.111.61.226:80 (10.111.61.226:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-10 17:27:59,743 - DEBUG - [Pod Pod ctest-pod-84504513] Cmd wget http://10.111.61.226:80/ -O - -T 5 -t 1 passed
2025-02-10 17:27:59,743 - DEBUG - [Pod Pod ctest-pod-84504513] Cmd output: ctest-pod-89135456
Connecting to 10.111.61.226:80 (10.111.61.226:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-10 17:27:59,805 - DEBUG - [Pod ctest-pod-84504513] Cmd: wget http://10.111.61.226:80/ -O - -T 5 -t 1 , Output: ctest-pod-46987356
Connecting to 10.111.61.226:80 (10.111.61.226:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-10 17:27:59,806 - DEBUG - [Pod Pod ctest-pod-84504513] Cmd wget http://10.111.61.226:80/ -O - -T 5 -t 1 passed
2025-02-10 17:27:59,806 - DEBUG - [Pod Pod ctest-pod-84504513] Cmd output: ctest-pod-46987356
Connecting to 10.111.61.226:80 (10.111.61.226:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-02-10 17:27:59,806 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-89135456': 4, 'ctest-pod-46987356': 1}
2025-02-10 17:27:59,879 - DEBUG - [Pod ctest-pod-59095385] Cmd: wget http://10.111.61.226:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-46987356
2025-02-10 17:27:59,879 - DEBUG - [Pod Pod ctest-pod-59095385] Cmd wget http://10.111.61.226:80/ -O - -T 5 -t 1 passed
2025-02-10 17:27:59,879 - DEBUG - [Pod Pod ctest-pod-59095385] Cmd output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-46987356
2025-02-10 17:27:59,931 - DEBUG - [Pod ctest-pod-59095385] Cmd: wget http://10.111.61.226:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-89135456
2025-02-10 17:27:59,931 - DEBUG - [Pod Pod ctest-pod-59095385] Cmd wget http://10.111.61.226:80/ -O - -T 5 -t 1 passed
2025-02-10 17:27:59,931 - DEBUG - [Pod Pod ctest-pod-59095385] Cmd output: Connecting to 10.111.61.226:80 (10.111.61.226:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-89135456
2025-02-10 17:27:59,931 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-89135456': 1, 'ctest-pod-46987356': 1}
2025-02-10 17:28:01,989 - DEBUG - [Pod ctest-pod-84504513] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.104 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.075 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.077 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.075/0.418/1.104 ms
2025-02-10 17:28:01,989 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-84504513 with expectation True passed
2025-02-10 17:28:04,063 - DEBUG - [Pod ctest-pod-12061999] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.528 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.072 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.075 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.072/0.225/0.528 ms
2025-02-10 17:28:04,063 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-12061999 with expectation True passed
2025-02-10 17:28:06,118 - DEBUG - [Pod ctest-pod-59095385] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.112 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.066 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.092 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.066/0.423/1.112 ms
2025-02-10 17:28:06,118 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-59095385 with expectation True passed
2025-02-10 17:28:06,174 - DEBUG - [Pod ctest-pod-84504513] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-10 17:28:06,174 - DEBUG - [Pod Pod ctest-pod-84504513] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-02-10 17:28:06,174 - DEBUG - [Pod Pod ctest-pod-84504513] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-10 17:28:06,174 - INFO - wget check of of http://10.47.255.251 from ctest-pod-84504513 passed
2025-02-10 17:28:06,243 - DEBUG - [Pod ctest-pod-84504513] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-10 17:28:06,243 - DEBUG - [Pod Pod ctest-pod-84504513] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-02-10 17:28:06,243 - DEBUG - [Pod Pod ctest-pod-84504513] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-10 17:28:06,243 - INFO - wget check of of http://10.47.255.250 from ctest-pod-84504513 passed
2025-02-10 17:28:11,306 - DEBUG - [Pod ctest-pod-12061999] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-02-10 17:28:11,306 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-02-10 17:28:11,307 - DEBUG - [Pod Pod ctest-pod-12061999] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-02-10 17:28:11,307 - INFO - wget check of of http://10.47.255.250 from ctest-pod-12061999 passed
2025-02-10 17:28:11,372 - DEBUG - [Pod ctest-pod-34782324] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-10 17:28:11,372 - DEBUG - [Pod Pod ctest-pod-34782324] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-02-10 17:28:11,372 - DEBUG - [Pod Pod ctest-pod-34782324] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-02-10 17:28:11,372 - INFO - wget check of of http://10.47.255.251 from ctest-pod-34782324 passed
2025-02-10 17:28:11,373 - INFO - Deleting Network Policy : ingress-on-service
2025-02-10 17:28:11,373 - INFO - Deleting service : ctest-nginx-svc-38778311
2025-02-10 17:28:11,609 - DEBUG - No XMPP flaps were noticed during the test
2025-02-10 17:28:11,609 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:14]
2025-02-10 17:28:11,609 - INFO - --------------------------------------------------------------------------------
2025-02-10 17:28:11,616 - INFO - Deleting pod ctest-new-default-52540862:ctest-pod-89135456
2025-02-10 17:28:11,617 - INFO - Deleting pod ctest-new-default-52540862:ctest-pod-46987356
2025-02-10 17:28:11,618 - INFO - Deleting pod ctest-non-default-55835878:ctest-pod-79458694
2025-02-10 17:28:11,618 - INFO - Deleting pod ctest-non-default-55835878:ctest-pod-37564693
2025-02-10 17:28:11,619 - INFO - Deleting pod ctest-new-default-52540862:ctest-pod-12061999
2025-02-10 17:28:11,619 - INFO - Deleting pod ctest-new-default-52540862:ctest-pod-84504513
2025-02-10 17:28:11,620 - INFO - Deleting pod ctest-non-default-55835878:ctest-pod-59095385
2025-02-10 17:28:11,620 - INFO - Deleting pod ctest-non-default-55835878:ctest-pod-34782324
2025-02-10 17:28:11,660 - WARNING - Pod uuid 07ed440b-c6dc-47ca-bdd4-63deaa00612b is still seen in agent 10.0.0.44 VM list
2025-02-10 17:28:11,738 - WARNING - Pod uuid 5a9bb2ef-0eff-499e-961c-c673ec039454 is still seen in agent 10.0.0.44 VM list
2025-02-10 17:28:11,806 - WARNING - Pod uuid 691e012b-ed15-4279-a7ab-042e024df110 is still seen in agent 10.0.0.44 VM list
2025-02-10 17:28:11,808 - WARNING - Pod uuid 9e46784a-b224-4cfc-bf83-cabcd60cef32 is still seen in agent 10.0.0.44 VM list
2025-02-10 17:28:11,810 - WARNING - Pod uuid 59bed2db-dbb3-4e14-9a1a-8ba859da2760 is still seen in agent 10.0.0.44 VM list
2025-02-10 17:28:11,811 - WARNING - Pod uuid cf98f913-2120-49b0-aa63-5b9321e50a18 is still seen in agent 10.0.0.44 VM list
2025-02-10 17:28:11,812 - WARNING - Pod uuid 506c038a-705b-4c59-9e8c-4c8ffed7c778 is still seen in agent 10.0.0.44 VM list
2025-02-10 17:28:11,813 - WARNING - Pod uuid c116bcb8-8656-4c9a-a28d-5d4c5f8e4981 is still seen in agent 10.0.0.44 VM list
2025-02-10 17:28:16,668 - DEBUG - Pod 07ed440b-c6dc-47ca-bdd4-63deaa00612b is not in agent 10.0.0.44 VM list
2025-02-10 17:28:16,674 - DEBUG - VMI e79458a6-e7d3-11ef-b0d5-fa163e44080b is removed from agent 10.0.0.44
2025-02-10 17:28:16,674 - INFO - Verified that pod ctest-pod-89135456 is removed in agent
2025-02-10 17:28:16,748 - WARNING - Pod uuid 5a9bb2ef-0eff-499e-961c-c673ec039454 is still seen in agent 10.0.0.44 VM list
2025-02-10 17:28:16,845 - DEBUG - Pod 691e012b-ed15-4279-a7ab-042e024df110 is not in agent 10.0.0.44 VM list
2025-02-10 17:28:16,848 - WARNING - Pod uuid 506c038a-705b-4c59-9e8c-4c8ffed7c778 is still seen in agent 10.0.0.44 VM list
2025-02-10 17:28:16,849 - WARNING - Pod uuid 9e46784a-b224-4cfc-bf83-cabcd60cef32 is still seen in agent 10.0.0.44 VM list
2025-02-10 17:28:16,853 - DEBUG - Pod c116bcb8-8656-4c9a-a28d-5d4c5f8e4981 is not in agent 10.0.0.44 VM list
2025-02-10 17:28:16,856 - WARNING - Pod uuid cf98f913-2120-49b0-aa63-5b9321e50a18 is still seen in agent 10.0.0.44 VM list
2025-02-10 17:28:16,856 - WARNING - Pod uuid 59bed2db-dbb3-4e14-9a1a-8ba859da2760 is still seen in agent 10.0.0.44 VM list
2025-02-10 17:28:16,868 - DEBUG - VMI e953d39c-e7d3-11ef-b0d5-fa163e44080b is removed from agent 10.0.0.44
2025-02-10 17:28:16,868 - INFO - Verified that pod ctest-pod-37564693 is removed in agent
2025-02-10 17:28:16,871 - DEBUG - VMI e8c8c3d8-e7d3-11ef-b0d5-fa163e44080b is removed from agent 10.0.0.44
2025-02-10 17:28:16,871 - INFO - Verified that pod ctest-pod-79458694 is removed in agent
2025-02-10 17:28:21,757 - WARNING - Pod uuid 5a9bb2ef-0eff-499e-961c-c673ec039454 is still seen in agent 10.0.0.44 VM list
2025-02-10 17:28:21,862 - WARNING - Pod uuid 506c038a-705b-4c59-9e8c-4c8ffed7c778 is still seen in agent 10.0.0.44 VM list
2025-02-10 17:28:21,862 - WARNING - Pod uuid 9e46784a-b224-4cfc-bf83-cabcd60cef32 is still seen in agent 10.0.0.44 VM list
2025-02-10 17:28:21,870 - WARNING - Pod uuid cf98f913-2120-49b0-aa63-5b9321e50a18 is still seen in agent 10.0.0.44 VM list
2025-02-10 17:28:21,871 - WARNING - Pod uuid 59bed2db-dbb3-4e14-9a1a-8ba859da2760 is still seen in agent 10.0.0.44 VM list
2025-02-10 17:28:26,766 - WARNING - Pod uuid 5a9bb2ef-0eff-499e-961c-c673ec039454 is still seen in agent 10.0.0.44 VM list
2025-02-10 17:28:26,876 - WARNING - Pod uuid 9e46784a-b224-4cfc-bf83-cabcd60cef32 is still seen in agent 10.0.0.44 VM list
2025-02-10 17:28:26,877 - WARNING - Pod uuid 506c038a-705b-4c59-9e8c-4c8ffed7c778 is still seen in agent 10.0.0.44 VM list
2025-02-10 17:28:26,884 - WARNING - Pod uuid 59bed2db-dbb3-4e14-9a1a-8ba859da2760 is still seen in agent 10.0.0.44 VM list
2025-02-10 17:28:26,886 - WARNING - Pod uuid cf98f913-2120-49b0-aa63-5b9321e50a18 is still seen in agent 10.0.0.44 VM list
2025-02-10 17:28:31,776 - WARNING - Pod uuid 5a9bb2ef-0eff-499e-961c-c673ec039454 is still seen in agent 10.0.0.44 VM list
2025-02-10 17:28:31,890 - WARNING - Pod uuid 9e46784a-b224-4cfc-bf83-cabcd60cef32 is still seen in agent 10.0.0.44 VM list
2025-02-10 17:28:31,890 - WARNING - Pod uuid 506c038a-705b-4c59-9e8c-4c8ffed7c778 is still seen in agent 10.0.0.44 VM list
2025-02-10 17:28:31,897 - WARNING - Pod uuid 59bed2db-dbb3-4e14-9a1a-8ba859da2760 is still seen in agent 10.0.0.44 VM list
2025-02-10 17:28:31,898 - WARNING - Pod uuid cf98f913-2120-49b0-aa63-5b9321e50a18 is still seen in agent 10.0.0.44 VM list
2025-02-10 17:28:36,785 - WARNING - Pod uuid 5a9bb2ef-0eff-499e-961c-c673ec039454 is still seen in agent 10.0.0.44 VM list
2025-02-10 17:28:36,905 - WARNING - Pod uuid 9e46784a-b224-4cfc-bf83-cabcd60cef32 is still seen in agent 10.0.0.44 VM list
2025-02-10 17:28:36,905 - WARNING - Pod uuid 506c038a-705b-4c59-9e8c-4c8ffed7c778 is still seen in agent 10.0.0.44 VM list
2025-02-10 17:28:36,912 - WARNING - Pod uuid cf98f913-2120-49b0-aa63-5b9321e50a18 is still seen in agent 10.0.0.44 VM list
2025-02-10 17:28:36,913 - WARNING - Pod uuid 59bed2db-dbb3-4e14-9a1a-8ba859da2760 is still seen in agent 10.0.0.44 VM list
2025-02-10 17:28:41,799 - WARNING - Pod uuid 5a9bb2ef-0eff-499e-961c-c673ec039454 is still seen in agent 10.0.0.44 VM list
2025-02-10 17:28:41,939 - WARNING - Pod uuid 9e46784a-b224-4cfc-bf83-cabcd60cef32 is still seen in agent 10.0.0.44 VM list
2025-02-10 17:28:41,939 - WARNING - Pod uuid cf98f913-2120-49b0-aa63-5b9321e50a18 is still seen in agent 10.0.0.44 VM list
2025-02-10 17:28:41,941 - WARNING - Pod uuid 59bed2db-dbb3-4e14-9a1a-8ba859da2760 is still seen in agent 10.0.0.44 VM list
2025-02-10 17:28:41,942 - WARNING - Pod uuid 506c038a-705b-4c59-9e8c-4c8ffed7c778 is still seen in agent 10.0.0.44 VM list
2025-02-10 17:28:46,807 - DEBUG - Pod 5a9bb2ef-0eff-499e-961c-c673ec039454 is not in agent 10.0.0.44 VM list
2025-02-10 17:28:46,814 - DEBUG - VMI ea6a653e-e7d3-11ef-b0d5-fa163e44080b is removed from agent 10.0.0.44
2025-02-10 17:28:46,814 - INFO - Verified that pod ctest-pod-84504513 is removed in agent
2025-02-10 17:28:46,959 - DEBUG - Pod 506c038a-705b-4c59-9e8c-4c8ffed7c778 is not in agent 10.0.0.44 VM list
2025-02-10 17:28:46,960 - DEBUG - Pod cf98f913-2120-49b0-aa63-5b9321e50a18 is not in agent 10.0.0.44 VM list
2025-02-10 17:28:46,962 - DEBUG - Pod 9e46784a-b224-4cfc-bf83-cabcd60cef32 is not in agent 10.0.0.44 VM list
2025-02-10 17:28:46,965 - DEBUG - Pod 59bed2db-dbb3-4e14-9a1a-8ba859da2760 is not in agent 10.0.0.44 VM list
2025-02-10 17:28:46,979 - DEBUG - VMI e822cbae-e7d3-11ef-b0d5-fa163e44080b is removed from agent 10.0.0.44
2025-02-10 17:28:46,979 - INFO - Verified that pod ctest-pod-46987356 is removed in agent
2025-02-10 17:28:46,980 - DEBUG - VMI eb70a984-e7d3-11ef-b0d5-fa163e44080b is removed from agent 10.0.0.44
2025-02-10 17:28:46,980 - INFO - Verified that pod ctest-pod-34782324 is removed in agent
2025-02-10 17:28:46,982 - DEBUG - VMI eaee56e6-e7d3-11ef-b0d5-fa163e44080b is removed from agent 10.0.0.44
2025-02-10 17:28:46,982 - INFO - Verified that pod ctest-pod-59095385 is removed in agent
2025-02-10 17:28:46,983 - DEBUG - VMI e9ec7db8-e7d3-11ef-b0d5-fa163e44080b is removed from agent 10.0.0.44
2025-02-10 17:28:46,983 - INFO - Verified that pod ctest-pod-12061999 is removed in agent
2025-02-10 17:28:46,983 - INFO - Deleting namespace ctest-non-default-55835878
2025-02-10 17:28:47,007 - DEBUG - Namespace ctest-non-default-55835878 still in k8s
2025-02-10 17:28:49,014 - DEBUG - Namespace ctest-non-default-55835878 still in k8s
2025-02-10 17:28:51,020 - DEBUG - Namespace ctest-non-default-55835878 still in k8s
2025-02-10 17:28:53,024 - DEBUG - Namespace ctest-non-default-55835878 is not in k8s
2025-02-10 17:28:53,024 - DEBUG - No need to check project deletion in contrail-api
2025-02-10 17:28:53,024 - INFO - Deleting namespace ctest-new-default-52540862
2025-02-10 17:28:53,033 - DEBUG - Namespace ctest-new-default-52540862 still in k8s
2025-02-10 17:28:55,038 - DEBUG - Namespace ctest-new-default-52540862 still in k8s
2025-02-10 17:28:57,043 - DEBUG - Namespace ctest-new-default-52540862 still in k8s
2025-02-10 17:28:59,047 - DEBUG - Namespace ctest-new-default-52540862 is not in k8s
2025-02-10 17:28:59,047 - DEBUG - No need to check project deletion in contrail-api