2025-03-24 16:20:04,120 - INFO - Using existing project ['default-domain', 'k8s-default'](d91f0e1a-6ef6-481d-ae23-a26736d19adf)
2025-03-24 16:20:04,145 - DEBUG - Namespace ctest-new-default-38696221 not present
2025-03-24 16:20:04,164 - INFO - Created namespace ctest-new-default-38696221
2025-03-24 16:20:07,171 - DEBUG - Namespace ctest-non-default-99121047 not present
2025-03-24 16:20:07,182 - INFO - Created namespace ctest-non-default-99121047
2025-03-24 16:20:10,205 - DEBUG - Pod ctest-pod-60292694 not present
2025-03-24 16:20:10,205 - INFO - Creating Pod ctest-pod-60292694
2025-03-24 16:20:10,242 - DEBUG - Pod : ctest-pod-60292694 UUID is 251a3513-4fe5-4986-b0e4-81fe62c8f108
2025-03-24 16:20:10,246 - DEBUG - Pod ctest-pod-90407895 not present
2025-03-24 16:20:10,246 - INFO - Creating Pod ctest-pod-90407895
2025-03-24 16:20:10,295 - DEBUG - Pod : ctest-pod-90407895 UUID is 6d516462-6e9c-4f26-bb77-00427502a43c
2025-03-24 16:20:10,299 - DEBUG - Pod ctest-pod-01325696 not present
2025-03-24 16:20:10,299 - INFO - Creating Pod ctest-pod-01325696
2025-03-24 16:20:10,354 - DEBUG - Pod : ctest-pod-01325696 UUID is 536f7879-e155-4bba-a460-40def3f78a51
2025-03-24 16:20:10,358 - DEBUG - Pod ctest-pod-34644068 not present
2025-03-24 16:20:10,358 - INFO - Creating Pod ctest-pod-34644068
2025-03-24 16:20:10,389 - DEBUG - Pod : ctest-pod-34644068 UUID is 38273d70-6c92-4e23-8dd4-75429e345494
2025-03-24 16:20:10,393 - DEBUG - Pod ctest-pod-64884415 not present
2025-03-24 16:20:10,393 - INFO - Creating Pod ctest-pod-64884415
2025-03-24 16:20:10,420 - DEBUG - Pod : ctest-pod-64884415 UUID is 1b71b83e-f244-4c27-92b4-79201e4b4e4e
2025-03-24 16:20:10,423 - DEBUG - Pod ctest-pod-68965387 not present
2025-03-24 16:20:10,423 - INFO - Creating Pod ctest-pod-68965387
2025-03-24 16:20:10,452 - DEBUG - Pod : ctest-pod-68965387 UUID is 39dcf4b2-4fab-4e6c-a59d-b32c20bdac7e
2025-03-24 16:20:10,461 - DEBUG - Pod ctest-pod-08078433 not present
2025-03-24 16:20:10,462 - INFO - Creating Pod ctest-pod-08078433
2025-03-24 16:20:10,524 - DEBUG - Pod : ctest-pod-08078433 UUID is ed68d5e5-2db6-47d1-a2a7-1e2b61a3a695
2025-03-24 16:20:10,536 - DEBUG - Pod ctest-pod-50962320 not present
2025-03-24 16:20:10,537 - INFO - Creating Pod ctest-pod-50962320
2025-03-24 16:20:10,569 - DEBUG - Pod : ctest-pod-50962320 UUID is d21c220d-b422-45b0-87dc-2b9d09b5cf87
2025-03-24 16:20:10,843 - INFO - Project default-domain:k8s-ctest-new-default-38696221 for Namespace ctest-new-default-38696221 is seen in contrail-api
2025-03-24 16:20:10,843 - DEBUG - Project uuid in Contrail is 3cfa3c52-a7dd-4d9c-bf0f-2bcb4ae7c85a
2025-03-24 16:20:11,010 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_NamespaceDatabaseList?namespace_uuid=665ee17c-c8d9-44f2-ab7e-d039acdb1179
2025-03-24 16:20:11,018 - INFO - Namespace ctest-new-default-38696221 with uuid 665ee17c-c8d9-44f2-ab7e-d039acdb1179 found in kube manager
2025-03-24 16:20:11,018 - INFO - Namespace ctest-new-default-38696221 verification passed
2025-03-24 16:20:11,298 - INFO - Project default-domain:k8s-ctest-non-default-99121047 for Namespace ctest-non-default-99121047 is seen in contrail-api
2025-03-24 16:20:11,298 - DEBUG - Project uuid in Contrail is 86231288-f77d-4a93-ad03-bd2629796bcb
2025-03-24 16:20:11,299 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_NamespaceDatabaseList?namespace_uuid=5517b5a0-1c47-4640-bb30-461219fd9a80
2025-03-24 16:20:11,303 - INFO - Namespace ctest-non-default-99121047 with uuid 5517b5a0-1c47-4640-bb30-461219fd9a80 found in kube manager
2025-03-24 16:20:11,303 - INFO - Namespace ctest-non-default-99121047 verification passed
2025-03-24 16:20:11,309 - DEBUG - Pod ctest-pod-60292694 not in running state.Currently in Pending
2025-03-24 16:20:16,317 - DEBUG - Pod ctest-pod-60292694 not in running state.Currently in Pending
2025-03-24 16:20:21,324 - DEBUG - Pod ctest-pod-60292694 not in running state.Currently in Pending
2025-03-24 16:20:26,332 - INFO - Pod ctest-pod-60292694 is in running state.Got IP 10.47.255.251
2025-03-24 16:20:26,349 - DEBUG - Pod ctest-pod-60292694 has vmi dcc492ec-08cb-11f0-8be3-fa163e6d2c22
2025-03-24 16:20:26,349 - INFO - Verified pod ctest-pod-60292694 in contrail-api
2025-03-24 16:20:26,367 - DEBUG - VMI dcc492ec-08cb-11f0-8be3-fa163e6d2c22 is active in agent 10.0.0.47
2025-03-24 16:20:26,368 - INFO - Verified Pod ctest-pod-60292694 in agent 10.0.0.47
2025-03-24 16:20:26,368 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=251a3513-4fe5-4986-b0e4-81fe62c8f108
2025-03-24 16:20:26,375 - INFO - Pod ctest-pod-60292694 with uuid 251a3513-4fe5-4986-b0e4-81fe62c8f108 found in kube manager
2025-03-24 16:20:26,376 - INFO - Pod ctest-pod-60292694 verification passed
2025-03-24 16:20:26,382 - INFO - Pod ctest-pod-90407895 is in running state.Got IP 10.47.255.250
2025-03-24 16:20:26,447 - DEBUG - Pod ctest-pod-90407895 has vmi dd61c7f6-08cb-11f0-8be3-fa163e6d2c22
2025-03-24 16:20:26,447 - INFO - Verified pod ctest-pod-90407895 in contrail-api
2025-03-24 16:20:26,464 - DEBUG - VMI dd61c7f6-08cb-11f0-8be3-fa163e6d2c22 is active in agent 10.0.0.47
2025-03-24 16:20:26,464 - INFO - Verified Pod ctest-pod-90407895 in agent 10.0.0.47
2025-03-24 16:20:26,465 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=6d516462-6e9c-4f26-bb77-00427502a43c
2025-03-24 16:20:26,471 - INFO - Pod ctest-pod-90407895 with uuid 6d516462-6e9c-4f26-bb77-00427502a43c found in kube manager
2025-03-24 16:20:26,471 - INFO - Pod ctest-pod-90407895 verification passed
2025-03-24 16:20:26,478 - INFO - Pod ctest-pod-01325696 is in running state.Got IP 10.47.255.249
2025-03-24 16:20:26,498 - DEBUG - Pod ctest-pod-01325696 has vmi de1e0024-08cb-11f0-8be3-fa163e6d2c22
2025-03-24 16:20:26,498 - INFO - Verified pod ctest-pod-01325696 in contrail-api
2025-03-24 16:20:26,514 - DEBUG - VMI de1e0024-08cb-11f0-8be3-fa163e6d2c22 is active in agent 10.0.0.47
2025-03-24 16:20:26,515 - INFO - Verified Pod ctest-pod-01325696 in agent 10.0.0.47
2025-03-24 16:20:26,515 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=536f7879-e155-4bba-a460-40def3f78a51
2025-03-24 16:20:26,521 - INFO - Pod ctest-pod-01325696 with uuid 536f7879-e155-4bba-a460-40def3f78a51 found in kube manager
2025-03-24 16:20:26,521 - INFO - Pod ctest-pod-01325696 verification passed
2025-03-24 16:20:26,530 - INFO - Pod ctest-pod-34644068 is in running state.Got IP 10.47.255.248
2025-03-24 16:20:26,592 - DEBUG - Pod ctest-pod-34644068 has vmi deae1844-08cb-11f0-8be3-fa163e6d2c22
2025-03-24 16:20:26,593 - INFO - Verified pod ctest-pod-34644068 in contrail-api
2025-03-24 16:20:26,614 - DEBUG - VMI deae1844-08cb-11f0-8be3-fa163e6d2c22 is active in agent 10.0.0.47
2025-03-24 16:20:26,614 - INFO - Verified Pod ctest-pod-34644068 in agent 10.0.0.47
2025-03-24 16:20:26,615 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=38273d70-6c92-4e23-8dd4-75429e345494
2025-03-24 16:20:26,620 - INFO - Pod ctest-pod-34644068 with uuid 38273d70-6c92-4e23-8dd4-75429e345494 found in kube manager
2025-03-24 16:20:26,620 - INFO - Pod ctest-pod-34644068 verification passed
2025-03-24 16:20:26,626 - INFO - Pod ctest-pod-64884415 is in running state.Got IP 10.47.255.247
2025-03-24 16:20:26,687 - DEBUG - Pod ctest-pod-64884415 has vmi df49eefe-08cb-11f0-8be3-fa163e6d2c22
2025-03-24 16:20:26,687 - INFO - Verified pod ctest-pod-64884415 in contrail-api
2025-03-24 16:20:26,704 - DEBUG - VMI df49eefe-08cb-11f0-8be3-fa163e6d2c22 is active in agent 10.0.0.47
2025-03-24 16:20:26,705 - INFO - Verified Pod ctest-pod-64884415 in agent 10.0.0.47
2025-03-24 16:20:26,705 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=1b71b83e-f244-4c27-92b4-79201e4b4e4e
2025-03-24 16:20:26,713 - INFO - Pod ctest-pod-64884415 with uuid 1b71b83e-f244-4c27-92b4-79201e4b4e4e found in kube manager
2025-03-24 16:20:26,713 - INFO - Pod ctest-pod-64884415 verification passed
2025-03-24 16:20:26,721 - INFO - Pod ctest-pod-08078433 is in running state.Got IP 10.47.255.245
2025-03-24 16:20:26,752 - DEBUG - Pod ctest-pod-08078433 has vmi e06a82f8-08cb-11f0-8be3-fa163e6d2c22
2025-03-24 16:20:26,753 - INFO - Verified pod ctest-pod-08078433 in contrail-api
2025-03-24 16:20:26,772 - DEBUG - VMI e06a82f8-08cb-11f0-8be3-fa163e6d2c22 is active in agent 10.0.0.47
2025-03-24 16:20:26,773 - INFO - Verified Pod ctest-pod-08078433 in agent 10.0.0.47
2025-03-24 16:20:26,779 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=ed68d5e5-2db6-47d1-a2a7-1e2b61a3a695
2025-03-24 16:20:26,786 - INFO - Pod ctest-pod-08078433 with uuid ed68d5e5-2db6-47d1-a2a7-1e2b61a3a695 found in kube manager
2025-03-24 16:20:26,786 - INFO - Pod ctest-pod-08078433 verification passed
2025-03-24 16:20:26,891 - INFO - Pod ctest-pod-68965387 is in running state.Got IP 10.47.255.246
2025-03-24 16:20:26,959 - DEBUG - Pod ctest-pod-68965387 has vmi dfddc052-08cb-11f0-8be3-fa163e6d2c22
2025-03-24 16:20:26,959 - INFO - Verified pod ctest-pod-68965387 in contrail-api
2025-03-24 16:20:26,983 - DEBUG - VMI dfddc052-08cb-11f0-8be3-fa163e6d2c22 is active in agent 10.0.0.47
2025-03-24 16:20:26,984 - INFO - Verified Pod ctest-pod-68965387 in agent 10.0.0.47
2025-03-24 16:20:26,984 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=39dcf4b2-4fab-4e6c-a59d-b32c20bdac7e
2025-03-24 16:20:26,994 - INFO - Pod ctest-pod-68965387 with uuid 39dcf4b2-4fab-4e6c-a59d-b32c20bdac7e found in kube manager
2025-03-24 16:20:26,994 - INFO - Pod ctest-pod-68965387 verification passed
2025-03-24 16:20:27,015 - INFO - Pod ctest-pod-50962320 is in running state.Got IP 10.47.255.244
2025-03-24 16:20:27,041 - DEBUG - Pod ctest-pod-50962320 has vmi e0f85420-08cb-11f0-8be3-fa163e6d2c22
2025-03-24 16:20:27,041 - INFO - Verified pod ctest-pod-50962320 in contrail-api
2025-03-24 16:20:27,060 - DEBUG - VMI e0f85420-08cb-11f0-8be3-fa163e6d2c22 is active in agent 10.0.0.47
2025-03-24 16:20:27,060 - INFO - Verified Pod ctest-pod-50962320 in agent 10.0.0.47
2025-03-24 16:20:27,060 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_VirtualMachineDatabaseList?x=d21c220d-b422-45b0-87dc-2b9d09b5cf87
2025-03-24 16:20:27,072 - INFO - Pod ctest-pod-50962320 with uuid d21c220d-b422-45b0-87dc-2b9d09b5cf87 found in kube manager
2025-03-24 16:20:27,072 - INFO - Pod ctest-pod-50962320 verification passed
2025-03-24 16:20:27,074 - INFO - ================================================================================
2025-03-24 16:20:27,074 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-03-24 16:20:27,074 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-03-24 16:20:27,328 - DEBUG - Nothing to compare xmpp stats {'10.0.0.47': {'10.0.0.29': '0'}} with
2025-03-24 16:20:27,328 - INFO - Initial checks done. Running the testcase now
2025-03-24 16:20:27,328 - INFO -
2025-03-24 16:20:27,402 - DEBUG - [Pod ctest-pod-60292694] Cmd: echo ctest-pod-60292694 > /usr/share/nginx/html/index.html, Output:
2025-03-24 16:20:27,463 - DEBUG - [Pod ctest-pod-90407895] Cmd: echo ctest-pod-90407895 > /usr/share/nginx/html/index.html, Output:
2025-03-24 16:20:27,537 - DEBUG - [Pod ctest-pod-01325696] Cmd: echo ctest-pod-01325696 > /usr/share/nginx/html/index.html, Output:
2025-03-24 16:20:27,606 - DEBUG - [Pod ctest-pod-34644068] Cmd: echo ctest-pod-34644068 > /usr/share/nginx/html/index.html, Output:
2025-03-24 16:20:27,614 - DEBUG - Service ctest-nginx-svc-34667334 not present
2025-03-24 16:20:27,614 - INFO - Creating service ctest-nginx-svc-34667334
2025-03-24 16:20:27,647 - INFO - Created Service ctest-nginx-svc-34667334
2025-03-24 16:20:27,661 - WARNING - Service UUID 23fbab4e-608e-4dc7-b66a-e08757c7abf6 not yet found in contrail-api
2025-03-24 16:20:28,683 - INFO - Validated that Service ctest-nginx-svc-34667334 is seen in contrail-api
2025-03-24 16:20:28,683 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_LoadbalancerDatabaseList?x=23fbab4e-608e-4dc7-b66a-e08757c7abf6
2025-03-24 16:20:28,702 - INFO - Service ctest-nginx-svc-34667334 with uuid 23fbab4e-608e-4dc7-b66a-e08757c7abf6 found in kube manager
2025-03-24 16:20:28,702 - INFO - Service ctest-nginx-svc-34667334 verification passed
2025-03-24 16:20:29,809 - DEBUG - [Pod ctest-pod-64884415] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-60292694
2025-03-24 16:20:29,809 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 passed
2025-03-24 16:20:29,809 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-60292694
2025-03-24 16:20:30,157 - DEBUG - [Pod ctest-pod-64884415] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: ctest-pod-60292694
Connecting to 10.103.231.119:80 (10.103.231.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-24 16:20:30,157 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 passed
2025-03-24 16:20:30,157 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd output: ctest-pod-60292694
Connecting to 10.103.231.119:80 (10.103.231.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-24 16:20:30,220 - DEBUG - [Pod ctest-pod-64884415] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: ctest-pod-60292694
Connecting to 10.103.231.119:80 (10.103.231.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-24 16:20:30,220 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 passed
2025-03-24 16:20:30,220 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd output: ctest-pod-60292694
Connecting to 10.103.231.119:80 (10.103.231.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-24 16:20:30,281 - DEBUG - [Pod ctest-pod-64884415] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: ctest-pod-60292694
Connecting to 10.103.231.119:80 (10.103.231.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-24 16:20:30,282 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 passed
2025-03-24 16:20:30,282 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd output: ctest-pod-60292694
Connecting to 10.103.231.119:80 (10.103.231.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-24 16:20:30,346 - DEBUG - [Pod ctest-pod-64884415] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: ctest-pod-90407895
Connecting to 10.103.231.119:80 (10.103.231.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-24 16:20:30,346 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 passed
2025-03-24 16:20:30,346 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd output: ctest-pod-90407895
Connecting to 10.103.231.119:80 (10.103.231.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-24 16:20:30,346 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-60292694': 4, 'ctest-pod-90407895': 1}
2025-03-24 16:20:30,419 - DEBUG - [Pod ctest-pod-08078433] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: ctest-pod-90407895
Connecting to 10.103.231.119:80 (10.103.231.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-24 16:20:30,419 - DEBUG - [Pod Pod ctest-pod-08078433] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 passed
2025-03-24 16:20:30,419 - DEBUG - [Pod Pod ctest-pod-08078433] Cmd output: ctest-pod-90407895
Connecting to 10.103.231.119:80 (10.103.231.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-24 16:20:30,475 - DEBUG - [Pod ctest-pod-08078433] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: ctest-pod-90407895
Connecting to 10.103.231.119:80 (10.103.231.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-24 16:20:30,475 - DEBUG - [Pod Pod ctest-pod-08078433] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 passed
2025-03-24 16:20:30,475 - DEBUG - [Pod Pod ctest-pod-08078433] Cmd output: ctest-pod-90407895
Connecting to 10.103.231.119:80 (10.103.231.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-24 16:20:30,555 - DEBUG - [Pod ctest-pod-08078433] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-90407895
2025-03-24 16:20:30,555 - DEBUG - [Pod Pod ctest-pod-08078433] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 passed
2025-03-24 16:20:30,555 - DEBUG - [Pod Pod ctest-pod-08078433] Cmd output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-90407895
2025-03-24 16:20:30,621 - DEBUG - [Pod ctest-pod-08078433] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: ctest-pod-60292694
Connecting to 10.103.231.119:80 (10.103.231.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-24 16:20:30,621 - DEBUG - [Pod Pod ctest-pod-08078433] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 passed
2025-03-24 16:20:30,621 - DEBUG - [Pod Pod ctest-pod-08078433] Cmd output: ctest-pod-60292694
Connecting to 10.103.231.119:80 (10.103.231.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-24 16:20:30,621 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-60292694': 1, 'ctest-pod-90407895': 3}
2025-03-24 16:20:30,629 - DEBUG - Network policy ingress-on-service not present
2025-03-24 16:20:30,629 - INFO - Creating Network Policy ingress-on-service
2025-03-24 16:20:30,643 - INFO - Network policy found in k8s
2025-03-24 16:20:30,643 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=94799b22-acc6-45d1-a24f-13c69f5ea89d
2025-03-24 16:20:30,657 - INFO - Network Policy ingress-on-service with uuid 94799b22-acc6-45d1-a24f-13c69f5ea89d found in kube manager
2025-03-24 16:20:30,708 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-03-24 16:20:30,708 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-03-24 16:20:30,709 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=94799b22-acc6-45d1-a24f-13c69f5ea89d
2025-03-24 16:20:30,769 - WARNING - Network policy with name ingress-on-service not found in agent
2025-03-24 16:20:32,782 - DEBUG - Requesting: http://10.0.0.29:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=94799b22-acc6-45d1-a24f-13c69f5ea89d
2025-03-24 16:20:32,838 - INFO - Network policy with name ingress-on-service found in agent
2025-03-24 16:20:32,839 - INFO - Network Policy ingress-on-service verification passed
2025-03-24 16:20:37,901 - DEBUG - [Pod ctest-pod-64884415] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:20:37,901 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:20:37,901 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:20:42,960 - DEBUG - [Pod ctest-pod-64884415] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:20:42,961 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:20:42,961 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:20:48,012 - DEBUG - [Pod ctest-pod-64884415] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:20:48,012 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:20:48,012 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:20:53,074 - DEBUG - [Pod ctest-pod-64884415] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:20:53,074 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:20:53,074 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:20:58,146 - DEBUG - [Pod ctest-pod-64884415] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:20:58,147 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:20:58,147 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:21:03,219 - DEBUG - [Pod ctest-pod-64884415] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:21:03,219 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:21:03,219 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:21:08,293 - DEBUG - [Pod ctest-pod-64884415] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:21:08,293 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:21:08,293 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:21:13,361 - DEBUG - [Pod ctest-pod-64884415] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:21:13,361 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:21:13,361 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:21:18,437 - DEBUG - [Pod ctest-pod-64884415] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:21:18,437 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:21:18,437 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:21:23,507 - DEBUG - [Pod ctest-pod-64884415] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:21:23,508 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:21:23,508 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:21:23,508 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-60292694': 0, 'ctest-pod-90407895': 0}
2025-03-24 16:21:23,565 - DEBUG - [Pod ctest-pod-68965387] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: ctest-pod-90407895
Connecting to 10.103.231.119:80 (10.103.231.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-24 16:21:23,566 - DEBUG - [Pod Pod ctest-pod-68965387] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 passed
2025-03-24 16:21:23,566 - DEBUG - [Pod Pod ctest-pod-68965387] Cmd output: ctest-pod-90407895
Connecting to 10.103.231.119:80 (10.103.231.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-24 16:21:23,631 - DEBUG - [Pod ctest-pod-68965387] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-90407895
2025-03-24 16:21:23,632 - DEBUG - [Pod Pod ctest-pod-68965387] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 passed
2025-03-24 16:21:23,632 - DEBUG - [Pod Pod ctest-pod-68965387] Cmd output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-90407895
2025-03-24 16:21:23,697 - DEBUG - [Pod ctest-pod-68965387] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-60292694
2025-03-24 16:21:23,697 - DEBUG - [Pod Pod ctest-pod-68965387] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 passed
2025-03-24 16:21:23,697 - DEBUG - [Pod Pod ctest-pod-68965387] Cmd output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-60292694
2025-03-24 16:21:23,697 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-60292694': 1, 'ctest-pod-90407895': 2}
2025-03-24 16:21:28,766 - DEBUG - [Pod ctest-pod-08078433] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:21:28,766 - DEBUG - [Pod Pod ctest-pod-08078433] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:21:28,767 - DEBUG - [Pod Pod ctest-pod-08078433] Cmd output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:21:33,835 - DEBUG - [Pod ctest-pod-08078433] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:21:33,836 - DEBUG - [Pod Pod ctest-pod-08078433] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:21:33,836 - DEBUG - [Pod Pod ctest-pod-08078433] Cmd output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:21:38,902 - DEBUG - [Pod ctest-pod-08078433] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:21:38,902 - DEBUG - [Pod Pod ctest-pod-08078433] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:21:38,902 - DEBUG - [Pod Pod ctest-pod-08078433] Cmd output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:21:43,952 - DEBUG - [Pod ctest-pod-08078433] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:21:43,952 - DEBUG - [Pod Pod ctest-pod-08078433] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:21:43,952 - DEBUG - [Pod Pod ctest-pod-08078433] Cmd output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:21:49,012 - DEBUG - [Pod ctest-pod-08078433] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:21:49,012 - DEBUG - [Pod Pod ctest-pod-08078433] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:21:49,012 - DEBUG - [Pod Pod ctest-pod-08078433] Cmd output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:21:54,094 - DEBUG - [Pod ctest-pod-08078433] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:21:54,094 - DEBUG - [Pod Pod ctest-pod-08078433] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:21:54,094 - DEBUG - [Pod Pod ctest-pod-08078433] Cmd output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:21:59,145 - DEBUG - [Pod ctest-pod-08078433] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:21:59,145 - DEBUG - [Pod Pod ctest-pod-08078433] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:21:59,145 - DEBUG - [Pod Pod ctest-pod-08078433] Cmd output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:22:04,218 - DEBUG - [Pod ctest-pod-08078433] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:22:04,218 - DEBUG - [Pod Pod ctest-pod-08078433] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:22:04,219 - DEBUG - [Pod Pod ctest-pod-08078433] Cmd output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:22:09,281 - DEBUG - [Pod ctest-pod-08078433] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:22:09,282 - DEBUG - [Pod Pod ctest-pod-08078433] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:22:09,282 - DEBUG - [Pod Pod ctest-pod-08078433] Cmd output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:22:14,345 - DEBUG - [Pod ctest-pod-08078433] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:22:14,345 - DEBUG - [Pod Pod ctest-pod-08078433] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:22:14,345 - DEBUG - [Pod Pod ctest-pod-08078433] Cmd output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:22:14,345 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-60292694': 0, 'ctest-pod-90407895': 0}
2025-03-24 16:22:16,413 - DEBUG - [Pod ctest-pod-68965387] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.472 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.080 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.081 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.080/0.544/1.472 ms
2025-03-24 16:22:16,414 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-68965387 with expectation True passed
2025-03-24 16:22:18,483 - DEBUG - [Pod ctest-pod-64884415] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.607 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.101 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.089 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.089/0.265/0.607 ms
2025-03-24 16:22:18,483 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-64884415 with expectation True passed
2025-03-24 16:22:20,574 - DEBUG - [Pod ctest-pod-08078433] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.222 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.076 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.084 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.076/0.460/1.222 ms
2025-03-24 16:22:20,574 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-08078433 with expectation True passed
2025-03-24 16:22:20,670 - DEBUG - [Pod ctest-pod-68965387] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-24 16:22:20,670 - DEBUG - [Pod Pod ctest-pod-68965387] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-03-24 16:22:20,670 - DEBUG - [Pod Pod ctest-pod-68965387] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-24 16:22:20,670 - INFO - wget check of of http://10.47.255.251 from ctest-pod-68965387 passed
2025-03-24 16:22:20,749 - DEBUG - [Pod ctest-pod-68965387] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-24 16:22:20,749 - DEBUG - [Pod Pod ctest-pod-68965387] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-03-24 16:22:20,749 - DEBUG - [Pod Pod ctest-pod-68965387] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-24 16:22:20,749 - INFO - wget check of of http://10.47.255.250 from ctest-pod-68965387 passed
2025-03-24 16:22:24,018 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2025-03-24 16:22:34,081 - DEBUG - [Pod ctest-pod-64884415] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-24 16:22:34,081 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-24 16:22:34,081 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-24 16:22:34,081 - INFO - wget check of of http://10.47.255.250 from ctest-pod-64884415 passed
2025-03-24 16:22:39,155 - DEBUG - [Pod ctest-pod-50962320] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-03-24 16:22:39,155 - DEBUG - [Pod Pod ctest-pod-50962320] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-03-24 16:22:39,155 - DEBUG - [Pod Pod ctest-pod-50962320] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-03-24 16:22:39,155 - INFO - wget check of of http://10.47.255.251 from ctest-pod-50962320 passed
2025-03-24 16:22:39,164 - INFO - Updating Network Policy ingress-on-service
2025-03-24 16:22:44,277 - DEBUG - [Pod ctest-pod-64884415] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:22:44,277 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:22:44,277 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:22:49,338 - DEBUG - [Pod ctest-pod-64884415] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:22:49,339 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:22:49,339 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:22:54,397 - DEBUG - [Pod ctest-pod-64884415] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:22:54,397 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:22:54,397 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:22:59,466 - DEBUG - [Pod ctest-pod-64884415] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:22:59,467 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:22:59,467 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:23:04,551 - DEBUG - [Pod ctest-pod-64884415] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:23:04,552 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:23:04,552 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:23:09,621 - DEBUG - [Pod ctest-pod-64884415] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:23:09,622 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:23:09,622 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:23:14,686 - DEBUG - [Pod ctest-pod-64884415] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:23:14,687 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:23:14,687 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:23:19,753 - DEBUG - [Pod ctest-pod-64884415] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:23:19,753 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:23:19,753 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:23:24,807 - DEBUG - [Pod ctest-pod-64884415] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:23:24,807 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:23:24,807 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:23:29,875 - DEBUG - [Pod ctest-pod-64884415] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:23:29,876 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:23:29,876 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
wget: download timed out
2025-03-24 16:23:29,876 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-60292694': 0, 'ctest-pod-90407895': 0}
2025-03-24 16:23:29,943 - DEBUG - [Pod ctest-pod-68965387] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: ctest-pod-90407895
Connecting to 10.103.231.119:80 (10.103.231.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-24 16:23:29,944 - DEBUG - [Pod Pod ctest-pod-68965387] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 passed
2025-03-24 16:23:29,944 - DEBUG - [Pod Pod ctest-pod-68965387] Cmd output: ctest-pod-90407895
Connecting to 10.103.231.119:80 (10.103.231.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-24 16:23:30,010 - DEBUG - [Pod ctest-pod-68965387] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: ctest-pod-90407895
Connecting to 10.103.231.119:80 (10.103.231.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-24 16:23:30,010 - DEBUG - [Pod Pod ctest-pod-68965387] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 passed
2025-03-24 16:23:30,010 - DEBUG - [Pod Pod ctest-pod-68965387] Cmd output: ctest-pod-90407895
Connecting to 10.103.231.119:80 (10.103.231.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-24 16:23:30,082 - DEBUG - [Pod ctest-pod-68965387] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-90407895
2025-03-24 16:23:30,082 - DEBUG - [Pod Pod ctest-pod-68965387] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 passed
2025-03-24 16:23:30,082 - DEBUG - [Pod Pod ctest-pod-68965387] Cmd output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-90407895
2025-03-24 16:23:30,142 - DEBUG - [Pod ctest-pod-68965387] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: ctest-pod-60292694
Connecting to 10.103.231.119:80 (10.103.231.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-24 16:23:30,142 - DEBUG - [Pod Pod ctest-pod-68965387] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 passed
2025-03-24 16:23:30,142 - DEBUG - [Pod Pod ctest-pod-68965387] Cmd output: ctest-pod-60292694
Connecting to 10.103.231.119:80 (10.103.231.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-24 16:23:30,142 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-60292694': 1, 'ctest-pod-90407895': 3}
2025-03-24 16:23:30,212 - DEBUG - [Pod ctest-pod-08078433] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
ctest-pod-90407895
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-24 16:23:30,212 - DEBUG - [Pod Pod ctest-pod-08078433] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 passed
2025-03-24 16:23:30,212 - DEBUG - [Pod Pod ctest-pod-08078433] Cmd output: Connecting to 10.103.231.119:80 (10.103.231.119:80)
ctest-pod-90407895
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-24 16:23:30,294 - DEBUG - [Pod ctest-pod-08078433] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: ctest-pod-90407895
Connecting to 10.103.231.119:80 (10.103.231.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-24 16:23:30,295 - DEBUG - [Pod Pod ctest-pod-08078433] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 passed
2025-03-24 16:23:30,295 - DEBUG - [Pod Pod ctest-pod-08078433] Cmd output: ctest-pod-90407895
Connecting to 10.103.231.119:80 (10.103.231.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-24 16:23:30,372 - DEBUG - [Pod ctest-pod-08078433] Cmd: wget http://10.103.231.119:80/ -O - -T 5 -t 1 , Output: ctest-pod-60292694
Connecting to 10.103.231.119:80 (10.103.231.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-24 16:23:30,372 - DEBUG - [Pod Pod ctest-pod-08078433] Cmd wget http://10.103.231.119:80/ -O - -T 5 -t 1 passed
2025-03-24 16:23:30,372 - DEBUG - [Pod Pod ctest-pod-08078433] Cmd output: ctest-pod-60292694
Connecting to 10.103.231.119:80 (10.103.231.119:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-24 16:23:30,372 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-60292694': 1, 'ctest-pod-90407895': 2}
2025-03-24 16:23:32,427 - DEBUG - [Pod ctest-pod-68965387] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.896 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.082 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.101 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.082/0.359/0.896 ms
2025-03-24 16:23:32,427 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-68965387 with expectation True passed
2025-03-24 16:23:34,491 - DEBUG - [Pod ctest-pod-64884415] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.453 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.082 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.092 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.082/0.209/0.453 ms
2025-03-24 16:23:34,492 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-64884415 with expectation True passed
2025-03-24 16:23:36,553 - DEBUG - [Pod ctest-pod-08078433] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.403 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.067 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.084 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.067/0.184/0.403 ms
2025-03-24 16:23:36,553 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-08078433 with expectation True passed
2025-03-24 16:23:36,617 - DEBUG - [Pod ctest-pod-68965387] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-24 16:23:36,617 - DEBUG - [Pod Pod ctest-pod-68965387] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-03-24 16:23:36,617 - DEBUG - [Pod Pod ctest-pod-68965387] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-24 16:23:36,617 - INFO - wget check of of http://10.47.255.251 from ctest-pod-68965387 passed
2025-03-24 16:23:36,678 - DEBUG - [Pod ctest-pod-68965387] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-24 16:23:36,679 - DEBUG - [Pod Pod ctest-pod-68965387] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-03-24 16:23:36,679 - DEBUG - [Pod Pod ctest-pod-68965387] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-24 16:23:36,679 - INFO - wget check of of http://10.47.255.250 from ctest-pod-68965387 passed
2025-03-24 16:23:41,733 - DEBUG - [Pod ctest-pod-64884415] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-24 16:23:41,733 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-24 16:23:41,733 - DEBUG - [Pod Pod ctest-pod-64884415] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-24 16:23:41,733 - INFO - wget check of of http://10.47.255.250 from ctest-pod-64884415 passed
2025-03-24 16:23:41,808 - DEBUG - [Pod ctest-pod-50962320] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-24 16:23:41,808 - DEBUG - [Pod Pod ctest-pod-50962320] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-03-24 16:23:41,808 - DEBUG - [Pod Pod ctest-pod-50962320] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-24 16:23:41,808 - INFO - wget check of of http://10.47.255.251 from ctest-pod-50962320 passed
2025-03-24 16:23:41,808 - INFO - Deleting Network Policy : ingress-on-service
2025-03-24 16:23:41,809 - INFO - Deleting service : ctest-nginx-svc-34667334
2025-03-24 16:23:41,991 - DEBUG - No XMPP flaps were noticed during the test
2025-03-24 16:23:41,992 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:14]
2025-03-24 16:23:41,992 - INFO - --------------------------------------------------------------------------------
2025-03-24 16:23:41,998 - INFO - Deleting pod ctest-new-default-38696221:ctest-pod-60292694
2025-03-24 16:23:41,999 - INFO - Deleting pod ctest-new-default-38696221:ctest-pod-90407895
2025-03-24 16:23:41,999 - INFO - Deleting pod ctest-non-default-99121047:ctest-pod-01325696
2025-03-24 16:23:41,999 - INFO - Deleting pod ctest-non-default-99121047:ctest-pod-34644068
2025-03-24 16:23:42,000 - INFO - Deleting pod ctest-new-default-38696221:ctest-pod-64884415
2025-03-24 16:23:42,000 - INFO - Deleting pod ctest-new-default-38696221:ctest-pod-68965387
2025-03-24 16:23:42,001 - INFO - Deleting pod ctest-non-default-99121047:ctest-pod-08078433
2025-03-24 16:23:42,001 - INFO - Deleting pod ctest-non-default-99121047:ctest-pod-50962320
2025-03-24 16:23:42,171 - WARNING - Pod uuid 1b71b83e-f244-4c27-92b4-79201e4b4e4e is still seen in agent 10.0.0.47 VM list
2025-03-24 16:23:42,172 - WARNING - Pod uuid 251a3513-4fe5-4986-b0e4-81fe62c8f108 is still seen in agent 10.0.0.47 VM list
2025-03-24 16:23:42,172 - WARNING - Pod uuid 38273d70-6c92-4e23-8dd4-75429e345494 is still seen in agent 10.0.0.47 VM list
2025-03-24 16:23:42,172 - WARNING - Pod uuid d21c220d-b422-45b0-87dc-2b9d09b5cf87 is still seen in agent 10.0.0.47 VM list
2025-03-24 16:23:42,173 - WARNING - Pod uuid 39dcf4b2-4fab-4e6c-a59d-b32c20bdac7e is still seen in agent 10.0.0.47 VM list
2025-03-24 16:23:42,174 - WARNING - Pod uuid ed68d5e5-2db6-47d1-a2a7-1e2b61a3a695 is still seen in agent 10.0.0.47 VM list
2025-03-24 16:23:42,174 - WARNING - Pod uuid 536f7879-e155-4bba-a460-40def3f78a51 is still seen in agent 10.0.0.47 VM list
2025-03-24 16:23:42,174 - WARNING - Pod uuid 6d516462-6e9c-4f26-bb77-00427502a43c is still seen in agent 10.0.0.47 VM list
2025-03-24 16:23:47,212 - WARNING - Pod uuid 39dcf4b2-4fab-4e6c-a59d-b32c20bdac7e is still seen in agent 10.0.0.47 VM list
2025-03-24 16:23:47,216 - DEBUG - Pod 536f7879-e155-4bba-a460-40def3f78a51 is not in agent 10.0.0.47 VM list
2025-03-24 16:23:47,218 - WARNING - Pod uuid d21c220d-b422-45b0-87dc-2b9d09b5cf87 is still seen in agent 10.0.0.47 VM list
2025-03-24 16:23:47,219 - DEBUG - Pod 6d516462-6e9c-4f26-bb77-00427502a43c is not in agent 10.0.0.47 VM list
2025-03-24 16:23:47,221 - WARNING - Pod uuid ed68d5e5-2db6-47d1-a2a7-1e2b61a3a695 is still seen in agent 10.0.0.47 VM list
2025-03-24 16:23:47,221 - WARNING - Pod uuid 1b71b83e-f244-4c27-92b4-79201e4b4e4e is still seen in agent 10.0.0.47 VM list
2025-03-24 16:23:47,222 - DEBUG - Pod 251a3513-4fe5-4986-b0e4-81fe62c8f108 is not in agent 10.0.0.47 VM list
2025-03-24 16:23:47,223 - DEBUG - Pod 38273d70-6c92-4e23-8dd4-75429e345494 is not in agent 10.0.0.47 VM list
2025-03-24 16:23:47,239 - DEBUG - VMI deae1844-08cb-11f0-8be3-fa163e6d2c22 is removed from agent 10.0.0.47
2025-03-24 16:23:47,239 - INFO - Verified that pod ctest-pod-34644068 is removed in agent
2025-03-24 16:23:47,240 - DEBUG - VMI de1e0024-08cb-11f0-8be3-fa163e6d2c22 is removed from agent 10.0.0.47
2025-03-24 16:23:47,240 - INFO - Verified that pod ctest-pod-01325696 is removed in agent
2025-03-24 16:23:47,243 - DEBUG - VMI dd61c7f6-08cb-11f0-8be3-fa163e6d2c22 is removed from agent 10.0.0.47
2025-03-24 16:23:47,243 - INFO - Verified that pod ctest-pod-90407895 is removed in agent
2025-03-24 16:23:47,244 - DEBUG - VMI dcc492ec-08cb-11f0-8be3-fa163e6d2c22 is removed from agent 10.0.0.47
2025-03-24 16:23:47,244 - INFO - Verified that pod ctest-pod-60292694 is removed in agent
2025-03-24 16:23:52,222 - WARNING - Pod uuid 39dcf4b2-4fab-4e6c-a59d-b32c20bdac7e is still seen in agent 10.0.0.47 VM list
2025-03-24 16:23:52,238 - WARNING - Pod uuid d21c220d-b422-45b0-87dc-2b9d09b5cf87 is still seen in agent 10.0.0.47 VM list
2025-03-24 16:23:52,240 - WARNING - Pod uuid 1b71b83e-f244-4c27-92b4-79201e4b4e4e is still seen in agent 10.0.0.47 VM list
2025-03-24 16:23:52,240 - WARNING - Pod uuid ed68d5e5-2db6-47d1-a2a7-1e2b61a3a695 is still seen in agent 10.0.0.47 VM list
2025-03-24 16:23:57,231 - WARNING - Pod uuid 39dcf4b2-4fab-4e6c-a59d-b32c20bdac7e is still seen in agent 10.0.0.47 VM list
2025-03-24 16:23:57,255 - WARNING - Pod uuid ed68d5e5-2db6-47d1-a2a7-1e2b61a3a695 is still seen in agent 10.0.0.47 VM list
2025-03-24 16:23:57,255 - WARNING - Pod uuid d21c220d-b422-45b0-87dc-2b9d09b5cf87 is still seen in agent 10.0.0.47 VM list
2025-03-24 16:23:57,256 - WARNING - Pod uuid 1b71b83e-f244-4c27-92b4-79201e4b4e4e is still seen in agent 10.0.0.47 VM list
2025-03-24 16:24:02,242 - WARNING - Pod uuid 39dcf4b2-4fab-4e6c-a59d-b32c20bdac7e is still seen in agent 10.0.0.47 VM list
2025-03-24 16:24:02,275 - WARNING - Pod uuid ed68d5e5-2db6-47d1-a2a7-1e2b61a3a695 is still seen in agent 10.0.0.47 VM list
2025-03-24 16:24:02,278 - WARNING - Pod uuid d21c220d-b422-45b0-87dc-2b9d09b5cf87 is still seen in agent 10.0.0.47 VM list
2025-03-24 16:24:02,278 - WARNING - Pod uuid 1b71b83e-f244-4c27-92b4-79201e4b4e4e is still seen in agent 10.0.0.47 VM list
2025-03-24 16:24:07,251 - WARNING - Pod uuid 39dcf4b2-4fab-4e6c-a59d-b32c20bdac7e is still seen in agent 10.0.0.47 VM list
2025-03-24 16:24:07,291 - WARNING - Pod uuid ed68d5e5-2db6-47d1-a2a7-1e2b61a3a695 is still seen in agent 10.0.0.47 VM list
2025-03-24 16:24:07,293 - WARNING - Pod uuid 1b71b83e-f244-4c27-92b4-79201e4b4e4e is still seen in agent 10.0.0.47 VM list
2025-03-24 16:24:07,293 - WARNING - Pod uuid d21c220d-b422-45b0-87dc-2b9d09b5cf87 is still seen in agent 10.0.0.47 VM list
2025-03-24 16:24:12,268 - WARNING - Pod uuid 39dcf4b2-4fab-4e6c-a59d-b32c20bdac7e is still seen in agent 10.0.0.47 VM list
2025-03-24 16:24:12,312 - WARNING - Pod uuid d21c220d-b422-45b0-87dc-2b9d09b5cf87 is still seen in agent 10.0.0.47 VM list
2025-03-24 16:24:12,313 - WARNING - Pod uuid 1b71b83e-f244-4c27-92b4-79201e4b4e4e is still seen in agent 10.0.0.47 VM list
2025-03-24 16:24:12,313 - WARNING - Pod uuid ed68d5e5-2db6-47d1-a2a7-1e2b61a3a695 is still seen in agent 10.0.0.47 VM list
2025-03-24 16:24:17,278 - DEBUG - Pod 39dcf4b2-4fab-4e6c-a59d-b32c20bdac7e is not in agent 10.0.0.47 VM list
2025-03-24 16:24:17,289 - DEBUG - VMI dfddc052-08cb-11f0-8be3-fa163e6d2c22 is removed from agent 10.0.0.47
2025-03-24 16:24:17,289 - INFO - Verified that pod ctest-pod-68965387 is removed in agent
2025-03-24 16:24:17,328 - DEBUG - Pod d21c220d-b422-45b0-87dc-2b9d09b5cf87 is not in agent 10.0.0.47 VM list
2025-03-24 16:24:17,333 - DEBUG - Pod ed68d5e5-2db6-47d1-a2a7-1e2b61a3a695 is not in agent 10.0.0.47 VM list
2025-03-24 16:24:17,335 - DEBUG - Pod 1b71b83e-f244-4c27-92b4-79201e4b4e4e is not in agent 10.0.0.47 VM list
2025-03-24 16:24:17,350 - DEBUG - VMI df49eefe-08cb-11f0-8be3-fa163e6d2c22 is removed from agent 10.0.0.47
2025-03-24 16:24:17,350 - INFO - Verified that pod ctest-pod-64884415 is removed in agent
2025-03-24 16:24:17,350 - DEBUG - VMI e0f85420-08cb-11f0-8be3-fa163e6d2c22 is removed from agent 10.0.0.47
2025-03-24 16:24:17,350 - INFO - Verified that pod ctest-pod-50962320 is removed in agent
2025-03-24 16:24:17,352 - DEBUG - VMI e06a82f8-08cb-11f0-8be3-fa163e6d2c22 is removed from agent 10.0.0.47
2025-03-24 16:24:17,352 - INFO - Verified that pod ctest-pod-08078433 is removed in agent
2025-03-24 16:24:17,353 - INFO - Deleting namespace ctest-non-default-99121047
2025-03-24 16:24:17,392 - DEBUG - Namespace ctest-non-default-99121047 still in k8s
2025-03-24 16:24:19,403 - DEBUG - Namespace ctest-non-default-99121047 still in k8s
2025-03-24 16:24:21,410 - DEBUG - Namespace ctest-non-default-99121047 still in k8s
2025-03-24 16:24:23,416 - DEBUG - Namespace ctest-non-default-99121047 is not in k8s
2025-03-24 16:24:23,416 - DEBUG - No need to check project deletion in contrail-api
2025-03-24 16:24:23,416 - INFO - Deleting namespace ctest-new-default-38696221
2025-03-24 16:24:23,435 - DEBUG - Namespace ctest-new-default-38696221 still in k8s
2025-03-24 16:24:25,446 - DEBUG - Namespace ctest-new-default-38696221 still in k8s
2025-03-24 16:24:27,450 - DEBUG - Namespace ctest-new-default-38696221 still in k8s
2025-03-24 16:24:29,455 - DEBUG - Namespace ctest-new-default-38696221 is not in k8s
2025-03-24 16:24:29,455 - DEBUG - No need to check project deletion in contrail-api