2025-07-09 09:20:56,960 - INFO - Using existing project ['default-domain', 'k8s-default'](f4dbd7c1-096f-48fc-9bd7-46836dcca66f)
2025-07-09 09:20:56,983 - DEBUG - Namespace ctest-new-default-24819908 not present
2025-07-09 09:20:56,991 - INFO - Created namespace ctest-new-default-24819908
2025-07-09 09:20:59,994 - DEBUG - Namespace ctest-non-default-08825650 not present
2025-07-09 09:21:00,004 - INFO - Created namespace ctest-non-default-08825650
2025-07-09 09:21:03,023 - DEBUG - Pod ctest-pod-15722059 not present
2025-07-09 09:21:03,023 - INFO - Creating Pod ctest-pod-15722059
2025-07-09 09:21:03,055 - DEBUG - Pod : ctest-pod-15722059 UUID is c71b3098-602a-40b9-af03-26b1451e928a
2025-07-09 09:21:03,057 - DEBUG - Pod ctest-pod-22457658 not present
2025-07-09 09:21:03,057 - INFO - Creating Pod ctest-pod-22457658
2025-07-09 09:21:03,105 - DEBUG - Pod : ctest-pod-22457658 UUID is 84c8b8c2-3520-4f1d-88c1-9ffb24364364
2025-07-09 09:21:03,110 - DEBUG - Pod ctest-pod-64694221 not present
2025-07-09 09:21:03,110 - INFO - Creating Pod ctest-pod-64694221
2025-07-09 09:21:03,141 - DEBUG - Pod : ctest-pod-64694221 UUID is 20db3bc5-d618-4f6f-936e-6c705ee80372
2025-07-09 09:21:03,145 - DEBUG - Pod ctest-pod-50974295 not present
2025-07-09 09:21:03,145 - INFO - Creating Pod ctest-pod-50974295
2025-07-09 09:21:03,191 - DEBUG - Pod : ctest-pod-50974295 UUID is 4b662acf-4b19-4a7d-89f0-44f53f6af73c
2025-07-09 09:21:03,194 - DEBUG - Pod ctest-pod-61319584 not present
2025-07-09 09:21:03,194 - INFO - Creating Pod ctest-pod-61319584
2025-07-09 09:21:03,215 - DEBUG - Pod : ctest-pod-61319584 UUID is e16dcadd-b83c-49a7-b0c1-af71a9abcfa8
2025-07-09 09:21:03,219 - DEBUG - Pod ctest-pod-09594293 not present
2025-07-09 09:21:03,220 - INFO - Creating Pod ctest-pod-09594293
2025-07-09 09:21:03,242 - DEBUG - Pod : ctest-pod-09594293 UUID is 76e44c0e-2d1a-41ff-a8f1-70c2ce7144dd
2025-07-09 09:21:03,245 - DEBUG - Pod ctest-pod-86752382 not present
2025-07-09 09:21:03,245 - INFO - Creating Pod ctest-pod-86752382
2025-07-09 09:21:03,277 - DEBUG - Pod : ctest-pod-86752382 UUID is 171cec56-5ee3-4780-a08c-5d64f90a9c78
2025-07-09 09:21:03,281 - DEBUG - Pod ctest-pod-58093274 not present
2025-07-09 09:21:03,281 - INFO - Creating Pod ctest-pod-58093274
2025-07-09 09:21:03,313 - DEBUG - Pod : ctest-pod-58093274 UUID is 9fb0714a-7a47-4fb0-a9a7-fcc328983e96
2025-07-09 09:21:03,542 - INFO - Project default-domain:k8s-ctest-new-default-24819908 for Namespace ctest-new-default-24819908 is seen in contrail-api
2025-07-09 09:21:03,543 - DEBUG - Project uuid in Contrail is aa2d7ae5-2cfe-4a35-a0fe-08421b7fad60
2025-07-09 09:21:03,752 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_NamespaceDatabaseList?namespace_uuid=c3f5288b-b74f-44fb-8bbc-3025c457ec9c
2025-07-09 09:21:03,759 - INFO - Namespace ctest-new-default-24819908 with uuid c3f5288b-b74f-44fb-8bbc-3025c457ec9c found in kube manager
2025-07-09 09:21:03,760 - INFO - Namespace ctest-new-default-24819908 verification passed
2025-07-09 09:21:03,973 - INFO - Project default-domain:k8s-ctest-non-default-08825650 for Namespace ctest-non-default-08825650 is seen in contrail-api
2025-07-09 09:21:03,973 - DEBUG - Project uuid in Contrail is 74f68540-824b-4f60-8eaa-662efec6ac9b
2025-07-09 09:21:03,973 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_NamespaceDatabaseList?namespace_uuid=083d872f-0176-4807-b490-05e8b4e3c2e1
2025-07-09 09:21:03,979 - INFO - Namespace ctest-non-default-08825650 with uuid 083d872f-0176-4807-b490-05e8b4e3c2e1 found in kube manager
2025-07-09 09:21:03,980 - INFO - Namespace ctest-non-default-08825650 verification passed
2025-07-09 09:21:03,986 - DEBUG - Pod ctest-pod-15722059 not in running state.Currently in Pending
2025-07-09 09:21:08,994 - DEBUG - Pod ctest-pod-15722059 not in running state.Currently in Pending
2025-07-09 09:21:14,002 - INFO - Pod ctest-pod-15722059 is in running state.Got IP 10.47.255.251
2025-07-09 09:21:14,072 - DEBUG - Pod ctest-pod-15722059 has vmi 0a06c8c8-5ca6-11f0-b464-fa163e2f652b
2025-07-09 09:21:14,072 - INFO - Verified pod ctest-pod-15722059 in contrail-api
2025-07-09 09:21:14,085 - DEBUG - VMI 0a06c8c8-5ca6-11f0-b464-fa163e2f652b is active in agent 10.0.0.129
2025-07-09 09:21:14,085 - INFO - Verified Pod ctest-pod-15722059 in agent 10.0.0.129
2025-07-09 09:21:14,085 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=c71b3098-602a-40b9-af03-26b1451e928a
2025-07-09 09:21:14,090 - INFO - Pod ctest-pod-15722059 with uuid c71b3098-602a-40b9-af03-26b1451e928a found in kube manager
2025-07-09 09:21:14,090 - INFO - Pod ctest-pod-15722059 verification passed
2025-07-09 09:21:14,095 - DEBUG - Pod ctest-pod-22457658 not in running state.Currently in Pending
2025-07-09 09:21:19,103 - INFO - Pod ctest-pod-22457658 is in running state.Got IP 10.47.255.250
2025-07-09 09:21:19,121 - DEBUG - Pod ctest-pod-22457658 has vmi 0a818d24-5ca6-11f0-b464-fa163e2f652b
2025-07-09 09:21:19,121 - INFO - Verified pod ctest-pod-22457658 in contrail-api
2025-07-09 09:21:19,139 - DEBUG - VMI 0a818d24-5ca6-11f0-b464-fa163e2f652b is active in agent 10.0.0.129
2025-07-09 09:21:19,140 - INFO - Verified Pod ctest-pod-22457658 in agent 10.0.0.129
2025-07-09 09:21:19,140 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=84c8b8c2-3520-4f1d-88c1-9ffb24364364
2025-07-09 09:21:19,146 - INFO - Pod ctest-pod-22457658 with uuid 84c8b8c2-3520-4f1d-88c1-9ffb24364364 found in kube manager
2025-07-09 09:21:19,147 - INFO - Pod ctest-pod-22457658 verification passed
2025-07-09 09:21:19,153 - INFO - Pod ctest-pod-64694221 is in running state.Got IP 10.47.255.249
2025-07-09 09:21:19,177 - DEBUG - Pod ctest-pod-64694221 has vmi 0b428970-5ca6-11f0-b464-fa163e2f652b
2025-07-09 09:21:19,177 - INFO - Verified pod ctest-pod-64694221 in contrail-api
2025-07-09 09:21:19,192 - DEBUG - VMI 0b428970-5ca6-11f0-b464-fa163e2f652b is active in agent 10.0.0.129
2025-07-09 09:21:19,192 - INFO - Verified Pod ctest-pod-64694221 in agent 10.0.0.129
2025-07-09 09:21:19,192 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=20db3bc5-d618-4f6f-936e-6c705ee80372
2025-07-09 09:21:19,197 - INFO - Pod ctest-pod-64694221 with uuid 20db3bc5-d618-4f6f-936e-6c705ee80372 found in kube manager
2025-07-09 09:21:19,197 - INFO - Pod ctest-pod-64694221 verification passed
2025-07-09 09:21:19,203 - INFO - Pod ctest-pod-50974295 is in running state.Got IP 10.47.255.248
2025-07-09 09:21:19,260 - DEBUG - Pod ctest-pod-50974295 has vmi 0bd07168-5ca6-11f0-b464-fa163e2f652b
2025-07-09 09:21:19,261 - INFO - Verified pod ctest-pod-50974295 in contrail-api
2025-07-09 09:21:19,276 - DEBUG - VMI 0bd07168-5ca6-11f0-b464-fa163e2f652b is active in agent 10.0.0.129
2025-07-09 09:21:19,276 - INFO - Verified Pod ctest-pod-50974295 in agent 10.0.0.129
2025-07-09 09:21:19,276 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=4b662acf-4b19-4a7d-89f0-44f53f6af73c
2025-07-09 09:21:19,282 - INFO - Pod ctest-pod-50974295 with uuid 4b662acf-4b19-4a7d-89f0-44f53f6af73c found in kube manager
2025-07-09 09:21:19,282 - INFO - Pod ctest-pod-50974295 verification passed
2025-07-09 09:21:19,289 - INFO - Pod ctest-pod-61319584 is in running state.Got IP 10.47.255.247
2025-07-09 09:21:19,348 - DEBUG - Pod ctest-pod-61319584 has vmi 0c613b26-5ca6-11f0-b464-fa163e2f652b
2025-07-09 09:21:19,348 - INFO - Verified pod ctest-pod-61319584 in contrail-api
2025-07-09 09:21:19,362 - DEBUG - VMI 0c613b26-5ca6-11f0-b464-fa163e2f652b is active in agent 10.0.0.129
2025-07-09 09:21:19,362 - INFO - Verified Pod ctest-pod-61319584 in agent 10.0.0.129
2025-07-09 09:21:19,363 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=e16dcadd-b83c-49a7-b0c1-af71a9abcfa8
2025-07-09 09:21:19,377 - INFO - Pod ctest-pod-61319584 with uuid e16dcadd-b83c-49a7-b0c1-af71a9abcfa8 found in kube manager
2025-07-09 09:21:19,377 - INFO - Pod ctest-pod-61319584 verification passed
2025-07-09 09:21:19,384 - DEBUG - Pod ctest-pod-86752382 not in running state.Currently in Pending
2025-07-09 09:21:24,390 - INFO - Pod ctest-pod-86752382 is in running state.Got IP 10.47.255.245
2025-07-09 09:21:24,403 - DEBUG - Pod ctest-pod-86752382 has vmi 0d5e4032-5ca6-11f0-b464-fa163e2f652b
2025-07-09 09:21:24,403 - INFO - Verified pod ctest-pod-86752382 in contrail-api
2025-07-09 09:21:24,418 - DEBUG - VMI 0d5e4032-5ca6-11f0-b464-fa163e2f652b is active in agent 10.0.0.129
2025-07-09 09:21:24,418 - INFO - Verified Pod ctest-pod-86752382 in agent 10.0.0.129
2025-07-09 09:21:24,418 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=171cec56-5ee3-4780-a08c-5d64f90a9c78
2025-07-09 09:21:24,423 - INFO - Pod ctest-pod-86752382 with uuid 171cec56-5ee3-4780-a08c-5d64f90a9c78 found in kube manager
2025-07-09 09:21:24,423 - INFO - Pod ctest-pod-86752382 verification passed
2025-07-09 09:21:24,428 - INFO - Pod ctest-pod-09594293 is in running state.Got IP 10.47.255.246
2025-07-09 09:21:24,484 - DEBUG - Pod ctest-pod-09594293 has vmi 0cde3ac2-5ca6-11f0-b464-fa163e2f652b
2025-07-09 09:21:24,484 - INFO - Verified pod ctest-pod-09594293 in contrail-api
2025-07-09 09:21:24,499 - DEBUG - VMI 0cde3ac2-5ca6-11f0-b464-fa163e2f652b is active in agent 10.0.0.129
2025-07-09 09:21:24,499 - INFO - Verified Pod ctest-pod-09594293 in agent 10.0.0.129
2025-07-09 09:21:24,499 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=76e44c0e-2d1a-41ff-a8f1-70c2ce7144dd
2025-07-09 09:21:24,503 - INFO - Pod ctest-pod-09594293 with uuid 76e44c0e-2d1a-41ff-a8f1-70c2ce7144dd found in kube manager
2025-07-09 09:21:24,504 - INFO - Pod ctest-pod-09594293 verification passed
2025-07-09 09:21:24,508 - INFO - Pod ctest-pod-58093274 is in running state.Got IP 10.47.255.244
2025-07-09 09:21:24,521 - DEBUG - Pod ctest-pod-58093274 has vmi 0ddf07e4-5ca6-11f0-b464-fa163e2f652b
2025-07-09 09:21:24,522 - INFO - Verified pod ctest-pod-58093274 in contrail-api
2025-07-09 09:21:24,535 - DEBUG - VMI 0ddf07e4-5ca6-11f0-b464-fa163e2f652b is active in agent 10.0.0.129
2025-07-09 09:21:24,535 - INFO - Verified Pod ctest-pod-58093274 in agent 10.0.0.129
2025-07-09 09:21:24,535 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=9fb0714a-7a47-4fb0-a9a7-fcc328983e96
2025-07-09 09:21:24,540 - INFO - Pod ctest-pod-58093274 with uuid 9fb0714a-7a47-4fb0-a9a7-fcc328983e96 found in kube manager
2025-07-09 09:21:24,540 - INFO - Pod ctest-pod-58093274 verification passed
2025-07-09 09:21:24,540 - INFO - ================================================================================
2025-07-09 09:21:24,540 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-07-09 09:21:24,540 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-07-09 09:21:24,775 - DEBUG - Nothing to compare xmpp stats {'10.0.0.129': {'10.0.0.57': '0'}} with
2025-07-09 09:21:24,775 - INFO - Initial checks done. Running the testcase now
2025-07-09 09:21:24,775 - INFO -
2025-07-09 09:21:24,835 - DEBUG - [Pod ctest-pod-15722059] Cmd: echo ctest-pod-15722059 > /usr/share/nginx/html/index.html, Output:
2025-07-09 09:21:24,894 - DEBUG - [Pod ctest-pod-22457658] Cmd: echo ctest-pod-22457658 > /usr/share/nginx/html/index.html, Output:
2025-07-09 09:21:24,954 - DEBUG - [Pod ctest-pod-64694221] Cmd: echo ctest-pod-64694221 > /usr/share/nginx/html/index.html, Output:
2025-07-09 09:21:25,003 - DEBUG - [Pod ctest-pod-50974295] Cmd: echo ctest-pod-50974295 > /usr/share/nginx/html/index.html, Output:
2025-07-09 09:21:25,006 - DEBUG - Service ctest-nginx-svc-26358408 not present
2025-07-09 09:21:25,006 - INFO - Creating service ctest-nginx-svc-26358408
2025-07-09 09:21:25,018 - INFO - Created Service ctest-nginx-svc-26358408
2025-07-09 09:21:25,029 - WARNING - Service UUID 11586668-d4bb-4b36-a700-7d52c25a1b59 not yet found in contrail-api
2025-07-09 09:21:26,037 - INFO - Validated that Service ctest-nginx-svc-26358408 is seen in contrail-api
2025-07-09 09:21:26,037 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_LoadbalancerDatabaseList?x=11586668-d4bb-4b36-a700-7d52c25a1b59
2025-07-09 09:21:26,046 - INFO - Service ctest-nginx-svc-26358408 with uuid 11586668-d4bb-4b36-a700-7d52c25a1b59 found in kube manager
2025-07-09 09:21:26,046 - INFO - Service ctest-nginx-svc-26358408 verification passed
2025-07-09 09:21:27,108 - DEBUG - [Pod ctest-pod-61319584] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
ctest-pod-22457658
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-09 09:21:27,108 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 passed
2025-07-09 09:21:27,108 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
ctest-pod-22457658
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-09 09:21:27,159 - DEBUG - [Pod ctest-pod-61319584] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: ctest-pod-22457658
Connecting to 10.99.108.253:80 (10.99.108.253:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-09 09:21:27,159 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 passed
2025-07-09 09:21:27,159 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd output: ctest-pod-22457658
Connecting to 10.99.108.253:80 (10.99.108.253:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-09 09:21:27,219 - DEBUG - [Pod ctest-pod-61319584] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: ctest-pod-15722059
Connecting to 10.99.108.253:80 (10.99.108.253:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-09 09:21:27,219 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 passed
2025-07-09 09:21:27,219 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd output: ctest-pod-15722059
Connecting to 10.99.108.253:80 (10.99.108.253:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-09 09:21:27,219 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-15722059': 1, 'ctest-pod-22457658': 2}
2025-07-09 09:21:27,257 - DEBUG - [Pod ctest-pod-86752382] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-22457658
2025-07-09 09:21:27,257 - DEBUG - [Pod Pod ctest-pod-86752382] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 passed
2025-07-09 09:21:27,257 - DEBUG - [Pod Pod ctest-pod-86752382] Cmd output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-22457658
2025-07-09 09:21:27,310 - DEBUG - [Pod ctest-pod-86752382] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: ctest-pod-15722059
Connecting to 10.99.108.253:80 (10.99.108.253:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-09 09:21:27,310 - DEBUG - [Pod Pod ctest-pod-86752382] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 passed
2025-07-09 09:21:27,310 - DEBUG - [Pod Pod ctest-pod-86752382] Cmd output: ctest-pod-15722059
Connecting to 10.99.108.253:80 (10.99.108.253:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-09 09:21:27,310 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-15722059': 1, 'ctest-pod-22457658': 1}
2025-07-09 09:21:27,313 - DEBUG - Network policy ingress-on-service not present
2025-07-09 09:21:27,381 - INFO - Creating Network Policy ingress-on-service
2025-07-09 09:21:27,395 - INFO - Network policy found in k8s
2025-07-09 09:21:27,395 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=b4d06498-990b-45be-8ce1-4057fc7e3141
2025-07-09 09:21:27,405 - INFO - Network Policy ingress-on-service with uuid b4d06498-990b-45be-8ce1-4057fc7e3141 found in kube manager
2025-07-09 09:21:27,446 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-07-09 09:21:27,446 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-07-09 09:21:27,446 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=b4d06498-990b-45be-8ce1-4057fc7e3141
2025-07-09 09:21:27,475 - WARNING - Network policy with name ingress-on-service not found in agent
2025-07-09 09:21:29,476 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=b4d06498-990b-45be-8ce1-4057fc7e3141
2025-07-09 09:21:29,509 - INFO - Network policy with name ingress-on-service found in agent
2025-07-09 09:21:29,510 - INFO - Network Policy ingress-on-service verification passed
2025-07-09 09:21:34,571 - DEBUG - [Pod ctest-pod-61319584] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:21:34,572 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:21:34,572 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:21:39,620 - DEBUG - [Pod ctest-pod-61319584] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:21:39,620 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:21:39,620 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:21:44,672 - DEBUG - [Pod ctest-pod-61319584] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:21:44,673 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:21:44,673 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:21:49,719 - DEBUG - [Pod ctest-pod-61319584] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:21:49,719 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:21:49,719 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:21:54,772 - DEBUG - [Pod ctest-pod-61319584] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:21:54,772 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:21:54,772 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:21:59,824 - DEBUG - [Pod ctest-pod-61319584] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:21:59,825 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:21:59,825 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:22:04,883 - DEBUG - [Pod ctest-pod-61319584] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:22:04,883 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:22:04,883 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:22:09,931 - DEBUG - [Pod ctest-pod-61319584] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:22:09,931 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:22:09,931 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:22:14,983 - DEBUG - [Pod ctest-pod-61319584] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:22:14,983 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:22:14,983 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:22:20,037 - DEBUG - [Pod ctest-pod-61319584] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:22:20,037 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:22:20,037 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:22:20,037 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-15722059': 0, 'ctest-pod-22457658': 0}
2025-07-09 09:22:20,132 - DEBUG - [Pod ctest-pod-09594293] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-22457658
2025-07-09 09:22:20,132 - DEBUG - [Pod Pod ctest-pod-09594293] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 passed
2025-07-09 09:22:20,132 - DEBUG - [Pod Pod ctest-pod-09594293] Cmd output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-22457658
2025-07-09 09:22:20,199 - DEBUG - [Pod ctest-pod-09594293] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
ctest-pod-22457658
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-09 09:22:20,199 - DEBUG - [Pod Pod ctest-pod-09594293] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 passed
2025-07-09 09:22:20,199 - DEBUG - [Pod Pod ctest-pod-09594293] Cmd output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
ctest-pod-22457658
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-09 09:22:20,268 - DEBUG - [Pod ctest-pod-09594293] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: ctest-pod-22457658
Connecting to 10.99.108.253:80 (10.99.108.253:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-09 09:22:20,268 - DEBUG - [Pod Pod ctest-pod-09594293] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 passed
2025-07-09 09:22:20,268 - DEBUG - [Pod Pod ctest-pod-09594293] Cmd output: ctest-pod-22457658
Connecting to 10.99.108.253:80 (10.99.108.253:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-09 09:22:20,327 - DEBUG - [Pod ctest-pod-09594293] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: ctest-pod-22457658
Connecting to 10.99.108.253:80 (10.99.108.253:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-09 09:22:20,328 - DEBUG - [Pod Pod ctest-pod-09594293] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 passed
2025-07-09 09:22:20,328 - DEBUG - [Pod Pod ctest-pod-09594293] Cmd output: ctest-pod-22457658
Connecting to 10.99.108.253:80 (10.99.108.253:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-09 09:22:20,390 - DEBUG - [Pod ctest-pod-09594293] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-22457658
2025-07-09 09:22:20,390 - DEBUG - [Pod Pod ctest-pod-09594293] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 passed
2025-07-09 09:22:20,390 - DEBUG - [Pod Pod ctest-pod-09594293] Cmd output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-22457658
2025-07-09 09:22:20,505 - DEBUG - [Pod ctest-pod-09594293] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-22457658
2025-07-09 09:22:20,505 - DEBUG - [Pod Pod ctest-pod-09594293] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 passed
2025-07-09 09:22:20,505 - DEBUG - [Pod Pod ctest-pod-09594293] Cmd output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-22457658
2025-07-09 09:22:20,574 - DEBUG - [Pod ctest-pod-09594293] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: ctest-pod-22457658
Connecting to 10.99.108.253:80 (10.99.108.253:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-09 09:22:20,574 - DEBUG - [Pod Pod ctest-pod-09594293] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 passed
2025-07-09 09:22:20,574 - DEBUG - [Pod Pod ctest-pod-09594293] Cmd output: ctest-pod-22457658
Connecting to 10.99.108.253:80 (10.99.108.253:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-09 09:22:20,638 - DEBUG - [Pod ctest-pod-09594293] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: ctest-pod-15722059
Connecting to 10.99.108.253:80 (10.99.108.253:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-09 09:22:20,639 - DEBUG - [Pod Pod ctest-pod-09594293] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 passed
2025-07-09 09:22:20,639 - DEBUG - [Pod Pod ctest-pod-09594293] Cmd output: ctest-pod-15722059
Connecting to 10.99.108.253:80 (10.99.108.253:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-09 09:22:20,639 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-15722059': 1, 'ctest-pod-22457658': 7}
2025-07-09 09:22:25,719 - DEBUG - [Pod ctest-pod-86752382] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:22:25,719 - DEBUG - [Pod Pod ctest-pod-86752382] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:22:25,719 - DEBUG - [Pod Pod ctest-pod-86752382] Cmd output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:22:30,768 - DEBUG - [Pod ctest-pod-86752382] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:22:30,769 - DEBUG - [Pod Pod ctest-pod-86752382] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:22:30,769 - DEBUG - [Pod Pod ctest-pod-86752382] Cmd output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:22:35,820 - DEBUG - [Pod ctest-pod-86752382] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:22:35,820 - DEBUG - [Pod Pod ctest-pod-86752382] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:22:35,820 - DEBUG - [Pod Pod ctest-pod-86752382] Cmd output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:22:40,873 - DEBUG - [Pod ctest-pod-86752382] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:22:40,873 - DEBUG - [Pod Pod ctest-pod-86752382] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:22:40,873 - DEBUG - [Pod Pod ctest-pod-86752382] Cmd output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:22:45,928 - DEBUG - [Pod ctest-pod-86752382] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:22:45,928 - DEBUG - [Pod Pod ctest-pod-86752382] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:22:45,928 - DEBUG - [Pod Pod ctest-pod-86752382] Cmd output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:22:50,987 - DEBUG - [Pod ctest-pod-86752382] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:22:50,987 - DEBUG - [Pod Pod ctest-pod-86752382] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:22:50,987 - DEBUG - [Pod Pod ctest-pod-86752382] Cmd output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:22:56,039 - DEBUG - [Pod ctest-pod-86752382] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:22:56,039 - DEBUG - [Pod Pod ctest-pod-86752382] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:22:56,040 - DEBUG - [Pod Pod ctest-pod-86752382] Cmd output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:23:01,098 - DEBUG - [Pod ctest-pod-86752382] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:23:01,098 - DEBUG - [Pod Pod ctest-pod-86752382] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:23:01,098 - DEBUG - [Pod Pod ctest-pod-86752382] Cmd output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:23:04,690 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2025-07-09 09:23:14,757 - DEBUG - [Pod ctest-pod-86752382] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:23:14,757 - DEBUG - [Pod Pod ctest-pod-86752382] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:23:14,757 - DEBUG - [Pod Pod ctest-pod-86752382] Cmd output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:23:19,829 - DEBUG - [Pod ctest-pod-86752382] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:23:19,829 - DEBUG - [Pod Pod ctest-pod-86752382] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:23:19,829 - DEBUG - [Pod Pod ctest-pod-86752382] Cmd output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:23:19,829 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-15722059': 0, 'ctest-pod-22457658': 0}
2025-07-09 09:23:21,883 - DEBUG - [Pod ctest-pod-09594293] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.435 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.087 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.115 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.087/0.212/0.435 ms
2025-07-09 09:23:21,884 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-09594293 with expectation True passed
2025-07-09 09:23:23,935 - DEBUG - [Pod ctest-pod-61319584] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.905 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.092 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.103 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.092/0.366/0.905 ms
2025-07-09 09:23:23,936 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-61319584 with expectation True passed
2025-07-09 09:23:25,996 - DEBUG - [Pod ctest-pod-86752382] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.157 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.092 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.091 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.091/0.446/1.157 ms
2025-07-09 09:23:25,996 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-86752382 with expectation True passed
2025-07-09 09:23:26,055 - DEBUG - [Pod ctest-pod-09594293] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-09 09:23:26,055 - DEBUG - [Pod Pod ctest-pod-09594293] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-07-09 09:23:26,055 - DEBUG - [Pod Pod ctest-pod-09594293] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-09 09:23:26,055 - INFO - wget check of of http://10.47.255.251 from ctest-pod-09594293 passed
2025-07-09 09:23:26,111 - DEBUG - [Pod ctest-pod-09594293] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-09 09:23:26,111 - DEBUG - [Pod Pod ctest-pod-09594293] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-07-09 09:23:26,111 - DEBUG - [Pod Pod ctest-pod-09594293] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-09 09:23:26,111 - INFO - wget check of of http://10.47.255.250 from ctest-pod-09594293 passed
2025-07-09 09:23:31,167 - DEBUG - [Pod ctest-pod-61319584] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-07-09 09:23:31,168 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-07-09 09:23:31,168 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-07-09 09:23:31,168 - INFO - wget check of of http://10.47.255.250 from ctest-pod-61319584 passed
2025-07-09 09:23:36,233 - DEBUG - [Pod ctest-pod-58093274] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-07-09 09:23:36,233 - DEBUG - [Pod Pod ctest-pod-58093274] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-07-09 09:23:36,233 - DEBUG - [Pod Pod ctest-pod-58093274] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-07-09 09:23:36,233 - INFO - wget check of of http://10.47.255.251 from ctest-pod-58093274 passed
2025-07-09 09:23:36,242 - INFO - Updating Network Policy ingress-on-service
2025-07-09 09:23:41,307 - DEBUG - [Pod ctest-pod-61319584] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:23:41,307 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:23:41,307 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:23:46,359 - DEBUG - [Pod ctest-pod-61319584] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:23:46,359 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:23:46,359 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:23:51,413 - DEBUG - [Pod ctest-pod-61319584] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:23:51,413 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:23:51,413 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:23:56,468 - DEBUG - [Pod ctest-pod-61319584] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:23:56,468 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:23:56,468 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:24:01,516 - DEBUG - [Pod ctest-pod-61319584] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:24:01,516 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:24:01,516 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:24:06,563 - DEBUG - [Pod ctest-pod-61319584] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:24:06,564 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:24:06,564 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:24:11,625 - DEBUG - [Pod ctest-pod-61319584] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:24:11,625 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:24:11,625 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:24:16,678 - DEBUG - [Pod ctest-pod-61319584] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:24:16,678 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:24:16,678 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:24:21,733 - DEBUG - [Pod ctest-pod-61319584] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:24:21,734 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:24:21,734 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:24:26,781 - DEBUG - [Pod ctest-pod-61319584] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:24:26,781 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:24:26,781 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
wget: download timed out
2025-07-09 09:24:26,781 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-15722059': 0, 'ctest-pod-22457658': 0}
2025-07-09 09:24:26,838 - DEBUG - [Pod ctest-pod-09594293] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: ctest-pod-15722059
Connecting to 10.99.108.253:80 (10.99.108.253:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-09 09:24:26,838 - DEBUG - [Pod Pod ctest-pod-09594293] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 passed
2025-07-09 09:24:26,838 - DEBUG - [Pod Pod ctest-pod-09594293] Cmd output: ctest-pod-15722059
Connecting to 10.99.108.253:80 (10.99.108.253:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-09 09:24:26,890 - DEBUG - [Pod ctest-pod-09594293] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-22457658
2025-07-09 09:24:26,890 - DEBUG - [Pod Pod ctest-pod-09594293] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 passed
2025-07-09 09:24:26,890 - DEBUG - [Pod Pod ctest-pod-09594293] Cmd output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-22457658
2025-07-09 09:24:26,890 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-15722059': 1, 'ctest-pod-22457658': 1}
2025-07-09 09:24:26,943 - DEBUG - [Pod ctest-pod-86752382] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: ctest-pod-22457658
Connecting to 10.99.108.253:80 (10.99.108.253:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-09 09:24:26,943 - DEBUG - [Pod Pod ctest-pod-86752382] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 passed
2025-07-09 09:24:26,943 - DEBUG - [Pod Pod ctest-pod-86752382] Cmd output: ctest-pod-22457658
Connecting to 10.99.108.253:80 (10.99.108.253:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-09 09:24:27,001 - DEBUG - [Pod ctest-pod-86752382] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: ctest-pod-22457658
Connecting to 10.99.108.253:80 (10.99.108.253:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-09 09:24:27,001 - DEBUG - [Pod Pod ctest-pod-86752382] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 passed
2025-07-09 09:24:27,001 - DEBUG - [Pod Pod ctest-pod-86752382] Cmd output: ctest-pod-22457658
Connecting to 10.99.108.253:80 (10.99.108.253:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-09 09:24:27,050 - DEBUG - [Pod ctest-pod-86752382] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: ctest-pod-22457658
Connecting to 10.99.108.253:80 (10.99.108.253:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-09 09:24:27,050 - DEBUG - [Pod Pod ctest-pod-86752382] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 passed
2025-07-09 09:24:27,050 - DEBUG - [Pod Pod ctest-pod-86752382] Cmd output: ctest-pod-22457658
Connecting to 10.99.108.253:80 (10.99.108.253:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-09 09:24:27,106 - DEBUG - [Pod ctest-pod-86752382] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-22457658
2025-07-09 09:24:27,108 - DEBUG - [Pod Pod ctest-pod-86752382] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 passed
2025-07-09 09:24:27,108 - DEBUG - [Pod Pod ctest-pod-86752382] Cmd output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-22457658
2025-07-09 09:24:27,162 - DEBUG - [Pod ctest-pod-86752382] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: ctest-pod-22457658
Connecting to 10.99.108.253:80 (10.99.108.253:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-09 09:24:27,162 - DEBUG - [Pod Pod ctest-pod-86752382] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 passed
2025-07-09 09:24:27,163 - DEBUG - [Pod Pod ctest-pod-86752382] Cmd output: ctest-pod-22457658
Connecting to 10.99.108.253:80 (10.99.108.253:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-09 09:24:27,223 - DEBUG - [Pod ctest-pod-86752382] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: ctest-pod-22457658
Connecting to 10.99.108.253:80 (10.99.108.253:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-09 09:24:27,223 - DEBUG - [Pod Pod ctest-pod-86752382] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 passed
2025-07-09 09:24:27,223 - DEBUG - [Pod Pod ctest-pod-86752382] Cmd output: ctest-pod-22457658
Connecting to 10.99.108.253:80 (10.99.108.253:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-09 09:24:27,281 - DEBUG - [Pod ctest-pod-86752382] Cmd: wget http://10.99.108.253:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
ctest-pod-15722059
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-09 09:24:27,282 - DEBUG - [Pod Pod ctest-pod-86752382] Cmd wget http://10.99.108.253:80/ -O - -T 5 -t 1 passed
2025-07-09 09:24:27,282 - DEBUG - [Pod Pod ctest-pod-86752382] Cmd output: Connecting to 10.99.108.253:80 (10.99.108.253:80)
ctest-pod-15722059
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-07-09 09:24:27,282 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-15722059': 1, 'ctest-pod-22457658': 6}
2025-07-09 09:24:29,336 - DEBUG - [Pod ctest-pod-09594293] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.883 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.081 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.085 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.081/0.349/0.883 ms
2025-07-09 09:24:29,336 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-09594293 with expectation True passed
2025-07-09 09:24:31,394 - DEBUG - [Pod ctest-pod-61319584] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.288 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.080 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.099 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.080/0.489/1.288 ms
2025-07-09 09:24:31,394 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-61319584 with expectation True passed
2025-07-09 09:24:33,447 - DEBUG - [Pod ctest-pod-86752382] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.820 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.078 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.107 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.078/0.335/0.820 ms
2025-07-09 09:24:33,447 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-86752382 with expectation True passed
2025-07-09 09:24:33,501 - DEBUG - [Pod ctest-pod-09594293] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-09 09:24:33,502 - DEBUG - [Pod Pod ctest-pod-09594293] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-07-09 09:24:33,502 - DEBUG - [Pod Pod ctest-pod-09594293] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-09 09:24:33,502 - INFO - wget check of of http://10.47.255.251 from ctest-pod-09594293 passed
2025-07-09 09:24:33,560 - DEBUG - [Pod ctest-pod-09594293] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-09 09:24:33,560 - DEBUG - [Pod Pod ctest-pod-09594293] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-07-09 09:24:33,561 - DEBUG - [Pod Pod ctest-pod-09594293] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-09 09:24:33,561 - INFO - wget check of of http://10.47.255.250 from ctest-pod-09594293 passed
2025-07-09 09:24:38,608 - DEBUG - [Pod ctest-pod-61319584] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-07-09 09:24:38,608 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-07-09 09:24:38,608 - DEBUG - [Pod Pod ctest-pod-61319584] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-07-09 09:24:38,608 - INFO - wget check of of http://10.47.255.250 from ctest-pod-61319584 passed
2025-07-09 09:24:38,667 - DEBUG - [Pod ctest-pod-58093274] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-09 09:24:38,667 - DEBUG - [Pod Pod ctest-pod-58093274] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-07-09 09:24:38,667 - DEBUG - [Pod Pod ctest-pod-58093274] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-07-09 09:24:38,667 - INFO - wget check of of http://10.47.255.251 from ctest-pod-58093274 passed
2025-07-09 09:24:38,667 - INFO - Deleting Network Policy : ingress-on-service
2025-07-09 09:24:38,668 - INFO - Deleting service : ctest-nginx-svc-26358408
2025-07-09 09:24:38,916 - DEBUG - No XMPP flaps were noticed during the test
2025-07-09 09:24:38,916 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:14]
2025-07-09 09:24:38,916 - INFO - --------------------------------------------------------------------------------
2025-07-09 09:24:38,920 - INFO - Deleting pod ctest-new-default-24819908:ctest-pod-15722059
2025-07-09 09:24:38,921 - INFO - Deleting pod ctest-new-default-24819908:ctest-pod-22457658
2025-07-09 09:24:38,921 - INFO - Deleting pod ctest-non-default-08825650:ctest-pod-64694221
2025-07-09 09:24:38,922 - INFO - Deleting pod ctest-non-default-08825650:ctest-pod-50974295
2025-07-09 09:24:38,922 - INFO - Deleting pod ctest-new-default-24819908:ctest-pod-61319584
2025-07-09 09:24:38,922 - INFO - Deleting pod ctest-new-default-24819908:ctest-pod-09594293
2025-07-09 09:24:38,922 - INFO - Deleting pod ctest-non-default-08825650:ctest-pod-86752382
2025-07-09 09:24:38,923 - INFO - Deleting pod ctest-non-default-08825650:ctest-pod-58093274
2025-07-09 09:24:39,108 - WARNING - Pod uuid 4b662acf-4b19-4a7d-89f0-44f53f6af73c is still seen in agent 10.0.0.129 VM list
2025-07-09 09:24:39,109 - WARNING - Pod uuid e16dcadd-b83c-49a7-b0c1-af71a9abcfa8 is still seen in agent 10.0.0.129 VM list
2025-07-09 09:24:39,109 - WARNING - Pod uuid 76e44c0e-2d1a-41ff-a8f1-70c2ce7144dd is still seen in agent 10.0.0.129 VM list
2025-07-09 09:24:39,110 - WARNING - Pod uuid 20db3bc5-d618-4f6f-936e-6c705ee80372 is still seen in agent 10.0.0.129 VM list
2025-07-09 09:24:39,110 - WARNING - Pod uuid c71b3098-602a-40b9-af03-26b1451e928a is still seen in agent 10.0.0.129 VM list
2025-07-09 09:24:39,111 - WARNING - Pod uuid 9fb0714a-7a47-4fb0-a9a7-fcc328983e96 is still seen in agent 10.0.0.129 VM list
2025-07-09 09:24:39,112 - WARNING - Pod uuid 84c8b8c2-3520-4f1d-88c1-9ffb24364364 is still seen in agent 10.0.0.129 VM list
2025-07-09 09:24:39,112 - WARNING - Pod uuid 171cec56-5ee3-4780-a08c-5d64f90a9c78 is still seen in agent 10.0.0.129 VM list
2025-07-09 09:24:44,142 - WARNING - Pod uuid 171cec56-5ee3-4780-a08c-5d64f90a9c78 is still seen in agent 10.0.0.129 VM list
2025-07-09 09:24:44,143 - WARNING - Pod uuid e16dcadd-b83c-49a7-b0c1-af71a9abcfa8 is still seen in agent 10.0.0.129 VM list
2025-07-09 09:24:44,143 - DEBUG - Pod c71b3098-602a-40b9-af03-26b1451e928a is not in agent 10.0.0.129 VM list
2025-07-09 09:24:44,145 - WARNING - Pod uuid 76e44c0e-2d1a-41ff-a8f1-70c2ce7144dd is still seen in agent 10.0.0.129 VM list
2025-07-09 09:24:44,145 - DEBUG - Pod 4b662acf-4b19-4a7d-89f0-44f53f6af73c is not in agent 10.0.0.129 VM list
2025-07-09 09:24:44,147 - DEBUG - Pod 20db3bc5-d618-4f6f-936e-6c705ee80372 is not in agent 10.0.0.129 VM list
2025-07-09 09:24:44,151 - WARNING - Pod uuid 9fb0714a-7a47-4fb0-a9a7-fcc328983e96 is still seen in agent 10.0.0.129 VM list
2025-07-09 09:24:44,151 - WARNING - Pod uuid 84c8b8c2-3520-4f1d-88c1-9ffb24364364 is still seen in agent 10.0.0.129 VM list
2025-07-09 09:24:44,160 - DEBUG - VMI 0a06c8c8-5ca6-11f0-b464-fa163e2f652b is removed from agent 10.0.0.129
2025-07-09 09:24:44,160 - INFO - Verified that pod ctest-pod-15722059 is removed in agent
2025-07-09 09:24:44,162 - DEBUG - VMI 0b428970-5ca6-11f0-b464-fa163e2f652b is removed from agent 10.0.0.129
2025-07-09 09:24:44,162 - INFO - Verified that pod ctest-pod-64694221 is removed in agent
2025-07-09 09:24:44,162 - DEBUG - VMI 0bd07168-5ca6-11f0-b464-fa163e2f652b is removed from agent 10.0.0.129
2025-07-09 09:24:44,162 - INFO - Verified that pod ctest-pod-50974295 is removed in agent
2025-07-09 09:24:49,157 - WARNING - Pod uuid 171cec56-5ee3-4780-a08c-5d64f90a9c78 is still seen in agent 10.0.0.129 VM list
2025-07-09 09:24:49,162 - WARNING - Pod uuid 84c8b8c2-3520-4f1d-88c1-9ffb24364364 is still seen in agent 10.0.0.129 VM list
2025-07-09 09:24:49,163 - WARNING - Pod uuid 76e44c0e-2d1a-41ff-a8f1-70c2ce7144dd is still seen in agent 10.0.0.129 VM list
2025-07-09 09:24:49,163 - WARNING - Pod uuid e16dcadd-b83c-49a7-b0c1-af71a9abcfa8 is still seen in agent 10.0.0.129 VM list
2025-07-09 09:24:49,163 - WARNING - Pod uuid 9fb0714a-7a47-4fb0-a9a7-fcc328983e96 is still seen in agent 10.0.0.129 VM list
2025-07-09 09:24:54,171 - WARNING - Pod uuid 171cec56-5ee3-4780-a08c-5d64f90a9c78 is still seen in agent 10.0.0.129 VM list
2025-07-09 09:24:54,185 - WARNING - Pod uuid 9fb0714a-7a47-4fb0-a9a7-fcc328983e96 is still seen in agent 10.0.0.129 VM list
2025-07-09 09:24:54,185 - WARNING - Pod uuid 76e44c0e-2d1a-41ff-a8f1-70c2ce7144dd is still seen in agent 10.0.0.129 VM list
2025-07-09 09:24:54,185 - WARNING - Pod uuid 84c8b8c2-3520-4f1d-88c1-9ffb24364364 is still seen in agent 10.0.0.129 VM list
2025-07-09 09:24:54,186 - WARNING - Pod uuid e16dcadd-b83c-49a7-b0c1-af71a9abcfa8 is still seen in agent 10.0.0.129 VM list
2025-07-09 09:24:59,180 - WARNING - Pod uuid 171cec56-5ee3-4780-a08c-5d64f90a9c78 is still seen in agent 10.0.0.129 VM list
2025-07-09 09:24:59,203 - WARNING - Pod uuid 76e44c0e-2d1a-41ff-a8f1-70c2ce7144dd is still seen in agent 10.0.0.129 VM list
2025-07-09 09:24:59,204 - WARNING - Pod uuid e16dcadd-b83c-49a7-b0c1-af71a9abcfa8 is still seen in agent 10.0.0.129 VM list
2025-07-09 09:24:59,205 - WARNING - Pod uuid 84c8b8c2-3520-4f1d-88c1-9ffb24364364 is still seen in agent 10.0.0.129 VM list
2025-07-09 09:24:59,205 - WARNING - Pod uuid 9fb0714a-7a47-4fb0-a9a7-fcc328983e96 is still seen in agent 10.0.0.129 VM list
2025-07-09 09:25:04,192 - WARNING - Pod uuid 171cec56-5ee3-4780-a08c-5d64f90a9c78 is still seen in agent 10.0.0.129 VM list
2025-07-09 09:25:04,223 - WARNING - Pod uuid e16dcadd-b83c-49a7-b0c1-af71a9abcfa8 is still seen in agent 10.0.0.129 VM list
2025-07-09 09:25:04,223 - WARNING - Pod uuid 76e44c0e-2d1a-41ff-a8f1-70c2ce7144dd is still seen in agent 10.0.0.129 VM list
2025-07-09 09:25:04,225 - WARNING - Pod uuid 84c8b8c2-3520-4f1d-88c1-9ffb24364364 is still seen in agent 10.0.0.129 VM list
2025-07-09 09:25:04,225 - WARNING - Pod uuid 9fb0714a-7a47-4fb0-a9a7-fcc328983e96 is still seen in agent 10.0.0.129 VM list
2025-07-09 09:25:09,260 - WARNING - Pod uuid 171cec56-5ee3-4780-a08c-5d64f90a9c78 is still seen in agent 10.0.0.129 VM list
2025-07-09 09:25:09,269 - WARNING - Pod uuid e16dcadd-b83c-49a7-b0c1-af71a9abcfa8 is still seen in agent 10.0.0.129 VM list
2025-07-09 09:25:09,269 - WARNING - Pod uuid 84c8b8c2-3520-4f1d-88c1-9ffb24364364 is still seen in agent 10.0.0.129 VM list
2025-07-09 09:25:09,271 - WARNING - Pod uuid 9fb0714a-7a47-4fb0-a9a7-fcc328983e96 is still seen in agent 10.0.0.129 VM list
2025-07-09 09:25:09,271 - WARNING - Pod uuid 76e44c0e-2d1a-41ff-a8f1-70c2ce7144dd is still seen in agent 10.0.0.129 VM list
2025-07-09 09:25:14,268 - DEBUG - Pod 171cec56-5ee3-4780-a08c-5d64f90a9c78 is not in agent 10.0.0.129 VM list
2025-07-09 09:25:14,291 - DEBUG - Pod e16dcadd-b83c-49a7-b0c1-af71a9abcfa8 is not in agent 10.0.0.129 VM list
2025-07-09 09:25:14,295 - DEBUG - Pod 9fb0714a-7a47-4fb0-a9a7-fcc328983e96 is not in agent 10.0.0.129 VM list
2025-07-09 09:25:14,296 - DEBUG - VMI 0d5e4032-5ca6-11f0-b464-fa163e2f652b is removed from agent 10.0.0.129
2025-07-09 09:25:14,296 - INFO - Verified that pod ctest-pod-86752382 is removed in agent
2025-07-09 09:25:14,297 - DEBUG - Pod 76e44c0e-2d1a-41ff-a8f1-70c2ce7144dd is not in agent 10.0.0.129 VM list
2025-07-09 09:25:14,298 - DEBUG - Pod 84c8b8c2-3520-4f1d-88c1-9ffb24364364 is not in agent 10.0.0.129 VM list
2025-07-09 09:25:14,313 - DEBUG - VMI 0a818d24-5ca6-11f0-b464-fa163e2f652b is removed from agent 10.0.0.129
2025-07-09 09:25:14,313 - INFO - Verified that pod ctest-pod-22457658 is removed in agent
2025-07-09 09:25:14,314 - DEBUG - VMI 0c613b26-5ca6-11f0-b464-fa163e2f652b is removed from agent 10.0.0.129
2025-07-09 09:25:14,314 - INFO - Verified that pod ctest-pod-61319584 is removed in agent
2025-07-09 09:25:14,315 - DEBUG - VMI 0cde3ac2-5ca6-11f0-b464-fa163e2f652b is removed from agent 10.0.0.129
2025-07-09 09:25:14,315 - INFO - Verified that pod ctest-pod-09594293 is removed in agent
2025-07-09 09:25:14,316 - DEBUG - VMI 0ddf07e4-5ca6-11f0-b464-fa163e2f652b is removed from agent 10.0.0.129
2025-07-09 09:25:14,316 - INFO - Verified that pod ctest-pod-58093274 is removed in agent
2025-07-09 09:25:14,316 - INFO - Deleting namespace ctest-non-default-08825650
2025-07-09 09:25:14,335 - DEBUG - Namespace ctest-non-default-08825650 still in k8s
2025-07-09 09:25:16,340 - DEBUG - Namespace ctest-non-default-08825650 still in k8s
2025-07-09 09:25:18,345 - DEBUG - Namespace ctest-non-default-08825650 still in k8s
2025-07-09 09:25:20,349 - DEBUG - Namespace ctest-non-default-08825650 is not in k8s
2025-07-09 09:25:20,349 - DEBUG - No need to check project deletion in contrail-api
2025-07-09 09:25:20,350 - INFO - Deleting namespace ctest-new-default-24819908
2025-07-09 09:25:20,359 - DEBUG - Namespace ctest-new-default-24819908 still in k8s
2025-07-09 09:25:22,367 - DEBUG - Namespace ctest-new-default-24819908 still in k8s
2025-07-09 09:25:24,373 - DEBUG - Namespace ctest-new-default-24819908 still in k8s
2025-07-09 09:25:26,376 - DEBUG - Namespace ctest-new-default-24819908 is not in k8s
2025-07-09 09:25:26,376 - DEBUG - No need to check project deletion in contrail-api