2025-06-26 02:02:38,371 - INFO - Using existing project ['default-domain', 'k8s-default'](bd39e0ef-11d5-40a5-9419-7f7d657fabc6)
2025-06-26 02:02:38,389 - DEBUG - Namespace ctest-new-default-44868559 not present
2025-06-26 02:02:38,402 - INFO - Created namespace ctest-new-default-44868559
2025-06-26 02:02:41,408 - DEBUG - Namespace ctest-non-default-96493591 not present
2025-06-26 02:02:41,419 - INFO - Created namespace ctest-non-default-96493591
2025-06-26 02:02:44,450 - DEBUG - Pod ctest-pod-21454412 not present
2025-06-26 02:02:44,451 - INFO - Creating Pod ctest-pod-21454412
2025-06-26 02:02:44,483 - DEBUG - Pod : ctest-pod-21454412 UUID is ed60d178-2298-4043-8384-8b11056c9540
2025-06-26 02:02:44,501 - DEBUG - Pod ctest-pod-07791848 not present
2025-06-26 02:02:44,501 - INFO - Creating Pod ctest-pod-07791848
2025-06-26 02:02:44,528 - DEBUG - Pod : ctest-pod-07791848 UUID is e9a962dd-19f5-410c-b0da-966f8470ffc9
2025-06-26 02:02:44,530 - DEBUG - Pod ctest-pod-06103271 not present
2025-06-26 02:02:44,530 - INFO - Creating Pod ctest-pod-06103271
2025-06-26 02:02:44,570 - DEBUG - Pod : ctest-pod-06103271 UUID is 002013d3-595d-46b7-9697-b1c32c457950
2025-06-26 02:02:44,572 - DEBUG - Pod ctest-pod-09408021 not present
2025-06-26 02:02:44,573 - INFO - Creating Pod ctest-pod-09408021
2025-06-26 02:02:44,600 - DEBUG - Pod : ctest-pod-09408021 UUID is 1df11122-dc4c-42cc-a433-2997399ec9a7
2025-06-26 02:02:44,602 - DEBUG - Pod ctest-pod-37664845 not present
2025-06-26 02:02:44,602 - INFO - Creating Pod ctest-pod-37664845
2025-06-26 02:02:44,621 - DEBUG - Pod : ctest-pod-37664845 UUID is 81fc256c-32e5-4c1f-ab76-43ef4b390363
2025-06-26 02:02:44,630 - DEBUG - Pod ctest-pod-77600086 not present
2025-06-26 02:02:44,630 - INFO - Creating Pod ctest-pod-77600086
2025-06-26 02:02:44,646 - DEBUG - Pod : ctest-pod-77600086 UUID is befaa48c-81ff-4c12-81a8-637a0a4175d3
2025-06-26 02:02:44,649 - DEBUG - Pod ctest-pod-12876759 not present
2025-06-26 02:02:44,649 - INFO - Creating Pod ctest-pod-12876759
2025-06-26 02:02:44,677 - DEBUG - Pod : ctest-pod-12876759 UUID is a1fd166c-71bd-4cbb-92f4-273343342499
2025-06-26 02:02:44,679 - DEBUG - Pod ctest-pod-46324807 not present
2025-06-26 02:02:44,680 - INFO - Creating Pod ctest-pod-46324807
2025-06-26 02:02:44,716 - DEBUG - Pod : ctest-pod-46324807 UUID is 16df801e-9a16-4fdc-bea4-8ec7fb3058d0
2025-06-26 02:02:44,903 - INFO - Project default-domain:k8s-ctest-new-default-44868559 for Namespace ctest-new-default-44868559 is seen in contrail-api
2025-06-26 02:02:44,904 - DEBUG - Project uuid in Contrail is ec0c903a-cde2-46a3-aaa6-549ec78e11d5
2025-06-26 02:02:45,087 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_NamespaceDatabaseList?namespace_uuid=30ef8a16-a1fe-4ad0-b004-de1885d44902
2025-06-26 02:02:45,094 - INFO - Namespace ctest-new-default-44868559 with uuid 30ef8a16-a1fe-4ad0-b004-de1885d44902 found in kube manager
2025-06-26 02:02:45,094 - INFO - Namespace ctest-new-default-44868559 verification passed
2025-06-26 02:02:45,247 - INFO - Project default-domain:k8s-ctest-non-default-96493591 for Namespace ctest-non-default-96493591 is seen in contrail-api
2025-06-26 02:02:45,247 - DEBUG - Project uuid in Contrail is 7a7bb2b8-c588-4644-8441-06d4553766f1
2025-06-26 02:02:45,247 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_NamespaceDatabaseList?namespace_uuid=19156fde-3c79-4b9a-813c-8b716dd79e20
2025-06-26 02:02:45,252 - INFO - Namespace ctest-non-default-96493591 with uuid 19156fde-3c79-4b9a-813c-8b716dd79e20 found in kube manager
2025-06-26 02:02:45,252 - INFO - Namespace ctest-non-default-96493591 verification passed
2025-06-26 02:02:45,258 - DEBUG - Pod ctest-pod-21454412 not in running state.Currently in Pending
2025-06-26 02:02:50,272 - DEBUG - Pod ctest-pod-21454412 not in running state.Currently in Pending
2025-06-26 02:02:55,283 - INFO - Pod ctest-pod-21454412 is in running state.Got IP 10.47.255.251
2025-06-26 02:02:55,296 - DEBUG - Pod ctest-pod-21454412 has vmi a74b9ec6-5231-11f0-ba63-fa163e6b0b54
2025-06-26 02:02:55,296 - INFO - Verified pod ctest-pod-21454412 in contrail-api
2025-06-26 02:02:55,309 - DEBUG - VMI a74b9ec6-5231-11f0-ba63-fa163e6b0b54 is active in agent 10.0.0.22
2025-06-26 02:02:55,310 - INFO - Verified Pod ctest-pod-21454412 in agent 10.0.0.22
2025-06-26 02:02:55,310 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=ed60d178-2298-4043-8384-8b11056c9540
2025-06-26 02:02:55,314 - INFO - Pod ctest-pod-21454412 with uuid ed60d178-2298-4043-8384-8b11056c9540 found in kube manager
2025-06-26 02:02:55,315 - INFO - Pod ctest-pod-21454412 verification passed
2025-06-26 02:02:55,320 - INFO - Pod ctest-pod-07791848 is in running state.Got IP 10.47.255.250
2025-06-26 02:02:55,379 - DEBUG - Pod ctest-pod-07791848 has vmi a7cb8172-5231-11f0-ba63-fa163e6b0b54
2025-06-26 02:02:55,379 - INFO - Verified pod ctest-pod-07791848 in contrail-api
2025-06-26 02:02:55,391 - DEBUG - VMI a7cb8172-5231-11f0-ba63-fa163e6b0b54 is active in agent 10.0.0.22
2025-06-26 02:02:55,391 - INFO - Verified Pod ctest-pod-07791848 in agent 10.0.0.22
2025-06-26 02:02:55,392 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=e9a962dd-19f5-410c-b0da-966f8470ffc9
2025-06-26 02:02:55,396 - INFO - Pod ctest-pod-07791848 with uuid e9a962dd-19f5-410c-b0da-966f8470ffc9 found in kube manager
2025-06-26 02:02:55,396 - INFO - Pod ctest-pod-07791848 verification passed
2025-06-26 02:02:55,412 - INFO - Pod ctest-pod-06103271 is in running state.Got IP 10.47.255.249
2025-06-26 02:02:55,428 - DEBUG - Pod ctest-pod-06103271 has vmi a87828d2-5231-11f0-ba63-fa163e6b0b54
2025-06-26 02:02:55,429 - INFO - Verified pod ctest-pod-06103271 in contrail-api
2025-06-26 02:02:55,440 - DEBUG - VMI a87828d2-5231-11f0-ba63-fa163e6b0b54 is active in agent 10.0.0.22
2025-06-26 02:02:55,440 - INFO - Verified Pod ctest-pod-06103271 in agent 10.0.0.22
2025-06-26 02:02:55,441 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=002013d3-595d-46b7-9697-b1c32c457950
2025-06-26 02:02:55,445 - INFO - Pod ctest-pod-06103271 with uuid 002013d3-595d-46b7-9697-b1c32c457950 found in kube manager
2025-06-26 02:02:55,445 - INFO - Pod ctest-pod-06103271 verification passed
2025-06-26 02:02:55,454 - INFO - Pod ctest-pod-09408021 is in running state.Got IP 10.47.255.248
2025-06-26 02:02:55,511 - DEBUG - Pod ctest-pod-09408021 has vmi a905c854-5231-11f0-ba63-fa163e6b0b54
2025-06-26 02:02:55,511 - INFO - Verified pod ctest-pod-09408021 in contrail-api
2025-06-26 02:02:55,523 - DEBUG - VMI a905c854-5231-11f0-ba63-fa163e6b0b54 is active in agent 10.0.0.22
2025-06-26 02:02:55,524 - INFO - Verified Pod ctest-pod-09408021 in agent 10.0.0.22
2025-06-26 02:02:55,524 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=1df11122-dc4c-42cc-a433-2997399ec9a7
2025-06-26 02:02:55,528 - INFO - Pod ctest-pod-09408021 with uuid 1df11122-dc4c-42cc-a433-2997399ec9a7 found in kube manager
2025-06-26 02:02:55,528 - INFO - Pod ctest-pod-09408021 verification passed
2025-06-26 02:02:55,534 - DEBUG - Pod ctest-pod-37664845 not in running state.Currently in Pending
2025-06-26 02:03:00,541 - INFO - Pod ctest-pod-37664845 is in running state.Got IP 10.47.255.247
2025-06-26 02:03:00,564 - DEBUG - Pod ctest-pod-37664845 has vmi a9ad7176-5231-11f0-ba63-fa163e6b0b54
2025-06-26 02:03:00,564 - INFO - Verified pod ctest-pod-37664845 in contrail-api
2025-06-26 02:03:00,584 - DEBUG - VMI a9ad7176-5231-11f0-ba63-fa163e6b0b54 is active in agent 10.0.0.22
2025-06-26 02:03:00,584 - INFO - Verified Pod ctest-pod-37664845 in agent 10.0.0.22
2025-06-26 02:03:00,584 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=81fc256c-32e5-4c1f-ab76-43ef4b390363
2025-06-26 02:03:00,591 - INFO - Pod ctest-pod-37664845 with uuid 81fc256c-32e5-4c1f-ab76-43ef4b390363 found in kube manager
2025-06-26 02:03:00,592 - INFO - Pod ctest-pod-37664845 verification passed
2025-06-26 02:03:00,677 - INFO - Pod ctest-pod-12876759 is in running state.Got IP 10.47.255.245
2025-06-26 02:03:00,735 - DEBUG - Pod ctest-pod-12876759 has vmi aaa86fae-5231-11f0-ba63-fa163e6b0b54
2025-06-26 02:03:00,735 - INFO - Verified pod ctest-pod-12876759 in contrail-api
2025-06-26 02:03:00,754 - DEBUG - VMI aaa86fae-5231-11f0-ba63-fa163e6b0b54 is active in agent 10.0.0.22
2025-06-26 02:03:00,754 - INFO - Verified Pod ctest-pod-12876759 in agent 10.0.0.22
2025-06-26 02:03:00,754 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=a1fd166c-71bd-4cbb-92f4-273343342499
2025-06-26 02:03:00,763 - INFO - Pod ctest-pod-12876759 with uuid a1fd166c-71bd-4cbb-92f4-273343342499 found in kube manager
2025-06-26 02:03:00,763 - INFO - Pod ctest-pod-12876759 verification passed
2025-06-26 02:03:00,769 - DEBUG - Pod ctest-pod-77600086 not in running state.Currently in Pending
2025-06-26 02:03:05,776 - INFO - Pod ctest-pod-77600086 is in running state.Got IP 10.47.255.246
2025-06-26 02:03:05,790 - DEBUG - Pod ctest-pod-77600086 has vmi aa2c7dcc-5231-11f0-ba63-fa163e6b0b54
2025-06-26 02:03:05,790 - INFO - Verified pod ctest-pod-77600086 in contrail-api
2025-06-26 02:03:05,804 - DEBUG - VMI aa2c7dcc-5231-11f0-ba63-fa163e6b0b54 is active in agent 10.0.0.22
2025-06-26 02:03:05,804 - INFO - Verified Pod ctest-pod-77600086 in agent 10.0.0.22
2025-06-26 02:03:05,804 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=befaa48c-81ff-4c12-81a8-637a0a4175d3
2025-06-26 02:03:05,809 - INFO - Pod ctest-pod-77600086 with uuid befaa48c-81ff-4c12-81a8-637a0a4175d3 found in kube manager
2025-06-26 02:03:05,809 - INFO - Pod ctest-pod-77600086 verification passed
2025-06-26 02:03:05,814 - INFO - Pod ctest-pod-46324807 is in running state.Got IP 10.47.255.244
2025-06-26 02:03:05,871 - DEBUG - Pod ctest-pod-46324807 has vmi ab20947a-5231-11f0-ba63-fa163e6b0b54
2025-06-26 02:03:05,871 - INFO - Verified pod ctest-pod-46324807 in contrail-api
2025-06-26 02:03:05,886 - DEBUG - VMI ab20947a-5231-11f0-ba63-fa163e6b0b54 is active in agent 10.0.0.22
2025-06-26 02:03:05,886 - INFO - Verified Pod ctest-pod-46324807 in agent 10.0.0.22
2025-06-26 02:03:05,886 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_VirtualMachineDatabaseList?x=16df801e-9a16-4fdc-bea4-8ec7fb3058d0
2025-06-26 02:03:05,891 - INFO - Pod ctest-pod-46324807 with uuid 16df801e-9a16-4fdc-bea4-8ec7fb3058d0 found in kube manager
2025-06-26 02:03:05,891 - INFO - Pod ctest-pod-46324807 verification passed
2025-06-26 02:03:05,891 - INFO - ================================================================================
2025-06-26 02:03:05,892 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-06-26 02:03:05,892 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-06-26 02:03:06,107 - DEBUG - Nothing to compare xmpp stats {'10.0.0.22': {'10.0.0.38': '0'}} with
2025-06-26 02:03:06,107 - INFO - Initial checks done. Running the testcase now
2025-06-26 02:03:06,107 - INFO -
2025-06-26 02:03:06,175 - DEBUG - [Pod ctest-pod-21454412] Cmd: echo ctest-pod-21454412 > /usr/share/nginx/html/index.html, Output:
2025-06-26 02:03:06,232 - DEBUG - [Pod ctest-pod-07791848] Cmd: echo ctest-pod-07791848 > /usr/share/nginx/html/index.html, Output:
2025-06-26 02:03:06,286 - DEBUG - [Pod ctest-pod-06103271] Cmd: echo ctest-pod-06103271 > /usr/share/nginx/html/index.html, Output:
2025-06-26 02:03:06,342 - DEBUG - [Pod ctest-pod-09408021] Cmd: echo ctest-pod-09408021 > /usr/share/nginx/html/index.html, Output:
2025-06-26 02:03:06,346 - DEBUG - Service ctest-nginx-svc-87375854 not present
2025-06-26 02:03:06,346 - INFO - Creating service ctest-nginx-svc-87375854
2025-06-26 02:03:06,359 - INFO - Created Service ctest-nginx-svc-87375854
2025-06-26 02:03:06,372 - WARNING - Service UUID 9f3ea610-7457-423c-a365-ed2a9d151ac3 not yet found in contrail-api
2025-06-26 02:03:07,380 - INFO - Validated that Service ctest-nginx-svc-87375854 is seen in contrail-api
2025-06-26 02:03:07,380 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_LoadbalancerDatabaseList?x=9f3ea610-7457-423c-a365-ed2a9d151ac3
2025-06-26 02:03:07,385 - INFO - Service ctest-nginx-svc-87375854 with uuid 9f3ea610-7457-423c-a365-ed2a9d151ac3 found in kube manager
2025-06-26 02:03:07,385 - INFO - Service ctest-nginx-svc-87375854 verification passed
2025-06-26 02:03:08,453 - DEBUG - [Pod ctest-pod-37664845] Cmd: wget http://10.111.158.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-07791848
2025-06-26 02:03:08,453 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd wget http://10.111.158.79:80/ -O - -T 5 -t 1 passed
2025-06-26 02:03:08,453 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-07791848
2025-06-26 02:03:08,508 - DEBUG - [Pod ctest-pod-37664845] Cmd: wget http://10.111.158.79:80/ -O - -T 5 -t 1 , Output: ctest-pod-07791848
Connecting to 10.111.158.79:80 (10.111.158.79:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-26 02:03:08,508 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd wget http://10.111.158.79:80/ -O - -T 5 -t 1 passed
2025-06-26 02:03:08,508 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd output: ctest-pod-07791848
Connecting to 10.111.158.79:80 (10.111.158.79:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-26 02:03:08,571 - DEBUG - [Pod ctest-pod-37664845] Cmd: wget http://10.111.158.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-21454412
2025-06-26 02:03:08,572 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd wget http://10.111.158.79:80/ -O - -T 5 -t 1 passed
2025-06-26 02:03:08,572 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-21454412
2025-06-26 02:03:08,572 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-21454412': 1, 'ctest-pod-07791848': 2}
2025-06-26 02:03:08,640 - DEBUG - [Pod ctest-pod-12876759] Cmd: wget http://10.111.158.79:80/ -O - -T 5 -t 1 , Output: ctest-pod-07791848
Connecting to 10.111.158.79:80 (10.111.158.79:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-26 02:03:08,640 - DEBUG - [Pod Pod ctest-pod-12876759] Cmd wget http://10.111.158.79:80/ -O - -T 5 -t 1 passed
2025-06-26 02:03:08,640 - DEBUG - [Pod Pod ctest-pod-12876759] Cmd output: ctest-pod-07791848
Connecting to 10.111.158.79:80 (10.111.158.79:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-26 02:03:08,695 - DEBUG - [Pod ctest-pod-12876759] Cmd: wget http://10.111.158.79:80/ -O - -T 5 -t 1 , Output: ctest-pod-21454412
Connecting to 10.111.158.79:80 (10.111.158.79:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-26 02:03:08,695 - DEBUG - [Pod Pod ctest-pod-12876759] Cmd wget http://10.111.158.79:80/ -O - -T 5 -t 1 passed
2025-06-26 02:03:08,695 - DEBUG - [Pod Pod ctest-pod-12876759] Cmd output: ctest-pod-21454412
Connecting to 10.111.158.79:80 (10.111.158.79:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-26 02:03:08,695 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-21454412': 1, 'ctest-pod-07791848': 1}
2025-06-26 02:03:08,699 - DEBUG - Network policy ingress-on-service not present
2025-06-26 02:03:08,700 - INFO - Creating Network Policy ingress-on-service
2025-06-26 02:03:08,713 - INFO - Network policy found in k8s
2025-06-26 02:03:08,713 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=3314af93-1a6b-4065-a4b2-4e38c39ad983
2025-06-26 02:03:08,718 - INFO - Network Policy ingress-on-service with uuid 3314af93-1a6b-4065-a4b2-4e38c39ad983 found in kube manager
2025-06-26 02:03:08,760 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-06-26 02:03:08,760 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-06-26 02:03:08,760 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=3314af93-1a6b-4065-a4b2-4e38c39ad983
2025-06-26 02:03:08,791 - WARNING - Network policy with name ingress-on-service not found in agent
2025-06-26 02:03:10,792 - DEBUG - Requesting: http://10.0.0.38:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=3314af93-1a6b-4065-a4b2-4e38c39ad983
2025-06-26 02:03:10,827 - INFO - Network policy with name ingress-on-service found in agent
2025-06-26 02:03:10,828 - INFO - Network Policy ingress-on-service verification passed
2025-06-26 02:03:15,891 - DEBUG - [Pod ctest-pod-37664845] Cmd: wget http://10.111.158.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:03:15,891 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd wget http://10.111.158.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:03:15,891 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:03:20,955 - DEBUG - [Pod ctest-pod-37664845] Cmd: wget http://10.111.158.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:03:20,955 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd wget http://10.111.158.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:03:20,955 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:03:26,006 - DEBUG - [Pod ctest-pod-37664845] Cmd: wget http://10.111.158.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:03:26,006 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd wget http://10.111.158.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:03:26,006 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:03:31,062 - DEBUG - [Pod ctest-pod-37664845] Cmd: wget http://10.111.158.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:03:31,062 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd wget http://10.111.158.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:03:31,062 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:03:36,114 - DEBUG - [Pod ctest-pod-37664845] Cmd: wget http://10.111.158.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:03:36,114 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd wget http://10.111.158.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:03:36,114 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:03:41,165 - DEBUG - [Pod ctest-pod-37664845] Cmd: wget http://10.111.158.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:03:41,165 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd wget http://10.111.158.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:03:41,165 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:03:46,224 - DEBUG - [Pod ctest-pod-37664845] Cmd: wget http://10.111.158.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:03:46,224 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd wget http://10.111.158.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:03:46,224 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:03:51,278 - DEBUG - [Pod ctest-pod-37664845] Cmd: wget http://10.111.158.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:03:51,278 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd wget http://10.111.158.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:03:51,278 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:03:56,337 - DEBUG - [Pod ctest-pod-37664845] Cmd: wget http://10.111.158.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:03:56,337 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd wget http://10.111.158.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:03:56,337 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:04:01,405 - DEBUG - [Pod ctest-pod-37664845] Cmd: wget http://10.111.158.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:04:01,405 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd wget http://10.111.158.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:04:01,405 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:04:01,405 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-21454412': 0, 'ctest-pod-07791848': 0}
2025-06-26 02:04:01,486 - DEBUG - [Pod ctest-pod-77600086] Cmd: wget http://10.111.158.79:80/ -O - -T 5 -t 1 , Output: ctest-pod-07791848
Connecting to 10.111.158.79:80 (10.111.158.79:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-26 02:04:01,486 - DEBUG - [Pod Pod ctest-pod-77600086] Cmd wget http://10.111.158.79:80/ -O - -T 5 -t 1 passed
2025-06-26 02:04:01,486 - DEBUG - [Pod Pod ctest-pod-77600086] Cmd output: ctest-pod-07791848
Connecting to 10.111.158.79:80 (10.111.158.79:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-26 02:04:01,548 - DEBUG - [Pod ctest-pod-77600086] Cmd: wget http://10.111.158.79:80/ -O - -T 5 -t 1 , Output: ctest-pod-21454412
Connecting to 10.111.158.79:80 (10.111.158.79:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-26 02:04:01,548 - DEBUG - [Pod Pod ctest-pod-77600086] Cmd wget http://10.111.158.79:80/ -O - -T 5 -t 1 passed
2025-06-26 02:04:01,548 - DEBUG - [Pod Pod ctest-pod-77600086] Cmd output: ctest-pod-21454412
Connecting to 10.111.158.79:80 (10.111.158.79:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-26 02:04:01,548 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-21454412': 1, 'ctest-pod-07791848': 1}
2025-06-26 02:04:06,602 - DEBUG - [Pod ctest-pod-12876759] Cmd: wget http://10.111.158.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:04:06,603 - DEBUG - [Pod Pod ctest-pod-12876759] Cmd wget http://10.111.158.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:04:06,603 - DEBUG - [Pod Pod ctest-pod-12876759] Cmd output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:04:11,660 - DEBUG - [Pod ctest-pod-12876759] Cmd: wget http://10.111.158.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:04:11,661 - DEBUG - [Pod Pod ctest-pod-12876759] Cmd wget http://10.111.158.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:04:11,661 - DEBUG - [Pod Pod ctest-pod-12876759] Cmd output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:04:16,715 - DEBUG - [Pod ctest-pod-12876759] Cmd: wget http://10.111.158.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:04:16,715 - DEBUG - [Pod Pod ctest-pod-12876759] Cmd wget http://10.111.158.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:04:16,715 - DEBUG - [Pod Pod ctest-pod-12876759] Cmd output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:04:21,783 - DEBUG - [Pod ctest-pod-12876759] Cmd: wget http://10.111.158.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:04:21,783 - DEBUG - [Pod Pod ctest-pod-12876759] Cmd wget http://10.111.158.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:04:21,783 - DEBUG - [Pod Pod ctest-pod-12876759] Cmd output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:04:26,834 - DEBUG - [Pod ctest-pod-12876759] Cmd: wget http://10.111.158.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:04:26,834 - DEBUG - [Pod Pod ctest-pod-12876759] Cmd wget http://10.111.158.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:04:26,834 - DEBUG - [Pod Pod ctest-pod-12876759] Cmd output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:04:31,889 - DEBUG - [Pod ctest-pod-12876759] Cmd: wget http://10.111.158.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:04:31,889 - DEBUG - [Pod Pod ctest-pod-12876759] Cmd wget http://10.111.158.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:04:31,889 - DEBUG - [Pod Pod ctest-pod-12876759] Cmd output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:04:36,942 - DEBUG - [Pod ctest-pod-12876759] Cmd: wget http://10.111.158.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:04:36,942 - DEBUG - [Pod Pod ctest-pod-12876759] Cmd wget http://10.111.158.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:04:36,942 - DEBUG - [Pod Pod ctest-pod-12876759] Cmd output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:04:37,722 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2025-06-26 02:04:47,801 - DEBUG - [Pod ctest-pod-12876759] Cmd: wget http://10.111.158.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:04:47,802 - DEBUG - [Pod Pod ctest-pod-12876759] Cmd wget http://10.111.158.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:04:47,802 - DEBUG - [Pod Pod ctest-pod-12876759] Cmd output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:04:52,886 - DEBUG - [Pod ctest-pod-12876759] Cmd: wget http://10.111.158.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:04:52,886 - DEBUG - [Pod Pod ctest-pod-12876759] Cmd wget http://10.111.158.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:04:52,886 - DEBUG - [Pod Pod ctest-pod-12876759] Cmd output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:04:57,942 - DEBUG - [Pod ctest-pod-12876759] Cmd: wget http://10.111.158.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:04:57,943 - DEBUG - [Pod Pod ctest-pod-12876759] Cmd wget http://10.111.158.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:04:57,943 - DEBUG - [Pod Pod ctest-pod-12876759] Cmd output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:04:57,943 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-21454412': 0, 'ctest-pod-07791848': 0}
2025-06-26 02:05:00,007 - DEBUG - [Pod ctest-pod-77600086] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.931 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.091 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.116 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.091/0.379/0.931 ms
2025-06-26 02:05:00,007 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-77600086 with expectation True passed
2025-06-26 02:05:02,062 - DEBUG - [Pod ctest-pod-37664845] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=2.041 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.094 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.106 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.094/0.747/2.041 ms
2025-06-26 02:05:02,062 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-37664845 with expectation True passed
2025-06-26 02:05:04,127 - DEBUG - [Pod ctest-pod-12876759] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.524 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.091 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.100 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.091/0.238/0.524 ms
2025-06-26 02:05:04,127 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-12876759 with expectation True passed
2025-06-26 02:05:04,192 - DEBUG - [Pod ctest-pod-77600086] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-06-26 02:05:04,192 - DEBUG - [Pod Pod ctest-pod-77600086] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-06-26 02:05:04,192 - DEBUG - [Pod Pod ctest-pod-77600086] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-06-26 02:05:04,192 - INFO - wget check of of http://10.47.255.251 from ctest-pod-77600086 passed
2025-06-26 02:05:04,251 - DEBUG - [Pod ctest-pod-77600086] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-06-26 02:05:04,251 - DEBUG - [Pod Pod ctest-pod-77600086] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-06-26 02:05:04,251 - DEBUG - [Pod Pod ctest-pod-77600086] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-06-26 02:05:04,251 - INFO - wget check of of http://10.47.255.250 from ctest-pod-77600086 passed
2025-06-26 02:05:09,315 - DEBUG - [Pod ctest-pod-37664845] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-06-26 02:05:09,315 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-06-26 02:05:09,316 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-06-26 02:05:09,316 - INFO - wget check of of http://10.47.255.250 from ctest-pod-37664845 passed
2025-06-26 02:05:14,377 - DEBUG - [Pod ctest-pod-46324807] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-06-26 02:05:14,377 - DEBUG - [Pod Pod ctest-pod-46324807] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-06-26 02:05:14,377 - DEBUG - [Pod Pod ctest-pod-46324807] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-06-26 02:05:14,378 - INFO - wget check of of http://10.47.255.251 from ctest-pod-46324807 passed
2025-06-26 02:05:14,386 - INFO - Updating Network Policy ingress-on-service
2025-06-26 02:05:19,462 - DEBUG - [Pod ctest-pod-37664845] Cmd: wget http://10.111.158.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:05:19,463 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd wget http://10.111.158.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:05:19,463 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:05:24,514 - DEBUG - [Pod ctest-pod-37664845] Cmd: wget http://10.111.158.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:05:24,514 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd wget http://10.111.158.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:05:24,514 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:05:29,570 - DEBUG - [Pod ctest-pod-37664845] Cmd: wget http://10.111.158.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:05:29,570 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd wget http://10.111.158.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:05:29,570 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:05:34,617 - DEBUG - [Pod ctest-pod-37664845] Cmd: wget http://10.111.158.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:05:34,617 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd wget http://10.111.158.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:05:34,617 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:05:39,670 - DEBUG - [Pod ctest-pod-37664845] Cmd: wget http://10.111.158.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:05:39,670 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd wget http://10.111.158.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:05:39,671 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:05:44,726 - DEBUG - [Pod ctest-pod-37664845] Cmd: wget http://10.111.158.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:05:44,726 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd wget http://10.111.158.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:05:44,726 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:05:49,780 - DEBUG - [Pod ctest-pod-37664845] Cmd: wget http://10.111.158.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:05:49,780 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd wget http://10.111.158.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:05:49,780 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:05:54,829 - DEBUG - [Pod ctest-pod-37664845] Cmd: wget http://10.111.158.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:05:54,829 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd wget http://10.111.158.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:05:54,829 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:05:59,894 - DEBUG - [Pod ctest-pod-37664845] Cmd: wget http://10.111.158.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:05:59,895 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd wget http://10.111.158.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:05:59,895 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:06:04,949 - DEBUG - [Pod ctest-pod-37664845] Cmd: wget http://10.111.158.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:06:04,949 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd wget http://10.111.158.79:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:06:04,949 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
wget: download timed out
2025-06-26 02:06:04,949 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-21454412': 0, 'ctest-pod-07791848': 0}
2025-06-26 02:06:05,004 - DEBUG - [Pod ctest-pod-77600086] Cmd: wget http://10.111.158.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-07791848
2025-06-26 02:06:05,005 - DEBUG - [Pod Pod ctest-pod-77600086] Cmd wget http://10.111.158.79:80/ -O - -T 5 -t 1 passed
2025-06-26 02:06:05,005 - DEBUG - [Pod Pod ctest-pod-77600086] Cmd output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-07791848
2025-06-26 02:06:05,061 - DEBUG - [Pod ctest-pod-77600086] Cmd: wget http://10.111.158.79:80/ -O - -T 5 -t 1 , Output: ctest-pod-07791848
Connecting to 10.111.158.79:80 (10.111.158.79:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-26 02:06:05,061 - DEBUG - [Pod Pod ctest-pod-77600086] Cmd wget http://10.111.158.79:80/ -O - -T 5 -t 1 passed
2025-06-26 02:06:05,061 - DEBUG - [Pod Pod ctest-pod-77600086] Cmd output: ctest-pod-07791848
Connecting to 10.111.158.79:80 (10.111.158.79:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-26 02:06:05,113 - DEBUG - [Pod ctest-pod-77600086] Cmd: wget http://10.111.158.79:80/ -O - -T 5 -t 1 , Output: ctest-pod-21454412
Connecting to 10.111.158.79:80 (10.111.158.79:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-26 02:06:05,113 - DEBUG - [Pod Pod ctest-pod-77600086] Cmd wget http://10.111.158.79:80/ -O - -T 5 -t 1 passed
2025-06-26 02:06:05,113 - DEBUG - [Pod Pod ctest-pod-77600086] Cmd output: ctest-pod-21454412
Connecting to 10.111.158.79:80 (10.111.158.79:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-26 02:06:05,113 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-21454412': 1, 'ctest-pod-07791848': 2}
2025-06-26 02:06:05,168 - DEBUG - [Pod ctest-pod-12876759] Cmd: wget http://10.111.158.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-07791848
2025-06-26 02:06:05,168 - DEBUG - [Pod Pod ctest-pod-12876759] Cmd wget http://10.111.158.79:80/ -O - -T 5 -t 1 passed
2025-06-26 02:06:05,168 - DEBUG - [Pod Pod ctest-pod-12876759] Cmd output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-07791848
2025-06-26 02:06:05,231 - DEBUG - [Pod ctest-pod-12876759] Cmd: wget http://10.111.158.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-07791848
2025-06-26 02:06:05,231 - DEBUG - [Pod Pod ctest-pod-12876759] Cmd wget http://10.111.158.79:80/ -O - -T 5 -t 1 passed
2025-06-26 02:06:05,231 - DEBUG - [Pod Pod ctest-pod-12876759] Cmd output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-07791848
2025-06-26 02:06:05,291 - DEBUG - [Pod ctest-pod-12876759] Cmd: wget http://10.111.158.79:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-07791848
2025-06-26 02:06:05,291 - DEBUG - [Pod Pod ctest-pod-12876759] Cmd wget http://10.111.158.79:80/ -O - -T 5 -t 1 passed
2025-06-26 02:06:05,291 - DEBUG - [Pod Pod ctest-pod-12876759] Cmd output: Connecting to 10.111.158.79:80 (10.111.158.79:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-07791848
2025-06-26 02:06:05,347 - DEBUG - [Pod ctest-pod-12876759] Cmd: wget http://10.111.158.79:80/ -O - -T 5 -t 1 , Output: ctest-pod-07791848
Connecting to 10.111.158.79:80 (10.111.158.79:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-26 02:06:05,347 - DEBUG - [Pod Pod ctest-pod-12876759] Cmd wget http://10.111.158.79:80/ -O - -T 5 -t 1 passed
2025-06-26 02:06:05,347 - DEBUG - [Pod Pod ctest-pod-12876759] Cmd output: ctest-pod-07791848
Connecting to 10.111.158.79:80 (10.111.158.79:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-26 02:06:05,405 - DEBUG - [Pod ctest-pod-12876759] Cmd: wget http://10.111.158.79:80/ -O - -T 5 -t 1 , Output: ctest-pod-21454412
Connecting to 10.111.158.79:80 (10.111.158.79:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-26 02:06:05,405 - DEBUG - [Pod Pod ctest-pod-12876759] Cmd wget http://10.111.158.79:80/ -O - -T 5 -t 1 passed
2025-06-26 02:06:05,405 - DEBUG - [Pod Pod ctest-pod-12876759] Cmd output: ctest-pod-21454412
Connecting to 10.111.158.79:80 (10.111.158.79:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-26 02:06:05,405 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-21454412': 1, 'ctest-pod-07791848': 4}
2025-06-26 02:06:07,463 - DEBUG - [Pod ctest-pod-77600086] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.429 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.086 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.100 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.086/0.538/1.429 ms
2025-06-26 02:06:07,463 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-77600086 with expectation True passed
2025-06-26 02:06:09,523 - DEBUG - [Pod ctest-pod-37664845] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.959 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.087 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.160 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.087/0.402/0.959 ms
2025-06-26 02:06:09,524 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-37664845 with expectation True passed
2025-06-26 02:06:11,582 - DEBUG - [Pod ctest-pod-12876759] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.531 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.086 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.093 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.086/0.570/1.531 ms
2025-06-26 02:06:11,582 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-12876759 with expectation True passed
2025-06-26 02:06:11,644 - DEBUG - [Pod ctest-pod-77600086] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-06-26 02:06:11,644 - DEBUG - [Pod Pod ctest-pod-77600086] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-06-26 02:06:11,644 - DEBUG - [Pod Pod ctest-pod-77600086] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-06-26 02:06:11,644 - INFO - wget check of of http://10.47.255.251 from ctest-pod-77600086 passed
2025-06-26 02:06:11,707 - DEBUG - [Pod ctest-pod-77600086] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-06-26 02:06:11,707 - DEBUG - [Pod Pod ctest-pod-77600086] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-06-26 02:06:11,707 - DEBUG - [Pod Pod ctest-pod-77600086] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-06-26 02:06:11,707 - INFO - wget check of of http://10.47.255.250 from ctest-pod-77600086 passed
2025-06-26 02:06:16,762 - DEBUG - [Pod ctest-pod-37664845] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-06-26 02:06:16,762 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-06-26 02:06:16,762 - DEBUG - [Pod Pod ctest-pod-37664845] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-06-26 02:06:16,762 - INFO - wget check of of http://10.47.255.250 from ctest-pod-37664845 passed
2025-06-26 02:06:16,815 - DEBUG - [Pod ctest-pod-46324807] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-06-26 02:06:16,815 - DEBUG - [Pod Pod ctest-pod-46324807] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-06-26 02:06:16,815 - DEBUG - [Pod Pod ctest-pod-46324807] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-06-26 02:06:16,815 - INFO - wget check of of http://10.47.255.251 from ctest-pod-46324807 passed
2025-06-26 02:06:16,816 - INFO - Deleting Network Policy : ingress-on-service
2025-06-26 02:06:16,816 - INFO - Deleting service : ctest-nginx-svc-87375854
2025-06-26 02:06:17,095 - DEBUG - No XMPP flaps were noticed during the test
2025-06-26 02:06:17,095 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:12]
2025-06-26 02:06:17,095 - INFO - --------------------------------------------------------------------------------
2025-06-26 02:06:17,102 - INFO - Deleting pod ctest-new-default-44868559:ctest-pod-21454412
2025-06-26 02:06:17,102 - INFO - Deleting pod ctest-new-default-44868559:ctest-pod-07791848
2025-06-26 02:06:17,103 - INFO - Deleting pod ctest-non-default-96493591:ctest-pod-06103271
2025-06-26 02:06:17,103 - INFO - Deleting pod ctest-non-default-96493591:ctest-pod-09408021
2025-06-26 02:06:17,104 - INFO - Deleting pod ctest-new-default-44868559:ctest-pod-37664845
2025-06-26 02:06:17,104 - INFO - Deleting pod ctest-new-default-44868559:ctest-pod-77600086
2025-06-26 02:06:17,104 - INFO - Deleting pod ctest-non-default-96493591:ctest-pod-12876759
2025-06-26 02:06:17,105 - INFO - Deleting pod ctest-non-default-96493591:ctest-pod-46324807
2025-06-26 02:06:17,146 - WARNING - Pod uuid ed60d178-2298-4043-8384-8b11056c9540 is still seen in agent 10.0.0.22 VM list
2025-06-26 02:06:17,168 - WARNING - Pod uuid 1df11122-dc4c-42cc-a433-2997399ec9a7 is still seen in agent 10.0.0.22 VM list
2025-06-26 02:06:17,211 - WARNING - Pod uuid 16df801e-9a16-4fdc-bea4-8ec7fb3058d0 is still seen in agent 10.0.0.22 VM list
2025-06-26 02:06:17,266 - WARNING - Pod uuid 002013d3-595d-46b7-9697-b1c32c457950 is still seen in agent 10.0.0.22 VM list
2025-06-26 02:06:17,266 - WARNING - Pod uuid 81fc256c-32e5-4c1f-ab76-43ef4b390363 is still seen in agent 10.0.0.22 VM list
2025-06-26 02:06:17,267 - WARNING - Pod uuid e9a962dd-19f5-410c-b0da-966f8470ffc9 is still seen in agent 10.0.0.22 VM list
2025-06-26 02:06:17,267 - WARNING - Pod uuid a1fd166c-71bd-4cbb-92f4-273343342499 is still seen in agent 10.0.0.22 VM list
2025-06-26 02:06:17,268 - WARNING - Pod uuid befaa48c-81ff-4c12-81a8-637a0a4175d3 is still seen in agent 10.0.0.22 VM list
2025-06-26 02:06:22,156 - DEBUG - Pod ed60d178-2298-4043-8384-8b11056c9540 is not in agent 10.0.0.22 VM list
2025-06-26 02:06:22,230 - DEBUG - VMI a74b9ec6-5231-11f0-ba63-fa163e6b0b54 is removed from agent 10.0.0.22
2025-06-26 02:06:22,230 - INFO - Verified that pod ctest-pod-21454412 is removed in agent
2025-06-26 02:06:22,244 - DEBUG - Pod 1df11122-dc4c-42cc-a433-2997399ec9a7 is not in agent 10.0.0.22 VM list
2025-06-26 02:06:22,246 - WARNING - Pod uuid 16df801e-9a16-4fdc-bea4-8ec7fb3058d0 is still seen in agent 10.0.0.22 VM list
2025-06-26 02:06:22,255 - DEBUG - VMI a905c854-5231-11f0-ba63-fa163e6b0b54 is removed from agent 10.0.0.22
2025-06-26 02:06:22,256 - INFO - Verified that pod ctest-pod-09408021 is removed in agent
2025-06-26 02:06:22,298 - WARNING - Pod uuid a1fd166c-71bd-4cbb-92f4-273343342499 is still seen in agent 10.0.0.22 VM list
2025-06-26 02:06:22,300 - DEBUG - Pod e9a962dd-19f5-410c-b0da-966f8470ffc9 is not in agent 10.0.0.22 VM list
2025-06-26 02:06:22,302 - WARNING - Pod uuid 81fc256c-32e5-4c1f-ab76-43ef4b390363 is still seen in agent 10.0.0.22 VM list
2025-06-26 02:06:22,303 - DEBUG - Pod 002013d3-595d-46b7-9697-b1c32c457950 is not in agent 10.0.0.22 VM list
2025-06-26 02:06:22,304 - WARNING - Pod uuid befaa48c-81ff-4c12-81a8-637a0a4175d3 is still seen in agent 10.0.0.22 VM list
2025-06-26 02:06:22,319 - DEBUG - VMI a7cb8172-5231-11f0-ba63-fa163e6b0b54 is removed from agent 10.0.0.22
2025-06-26 02:06:22,319 - INFO - Verified that pod ctest-pod-07791848 is removed in agent
2025-06-26 02:06:22,319 - DEBUG - VMI a87828d2-5231-11f0-ba63-fa163e6b0b54 is removed from agent 10.0.0.22
2025-06-26 02:06:22,319 - INFO - Verified that pod ctest-pod-06103271 is removed in agent
2025-06-26 02:06:27,260 - WARNING - Pod uuid 16df801e-9a16-4fdc-bea4-8ec7fb3058d0 is still seen in agent 10.0.0.22 VM list
2025-06-26 02:06:27,319 - WARNING - Pod uuid a1fd166c-71bd-4cbb-92f4-273343342499 is still seen in agent 10.0.0.22 VM list
2025-06-26 02:06:27,321 - WARNING - Pod uuid befaa48c-81ff-4c12-81a8-637a0a4175d3 is still seen in agent 10.0.0.22 VM list
2025-06-26 02:06:27,321 - WARNING - Pod uuid 81fc256c-32e5-4c1f-ab76-43ef4b390363 is still seen in agent 10.0.0.22 VM list
2025-06-26 02:06:32,271 - WARNING - Pod uuid 16df801e-9a16-4fdc-bea4-8ec7fb3058d0 is still seen in agent 10.0.0.22 VM list
2025-06-26 02:06:32,337 - WARNING - Pod uuid a1fd166c-71bd-4cbb-92f4-273343342499 is still seen in agent 10.0.0.22 VM list
2025-06-26 02:06:32,339 - WARNING - Pod uuid befaa48c-81ff-4c12-81a8-637a0a4175d3 is still seen in agent 10.0.0.22 VM list
2025-06-26 02:06:32,339 - WARNING - Pod uuid 81fc256c-32e5-4c1f-ab76-43ef4b390363 is still seen in agent 10.0.0.22 VM list
2025-06-26 02:06:37,280 - WARNING - Pod uuid 16df801e-9a16-4fdc-bea4-8ec7fb3058d0 is still seen in agent 10.0.0.22 VM list
2025-06-26 02:06:37,356 - WARNING - Pod uuid a1fd166c-71bd-4cbb-92f4-273343342499 is still seen in agent 10.0.0.22 VM list
2025-06-26 02:06:37,359 - WARNING - Pod uuid befaa48c-81ff-4c12-81a8-637a0a4175d3 is still seen in agent 10.0.0.22 VM list
2025-06-26 02:06:37,360 - WARNING - Pod uuid 81fc256c-32e5-4c1f-ab76-43ef4b390363 is still seen in agent 10.0.0.22 VM list
2025-06-26 02:06:42,289 - WARNING - Pod uuid 16df801e-9a16-4fdc-bea4-8ec7fb3058d0 is still seen in agent 10.0.0.22 VM list
2025-06-26 02:06:42,374 - WARNING - Pod uuid befaa48c-81ff-4c12-81a8-637a0a4175d3 is still seen in agent 10.0.0.22 VM list
2025-06-26 02:06:42,375 - WARNING - Pod uuid a1fd166c-71bd-4cbb-92f4-273343342499 is still seen in agent 10.0.0.22 VM list
2025-06-26 02:06:42,376 - WARNING - Pod uuid 81fc256c-32e5-4c1f-ab76-43ef4b390363 is still seen in agent 10.0.0.22 VM list
2025-06-26 02:06:47,299 - WARNING - Pod uuid 16df801e-9a16-4fdc-bea4-8ec7fb3058d0 is still seen in agent 10.0.0.22 VM list
2025-06-26 02:06:47,393 - WARNING - Pod uuid befaa48c-81ff-4c12-81a8-637a0a4175d3 is still seen in agent 10.0.0.22 VM list
2025-06-26 02:06:47,395 - WARNING - Pod uuid 81fc256c-32e5-4c1f-ab76-43ef4b390363 is still seen in agent 10.0.0.22 VM list
2025-06-26 02:06:47,396 - WARNING - Pod uuid a1fd166c-71bd-4cbb-92f4-273343342499 is still seen in agent 10.0.0.22 VM list
2025-06-26 02:06:52,309 - DEBUG - Pod 16df801e-9a16-4fdc-bea4-8ec7fb3058d0 is not in agent 10.0.0.22 VM list
2025-06-26 02:06:52,317 - DEBUG - VMI ab20947a-5231-11f0-ba63-fa163e6b0b54 is removed from agent 10.0.0.22
2025-06-26 02:06:52,317 - INFO - Verified that pod ctest-pod-46324807 is removed in agent
2025-06-26 02:06:52,412 - DEBUG - Pod befaa48c-81ff-4c12-81a8-637a0a4175d3 is not in agent 10.0.0.22 VM list
2025-06-26 02:06:52,415 - DEBUG - Pod a1fd166c-71bd-4cbb-92f4-273343342499 is not in agent 10.0.0.22 VM list
2025-06-26 02:06:52,417 - DEBUG - Pod 81fc256c-32e5-4c1f-ab76-43ef4b390363 is not in agent 10.0.0.22 VM list
2025-06-26 02:06:52,429 - DEBUG - VMI aa2c7dcc-5231-11f0-ba63-fa163e6b0b54 is removed from agent 10.0.0.22
2025-06-26 02:06:52,429 - INFO - Verified that pod ctest-pod-77600086 is removed in agent
2025-06-26 02:06:52,431 - DEBUG - VMI a9ad7176-5231-11f0-ba63-fa163e6b0b54 is removed from agent 10.0.0.22
2025-06-26 02:06:52,431 - INFO - Verified that pod ctest-pod-37664845 is removed in agent
2025-06-26 02:06:52,432 - DEBUG - VMI aaa86fae-5231-11f0-ba63-fa163e6b0b54 is removed from agent 10.0.0.22
2025-06-26 02:06:52,432 - INFO - Verified that pod ctest-pod-12876759 is removed in agent
2025-06-26 02:06:52,432 - INFO - Deleting namespace ctest-non-default-96493591
2025-06-26 02:06:52,448 - DEBUG - Namespace ctest-non-default-96493591 still in k8s
2025-06-26 02:06:54,453 - DEBUG - Namespace ctest-non-default-96493591 still in k8s
2025-06-26 02:06:56,458 - DEBUG - Namespace ctest-non-default-96493591 still in k8s
2025-06-26 02:06:58,462 - DEBUG - Namespace ctest-non-default-96493591 is not in k8s
2025-06-26 02:06:58,462 - DEBUG - No need to check project deletion in contrail-api
2025-06-26 02:06:58,462 - INFO - Deleting namespace ctest-new-default-44868559
2025-06-26 02:06:58,471 - DEBUG - Namespace ctest-new-default-44868559 still in k8s
2025-06-26 02:07:00,476 - DEBUG - Namespace ctest-new-default-44868559 still in k8s
2025-06-26 02:07:02,481 - DEBUG - Namespace ctest-new-default-44868559 still in k8s
2025-06-26 02:07:04,493 - DEBUG - Namespace ctest-new-default-44868559 is not in k8s
2025-06-26 02:07:04,493 - DEBUG - No need to check project deletion in contrail-api