2025-04-23 08:42:00,651 - INFO - Using existing project ['default-domain', 'k8s-default'](d86b68c7-9d93-429b-b45e-59dd8ff69049)
2025-04-23 08:42:00,672 - DEBUG - Namespace ctest-new-default-05334063 not present
2025-04-23 08:42:00,683 - INFO - Created namespace ctest-new-default-05334063
2025-04-23 08:42:03,687 - DEBUG - Namespace ctest-non-default-34868741 not present
2025-04-23 08:42:03,694 - INFO - Created namespace ctest-non-default-34868741
2025-04-23 08:42:06,718 - DEBUG - Pod ctest-pod-52155045 not present
2025-04-23 08:42:06,718 - INFO - Creating Pod ctest-pod-52155045
2025-04-23 08:42:06,750 - DEBUG - Pod : ctest-pod-52155045 UUID is 532de7a3-4303-4cc2-9931-231bbd1e0381
2025-04-23 08:42:06,756 - DEBUG - Pod ctest-pod-30903643 not present
2025-04-23 08:42:06,756 - INFO - Creating Pod ctest-pod-30903643
2025-04-23 08:42:06,799 - DEBUG - Pod : ctest-pod-30903643 UUID is 5625d080-1e11-4f4f-8bcf-e5f2cb32a349
2025-04-23 08:42:06,803 - DEBUG - Pod ctest-pod-21238940 not present
2025-04-23 08:42:06,803 - INFO - Creating Pod ctest-pod-21238940
2025-04-23 08:42:06,831 - DEBUG - Pod : ctest-pod-21238940 UUID is 1ab568bc-e3b3-4dc0-b2da-bd4ef359928f
2025-04-23 08:42:06,834 - DEBUG - Pod ctest-pod-94885037 not present
2025-04-23 08:42:06,834 - INFO - Creating Pod ctest-pod-94885037
2025-04-23 08:42:06,875 - DEBUG - Pod : ctest-pod-94885037 UUID is 5f43dab7-10c6-416b-946e-d4c0d338efa6
2025-04-23 08:42:06,880 - DEBUG - Pod ctest-pod-42885028 not present
2025-04-23 08:42:06,880 - INFO - Creating Pod ctest-pod-42885028
2025-04-23 08:42:06,912 - DEBUG - Pod : ctest-pod-42885028 UUID is 3490af09-eb47-44b0-adf8-21c02b6c9f60
2025-04-23 08:42:06,915 - DEBUG - Pod ctest-pod-37366074 not present
2025-04-23 08:42:06,915 - INFO - Creating Pod ctest-pod-37366074
2025-04-23 08:42:06,945 - DEBUG - Pod : ctest-pod-37366074 UUID is f0815a0d-2b2b-4fa9-b052-f708c2592c4c
2025-04-23 08:42:06,947 - DEBUG - Pod ctest-pod-84230689 not present
2025-04-23 08:42:06,947 - INFO - Creating Pod ctest-pod-84230689
2025-04-23 08:42:06,980 - DEBUG - Pod : ctest-pod-84230689 UUID is 5e0c44fd-4eab-446f-aeda-9cf4801b39d0
2025-04-23 08:42:06,982 - DEBUG - Pod ctest-pod-68639635 not present
2025-04-23 08:42:06,983 - INFO - Creating Pod ctest-pod-68639635
2025-04-23 08:42:07,019 - DEBUG - Pod : ctest-pod-68639635 UUID is 76944504-2434-46fc-b0dc-44458e73a514
2025-04-23 08:42:07,209 - INFO - Project default-domain:k8s-ctest-new-default-05334063 for Namespace ctest-new-default-05334063 is seen in contrail-api
2025-04-23 08:42:07,209 - DEBUG - Project uuid in Contrail is 4af90d60-4412-4aa8-a21d-8f83e7412325
2025-04-23 08:42:07,409 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NamespaceDatabaseList?namespace_uuid=8b87f229-be3f-4372-ad42-37e7f4067c7f
2025-04-23 08:42:07,413 - INFO - Namespace ctest-new-default-05334063 with uuid 8b87f229-be3f-4372-ad42-37e7f4067c7f found in kube manager
2025-04-23 08:42:07,414 - INFO - Namespace ctest-new-default-05334063 verification passed
2025-04-23 08:42:07,638 - INFO - Project default-domain:k8s-ctest-non-default-34868741 for Namespace ctest-non-default-34868741 is seen in contrail-api
2025-04-23 08:42:07,639 - DEBUG - Project uuid in Contrail is 9163ec84-a2c8-4a41-828f-06de178d3037
2025-04-23 08:42:07,639 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NamespaceDatabaseList?namespace_uuid=d2bbe28d-3811-4c93-88f0-4823c6720182
2025-04-23 08:42:07,646 - INFO - Namespace ctest-non-default-34868741 with uuid d2bbe28d-3811-4c93-88f0-4823c6720182 found in kube manager
2025-04-23 08:42:07,646 - INFO - Namespace ctest-non-default-34868741 verification passed
2025-04-23 08:42:07,653 - DEBUG - Pod ctest-pod-52155045 not in running state.Currently in Pending
2025-04-23 08:42:12,659 - DEBUG - Pod ctest-pod-52155045 not in running state.Currently in Pending
2025-04-23 08:42:17,666 - DEBUG - Pod ctest-pod-52155045 not in running state.Currently in Pending
2025-04-23 08:42:22,675 - INFO - Pod ctest-pod-52155045 is in running state.Got IP 10.47.255.251
2025-04-23 08:42:22,693 - DEBUG - Pod ctest-pod-52155045 has vmi d7ac8534-201e-11f0-bcf6-fa163e142c54
2025-04-23 08:42:22,693 - INFO - Verified pod ctest-pod-52155045 in contrail-api
2025-04-23 08:42:22,709 - DEBUG - VMI d7ac8534-201e-11f0-bcf6-fa163e142c54 is active in agent 10.0.0.57
2025-04-23 08:42:22,709 - INFO - Verified Pod ctest-pod-52155045 in agent 10.0.0.57
2025-04-23 08:42:22,709 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=532de7a3-4303-4cc2-9931-231bbd1e0381
2025-04-23 08:42:22,714 - INFO - Pod ctest-pod-52155045 with uuid 532de7a3-4303-4cc2-9931-231bbd1e0381 found in kube manager
2025-04-23 08:42:22,714 - INFO - Pod ctest-pod-52155045 verification passed
2025-04-23 08:42:22,720 - INFO - Pod ctest-pod-30903643 is in running state.Got IP 10.47.255.250
2025-04-23 08:42:22,736 - DEBUG - Pod ctest-pod-30903643 has vmi d860b298-201e-11f0-bcf6-fa163e142c54
2025-04-23 08:42:22,736 - INFO - Verified pod ctest-pod-30903643 in contrail-api
2025-04-23 08:42:22,754 - DEBUG - VMI d860b298-201e-11f0-bcf6-fa163e142c54 is active in agent 10.0.0.57
2025-04-23 08:42:22,754 - INFO - Verified Pod ctest-pod-30903643 in agent 10.0.0.57
2025-04-23 08:42:22,754 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=5625d080-1e11-4f4f-8bcf-e5f2cb32a349
2025-04-23 08:42:22,760 - INFO - Pod ctest-pod-30903643 with uuid 5625d080-1e11-4f4f-8bcf-e5f2cb32a349 found in kube manager
2025-04-23 08:42:22,760 - INFO - Pod ctest-pod-30903643 verification passed
2025-04-23 08:42:22,766 - INFO - Pod ctest-pod-21238940 is in running state.Got IP 10.47.255.249
2025-04-23 08:42:22,823 - DEBUG - Pod ctest-pod-21238940 has vmi d9418a7a-201e-11f0-bcf6-fa163e142c54
2025-04-23 08:42:22,823 - INFO - Verified pod ctest-pod-21238940 in contrail-api
2025-04-23 08:42:22,836 - DEBUG - VMI d9418a7a-201e-11f0-bcf6-fa163e142c54 is active in agent 10.0.0.57
2025-04-23 08:42:22,836 - INFO - Verified Pod ctest-pod-21238940 in agent 10.0.0.57
2025-04-23 08:42:22,837 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=1ab568bc-e3b3-4dc0-b2da-bd4ef359928f
2025-04-23 08:42:22,841 - INFO - Pod ctest-pod-21238940 with uuid 1ab568bc-e3b3-4dc0-b2da-bd4ef359928f found in kube manager
2025-04-23 08:42:22,841 - INFO - Pod ctest-pod-21238940 verification passed
2025-04-23 08:42:22,847 - DEBUG - Pod ctest-pod-94885037 not in running state.Currently in Pending
2025-04-23 08:42:27,855 - INFO - Pod ctest-pod-94885037 is in running state.Got IP 10.47.255.248
2025-04-23 08:42:27,871 - DEBUG - Pod ctest-pod-94885037 has vmi d9e15a64-201e-11f0-bcf6-fa163e142c54
2025-04-23 08:42:27,871 - INFO - Verified pod ctest-pod-94885037 in contrail-api
2025-04-23 08:42:27,885 - DEBUG - VMI d9e15a64-201e-11f0-bcf6-fa163e142c54 is active in agent 10.0.0.57
2025-04-23 08:42:27,885 - INFO - Verified Pod ctest-pod-94885037 in agent 10.0.0.57
2025-04-23 08:42:27,886 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=5f43dab7-10c6-416b-946e-d4c0d338efa6
2025-04-23 08:42:27,891 - INFO - Pod ctest-pod-94885037 with uuid 5f43dab7-10c6-416b-946e-d4c0d338efa6 found in kube manager
2025-04-23 08:42:27,891 - INFO - Pod ctest-pod-94885037 verification passed
2025-04-23 08:42:27,896 - INFO - Pod ctest-pod-42885028 is in running state.Got IP 10.47.255.247
2025-04-23 08:42:27,950 - DEBUG - Pod ctest-pod-42885028 has vmi da91a3c4-201e-11f0-bcf6-fa163e142c54
2025-04-23 08:42:27,950 - INFO - Verified pod ctest-pod-42885028 in contrail-api
2025-04-23 08:42:27,965 - DEBUG - VMI da91a3c4-201e-11f0-bcf6-fa163e142c54 is active in agent 10.0.0.57
2025-04-23 08:42:27,966 - INFO - Verified Pod ctest-pod-42885028 in agent 10.0.0.57
2025-04-23 08:42:27,966 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=3490af09-eb47-44b0-adf8-21c02b6c9f60
2025-04-23 08:42:27,971 - INFO - Pod ctest-pod-42885028 with uuid 3490af09-eb47-44b0-adf8-21c02b6c9f60 found in kube manager
2025-04-23 08:42:27,971 - INFO - Pod ctest-pod-42885028 verification passed
2025-04-23 08:42:27,977 - INFO - Pod ctest-pod-84230689 is in running state.Got IP 10.47.255.245
2025-04-23 08:42:28,030 - DEBUG - Pod ctest-pod-84230689 has vmi dbbe92b6-201e-11f0-bcf6-fa163e142c54
2025-04-23 08:42:28,031 - INFO - Verified pod ctest-pod-84230689 in contrail-api
2025-04-23 08:42:28,044 - DEBUG - VMI dbbe92b6-201e-11f0-bcf6-fa163e142c54 is active in agent 10.0.0.57
2025-04-23 08:42:28,044 - INFO - Verified Pod ctest-pod-84230689 in agent 10.0.0.57
2025-04-23 08:42:28,044 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=5e0c44fd-4eab-446f-aeda-9cf4801b39d0
2025-04-23 08:42:28,048 - INFO - Pod ctest-pod-84230689 with uuid 5e0c44fd-4eab-446f-aeda-9cf4801b39d0 found in kube manager
2025-04-23 08:42:28,049 - INFO - Pod ctest-pod-84230689 verification passed
2025-04-23 08:42:28,054 - INFO - Pod ctest-pod-37366074 is in running state.Got IP 10.47.255.246
2025-04-23 08:42:28,074 - DEBUG - Pod ctest-pod-37366074 has vmi db1ad9aa-201e-11f0-bcf6-fa163e142c54
2025-04-23 08:42:28,075 - INFO - Verified pod ctest-pod-37366074 in contrail-api
2025-04-23 08:42:28,087 - DEBUG - VMI db1ad9aa-201e-11f0-bcf6-fa163e142c54 is active in agent 10.0.0.57
2025-04-23 08:42:28,088 - INFO - Verified Pod ctest-pod-37366074 in agent 10.0.0.57
2025-04-23 08:42:28,088 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=f0815a0d-2b2b-4fa9-b052-f708c2592c4c
2025-04-23 08:42:28,093 - INFO - Pod ctest-pod-37366074 with uuid f0815a0d-2b2b-4fa9-b052-f708c2592c4c found in kube manager
2025-04-23 08:42:28,093 - INFO - Pod ctest-pod-37366074 verification passed
2025-04-23 08:42:28,099 - INFO - Pod ctest-pod-68639635 is in running state.Got IP 10.47.255.244
2025-04-23 08:42:28,155 - DEBUG - Pod ctest-pod-68639635 has vmi dc4febda-201e-11f0-bcf6-fa163e142c54
2025-04-23 08:42:28,155 - INFO - Verified pod ctest-pod-68639635 in contrail-api
2025-04-23 08:42:28,169 - DEBUG - VMI dc4febda-201e-11f0-bcf6-fa163e142c54 is active in agent 10.0.0.57
2025-04-23 08:42:28,169 - INFO - Verified Pod ctest-pod-68639635 in agent 10.0.0.57
2025-04-23 08:42:28,169 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=76944504-2434-46fc-b0dc-44458e73a514
2025-04-23 08:42:28,174 - INFO - Pod ctest-pod-68639635 with uuid 76944504-2434-46fc-b0dc-44458e73a514 found in kube manager
2025-04-23 08:42:28,174 - INFO - Pod ctest-pod-68639635 verification passed
2025-04-23 08:42:28,175 - INFO - ================================================================================
2025-04-23 08:42:28,175 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-04-23 08:42:28,175 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-04-23 08:42:28,418 - DEBUG - Nothing to compare xmpp stats {'10.0.0.57': {'10.0.0.50': '0'}} with
2025-04-23 08:42:28,418 - INFO - Initial checks done. Running the testcase now
2025-04-23 08:42:28,418 - INFO -
2025-04-23 08:42:28,475 - DEBUG - [Pod ctest-pod-52155045] Cmd: echo ctest-pod-52155045 > /usr/share/nginx/html/index.html, Output:
2025-04-23 08:42:28,547 - DEBUG - [Pod ctest-pod-30903643] Cmd: echo ctest-pod-30903643 > /usr/share/nginx/html/index.html, Output:
2025-04-23 08:42:28,614 - DEBUG - [Pod ctest-pod-21238940] Cmd: echo ctest-pod-21238940 > /usr/share/nginx/html/index.html, Output:
2025-04-23 08:42:28,669 - DEBUG - [Pod ctest-pod-94885037] Cmd: echo ctest-pod-94885037 > /usr/share/nginx/html/index.html, Output:
2025-04-23 08:42:28,672 - DEBUG - Service ctest-nginx-svc-13678315 not present
2025-04-23 08:42:28,672 - INFO - Creating service ctest-nginx-svc-13678315
2025-04-23 08:42:28,686 - INFO - Created Service ctest-nginx-svc-13678315
2025-04-23 08:42:28,694 - WARNING - Service UUID a3cb2d01-8bf0-4519-9b60-4ba49c21de55 not yet found in contrail-api
2025-04-23 08:42:29,701 - INFO - Validated that Service ctest-nginx-svc-13678315 is seen in contrail-api
2025-04-23 08:42:29,701 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_LoadbalancerDatabaseList?x=a3cb2d01-8bf0-4519-9b60-4ba49c21de55
2025-04-23 08:42:29,706 - INFO - Service ctest-nginx-svc-13678315 with uuid a3cb2d01-8bf0-4519-9b60-4ba49c21de55 found in kube manager
2025-04-23 08:42:29,706 - INFO - Service ctest-nginx-svc-13678315 verification passed
2025-04-23 08:42:30,769 - DEBUG - [Pod ctest-pod-42885028] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-52155045
2025-04-23 08:42:30,769 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 passed
2025-04-23 08:42:30,769 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-52155045
2025-04-23 08:42:30,819 - DEBUG - [Pod ctest-pod-42885028] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
ctest-pod-52155045
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 08:42:30,819 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 passed
2025-04-23 08:42:30,819 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
ctest-pod-52155045
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 08:42:30,874 - DEBUG - [Pod ctest-pod-42885028] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-52155045
2025-04-23 08:42:30,874 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 passed
2025-04-23 08:42:30,874 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-52155045
2025-04-23 08:42:30,934 - DEBUG - [Pod ctest-pod-42885028] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-30903643
2025-04-23 08:42:30,935 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 passed
2025-04-23 08:42:30,935 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-30903643
2025-04-23 08:42:30,935 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-52155045': 3, 'ctest-pod-30903643': 1}
2025-04-23 08:42:30,990 - DEBUG - [Pod ctest-pod-84230689] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: ctest-pod-52155045
Connecting to 10.104.34.250:80 (10.104.34.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 08:42:30,990 - DEBUG - [Pod Pod ctest-pod-84230689] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 passed
2025-04-23 08:42:30,990 - DEBUG - [Pod Pod ctest-pod-84230689] Cmd output: ctest-pod-52155045
Connecting to 10.104.34.250:80 (10.104.34.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 08:42:31,081 - DEBUG - [Pod ctest-pod-84230689] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: ctest-pod-30903643
Connecting to 10.104.34.250:80 (10.104.34.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 08:42:31,081 - DEBUG - [Pod Pod ctest-pod-84230689] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 passed
2025-04-23 08:42:31,081 - DEBUG - [Pod Pod ctest-pod-84230689] Cmd output: ctest-pod-30903643
Connecting to 10.104.34.250:80 (10.104.34.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 08:42:31,081 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-52155045': 1, 'ctest-pod-30903643': 1}
2025-04-23 08:42:31,084 - DEBUG - Network policy ingress-on-service not present
2025-04-23 08:42:31,084 - INFO - Creating Network Policy ingress-on-service
2025-04-23 08:42:31,097 - INFO - Network policy found in k8s
2025-04-23 08:42:31,097 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=3479f79d-1e3a-4d07-8414-41ce5c468072
2025-04-23 08:42:31,106 - INFO - Network Policy ingress-on-service with uuid 3479f79d-1e3a-4d07-8414-41ce5c468072 found in kube manager
2025-04-23 08:42:31,139 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-04-23 08:42:31,139 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-04-23 08:42:31,139 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=3479f79d-1e3a-4d07-8414-41ce5c468072
2025-04-23 08:42:31,169 - WARNING - Network policy with name ingress-on-service not found in agent
2025-04-23 08:42:33,170 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=3479f79d-1e3a-4d07-8414-41ce5c468072
2025-04-23 08:42:33,204 - INFO - Network policy with name ingress-on-service found in agent
2025-04-23 08:42:33,204 - INFO - Network Policy ingress-on-service verification passed
2025-04-23 08:42:38,274 - DEBUG - [Pod ctest-pod-42885028] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:42:38,275 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:42:38,275 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:42:43,330 - DEBUG - [Pod ctest-pod-42885028] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:42:43,330 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:42:43,330 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:42:48,387 - DEBUG - [Pod ctest-pod-42885028] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:42:48,387 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:42:48,387 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:42:53,441 - DEBUG - [Pod ctest-pod-42885028] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:42:53,441 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:42:53,441 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:42:58,489 - DEBUG - [Pod ctest-pod-42885028] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:42:58,489 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:42:58,489 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:43:03,541 - DEBUG - [Pod ctest-pod-42885028] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:43:03,541 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:43:03,541 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:43:08,599 - DEBUG - [Pod ctest-pod-42885028] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:43:08,599 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:43:08,599 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:43:13,653 - DEBUG - [Pod ctest-pod-42885028] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:43:13,653 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:43:13,653 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:43:18,707 - DEBUG - [Pod ctest-pod-42885028] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:43:18,707 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:43:18,707 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:43:23,756 - DEBUG - [Pod ctest-pod-42885028] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:43:23,757 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:43:23,757 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:43:23,757 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-52155045': 0, 'ctest-pod-30903643': 0}
2025-04-23 08:43:23,812 - DEBUG - [Pod ctest-pod-37366074] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: ctest-pod-30903643
Connecting to 10.104.34.250:80 (10.104.34.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 08:43:23,812 - DEBUG - [Pod Pod ctest-pod-37366074] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 passed
2025-04-23 08:43:23,812 - DEBUG - [Pod Pod ctest-pod-37366074] Cmd output: ctest-pod-30903643
Connecting to 10.104.34.250:80 (10.104.34.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 08:43:23,864 - DEBUG - [Pod ctest-pod-37366074] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: ctest-pod-30903643
Connecting to 10.104.34.250:80 (10.104.34.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 08:43:23,864 - DEBUG - [Pod Pod ctest-pod-37366074] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 passed
2025-04-23 08:43:23,864 - DEBUG - [Pod Pod ctest-pod-37366074] Cmd output: ctest-pod-30903643
Connecting to 10.104.34.250:80 (10.104.34.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 08:43:23,922 - DEBUG - [Pod ctest-pod-37366074] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: ctest-pod-30903643
Connecting to 10.104.34.250:80 (10.104.34.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 08:43:23,922 - DEBUG - [Pod Pod ctest-pod-37366074] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 passed
2025-04-23 08:43:23,922 - DEBUG - [Pod Pod ctest-pod-37366074] Cmd output: ctest-pod-30903643
Connecting to 10.104.34.250:80 (10.104.34.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 08:43:23,980 - DEBUG - [Pod ctest-pod-37366074] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: ctest-pod-30903643
Connecting to 10.104.34.250:80 (10.104.34.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 08:43:23,980 - DEBUG - [Pod Pod ctest-pod-37366074] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 passed
2025-04-23 08:43:23,980 - DEBUG - [Pod Pod ctest-pod-37366074] Cmd output: ctest-pod-30903643
Connecting to 10.104.34.250:80 (10.104.34.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 08:43:24,031 - DEBUG - [Pod ctest-pod-37366074] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: ctest-pod-30903643
Connecting to 10.104.34.250:80 (10.104.34.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 08:43:24,031 - DEBUG - [Pod Pod ctest-pod-37366074] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 passed
2025-04-23 08:43:24,031 - DEBUG - [Pod Pod ctest-pod-37366074] Cmd output: ctest-pod-30903643
Connecting to 10.104.34.250:80 (10.104.34.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 08:43:24,086 - DEBUG - [Pod ctest-pod-37366074] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: ctest-pod-30903643
Connecting to 10.104.34.250:80 (10.104.34.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 08:43:24,087 - DEBUG - [Pod Pod ctest-pod-37366074] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 passed
2025-04-23 08:43:24,087 - DEBUG - [Pod Pod ctest-pod-37366074] Cmd output: ctest-pod-30903643
Connecting to 10.104.34.250:80 (10.104.34.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 08:43:24,143 - DEBUG - [Pod ctest-pod-37366074] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-52155045
2025-04-23 08:43:24,144 - DEBUG - [Pod Pod ctest-pod-37366074] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 passed
2025-04-23 08:43:24,144 - DEBUG - [Pod Pod ctest-pod-37366074] Cmd output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-52155045
2025-04-23 08:43:24,144 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-52155045': 1, 'ctest-pod-30903643': 6}
2025-04-23 08:43:29,189 - DEBUG - [Pod ctest-pod-84230689] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:43:29,189 - DEBUG - [Pod Pod ctest-pod-84230689] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:43:29,189 - DEBUG - [Pod Pod ctest-pod-84230689] Cmd output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:43:34,241 - DEBUG - [Pod ctest-pod-84230689] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:43:34,241 - DEBUG - [Pod Pod ctest-pod-84230689] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:43:34,241 - DEBUG - [Pod Pod ctest-pod-84230689] Cmd output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:43:39,319 - DEBUG - [Pod ctest-pod-84230689] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:43:39,319 - DEBUG - [Pod Pod ctest-pod-84230689] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:43:39,319 - DEBUG - [Pod Pod ctest-pod-84230689] Cmd output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:43:44,366 - DEBUG - [Pod ctest-pod-84230689] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:43:44,366 - DEBUG - [Pod Pod ctest-pod-84230689] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:43:44,366 - DEBUG - [Pod Pod ctest-pod-84230689] Cmd output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:43:49,417 - DEBUG - [Pod ctest-pod-84230689] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:43:49,417 - DEBUG - [Pod Pod ctest-pod-84230689] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:43:49,417 - DEBUG - [Pod Pod ctest-pod-84230689] Cmd output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:43:54,473 - DEBUG - [Pod ctest-pod-84230689] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:43:54,473 - DEBUG - [Pod Pod ctest-pod-84230689] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:43:54,473 - DEBUG - [Pod Pod ctest-pod-84230689] Cmd output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:43:59,530 - DEBUG - [Pod ctest-pod-84230689] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:43:59,530 - DEBUG - [Pod Pod ctest-pod-84230689] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:43:59,530 - DEBUG - [Pod Pod ctest-pod-84230689] Cmd output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:44:04,583 - DEBUG - [Pod ctest-pod-84230689] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:44:04,583 - DEBUG - [Pod Pod ctest-pod-84230689] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:44:04,583 - DEBUG - [Pod Pod ctest-pod-84230689] Cmd output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:44:07,746 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2025-04-23 08:44:17,819 - DEBUG - [Pod ctest-pod-84230689] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:44:17,820 - DEBUG - [Pod Pod ctest-pod-84230689] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:44:17,820 - DEBUG - [Pod Pod ctest-pod-84230689] Cmd output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:44:22,874 - DEBUG - [Pod ctest-pod-84230689] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:44:22,874 - DEBUG - [Pod Pod ctest-pod-84230689] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:44:22,874 - DEBUG - [Pod Pod ctest-pod-84230689] Cmd output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:44:22,874 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-52155045': 0, 'ctest-pod-30903643': 0}
2025-04-23 08:44:24,932 - DEBUG - [Pod ctest-pod-37366074] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.808 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.070 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.088 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.070/0.322/0.808 ms
2025-04-23 08:44:24,933 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-37366074 with expectation True passed
2025-04-23 08:44:26,986 - DEBUG - [Pod ctest-pod-42885028] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.804 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.085 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.080 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.080/0.656/1.804 ms
2025-04-23 08:44:26,986 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-42885028 with expectation True passed
2025-04-23 08:44:29,038 - DEBUG - [Pod ctest-pod-84230689] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.682 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.076 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.078 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.076/0.278/0.682 ms
2025-04-23 08:44:29,038 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-84230689 with expectation True passed
2025-04-23 08:44:29,084 - DEBUG - [Pod ctest-pod-37366074] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-23 08:44:29,084 - DEBUG - [Pod Pod ctest-pod-37366074] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-04-23 08:44:29,084 - DEBUG - [Pod Pod ctest-pod-37366074] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-23 08:44:29,084 - INFO - wget check of of http://10.47.255.251 from ctest-pod-37366074 passed
2025-04-23 08:44:29,141 - DEBUG - [Pod ctest-pod-37366074] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-23 08:44:29,141 - DEBUG - [Pod Pod ctest-pod-37366074] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-04-23 08:44:29,142 - DEBUG - [Pod Pod ctest-pod-37366074] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-23 08:44:29,142 - INFO - wget check of of http://10.47.255.250 from ctest-pod-37366074 passed
2025-04-23 08:44:34,195 - DEBUG - [Pod ctest-pod-42885028] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-23 08:44:34,195 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-23 08:44:34,195 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-23 08:44:34,195 - INFO - wget check of of http://10.47.255.250 from ctest-pod-42885028 passed
2025-04-23 08:44:39,251 - DEBUG - [Pod ctest-pod-68639635] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-04-23 08:44:39,251 - DEBUG - [Pod Pod ctest-pod-68639635] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-04-23 08:44:39,251 - DEBUG - [Pod Pod ctest-pod-68639635] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-04-23 08:44:39,251 - INFO - wget check of of http://10.47.255.251 from ctest-pod-68639635 passed
2025-04-23 08:44:39,267 - INFO - Updating Network Policy ingress-on-service
2025-04-23 08:44:44,342 - DEBUG - [Pod ctest-pod-42885028] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:44:44,342 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:44:44,342 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:44:49,395 - DEBUG - [Pod ctest-pod-42885028] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:44:49,395 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:44:49,395 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:44:54,449 - DEBUG - [Pod ctest-pod-42885028] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:44:54,449 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:44:54,449 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:44:59,501 - DEBUG - [Pod ctest-pod-42885028] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:44:59,501 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:44:59,502 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:45:04,550 - DEBUG - [Pod ctest-pod-42885028] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:45:04,550 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:45:04,550 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:45:09,601 - DEBUG - [Pod ctest-pod-42885028] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:45:09,601 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:45:09,601 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:45:14,657 - DEBUG - [Pod ctest-pod-42885028] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:45:14,658 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:45:14,658 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:45:19,709 - DEBUG - [Pod ctest-pod-42885028] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:45:19,709 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:45:19,709 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:45:24,761 - DEBUG - [Pod ctest-pod-42885028] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:45:24,762 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:45:24,762 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:45:29,819 - DEBUG - [Pod ctest-pod-42885028] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:45:29,819 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:45:29,819 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
wget: download timed out
2025-04-23 08:45:29,819 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-52155045': 0, 'ctest-pod-30903643': 0}
2025-04-23 08:45:29,876 - DEBUG - [Pod ctest-pod-37366074] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: ctest-pod-52155045
Connecting to 10.104.34.250:80 (10.104.34.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 08:45:29,876 - DEBUG - [Pod Pod ctest-pod-37366074] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 passed
2025-04-23 08:45:29,876 - DEBUG - [Pod Pod ctest-pod-37366074] Cmd output: ctest-pod-52155045
Connecting to 10.104.34.250:80 (10.104.34.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 08:45:29,913 - DEBUG - [Pod ctest-pod-37366074] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-30903643
2025-04-23 08:45:29,913 - DEBUG - [Pod Pod ctest-pod-37366074] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 passed
2025-04-23 08:45:29,913 - DEBUG - [Pod Pod ctest-pod-37366074] Cmd output: Connecting to 10.104.34.250:80 (10.104.34.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-30903643
2025-04-23 08:45:29,913 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-52155045': 1, 'ctest-pod-30903643': 1}
2025-04-23 08:45:29,967 - DEBUG - [Pod ctest-pod-84230689] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: ctest-pod-52155045
Connecting to 10.104.34.250:80 (10.104.34.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 08:45:29,967 - DEBUG - [Pod Pod ctest-pod-84230689] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 passed
2025-04-23 08:45:29,967 - DEBUG - [Pod Pod ctest-pod-84230689] Cmd output: ctest-pod-52155045
Connecting to 10.104.34.250:80 (10.104.34.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 08:45:30,025 - DEBUG - [Pod ctest-pod-84230689] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: ctest-pod-52155045
Connecting to 10.104.34.250:80 (10.104.34.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 08:45:30,025 - DEBUG - [Pod Pod ctest-pod-84230689] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 passed
2025-04-23 08:45:30,025 - DEBUG - [Pod Pod ctest-pod-84230689] Cmd output: ctest-pod-52155045
Connecting to 10.104.34.250:80 (10.104.34.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 08:45:30,075 - DEBUG - [Pod ctest-pod-84230689] Cmd: wget http://10.104.34.250:80/ -O - -T 5 -t 1 , Output: ctest-pod-30903643
Connecting to 10.104.34.250:80 (10.104.34.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 08:45:30,075 - DEBUG - [Pod Pod ctest-pod-84230689] Cmd wget http://10.104.34.250:80/ -O - -T 5 -t 1 passed
2025-04-23 08:45:30,075 - DEBUG - [Pod Pod ctest-pod-84230689] Cmd output: ctest-pod-30903643
Connecting to 10.104.34.250:80 (10.104.34.250:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 08:45:30,075 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-52155045': 2, 'ctest-pod-30903643': 1}
2025-04-23 08:45:32,126 - DEBUG - [Pod ctest-pod-37366074] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.170 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.069 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.059 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.059/0.432/1.170 ms
2025-04-23 08:45:32,127 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-37366074 with expectation True passed
2025-04-23 08:45:34,189 - DEBUG - [Pod ctest-pod-42885028] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.005 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.074 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.085 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.074/0.388/1.005 ms
2025-04-23 08:45:34,190 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-42885028 with expectation True passed
2025-04-23 08:45:36,242 - DEBUG - [Pod ctest-pod-84230689] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.419 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.074 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.109 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.074/0.200/0.419 ms
2025-04-23 08:45:36,242 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-84230689 with expectation True passed
2025-04-23 08:45:36,302 - DEBUG - [Pod ctest-pod-37366074] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-23 08:45:36,302 - DEBUG - [Pod Pod ctest-pod-37366074] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-04-23 08:45:36,302 - DEBUG - [Pod Pod ctest-pod-37366074] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-23 08:45:36,302 - INFO - wget check of of http://10.47.255.251 from ctest-pod-37366074 passed
2025-04-23 08:45:36,367 - DEBUG - [Pod ctest-pod-37366074] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-23 08:45:36,367 - DEBUG - [Pod Pod ctest-pod-37366074] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-04-23 08:45:36,367 - DEBUG - [Pod Pod ctest-pod-37366074] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-23 08:45:36,367 - INFO - wget check of of http://10.47.255.250 from ctest-pod-37366074 passed
2025-04-23 08:45:41,417 - DEBUG - [Pod ctest-pod-42885028] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-23 08:45:41,417 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-23 08:45:41,417 - DEBUG - [Pod Pod ctest-pod-42885028] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-23 08:45:41,417 - INFO - wget check of of http://10.47.255.250 from ctest-pod-42885028 passed
2025-04-23 08:45:41,480 - DEBUG - [Pod ctest-pod-68639635] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-23 08:45:41,481 - DEBUG - [Pod Pod ctest-pod-68639635] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-04-23 08:45:41,481 - DEBUG - [Pod Pod ctest-pod-68639635] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-23 08:45:41,481 - INFO - wget check of of http://10.47.255.251 from ctest-pod-68639635 passed
2025-04-23 08:45:41,481 - INFO - Deleting Network Policy : ingress-on-service
2025-04-23 08:45:41,481 - INFO - Deleting service : ctest-nginx-svc-13678315
2025-04-23 08:45:41,739 - DEBUG - No XMPP flaps were noticed during the test
2025-04-23 08:45:41,739 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:13]
2025-04-23 08:45:41,739 - INFO - --------------------------------------------------------------------------------
2025-04-23 08:45:41,744 - INFO - Deleting pod ctest-new-default-05334063:ctest-pod-52155045
2025-04-23 08:45:41,745 - INFO - Deleting pod ctest-new-default-05334063:ctest-pod-30903643
2025-04-23 08:45:41,746 - INFO - Deleting pod ctest-non-default-34868741:ctest-pod-21238940
2025-04-23 08:45:41,746 - INFO - Deleting pod ctest-non-default-34868741:ctest-pod-94885037
2025-04-23 08:45:41,746 - INFO - Deleting pod ctest-new-default-05334063:ctest-pod-42885028
2025-04-23 08:45:41,747 - INFO - Deleting pod ctest-new-default-05334063:ctest-pod-37366074
2025-04-23 08:45:41,747 - INFO - Deleting pod ctest-non-default-34868741:ctest-pod-84230689
2025-04-23 08:45:41,747 - INFO - Deleting pod ctest-non-default-34868741:ctest-pod-68639635
2025-04-23 08:45:41,984 - WARNING - Pod uuid 532de7a3-4303-4cc2-9931-231bbd1e0381 is still seen in agent 10.0.0.57 VM list
2025-04-23 08:45:41,987 - WARNING - Pod uuid 5f43dab7-10c6-416b-946e-d4c0d338efa6 is still seen in agent 10.0.0.57 VM list
2025-04-23 08:45:41,987 - WARNING - Pod uuid 1ab568bc-e3b3-4dc0-b2da-bd4ef359928f is still seen in agent 10.0.0.57 VM list
2025-04-23 08:45:41,988 - WARNING - Pod uuid 5e0c44fd-4eab-446f-aeda-9cf4801b39d0 is still seen in agent 10.0.0.57 VM list
2025-04-23 08:45:41,988 - WARNING - Pod uuid 76944504-2434-46fc-b0dc-44458e73a514 is still seen in agent 10.0.0.57 VM list
2025-04-23 08:45:41,989 - WARNING - Pod uuid 3490af09-eb47-44b0-adf8-21c02b6c9f60 is still seen in agent 10.0.0.57 VM list
2025-04-23 08:45:41,989 - WARNING - Pod uuid f0815a0d-2b2b-4fa9-b052-f708c2592c4c is still seen in agent 10.0.0.57 VM list
2025-04-23 08:45:41,989 - WARNING - Pod uuid 5625d080-1e11-4f4f-8bcf-e5f2cb32a349 is still seen in agent 10.0.0.57 VM list
2025-04-23 08:45:47,030 - WARNING - Pod uuid 76944504-2434-46fc-b0dc-44458e73a514 is still seen in agent 10.0.0.57 VM list
2025-04-23 08:45:47,031 - WARNING - Pod uuid 5e0c44fd-4eab-446f-aeda-9cf4801b39d0 is still seen in agent 10.0.0.57 VM list
2025-04-23 08:45:47,035 - WARNING - Pod uuid f0815a0d-2b2b-4fa9-b052-f708c2592c4c is still seen in agent 10.0.0.57 VM list
2025-04-23 08:45:47,035 - DEBUG - Pod 5625d080-1e11-4f4f-8bcf-e5f2cb32a349 is not in agent 10.0.0.57 VM list
2025-04-23 08:45:47,037 - WARNING - Pod uuid 3490af09-eb47-44b0-adf8-21c02b6c9f60 is still seen in agent 10.0.0.57 VM list
2025-04-23 08:45:47,038 - DEBUG - Pod 532de7a3-4303-4cc2-9931-231bbd1e0381 is not in agent 10.0.0.57 VM list
2025-04-23 08:45:47,039 - DEBUG - Pod 1ab568bc-e3b3-4dc0-b2da-bd4ef359928f is not in agent 10.0.0.57 VM list
2025-04-23 08:45:47,041 - DEBUG - Pod 5f43dab7-10c6-416b-946e-d4c0d338efa6 is not in agent 10.0.0.57 VM list
2025-04-23 08:45:47,057 - DEBUG - VMI d9e15a64-201e-11f0-bcf6-fa163e142c54 is removed from agent 10.0.0.57
2025-04-23 08:45:47,057 - INFO - Verified that pod ctest-pod-94885037 is removed in agent
2025-04-23 08:45:47,057 - DEBUG - VMI d860b298-201e-11f0-bcf6-fa163e142c54 is removed from agent 10.0.0.57
2025-04-23 08:45:47,057 - INFO - Verified that pod ctest-pod-30903643 is removed in agent
2025-04-23 08:45:47,059 - DEBUG - VMI d9418a7a-201e-11f0-bcf6-fa163e142c54 is removed from agent 10.0.0.57
2025-04-23 08:45:47,059 - INFO - Verified that pod ctest-pod-21238940 is removed in agent
2025-04-23 08:45:47,060 - DEBUG - VMI d7ac8534-201e-11f0-bcf6-fa163e142c54 is removed from agent 10.0.0.57
2025-04-23 08:45:47,060 - INFO - Verified that pod ctest-pod-52155045 is removed in agent
2025-04-23 08:45:52,053 - WARNING - Pod uuid 5e0c44fd-4eab-446f-aeda-9cf4801b39d0 is still seen in agent 10.0.0.57 VM list
2025-04-23 08:45:52,054 - WARNING - Pod uuid 76944504-2434-46fc-b0dc-44458e73a514 is still seen in agent 10.0.0.57 VM list
2025-04-23 08:45:52,055 - WARNING - Pod uuid 3490af09-eb47-44b0-adf8-21c02b6c9f60 is still seen in agent 10.0.0.57 VM list
2025-04-23 08:45:52,056 - WARNING - Pod uuid f0815a0d-2b2b-4fa9-b052-f708c2592c4c is still seen in agent 10.0.0.57 VM list
2025-04-23 08:45:57,074 - WARNING - Pod uuid 76944504-2434-46fc-b0dc-44458e73a514 is still seen in agent 10.0.0.57 VM list
2025-04-23 08:45:57,076 - WARNING - Pod uuid f0815a0d-2b2b-4fa9-b052-f708c2592c4c is still seen in agent 10.0.0.57 VM list
2025-04-23 08:45:57,076 - WARNING - Pod uuid 3490af09-eb47-44b0-adf8-21c02b6c9f60 is still seen in agent 10.0.0.57 VM list
2025-04-23 08:45:57,077 - WARNING - Pod uuid 5e0c44fd-4eab-446f-aeda-9cf4801b39d0 is still seen in agent 10.0.0.57 VM list
2025-04-23 08:46:02,112 - WARNING - Pod uuid 5e0c44fd-4eab-446f-aeda-9cf4801b39d0 is still seen in agent 10.0.0.57 VM list
2025-04-23 08:46:02,112 - WARNING - Pod uuid f0815a0d-2b2b-4fa9-b052-f708c2592c4c is still seen in agent 10.0.0.57 VM list
2025-04-23 08:46:02,113 - WARNING - Pod uuid 3490af09-eb47-44b0-adf8-21c02b6c9f60 is still seen in agent 10.0.0.57 VM list
2025-04-23 08:46:02,113 - WARNING - Pod uuid 76944504-2434-46fc-b0dc-44458e73a514 is still seen in agent 10.0.0.57 VM list
2025-04-23 08:46:07,132 - WARNING - Pod uuid 76944504-2434-46fc-b0dc-44458e73a514 is still seen in agent 10.0.0.57 VM list
2025-04-23 08:46:07,133 - WARNING - Pod uuid 5e0c44fd-4eab-446f-aeda-9cf4801b39d0 is still seen in agent 10.0.0.57 VM list
2025-04-23 08:46:07,135 - WARNING - Pod uuid 3490af09-eb47-44b0-adf8-21c02b6c9f60 is still seen in agent 10.0.0.57 VM list
2025-04-23 08:46:07,135 - WARNING - Pod uuid f0815a0d-2b2b-4fa9-b052-f708c2592c4c is still seen in agent 10.0.0.57 VM list
2025-04-23 08:46:12,153 - WARNING - Pod uuid 5e0c44fd-4eab-446f-aeda-9cf4801b39d0 is still seen in agent 10.0.0.57 VM list
2025-04-23 08:46:12,154 - WARNING - Pod uuid f0815a0d-2b2b-4fa9-b052-f708c2592c4c is still seen in agent 10.0.0.57 VM list
2025-04-23 08:46:12,155 - WARNING - Pod uuid 3490af09-eb47-44b0-adf8-21c02b6c9f60 is still seen in agent 10.0.0.57 VM list
2025-04-23 08:46:12,155 - WARNING - Pod uuid 76944504-2434-46fc-b0dc-44458e73a514 is still seen in agent 10.0.0.57 VM list
2025-04-23 08:46:17,173 - DEBUG - Pod f0815a0d-2b2b-4fa9-b052-f708c2592c4c is not in agent 10.0.0.57 VM list
2025-04-23 08:46:17,175 - DEBUG - Pod 5e0c44fd-4eab-446f-aeda-9cf4801b39d0 is not in agent 10.0.0.57 VM list
2025-04-23 08:46:17,178 - DEBUG - Pod 76944504-2434-46fc-b0dc-44458e73a514 is not in agent 10.0.0.57 VM list
2025-04-23 08:46:17,180 - DEBUG - Pod 3490af09-eb47-44b0-adf8-21c02b6c9f60 is not in agent 10.0.0.57 VM list
2025-04-23 08:46:17,207 - DEBUG - VMI db1ad9aa-201e-11f0-bcf6-fa163e142c54 is removed from agent 10.0.0.57
2025-04-23 08:46:17,207 - INFO - Verified that pod ctest-pod-37366074 is removed in agent
2025-04-23 08:46:17,208 - DEBUG - VMI dbbe92b6-201e-11f0-bcf6-fa163e142c54 is removed from agent 10.0.0.57
2025-04-23 08:46:17,208 - INFO - Verified that pod ctest-pod-84230689 is removed in agent
2025-04-23 08:46:17,209 - DEBUG - VMI da91a3c4-201e-11f0-bcf6-fa163e142c54 is removed from agent 10.0.0.57
2025-04-23 08:46:17,209 - INFO - Verified that pod ctest-pod-42885028 is removed in agent
2025-04-23 08:46:17,210 - DEBUG - VMI dc4febda-201e-11f0-bcf6-fa163e142c54 is removed from agent 10.0.0.57
2025-04-23 08:46:17,210 - INFO - Verified that pod ctest-pod-68639635 is removed in agent
2025-04-23 08:46:17,210 - INFO - Deleting namespace ctest-non-default-34868741
2025-04-23 08:46:17,220 - DEBUG - Namespace ctest-non-default-34868741 still in k8s
2025-04-23 08:46:19,225 - DEBUG - Namespace ctest-non-default-34868741 still in k8s
2025-04-23 08:46:21,230 - DEBUG - Namespace ctest-non-default-34868741 still in k8s
2025-04-23 08:46:23,234 - DEBUG - Namespace ctest-non-default-34868741 is not in k8s
2025-04-23 08:46:23,234 - DEBUG - No need to check project deletion in contrail-api
2025-04-23 08:46:23,234 - INFO - Deleting namespace ctest-new-default-05334063
2025-04-23 08:46:23,242 - DEBUG - Namespace ctest-new-default-05334063 still in k8s
2025-04-23 08:46:25,247 - DEBUG - Namespace ctest-new-default-05334063 still in k8s
2025-04-23 08:46:27,253 - DEBUG - Namespace ctest-new-default-05334063 still in k8s
2025-04-23 08:46:29,262 - DEBUG - Namespace ctest-new-default-05334063 is not in k8s
2025-04-23 08:46:29,264 - DEBUG - No need to check project deletion in contrail-api