2025-03-29 14:53:52,687 - INFO - Using existing project ['default-domain', 'k8s-default'](e47b39d1-4cc4-4734-bfb2-0f45a869bd82)
2025-03-29 14:53:52,717 - DEBUG - Namespace ctest-new-default-36952500 not present
2025-03-29 14:53:52,739 - INFO - Created namespace ctest-new-default-36952500
2025-03-29 14:53:55,742 - DEBUG - Namespace ctest-non-default-82868352 not present
2025-03-29 14:53:55,754 - INFO - Created namespace ctest-non-default-82868352
2025-03-29 14:53:58,773 - DEBUG - Pod ctest-pod-80977711 not present
2025-03-29 14:53:58,773 - INFO - Creating Pod ctest-pod-80977711
2025-03-29 14:53:58,821 - DEBUG - Pod : ctest-pod-80977711 UUID is 56e7a1ed-8366-4372-8c30-c4e7bc382327
2025-03-29 14:53:58,833 - DEBUG - Pod ctest-pod-58637338 not present
2025-03-29 14:53:58,833 - INFO - Creating Pod ctest-pod-58637338
2025-03-29 14:53:58,860 - DEBUG - Pod : ctest-pod-58637338 UUID is 60ca2f82-4ba3-42ba-bb90-d66cc410aa17
2025-03-29 14:53:58,864 - DEBUG - Pod ctest-pod-48779240 not present
2025-03-29 14:53:58,864 - INFO - Creating Pod ctest-pod-48779240
2025-03-29 14:53:58,922 - DEBUG - Pod : ctest-pod-48779240 UUID is 4474cda2-0ebf-4d19-8344-93095aec5a4e
2025-03-29 14:53:58,927 - DEBUG - Pod ctest-pod-23505358 not present
2025-03-29 14:53:58,927 - INFO - Creating Pod ctest-pod-23505358
2025-03-29 14:53:58,960 - DEBUG - Pod : ctest-pod-23505358 UUID is 3e1f9db0-91ef-424a-bd63-b30e09172f5c
2025-03-29 14:53:58,964 - DEBUG - Pod ctest-pod-76226947 not present
2025-03-29 14:53:58,964 - INFO - Creating Pod ctest-pod-76226947
2025-03-29 14:53:58,983 - DEBUG - Pod : ctest-pod-76226947 UUID is 76cc76e6-66ad-4ad0-9f68-56d52c5b9c74
2025-03-29 14:53:58,988 - DEBUG - Pod ctest-pod-00421583 not present
2025-03-29 14:53:58,989 - INFO - Creating Pod ctest-pod-00421583
2025-03-29 14:53:59,013 - DEBUG - Pod : ctest-pod-00421583 UUID is f8d510be-8475-4fd0-9c8a-b65ef3ee293d
2025-03-29 14:53:59,017 - DEBUG - Pod ctest-pod-10014917 not present
2025-03-29 14:53:59,017 - INFO - Creating Pod ctest-pod-10014917
2025-03-29 14:53:59,036 - DEBUG - Pod : ctest-pod-10014917 UUID is f91d75c3-150f-4280-a555-3b250357914a
2025-03-29 14:53:59,041 - DEBUG - Pod ctest-pod-88912650 not present
2025-03-29 14:53:59,042 - INFO - Creating Pod ctest-pod-88912650
2025-03-29 14:53:59,079 - DEBUG - Pod : ctest-pod-88912650 UUID is 5d503a0a-8ea6-47a3-b9d4-75a2e2e3f7bc
2025-03-29 14:53:59,268 - INFO - Project default-domain:k8s-ctest-new-default-36952500 for Namespace ctest-new-default-36952500 is seen in contrail-api
2025-03-29 14:53:59,268 - DEBUG - Project uuid in Contrail is 51d3169f-5011-44ad-9a09-10ef4cbda16b
2025-03-29 14:53:59,474 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_NamespaceDatabaseList?namespace_uuid=0049a137-49c6-48b3-b177-ab73fd80114a
2025-03-29 14:53:59,480 - INFO - Namespace ctest-new-default-36952500 with uuid 0049a137-49c6-48b3-b177-ab73fd80114a found in kube manager
2025-03-29 14:53:59,480 - INFO - Namespace ctest-new-default-36952500 verification passed
2025-03-29 14:53:59,720 - INFO - Project default-domain:k8s-ctest-non-default-82868352 for Namespace ctest-non-default-82868352 is seen in contrail-api
2025-03-29 14:53:59,720 - DEBUG - Project uuid in Contrail is 988ca15f-03b2-40be-93a8-4559ad5f56a4
2025-03-29 14:53:59,720 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_NamespaceDatabaseList?namespace_uuid=6552cc16-508d-4442-825d-6aeb52e169d5
2025-03-29 14:53:59,726 - INFO - Namespace ctest-non-default-82868352 with uuid 6552cc16-508d-4442-825d-6aeb52e169d5 found in kube manager
2025-03-29 14:53:59,726 - INFO - Namespace ctest-non-default-82868352 verification passed
2025-03-29 14:53:59,748 - DEBUG - Pod ctest-pod-80977711 not in running state.Currently in Pending
2025-03-29 14:54:04,763 - DEBUG - Pod ctest-pod-80977711 not in running state.Currently in Pending
2025-03-29 14:54:09,773 - DEBUG - Pod ctest-pod-80977711 not in running state.Currently in Pending
2025-03-29 14:54:14,779 - INFO - Pod ctest-pod-80977711 is in running state.Got IP 10.47.255.251
2025-03-29 14:54:14,835 - DEBUG - Pod ctest-pod-80977711 has vmi a65d7a30-0cad-11f0-87fb-fa163e6ee716
2025-03-29 14:54:14,836 - INFO - Verified pod ctest-pod-80977711 in contrail-api
2025-03-29 14:54:14,854 - DEBUG - VMI a65d7a30-0cad-11f0-87fb-fa163e6ee716 is active in agent 10.0.0.28
2025-03-29 14:54:14,854 - INFO - Verified Pod ctest-pod-80977711 in agent 10.0.0.28
2025-03-29 14:54:14,855 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=56e7a1ed-8366-4372-8c30-c4e7bc382327
2025-03-29 14:54:14,861 - INFO - Pod ctest-pod-80977711 with uuid 56e7a1ed-8366-4372-8c30-c4e7bc382327 found in kube manager
2025-03-29 14:54:14,861 - INFO - Pod ctest-pod-80977711 verification passed
2025-03-29 14:54:14,867 - INFO - Pod ctest-pod-58637338 is in running state.Got IP 10.47.255.250
2025-03-29 14:54:14,882 - DEBUG - Pod ctest-pod-58637338 has vmi a6f60548-0cad-11f0-87fb-fa163e6ee716
2025-03-29 14:54:14,882 - INFO - Verified pod ctest-pod-58637338 in contrail-api
2025-03-29 14:54:14,898 - DEBUG - VMI a6f60548-0cad-11f0-87fb-fa163e6ee716 is active in agent 10.0.0.28
2025-03-29 14:54:14,898 - INFO - Verified Pod ctest-pod-58637338 in agent 10.0.0.28
2025-03-29 14:54:14,899 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=60ca2f82-4ba3-42ba-bb90-d66cc410aa17
2025-03-29 14:54:14,903 - INFO - Pod ctest-pod-58637338 with uuid 60ca2f82-4ba3-42ba-bb90-d66cc410aa17 found in kube manager
2025-03-29 14:54:14,904 - INFO - Pod ctest-pod-58637338 verification passed
2025-03-29 14:54:14,909 - INFO - Pod ctest-pod-48779240 is in running state.Got IP 10.47.255.249
2025-03-29 14:54:14,968 - DEBUG - Pod ctest-pod-48779240 has vmi a7b30eae-0cad-11f0-87fb-fa163e6ee716
2025-03-29 14:54:14,968 - INFO - Verified pod ctest-pod-48779240 in contrail-api
2025-03-29 14:54:14,982 - DEBUG - VMI a7b30eae-0cad-11f0-87fb-fa163e6ee716 is active in agent 10.0.0.28
2025-03-29 14:54:14,983 - INFO - Verified Pod ctest-pod-48779240 in agent 10.0.0.28
2025-03-29 14:54:14,983 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=4474cda2-0ebf-4d19-8344-93095aec5a4e
2025-03-29 14:54:14,989 - INFO - Pod ctest-pod-48779240 with uuid 4474cda2-0ebf-4d19-8344-93095aec5a4e found in kube manager
2025-03-29 14:54:14,989 - INFO - Pod ctest-pod-48779240 verification passed
2025-03-29 14:54:14,994 - INFO - Pod ctest-pod-23505358 is in running state.Got IP 10.47.255.248
2025-03-29 14:54:15,051 - DEBUG - Pod ctest-pod-23505358 has vmi a83dfc76-0cad-11f0-87fb-fa163e6ee716
2025-03-29 14:54:15,051 - INFO - Verified pod ctest-pod-23505358 in contrail-api
2025-03-29 14:54:15,066 - DEBUG - VMI a83dfc76-0cad-11f0-87fb-fa163e6ee716 is active in agent 10.0.0.28
2025-03-29 14:54:15,066 - INFO - Verified Pod ctest-pod-23505358 in agent 10.0.0.28
2025-03-29 14:54:15,066 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=3e1f9db0-91ef-424a-bd63-b30e09172f5c
2025-03-29 14:54:15,072 - INFO - Pod ctest-pod-23505358 with uuid 3e1f9db0-91ef-424a-bd63-b30e09172f5c found in kube manager
2025-03-29 14:54:15,072 - INFO - Pod ctest-pod-23505358 verification passed
2025-03-29 14:54:15,078 - INFO - Pod ctest-pod-76226947 is in running state.Got IP 10.47.255.247
2025-03-29 14:54:15,103 - DEBUG - Pod ctest-pod-76226947 has vmi a8e3750c-0cad-11f0-87fb-fa163e6ee716
2025-03-29 14:54:15,103 - INFO - Verified pod ctest-pod-76226947 in contrail-api
2025-03-29 14:54:15,118 - DEBUG - VMI a8e3750c-0cad-11f0-87fb-fa163e6ee716 is active in agent 10.0.0.28
2025-03-29 14:54:15,119 - INFO - Verified Pod ctest-pod-76226947 in agent 10.0.0.28
2025-03-29 14:54:15,119 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=76cc76e6-66ad-4ad0-9f68-56d52c5b9c74
2025-03-29 14:54:15,124 - INFO - Pod ctest-pod-76226947 with uuid 76cc76e6-66ad-4ad0-9f68-56d52c5b9c74 found in kube manager
2025-03-29 14:54:15,124 - INFO - Pod ctest-pod-76226947 verification passed
2025-03-29 14:54:15,132 - INFO - Pod ctest-pod-10014917 is in running state.Got IP 10.47.255.245
2025-03-29 14:54:15,190 - DEBUG - Pod ctest-pod-10014917 has vmi aa034f98-0cad-11f0-87fb-fa163e6ee716
2025-03-29 14:54:15,190 - INFO - Verified pod ctest-pod-10014917 in contrail-api
2025-03-29 14:54:15,208 - DEBUG - VMI aa034f98-0cad-11f0-87fb-fa163e6ee716 is active in agent 10.0.0.28
2025-03-29 14:54:15,208 - INFO - Verified Pod ctest-pod-10014917 in agent 10.0.0.28
2025-03-29 14:54:15,208 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=f91d75c3-150f-4280-a555-3b250357914a
2025-03-29 14:54:15,217 - INFO - Pod ctest-pod-10014917 with uuid f91d75c3-150f-4280-a555-3b250357914a found in kube manager
2025-03-29 14:54:15,217 - INFO - Pod ctest-pod-10014917 verification passed
2025-03-29 14:54:15,223 - DEBUG - Pod ctest-pod-00421583 not in running state.Currently in Pending
2025-03-29 14:54:20,232 - INFO - Pod ctest-pod-00421583 is in running state.Got IP 10.47.255.246
2025-03-29 14:54:20,248 - DEBUG - Pod ctest-pod-00421583 has vmi a96b2916-0cad-11f0-87fb-fa163e6ee716
2025-03-29 14:54:20,248 - INFO - Verified pod ctest-pod-00421583 in contrail-api
2025-03-29 14:54:20,266 - DEBUG - VMI a96b2916-0cad-11f0-87fb-fa163e6ee716 is active in agent 10.0.0.28
2025-03-29 14:54:20,267 - INFO - Verified Pod ctest-pod-00421583 in agent 10.0.0.28
2025-03-29 14:54:20,267 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=f8d510be-8475-4fd0-9c8a-b65ef3ee293d
2025-03-29 14:54:20,275 - INFO - Pod ctest-pod-00421583 with uuid f8d510be-8475-4fd0-9c8a-b65ef3ee293d found in kube manager
2025-03-29 14:54:20,275 - INFO - Pod ctest-pod-00421583 verification passed
2025-03-29 14:54:20,283 - INFO - Pod ctest-pod-88912650 is in running state.Got IP 10.47.255.244
2025-03-29 14:54:20,356 - DEBUG - Pod ctest-pod-88912650 has vmi aa923776-0cad-11f0-87fb-fa163e6ee716
2025-03-29 14:54:20,356 - INFO - Verified pod ctest-pod-88912650 in contrail-api
2025-03-29 14:54:20,373 - DEBUG - VMI aa923776-0cad-11f0-87fb-fa163e6ee716 is active in agent 10.0.0.28
2025-03-29 14:54:20,373 - INFO - Verified Pod ctest-pod-88912650 in agent 10.0.0.28
2025-03-29 14:54:20,373 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=5d503a0a-8ea6-47a3-b9d4-75a2e2e3f7bc
2025-03-29 14:54:20,380 - INFO - Pod ctest-pod-88912650 with uuid 5d503a0a-8ea6-47a3-b9d4-75a2e2e3f7bc found in kube manager
2025-03-29 14:54:20,380 - INFO - Pod ctest-pod-88912650 verification passed
2025-03-29 14:54:20,380 - INFO - ================================================================================
2025-03-29 14:54:20,381 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-03-29 14:54:20,381 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-03-29 14:54:20,647 - DEBUG - Nothing to compare xmpp stats {'10.0.0.28': {'10.0.0.41': '0'}} with
2025-03-29 14:54:20,647 - INFO - Initial checks done. Running the testcase now
2025-03-29 14:54:20,647 - INFO -
2025-03-29 14:54:20,719 - DEBUG - [Pod ctest-pod-80977711] Cmd: echo ctest-pod-80977711 > /usr/share/nginx/html/index.html, Output:
2025-03-29 14:54:20,795 - DEBUG - [Pod ctest-pod-58637338] Cmd: echo ctest-pod-58637338 > /usr/share/nginx/html/index.html, Output:
2025-03-29 14:54:20,875 - DEBUG - [Pod ctest-pod-48779240] Cmd: echo ctest-pod-48779240 > /usr/share/nginx/html/index.html, Output:
2025-03-29 14:54:20,950 - DEBUG - [Pod ctest-pod-23505358] Cmd: echo ctest-pod-23505358 > /usr/share/nginx/html/index.html, Output:
2025-03-29 14:54:20,953 - DEBUG - Service ctest-nginx-svc-02166610 not present
2025-03-29 14:54:20,953 - INFO - Creating service ctest-nginx-svc-02166610
2025-03-29 14:54:20,971 - INFO - Created Service ctest-nginx-svc-02166610
2025-03-29 14:54:20,990 - WARNING - Service UUID a848c62c-3b34-4760-881d-ac9192eb6de2 not yet found in contrail-api
2025-03-29 14:54:21,997 - INFO - Validated that Service ctest-nginx-svc-02166610 is seen in contrail-api
2025-03-29 14:54:21,997 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_LoadbalancerDatabaseList?x=a848c62c-3b34-4760-881d-ac9192eb6de2
2025-03-29 14:54:22,002 - INFO - Service ctest-nginx-svc-02166610 with uuid a848c62c-3b34-4760-881d-ac9192eb6de2 found in kube manager
2025-03-29 14:54:22,002 - INFO - Service ctest-nginx-svc-02166610 verification passed
2025-03-29 14:54:23,076 - DEBUG - [Pod ctest-pod-76226947] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
ctest-pod-58637338
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 14:54:23,077 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 passed
2025-03-29 14:54:23,077 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
ctest-pod-58637338
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 14:54:23,153 - DEBUG - [Pod ctest-pod-76226947] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: ctest-pod-58637338
Connecting to 10.106.68.30:80 (10.106.68.30:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 14:54:23,154 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 passed
2025-03-29 14:54:23,154 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd output: ctest-pod-58637338
Connecting to 10.106.68.30:80 (10.106.68.30:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 14:54:23,214 - DEBUG - [Pod ctest-pod-76226947] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: ctest-pod-58637338
Connecting to 10.106.68.30:80 (10.106.68.30:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 14:54:23,214 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 passed
2025-03-29 14:54:23,214 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd output: ctest-pod-58637338
Connecting to 10.106.68.30:80 (10.106.68.30:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 14:54:23,297 - DEBUG - [Pod ctest-pod-76226947] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: ctest-pod-80977711
Connecting to 10.106.68.30:80 (10.106.68.30:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 14:54:23,297 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 passed
2025-03-29 14:54:23,297 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd output: ctest-pod-80977711
Connecting to 10.106.68.30:80 (10.106.68.30:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 14:54:23,297 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-80977711': 1, 'ctest-pod-58637338': 3}
2025-03-29 14:54:23,366 - DEBUG - [Pod ctest-pod-10014917] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: ctest-pod-80977711
Connecting to 10.106.68.30:80 (10.106.68.30:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 14:54:23,366 - DEBUG - [Pod Pod ctest-pod-10014917] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 passed
2025-03-29 14:54:23,366 - DEBUG - [Pod Pod ctest-pod-10014917] Cmd output: ctest-pod-80977711
Connecting to 10.106.68.30:80 (10.106.68.30:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 14:54:23,430 - DEBUG - [Pod ctest-pod-10014917] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
ctest-pod-58637338
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 14:54:23,431 - DEBUG - [Pod Pod ctest-pod-10014917] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 passed
2025-03-29 14:54:23,431 - DEBUG - [Pod Pod ctest-pod-10014917] Cmd output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
ctest-pod-58637338
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 14:54:23,431 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-80977711': 1, 'ctest-pod-58637338': 1}
2025-03-29 14:54:23,521 - DEBUG - Network policy ingress-on-service not present
2025-03-29 14:54:23,522 - INFO - Creating Network Policy ingress-on-service
2025-03-29 14:54:23,534 - INFO - Network policy found in k8s
2025-03-29 14:54:23,534 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=fbde616e-cff6-4b22-853f-691492ae2e78
2025-03-29 14:54:23,540 - INFO - Network Policy ingress-on-service with uuid fbde616e-cff6-4b22-853f-691492ae2e78 found in kube manager
2025-03-29 14:54:23,577 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-03-29 14:54:23,578 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-03-29 14:54:23,578 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=fbde616e-cff6-4b22-853f-691492ae2e78
2025-03-29 14:54:23,617 - WARNING - Network policy with name ingress-on-service not found in agent
2025-03-29 14:54:25,619 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=fbde616e-cff6-4b22-853f-691492ae2e78
2025-03-29 14:54:25,653 - INFO - Network policy with name ingress-on-service found in agent
2025-03-29 14:54:25,653 - INFO - Network Policy ingress-on-service verification passed
2025-03-29 14:54:30,713 - DEBUG - [Pod ctest-pod-76226947] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:54:30,713 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:54:30,713 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:54:35,791 - DEBUG - [Pod ctest-pod-76226947] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:54:35,791 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:54:35,791 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:54:40,865 - DEBUG - [Pod ctest-pod-76226947] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:54:40,865 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:54:40,865 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:54:45,930 - DEBUG - [Pod ctest-pod-76226947] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:54:45,930 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:54:45,930 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:54:50,993 - DEBUG - [Pod ctest-pod-76226947] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:54:50,993 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:54:50,993 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:54:56,061 - DEBUG - [Pod ctest-pod-76226947] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:54:56,061 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:54:56,061 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:55:01,120 - DEBUG - [Pod ctest-pod-76226947] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:55:01,121 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:55:01,121 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:55:06,192 - DEBUG - [Pod ctest-pod-76226947] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:55:06,192 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:55:06,193 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:55:11,249 - DEBUG - [Pod ctest-pod-76226947] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:55:11,250 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:55:11,250 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:55:16,313 - DEBUG - [Pod ctest-pod-76226947] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:55:16,314 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:55:16,314 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:55:16,314 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-80977711': 0, 'ctest-pod-58637338': 0}
2025-03-29 14:55:16,377 - DEBUG - [Pod ctest-pod-00421583] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-58637338
2025-03-29 14:55:16,377 - DEBUG - [Pod Pod ctest-pod-00421583] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 passed
2025-03-29 14:55:16,377 - DEBUG - [Pod Pod ctest-pod-00421583] Cmd output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-58637338
2025-03-29 14:55:16,438 - DEBUG - [Pod ctest-pod-00421583] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: ctest-pod-58637338
Connecting to 10.106.68.30:80 (10.106.68.30:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 14:55:16,438 - DEBUG - [Pod Pod ctest-pod-00421583] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 passed
2025-03-29 14:55:16,438 - DEBUG - [Pod Pod ctest-pod-00421583] Cmd output: ctest-pod-58637338
Connecting to 10.106.68.30:80 (10.106.68.30:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 14:55:16,496 - DEBUG - [Pod ctest-pod-00421583] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
ctest-pod-80977711
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 14:55:16,496 - DEBUG - [Pod Pod ctest-pod-00421583] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 passed
2025-03-29 14:55:16,496 - DEBUG - [Pod Pod ctest-pod-00421583] Cmd output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
ctest-pod-80977711
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 14:55:16,496 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-80977711': 1, 'ctest-pod-58637338': 2}
2025-03-29 14:55:21,554 - DEBUG - [Pod ctest-pod-10014917] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:55:21,554 - DEBUG - [Pod Pod ctest-pod-10014917] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:55:21,554 - DEBUG - [Pod Pod ctest-pod-10014917] Cmd output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:55:26,604 - DEBUG - [Pod ctest-pod-10014917] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:55:26,604 - DEBUG - [Pod Pod ctest-pod-10014917] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:55:26,604 - DEBUG - [Pod Pod ctest-pod-10014917] Cmd output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:55:31,674 - DEBUG - [Pod ctest-pod-10014917] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:55:31,674 - DEBUG - [Pod Pod ctest-pod-10014917] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:55:31,674 - DEBUG - [Pod Pod ctest-pod-10014917] Cmd output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:55:36,746 - DEBUG - [Pod ctest-pod-10014917] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:55:36,746 - DEBUG - [Pod Pod ctest-pod-10014917] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:55:36,746 - DEBUG - [Pod Pod ctest-pod-10014917] Cmd output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:55:41,822 - DEBUG - [Pod ctest-pod-10014917] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:55:41,822 - DEBUG - [Pod Pod ctest-pod-10014917] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:55:41,822 - DEBUG - [Pod Pod ctest-pod-10014917] Cmd output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:55:46,885 - DEBUG - [Pod ctest-pod-10014917] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:55:46,885 - DEBUG - [Pod Pod ctest-pod-10014917] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:55:46,885 - DEBUG - [Pod Pod ctest-pod-10014917] Cmd output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:55:51,945 - DEBUG - [Pod ctest-pod-10014917] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:55:51,945 - DEBUG - [Pod Pod ctest-pod-10014917] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:55:51,945 - DEBUG - [Pod Pod ctest-pod-10014917] Cmd output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:55:57,005 - DEBUG - [Pod ctest-pod-10014917] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:55:57,006 - DEBUG - [Pod Pod ctest-pod-10014917] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:55:57,006 - DEBUG - [Pod Pod ctest-pod-10014917] Cmd output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:56:02,069 - DEBUG - [Pod ctest-pod-10014917] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:56:02,069 - DEBUG - [Pod Pod ctest-pod-10014917] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:56:02,069 - DEBUG - [Pod Pod ctest-pod-10014917] Cmd output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:56:07,142 - DEBUG - [Pod ctest-pod-10014917] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:56:07,142 - DEBUG - [Pod Pod ctest-pod-10014917] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:56:07,143 - DEBUG - [Pod Pod ctest-pod-10014917] Cmd output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:56:07,143 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-80977711': 0, 'ctest-pod-58637338': 0}
2025-03-29 14:56:09,216 - DEBUG - [Pod ctest-pod-00421583] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.327 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.078 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.094 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.078/0.499/1.327 ms
2025-03-29 14:56:09,216 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-00421583 with expectation True passed
2025-03-29 14:56:11,290 - DEBUG - [Pod ctest-pod-76226947] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.027 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.102 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.087 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.087/0.405/1.027 ms
2025-03-29 14:56:11,290 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-76226947 with expectation True passed
2025-03-29 14:56:13,362 - DEBUG - [Pod ctest-pod-10014917] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.455 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.094 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.085 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.085/0.211/0.455 ms
2025-03-29 14:56:13,362 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-10014917 with expectation True passed
2025-03-29 14:56:13,418 - DEBUG - [Pod ctest-pod-00421583] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-29 14:56:13,419 - DEBUG - [Pod Pod ctest-pod-00421583] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-03-29 14:56:13,419 - DEBUG - [Pod Pod ctest-pod-00421583] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-29 14:56:13,419 - INFO - wget check of of http://10.47.255.251 from ctest-pod-00421583 passed
2025-03-29 14:56:13,478 - DEBUG - [Pod ctest-pod-00421583] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-29 14:56:13,478 - DEBUG - [Pod Pod ctest-pod-00421583] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-03-29 14:56:13,479 - DEBUG - [Pod Pod ctest-pod-00421583] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-29 14:56:13,479 - INFO - wget check of of http://10.47.255.250 from ctest-pod-00421583 passed
2025-03-29 14:56:18,540 - DEBUG - [Pod ctest-pod-76226947] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-29 14:56:18,540 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-29 14:56:18,540 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-29 14:56:18,540 - INFO - wget check of of http://10.47.255.250 from ctest-pod-76226947 passed
2025-03-29 14:56:23,613 - DEBUG - [Pod ctest-pod-88912650] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-03-29 14:56:23,613 - DEBUG - [Pod Pod ctest-pod-88912650] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-03-29 14:56:23,613 - DEBUG - [Pod Pod ctest-pod-88912650] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-03-29 14:56:23,613 - INFO - wget check of of http://10.47.255.251 from ctest-pod-88912650 passed
2025-03-29 14:56:23,626 - INFO - Updating Network Policy ingress-on-service
2025-03-29 14:56:28,713 - DEBUG - [Pod ctest-pod-76226947] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:56:28,713 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:56:28,713 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:56:33,781 - DEBUG - [Pod ctest-pod-76226947] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:56:33,781 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:56:33,781 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:56:38,877 - DEBUG - [Pod ctest-pod-76226947] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:56:38,877 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:56:38,877 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:56:43,932 - DEBUG - [Pod ctest-pod-76226947] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:56:43,932 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:56:43,932 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:56:49,004 - DEBUG - [Pod ctest-pod-76226947] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:56:49,004 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:56:49,004 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:56:54,061 - DEBUG - [Pod ctest-pod-76226947] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:56:54,062 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:56:54,062 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:56:59,135 - DEBUG - [Pod ctest-pod-76226947] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:56:59,136 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:56:59,136 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:57:04,189 - DEBUG - [Pod ctest-pod-76226947] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:57:04,189 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:57:04,189 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:57:09,238 - DEBUG - [Pod ctest-pod-76226947] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:57:09,238 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:57:09,238 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:57:14,315 - DEBUG - [Pod ctest-pod-76226947] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:57:14,315 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:57:14,315 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
wget: download timed out
2025-03-29 14:57:14,315 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-80977711': 0, 'ctest-pod-58637338': 0}
2025-03-29 14:57:14,377 - DEBUG - [Pod ctest-pod-00421583] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
ctest-pod-58637338
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 14:57:14,377 - DEBUG - [Pod Pod ctest-pod-00421583] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 passed
2025-03-29 14:57:14,377 - DEBUG - [Pod Pod ctest-pod-00421583] Cmd output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
ctest-pod-58637338
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 14:57:14,437 - DEBUG - [Pod ctest-pod-00421583] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-80977711
2025-03-29 14:57:14,437 - DEBUG - [Pod Pod ctest-pod-00421583] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 passed
2025-03-29 14:57:14,437 - DEBUG - [Pod Pod ctest-pod-00421583] Cmd output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-80977711
2025-03-29 14:57:14,437 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-80977711': 1, 'ctest-pod-58637338': 1}
2025-03-29 14:57:14,506 - DEBUG - [Pod ctest-pod-10014917] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: ctest-pod-80977711
Connecting to 10.106.68.30:80 (10.106.68.30:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 14:57:14,506 - DEBUG - [Pod Pod ctest-pod-10014917] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 passed
2025-03-29 14:57:14,506 - DEBUG - [Pod Pod ctest-pod-10014917] Cmd output: ctest-pod-80977711
Connecting to 10.106.68.30:80 (10.106.68.30:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 14:57:14,567 - DEBUG - [Pod ctest-pod-10014917] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: ctest-pod-80977711
Connecting to 10.106.68.30:80 (10.106.68.30:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 14:57:14,567 - DEBUG - [Pod Pod ctest-pod-10014917] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 passed
2025-03-29 14:57:14,567 - DEBUG - [Pod Pod ctest-pod-10014917] Cmd output: ctest-pod-80977711
Connecting to 10.106.68.30:80 (10.106.68.30:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 14:57:14,619 - DEBUG - [Pod ctest-pod-10014917] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: ctest-pod-80977711
Connecting to 10.106.68.30:80 (10.106.68.30:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 14:57:14,619 - DEBUG - [Pod Pod ctest-pod-10014917] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 passed
2025-03-29 14:57:14,619 - DEBUG - [Pod Pod ctest-pod-10014917] Cmd output: ctest-pod-80977711
Connecting to 10.106.68.30:80 (10.106.68.30:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 14:57:14,679 - DEBUG - [Pod ctest-pod-10014917] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: ctest-pod-80977711
Connecting to 10.106.68.30:80 (10.106.68.30:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 14:57:14,679 - DEBUG - [Pod Pod ctest-pod-10014917] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 passed
2025-03-29 14:57:14,679 - DEBUG - [Pod Pod ctest-pod-10014917] Cmd output: ctest-pod-80977711
Connecting to 10.106.68.30:80 (10.106.68.30:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 14:57:14,744 - DEBUG - [Pod ctest-pod-10014917] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-80977711
2025-03-29 14:57:14,744 - DEBUG - [Pod Pod ctest-pod-10014917] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 passed
2025-03-29 14:57:14,744 - DEBUG - [Pod Pod ctest-pod-10014917] Cmd output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-80977711
2025-03-29 14:57:14,792 - DEBUG - [Pod ctest-pod-10014917] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: ctest-pod-80977711
Connecting to 10.106.68.30:80 (10.106.68.30:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 14:57:14,792 - DEBUG - [Pod Pod ctest-pod-10014917] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 passed
2025-03-29 14:57:14,792 - DEBUG - [Pod Pod ctest-pod-10014917] Cmd output: ctest-pod-80977711
Connecting to 10.106.68.30:80 (10.106.68.30:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 14:57:14,846 - DEBUG - [Pod ctest-pod-10014917] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-80977711
2025-03-29 14:57:14,847 - DEBUG - [Pod Pod ctest-pod-10014917] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 passed
2025-03-29 14:57:14,847 - DEBUG - [Pod Pod ctest-pod-10014917] Cmd output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-80977711
2025-03-29 14:57:14,901 - DEBUG - [Pod ctest-pod-10014917] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: ctest-pod-80977711
Connecting to 10.106.68.30:80 (10.106.68.30:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 14:57:14,901 - DEBUG - [Pod Pod ctest-pod-10014917] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 passed
2025-03-29 14:57:14,901 - DEBUG - [Pod Pod ctest-pod-10014917] Cmd output: ctest-pod-80977711
Connecting to 10.106.68.30:80 (10.106.68.30:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 14:57:14,958 - DEBUG - [Pod ctest-pod-10014917] Cmd: wget http://10.106.68.30:80/ -O - -T 5 -t 1 , Output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
ctest-pod-58637338
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 14:57:14,958 - DEBUG - [Pod Pod ctest-pod-10014917] Cmd wget http://10.106.68.30:80/ -O - -T 5 -t 1 passed
2025-03-29 14:57:14,958 - DEBUG - [Pod Pod ctest-pod-10014917] Cmd output: Connecting to 10.106.68.30:80 (10.106.68.30:80)
ctest-pod-58637338
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 14:57:14,958 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-80977711': 8, 'ctest-pod-58637338': 1}
2025-03-29 14:57:17,015 - DEBUG - [Pod ctest-pod-00421583] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.302 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.110 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.133 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.110/0.515/1.302 ms
2025-03-29 14:57:17,015 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-00421583 with expectation True passed
2025-03-29 14:57:19,079 - DEBUG - [Pod ctest-pod-76226947] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.324 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.083 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.094 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.083/0.500/1.324 ms
2025-03-29 14:57:19,079 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-76226947 with expectation True passed
2025-03-29 14:57:21,140 - DEBUG - [Pod ctest-pod-10014917] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.110 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.080 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.094 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.080/0.428/1.110 ms
2025-03-29 14:57:21,140 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-10014917 with expectation True passed
2025-03-29 14:57:21,195 - DEBUG - [Pod ctest-pod-00421583] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-29 14:57:21,196 - DEBUG - [Pod Pod ctest-pod-00421583] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-03-29 14:57:21,196 - DEBUG - [Pod Pod ctest-pod-00421583] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-29 14:57:21,196 - INFO - wget check of of http://10.47.255.251 from ctest-pod-00421583 passed
2025-03-29 14:57:21,244 - DEBUG - [Pod ctest-pod-00421583] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-29 14:57:21,245 - DEBUG - [Pod Pod ctest-pod-00421583] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-03-29 14:57:21,245 - DEBUG - [Pod Pod ctest-pod-00421583] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-29 14:57:21,245 - INFO - wget check of of http://10.47.255.250 from ctest-pod-00421583 passed
2025-03-29 14:57:26,297 - DEBUG - [Pod ctest-pod-76226947] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-29 14:57:26,298 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-29 14:57:26,298 - DEBUG - [Pod Pod ctest-pod-76226947] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-29 14:57:26,298 - INFO - wget check of of http://10.47.255.250 from ctest-pod-76226947 passed
2025-03-29 14:57:26,364 - DEBUG - [Pod ctest-pod-88912650] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-29 14:57:26,364 - DEBUG - [Pod Pod ctest-pod-88912650] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-03-29 14:57:26,364 - DEBUG - [Pod Pod ctest-pod-88912650] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-29 14:57:26,364 - INFO - wget check of of http://10.47.255.251 from ctest-pod-88912650 passed
2025-03-29 14:57:26,364 - INFO - Deleting Network Policy : ingress-on-service
2025-03-29 14:57:26,365 - INFO - Deleting service : ctest-nginx-svc-02166610
2025-03-29 14:57:26,602 - DEBUG - No XMPP flaps were noticed during the test
2025-03-29 14:57:26,602 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:06]
2025-03-29 14:57:26,602 - INFO - --------------------------------------------------------------------------------
2025-03-29 14:57:26,611 - INFO - Deleting pod ctest-new-default-36952500:ctest-pod-80977711
2025-03-29 14:57:26,612 - INFO - Deleting pod ctest-new-default-36952500:ctest-pod-58637338
2025-03-29 14:57:26,612 - INFO - Deleting pod ctest-non-default-82868352:ctest-pod-48779240
2025-03-29 14:57:26,613 - INFO - Deleting pod ctest-non-default-82868352:ctest-pod-23505358
2025-03-29 14:57:26,613 - INFO - Deleting pod ctest-new-default-36952500:ctest-pod-76226947
2025-03-29 14:57:26,613 - INFO - Deleting pod ctest-new-default-36952500:ctest-pod-00421583
2025-03-29 14:57:26,613 - INFO - Deleting pod ctest-non-default-82868352:ctest-pod-10014917
2025-03-29 14:57:26,614 - INFO - Deleting pod ctest-non-default-82868352:ctest-pod-88912650
2025-03-29 14:57:26,656 - WARNING - Pod uuid 56e7a1ed-8366-4372-8c30-c4e7bc382327 is still seen in agent 10.0.0.28 VM list
2025-03-29 14:57:26,730 - WARNING - Pod uuid f8d510be-8475-4fd0-9c8a-b65ef3ee293d is still seen in agent 10.0.0.28 VM list
2025-03-29 14:57:26,734 - WARNING - Pod uuid 76cc76e6-66ad-4ad0-9f68-56d52c5b9c74 is still seen in agent 10.0.0.28 VM list
2025-03-29 14:57:26,753 - WARNING - Pod uuid f91d75c3-150f-4280-a555-3b250357914a is still seen in agent 10.0.0.28 VM list
2025-03-29 14:57:26,754 - WARNING - Pod uuid 5d503a0a-8ea6-47a3-b9d4-75a2e2e3f7bc is still seen in agent 10.0.0.28 VM list
2025-03-29 14:57:26,756 - WARNING - Pod uuid 4474cda2-0ebf-4d19-8344-93095aec5a4e is still seen in agent 10.0.0.28 VM list
2025-03-29 14:57:26,757 - WARNING - Pod uuid 60ca2f82-4ba3-42ba-bb90-d66cc410aa17 is still seen in agent 10.0.0.28 VM list
2025-03-29 14:57:26,757 - WARNING - Pod uuid 3e1f9db0-91ef-424a-bd63-b30e09172f5c is still seen in agent 10.0.0.28 VM list
2025-03-29 14:57:31,665 - DEBUG - Pod 56e7a1ed-8366-4372-8c30-c4e7bc382327 is not in agent 10.0.0.28 VM list
2025-03-29 14:57:31,672 - DEBUG - VMI a65d7a30-0cad-11f0-87fb-fa163e6ee716 is removed from agent 10.0.0.28
2025-03-29 14:57:31,672 - INFO - Verified that pod ctest-pod-80977711 is removed in agent
2025-03-29 14:57:31,742 - WARNING - Pod uuid 76cc76e6-66ad-4ad0-9f68-56d52c5b9c74 is still seen in agent 10.0.0.28 VM list
2025-03-29 14:57:31,742 - WARNING - Pod uuid f8d510be-8475-4fd0-9c8a-b65ef3ee293d is still seen in agent 10.0.0.28 VM list
2025-03-29 14:57:31,784 - DEBUG - Pod 3e1f9db0-91ef-424a-bd63-b30e09172f5c is not in agent 10.0.0.28 VM list
2025-03-29 14:57:31,787 - DEBUG - Pod 4474cda2-0ebf-4d19-8344-93095aec5a4e is not in agent 10.0.0.28 VM list
2025-03-29 14:57:31,789 - DEBUG - Pod 60ca2f82-4ba3-42ba-bb90-d66cc410aa17 is not in agent 10.0.0.28 VM list
2025-03-29 14:57:31,790 - WARNING - Pod uuid 5d503a0a-8ea6-47a3-b9d4-75a2e2e3f7bc is still seen in agent 10.0.0.28 VM list
2025-03-29 14:57:31,790 - WARNING - Pod uuid f91d75c3-150f-4280-a555-3b250357914a is still seen in agent 10.0.0.28 VM list
2025-03-29 14:57:31,804 - DEBUG - VMI a6f60548-0cad-11f0-87fb-fa163e6ee716 is removed from agent 10.0.0.28
2025-03-29 14:57:31,804 - INFO - Verified that pod ctest-pod-58637338 is removed in agent
2025-03-29 14:57:31,805 - DEBUG - VMI a83dfc76-0cad-11f0-87fb-fa163e6ee716 is removed from agent 10.0.0.28
2025-03-29 14:57:31,805 - INFO - Verified that pod ctest-pod-23505358 is removed in agent
2025-03-29 14:57:31,806 - DEBUG - VMI a7b30eae-0cad-11f0-87fb-fa163e6ee716 is removed from agent 10.0.0.28
2025-03-29 14:57:31,806 - INFO - Verified that pod ctest-pod-48779240 is removed in agent
2025-03-29 14:57:36,756 - WARNING - Pod uuid 76cc76e6-66ad-4ad0-9f68-56d52c5b9c74 is still seen in agent 10.0.0.28 VM list
2025-03-29 14:57:36,759 - WARNING - Pod uuid f8d510be-8475-4fd0-9c8a-b65ef3ee293d is still seen in agent 10.0.0.28 VM list
2025-03-29 14:57:36,802 - WARNING - Pod uuid f91d75c3-150f-4280-a555-3b250357914a is still seen in agent 10.0.0.28 VM list
2025-03-29 14:57:36,804 - WARNING - Pod uuid 5d503a0a-8ea6-47a3-b9d4-75a2e2e3f7bc is still seen in agent 10.0.0.28 VM list
2025-03-29 14:57:41,772 - WARNING - Pod uuid 76cc76e6-66ad-4ad0-9f68-56d52c5b9c74 is still seen in agent 10.0.0.28 VM list
2025-03-29 14:57:41,773 - WARNING - Pod uuid f8d510be-8475-4fd0-9c8a-b65ef3ee293d is still seen in agent 10.0.0.28 VM list
2025-03-29 14:57:41,818 - WARNING - Pod uuid 5d503a0a-8ea6-47a3-b9d4-75a2e2e3f7bc is still seen in agent 10.0.0.28 VM list
2025-03-29 14:57:41,819 - WARNING - Pod uuid f91d75c3-150f-4280-a555-3b250357914a is still seen in agent 10.0.0.28 VM list
2025-03-29 14:57:46,785 - WARNING - Pod uuid f8d510be-8475-4fd0-9c8a-b65ef3ee293d is still seen in agent 10.0.0.28 VM list
2025-03-29 14:57:46,785 - WARNING - Pod uuid 76cc76e6-66ad-4ad0-9f68-56d52c5b9c74 is still seen in agent 10.0.0.28 VM list
2025-03-29 14:57:46,832 - WARNING - Pod uuid f91d75c3-150f-4280-a555-3b250357914a is still seen in agent 10.0.0.28 VM list
2025-03-29 14:57:46,833 - WARNING - Pod uuid 5d503a0a-8ea6-47a3-b9d4-75a2e2e3f7bc is still seen in agent 10.0.0.28 VM list
2025-03-29 14:57:51,799 - WARNING - Pod uuid 76cc76e6-66ad-4ad0-9f68-56d52c5b9c74 is still seen in agent 10.0.0.28 VM list
2025-03-29 14:57:51,800 - WARNING - Pod uuid f8d510be-8475-4fd0-9c8a-b65ef3ee293d is still seen in agent 10.0.0.28 VM list
2025-03-29 14:57:51,844 - WARNING - Pod uuid 5d503a0a-8ea6-47a3-b9d4-75a2e2e3f7bc is still seen in agent 10.0.0.28 VM list
2025-03-29 14:57:51,845 - WARNING - Pod uuid f91d75c3-150f-4280-a555-3b250357914a is still seen in agent 10.0.0.28 VM list
2025-03-29 14:57:56,813 - WARNING - Pod uuid 76cc76e6-66ad-4ad0-9f68-56d52c5b9c74 is still seen in agent 10.0.0.28 VM list
2025-03-29 14:57:56,814 - WARNING - Pod uuid f8d510be-8475-4fd0-9c8a-b65ef3ee293d is still seen in agent 10.0.0.28 VM list
2025-03-29 14:57:56,860 - WARNING - Pod uuid 5d503a0a-8ea6-47a3-b9d4-75a2e2e3f7bc is still seen in agent 10.0.0.28 VM list
2025-03-29 14:57:56,861 - WARNING - Pod uuid f91d75c3-150f-4280-a555-3b250357914a is still seen in agent 10.0.0.28 VM list
2025-03-29 14:58:01,831 - DEBUG - Pod f8d510be-8475-4fd0-9c8a-b65ef3ee293d is not in agent 10.0.0.28 VM list
2025-03-29 14:58:01,833 - DEBUG - Pod 76cc76e6-66ad-4ad0-9f68-56d52c5b9c74 is not in agent 10.0.0.28 VM list
2025-03-29 14:58:01,847 - DEBUG - VMI a8e3750c-0cad-11f0-87fb-fa163e6ee716 is removed from agent 10.0.0.28
2025-03-29 14:58:01,847 - INFO - Verified that pod ctest-pod-76226947 is removed in agent
2025-03-29 14:58:01,848 - DEBUG - VMI a96b2916-0cad-11f0-87fb-fa163e6ee716 is removed from agent 10.0.0.28
2025-03-29 14:58:01,848 - INFO - Verified that pod ctest-pod-00421583 is removed in agent
2025-03-29 14:58:01,874 - DEBUG - Pod f91d75c3-150f-4280-a555-3b250357914a is not in agent 10.0.0.28 VM list
2025-03-29 14:58:01,876 - DEBUG - Pod 5d503a0a-8ea6-47a3-b9d4-75a2e2e3f7bc is not in agent 10.0.0.28 VM list
2025-03-29 14:58:01,886 - DEBUG - VMI aa923776-0cad-11f0-87fb-fa163e6ee716 is removed from agent 10.0.0.28
2025-03-29 14:58:01,886 - INFO - Verified that pod ctest-pod-88912650 is removed in agent
2025-03-29 14:58:01,887 - DEBUG - VMI aa034f98-0cad-11f0-87fb-fa163e6ee716 is removed from agent 10.0.0.28
2025-03-29 14:58:01,887 - INFO - Verified that pod ctest-pod-10014917 is removed in agent
2025-03-29 14:58:01,887 - INFO - Deleting namespace ctest-non-default-82868352
2025-03-29 14:58:01,910 - DEBUG - Namespace ctest-non-default-82868352 still in k8s
2025-03-29 14:58:03,915 - DEBUG - Namespace ctest-non-default-82868352 still in k8s
2025-03-29 14:58:05,919 - DEBUG - Namespace ctest-non-default-82868352 still in k8s
2025-03-29 14:58:07,924 - DEBUG - Namespace ctest-non-default-82868352 is not in k8s
2025-03-29 14:58:07,924 - DEBUG - No need to check project deletion in contrail-api
2025-03-29 14:58:07,924 - INFO - Deleting namespace ctest-new-default-36952500
2025-03-29 14:58:07,942 - DEBUG - Namespace ctest-new-default-36952500 still in k8s
2025-03-29 14:58:09,949 - DEBUG - Namespace ctest-new-default-36952500 still in k8s
2025-03-29 14:58:11,954 - DEBUG - Namespace ctest-new-default-36952500 still in k8s
2025-03-29 14:58:13,958 - DEBUG - Namespace ctest-new-default-36952500 is not in k8s
2025-03-29 14:58:13,958 - DEBUG - No need to check project deletion in contrail-api