2025-03-22 09:09:02,827 - INFO - Using existing project ['default-domain', 'k8s-default'](6d22e8d4-74c8-4404-b041-3d49917b07c8) 2025-03-22 09:09:02,844 - DEBUG - Namespace ctest-new-default-61381501 not present 2025-03-22 09:09:02,852 - INFO - Created namespace ctest-new-default-61381501 2025-03-22 09:09:05,855 - DEBUG - Namespace ctest-non-default-70428481 not present 2025-03-22 09:09:05,863 - INFO - Created namespace ctest-non-default-70428481 2025-03-22 09:09:08,886 - DEBUG - Pod ctest-pod-23374019 not present 2025-03-22 09:09:08,887 - INFO - Creating Pod ctest-pod-23374019 2025-03-22 09:09:08,916 - DEBUG - Pod : ctest-pod-23374019 UUID is fd6b1be8-aa25-4672-9fef-b9f29a714672 2025-03-22 09:09:08,935 - DEBUG - Pod ctest-pod-70053039 not present 2025-03-22 09:09:08,936 - INFO - Creating Pod ctest-pod-70053039 2025-03-22 09:09:08,965 - DEBUG - Pod : ctest-pod-70053039 UUID is bf522a06-0c9e-4858-8734-873aa66221ba 2025-03-22 09:09:08,967 - DEBUG - Pod ctest-pod-98833543 not present 2025-03-22 09:09:08,968 - INFO - Creating Pod ctest-pod-98833543 2025-03-22 09:09:09,008 - DEBUG - Pod : ctest-pod-98833543 UUID is 989ad718-fa7a-4de2-8324-353d4cc4da5b 2025-03-22 09:09:09,010 - DEBUG - Pod ctest-pod-39686420 not present 2025-03-22 09:09:09,010 - INFO - Creating Pod ctest-pod-39686420 2025-03-22 09:09:09,034 - DEBUG - Pod : ctest-pod-39686420 UUID is 3cf2b18f-a9aa-464f-96a4-0e2f141abc37 2025-03-22 09:09:09,037 - DEBUG - Pod ctest-pod-50695065 not present 2025-03-22 09:09:09,037 - INFO - Creating Pod ctest-pod-50695065 2025-03-22 09:09:09,055 - DEBUG - Pod : ctest-pod-50695065 UUID is e908a6a9-49ca-4c77-ab46-5a357269d64a 2025-03-22 09:09:09,057 - DEBUG - Pod ctest-pod-81685636 not present 2025-03-22 09:09:09,057 - INFO - Creating Pod ctest-pod-81685636 2025-03-22 09:09:09,075 - DEBUG - Pod : ctest-pod-81685636 UUID is 86a888b4-4548-47a8-80a7-4edfa26fa30d 2025-03-22 09:09:09,077 - DEBUG - Pod ctest-pod-70794802 not present 2025-03-22 09:09:09,077 - INFO - Creating Pod ctest-pod-70794802 2025-03-22 09:09:09,100 - DEBUG - Pod : ctest-pod-70794802 UUID is 4ed92c90-f381-4868-96bb-b6e237948e97 2025-03-22 09:09:09,102 - DEBUG - Pod ctest-pod-25924788 not present 2025-03-22 09:09:09,102 - INFO - Creating Pod ctest-pod-25924788 2025-03-22 09:09:09,127 - DEBUG - Pod : ctest-pod-25924788 UUID is bf8f8746-a9ec-46c9-bea7-4649ce9fe9ec 2025-03-22 09:09:09,292 - INFO - Project default-domain:k8s-ctest-new-default-61381501 for Namespace ctest-new-default-61381501 is seen in contrail-api 2025-03-22 09:09:09,292 - DEBUG - Project uuid in Contrail is f1d35a78-bfcb-4fb5-ae29-4bf12d574b6a 2025-03-22 09:09:09,431 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_NamespaceDatabaseList?namespace_uuid=05d65b02-ff52-42b1-b954-b3eafae6f1d3 2025-03-22 09:09:09,463 - INFO - Namespace ctest-new-default-61381501 with uuid 05d65b02-ff52-42b1-b954-b3eafae6f1d3 found in kube manager 2025-03-22 09:09:09,463 - INFO - Namespace ctest-new-default-61381501 verification passed 2025-03-22 09:09:09,669 - INFO - Project default-domain:k8s-ctest-non-default-70428481 for Namespace ctest-non-default-70428481 is seen in contrail-api 2025-03-22 09:09:09,669 - DEBUG - Project uuid in Contrail is 03cf5e4e-10c9-4e19-93fa-a6e46cfc927a 2025-03-22 09:09:09,669 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_NamespaceDatabaseList?namespace_uuid=956259be-fc67-420e-af88-8890c1275424 2025-03-22 09:09:09,673 - INFO - Namespace ctest-non-default-70428481 with uuid 956259be-fc67-420e-af88-8890c1275424 found in kube manager 2025-03-22 09:09:09,673 - INFO - Namespace ctest-non-default-70428481 verification passed 2025-03-22 09:09:09,678 - DEBUG - Pod ctest-pod-23374019 not in running state.Currently in Pending 2025-03-22 09:09:14,684 - DEBUG - Pod ctest-pod-23374019 not in running state.Currently in Pending 2025-03-22 09:09:19,703 - INFO - Pod ctest-pod-23374019 is in running state.Got IP 10.47.255.251 2025-03-22 09:09:19,759 - DEBUG - Pod ctest-pod-23374019 has vmi 5134d04a-06fd-11f0-8355-fa163e3c553d 2025-03-22 09:09:19,759 - INFO - Verified pod ctest-pod-23374019 in contrail-api 2025-03-22 09:09:19,772 - DEBUG - VMI 5134d04a-06fd-11f0-8355-fa163e3c553d is active in agent 10.0.0.34 2025-03-22 09:09:19,772 - INFO - Verified Pod ctest-pod-23374019 in agent 10.0.0.34 2025-03-22 09:09:19,772 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_VirtualMachineDatabaseList?x=fd6b1be8-aa25-4672-9fef-b9f29a714672 2025-03-22 09:09:19,777 - INFO - Pod ctest-pod-23374019 with uuid fd6b1be8-aa25-4672-9fef-b9f29a714672 found in kube manager 2025-03-22 09:09:19,777 - INFO - Pod ctest-pod-23374019 verification passed 2025-03-22 09:09:19,782 - INFO - Pod ctest-pod-70053039 is in running state.Got IP 10.47.255.250 2025-03-22 09:09:19,809 - DEBUG - Pod ctest-pod-70053039 has vmi 51c1257c-06fd-11f0-8355-fa163e3c553d 2025-03-22 09:09:19,809 - INFO - Verified pod ctest-pod-70053039 in contrail-api 2025-03-22 09:09:19,827 - DEBUG - VMI 51c1257c-06fd-11f0-8355-fa163e3c553d is active in agent 10.0.0.34 2025-03-22 09:09:19,828 - INFO - Verified Pod ctest-pod-70053039 in agent 10.0.0.34 2025-03-22 09:09:19,828 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_VirtualMachineDatabaseList?x=bf522a06-0c9e-4858-8734-873aa66221ba 2025-03-22 09:09:19,834 - INFO - Pod ctest-pod-70053039 with uuid bf522a06-0c9e-4858-8734-873aa66221ba found in kube manager 2025-03-22 09:09:19,834 - INFO - Pod ctest-pod-70053039 verification passed 2025-03-22 09:09:19,843 - DEBUG - Pod ctest-pod-98833543 not in running state.Currently in Pending 2025-03-22 09:09:24,857 - INFO - Pod ctest-pod-98833543 is in running state.Got IP 10.47.255.249 2025-03-22 09:09:24,923 - DEBUG - Pod ctest-pod-98833543 has vmi 527a705e-06fd-11f0-8355-fa163e3c553d 2025-03-22 09:09:24,923 - INFO - Verified pod ctest-pod-98833543 in contrail-api 2025-03-22 09:09:24,938 - DEBUG - VMI 527a705e-06fd-11f0-8355-fa163e3c553d is active in agent 10.0.0.34 2025-03-22 09:09:24,938 - INFO - Verified Pod ctest-pod-98833543 in agent 10.0.0.34 2025-03-22 09:09:24,939 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_VirtualMachineDatabaseList?x=989ad718-fa7a-4de2-8324-353d4cc4da5b 2025-03-22 09:09:24,943 - INFO - Pod ctest-pod-98833543 with uuid 989ad718-fa7a-4de2-8324-353d4cc4da5b found in kube manager 2025-03-22 09:09:24,943 - INFO - Pod ctest-pod-98833543 verification passed 2025-03-22 09:09:24,948 - INFO - Pod ctest-pod-39686420 is in running state.Got IP 10.47.255.248 2025-03-22 09:09:24,961 - DEBUG - Pod ctest-pod-39686420 has vmi 5311265c-06fd-11f0-8355-fa163e3c553d 2025-03-22 09:09:24,961 - INFO - Verified pod ctest-pod-39686420 in contrail-api 2025-03-22 09:09:24,975 - DEBUG - VMI 5311265c-06fd-11f0-8355-fa163e3c553d is active in agent 10.0.0.34 2025-03-22 09:09:24,975 - INFO - Verified Pod ctest-pod-39686420 in agent 10.0.0.34 2025-03-22 09:09:24,975 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_VirtualMachineDatabaseList?x=3cf2b18f-a9aa-464f-96a4-0e2f141abc37 2025-03-22 09:09:24,979 - INFO - Pod ctest-pod-39686420 with uuid 3cf2b18f-a9aa-464f-96a4-0e2f141abc37 found in kube manager 2025-03-22 09:09:24,979 - INFO - Pod ctest-pod-39686420 verification passed 2025-03-22 09:09:24,984 - DEBUG - Pod ctest-pod-50695065 not in running state.Currently in Pending 2025-03-22 09:09:29,990 - INFO - Pod ctest-pod-50695065 is in running state.Got IP 10.47.255.247 2025-03-22 09:09:30,047 - DEBUG - Pod ctest-pod-50695065 has vmi 53a7f370-06fd-11f0-8355-fa163e3c553d 2025-03-22 09:09:30,047 - INFO - Verified pod ctest-pod-50695065 in contrail-api 2025-03-22 09:09:30,061 - DEBUG - VMI 53a7f370-06fd-11f0-8355-fa163e3c553d is active in agent 10.0.0.34 2025-03-22 09:09:30,061 - INFO - Verified Pod ctest-pod-50695065 in agent 10.0.0.34 2025-03-22 09:09:30,062 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_VirtualMachineDatabaseList?x=e908a6a9-49ca-4c77-ab46-5a357269d64a 2025-03-22 09:09:30,066 - INFO - Pod ctest-pod-50695065 with uuid e908a6a9-49ca-4c77-ab46-5a357269d64a found in kube manager 2025-03-22 09:09:30,066 - INFO - Pod ctest-pod-50695065 verification passed 2025-03-22 09:09:30,142 - INFO - Pod ctest-pod-70794802 is in running state.Got IP 10.47.255.245 2025-03-22 09:09:30,156 - DEBUG - Pod ctest-pod-70794802 has vmi 54abf640-06fd-11f0-8355-fa163e3c553d 2025-03-22 09:09:30,156 - INFO - Verified pod ctest-pod-70794802 in contrail-api 2025-03-22 09:09:30,174 - DEBUG - VMI 54abf640-06fd-11f0-8355-fa163e3c553d is active in agent 10.0.0.34 2025-03-22 09:09:30,174 - INFO - Verified Pod ctest-pod-70794802 in agent 10.0.0.34 2025-03-22 09:09:30,174 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_VirtualMachineDatabaseList?x=4ed92c90-f381-4868-96bb-b6e237948e97 2025-03-22 09:09:30,179 - INFO - Pod ctest-pod-70794802 with uuid 4ed92c90-f381-4868-96bb-b6e237948e97 found in kube manager 2025-03-22 09:09:30,179 - INFO - Pod ctest-pod-70794802 verification passed 2025-03-22 09:09:30,187 - INFO - Pod ctest-pod-81685636 is in running state.Got IP 10.47.255.246 2025-03-22 09:09:30,251 - DEBUG - Pod ctest-pod-81685636 has vmi 5429cc24-06fd-11f0-8355-fa163e3c553d 2025-03-22 09:09:30,251 - INFO - Verified pod ctest-pod-81685636 in contrail-api 2025-03-22 09:09:30,270 - DEBUG - VMI 5429cc24-06fd-11f0-8355-fa163e3c553d is active in agent 10.0.0.34 2025-03-22 09:09:30,270 - INFO - Verified Pod ctest-pod-81685636 in agent 10.0.0.34 2025-03-22 09:09:30,270 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_VirtualMachineDatabaseList?x=86a888b4-4548-47a8-80a7-4edfa26fa30d 2025-03-22 09:09:30,275 - INFO - Pod ctest-pod-81685636 with uuid 86a888b4-4548-47a8-80a7-4edfa26fa30d found in kube manager 2025-03-22 09:09:30,275 - INFO - Pod ctest-pod-81685636 verification passed 2025-03-22 09:09:30,280 - INFO - Pod ctest-pod-25924788 is in running state.Got IP 10.47.255.244 2025-03-22 09:09:30,296 - DEBUG - Pod ctest-pod-25924788 has vmi 552218a2-06fd-11f0-8355-fa163e3c553d 2025-03-22 09:09:30,296 - INFO - Verified pod ctest-pod-25924788 in contrail-api 2025-03-22 09:09:30,311 - DEBUG - VMI 552218a2-06fd-11f0-8355-fa163e3c553d is active in agent 10.0.0.34 2025-03-22 09:09:30,311 - INFO - Verified Pod ctest-pod-25924788 in agent 10.0.0.34 2025-03-22 09:09:30,311 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_VirtualMachineDatabaseList?x=bf8f8746-a9ec-46c9-bea7-4649ce9fe9ec 2025-03-22 09:09:30,317 - INFO - Pod ctest-pod-25924788 with uuid bf8f8746-a9ec-46c9-bea7-4649ce9fe9ec found in kube manager 2025-03-22 09:09:30,317 - INFO - Pod ctest-pod-25924788 verification passed 2025-03-22 09:09:30,317 - INFO - ================================================================================ 2025-03-22 09:09:30,317 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-03-22 09:09:30,317 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-03-22 09:09:30,586 - DEBUG - Nothing to compare xmpp stats {'10.0.0.34': {'10.0.0.31': '0'}} with 2025-03-22 09:09:30,586 - INFO - Initial checks done. Running the testcase now 2025-03-22 09:09:30,586 - INFO - 2025-03-22 09:09:30,643 - DEBUG - [Pod ctest-pod-23374019] Cmd: echo ctest-pod-23374019 > /usr/share/nginx/html/index.html, Output: 2025-03-22 09:09:30,695 - DEBUG - [Pod ctest-pod-70053039] Cmd: echo ctest-pod-70053039 > /usr/share/nginx/html/index.html, Output: 2025-03-22 09:09:30,765 - DEBUG - [Pod ctest-pod-98833543] Cmd: echo ctest-pod-98833543 > /usr/share/nginx/html/index.html, Output: 2025-03-22 09:09:30,817 - DEBUG - [Pod ctest-pod-39686420] Cmd: echo ctest-pod-39686420 > /usr/share/nginx/html/index.html, Output: 2025-03-22 09:09:30,820 - DEBUG - Service ctest-nginx-svc-80227854 not present 2025-03-22 09:09:30,820 - INFO - Creating service ctest-nginx-svc-80227854 2025-03-22 09:09:30,833 - INFO - Created Service ctest-nginx-svc-80227854 2025-03-22 09:09:30,847 - WARNING - Service UUID 8ad13412-abec-4045-91a1-423e8fe59ffb not yet found in contrail-api 2025-03-22 09:09:31,854 - INFO - Validated that Service ctest-nginx-svc-80227854 is seen in contrail-api 2025-03-22 09:09:31,854 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_LoadbalancerDatabaseList?x=8ad13412-abec-4045-91a1-423e8fe59ffb 2025-03-22 09:09:31,859 - INFO - Service ctest-nginx-svc-80227854 with uuid 8ad13412-abec-4045-91a1-423e8fe59ffb found in kube manager 2025-03-22 09:09:31,859 - INFO - Service ctest-nginx-svc-80227854 verification passed 2025-03-22 09:09:32,971 - DEBUG - [Pod ctest-pod-50695065] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.60.120:80 (10.97.60.120:80) ctest-pod-23374019 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-22 09:09:32,971 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 passed 2025-03-22 09:09:32,971 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd output: Connecting to 10.97.60.120:80 (10.97.60.120:80) ctest-pod-23374019 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-22 09:09:33,033 - DEBUG - [Pod ctest-pod-50695065] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: ctest-pod-23374019 Connecting to 10.97.60.120:80 (10.97.60.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-22 09:09:33,033 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 passed 2025-03-22 09:09:33,033 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd output: ctest-pod-23374019 Connecting to 10.97.60.120:80 (10.97.60.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-22 09:09:33,092 - DEBUG - [Pod ctest-pod-50695065] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.60.120:80 (10.97.60.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-70053039 2025-03-22 09:09:33,092 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 passed 2025-03-22 09:09:33,092 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd output: Connecting to 10.97.60.120:80 (10.97.60.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-70053039 2025-03-22 09:09:33,092 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-23374019': 2, 'ctest-pod-70053039': 1} 2025-03-22 09:09:33,150 - DEBUG - [Pod ctest-pod-70794802] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.60.120:80 (10.97.60.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-23374019 2025-03-22 09:09:33,150 - DEBUG - [Pod Pod ctest-pod-70794802] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 passed 2025-03-22 09:09:33,150 - DEBUG - [Pod Pod ctest-pod-70794802] Cmd output: Connecting to 10.97.60.120:80 (10.97.60.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-23374019 2025-03-22 09:09:33,198 - DEBUG - [Pod ctest-pod-70794802] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: ctest-pod-23374019 Connecting to 10.97.60.120:80 (10.97.60.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-22 09:09:33,198 - DEBUG - [Pod Pod ctest-pod-70794802] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 passed 2025-03-22 09:09:33,198 - DEBUG - [Pod Pod ctest-pod-70794802] Cmd output: ctest-pod-23374019 Connecting to 10.97.60.120:80 (10.97.60.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-22 09:09:33,239 - DEBUG - [Pod ctest-pod-70794802] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.60.120:80 (10.97.60.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-70053039 2025-03-22 09:09:33,240 - DEBUG - [Pod Pod ctest-pod-70794802] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 passed 2025-03-22 09:09:33,240 - DEBUG - [Pod Pod ctest-pod-70794802] Cmd output: Connecting to 10.97.60.120:80 (10.97.60.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-70053039 2025-03-22 09:09:33,240 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-23374019': 2, 'ctest-pod-70053039': 1} 2025-03-22 09:09:33,243 - DEBUG - Network policy ingress-on-service not present 2025-03-22 09:09:33,243 - INFO - Creating Network Policy ingress-on-service 2025-03-22 09:09:33,259 - INFO - Network policy found in k8s 2025-03-22 09:09:33,259 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=1d5ec748-e854-48bf-a80d-bb7d4312dec6 2025-03-22 09:09:33,266 - INFO - Network Policy ingress-on-service with uuid 1d5ec748-e854-48bf-a80d-bb7d4312dec6 found in kube manager 2025-03-22 09:09:33,298 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-03-22 09:09:33,298 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-03-22 09:09:33,298 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=1d5ec748-e854-48bf-a80d-bb7d4312dec6 2025-03-22 09:09:33,327 - WARNING - Network policy with name ingress-on-service not found in agent 2025-03-22 09:09:35,329 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=1d5ec748-e854-48bf-a80d-bb7d4312dec6 2025-03-22 09:09:35,359 - INFO - Network policy with name ingress-on-service found in agent 2025-03-22 09:09:35,359 - INFO - Network Policy ingress-on-service verification passed 2025-03-22 09:09:40,418 - DEBUG - [Pod ctest-pod-50695065] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:09:40,418 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:09:40,418 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:09:45,480 - DEBUG - [Pod ctest-pod-50695065] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:09:45,480 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:09:45,480 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:09:50,557 - DEBUG - [Pod ctest-pod-50695065] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:09:50,557 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:09:50,557 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:09:55,623 - DEBUG - [Pod ctest-pod-50695065] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:09:55,623 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:09:55,623 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:10:00,692 - DEBUG - [Pod ctest-pod-50695065] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:10:00,692 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:10:00,692 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:10:05,778 - DEBUG - [Pod ctest-pod-50695065] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:10:05,778 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:10:05,778 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:10:10,836 - DEBUG - [Pod ctest-pod-50695065] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:10:10,836 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:10:10,836 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:10:15,892 - DEBUG - [Pod ctest-pod-50695065] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:10:15,892 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:10:15,892 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:10:20,956 - DEBUG - [Pod ctest-pod-50695065] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:10:20,956 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:10:20,956 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:10:26,027 - DEBUG - [Pod ctest-pod-50695065] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:10:26,027 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:10:26,027 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:10:26,027 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-23374019': 0, 'ctest-pod-70053039': 0} 2025-03-22 09:10:26,103 - DEBUG - [Pod ctest-pod-81685636] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: ctest-pod-23374019 Connecting to 10.97.60.120:80 (10.97.60.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-22 09:10:26,103 - DEBUG - [Pod Pod ctest-pod-81685636] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 passed 2025-03-22 09:10:26,103 - DEBUG - [Pod Pod ctest-pod-81685636] Cmd output: ctest-pod-23374019 Connecting to 10.97.60.120:80 (10.97.60.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-22 09:10:26,163 - DEBUG - [Pod ctest-pod-81685636] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.60.120:80 (10.97.60.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-23374019 2025-03-22 09:10:26,163 - DEBUG - [Pod Pod ctest-pod-81685636] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 passed 2025-03-22 09:10:26,163 - DEBUG - [Pod Pod ctest-pod-81685636] Cmd output: Connecting to 10.97.60.120:80 (10.97.60.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-23374019 2025-03-22 09:10:26,229 - DEBUG - [Pod ctest-pod-81685636] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: ctest-pod-23374019 Connecting to 10.97.60.120:80 (10.97.60.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-22 09:10:26,229 - DEBUG - [Pod Pod ctest-pod-81685636] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 passed 2025-03-22 09:10:26,229 - DEBUG - [Pod Pod ctest-pod-81685636] Cmd output: ctest-pod-23374019 Connecting to 10.97.60.120:80 (10.97.60.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-22 09:10:26,291 - DEBUG - [Pod ctest-pod-81685636] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.60.120:80 (10.97.60.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-23374019 2025-03-22 09:10:26,291 - DEBUG - [Pod Pod ctest-pod-81685636] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 passed 2025-03-22 09:10:26,291 - DEBUG - [Pod Pod ctest-pod-81685636] Cmd output: Connecting to 10.97.60.120:80 (10.97.60.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-23374019 2025-03-22 09:10:26,350 - DEBUG - [Pod ctest-pod-81685636] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: ctest-pod-70053039 Connecting to 10.97.60.120:80 (10.97.60.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-22 09:10:26,350 - DEBUG - [Pod Pod ctest-pod-81685636] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 passed 2025-03-22 09:10:26,350 - DEBUG - [Pod Pod ctest-pod-81685636] Cmd output: ctest-pod-70053039 Connecting to 10.97.60.120:80 (10.97.60.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-22 09:10:26,351 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-23374019': 4, 'ctest-pod-70053039': 1} 2025-03-22 09:10:31,425 - DEBUG - [Pod ctest-pod-70794802] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:10:31,425 - DEBUG - [Pod Pod ctest-pod-70794802] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:10:31,425 - DEBUG - [Pod Pod ctest-pod-70794802] Cmd output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:10:36,492 - DEBUG - [Pod ctest-pod-70794802] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:10:36,492 - DEBUG - [Pod Pod ctest-pod-70794802] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:10:36,492 - DEBUG - [Pod Pod ctest-pod-70794802] Cmd output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:10:41,547 - DEBUG - [Pod ctest-pod-70794802] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:10:41,548 - DEBUG - [Pod Pod ctest-pod-70794802] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:10:41,548 - DEBUG - [Pod Pod ctest-pod-70794802] Cmd output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:10:46,612 - DEBUG - [Pod ctest-pod-70794802] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:10:46,612 - DEBUG - [Pod Pod ctest-pod-70794802] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:10:46,612 - DEBUG - [Pod Pod ctest-pod-70794802] Cmd output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:10:51,686 - DEBUG - [Pod ctest-pod-70794802] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:10:51,686 - DEBUG - [Pod Pod ctest-pod-70794802] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:10:51,686 - DEBUG - [Pod Pod ctest-pod-70794802] Cmd output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:10:56,745 - DEBUG - [Pod ctest-pod-70794802] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:10:56,745 - DEBUG - [Pod Pod ctest-pod-70794802] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:10:56,745 - DEBUG - [Pod Pod ctest-pod-70794802] Cmd output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:11:01,799 - DEBUG - [Pod ctest-pod-70794802] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:11:01,799 - DEBUG - [Pod Pod ctest-pod-70794802] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:11:01,799 - DEBUG - [Pod Pod ctest-pod-70794802] Cmd output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:11:06,874 - DEBUG - [Pod ctest-pod-70794802] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:11:06,874 - DEBUG - [Pod Pod ctest-pod-70794802] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:11:06,874 - DEBUG - [Pod Pod ctest-pod-70794802] Cmd output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:11:11,947 - DEBUG - [Pod ctest-pod-70794802] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:11:11,947 - DEBUG - [Pod Pod ctest-pod-70794802] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:11:11,947 - DEBUG - [Pod Pod ctest-pod-70794802] Cmd output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:11:17,015 - DEBUG - [Pod ctest-pod-70794802] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:11:17,016 - DEBUG - [Pod Pod ctest-pod-70794802] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:11:17,016 - DEBUG - [Pod Pod ctest-pod-70794802] Cmd output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:11:17,016 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-23374019': 0, 'ctest-pod-70053039': 0} 2025-03-22 09:11:19,076 - DEBUG - [Pod ctest-pod-81685636] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.147 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.095 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.090 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.090/0.444/1.147 ms 2025-03-22 09:11:19,076 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-81685636 with expectation True passed 2025-03-22 09:11:21,160 - DEBUG - [Pod ctest-pod-50695065] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.368 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.084 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.090 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.084/0.514/1.368 ms 2025-03-22 09:11:21,160 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-50695065 with expectation True passed 2025-03-22 09:11:23,243 - DEBUG - [Pod ctest-pod-70794802] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.549 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.097 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.089 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.089/0.578/1.549 ms 2025-03-22 09:11:23,243 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-70794802 with expectation True passed 2025-03-22 09:11:23,313 - DEBUG - [Pod ctest-pod-81685636] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-22 09:11:23,313 - DEBUG - [Pod Pod ctest-pod-81685636] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-03-22 09:11:23,313 - DEBUG - [Pod Pod ctest-pod-81685636] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-22 09:11:23,313 - INFO - wget check of of http://10.47.255.251 from ctest-pod-81685636 passed 2025-03-22 09:11:23,368 - DEBUG - [Pod ctest-pod-81685636] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-22 09:11:23,369 - DEBUG - [Pod Pod ctest-pod-81685636] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-03-22 09:11:23,369 - DEBUG - [Pod Pod ctest-pod-81685636] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-22 09:11:23,369 - INFO - wget check of of http://10.47.255.250 from ctest-pod-81685636 passed 2025-03-22 09:11:28,436 - DEBUG - [Pod ctest-pod-50695065] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-22 09:11:28,436 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-22 09:11:28,436 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-22 09:11:28,437 - INFO - wget check of of http://10.47.255.250 from ctest-pod-50695065 passed 2025-03-22 09:11:33,508 - DEBUG - [Pod ctest-pod-25924788] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-03-22 09:11:33,508 - DEBUG - [Pod Pod ctest-pod-25924788] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-03-22 09:11:33,508 - DEBUG - [Pod Pod ctest-pod-25924788] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-03-22 09:11:33,508 - INFO - wget check of of http://10.47.255.251 from ctest-pod-25924788 passed 2025-03-22 09:11:33,516 - INFO - Updating Network Policy ingress-on-service 2025-03-22 09:11:38,582 - DEBUG - [Pod ctest-pod-50695065] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:11:38,582 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:11:38,582 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:11:43,657 - DEBUG - [Pod ctest-pod-50695065] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:11:43,657 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:11:43,657 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:11:48,744 - DEBUG - [Pod ctest-pod-50695065] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:11:48,744 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:11:48,744 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:11:53,803 - DEBUG - [Pod ctest-pod-50695065] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:11:53,804 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:11:53,804 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:11:58,871 - DEBUG - [Pod ctest-pod-50695065] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:11:58,871 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:11:58,871 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:12:03,946 - DEBUG - [Pod ctest-pod-50695065] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:12:03,946 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:12:03,946 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:12:09,017 - DEBUG - [Pod ctest-pod-50695065] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:12:09,017 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:12:09,017 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:12:14,076 - DEBUG - [Pod ctest-pod-50695065] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:12:14,076 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:12:14,076 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:12:19,142 - DEBUG - [Pod ctest-pod-50695065] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:12:19,142 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:12:19,142 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:12:24,216 - DEBUG - [Pod ctest-pod-50695065] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:12:24,216 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:12:24,216 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd output: Connecting to 10.97.60.120:80 (10.97.60.120:80) wget: download timed out 2025-03-22 09:12:24,216 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-23374019': 0, 'ctest-pod-70053039': 0} 2025-03-22 09:12:24,277 - DEBUG - [Pod ctest-pod-81685636] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: ctest-pod-23374019 Connecting to 10.97.60.120:80 (10.97.60.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-22 09:12:24,278 - DEBUG - [Pod Pod ctest-pod-81685636] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 passed 2025-03-22 09:12:24,278 - DEBUG - [Pod Pod ctest-pod-81685636] Cmd output: ctest-pod-23374019 Connecting to 10.97.60.120:80 (10.97.60.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-22 09:12:24,350 - DEBUG - [Pod ctest-pod-81685636] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.60.120:80 (10.97.60.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-23374019 2025-03-22 09:12:24,350 - DEBUG - [Pod Pod ctest-pod-81685636] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 passed 2025-03-22 09:12:24,350 - DEBUG - [Pod Pod ctest-pod-81685636] Cmd output: Connecting to 10.97.60.120:80 (10.97.60.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-23374019 2025-03-22 09:12:24,418 - DEBUG - [Pod ctest-pod-81685636] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: ctest-pod-23374019 Connecting to 10.97.60.120:80 (10.97.60.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-22 09:12:24,419 - DEBUG - [Pod Pod ctest-pod-81685636] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 passed 2025-03-22 09:12:24,419 - DEBUG - [Pod Pod ctest-pod-81685636] Cmd output: ctest-pod-23374019 Connecting to 10.97.60.120:80 (10.97.60.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-22 09:12:24,482 - DEBUG - [Pod ctest-pod-81685636] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.60.120:80 (10.97.60.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-23374019 2025-03-22 09:12:24,482 - DEBUG - [Pod Pod ctest-pod-81685636] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 passed 2025-03-22 09:12:24,482 - DEBUG - [Pod Pod ctest-pod-81685636] Cmd output: Connecting to 10.97.60.120:80 (10.97.60.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-23374019 2025-03-22 09:12:24,555 - DEBUG - [Pod ctest-pod-81685636] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: ctest-pod-70053039 Connecting to 10.97.60.120:80 (10.97.60.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-22 09:12:24,555 - DEBUG - [Pod Pod ctest-pod-81685636] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 passed 2025-03-22 09:12:24,555 - DEBUG - [Pod Pod ctest-pod-81685636] Cmd output: ctest-pod-70053039 Connecting to 10.97.60.120:80 (10.97.60.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-22 09:12:24,555 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-23374019': 4, 'ctest-pod-70053039': 1} 2025-03-22 09:12:24,609 - DEBUG - [Pod ctest-pod-70794802] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.60.120:80 (10.97.60.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-70053039 2025-03-22 09:12:24,609 - DEBUG - [Pod Pod ctest-pod-70794802] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 passed 2025-03-22 09:12:24,609 - DEBUG - [Pod Pod ctest-pod-70794802] Cmd output: Connecting to 10.97.60.120:80 (10.97.60.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-70053039 2025-03-22 09:12:24,682 - DEBUG - [Pod ctest-pod-70794802] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: ctest-pod-70053039 Connecting to 10.97.60.120:80 (10.97.60.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-22 09:12:24,682 - DEBUG - [Pod Pod ctest-pod-70794802] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 passed 2025-03-22 09:12:24,682 - DEBUG - [Pod Pod ctest-pod-70794802] Cmd output: ctest-pod-70053039 Connecting to 10.97.60.120:80 (10.97.60.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-22 09:12:24,753 - DEBUG - [Pod ctest-pod-70794802] Cmd: wget http://10.97.60.120:80/ -O - -T 5 -t 1 , Output: ctest-pod-23374019 Connecting to 10.97.60.120:80 (10.97.60.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-22 09:12:24,753 - DEBUG - [Pod Pod ctest-pod-70794802] Cmd wget http://10.97.60.120:80/ -O - -T 5 -t 1 passed 2025-03-22 09:12:24,753 - DEBUG - [Pod Pod ctest-pod-70794802] Cmd output: ctest-pod-23374019 Connecting to 10.97.60.120:80 (10.97.60.120:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-03-22 09:12:24,753 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-23374019': 1, 'ctest-pod-70053039': 2} 2025-03-22 09:12:26,804 - DEBUG - [Pod ctest-pod-81685636] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.990 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.103 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.084 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.084/0.392/0.990 ms 2025-03-22 09:12:26,804 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-81685636 with expectation True passed 2025-03-22 09:12:28,860 - DEBUG - [Pod ctest-pod-50695065] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.514 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.079 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.100 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.079/0.231/0.514 ms 2025-03-22 09:12:28,860 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-50695065 with expectation True passed 2025-03-22 09:12:30,923 - DEBUG - [Pod ctest-pod-70794802] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.935 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.093 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.114 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.093/0.380/0.935 ms 2025-03-22 09:12:30,923 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-70794802 with expectation True passed 2025-03-22 09:12:31,001 - DEBUG - [Pod ctest-pod-81685636] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-22 09:12:31,001 - DEBUG - [Pod Pod ctest-pod-81685636] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-03-22 09:12:31,001 - DEBUG - [Pod Pod ctest-pod-81685636] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-22 09:12:31,001 - INFO - wget check of of http://10.47.255.251 from ctest-pod-81685636 passed 2025-03-22 09:12:31,077 - DEBUG - [Pod ctest-pod-81685636] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-22 09:12:31,077 - DEBUG - [Pod Pod ctest-pod-81685636] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-03-22 09:12:31,077 - DEBUG - [Pod Pod ctest-pod-81685636] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-22 09:12:31,077 - INFO - wget check of of http://10.47.255.250 from ctest-pod-81685636 passed 2025-03-22 09:12:36,136 - DEBUG - [Pod ctest-pod-50695065] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-22 09:12:36,136 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-22 09:12:36,136 - DEBUG - [Pod Pod ctest-pod-50695065] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-03-22 09:12:36,136 - INFO - wget check of of http://10.47.255.250 from ctest-pod-50695065 passed 2025-03-22 09:12:36,210 - DEBUG - [Pod ctest-pod-25924788] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-22 09:12:36,210 - DEBUG - [Pod Pod ctest-pod-25924788] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-03-22 09:12:36,210 - DEBUG - [Pod Pod ctest-pod-25924788] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-03-22 09:12:36,210 - INFO - wget check of of http://10.47.255.251 from ctest-pod-25924788 passed 2025-03-22 09:12:36,210 - INFO - Deleting Network Policy : ingress-on-service 2025-03-22 09:12:36,210 - INFO - Deleting service : ctest-nginx-svc-80227854 2025-03-22 09:12:36,440 - DEBUG - No XMPP flaps were noticed during the test 2025-03-22 09:12:36,440 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:06] 2025-03-22 09:12:36,440 - INFO - -------------------------------------------------------------------------------- 2025-03-22 09:12:36,445 - INFO - Deleting pod ctest-new-default-61381501:ctest-pod-23374019 2025-03-22 09:12:36,446 - INFO - Deleting pod ctest-new-default-61381501:ctest-pod-70053039 2025-03-22 09:12:36,446 - INFO - Deleting pod ctest-non-default-70428481:ctest-pod-98833543 2025-03-22 09:12:36,447 - INFO - Deleting pod ctest-non-default-70428481:ctest-pod-39686420 2025-03-22 09:12:36,447 - INFO - Deleting pod ctest-new-default-61381501:ctest-pod-50695065 2025-03-22 09:12:36,447 - INFO - Deleting pod ctest-new-default-61381501:ctest-pod-81685636 2025-03-22 09:12:36,448 - INFO - Deleting pod ctest-non-default-70428481:ctest-pod-70794802 2025-03-22 09:12:36,448 - INFO - Deleting pod ctest-non-default-70428481:ctest-pod-25924788 2025-03-22 09:12:36,528 - WARNING - Pod uuid fd6b1be8-aa25-4672-9fef-b9f29a714672 is still seen in agent 10.0.0.34 VM list 2025-03-22 09:12:36,531 - WARNING - Pod uuid 86a888b4-4548-47a8-80a7-4edfa26fa30d is still seen in agent 10.0.0.34 VM list 2025-03-22 09:12:36,533 - WARNING - Pod uuid 989ad718-fa7a-4de2-8324-353d4cc4da5b is still seen in agent 10.0.0.34 VM list 2025-03-22 09:12:36,581 - WARNING - Pod uuid bf522a06-0c9e-4858-8734-873aa66221ba is still seen in agent 10.0.0.34 VM list 2025-03-22 09:12:36,581 - WARNING - Pod uuid 3cf2b18f-a9aa-464f-96a4-0e2f141abc37 is still seen in agent 10.0.0.34 VM list 2025-03-22 09:12:36,581 - WARNING - Pod uuid 4ed92c90-f381-4868-96bb-b6e237948e97 is still seen in agent 10.0.0.34 VM list 2025-03-22 09:12:36,582 - WARNING - Pod uuid bf8f8746-a9ec-46c9-bea7-4649ce9fe9ec is still seen in agent 10.0.0.34 VM list 2025-03-22 09:12:36,582 - WARNING - Pod uuid e908a6a9-49ca-4c77-ab46-5a357269d64a is still seen in agent 10.0.0.34 VM list 2025-03-22 09:12:41,566 - DEBUG - Pod fd6b1be8-aa25-4672-9fef-b9f29a714672 is not in agent 10.0.0.34 VM list 2025-03-22 09:12:41,569 - DEBUG - Pod 989ad718-fa7a-4de2-8324-353d4cc4da5b is not in agent 10.0.0.34 VM list 2025-03-22 09:12:41,571 - WARNING - Pod uuid 86a888b4-4548-47a8-80a7-4edfa26fa30d is still seen in agent 10.0.0.34 VM list 2025-03-22 09:12:41,657 - DEBUG - VMI 5134d04a-06fd-11f0-8355-fa163e3c553d is removed from agent 10.0.0.34 2025-03-22 09:12:41,657 - INFO - Verified that pod ctest-pod-23374019 is removed in agent 2025-03-22 09:12:41,659 - WARNING - Pod uuid e908a6a9-49ca-4c77-ab46-5a357269d64a is still seen in agent 10.0.0.34 VM list 2025-03-22 09:12:41,659 - DEBUG - Pod 3cf2b18f-a9aa-464f-96a4-0e2f141abc37 is not in agent 10.0.0.34 VM list 2025-03-22 09:12:41,661 - WARNING - Pod uuid bf8f8746-a9ec-46c9-bea7-4649ce9fe9ec is still seen in agent 10.0.0.34 VM list 2025-03-22 09:12:41,661 - WARNING - Pod uuid 4ed92c90-f381-4868-96bb-b6e237948e97 is still seen in agent 10.0.0.34 VM list 2025-03-22 09:12:41,662 - WARNING - Pod uuid bf522a06-0c9e-4858-8734-873aa66221ba is still seen in agent 10.0.0.34 VM list 2025-03-22 09:12:41,662 - DEBUG - VMI 527a705e-06fd-11f0-8355-fa163e3c553d is removed from agent 10.0.0.34 2025-03-22 09:12:41,662 - INFO - Verified that pod ctest-pod-98833543 is removed in agent 2025-03-22 09:12:41,685 - DEBUG - VMI 5311265c-06fd-11f0-8355-fa163e3c553d is removed from agent 10.0.0.34 2025-03-22 09:12:41,685 - INFO - Verified that pod ctest-pod-39686420 is removed in agent 2025-03-22 09:12:46,580 - WARNING - Pod uuid 86a888b4-4548-47a8-80a7-4edfa26fa30d is still seen in agent 10.0.0.34 VM list 2025-03-22 09:12:46,679 - WARNING - Pod uuid e908a6a9-49ca-4c77-ab46-5a357269d64a is still seen in agent 10.0.0.34 VM list 2025-03-22 09:12:46,680 - WARNING - Pod uuid bf8f8746-a9ec-46c9-bea7-4649ce9fe9ec is still seen in agent 10.0.0.34 VM list 2025-03-22 09:12:46,681 - WARNING - Pod uuid 4ed92c90-f381-4868-96bb-b6e237948e97 is still seen in agent 10.0.0.34 VM list 2025-03-22 09:12:46,682 - WARNING - Pod uuid bf522a06-0c9e-4858-8734-873aa66221ba is still seen in agent 10.0.0.34 VM list 2025-03-22 09:12:51,589 - WARNING - Pod uuid 86a888b4-4548-47a8-80a7-4edfa26fa30d is still seen in agent 10.0.0.34 VM list 2025-03-22 09:12:51,699 - WARNING - Pod uuid bf8f8746-a9ec-46c9-bea7-4649ce9fe9ec is still seen in agent 10.0.0.34 VM list 2025-03-22 09:12:51,701 - WARNING - Pod uuid bf522a06-0c9e-4858-8734-873aa66221ba is still seen in agent 10.0.0.34 VM list 2025-03-22 09:12:51,702 - WARNING - Pod uuid 4ed92c90-f381-4868-96bb-b6e237948e97 is still seen in agent 10.0.0.34 VM list 2025-03-22 09:12:51,702 - WARNING - Pod uuid e908a6a9-49ca-4c77-ab46-5a357269d64a is still seen in agent 10.0.0.34 VM list 2025-03-22 09:12:56,598 - WARNING - Pod uuid 86a888b4-4548-47a8-80a7-4edfa26fa30d is still seen in agent 10.0.0.34 VM list 2025-03-22 09:12:56,719 - WARNING - Pod uuid 4ed92c90-f381-4868-96bb-b6e237948e97 is still seen in agent 10.0.0.34 VM list 2025-03-22 09:12:56,719 - WARNING - Pod uuid bf8f8746-a9ec-46c9-bea7-4649ce9fe9ec is still seen in agent 10.0.0.34 VM list 2025-03-22 09:12:56,721 - WARNING - Pod uuid e908a6a9-49ca-4c77-ab46-5a357269d64a is still seen in agent 10.0.0.34 VM list 2025-03-22 09:12:56,721 - WARNING - Pod uuid bf522a06-0c9e-4858-8734-873aa66221ba is still seen in agent 10.0.0.34 VM list 2025-03-22 09:13:01,613 - WARNING - Pod uuid 86a888b4-4548-47a8-80a7-4edfa26fa30d is still seen in agent 10.0.0.34 VM list 2025-03-22 09:13:01,740 - WARNING - Pod uuid bf522a06-0c9e-4858-8734-873aa66221ba is still seen in agent 10.0.0.34 VM list 2025-03-22 09:13:01,740 - WARNING - Pod uuid bf8f8746-a9ec-46c9-bea7-4649ce9fe9ec is still seen in agent 10.0.0.34 VM list 2025-03-22 09:13:01,741 - WARNING - Pod uuid 4ed92c90-f381-4868-96bb-b6e237948e97 is still seen in agent 10.0.0.34 VM list 2025-03-22 09:13:01,742 - WARNING - Pod uuid e908a6a9-49ca-4c77-ab46-5a357269d64a is still seen in agent 10.0.0.34 VM list 2025-03-22 09:13:06,621 - WARNING - Pod uuid 86a888b4-4548-47a8-80a7-4edfa26fa30d is still seen in agent 10.0.0.34 VM list 2025-03-22 09:13:06,790 - WARNING - Pod uuid bf8f8746-a9ec-46c9-bea7-4649ce9fe9ec is still seen in agent 10.0.0.34 VM list 2025-03-22 09:13:06,791 - WARNING - Pod uuid e908a6a9-49ca-4c77-ab46-5a357269d64a is still seen in agent 10.0.0.34 VM list 2025-03-22 09:13:06,792 - WARNING - Pod uuid 4ed92c90-f381-4868-96bb-b6e237948e97 is still seen in agent 10.0.0.34 VM list 2025-03-22 09:13:06,792 - WARNING - Pod uuid bf522a06-0c9e-4858-8734-873aa66221ba is still seen in agent 10.0.0.34 VM list 2025-03-22 09:13:11,630 - DEBUG - Pod 86a888b4-4548-47a8-80a7-4edfa26fa30d is not in agent 10.0.0.34 VM list 2025-03-22 09:13:11,637 - DEBUG - VMI 5429cc24-06fd-11f0-8355-fa163e3c553d is removed from agent 10.0.0.34 2025-03-22 09:13:11,637 - INFO - Verified that pod ctest-pod-81685636 is removed in agent 2025-03-22 09:13:11,809 - DEBUG - Pod bf8f8746-a9ec-46c9-bea7-4649ce9fe9ec is not in agent 10.0.0.34 VM list 2025-03-22 09:13:11,812 - DEBUG - Pod bf522a06-0c9e-4858-8734-873aa66221ba is not in agent 10.0.0.34 VM list 2025-03-22 09:13:11,813 - DEBUG - Pod 4ed92c90-f381-4868-96bb-b6e237948e97 is not in agent 10.0.0.34 VM list 2025-03-22 09:13:11,815 - DEBUG - Pod e908a6a9-49ca-4c77-ab46-5a357269d64a is not in agent 10.0.0.34 VM list 2025-03-22 09:13:11,839 - DEBUG - VMI 51c1257c-06fd-11f0-8355-fa163e3c553d is removed from agent 10.0.0.34 2025-03-22 09:13:11,839 - INFO - Verified that pod ctest-pod-70053039 is removed in agent 2025-03-22 09:13:11,839 - DEBUG - VMI 53a7f370-06fd-11f0-8355-fa163e3c553d is removed from agent 10.0.0.34 2025-03-22 09:13:11,839 - INFO - Verified that pod ctest-pod-50695065 is removed in agent 2025-03-22 09:13:11,840 - DEBUG - VMI 552218a2-06fd-11f0-8355-fa163e3c553d is removed from agent 10.0.0.34 2025-03-22 09:13:11,840 - INFO - Verified that pod ctest-pod-25924788 is removed in agent 2025-03-22 09:13:11,840 - DEBUG - VMI 54abf640-06fd-11f0-8355-fa163e3c553d is removed from agent 10.0.0.34 2025-03-22 09:13:11,840 - INFO - Verified that pod ctest-pod-70794802 is removed in agent 2025-03-22 09:13:11,840 - INFO - Deleting namespace ctest-non-default-70428481 2025-03-22 09:13:11,854 - DEBUG - Namespace ctest-non-default-70428481 still in k8s 2025-03-22 09:13:13,858 - DEBUG - Namespace ctest-non-default-70428481 still in k8s 2025-03-22 09:13:15,862 - DEBUG - Namespace ctest-non-default-70428481 still in k8s 2025-03-22 09:13:17,874 - DEBUG - Namespace ctest-non-default-70428481 is not in k8s 2025-03-22 09:13:17,874 - DEBUG - No need to check project deletion in contrail-api 2025-03-22 09:13:17,874 - INFO - Deleting namespace ctest-new-default-61381501 2025-03-22 09:13:17,881 - DEBUG - Namespace ctest-new-default-61381501 still in k8s 2025-03-22 09:13:19,887 - DEBUG - Namespace ctest-new-default-61381501 still in k8s 2025-03-22 09:13:21,892 - DEBUG - Namespace ctest-new-default-61381501 still in k8s 2025-03-22 09:13:23,894 - DEBUG - Namespace ctest-new-default-61381501 is not in k8s 2025-03-22 09:13:23,895 - DEBUG - No need to check project deletion in contrail-api