2025-01-02 23:25:50,038 - INFO - Using existing project ['default-domain', 'k8s-default'](c4efa33e-3e8b-4021-8f18-7d45e83cd7d5) 2025-01-02 23:25:50,064 - DEBUG - Namespace ctest-new-default-37180827 not present 2025-01-02 23:25:50,072 - INFO - Created namespace ctest-new-default-37180827 2025-01-02 23:25:53,076 - DEBUG - Namespace ctest-non-default-05632403 not present 2025-01-02 23:25:53,085 - INFO - Created namespace ctest-non-default-05632403 2025-01-02 23:25:56,112 - DEBUG - Pod ctest-pod-80243175 not present 2025-01-02 23:25:56,112 - INFO - Creating Pod ctest-pod-80243175 2025-01-02 23:25:56,151 - DEBUG - Pod : ctest-pod-80243175 UUID is 5c9cf711-cfd7-4f64-8f6b-22c6852a0acf 2025-01-02 23:25:56,168 - DEBUG - Pod ctest-pod-00858094 not present 2025-01-02 23:25:56,168 - INFO - Creating Pod ctest-pod-00858094 2025-01-02 23:25:56,194 - DEBUG - Pod : ctest-pod-00858094 UUID is f1c67d3a-39ee-4387-a251-cc210c2a0cdf 2025-01-02 23:25:56,196 - DEBUG - Pod ctest-pod-45833422 not present 2025-01-02 23:25:56,196 - INFO - Creating Pod ctest-pod-45833422 2025-01-02 23:25:56,230 - DEBUG - Pod : ctest-pod-45833422 UUID is bc101254-4305-4c59-bac5-460d468e5c21 2025-01-02 23:25:56,232 - DEBUG - Pod ctest-pod-46835009 not present 2025-01-02 23:25:56,232 - INFO - Creating Pod ctest-pod-46835009 2025-01-02 23:25:56,260 - DEBUG - Pod : ctest-pod-46835009 UUID is ae439d58-91e0-43e4-ac58-23a4952a76a0 2025-01-02 23:25:56,262 - DEBUG - Pod ctest-pod-52245407 not present 2025-01-02 23:25:56,262 - INFO - Creating Pod ctest-pod-52245407 2025-01-02 23:25:56,284 - DEBUG - Pod : ctest-pod-52245407 UUID is 0fc36460-22b1-4ea1-a971-e15bffd8d896 2025-01-02 23:25:56,287 - DEBUG - Pod ctest-pod-20395723 not present 2025-01-02 23:25:56,287 - INFO - Creating Pod ctest-pod-20395723 2025-01-02 23:25:56,305 - DEBUG - Pod : ctest-pod-20395723 UUID is c0c36259-9138-4c5b-bb68-5034620b4f95 2025-01-02 23:25:56,307 - DEBUG - Pod ctest-pod-29837186 not present 2025-01-02 23:25:56,308 - INFO - Creating Pod ctest-pod-29837186 2025-01-02 23:25:56,325 - DEBUG - Pod : ctest-pod-29837186 UUID is 96f47a1e-6fb3-4890-9d8e-93abb32d3177 2025-01-02 23:25:56,327 - DEBUG - Pod ctest-pod-24928913 not present 2025-01-02 23:25:56,327 - INFO - Creating Pod ctest-pod-24928913 2025-01-02 23:25:56,358 - DEBUG - Pod : ctest-pod-24928913 UUID is 6f65b98d-9dae-4aa4-8eeb-0059f73fab0e 2025-01-02 23:25:56,564 - INFO - Project default-domain:k8s-ctest-new-default-37180827 for Namespace ctest-new-default-37180827 is seen in contrail-api 2025-01-02 23:25:56,564 - DEBUG - Project uuid in Contrail is 7fbc29ee-ed86-4e93-8dd0-a689bf8b5e52 2025-01-02 23:25:56,783 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_NamespaceDatabaseList?namespace_uuid=bb32e0a6-e245-4c03-8b2c-08201120933d 2025-01-02 23:25:56,797 - INFO - Namespace ctest-new-default-37180827 with uuid bb32e0a6-e245-4c03-8b2c-08201120933d found in kube manager 2025-01-02 23:25:56,797 - INFO - Namespace ctest-new-default-37180827 verification passed 2025-01-02 23:25:57,019 - INFO - Project default-domain:k8s-ctest-non-default-05632403 for Namespace ctest-non-default-05632403 is seen in contrail-api 2025-01-02 23:25:57,019 - DEBUG - Project uuid in Contrail is d5ff5f08-2051-4d56-8346-45a80a0dce63 2025-01-02 23:25:57,019 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_NamespaceDatabaseList?namespace_uuid=a4407363-5ffb-4dc6-80ba-ed9a0cef2b02 2025-01-02 23:25:57,024 - INFO - Namespace ctest-non-default-05632403 with uuid a4407363-5ffb-4dc6-80ba-ed9a0cef2b02 found in kube manager 2025-01-02 23:25:57,024 - INFO - Namespace ctest-non-default-05632403 verification passed 2025-01-02 23:25:57,029 - DEBUG - Pod ctest-pod-80243175 not in running state.Currently in Pending 2025-01-02 23:26:02,044 - DEBUG - Pod ctest-pod-80243175 not in running state.Currently in Pending 2025-01-02 23:26:07,051 - DEBUG - Pod ctest-pod-80243175 not in running state.Currently in Pending 2025-01-02 23:26:12,059 - INFO - Pod ctest-pod-80243175 is in running state.Got IP 10.47.255.251 2025-01-02 23:26:12,076 - DEBUG - Pod ctest-pod-80243175 has vmi ebafdd84-c960-11ef-aca6-fa163ec365c1 2025-01-02 23:26:12,076 - INFO - Verified pod ctest-pod-80243175 in contrail-api 2025-01-02 23:26:12,091 - DEBUG - VMI ebafdd84-c960-11ef-aca6-fa163ec365c1 is active in agent 10.0.0.27 2025-01-02 23:26:12,091 - INFO - Verified Pod ctest-pod-80243175 in agent 10.0.0.27 2025-01-02 23:26:12,091 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=5c9cf711-cfd7-4f64-8f6b-22c6852a0acf 2025-01-02 23:26:12,100 - INFO - Pod ctest-pod-80243175 with uuid 5c9cf711-cfd7-4f64-8f6b-22c6852a0acf found in kube manager 2025-01-02 23:26:12,100 - INFO - Pod ctest-pod-80243175 verification passed 2025-01-02 23:26:12,106 - INFO - Pod ctest-pod-00858094 is in running state.Got IP 10.47.255.250 2025-01-02 23:26:12,163 - DEBUG - Pod ctest-pod-00858094 has vmi ec3640cc-c960-11ef-aca6-fa163ec365c1 2025-01-02 23:26:12,163 - INFO - Verified pod ctest-pod-00858094 in contrail-api 2025-01-02 23:26:12,179 - DEBUG - VMI ec3640cc-c960-11ef-aca6-fa163ec365c1 is active in agent 10.0.0.27 2025-01-02 23:26:12,179 - INFO - Verified Pod ctest-pod-00858094 in agent 10.0.0.27 2025-01-02 23:26:12,179 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=f1c67d3a-39ee-4387-a251-cc210c2a0cdf 2025-01-02 23:26:12,185 - INFO - Pod ctest-pod-00858094 with uuid f1c67d3a-39ee-4387-a251-cc210c2a0cdf found in kube manager 2025-01-02 23:26:12,185 - INFO - Pod ctest-pod-00858094 verification passed 2025-01-02 23:26:12,213 - INFO - Pod ctest-pod-45833422 is in running state.Got IP 10.47.255.249 2025-01-02 23:26:12,236 - DEBUG - Pod ctest-pod-45833422 has vmi ecdbe144-c960-11ef-aca6-fa163ec365c1 2025-01-02 23:26:12,236 - INFO - Verified pod ctest-pod-45833422 in contrail-api 2025-01-02 23:26:12,249 - DEBUG - VMI ecdbe144-c960-11ef-aca6-fa163ec365c1 is active in agent 10.0.0.27 2025-01-02 23:26:12,249 - INFO - Verified Pod ctest-pod-45833422 in agent 10.0.0.27 2025-01-02 23:26:12,250 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=bc101254-4305-4c59-bac5-460d468e5c21 2025-01-02 23:26:12,254 - INFO - Pod ctest-pod-45833422 with uuid bc101254-4305-4c59-bac5-460d468e5c21 found in kube manager 2025-01-02 23:26:12,254 - INFO - Pod ctest-pod-45833422 verification passed 2025-01-02 23:26:12,261 - DEBUG - Pod ctest-pod-46835009 not in running state.Currently in Pending 2025-01-02 23:26:17,270 - INFO - Pod ctest-pod-46835009 is in running state.Got IP 10.47.255.248 2025-01-02 23:26:17,295 - DEBUG - Pod ctest-pod-46835009 has vmi ed63395a-c960-11ef-aca6-fa163ec365c1 2025-01-02 23:26:17,295 - INFO - Verified pod ctest-pod-46835009 in contrail-api 2025-01-02 23:26:17,310 - DEBUG - VMI ed63395a-c960-11ef-aca6-fa163ec365c1 is active in agent 10.0.0.27 2025-01-02 23:26:17,310 - INFO - Verified Pod ctest-pod-46835009 in agent 10.0.0.27 2025-01-02 23:26:17,310 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=ae439d58-91e0-43e4-ac58-23a4952a76a0 2025-01-02 23:26:17,321 - INFO - Pod ctest-pod-46835009 with uuid ae439d58-91e0-43e4-ac58-23a4952a76a0 found in kube manager 2025-01-02 23:26:17,322 - INFO - Pod ctest-pod-46835009 verification passed 2025-01-02 23:26:17,329 - INFO - Pod ctest-pod-52245407 is in running state.Got IP 10.47.255.247 2025-01-02 23:26:17,389 - DEBUG - Pod ctest-pod-52245407 has vmi ede5dedc-c960-11ef-aca6-fa163ec365c1 2025-01-02 23:26:17,390 - INFO - Verified pod ctest-pod-52245407 in contrail-api 2025-01-02 23:26:17,409 - DEBUG - VMI ede5dedc-c960-11ef-aca6-fa163ec365c1 is active in agent 10.0.0.27 2025-01-02 23:26:17,409 - INFO - Verified Pod ctest-pod-52245407 in agent 10.0.0.27 2025-01-02 23:26:17,410 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=0fc36460-22b1-4ea1-a971-e15bffd8d896 2025-01-02 23:26:17,418 - INFO - Pod ctest-pod-52245407 with uuid 0fc36460-22b1-4ea1-a971-e15bffd8d896 found in kube manager 2025-01-02 23:26:17,418 - INFO - Pod ctest-pod-52245407 verification passed 2025-01-02 23:26:17,425 - INFO - Pod ctest-pod-29837186 is in running state.Got IP 10.47.255.245 2025-01-02 23:26:17,443 - DEBUG - Pod ctest-pod-29837186 has vmi ef09d980-c960-11ef-aca6-fa163ec365c1 2025-01-02 23:26:17,443 - INFO - Verified pod ctest-pod-29837186 in contrail-api 2025-01-02 23:26:17,457 - DEBUG - VMI ef09d980-c960-11ef-aca6-fa163ec365c1 is active in agent 10.0.0.27 2025-01-02 23:26:17,458 - INFO - Verified Pod ctest-pod-29837186 in agent 10.0.0.27 2025-01-02 23:26:17,458 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=96f47a1e-6fb3-4890-9d8e-93abb32d3177 2025-01-02 23:26:17,473 - INFO - Pod ctest-pod-29837186 with uuid 96f47a1e-6fb3-4890-9d8e-93abb32d3177 found in kube manager 2025-01-02 23:26:17,473 - INFO - Pod ctest-pod-29837186 verification passed 2025-01-02 23:26:17,479 - INFO - Pod ctest-pod-20395723 is in running state.Got IP 10.47.255.246 2025-01-02 23:26:17,550 - DEBUG - Pod ctest-pod-20395723 has vmi ee9474d8-c960-11ef-aca6-fa163ec365c1 2025-01-02 23:26:17,550 - INFO - Verified pod ctest-pod-20395723 in contrail-api 2025-01-02 23:26:17,567 - DEBUG - VMI ee9474d8-c960-11ef-aca6-fa163ec365c1 is active in agent 10.0.0.27 2025-01-02 23:26:17,567 - INFO - Verified Pod ctest-pod-20395723 in agent 10.0.0.27 2025-01-02 23:26:17,567 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=c0c36259-9138-4c5b-bb68-5034620b4f95 2025-01-02 23:26:17,572 - INFO - Pod ctest-pod-20395723 with uuid c0c36259-9138-4c5b-bb68-5034620b4f95 found in kube manager 2025-01-02 23:26:17,572 - INFO - Pod ctest-pod-20395723 verification passed 2025-01-02 23:26:17,581 - INFO - Pod ctest-pod-24928913 is in running state.Got IP 10.47.255.244 2025-01-02 23:26:17,639 - DEBUG - Pod ctest-pod-24928913 has vmi ef82b0b2-c960-11ef-aca6-fa163ec365c1 2025-01-02 23:26:17,639 - INFO - Verified pod ctest-pod-24928913 in contrail-api 2025-01-02 23:26:17,654 - DEBUG - VMI ef82b0b2-c960-11ef-aca6-fa163ec365c1 is active in agent 10.0.0.27 2025-01-02 23:26:17,655 - INFO - Verified Pod ctest-pod-24928913 in agent 10.0.0.27 2025-01-02 23:26:17,655 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=6f65b98d-9dae-4aa4-8eeb-0059f73fab0e 2025-01-02 23:26:17,662 - INFO - Pod ctest-pod-24928913 with uuid 6f65b98d-9dae-4aa4-8eeb-0059f73fab0e found in kube manager 2025-01-02 23:26:17,662 - INFO - Pod ctest-pod-24928913 verification passed 2025-01-02 23:26:17,663 - INFO - ================================================================================ 2025-01-02 23:26:17,663 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-01-02 23:26:17,663 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-01-02 23:26:17,851 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.0.0.37': '0'}} with 2025-01-02 23:26:17,851 - INFO - Initial checks done. Running the testcase now 2025-01-02 23:26:17,851 - INFO - 2025-01-02 23:26:17,944 - DEBUG - [Pod ctest-pod-80243175] Cmd: echo ctest-pod-80243175 > /usr/share/nginx/html/index.html, Output: 2025-01-02 23:26:18,023 - DEBUG - [Pod ctest-pod-00858094] Cmd: echo ctest-pod-00858094 > /usr/share/nginx/html/index.html, Output: 2025-01-02 23:26:18,073 - DEBUG - [Pod ctest-pod-45833422] Cmd: echo ctest-pod-45833422 > /usr/share/nginx/html/index.html, Output: 2025-01-02 23:26:18,150 - DEBUG - [Pod ctest-pod-46835009] Cmd: echo ctest-pod-46835009 > /usr/share/nginx/html/index.html, Output: 2025-01-02 23:26:18,153 - DEBUG - Service ctest-nginx-svc-42049151 not present 2025-01-02 23:26:18,153 - INFO - Creating service ctest-nginx-svc-42049151 2025-01-02 23:26:18,186 - INFO - Created Service ctest-nginx-svc-42049151 2025-01-02 23:26:18,199 - WARNING - Service UUID 849ee99d-e902-4e74-b2b9-049bd4448161 not yet found in contrail-api 2025-01-02 23:26:19,210 - INFO - Validated that Service ctest-nginx-svc-42049151 is seen in contrail-api 2025-01-02 23:26:19,211 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_LoadbalancerDatabaseList?x=849ee99d-e902-4e74-b2b9-049bd4448161 2025-01-02 23:26:19,216 - INFO - Service ctest-nginx-svc-42049151 with uuid 849ee99d-e902-4e74-b2b9-049bd4448161 found in kube manager 2025-01-02 23:26:19,216 - INFO - Service ctest-nginx-svc-42049151 verification passed 2025-01-02 23:26:20,320 - DEBUG - [Pod ctest-pod-52245407] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.117.222:80 (10.96.117.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-00858094 2025-01-02 23:26:20,320 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 passed 2025-01-02 23:26:20,320 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd output: Connecting to 10.96.117.222:80 (10.96.117.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-00858094 2025-01-02 23:26:20,375 - DEBUG - [Pod ctest-pod-52245407] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: ctest-pod-00858094 Connecting to 10.96.117.222:80 (10.96.117.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 23:26:20,375 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 passed 2025-01-02 23:26:20,375 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd output: ctest-pod-00858094 Connecting to 10.96.117.222:80 (10.96.117.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 23:26:20,438 - DEBUG - [Pod ctest-pod-52245407] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: ctest-pod-80243175 Connecting to 10.96.117.222:80 (10.96.117.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 23:26:20,438 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 passed 2025-01-02 23:26:20,438 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd output: ctest-pod-80243175 Connecting to 10.96.117.222:80 (10.96.117.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 23:26:20,438 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-80243175': 1, 'ctest-pod-00858094': 2} 2025-01-02 23:26:20,507 - DEBUG - [Pod ctest-pod-29837186] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: ctest-pod-80243175 Connecting to 10.96.117.222:80 (10.96.117.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 23:26:20,507 - DEBUG - [Pod Pod ctest-pod-29837186] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 passed 2025-01-02 23:26:20,507 - DEBUG - [Pod Pod ctest-pod-29837186] Cmd output: ctest-pod-80243175 Connecting to 10.96.117.222:80 (10.96.117.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 23:26:20,575 - DEBUG - [Pod ctest-pod-29837186] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.117.222:80 (10.96.117.222:80) ctest-pod-80243175 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 23:26:20,575 - DEBUG - [Pod Pod ctest-pod-29837186] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 passed 2025-01-02 23:26:20,575 - DEBUG - [Pod Pod ctest-pod-29837186] Cmd output: Connecting to 10.96.117.222:80 (10.96.117.222:80) ctest-pod-80243175 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 23:26:20,631 - DEBUG - [Pod ctest-pod-29837186] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: ctest-pod-80243175 Connecting to 10.96.117.222:80 (10.96.117.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 23:26:20,631 - DEBUG - [Pod Pod ctest-pod-29837186] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 passed 2025-01-02 23:26:20,631 - DEBUG - [Pod Pod ctest-pod-29837186] Cmd output: ctest-pod-80243175 Connecting to 10.96.117.222:80 (10.96.117.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 23:26:20,686 - DEBUG - [Pod ctest-pod-29837186] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.117.222:80 (10.96.117.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-00858094 2025-01-02 23:26:20,687 - DEBUG - [Pod Pod ctest-pod-29837186] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 passed 2025-01-02 23:26:20,687 - DEBUG - [Pod Pod ctest-pod-29837186] Cmd output: Connecting to 10.96.117.222:80 (10.96.117.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-00858094 2025-01-02 23:26:20,687 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-80243175': 3, 'ctest-pod-00858094': 1} 2025-01-02 23:26:20,690 - DEBUG - Network policy ingress-on-service not present 2025-01-02 23:26:20,690 - INFO - Creating Network Policy ingress-on-service 2025-01-02 23:26:20,704 - INFO - Network policy found in k8s 2025-01-02 23:26:20,704 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=14b833e3-906d-48b1-9c11-0e0b1882ee58 2025-01-02 23:26:20,709 - INFO - Network Policy ingress-on-service with uuid 14b833e3-906d-48b1-9c11-0e0b1882ee58 found in kube manager 2025-01-02 23:26:20,764 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-01-02 23:26:20,766 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-01-02 23:26:20,766 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=14b833e3-906d-48b1-9c11-0e0b1882ee58 2025-01-02 23:26:20,798 - WARNING - Network policy with name ingress-on-service not found in agent 2025-01-02 23:26:22,799 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=14b833e3-906d-48b1-9c11-0e0b1882ee58 2025-01-02 23:26:22,837 - INFO - Network policy with name ingress-on-service found in agent 2025-01-02 23:26:22,837 - INFO - Network Policy ingress-on-service verification passed 2025-01-02 23:26:27,904 - DEBUG - [Pod ctest-pod-52245407] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:26:27,905 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:26:27,905 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:26:32,966 - DEBUG - [Pod ctest-pod-52245407] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:26:32,966 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:26:32,966 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:26:38,028 - DEBUG - [Pod ctest-pod-52245407] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:26:38,028 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:26:38,028 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:26:43,085 - DEBUG - [Pod ctest-pod-52245407] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:26:43,085 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:26:43,085 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:26:48,146 - DEBUG - [Pod ctest-pod-52245407] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:26:48,146 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:26:48,146 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:26:53,208 - DEBUG - [Pod ctest-pod-52245407] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:26:53,208 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:26:53,209 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:26:58,262 - DEBUG - [Pod ctest-pod-52245407] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:26:58,262 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:26:58,262 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:27:03,321 - DEBUG - [Pod ctest-pod-52245407] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:27:03,321 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:27:03,322 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:27:08,416 - DEBUG - [Pod ctest-pod-52245407] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:27:08,416 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:27:08,416 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:27:13,521 - DEBUG - [Pod ctest-pod-52245407] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:27:13,521 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:27:13,521 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:27:13,522 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-80243175': 0, 'ctest-pod-00858094': 0} 2025-01-02 23:27:13,594 - DEBUG - [Pod ctest-pod-20395723] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: ctest-pod-80243175 Connecting to 10.96.117.222:80 (10.96.117.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 23:27:13,594 - DEBUG - [Pod Pod ctest-pod-20395723] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 passed 2025-01-02 23:27:13,594 - DEBUG - [Pod Pod ctest-pod-20395723] Cmd output: ctest-pod-80243175 Connecting to 10.96.117.222:80 (10.96.117.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 23:27:13,670 - DEBUG - [Pod ctest-pod-20395723] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: ctest-pod-80243175 Connecting to 10.96.117.222:80 (10.96.117.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 23:27:13,671 - DEBUG - [Pod Pod ctest-pod-20395723] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 passed 2025-01-02 23:27:13,671 - DEBUG - [Pod Pod ctest-pod-20395723] Cmd output: ctest-pod-80243175 Connecting to 10.96.117.222:80 (10.96.117.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 23:27:13,741 - DEBUG - [Pod ctest-pod-20395723] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: ctest-pod-80243175 Connecting to 10.96.117.222:80 (10.96.117.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 23:27:13,741 - DEBUG - [Pod Pod ctest-pod-20395723] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 passed 2025-01-02 23:27:13,741 - DEBUG - [Pod Pod ctest-pod-20395723] Cmd output: ctest-pod-80243175 Connecting to 10.96.117.222:80 (10.96.117.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 23:27:13,814 - DEBUG - [Pod ctest-pod-20395723] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: ctest-pod-80243175 Connecting to 10.96.117.222:80 (10.96.117.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 23:27:13,832 - DEBUG - [Pod Pod ctest-pod-20395723] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 passed 2025-01-02 23:27:13,832 - DEBUG - [Pod Pod ctest-pod-20395723] Cmd output: ctest-pod-80243175 Connecting to 10.96.117.222:80 (10.96.117.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 23:27:13,886 - DEBUG - [Pod ctest-pod-20395723] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.117.222:80 (10.96.117.222:80) ctest-pod-00858094 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 23:27:13,886 - DEBUG - [Pod Pod ctest-pod-20395723] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 passed 2025-01-02 23:27:13,886 - DEBUG - [Pod Pod ctest-pod-20395723] Cmd output: Connecting to 10.96.117.222:80 (10.96.117.222:80) ctest-pod-00858094 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 23:27:13,886 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-80243175': 4, 'ctest-pod-00858094': 1} 2025-01-02 23:27:18,937 - DEBUG - [Pod ctest-pod-29837186] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:27:18,937 - DEBUG - [Pod Pod ctest-pod-29837186] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:27:18,937 - DEBUG - [Pod Pod ctest-pod-29837186] Cmd output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:27:24,004 - DEBUG - [Pod ctest-pod-29837186] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:27:24,004 - DEBUG - [Pod Pod ctest-pod-29837186] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:27:24,004 - DEBUG - [Pod Pod ctest-pod-29837186] Cmd output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:27:29,070 - DEBUG - [Pod ctest-pod-29837186] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:27:29,070 - DEBUG - [Pod Pod ctest-pod-29837186] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:27:29,070 - DEBUG - [Pod Pod ctest-pod-29837186] Cmd output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:27:34,139 - DEBUG - [Pod ctest-pod-29837186] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:27:34,139 - DEBUG - [Pod Pod ctest-pod-29837186] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:27:34,139 - DEBUG - [Pod Pod ctest-pod-29837186] Cmd output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:27:39,204 - DEBUG - [Pod ctest-pod-29837186] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:27:39,204 - DEBUG - [Pod Pod ctest-pod-29837186] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:27:39,204 - DEBUG - [Pod Pod ctest-pod-29837186] Cmd output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:27:44,265 - DEBUG - [Pod ctest-pod-29837186] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:27:44,266 - DEBUG - [Pod Pod ctest-pod-29837186] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:27:44,266 - DEBUG - [Pod Pod ctest-pod-29837186] Cmd output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:27:49,332 - DEBUG - [Pod ctest-pod-29837186] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:27:49,332 - DEBUG - [Pod Pod ctest-pod-29837186] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:27:49,332 - DEBUG - [Pod Pod ctest-pod-29837186] Cmd output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:27:54,393 - DEBUG - [Pod ctest-pod-29837186] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:27:54,393 - DEBUG - [Pod Pod ctest-pod-29837186] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:27:54,393 - DEBUG - [Pod Pod ctest-pod-29837186] Cmd output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:27:59,457 - DEBUG - [Pod ctest-pod-29837186] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:27:59,458 - DEBUG - [Pod Pod ctest-pod-29837186] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:27:59,458 - DEBUG - [Pod Pod ctest-pod-29837186] Cmd output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:28:04,520 - DEBUG - [Pod ctest-pod-29837186] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:28:04,520 - DEBUG - [Pod Pod ctest-pod-29837186] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:28:04,520 - DEBUG - [Pod Pod ctest-pod-29837186] Cmd output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:28:04,520 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-80243175': 0, 'ctest-pod-00858094': 0} 2025-01-02 23:28:06,584 - DEBUG - [Pod ctest-pod-20395723] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.503 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.075 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.088 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.075/0.222/0.503 ms 2025-01-02 23:28:06,585 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-20395723 with expectation True passed 2025-01-02 23:28:08,646 - DEBUG - [Pod ctest-pod-52245407] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.418 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.078 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.089 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.078/0.195/0.418 ms 2025-01-02 23:28:08,646 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-52245407 with expectation True passed 2025-01-02 23:28:10,715 - DEBUG - [Pod ctest-pod-29837186] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.519 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.081 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.096 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.081/0.565/1.519 ms 2025-01-02 23:28:10,715 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-29837186 with expectation True passed 2025-01-02 23:28:10,847 - DEBUG - [Pod ctest-pod-20395723] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-02 23:28:10,847 - DEBUG - [Pod Pod ctest-pod-20395723] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-01-02 23:28:10,847 - DEBUG - [Pod Pod ctest-pod-20395723] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-02 23:28:10,847 - INFO - wget check of of http://10.47.255.251 from ctest-pod-20395723 passed 2025-01-02 23:28:10,900 - DEBUG - [Pod ctest-pod-20395723] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-02 23:28:10,900 - DEBUG - [Pod Pod ctest-pod-20395723] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-01-02 23:28:10,900 - DEBUG - [Pod Pod ctest-pod-20395723] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-02 23:28:10,900 - INFO - wget check of of http://10.47.255.250 from ctest-pod-20395723 passed 2025-01-02 23:28:15,978 - DEBUG - [Pod ctest-pod-52245407] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-02 23:28:15,978 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-02 23:28:15,978 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-02 23:28:15,978 - INFO - wget check of of http://10.47.255.250 from ctest-pod-52245407 passed 2025-01-02 23:28:21,046 - DEBUG - [Pod ctest-pod-24928913] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-01-02 23:28:21,047 - DEBUG - [Pod Pod ctest-pod-24928913] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-01-02 23:28:21,047 - DEBUG - [Pod Pod ctest-pod-24928913] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-01-02 23:28:21,047 - INFO - wget check of of http://10.47.255.251 from ctest-pod-24928913 passed 2025-01-02 23:28:21,056 - INFO - Updating Network Policy ingress-on-service 2025-01-02 23:28:26,149 - DEBUG - [Pod ctest-pod-52245407] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:28:26,149 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:28:26,149 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:28:31,204 - DEBUG - [Pod ctest-pod-52245407] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:28:31,204 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:28:31,204 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:28:36,264 - DEBUG - [Pod ctest-pod-52245407] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:28:36,265 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:28:36,265 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:28:41,333 - DEBUG - [Pod ctest-pod-52245407] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:28:41,333 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:28:41,333 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:28:46,386 - DEBUG - [Pod ctest-pod-52245407] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:28:46,386 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:28:46,386 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:28:51,570 - DEBUG - [Pod ctest-pod-52245407] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:28:51,570 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:28:51,570 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:28:56,633 - DEBUG - [Pod ctest-pod-52245407] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:28:56,633 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:28:56,633 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:29:01,720 - DEBUG - [Pod ctest-pod-52245407] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:29:01,720 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:29:01,720 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:29:06,778 - DEBUG - [Pod ctest-pod-52245407] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:29:06,778 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:29:06,778 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:29:11,846 - DEBUG - [Pod ctest-pod-52245407] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:29:11,846 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:29:11,846 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd output: Connecting to 10.96.117.222:80 (10.96.117.222:80) wget: download timed out 2025-01-02 23:29:11,846 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-80243175': 0, 'ctest-pod-00858094': 0} 2025-01-02 23:29:11,915 - DEBUG - [Pod ctest-pod-20395723] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.117.222:80 (10.96.117.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-00858094 2025-01-02 23:29:11,915 - DEBUG - [Pod Pod ctest-pod-20395723] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 passed 2025-01-02 23:29:11,915 - DEBUG - [Pod Pod ctest-pod-20395723] Cmd output: Connecting to 10.96.117.222:80 (10.96.117.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-00858094 2025-01-02 23:29:11,986 - DEBUG - [Pod ctest-pod-20395723] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: ctest-pod-00858094 Connecting to 10.96.117.222:80 (10.96.117.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 23:29:11,986 - DEBUG - [Pod Pod ctest-pod-20395723] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 passed 2025-01-02 23:29:11,986 - DEBUG - [Pod Pod ctest-pod-20395723] Cmd output: ctest-pod-00858094 Connecting to 10.96.117.222:80 (10.96.117.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 23:29:12,073 - DEBUG - [Pod ctest-pod-20395723] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.117.222:80 (10.96.117.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-80243175 2025-01-02 23:29:12,073 - DEBUG - [Pod Pod ctest-pod-20395723] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 passed 2025-01-02 23:29:12,073 - DEBUG - [Pod Pod ctest-pod-20395723] Cmd output: Connecting to 10.96.117.222:80 (10.96.117.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-80243175 2025-01-02 23:29:12,073 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-80243175': 1, 'ctest-pod-00858094': 2} 2025-01-02 23:29:12,126 - DEBUG - [Pod ctest-pod-29837186] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: ctest-pod-80243175 Connecting to 10.96.117.222:80 (10.96.117.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 23:29:12,126 - DEBUG - [Pod Pod ctest-pod-29837186] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 passed 2025-01-02 23:29:12,126 - DEBUG - [Pod Pod ctest-pod-29837186] Cmd output: ctest-pod-80243175 Connecting to 10.96.117.222:80 (10.96.117.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 23:29:12,191 - DEBUG - [Pod ctest-pod-29837186] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: ctest-pod-80243175 Connecting to 10.96.117.222:80 (10.96.117.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 23:29:12,191 - DEBUG - [Pod Pod ctest-pod-29837186] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 passed 2025-01-02 23:29:12,191 - DEBUG - [Pod Pod ctest-pod-29837186] Cmd output: ctest-pod-80243175 Connecting to 10.96.117.222:80 (10.96.117.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 23:29:12,251 - DEBUG - [Pod ctest-pod-29837186] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.117.222:80 (10.96.117.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-80243175 2025-01-02 23:29:12,251 - DEBUG - [Pod Pod ctest-pod-29837186] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 passed 2025-01-02 23:29:12,251 - DEBUG - [Pod Pod ctest-pod-29837186] Cmd output: Connecting to 10.96.117.222:80 (10.96.117.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-80243175 2025-01-02 23:29:12,307 - DEBUG - [Pod ctest-pod-29837186] Cmd: wget http://10.96.117.222:80/ -O - -T 5 -t 1 , Output: ctest-pod-00858094 Connecting to 10.96.117.222:80 (10.96.117.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 23:29:12,307 - DEBUG - [Pod Pod ctest-pod-29837186] Cmd wget http://10.96.117.222:80/ -O - -T 5 -t 1 passed 2025-01-02 23:29:12,307 - DEBUG - [Pod Pod ctest-pod-29837186] Cmd output: ctest-pod-00858094 Connecting to 10.96.117.222:80 (10.96.117.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-02 23:29:12,307 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-80243175': 3, 'ctest-pod-00858094': 1} 2025-01-02 23:29:14,515 - DEBUG - [Pod ctest-pod-20395723] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.702 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.078 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.069 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.069/0.616/1.702 ms 2025-01-02 23:29:14,515 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-20395723 with expectation True passed 2025-01-02 23:29:16,575 - DEBUG - [Pod ctest-pod-52245407] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.495 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.111 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.070/0.225/0.495 ms 2025-01-02 23:29:16,575 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-52245407 with expectation True passed 2025-01-02 23:29:18,649 - DEBUG - [Pod ctest-pod-29837186] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.546 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.078 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.079 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.078/0.234/0.546 ms 2025-01-02 23:29:18,649 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-29837186 with expectation True passed 2025-01-02 23:29:18,718 - DEBUG - [Pod ctest-pod-20395723] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-02 23:29:18,718 - DEBUG - [Pod Pod ctest-pod-20395723] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-01-02 23:29:18,718 - DEBUG - [Pod Pod ctest-pod-20395723] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-02 23:29:18,718 - INFO - wget check of of http://10.47.255.251 from ctest-pod-20395723 passed 2025-01-02 23:29:18,789 - DEBUG - [Pod ctest-pod-20395723] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-02 23:29:18,789 - DEBUG - [Pod Pod ctest-pod-20395723] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-01-02 23:29:18,789 - DEBUG - [Pod Pod ctest-pod-20395723] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-02 23:29:18,789 - INFO - wget check of of http://10.47.255.250 from ctest-pod-20395723 passed 2025-01-02 23:29:23,852 - DEBUG - [Pod ctest-pod-52245407] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-02 23:29:23,852 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-02 23:29:23,852 - DEBUG - [Pod Pod ctest-pod-52245407] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-02 23:29:23,852 - INFO - wget check of of http://10.47.255.250 from ctest-pod-52245407 passed 2025-01-02 23:29:23,932 - DEBUG - [Pod ctest-pod-24928913] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-02 23:29:23,932 - DEBUG - [Pod Pod ctest-pod-24928913] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-01-02 23:29:23,932 - DEBUG - [Pod Pod ctest-pod-24928913] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-02 23:29:23,932 - INFO - wget check of of http://10.47.255.251 from ctest-pod-24928913 passed 2025-01-02 23:29:23,932 - INFO - Deleting Network Policy : ingress-on-service 2025-01-02 23:29:23,933 - INFO - Deleting service : ctest-nginx-svc-42049151 2025-01-02 23:29:24,121 - DEBUG - No XMPP flaps were noticed during the test
2025-01-02 23:29:24,121 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:07]
2025-01-02 23:29:24,121 - INFO - -------------------------------------------------------------------------------- 2025-01-02 23:29:24,127 - INFO - Deleting pod ctest-new-default-37180827:ctest-pod-80243175 2025-01-02 23:29:24,127 - INFO - Deleting pod ctest-new-default-37180827:ctest-pod-00858094 2025-01-02 23:29:24,128 - INFO - Deleting pod ctest-non-default-05632403:ctest-pod-45833422 2025-01-02 23:29:24,128 - INFO - Deleting pod ctest-non-default-05632403:ctest-pod-46835009 2025-01-02 23:29:24,129 - INFO - Deleting pod ctest-new-default-37180827:ctest-pod-52245407 2025-01-02 23:29:24,129 - INFO - Deleting pod ctest-new-default-37180827:ctest-pod-20395723 2025-01-02 23:29:24,129 - INFO - Deleting pod ctest-non-default-05632403:ctest-pod-29837186 2025-01-02 23:29:24,130 - INFO - Deleting pod ctest-non-default-05632403:ctest-pod-24928913 2025-01-02 23:29:24,236 - WARNING - Pod uuid bc101254-4305-4c59-bac5-460d468e5c21 is still seen in agent 10.0.0.27 VM list 2025-01-02 23:29:24,237 - WARNING - Pod uuid 5c9cf711-cfd7-4f64-8f6b-22c6852a0acf is still seen in agent 10.0.0.27 VM list 2025-01-02 23:29:24,239 - WARNING - Pod uuid 96f47a1e-6fb3-4890-9d8e-93abb32d3177 is still seen in agent 10.0.0.27 VM list 2025-01-02 23:29:24,289 - WARNING - Pod uuid 0fc36460-22b1-4ea1-a971-e15bffd8d896 is still seen in agent 10.0.0.27 VM list 2025-01-02 23:29:24,289 - WARNING - Pod uuid ae439d58-91e0-43e4-ac58-23a4952a76a0 is still seen in agent 10.0.0.27 VM list 2025-01-02 23:29:24,290 - WARNING - Pod uuid 6f65b98d-9dae-4aa4-8eeb-0059f73fab0e is still seen in agent 10.0.0.27 VM list 2025-01-02 23:29:24,291 - WARNING - Pod uuid c0c36259-9138-4c5b-bb68-5034620b4f95 is still seen in agent 10.0.0.27 VM list 2025-01-02 23:29:24,291 - WARNING - Pod uuid f1c67d3a-39ee-4387-a251-cc210c2a0cdf is still seen in agent 10.0.0.27 VM list 2025-01-02 23:29:29,253 - WARNING - Pod uuid 96f47a1e-6fb3-4890-9d8e-93abb32d3177 is still seen in agent 10.0.0.27 VM list 2025-01-02 23:29:29,253 - DEBUG - Pod bc101254-4305-4c59-bac5-460d468e5c21 is not in agent 10.0.0.27 VM list 2025-01-02 23:29:29,256 - WARNING - Pod uuid 5c9cf711-cfd7-4f64-8f6b-22c6852a0acf is still seen in agent 10.0.0.27 VM list 2025-01-02 23:29:29,261 - DEBUG - VMI ecdbe144-c960-11ef-aca6-fa163ec365c1 is removed from agent 10.0.0.27 2025-01-02 23:29:29,261 - INFO - Verified that pod ctest-pod-45833422 is removed in agent 2025-01-02 23:29:29,316 - DEBUG - Pod f1c67d3a-39ee-4387-a251-cc210c2a0cdf is not in agent 10.0.0.27 VM list 2025-01-02 23:29:29,318 - WARNING - Pod uuid 6f65b98d-9dae-4aa4-8eeb-0059f73fab0e is still seen in agent 10.0.0.27 VM list 2025-01-02 23:29:29,318 - WARNING - Pod uuid c0c36259-9138-4c5b-bb68-5034620b4f95 is still seen in agent 10.0.0.27 VM list 2025-01-02 23:29:29,319 - DEBUG - Pod ae439d58-91e0-43e4-ac58-23a4952a76a0 is not in agent 10.0.0.27 VM list 2025-01-02 23:29:29,322 - WARNING - Pod uuid 0fc36460-22b1-4ea1-a971-e15bffd8d896 is still seen in agent 10.0.0.27 VM list 2025-01-02 23:29:29,331 - DEBUG - VMI ec3640cc-c960-11ef-aca6-fa163ec365c1 is removed from agent 10.0.0.27 2025-01-02 23:29:29,332 - INFO - Verified that pod ctest-pod-00858094 is removed in agent 2025-01-02 23:29:29,332 - DEBUG - VMI ed63395a-c960-11ef-aca6-fa163ec365c1 is removed from agent 10.0.0.27 2025-01-02 23:29:29,332 - INFO - Verified that pod ctest-pod-46835009 is removed in agent 2025-01-02 23:29:34,264 - WARNING - Pod uuid 96f47a1e-6fb3-4890-9d8e-93abb32d3177 is still seen in agent 10.0.0.27 VM list 2025-01-02 23:29:34,265 - WARNING - Pod uuid 5c9cf711-cfd7-4f64-8f6b-22c6852a0acf is still seen in agent 10.0.0.27 VM list 2025-01-02 23:29:34,335 - WARNING - Pod uuid 6f65b98d-9dae-4aa4-8eeb-0059f73fab0e is still seen in agent 10.0.0.27 VM list 2025-01-02 23:29:34,337 - WARNING - Pod uuid c0c36259-9138-4c5b-bb68-5034620b4f95 is still seen in agent 10.0.0.27 VM list 2025-01-02 23:29:34,337 - WARNING - Pod uuid 0fc36460-22b1-4ea1-a971-e15bffd8d896 is still seen in agent 10.0.0.27 VM list 2025-01-02 23:29:39,279 - WARNING - Pod uuid 5c9cf711-cfd7-4f64-8f6b-22c6852a0acf is still seen in agent 10.0.0.27 VM list 2025-01-02 23:29:39,280 - WARNING - Pod uuid 96f47a1e-6fb3-4890-9d8e-93abb32d3177 is still seen in agent 10.0.0.27 VM list 2025-01-02 23:29:39,349 - WARNING - Pod uuid 6f65b98d-9dae-4aa4-8eeb-0059f73fab0e is still seen in agent 10.0.0.27 VM list 2025-01-02 23:29:39,351 - WARNING - Pod uuid c0c36259-9138-4c5b-bb68-5034620b4f95 is still seen in agent 10.0.0.27 VM list 2025-01-02 23:29:39,352 - WARNING - Pod uuid 0fc36460-22b1-4ea1-a971-e15bffd8d896 is still seen in agent 10.0.0.27 VM list 2025-01-02 23:29:44,290 - WARNING - Pod uuid 5c9cf711-cfd7-4f64-8f6b-22c6852a0acf is still seen in agent 10.0.0.27 VM list 2025-01-02 23:29:44,293 - WARNING - Pod uuid 96f47a1e-6fb3-4890-9d8e-93abb32d3177 is still seen in agent 10.0.0.27 VM list 2025-01-02 23:29:44,364 - WARNING - Pod uuid 6f65b98d-9dae-4aa4-8eeb-0059f73fab0e is still seen in agent 10.0.0.27 VM list 2025-01-02 23:29:44,366 - WARNING - Pod uuid c0c36259-9138-4c5b-bb68-5034620b4f95 is still seen in agent 10.0.0.27 VM list 2025-01-02 23:29:44,367 - WARNING - Pod uuid 0fc36460-22b1-4ea1-a971-e15bffd8d896 is still seen in agent 10.0.0.27 VM list 2025-01-02 23:29:49,304 - WARNING - Pod uuid 96f47a1e-6fb3-4890-9d8e-93abb32d3177 is still seen in agent 10.0.0.27 VM list 2025-01-02 23:29:49,304 - WARNING - Pod uuid 5c9cf711-cfd7-4f64-8f6b-22c6852a0acf is still seen in agent 10.0.0.27 VM list 2025-01-02 23:29:49,381 - WARNING - Pod uuid 6f65b98d-9dae-4aa4-8eeb-0059f73fab0e is still seen in agent 10.0.0.27 VM list 2025-01-02 23:29:49,383 - WARNING - Pod uuid 0fc36460-22b1-4ea1-a971-e15bffd8d896 is still seen in agent 10.0.0.27 VM list 2025-01-02 23:29:49,383 - WARNING - Pod uuid c0c36259-9138-4c5b-bb68-5034620b4f95 is still seen in agent 10.0.0.27 VM list 2025-01-02 23:29:54,321 - WARNING - Pod uuid 96f47a1e-6fb3-4890-9d8e-93abb32d3177 is still seen in agent 10.0.0.27 VM list 2025-01-02 23:29:54,322 - WARNING - Pod uuid 5c9cf711-cfd7-4f64-8f6b-22c6852a0acf is still seen in agent 10.0.0.27 VM list 2025-01-02 23:29:54,398 - WARNING - Pod uuid 6f65b98d-9dae-4aa4-8eeb-0059f73fab0e is still seen in agent 10.0.0.27 VM list 2025-01-02 23:29:54,403 - WARNING - Pod uuid 0fc36460-22b1-4ea1-a971-e15bffd8d896 is still seen in agent 10.0.0.27 VM list 2025-01-02 23:29:54,404 - WARNING - Pod uuid c0c36259-9138-4c5b-bb68-5034620b4f95 is still seen in agent 10.0.0.27 VM list 2025-01-02 23:29:59,332 - DEBUG - Pod 96f47a1e-6fb3-4890-9d8e-93abb32d3177 is not in agent 10.0.0.27 VM list 2025-01-02 23:29:59,334 - DEBUG - Pod 5c9cf711-cfd7-4f64-8f6b-22c6852a0acf is not in agent 10.0.0.27 VM list 2025-01-02 23:29:59,342 - DEBUG - VMI ef09d980-c960-11ef-aca6-fa163ec365c1 is removed from agent 10.0.0.27 2025-01-02 23:29:59,342 - INFO - Verified that pod ctest-pod-29837186 is removed in agent 2025-01-02 23:29:59,343 - DEBUG - VMI ebafdd84-c960-11ef-aca6-fa163ec365c1 is removed from agent 10.0.0.27 2025-01-02 23:29:59,343 - INFO - Verified that pod ctest-pod-80243175 is removed in agent 2025-01-02 23:29:59,408 - DEBUG - Pod 6f65b98d-9dae-4aa4-8eeb-0059f73fab0e is not in agent 10.0.0.27 VM list 2025-01-02 23:29:59,417 - DEBUG - Pod 0fc36460-22b1-4ea1-a971-e15bffd8d896 is not in agent 10.0.0.27 VM list 2025-01-02 23:29:59,420 - DEBUG - VMI ef82b0b2-c960-11ef-aca6-fa163ec365c1 is removed from agent 10.0.0.27 2025-01-02 23:29:59,420 - INFO - Verified that pod ctest-pod-24928913 is removed in agent 2025-01-02 23:29:59,420 - DEBUG - Pod c0c36259-9138-4c5b-bb68-5034620b4f95 is not in agent 10.0.0.27 VM list 2025-01-02 23:29:59,432 - DEBUG - VMI ede5dedc-c960-11ef-aca6-fa163ec365c1 is removed from agent 10.0.0.27 2025-01-02 23:29:59,432 - INFO - Verified that pod ctest-pod-52245407 is removed in agent 2025-01-02 23:29:59,433 - DEBUG - VMI ee9474d8-c960-11ef-aca6-fa163ec365c1 is removed from agent 10.0.0.27 2025-01-02 23:29:59,433 - INFO - Verified that pod ctest-pod-20395723 is removed in agent 2025-01-02 23:29:59,433 - INFO - Deleting namespace ctest-non-default-05632403 2025-01-02 23:29:59,442 - DEBUG - Namespace ctest-non-default-05632403 still in k8s 2025-01-02 23:30:01,446 - DEBUG - Namespace ctest-non-default-05632403 still in k8s 2025-01-02 23:30:03,450 - DEBUG - Namespace ctest-non-default-05632403 still in k8s 2025-01-02 23:30:05,456 - DEBUG - Namespace ctest-non-default-05632403 is not in k8s 2025-01-02 23:30:05,456 - DEBUG - No need to check project deletion in contrail-api 2025-01-02 23:30:05,456 - INFO - Deleting namespace ctest-new-default-37180827 2025-01-02 23:30:05,465 - DEBUG - Namespace ctest-new-default-37180827 still in k8s 2025-01-02 23:30:07,470 - DEBUG - Namespace ctest-new-default-37180827 still in k8s 2025-01-02 23:30:09,475 - DEBUG - Namespace ctest-new-default-37180827 still in k8s 2025-01-02 23:30:11,490 - DEBUG - Namespace ctest-new-default-37180827 is not in k8s 2025-01-02 23:30:11,490 - DEBUG - No need to check project deletion in contrail-api