2025-01-04 19:33:55,369 - INFO - Using existing project ['default-domain', 'k8s-default'](c9084186-6d40-45e9-9e59-6ffec5a7bccd) 2025-01-04 19:33:55,388 - DEBUG - Namespace ctest-new-default-48739887 not present 2025-01-04 19:33:55,400 - INFO - Created namespace ctest-new-default-48739887 2025-01-04 19:33:58,405 - DEBUG - Namespace ctest-non-default-06755108 not present 2025-01-04 19:33:58,412 - INFO - Created namespace ctest-non-default-06755108 2025-01-04 19:34:01,430 - DEBUG - Pod ctest-pod-45664958 not present 2025-01-04 19:34:01,430 - INFO - Creating Pod ctest-pod-45664958 2025-01-04 19:34:01,453 - DEBUG - Pod : ctest-pod-45664958 UUID is ab7f2aa7-46cb-468a-8669-c8069c58e46f 2025-01-04 19:34:01,456 - DEBUG - Pod ctest-pod-44354236 not present 2025-01-04 19:34:01,456 - INFO - Creating Pod ctest-pod-44354236 2025-01-04 19:34:01,504 - DEBUG - Pod : ctest-pod-44354236 UUID is 8fedc2ce-0b77-4f9e-a24f-fe4c489e6610 2025-01-04 19:34:01,512 - DEBUG - Pod ctest-pod-26351059 not present 2025-01-04 19:34:01,512 - INFO - Creating Pod ctest-pod-26351059 2025-01-04 19:34:01,555 - DEBUG - Pod : ctest-pod-26351059 UUID is 9a2aaa88-2c9a-457b-a98b-c3d952cf8669 2025-01-04 19:34:01,557 - DEBUG - Pod ctest-pod-69497969 not present 2025-01-04 19:34:01,557 - INFO - Creating Pod ctest-pod-69497969 2025-01-04 19:34:01,575 - DEBUG - Pod : ctest-pod-69497969 UUID is 71924468-347a-4452-8fa2-23f6d6be1204 2025-01-04 19:34:01,580 - DEBUG - Pod ctest-pod-94383690 not present 2025-01-04 19:34:01,580 - INFO - Creating Pod ctest-pod-94383690 2025-01-04 19:34:01,601 - DEBUG - Pod : ctest-pod-94383690 UUID is c67ebb31-c266-443e-be0b-e6197b3db456 2025-01-04 19:34:01,606 - DEBUG - Pod ctest-pod-29104286 not present 2025-01-04 19:34:01,607 - INFO - Creating Pod ctest-pod-29104286 2025-01-04 19:34:01,634 - DEBUG - Pod : ctest-pod-29104286 UUID is f0846a85-a6a3-48a5-be8a-757efaa01b66 2025-01-04 19:34:01,637 - DEBUG - Pod ctest-pod-84512617 not present 2025-01-04 19:34:01,637 - INFO - Creating Pod ctest-pod-84512617 2025-01-04 19:34:01,659 - DEBUG - Pod : ctest-pod-84512617 UUID is 87dd419c-b40e-48fe-aba9-53a993abe523 2025-01-04 19:34:01,662 - DEBUG - Pod ctest-pod-80146130 not present 2025-01-04 19:34:01,662 - INFO - Creating Pod ctest-pod-80146130 2025-01-04 19:34:01,681 - DEBUG - Pod : ctest-pod-80146130 UUID is 6107d868-0d03-4184-a41b-6a6d30fd1bd6 2025-01-04 19:34:01,867 - INFO - Project default-domain:k8s-ctest-new-default-48739887 for Namespace ctest-new-default-48739887 is seen in contrail-api 2025-01-04 19:34:01,867 - DEBUG - Project uuid in Contrail is ebb7c703-7f4c-4b5c-a524-bda664cb0a48 2025-01-04 19:34:02,016 - DEBUG - Requesting: http://10.0.0.42:8108/Snh_NamespaceDatabaseList?namespace_uuid=1adf5242-c8d3-49f0-968a-19de09ee1554 2025-01-04 19:34:02,023 - INFO - Namespace ctest-new-default-48739887 with uuid 1adf5242-c8d3-49f0-968a-19de09ee1554 found in kube manager 2025-01-04 19:34:02,023 - INFO - Namespace ctest-new-default-48739887 verification passed 2025-01-04 19:34:02,290 - INFO - Project default-domain:k8s-ctest-non-default-06755108 for Namespace ctest-non-default-06755108 is seen in contrail-api 2025-01-04 19:34:02,290 - DEBUG - Project uuid in Contrail is fbde809b-e181-4e3e-9408-d493c28d0a63 2025-01-04 19:34:02,290 - DEBUG - Requesting: http://10.0.0.42:8108/Snh_NamespaceDatabaseList?namespace_uuid=2a7d702f-4f2d-49f4-bbfd-2aef159acb99 2025-01-04 19:34:02,296 - INFO - Namespace ctest-non-default-06755108 with uuid 2a7d702f-4f2d-49f4-bbfd-2aef159acb99 found in kube manager 2025-01-04 19:34:02,296 - INFO - Namespace ctest-non-default-06755108 verification passed 2025-01-04 19:34:02,302 - DEBUG - Pod ctest-pod-45664958 not in running state.Currently in Pending 2025-01-04 19:34:07,317 - DEBUG - Pod ctest-pod-45664958 not in running state.Currently in Pending 2025-01-04 19:34:12,324 - DEBUG - Pod ctest-pod-45664958 not in running state.Currently in Pending 2025-01-04 19:34:17,333 - INFO - Pod ctest-pod-45664958 is in running state.Got IP 10.47.255.251 2025-01-04 19:34:17,397 - DEBUG - Pod ctest-pod-45664958 has vmi daac8af0-cad2-11ef-8ef4-fa163ef2afd4 2025-01-04 19:34:17,397 - INFO - Verified pod ctest-pod-45664958 in contrail-api 2025-01-04 19:34:17,414 - DEBUG - VMI daac8af0-cad2-11ef-8ef4-fa163ef2afd4 is active in agent 10.0.0.63 2025-01-04 19:34:17,415 - INFO - Verified Pod ctest-pod-45664958 in agent 10.0.0.63 2025-01-04 19:34:17,415 - DEBUG - Requesting: http://10.0.0.42:8108/Snh_VirtualMachineDatabaseList?x=ab7f2aa7-46cb-468a-8669-c8069c58e46f 2025-01-04 19:34:17,421 - INFO - Pod ctest-pod-45664958 with uuid ab7f2aa7-46cb-468a-8669-c8069c58e46f found in kube manager 2025-01-04 19:34:17,421 - INFO - Pod ctest-pod-45664958 verification passed 2025-01-04 19:34:17,426 - INFO - Pod ctest-pod-44354236 is in running state.Got IP 10.47.255.250 2025-01-04 19:34:17,440 - DEBUG - Pod ctest-pod-44354236 has vmi db2c59ba-cad2-11ef-8ef4-fa163ef2afd4 2025-01-04 19:34:17,440 - INFO - Verified pod ctest-pod-44354236 in contrail-api 2025-01-04 19:34:17,454 - DEBUG - VMI db2c59ba-cad2-11ef-8ef4-fa163ef2afd4 is active in agent 10.0.0.63 2025-01-04 19:34:17,454 - INFO - Verified Pod ctest-pod-44354236 in agent 10.0.0.63 2025-01-04 19:34:17,454 - DEBUG - Requesting: http://10.0.0.42:8108/Snh_VirtualMachineDatabaseList?x=8fedc2ce-0b77-4f9e-a24f-fe4c489e6610 2025-01-04 19:34:17,459 - INFO - Pod ctest-pod-44354236 with uuid 8fedc2ce-0b77-4f9e-a24f-fe4c489e6610 found in kube manager 2025-01-04 19:34:17,459 - INFO - Pod ctest-pod-44354236 verification passed 2025-01-04 19:34:17,464 - INFO - Pod ctest-pod-26351059 is in running state.Got IP 10.47.255.249 2025-01-04 19:34:17,522 - DEBUG - Pod ctest-pod-26351059 has vmi dbf383dc-cad2-11ef-8ef4-fa163ef2afd4 2025-01-04 19:34:17,522 - INFO - Verified pod ctest-pod-26351059 in contrail-api 2025-01-04 19:34:17,536 - DEBUG - VMI dbf383dc-cad2-11ef-8ef4-fa163ef2afd4 is active in agent 10.0.0.63 2025-01-04 19:34:17,537 - INFO - Verified Pod ctest-pod-26351059 in agent 10.0.0.63 2025-01-04 19:34:17,537 - DEBUG - Requesting: http://10.0.0.42:8108/Snh_VirtualMachineDatabaseList?x=9a2aaa88-2c9a-457b-a98b-c3d952cf8669 2025-01-04 19:34:17,549 - INFO - Pod ctest-pod-26351059 with uuid 9a2aaa88-2c9a-457b-a98b-c3d952cf8669 found in kube manager 2025-01-04 19:34:17,549 - INFO - Pod ctest-pod-26351059 verification passed 2025-01-04 19:34:17,556 - INFO - Pod ctest-pod-69497969 is in running state.Got IP 10.47.255.248 2025-01-04 19:34:17,609 - DEBUG - Pod ctest-pod-69497969 has vmi dc75699c-cad2-11ef-8ef4-fa163ef2afd4 2025-01-04 19:34:17,609 - INFO - Verified pod ctest-pod-69497969 in contrail-api 2025-01-04 19:34:17,627 - DEBUG - VMI dc75699c-cad2-11ef-8ef4-fa163ef2afd4 is active in agent 10.0.0.63 2025-01-04 19:34:17,627 - INFO - Verified Pod ctest-pod-69497969 in agent 10.0.0.63 2025-01-04 19:34:17,627 - DEBUG - Requesting: http://10.0.0.42:8108/Snh_VirtualMachineDatabaseList?x=71924468-347a-4452-8fa2-23f6d6be1204 2025-01-04 19:34:17,634 - INFO - Pod ctest-pod-69497969 with uuid 71924468-347a-4452-8fa2-23f6d6be1204 found in kube manager 2025-01-04 19:34:17,634 - INFO - Pod ctest-pod-69497969 verification passed 2025-01-04 19:34:17,640 - DEBUG - Pod ctest-pod-94383690 not in running state.Currently in Pending 2025-01-04 19:34:22,646 - INFO - Pod ctest-pod-94383690 is in running state.Got IP 10.47.255.247 2025-01-04 19:34:22,659 - DEBUG - Pod ctest-pod-94383690 has vmi dcfb7b4a-cad2-11ef-8ef4-fa163ef2afd4 2025-01-04 19:34:22,659 - INFO - Verified pod ctest-pod-94383690 in contrail-api 2025-01-04 19:34:22,675 - DEBUG - VMI dcfb7b4a-cad2-11ef-8ef4-fa163ef2afd4 is active in agent 10.0.0.63 2025-01-04 19:34:22,676 - INFO - Verified Pod ctest-pod-94383690 in agent 10.0.0.63 2025-01-04 19:34:22,676 - DEBUG - Requesting: http://10.0.0.42:8108/Snh_VirtualMachineDatabaseList?x=c67ebb31-c266-443e-be0b-e6197b3db456 2025-01-04 19:34:22,681 - INFO - Pod ctest-pod-94383690 with uuid c67ebb31-c266-443e-be0b-e6197b3db456 found in kube manager 2025-01-04 19:34:22,681 - INFO - Pod ctest-pod-94383690 verification passed 2025-01-04 19:34:22,687 - INFO - Pod ctest-pod-84512617 is in running state.Got IP 10.47.255.245 2025-01-04 19:34:22,745 - DEBUG - Pod ctest-pod-84512617 has vmi dded1504-cad2-11ef-8ef4-fa163ef2afd4 2025-01-04 19:34:22,746 - INFO - Verified pod ctest-pod-84512617 in contrail-api 2025-01-04 19:34:22,760 - DEBUG - VMI dded1504-cad2-11ef-8ef4-fa163ef2afd4 is active in agent 10.0.0.63 2025-01-04 19:34:22,760 - INFO - Verified Pod ctest-pod-84512617 in agent 10.0.0.63 2025-01-04 19:34:22,760 - DEBUG - Requesting: http://10.0.0.42:8108/Snh_VirtualMachineDatabaseList?x=87dd419c-b40e-48fe-aba9-53a993abe523 2025-01-04 19:34:22,764 - INFO - Pod ctest-pod-84512617 with uuid 87dd419c-b40e-48fe-aba9-53a993abe523 found in kube manager 2025-01-04 19:34:22,765 - INFO - Pod ctest-pod-84512617 verification passed 2025-01-04 19:34:22,769 - INFO - Pod ctest-pod-29104286 is in running state.Got IP 10.47.255.246 2025-01-04 19:34:22,786 - DEBUG - Pod ctest-pod-29104286 has vmi dd761f08-cad2-11ef-8ef4-fa163ef2afd4 2025-01-04 19:34:22,786 - INFO - Verified pod ctest-pod-29104286 in contrail-api 2025-01-04 19:34:22,804 - DEBUG - VMI dd761f08-cad2-11ef-8ef4-fa163ef2afd4 is active in agent 10.0.0.63 2025-01-04 19:34:22,805 - INFO - Verified Pod ctest-pod-29104286 in agent 10.0.0.63 2025-01-04 19:34:22,805 - DEBUG - Requesting: http://10.0.0.42:8108/Snh_VirtualMachineDatabaseList?x=f0846a85-a6a3-48a5-be8a-757efaa01b66 2025-01-04 19:34:22,810 - INFO - Pod ctest-pod-29104286 with uuid f0846a85-a6a3-48a5-be8a-757efaa01b66 found in kube manager 2025-01-04 19:34:22,810 - INFO - Pod ctest-pod-29104286 verification passed 2025-01-04 19:34:22,815 - INFO - Pod ctest-pod-80146130 is in running state.Got IP 10.47.255.244 2025-01-04 19:34:22,871 - DEBUG - Pod ctest-pod-80146130 has vmi de5ff4de-cad2-11ef-8ef4-fa163ef2afd4 2025-01-04 19:34:22,871 - INFO - Verified pod ctest-pod-80146130 in contrail-api 2025-01-04 19:34:22,889 - DEBUG - VMI de5ff4de-cad2-11ef-8ef4-fa163ef2afd4 is active in agent 10.0.0.63 2025-01-04 19:34:22,890 - INFO - Verified Pod ctest-pod-80146130 in agent 10.0.0.63 2025-01-04 19:34:22,890 - DEBUG - Requesting: http://10.0.0.42:8108/Snh_VirtualMachineDatabaseList?x=6107d868-0d03-4184-a41b-6a6d30fd1bd6 2025-01-04 19:34:22,895 - INFO - Pod ctest-pod-80146130 with uuid 6107d868-0d03-4184-a41b-6a6d30fd1bd6 found in kube manager 2025-01-04 19:34:22,895 - INFO - Pod ctest-pod-80146130 verification passed 2025-01-04 19:34:22,895 - INFO - ================================================================================ 2025-01-04 19:34:22,895 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-01-04 19:34:22,895 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-01-04 19:34:23,146 - DEBUG - Nothing to compare xmpp stats {'10.0.0.63': {'10.0.0.42': '0'}} with 2025-01-04 19:34:23,146 - INFO - Initial checks done. Running the testcase now 2025-01-04 19:34:23,146 - INFO - 2025-01-04 19:34:23,208 - DEBUG - [Pod ctest-pod-45664958] Cmd: echo ctest-pod-45664958 > /usr/share/nginx/html/index.html, Output: 2025-01-04 19:34:23,281 - DEBUG - [Pod ctest-pod-44354236] Cmd: echo ctest-pod-44354236 > /usr/share/nginx/html/index.html, Output: 2025-01-04 19:34:23,346 - DEBUG - [Pod ctest-pod-26351059] Cmd: echo ctest-pod-26351059 > /usr/share/nginx/html/index.html, Output: 2025-01-04 19:34:23,420 - DEBUG - [Pod ctest-pod-69497969] Cmd: echo ctest-pod-69497969 > /usr/share/nginx/html/index.html, Output: 2025-01-04 19:34:23,423 - DEBUG - Service ctest-nginx-svc-84781166 not present 2025-01-04 19:34:23,423 - INFO - Creating service ctest-nginx-svc-84781166 2025-01-04 19:34:23,449 - INFO - Created Service ctest-nginx-svc-84781166 2025-01-04 19:34:23,463 - WARNING - Service UUID 8eb32ec8-f58f-45c7-9817-cd3c4a5639eb not yet found in contrail-api 2025-01-04 19:34:24,471 - INFO - Validated that Service ctest-nginx-svc-84781166 is seen in contrail-api 2025-01-04 19:34:24,471 - DEBUG - Requesting: http://10.0.0.42:8108/Snh_LoadbalancerDatabaseList?x=8eb32ec8-f58f-45c7-9817-cd3c4a5639eb 2025-01-04 19:34:24,479 - INFO - Service ctest-nginx-svc-84781166 with uuid 8eb32ec8-f58f-45c7-9817-cd3c4a5639eb found in kube manager 2025-01-04 19:34:24,479 - INFO - Service ctest-nginx-svc-84781166 verification passed 2025-01-04 19:34:25,553 - DEBUG - [Pod ctest-pod-94383690] Cmd: wget http://10.103.116.53:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.116.53:80 (10.103.116.53:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-45664958 2025-01-04 19:34:25,553 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd wget http://10.103.116.53:80/ -O - -T 5 -t 1 passed 2025-01-04 19:34:25,553 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd output: Connecting to 10.103.116.53:80 (10.103.116.53:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-45664958 2025-01-04 19:34:25,617 - DEBUG - [Pod ctest-pod-94383690] Cmd: wget http://10.103.116.53:80/ -O - -T 5 -t 1 , Output: ctest-pod-44354236 Connecting to 10.103.116.53:80 (10.103.116.53:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-04 19:34:25,617 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd wget http://10.103.116.53:80/ -O - -T 5 -t 1 passed 2025-01-04 19:34:25,617 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd output: ctest-pod-44354236 Connecting to 10.103.116.53:80 (10.103.116.53:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-04 19:34:25,617 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-45664958': 1, 'ctest-pod-44354236': 1} 2025-01-04 19:34:25,685 - DEBUG - [Pod ctest-pod-84512617] Cmd: wget http://10.103.116.53:80/ -O - -T 5 -t 1 , Output: ctest-pod-44354236 Connecting to 10.103.116.53:80 (10.103.116.53:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-04 19:34:25,685 - DEBUG - [Pod Pod ctest-pod-84512617] Cmd wget http://10.103.116.53:80/ -O - -T 5 -t 1 passed 2025-01-04 19:34:25,685 - DEBUG - [Pod Pod ctest-pod-84512617] Cmd output: ctest-pod-44354236 Connecting to 10.103.116.53:80 (10.103.116.53:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-04 19:34:25,756 - DEBUG - [Pod ctest-pod-84512617] Cmd: wget http://10.103.116.53:80/ -O - -T 5 -t 1 , Output: ctest-pod-44354236 Connecting to 10.103.116.53:80 (10.103.116.53:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-04 19:34:25,756 - DEBUG - [Pod Pod ctest-pod-84512617] Cmd wget http://10.103.116.53:80/ -O - -T 5 -t 1 passed 2025-01-04 19:34:25,756 - DEBUG - [Pod Pod ctest-pod-84512617] Cmd output: ctest-pod-44354236 Connecting to 10.103.116.53:80 (10.103.116.53:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-04 19:34:25,805 - DEBUG - [Pod ctest-pod-84512617] Cmd: wget http://10.103.116.53:80/ -O - -T 5 -t 1 , Output: ctest-pod-45664958 Connecting to 10.103.116.53:80 (10.103.116.53:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-04 19:34:25,805 - DEBUG - [Pod Pod ctest-pod-84512617] Cmd wget http://10.103.116.53:80/ -O - -T 5 -t 1 passed 2025-01-04 19:34:25,805 - DEBUG - [Pod Pod ctest-pod-84512617] Cmd output: ctest-pod-45664958 Connecting to 10.103.116.53:80 (10.103.116.53:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-04 19:34:25,805 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-45664958': 1, 'ctest-pod-44354236': 2} 2025-01-04 19:34:25,811 - DEBUG - Network policy ingress-on-service not present 2025-01-04 19:34:25,812 - INFO - Creating Network Policy ingress-on-service 2025-01-04 19:34:25,826 - INFO - Network policy found in k8s 2025-01-04 19:34:25,826 - DEBUG - Requesting: http://10.0.0.42:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=661247c5-e73d-4aff-8db7-dac40755d233 2025-01-04 19:34:25,832 - INFO - Network Policy ingress-on-service with uuid 661247c5-e73d-4aff-8db7-dac40755d233 found in kube manager 2025-01-04 19:34:25,865 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-01-04 19:34:25,866 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-01-04 19:34:25,866 - DEBUG - Requesting: http://10.0.0.42:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=661247c5-e73d-4aff-8db7-dac40755d233 2025-01-04 19:34:25,902 - WARNING - Network policy with name ingress-on-service not found in agent 2025-01-04 19:34:27,903 - DEBUG - Requesting: http://10.0.0.42:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=661247c5-e73d-4aff-8db7-dac40755d233 2025-01-04 19:34:27,943 - INFO - Network policy with name ingress-on-service found in agent 2025-01-04 19:34:27,944 - INFO - Network Policy ingress-on-service verification passed 2025-01-04 19:34:32,994 - DEBUG - [Pod ctest-pod-94383690] Cmd: wget http://10.103.116.53:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:34:32,994 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd wget http://10.103.116.53:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:34:32,994 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:34:38,063 - DEBUG - [Pod ctest-pod-94383690] Cmd: wget http://10.103.116.53:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:34:38,063 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd wget http://10.103.116.53:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:34:38,063 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:34:43,122 - DEBUG - [Pod ctest-pod-94383690] Cmd: wget http://10.103.116.53:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:34:43,123 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd wget http://10.103.116.53:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:34:43,123 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:34:48,176 - DEBUG - [Pod ctest-pod-94383690] Cmd: wget http://10.103.116.53:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:34:48,176 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd wget http://10.103.116.53:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:34:48,176 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:34:53,236 - DEBUG - [Pod ctest-pod-94383690] Cmd: wget http://10.103.116.53:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:34:53,236 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd wget http://10.103.116.53:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:34:53,236 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:34:58,293 - DEBUG - [Pod ctest-pod-94383690] Cmd: wget http://10.103.116.53:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:34:58,293 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd wget http://10.103.116.53:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:34:58,294 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:35:03,343 - DEBUG - [Pod ctest-pod-94383690] Cmd: wget http://10.103.116.53:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:35:03,343 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd wget http://10.103.116.53:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:35:03,343 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:35:08,406 - DEBUG - [Pod ctest-pod-94383690] Cmd: wget http://10.103.116.53:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:35:08,406 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd wget http://10.103.116.53:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:35:08,406 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:35:13,466 - DEBUG - [Pod ctest-pod-94383690] Cmd: wget http://10.103.116.53:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:35:13,466 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd wget http://10.103.116.53:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:35:13,466 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:35:18,531 - DEBUG - [Pod ctest-pod-94383690] Cmd: wget http://10.103.116.53:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:35:18,531 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd wget http://10.103.116.53:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:35:18,531 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:35:18,531 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-45664958': 0, 'ctest-pod-44354236': 0} 2025-01-04 19:35:18,593 - DEBUG - [Pod ctest-pod-29104286] Cmd: wget http://10.103.116.53:80/ -O - -T 5 -t 1 , Output: ctest-pod-44354236 Connecting to 10.103.116.53:80 (10.103.116.53:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-04 19:35:18,593 - DEBUG - [Pod Pod ctest-pod-29104286] Cmd wget http://10.103.116.53:80/ -O - -T 5 -t 1 passed 2025-01-04 19:35:18,593 - DEBUG - [Pod Pod ctest-pod-29104286] Cmd output: ctest-pod-44354236 Connecting to 10.103.116.53:80 (10.103.116.53:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-04 19:35:18,658 - DEBUG - [Pod ctest-pod-29104286] Cmd: wget http://10.103.116.53:80/ -O - -T 5 -t 1 , Output: ctest-pod-45664958 Connecting to 10.103.116.53:80 (10.103.116.53:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-04 19:35:18,658 - DEBUG - [Pod Pod ctest-pod-29104286] Cmd wget http://10.103.116.53:80/ -O - -T 5 -t 1 passed 2025-01-04 19:35:18,658 - DEBUG - [Pod Pod ctest-pod-29104286] Cmd output: ctest-pod-45664958 Connecting to 10.103.116.53:80 (10.103.116.53:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-04 19:35:18,658 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-45664958': 1, 'ctest-pod-44354236': 1} 2025-01-04 19:35:23,721 - DEBUG - [Pod ctest-pod-84512617] Cmd: wget http://10.103.116.53:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:35:23,721 - DEBUG - [Pod Pod ctest-pod-84512617] Cmd wget http://10.103.116.53:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:35:23,721 - DEBUG - [Pod Pod ctest-pod-84512617] Cmd output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:35:28,794 - DEBUG - [Pod ctest-pod-84512617] Cmd: wget http://10.103.116.53:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:35:28,794 - DEBUG - [Pod Pod ctest-pod-84512617] Cmd wget http://10.103.116.53:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:35:28,794 - DEBUG - [Pod Pod ctest-pod-84512617] Cmd output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:35:33,860 - DEBUG - [Pod ctest-pod-84512617] Cmd: wget http://10.103.116.53:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:35:33,860 - DEBUG - [Pod Pod ctest-pod-84512617] Cmd wget http://10.103.116.53:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:35:33,860 - DEBUG - [Pod Pod ctest-pod-84512617] Cmd output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:35:38,938 - DEBUG - [Pod ctest-pod-84512617] Cmd: wget http://10.103.116.53:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:35:38,938 - DEBUG - [Pod Pod ctest-pod-84512617] Cmd wget http://10.103.116.53:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:35:38,938 - DEBUG - [Pod Pod ctest-pod-84512617] Cmd output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:35:44,009 - DEBUG - [Pod ctest-pod-84512617] Cmd: wget http://10.103.116.53:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:35:44,009 - DEBUG - [Pod Pod ctest-pod-84512617] Cmd wget http://10.103.116.53:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:35:44,009 - DEBUG - [Pod Pod ctest-pod-84512617] Cmd output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:35:49,102 - DEBUG - [Pod ctest-pod-84512617] Cmd: wget http://10.103.116.53:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:35:49,102 - DEBUG - [Pod Pod ctest-pod-84512617] Cmd wget http://10.103.116.53:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:35:49,102 - DEBUG - [Pod Pod ctest-pod-84512617] Cmd output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:35:54,158 - DEBUG - [Pod ctest-pod-84512617] Cmd: wget http://10.103.116.53:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:35:54,158 - DEBUG - [Pod Pod ctest-pod-84512617] Cmd wget http://10.103.116.53:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:35:54,158 - DEBUG - [Pod Pod ctest-pod-84512617] Cmd output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:35:59,226 - DEBUG - [Pod ctest-pod-84512617] Cmd: wget http://10.103.116.53:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:35:59,226 - DEBUG - [Pod Pod ctest-pod-84512617] Cmd wget http://10.103.116.53:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:35:59,226 - DEBUG - [Pod Pod ctest-pod-84512617] Cmd output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:36:04,292 - DEBUG - [Pod ctest-pod-84512617] Cmd: wget http://10.103.116.53:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:36:04,293 - DEBUG - [Pod Pod ctest-pod-84512617] Cmd wget http://10.103.116.53:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:36:04,293 - DEBUG - [Pod Pod ctest-pod-84512617] Cmd output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:36:09,359 - DEBUG - [Pod ctest-pod-84512617] Cmd: wget http://10.103.116.53:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:36:09,359 - DEBUG - [Pod Pod ctest-pod-84512617] Cmd wget http://10.103.116.53:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:36:09,359 - DEBUG - [Pod Pod ctest-pod-84512617] Cmd output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:36:09,359 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-45664958': 0, 'ctest-pod-44354236': 0} 2025-01-04 19:36:11,427 - DEBUG - [Pod ctest-pod-29104286] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.294 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.082 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.119 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.082/0.498/1.294 ms 2025-01-04 19:36:11,427 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-29104286 with expectation True passed 2025-01-04 19:36:13,486 - DEBUG - [Pod ctest-pod-94383690] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.286 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.076 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.118 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.076/0.493/1.286 ms 2025-01-04 19:36:13,486 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-94383690 with expectation True passed 2025-01-04 19:36:15,542 - DEBUG - [Pod ctest-pod-84512617] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.374 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.077 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.087 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.077/0.512/1.374 ms 2025-01-04 19:36:15,542 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-84512617 with expectation True passed 2025-01-04 19:36:15,617 - DEBUG - [Pod ctest-pod-29104286] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-04 19:36:15,617 - DEBUG - [Pod Pod ctest-pod-29104286] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-01-04 19:36:15,618 - DEBUG - [Pod Pod ctest-pod-29104286] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-04 19:36:15,618 - INFO - wget check of of http://10.47.255.251 from ctest-pod-29104286 passed 2025-01-04 19:36:15,684 - DEBUG - [Pod ctest-pod-29104286] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-04 19:36:15,684 - DEBUG - [Pod Pod ctest-pod-29104286] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-01-04 19:36:15,684 - DEBUG - [Pod Pod ctest-pod-29104286] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-04 19:36:15,684 - INFO - wget check of of http://10.47.255.250 from ctest-pod-29104286 passed 2025-01-04 19:36:20,746 - DEBUG - [Pod ctest-pod-94383690] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-04 19:36:20,746 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-04 19:36:20,746 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-04 19:36:20,746 - INFO - wget check of of http://10.47.255.250 from ctest-pod-94383690 passed 2025-01-04 19:36:25,814 - DEBUG - [Pod ctest-pod-80146130] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-01-04 19:36:25,814 - DEBUG - [Pod Pod ctest-pod-80146130] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-01-04 19:36:25,814 - DEBUG - [Pod Pod ctest-pod-80146130] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-01-04 19:36:25,814 - INFO - wget check of of http://10.47.255.251 from ctest-pod-80146130 passed 2025-01-04 19:36:25,823 - INFO - Updating Network Policy ingress-on-service 2025-01-04 19:36:30,906 - DEBUG - [Pod ctest-pod-94383690] Cmd: wget http://10.103.116.53:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:36:30,906 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd wget http://10.103.116.53:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:36:30,906 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:36:35,978 - DEBUG - [Pod ctest-pod-94383690] Cmd: wget http://10.103.116.53:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:36:35,979 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd wget http://10.103.116.53:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:36:35,979 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:36:41,059 - DEBUG - [Pod ctest-pod-94383690] Cmd: wget http://10.103.116.53:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:36:41,059 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd wget http://10.103.116.53:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:36:41,059 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:36:46,123 - DEBUG - [Pod ctest-pod-94383690] Cmd: wget http://10.103.116.53:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:36:46,123 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd wget http://10.103.116.53:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:36:46,123 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:36:51,190 - DEBUG - [Pod ctest-pod-94383690] Cmd: wget http://10.103.116.53:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:36:51,190 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd wget http://10.103.116.53:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:36:51,190 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:36:56,270 - DEBUG - [Pod ctest-pod-94383690] Cmd: wget http://10.103.116.53:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:36:56,271 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd wget http://10.103.116.53:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:36:56,271 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:37:01,335 - DEBUG - [Pod ctest-pod-94383690] Cmd: wget http://10.103.116.53:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:37:01,335 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd wget http://10.103.116.53:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:37:01,336 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:37:06,401 - DEBUG - [Pod ctest-pod-94383690] Cmd: wget http://10.103.116.53:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:37:06,401 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd wget http://10.103.116.53:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:37:06,401 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:37:11,471 - DEBUG - [Pod ctest-pod-94383690] Cmd: wget http://10.103.116.53:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:37:11,472 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd wget http://10.103.116.53:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:37:11,472 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:37:16,539 - DEBUG - [Pod ctest-pod-94383690] Cmd: wget http://10.103.116.53:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:37:16,539 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd wget http://10.103.116.53:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:37:16,539 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd output: Connecting to 10.103.116.53:80 (10.103.116.53:80) wget: download timed out 2025-01-04 19:37:16,539 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-45664958': 0, 'ctest-pod-44354236': 0} 2025-01-04 19:37:16,632 - DEBUG - [Pod ctest-pod-29104286] Cmd: wget http://10.103.116.53:80/ -O - -T 5 -t 1 , Output: ctest-pod-44354236 Connecting to 10.103.116.53:80 (10.103.116.53:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-04 19:37:16,632 - DEBUG - [Pod Pod ctest-pod-29104286] Cmd wget http://10.103.116.53:80/ -O - -T 5 -t 1 passed 2025-01-04 19:37:16,632 - DEBUG - [Pod Pod ctest-pod-29104286] Cmd output: ctest-pod-44354236 Connecting to 10.103.116.53:80 (10.103.116.53:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-04 19:37:16,708 - DEBUG - [Pod ctest-pod-29104286] Cmd: wget http://10.103.116.53:80/ -O - -T 5 -t 1 , Output: ctest-pod-44354236 Connecting to 10.103.116.53:80 (10.103.116.53:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-04 19:37:16,708 - DEBUG - [Pod Pod ctest-pod-29104286] Cmd wget http://10.103.116.53:80/ -O - -T 5 -t 1 passed 2025-01-04 19:37:16,708 - DEBUG - [Pod Pod ctest-pod-29104286] Cmd output: ctest-pod-44354236 Connecting to 10.103.116.53:80 (10.103.116.53:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-04 19:37:16,773 - DEBUG - [Pod ctest-pod-29104286] Cmd: wget http://10.103.116.53:80/ -O - -T 5 -t 1 , Output: ctest-pod-45664958 Connecting to 10.103.116.53:80 (10.103.116.53:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-04 19:37:16,773 - DEBUG - [Pod Pod ctest-pod-29104286] Cmd wget http://10.103.116.53:80/ -O - -T 5 -t 1 passed 2025-01-04 19:37:16,773 - DEBUG - [Pod Pod ctest-pod-29104286] Cmd output: ctest-pod-45664958 Connecting to 10.103.116.53:80 (10.103.116.53:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-04 19:37:16,773 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-45664958': 1, 'ctest-pod-44354236': 2} 2025-01-04 19:37:16,852 - DEBUG - [Pod ctest-pod-84512617] Cmd: wget http://10.103.116.53:80/ -O - -T 5 -t 1 , Output: ctest-pod-45664958 Connecting to 10.103.116.53:80 (10.103.116.53:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-04 19:37:16,852 - DEBUG - [Pod Pod ctest-pod-84512617] Cmd wget http://10.103.116.53:80/ -O - -T 5 -t 1 passed 2025-01-04 19:37:16,852 - DEBUG - [Pod Pod ctest-pod-84512617] Cmd output: ctest-pod-45664958 Connecting to 10.103.116.53:80 (10.103.116.53:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-04 19:37:16,937 - DEBUG - [Pod ctest-pod-84512617] Cmd: wget http://10.103.116.53:80/ -O - -T 5 -t 1 , Output: ctest-pod-44354236 Connecting to 10.103.116.53:80 (10.103.116.53:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-04 19:37:16,937 - DEBUG - [Pod Pod ctest-pod-84512617] Cmd wget http://10.103.116.53:80/ -O - -T 5 -t 1 passed 2025-01-04 19:37:16,937 - DEBUG - [Pod Pod ctest-pod-84512617] Cmd output: ctest-pod-44354236 Connecting to 10.103.116.53:80 (10.103.116.53:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-01-04 19:37:16,937 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-45664958': 1, 'ctest-pod-44354236': 1} 2025-01-04 19:37:19,004 - DEBUG - [Pod ctest-pod-29104286] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.164 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.085 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.113 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.085/0.454/1.164 ms 2025-01-04 19:37:19,004 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-29104286 with expectation True passed 2025-01-04 19:37:21,091 - DEBUG - [Pod ctest-pod-94383690] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.395 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.109 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.404 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.109/0.302/0.404 ms 2025-01-04 19:37:21,091 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-94383690 with expectation True passed 2025-01-04 19:37:23,154 - DEBUG - [Pod ctest-pod-84512617] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.633 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.077 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.105 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.077/0.605/1.633 ms 2025-01-04 19:37:23,154 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-84512617 with expectation True passed 2025-01-04 19:37:23,225 - DEBUG - [Pod ctest-pod-29104286] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-04 19:37:23,225 - DEBUG - [Pod Pod ctest-pod-29104286] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-01-04 19:37:23,225 - DEBUG - [Pod Pod ctest-pod-29104286] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-04 19:37:23,225 - INFO - wget check of of http://10.47.255.251 from ctest-pod-29104286 passed 2025-01-04 19:37:23,304 - DEBUG - [Pod ctest-pod-29104286] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-04 19:37:23,304 - DEBUG - [Pod Pod ctest-pod-29104286] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-01-04 19:37:23,304 - DEBUG - [Pod Pod ctest-pod-29104286] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-04 19:37:23,304 - INFO - wget check of of http://10.47.255.250 from ctest-pod-29104286 passed 2025-01-04 19:37:28,377 - DEBUG - [Pod ctest-pod-94383690] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-04 19:37:28,377 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-04 19:37:28,377 - DEBUG - [Pod Pod ctest-pod-94383690] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-01-04 19:37:28,377 - INFO - wget check of of http://10.47.255.250 from ctest-pod-94383690 passed 2025-01-04 19:37:28,428 - DEBUG - [Pod ctest-pod-80146130] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-04 19:37:28,428 - DEBUG - [Pod Pod ctest-pod-80146130] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-01-04 19:37:28,428 - DEBUG - [Pod Pod ctest-pod-80146130] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-01-04 19:37:28,428 - INFO - wget check of of http://10.47.255.251 from ctest-pod-80146130 passed 2025-01-04 19:37:28,428 - INFO - Deleting Network Policy : ingress-on-service 2025-01-04 19:37:28,428 - INFO - Deleting service : ctest-nginx-svc-84781166 2025-01-04 19:37:28,667 - DEBUG - No XMPP flaps were noticed during the test 2025-01-04 19:37:28,667 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:06] 2025-01-04 19:37:28,667 - INFO - -------------------------------------------------------------------------------- 2025-01-04 19:37:28,673 - INFO - Deleting pod ctest-new-default-48739887:ctest-pod-45664958 2025-01-04 19:37:28,673 - INFO - Deleting pod ctest-new-default-48739887:ctest-pod-44354236 2025-01-04 19:37:28,674 - INFO - Deleting pod ctest-non-default-06755108:ctest-pod-26351059 2025-01-04 19:37:28,674 - INFO - Deleting pod ctest-non-default-06755108:ctest-pod-69497969 2025-01-04 19:37:28,674 - INFO - Deleting pod ctest-new-default-48739887:ctest-pod-94383690 2025-01-04 19:37:28,674 - INFO - Deleting pod ctest-new-default-48739887:ctest-pod-29104286 2025-01-04 19:37:28,675 - INFO - Deleting pod ctest-non-default-06755108:ctest-pod-84512617 2025-01-04 19:37:28,675 - INFO - Deleting pod ctest-non-default-06755108:ctest-pod-80146130 2025-01-04 19:37:28,707 - WARNING - Pod uuid ab7f2aa7-46cb-468a-8669-c8069c58e46f is still seen in agent 10.0.0.63 VM list 2025-01-04 19:37:28,745 - WARNING - Pod uuid 87dd419c-b40e-48fe-aba9-53a993abe523 is still seen in agent 10.0.0.63 VM list 2025-01-04 19:37:28,801 - WARNING - Pod uuid 8fedc2ce-0b77-4f9e-a24f-fe4c489e6610 is still seen in agent 10.0.0.63 VM list 2025-01-04 19:37:28,803 - WARNING - Pod uuid 6107d868-0d03-4184-a41b-6a6d30fd1bd6 is still seen in agent 10.0.0.63 VM list 2025-01-04 19:37:28,803 - WARNING - Pod uuid c67ebb31-c266-443e-be0b-e6197b3db456 is still seen in agent 10.0.0.63 VM list 2025-01-04 19:37:28,803 - WARNING - Pod uuid 9a2aaa88-2c9a-457b-a98b-c3d952cf8669 is still seen in agent 10.0.0.63 VM list 2025-01-04 19:37:28,804 - WARNING - Pod uuid 71924468-347a-4452-8fa2-23f6d6be1204 is still seen in agent 10.0.0.63 VM list 2025-01-04 19:37:28,804 - WARNING - Pod uuid f0846a85-a6a3-48a5-be8a-757efaa01b66 is still seen in agent 10.0.0.63 VM list 2025-01-04 19:37:33,716 - DEBUG - Pod ab7f2aa7-46cb-468a-8669-c8069c58e46f is not in agent 10.0.0.63 VM list 2025-01-04 19:37:33,723 - DEBUG - VMI daac8af0-cad2-11ef-8ef4-fa163ef2afd4 is removed from agent 10.0.0.63 2025-01-04 19:37:33,724 - INFO - Verified that pod ctest-pod-45664958 is removed in agent 2025-01-04 19:37:33,754 - WARNING - Pod uuid 87dd419c-b40e-48fe-aba9-53a993abe523 is still seen in agent 10.0.0.63 VM list 2025-01-04 19:37:33,828 - WARNING - Pod uuid c67ebb31-c266-443e-be0b-e6197b3db456 is still seen in agent 10.0.0.63 VM list 2025-01-04 19:37:33,831 - DEBUG - Pod 9a2aaa88-2c9a-457b-a98b-c3d952cf8669 is not in agent 10.0.0.63 VM list 2025-01-04 19:37:33,832 - DEBUG - Pod 71924468-347a-4452-8fa2-23f6d6be1204 is not in agent 10.0.0.63 VM list 2025-01-04 19:37:33,834 - WARNING - Pod uuid f0846a85-a6a3-48a5-be8a-757efaa01b66 is still seen in agent 10.0.0.63 VM list 2025-01-04 19:37:33,834 - WARNING - Pod uuid 6107d868-0d03-4184-a41b-6a6d30fd1bd6 is still seen in agent 10.0.0.63 VM list 2025-01-04 19:37:33,834 - DEBUG - Pod 8fedc2ce-0b77-4f9e-a24f-fe4c489e6610 is not in agent 10.0.0.63 VM list 2025-01-04 19:37:33,847 - DEBUG - VMI db2c59ba-cad2-11ef-8ef4-fa163ef2afd4 is removed from agent 10.0.0.63 2025-01-04 19:37:33,847 - INFO - Verified that pod ctest-pod-44354236 is removed in agent 2025-01-04 19:37:33,848 - DEBUG - VMI dc75699c-cad2-11ef-8ef4-fa163ef2afd4 is removed from agent 10.0.0.63 2025-01-04 19:37:33,848 - INFO - Verified that pod ctest-pod-69497969 is removed in agent 2025-01-04 19:37:33,849 - DEBUG - VMI dbf383dc-cad2-11ef-8ef4-fa163ef2afd4 is removed from agent 10.0.0.63 2025-01-04 19:37:33,849 - INFO - Verified that pod ctest-pod-26351059 is removed in agent 2025-01-04 19:37:38,764 - WARNING - Pod uuid 87dd419c-b40e-48fe-aba9-53a993abe523 is still seen in agent 10.0.0.63 VM list 2025-01-04 19:37:38,838 - WARNING - Pod uuid c67ebb31-c266-443e-be0b-e6197b3db456 is still seen in agent 10.0.0.63 VM list 2025-01-04 19:37:38,847 - WARNING - Pod uuid 6107d868-0d03-4184-a41b-6a6d30fd1bd6 is still seen in agent 10.0.0.63 VM list 2025-01-04 19:37:38,848 - WARNING - Pod uuid f0846a85-a6a3-48a5-be8a-757efaa01b66 is still seen in agent 10.0.0.63 VM list 2025-01-04 19:37:43,773 - WARNING - Pod uuid 87dd419c-b40e-48fe-aba9-53a993abe523 is still seen in agent 10.0.0.63 VM list 2025-01-04 19:37:43,848 - WARNING - Pod uuid c67ebb31-c266-443e-be0b-e6197b3db456 is still seen in agent 10.0.0.63 VM list 2025-01-04 19:37:43,860 - WARNING - Pod uuid f0846a85-a6a3-48a5-be8a-757efaa01b66 is still seen in agent 10.0.0.63 VM list 2025-01-04 19:37:43,861 - WARNING - Pod uuid 6107d868-0d03-4184-a41b-6a6d30fd1bd6 is still seen in agent 10.0.0.63 VM list 2025-01-04 19:37:48,781 - WARNING - Pod uuid 87dd419c-b40e-48fe-aba9-53a993abe523 is still seen in agent 10.0.0.63 VM list 2025-01-04 19:37:48,856 - WARNING - Pod uuid c67ebb31-c266-443e-be0b-e6197b3db456 is still seen in agent 10.0.0.63 VM list 2025-01-04 19:37:48,871 - WARNING - Pod uuid 6107d868-0d03-4184-a41b-6a6d30fd1bd6 is still seen in agent 10.0.0.63 VM list 2025-01-04 19:37:48,872 - WARNING - Pod uuid f0846a85-a6a3-48a5-be8a-757efaa01b66 is still seen in agent 10.0.0.63 VM list 2025-01-04 19:37:53,789 - WARNING - Pod uuid 87dd419c-b40e-48fe-aba9-53a993abe523 is still seen in agent 10.0.0.63 VM list 2025-01-04 19:37:53,865 - WARNING - Pod uuid c67ebb31-c266-443e-be0b-e6197b3db456 is still seen in agent 10.0.0.63 VM list 2025-01-04 19:37:53,886 - WARNING - Pod uuid f0846a85-a6a3-48a5-be8a-757efaa01b66 is still seen in agent 10.0.0.63 VM list 2025-01-04 19:37:53,888 - WARNING - Pod uuid 6107d868-0d03-4184-a41b-6a6d30fd1bd6 is still seen in agent 10.0.0.63 VM list 2025-01-04 19:37:58,801 - WARNING - Pod uuid 87dd419c-b40e-48fe-aba9-53a993abe523 is still seen in agent 10.0.0.63 VM list 2025-01-04 19:37:58,874 - WARNING - Pod uuid c67ebb31-c266-443e-be0b-e6197b3db456 is still seen in agent 10.0.0.63 VM list 2025-01-04 19:37:58,899 - WARNING - Pod uuid f0846a85-a6a3-48a5-be8a-757efaa01b66 is still seen in agent 10.0.0.63 VM list 2025-01-04 19:37:58,900 - WARNING - Pod uuid 6107d868-0d03-4184-a41b-6a6d30fd1bd6 is still seen in agent 10.0.0.63 VM list 2025-01-04 19:38:03,812 - DEBUG - Pod 87dd419c-b40e-48fe-aba9-53a993abe523 is not in agent 10.0.0.63 VM list 2025-01-04 19:38:03,819 - DEBUG - VMI dded1504-cad2-11ef-8ef4-fa163ef2afd4 is removed from agent 10.0.0.63 2025-01-04 19:38:03,819 - INFO - Verified that pod ctest-pod-84512617 is removed in agent 2025-01-04 19:38:03,883 - DEBUG - Pod c67ebb31-c266-443e-be0b-e6197b3db456 is not in agent 10.0.0.63 VM list 2025-01-04 19:38:03,890 - DEBUG - VMI dcfb7b4a-cad2-11ef-8ef4-fa163ef2afd4 is removed from agent 10.0.0.63 2025-01-04 19:38:03,890 - INFO - Verified that pod ctest-pod-94383690 is removed in agent 2025-01-04 19:38:03,912 - DEBUG - Pod f0846a85-a6a3-48a5-be8a-757efaa01b66 is not in agent 10.0.0.63 VM list 2025-01-04 19:38:03,914 - DEBUG - Pod 6107d868-0d03-4184-a41b-6a6d30fd1bd6 is not in agent 10.0.0.63 VM list 2025-01-04 19:38:03,923 - DEBUG - VMI de5ff4de-cad2-11ef-8ef4-fa163ef2afd4 is removed from agent 10.0.0.63 2025-01-04 19:38:03,923 - INFO - Verified that pod ctest-pod-80146130 is removed in agent 2025-01-04 19:38:03,924 - DEBUG - VMI dd761f08-cad2-11ef-8ef4-fa163ef2afd4 is removed from agent 10.0.0.63 2025-01-04 19:38:03,924 - INFO - Verified that pod ctest-pod-29104286 is removed in agent 2025-01-04 19:38:03,924 - INFO - Deleting namespace ctest-non-default-06755108 2025-01-04 19:38:03,941 - DEBUG - Namespace ctest-non-default-06755108 still in k8s 2025-01-04 19:38:05,946 - DEBUG - Namespace ctest-non-default-06755108 still in k8s 2025-01-04 19:38:07,951 - DEBUG - Namespace ctest-non-default-06755108 still in k8s 2025-01-04 19:38:09,955 - DEBUG - Namespace ctest-non-default-06755108 is not in k8s 2025-01-04 19:38:09,955 - DEBUG - No need to check project deletion in contrail-api 2025-01-04 19:38:09,955 - INFO - Deleting namespace ctest-new-default-48739887 2025-01-04 19:38:09,964 - DEBUG - Namespace ctest-new-default-48739887 still in k8s 2025-01-04 19:38:11,968 - DEBUG - Namespace ctest-new-default-48739887 still in k8s 2025-01-04 19:38:13,973 - DEBUG - Namespace ctest-new-default-48739887 still in k8s 2025-01-04 19:38:15,977 - DEBUG - Namespace ctest-new-default-48739887 is not in k8s 2025-01-04 19:38:15,977 - DEBUG - No need to check project deletion in contrail-api