2024-10-21 02:08:47,700 - INFO - Using existing project ['default-domain', 'k8s-default'](3f596d85-9087-4b0c-ad18-7153df704213) 2024-10-21 02:08:47,719 - DEBUG - Namespace ctest-new-default-06562415 not present 2024-10-21 02:08:47,728 - INFO - Created namespace ctest-new-default-06562415 2024-10-21 02:08:50,734 - DEBUG - Namespace ctest-non-default-24322941 not present 2024-10-21 02:08:50,746 - INFO - Created namespace ctest-non-default-24322941 2024-10-21 02:08:53,764 - DEBUG - Pod ctest-pod-35811258 not present 2024-10-21 02:08:53,764 - INFO - Creating Pod ctest-pod-35811258 2024-10-21 02:08:53,809 - DEBUG - Pod : ctest-pod-35811258 UUID is 9674ffe5-c65a-48ed-baf2-e93de6628237 2024-10-21 02:08:53,812 - DEBUG - Pod ctest-pod-05303066 not present 2024-10-21 02:08:53,812 - INFO - Creating Pod ctest-pod-05303066 2024-10-21 02:08:53,834 - DEBUG - Pod : ctest-pod-05303066 UUID is 36772b7e-48b6-4c49-bbb4-daa3b94f016d 2024-10-21 02:08:53,837 - DEBUG - Pod ctest-pod-76903646 not present 2024-10-21 02:08:53,837 - INFO - Creating Pod ctest-pod-76903646 2024-10-21 02:08:53,865 - DEBUG - Pod : ctest-pod-76903646 UUID is 48c578b3-99fb-407c-a469-e4a3268f3fa9 2024-10-21 02:08:53,869 - DEBUG - Pod ctest-pod-40376510 not present 2024-10-21 02:08:53,869 - INFO - Creating Pod ctest-pod-40376510 2024-10-21 02:08:53,897 - DEBUG - Pod : ctest-pod-40376510 UUID is 76d65ad1-98ab-4776-a567-2de5ad815df8 2024-10-21 02:08:53,900 - DEBUG - Pod ctest-pod-79096419 not present 2024-10-21 02:08:53,900 - INFO - Creating Pod ctest-pod-79096419 2024-10-21 02:08:53,917 - DEBUG - Pod : ctest-pod-79096419 UUID is 44a79a40-2900-4a78-a733-a4de94b83ba1 2024-10-21 02:08:53,919 - DEBUG - Pod ctest-pod-43216322 not present 2024-10-21 02:08:53,919 - INFO - Creating Pod ctest-pod-43216322 2024-10-21 02:08:53,936 - DEBUG - Pod : ctest-pod-43216322 UUID is 1802889a-28a3-46e7-adbc-01dd74230624 2024-10-21 02:08:53,938 - DEBUG - Pod ctest-pod-23487214 not present 2024-10-21 02:08:53,938 - INFO - Creating Pod ctest-pod-23487214 2024-10-21 02:08:53,957 - DEBUG - Pod : ctest-pod-23487214 UUID is 84c389cb-40e1-4755-9088-ee9d37c92553 2024-10-21 02:08:53,959 - DEBUG - Pod ctest-pod-51224678 not present 2024-10-21 02:08:53,960 - INFO - Creating Pod ctest-pod-51224678 2024-10-21 02:08:53,976 - DEBUG - Pod : ctest-pod-51224678 UUID is 7c8741ad-9049-474c-94b0-a4249a94f9cb 2024-10-21 02:08:54,158 - INFO - Project default-domain:k8s-ctest-new-default-06562415 for Namespace ctest-new-default-06562415 is seen in contrail-api 2024-10-21 02:08:54,158 - DEBUG - Project uuid in Contrail is 169e17b5-5fcc-4a21-b063-4799456aafd9 2024-10-21 02:08:54,282 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NamespaceDatabaseList?namespace_uuid=b7191a44-059b-44bb-8a89-272aecb19ee5 2024-10-21 02:08:54,293 - INFO - Namespace ctest-new-default-06562415 with uuid b7191a44-059b-44bb-8a89-272aecb19ee5 found in kube manager 2024-10-21 02:08:54,294 - INFO - Namespace ctest-new-default-06562415 verification passed 2024-10-21 02:08:54,532 - INFO - Project default-domain:k8s-ctest-non-default-24322941 for Namespace ctest-non-default-24322941 is seen in contrail-api 2024-10-21 02:08:54,532 - DEBUG - Project uuid in Contrail is 5c975b9e-49c4-433a-a8c2-6da98d2504e3 2024-10-21 02:08:54,532 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NamespaceDatabaseList?namespace_uuid=c56b6bef-cbb8-4ae5-b433-501be0cb048d 2024-10-21 02:08:54,536 - INFO - Namespace ctest-non-default-24322941 with uuid c56b6bef-cbb8-4ae5-b433-501be0cb048d found in kube manager 2024-10-21 02:08:54,536 - INFO - Namespace ctest-non-default-24322941 verification passed 2024-10-21 02:08:54,541 - DEBUG - Pod ctest-pod-35811258 not in running state.Currently in Pending 2024-10-21 02:08:59,547 - DEBUG - Pod ctest-pod-35811258 not in running state.Currently in Pending 2024-10-21 02:09:04,554 - INFO - Pod ctest-pod-35811258 is in running state.Got IP 10.47.255.251 2024-10-21 02:09:04,575 - DEBUG - Pod ctest-pod-35811258 has vmi 6d116766-8f51-11ef-a2d3-fa163ed25c24 2024-10-21 02:09:04,575 - INFO - Verified pod ctest-pod-35811258 in contrail-api 2024-10-21 02:09:04,589 - DEBUG - VMI 6d116766-8f51-11ef-a2d3-fa163ed25c24 is active in agent 10.0.0.12 2024-10-21 02:09:04,590 - INFO - Verified Pod ctest-pod-35811258 in agent 10.0.0.12 2024-10-21 02:09:04,590 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=9674ffe5-c65a-48ed-baf2-e93de6628237 2024-10-21 02:09:04,594 - INFO - Pod ctest-pod-35811258 with uuid 9674ffe5-c65a-48ed-baf2-e93de6628237 found in kube manager 2024-10-21 02:09:04,594 - INFO - Pod ctest-pod-35811258 verification passed 2024-10-21 02:09:04,599 - DEBUG - Pod ctest-pod-05303066 not in running state.Currently in Pending 2024-10-21 02:09:09,605 - INFO - Pod ctest-pod-05303066 is in running state.Got IP 10.47.255.250 2024-10-21 02:09:09,626 - DEBUG - Pod ctest-pod-05303066 has vmi 6d9737c4-8f51-11ef-a2d3-fa163ed25c24 2024-10-21 02:09:09,626 - INFO - Verified pod ctest-pod-05303066 in contrail-api 2024-10-21 02:09:09,643 - DEBUG - VMI 6d9737c4-8f51-11ef-a2d3-fa163ed25c24 is active in agent 10.0.0.12 2024-10-21 02:09:09,644 - INFO - Verified Pod ctest-pod-05303066 in agent 10.0.0.12 2024-10-21 02:09:09,644 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=36772b7e-48b6-4c49-bbb4-daa3b94f016d 2024-10-21 02:09:09,650 - INFO - Pod ctest-pod-05303066 with uuid 36772b7e-48b6-4c49-bbb4-daa3b94f016d found in kube manager 2024-10-21 02:09:09,655 - INFO - Pod ctest-pod-05303066 verification passed 2024-10-21 02:09:09,661 - INFO - Pod ctest-pod-76903646 is in running state.Got IP 10.47.255.249 2024-10-21 02:09:09,724 - DEBUG - Pod ctest-pod-76903646 has vmi 6e4a2b9a-8f51-11ef-a2d3-fa163ed25c24 2024-10-21 02:09:09,725 - INFO - Verified pod ctest-pod-76903646 in contrail-api 2024-10-21 02:09:09,743 - DEBUG - VMI 6e4a2b9a-8f51-11ef-a2d3-fa163ed25c24 is active in agent 10.0.0.12 2024-10-21 02:09:09,743 - INFO - Verified Pod ctest-pod-76903646 in agent 10.0.0.12 2024-10-21 02:09:09,743 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=48c578b3-99fb-407c-a469-e4a3268f3fa9 2024-10-21 02:09:09,750 - INFO - Pod ctest-pod-76903646 with uuid 48c578b3-99fb-407c-a469-e4a3268f3fa9 found in kube manager 2024-10-21 02:09:09,750 - INFO - Pod ctest-pod-76903646 verification passed 2024-10-21 02:09:09,756 - INFO - Pod ctest-pod-40376510 is in running state.Got IP 10.47.255.248 2024-10-21 02:09:09,820 - DEBUG - Pod ctest-pod-40376510 has vmi 6ecc933c-8f51-11ef-a2d3-fa163ed25c24 2024-10-21 02:09:09,820 - INFO - Verified pod ctest-pod-40376510 in contrail-api 2024-10-21 02:09:09,835 - DEBUG - VMI 6ecc933c-8f51-11ef-a2d3-fa163ed25c24 is active in agent 10.0.0.12 2024-10-21 02:09:09,836 - INFO - Verified Pod ctest-pod-40376510 in agent 10.0.0.12 2024-10-21 02:09:09,836 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=76d65ad1-98ab-4776-a567-2de5ad815df8 2024-10-21 02:09:09,841 - INFO - Pod ctest-pod-40376510 with uuid 76d65ad1-98ab-4776-a567-2de5ad815df8 found in kube manager 2024-10-21 02:09:09,841 - INFO - Pod ctest-pod-40376510 verification passed 2024-10-21 02:09:09,847 - INFO - Pod ctest-pod-79096419 is in running state.Got IP 10.47.255.247 2024-10-21 02:09:09,867 - DEBUG - Pod ctest-pod-79096419 has vmi 6f6ecbfc-8f51-11ef-a2d3-fa163ed25c24 2024-10-21 02:09:09,867 - INFO - Verified pod ctest-pod-79096419 in contrail-api 2024-10-21 02:09:09,884 - DEBUG - VMI 6f6ecbfc-8f51-11ef-a2d3-fa163ed25c24 is active in agent 10.0.0.12 2024-10-21 02:09:09,885 - INFO - Verified Pod ctest-pod-79096419 in agent 10.0.0.12 2024-10-21 02:09:09,885 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=44a79a40-2900-4a78-a733-a4de94b83ba1 2024-10-21 02:09:09,890 - INFO - Pod ctest-pod-79096419 with uuid 44a79a40-2900-4a78-a733-a4de94b83ba1 found in kube manager 2024-10-21 02:09:09,890 - INFO - Pod ctest-pod-79096419 verification passed 2024-10-21 02:09:09,895 - DEBUG - Pod ctest-pod-23487214 not in running state.Currently in Pending 2024-10-21 02:09:14,903 - INFO - Pod ctest-pod-23487214 is in running state.Got IP 10.47.255.245 2024-10-21 02:09:14,964 - DEBUG - Pod ctest-pod-23487214 has vmi 707b296e-8f51-11ef-a2d3-fa163ed25c24 2024-10-21 02:09:14,964 - INFO - Verified pod ctest-pod-23487214 in contrail-api 2024-10-21 02:09:14,982 - DEBUG - VMI 707b296e-8f51-11ef-a2d3-fa163ed25c24 is active in agent 10.0.0.12 2024-10-21 02:09:14,983 - INFO - Verified Pod ctest-pod-23487214 in agent 10.0.0.12 2024-10-21 02:09:14,983 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=84c389cb-40e1-4755-9088-ee9d37c92553 2024-10-21 02:09:14,988 - INFO - Pod ctest-pod-23487214 with uuid 84c389cb-40e1-4755-9088-ee9d37c92553 found in kube manager 2024-10-21 02:09:14,988 - INFO - Pod ctest-pod-23487214 verification passed 2024-10-21 02:09:14,993 - INFO - Pod ctest-pod-43216322 is in running state.Got IP 10.47.255.246 2024-10-21 02:09:15,016 - DEBUG - Pod ctest-pod-43216322 has vmi 6ff6ab12-8f51-11ef-a2d3-fa163ed25c24 2024-10-21 02:09:15,016 - INFO - Verified pod ctest-pod-43216322 in contrail-api 2024-10-21 02:09:15,031 - DEBUG - VMI 6ff6ab12-8f51-11ef-a2d3-fa163ed25c24 is active in agent 10.0.0.12 2024-10-21 02:09:15,031 - INFO - Verified Pod ctest-pod-43216322 in agent 10.0.0.12 2024-10-21 02:09:15,031 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=1802889a-28a3-46e7-adbc-01dd74230624 2024-10-21 02:09:15,036 - INFO - Pod ctest-pod-43216322 with uuid 1802889a-28a3-46e7-adbc-01dd74230624 found in kube manager 2024-10-21 02:09:15,036 - INFO - Pod ctest-pod-43216322 verification passed 2024-10-21 02:09:15,042 - INFO - Pod ctest-pod-51224678 is in running state.Got IP 10.47.255.244 2024-10-21 02:09:15,106 - DEBUG - Pod ctest-pod-51224678 has vmi 70fbadd2-8f51-11ef-a2d3-fa163ed25c24 2024-10-21 02:09:15,106 - INFO - Verified pod ctest-pod-51224678 in contrail-api 2024-10-21 02:09:15,120 - DEBUG - VMI 70fbadd2-8f51-11ef-a2d3-fa163ed25c24 is active in agent 10.0.0.12 2024-10-21 02:09:15,121 - INFO - Verified Pod ctest-pod-51224678 in agent 10.0.0.12 2024-10-21 02:09:15,121 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_VirtualMachineDatabaseList?x=7c8741ad-9049-474c-94b0-a4249a94f9cb 2024-10-21 02:09:15,126 - INFO - Pod ctest-pod-51224678 with uuid 7c8741ad-9049-474c-94b0-a4249a94f9cb found in kube manager 2024-10-21 02:09:15,126 - INFO - Pod ctest-pod-51224678 verification passed 2024-10-21 02:09:15,126 - INFO - ================================================================================ 2024-10-21 02:09:15,126 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-10-21 02:09:15,126 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-10-21 02:09:15,337 - DEBUG - Nothing to compare xmpp stats {'10.0.0.12': {'10.0.0.24': '0'}} with 2024-10-21 02:09:15,337 - INFO - Initial checks done. Running the testcase now 2024-10-21 02:09:15,338 - INFO - 2024-10-21 02:09:15,416 - DEBUG - [Pod ctest-pod-35811258] Cmd: echo ctest-pod-35811258 > /usr/share/nginx/html/index.html, Output: 2024-10-21 02:09:15,489 - DEBUG - [Pod ctest-pod-05303066] Cmd: echo ctest-pod-05303066 > /usr/share/nginx/html/index.html, Output: 2024-10-21 02:09:15,561 - DEBUG - [Pod ctest-pod-76903646] Cmd: echo ctest-pod-76903646 > /usr/share/nginx/html/index.html, Output: 2024-10-21 02:09:15,643 - DEBUG - [Pod ctest-pod-40376510] Cmd: echo ctest-pod-40376510 > /usr/share/nginx/html/index.html, Output: 2024-10-21 02:09:15,646 - DEBUG - Service ctest-nginx-svc-53817607 not present 2024-10-21 02:09:15,646 - INFO - Creating service ctest-nginx-svc-53817607 2024-10-21 02:09:15,662 - INFO - Created Service ctest-nginx-svc-53817607 2024-10-21 02:09:15,675 - WARNING - Service UUID 4c694923-1d70-4419-8075-f3e21404a561 not yet found in contrail-api 2024-10-21 02:09:16,687 - INFO - Validated that Service ctest-nginx-svc-53817607 is seen in contrail-api 2024-10-21 02:09:16,687 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_LoadbalancerDatabaseList?x=4c694923-1d70-4419-8075-f3e21404a561 2024-10-21 02:09:16,691 - INFO - Service ctest-nginx-svc-53817607 with uuid 4c694923-1d70-4419-8075-f3e21404a561 found in kube manager 2024-10-21 02:09:16,691 - INFO - Service ctest-nginx-svc-53817607 verification passed 2024-10-21 02:09:17,776 - DEBUG - [Pod ctest-pod-79096419] Cmd: wget http://10.105.204.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.204.105:80 (10.105.204.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-05303066 2024-10-21 02:09:17,776 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd wget http://10.105.204.105:80/ -O - -T 5 -t 1 passed 2024-10-21 02:09:17,776 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd output: Connecting to 10.105.204.105:80 (10.105.204.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-05303066 2024-10-21 02:09:17,843 - DEBUG - [Pod ctest-pod-79096419] Cmd: wget http://10.105.204.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.204.105:80 (10.105.204.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-35811258 2024-10-21 02:09:17,843 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd wget http://10.105.204.105:80/ -O - -T 5 -t 1 passed 2024-10-21 02:09:17,843 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd output: Connecting to 10.105.204.105:80 (10.105.204.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-35811258 2024-10-21 02:09:17,843 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-35811258': 1, 'ctest-pod-05303066': 1} 2024-10-21 02:09:17,910 - DEBUG - [Pod ctest-pod-23487214] Cmd: wget http://10.105.204.105:80/ -O - -T 5 -t 1 , Output: ctest-pod-05303066 Connecting to 10.105.204.105:80 (10.105.204.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-21 02:09:17,910 - DEBUG - [Pod Pod ctest-pod-23487214] Cmd wget http://10.105.204.105:80/ -O - -T 5 -t 1 passed 2024-10-21 02:09:17,910 - DEBUG - [Pod Pod ctest-pod-23487214] Cmd output: ctest-pod-05303066 Connecting to 10.105.204.105:80 (10.105.204.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-21 02:09:17,980 - DEBUG - [Pod ctest-pod-23487214] Cmd: wget http://10.105.204.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.204.105:80 (10.105.204.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-05303066 2024-10-21 02:09:17,980 - DEBUG - [Pod Pod ctest-pod-23487214] Cmd wget http://10.105.204.105:80/ -O - -T 5 -t 1 passed 2024-10-21 02:09:17,980 - DEBUG - [Pod Pod ctest-pod-23487214] Cmd output: Connecting to 10.105.204.105:80 (10.105.204.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-05303066 2024-10-21 02:09:18,037 - DEBUG - [Pod ctest-pod-23487214] Cmd: wget http://10.105.204.105:80/ -O - -T 5 -t 1 , Output: ctest-pod-35811258 Connecting to 10.105.204.105:80 (10.105.204.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-21 02:09:18,037 - DEBUG - [Pod Pod ctest-pod-23487214] Cmd wget http://10.105.204.105:80/ -O - -T 5 -t 1 passed 2024-10-21 02:09:18,037 - DEBUG - [Pod Pod ctest-pod-23487214] Cmd output: ctest-pod-35811258 Connecting to 10.105.204.105:80 (10.105.204.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-21 02:09:18,037 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-35811258': 1, 'ctest-pod-05303066': 2} 2024-10-21 02:09:18,040 - DEBUG - Network policy ingress-on-service not present 2024-10-21 02:09:18,041 - INFO - Creating Network Policy ingress-on-service 2024-10-21 02:09:18,052 - INFO - Network policy found in k8s 2024-10-21 02:09:18,052 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=b6d08ef8-bdcb-4513-8c3a-d7b9d36eec2c 2024-10-21 02:09:18,062 - INFO - Network Policy ingress-on-service with uuid b6d08ef8-bdcb-4513-8c3a-d7b9d36eec2c found in kube manager 2024-10-21 02:09:18,105 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-10-21 02:09:18,106 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-10-21 02:09:18,106 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=b6d08ef8-bdcb-4513-8c3a-d7b9d36eec2c 2024-10-21 02:09:18,139 - WARNING - Network policy with name ingress-on-service not found in agent 2024-10-21 02:09:20,140 - DEBUG - Requesting: http://10.0.0.24:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=b6d08ef8-bdcb-4513-8c3a-d7b9d36eec2c 2024-10-21 02:09:20,174 - INFO - Network policy with name ingress-on-service found in agent 2024-10-21 02:09:20,174 - INFO - Network Policy ingress-on-service verification passed 2024-10-21 02:09:25,238 - DEBUG - [Pod ctest-pod-79096419] Cmd: wget http://10.105.204.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:09:25,238 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd wget http://10.105.204.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:09:25,238 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:09:30,307 - DEBUG - [Pod ctest-pod-79096419] Cmd: wget http://10.105.204.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:09:30,307 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd wget http://10.105.204.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:09:30,307 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:09:35,371 - DEBUG - [Pod ctest-pod-79096419] Cmd: wget http://10.105.204.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:09:35,371 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd wget http://10.105.204.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:09:35,372 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:09:40,448 - DEBUG - [Pod ctest-pod-79096419] Cmd: wget http://10.105.204.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:09:40,448 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd wget http://10.105.204.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:09:40,448 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:09:45,502 - DEBUG - [Pod ctest-pod-79096419] Cmd: wget http://10.105.204.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:09:45,503 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd wget http://10.105.204.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:09:45,503 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:09:50,568 - DEBUG - [Pod ctest-pod-79096419] Cmd: wget http://10.105.204.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:09:50,568 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd wget http://10.105.204.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:09:50,568 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:09:55,642 - DEBUG - [Pod ctest-pod-79096419] Cmd: wget http://10.105.204.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:09:55,642 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd wget http://10.105.204.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:09:55,642 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:10:00,714 - DEBUG - [Pod ctest-pod-79096419] Cmd: wget http://10.105.204.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:10:00,714 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd wget http://10.105.204.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:10:00,714 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:10:05,779 - DEBUG - [Pod ctest-pod-79096419] Cmd: wget http://10.105.204.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:10:05,779 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd wget http://10.105.204.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:10:05,779 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:10:10,850 - DEBUG - [Pod ctest-pod-79096419] Cmd: wget http://10.105.204.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:10:10,850 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd wget http://10.105.204.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:10:10,850 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:10:10,850 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-35811258': 0, 'ctest-pod-05303066': 0} 2024-10-21 02:10:10,931 - DEBUG - [Pod ctest-pod-43216322] Cmd: wget http://10.105.204.105:80/ -O - -T 5 -t 1 , Output: ctest-pod-35811258 Connecting to 10.105.204.105:80 (10.105.204.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-21 02:10:10,931 - DEBUG - [Pod Pod ctest-pod-43216322] Cmd wget http://10.105.204.105:80/ -O - -T 5 -t 1 passed 2024-10-21 02:10:10,931 - DEBUG - [Pod Pod ctest-pod-43216322] Cmd output: ctest-pod-35811258 Connecting to 10.105.204.105:80 (10.105.204.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-21 02:10:11,003 - DEBUG - [Pod ctest-pod-43216322] Cmd: wget http://10.105.204.105:80/ -O - -T 5 -t 1 , Output: ctest-pod-35811258 Connecting to 10.105.204.105:80 (10.105.204.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-21 02:10:11,003 - DEBUG - [Pod Pod ctest-pod-43216322] Cmd wget http://10.105.204.105:80/ -O - -T 5 -t 1 passed 2024-10-21 02:10:11,003 - DEBUG - [Pod Pod ctest-pod-43216322] Cmd output: ctest-pod-35811258 Connecting to 10.105.204.105:80 (10.105.204.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-21 02:10:11,070 - DEBUG - [Pod ctest-pod-43216322] Cmd: wget http://10.105.204.105:80/ -O - -T 5 -t 1 , Output: ctest-pod-05303066 Connecting to 10.105.204.105:80 (10.105.204.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-21 02:10:11,070 - DEBUG - [Pod Pod ctest-pod-43216322] Cmd wget http://10.105.204.105:80/ -O - -T 5 -t 1 passed 2024-10-21 02:10:11,070 - DEBUG - [Pod Pod ctest-pod-43216322] Cmd output: ctest-pod-05303066 Connecting to 10.105.204.105:80 (10.105.204.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-21 02:10:11,070 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-35811258': 2, 'ctest-pod-05303066': 1} 2024-10-21 02:10:16,143 - DEBUG - [Pod ctest-pod-23487214] Cmd: wget http://10.105.204.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:10:16,143 - DEBUG - [Pod Pod ctest-pod-23487214] Cmd wget http://10.105.204.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:10:16,143 - DEBUG - [Pod Pod ctest-pod-23487214] Cmd output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:10:21,207 - DEBUG - [Pod ctest-pod-23487214] Cmd: wget http://10.105.204.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:10:21,207 - DEBUG - [Pod Pod ctest-pod-23487214] Cmd wget http://10.105.204.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:10:21,207 - DEBUG - [Pod Pod ctest-pod-23487214] Cmd output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:10:26,274 - DEBUG - [Pod ctest-pod-23487214] Cmd: wget http://10.105.204.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:10:26,274 - DEBUG - [Pod Pod ctest-pod-23487214] Cmd wget http://10.105.204.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:10:26,274 - DEBUG - [Pod Pod ctest-pod-23487214] Cmd output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:10:31,353 - DEBUG - [Pod ctest-pod-23487214] Cmd: wget http://10.105.204.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:10:31,353 - DEBUG - [Pod Pod ctest-pod-23487214] Cmd wget http://10.105.204.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:10:31,353 - DEBUG - [Pod Pod ctest-pod-23487214] Cmd output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:10:36,417 - DEBUG - [Pod ctest-pod-23487214] Cmd: wget http://10.105.204.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:10:36,418 - DEBUG - [Pod Pod ctest-pod-23487214] Cmd wget http://10.105.204.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:10:36,418 - DEBUG - [Pod Pod ctest-pod-23487214] Cmd output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:10:41,495 - DEBUG - [Pod ctest-pod-23487214] Cmd: wget http://10.105.204.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:10:41,495 - DEBUG - [Pod Pod ctest-pod-23487214] Cmd wget http://10.105.204.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:10:41,495 - DEBUG - [Pod Pod ctest-pod-23487214] Cmd output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:10:46,568 - DEBUG - [Pod ctest-pod-23487214] Cmd: wget http://10.105.204.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:10:46,568 - DEBUG - [Pod Pod ctest-pod-23487214] Cmd wget http://10.105.204.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:10:46,568 - DEBUG - [Pod Pod ctest-pod-23487214] Cmd output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:10:51,625 - DEBUG - [Pod ctest-pod-23487214] Cmd: wget http://10.105.204.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:10:51,625 - DEBUG - [Pod Pod ctest-pod-23487214] Cmd wget http://10.105.204.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:10:51,625 - DEBUG - [Pod Pod ctest-pod-23487214] Cmd output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:10:56,698 - DEBUG - [Pod ctest-pod-23487214] Cmd: wget http://10.105.204.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:10:56,698 - DEBUG - [Pod Pod ctest-pod-23487214] Cmd wget http://10.105.204.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:10:56,698 - DEBUG - [Pod Pod ctest-pod-23487214] Cmd output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:11:01,767 - DEBUG - [Pod ctest-pod-23487214] Cmd: wget http://10.105.204.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:11:01,767 - DEBUG - [Pod Pod ctest-pod-23487214] Cmd wget http://10.105.204.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:11:01,767 - DEBUG - [Pod Pod ctest-pod-23487214] Cmd output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:11:01,767 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-35811258': 0, 'ctest-pod-05303066': 0} 2024-10-21 02:11:03,833 - DEBUG - [Pod ctest-pod-43216322] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.658 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.080 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.112 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.080/0.283/0.658 ms 2024-10-21 02:11:03,833 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-43216322 with expectation True passed 2024-10-21 02:11:05,905 - DEBUG - [Pod ctest-pod-79096419] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.537 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.097 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.106 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.097/0.246/0.537 ms 2024-10-21 02:11:05,905 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-79096419 with expectation True passed 2024-10-21 02:11:07,964 - DEBUG - [Pod ctest-pod-23487214] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.645 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.081 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.092 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.081/0.606/1.645 ms 2024-10-21 02:11:07,964 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-23487214 with expectation True passed 2024-10-21 02:11:08,032 - DEBUG - [Pod ctest-pod-43216322] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-21 02:11:08,032 - DEBUG - [Pod Pod ctest-pod-43216322] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-10-21 02:11:08,032 - DEBUG - [Pod Pod ctest-pod-43216322] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-21 02:11:08,032 - INFO - wget check of of http://10.47.255.251 from ctest-pod-43216322 passed 2024-10-21 02:11:08,103 - DEBUG - [Pod ctest-pod-43216322] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-21 02:11:08,103 - DEBUG - [Pod Pod ctest-pod-43216322] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-10-21 02:11:08,103 - DEBUG - [Pod Pod ctest-pod-43216322] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-21 02:11:08,103 - INFO - wget check of of http://10.47.255.250 from ctest-pod-43216322 passed 2024-10-21 02:11:13,180 - DEBUG - [Pod ctest-pod-79096419] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-10-21 02:11:13,180 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-10-21 02:11:13,180 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-10-21 02:11:13,181 - INFO - wget check of of http://10.47.255.250 from ctest-pod-79096419 passed 2024-10-21 02:11:18,249 - DEBUG - [Pod ctest-pod-51224678] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-10-21 02:11:18,249 - DEBUG - [Pod Pod ctest-pod-51224678] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-10-21 02:11:18,249 - DEBUG - [Pod Pod ctest-pod-51224678] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-10-21 02:11:18,250 - INFO - wget check of of http://10.47.255.251 from ctest-pod-51224678 passed 2024-10-21 02:11:18,259 - INFO - Updating Network Policy ingress-on-service 2024-10-21 02:11:23,334 - DEBUG - [Pod ctest-pod-79096419] Cmd: wget http://10.105.204.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:11:23,334 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd wget http://10.105.204.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:11:23,334 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:11:28,409 - DEBUG - [Pod ctest-pod-79096419] Cmd: wget http://10.105.204.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:11:28,410 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd wget http://10.105.204.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:11:28,410 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:11:33,469 - DEBUG - [Pod ctest-pod-79096419] Cmd: wget http://10.105.204.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:11:33,469 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd wget http://10.105.204.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:11:33,469 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:11:38,530 - DEBUG - [Pod ctest-pod-79096419] Cmd: wget http://10.105.204.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:11:38,530 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd wget http://10.105.204.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:11:38,530 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:11:43,599 - DEBUG - [Pod ctest-pod-79096419] Cmd: wget http://10.105.204.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:11:43,600 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd wget http://10.105.204.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:11:43,600 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:11:48,658 - DEBUG - [Pod ctest-pod-79096419] Cmd: wget http://10.105.204.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:11:48,658 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd wget http://10.105.204.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:11:48,658 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:11:53,743 - DEBUG - [Pod ctest-pod-79096419] Cmd: wget http://10.105.204.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:11:53,743 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd wget http://10.105.204.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:11:53,743 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:11:58,836 - DEBUG - [Pod ctest-pod-79096419] Cmd: wget http://10.105.204.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:11:58,836 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd wget http://10.105.204.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:11:58,836 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:12:03,898 - DEBUG - [Pod ctest-pod-79096419] Cmd: wget http://10.105.204.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:12:03,898 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd wget http://10.105.204.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:12:03,898 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:12:08,981 - DEBUG - [Pod ctest-pod-79096419] Cmd: wget http://10.105.204.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:12:08,982 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd wget http://10.105.204.105:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:12:08,982 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd output: Connecting to 10.105.204.105:80 (10.105.204.105:80) wget: download timed out 2024-10-21 02:12:08,982 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-35811258': 0, 'ctest-pod-05303066': 0} 2024-10-21 02:12:09,051 - DEBUG - [Pod ctest-pod-43216322] Cmd: wget http://10.105.204.105:80/ -O - -T 5 -t 1 , Output: ctest-pod-05303066 Connecting to 10.105.204.105:80 (10.105.204.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-21 02:12:09,051 - DEBUG - [Pod Pod ctest-pod-43216322] Cmd wget http://10.105.204.105:80/ -O - -T 5 -t 1 passed 2024-10-21 02:12:09,052 - DEBUG - [Pod Pod ctest-pod-43216322] Cmd output: ctest-pod-05303066 Connecting to 10.105.204.105:80 (10.105.204.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-21 02:12:09,113 - DEBUG - [Pod ctest-pod-43216322] Cmd: wget http://10.105.204.105:80/ -O - -T 5 -t 1 , Output: ctest-pod-35811258 Connecting to 10.105.204.105:80 (10.105.204.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-21 02:12:09,113 - DEBUG - [Pod Pod ctest-pod-43216322] Cmd wget http://10.105.204.105:80/ -O - -T 5 -t 1 passed 2024-10-21 02:12:09,114 - DEBUG - [Pod Pod ctest-pod-43216322] Cmd output: ctest-pod-35811258 Connecting to 10.105.204.105:80 (10.105.204.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-21 02:12:09,114 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-35811258': 1, 'ctest-pod-05303066': 1} 2024-10-21 02:12:09,184 - DEBUG - [Pod ctest-pod-23487214] Cmd: wget http://10.105.204.105:80/ -O - -T 5 -t 1 , Output: ctest-pod-35811258 Connecting to 10.105.204.105:80 (10.105.204.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-21 02:12:09,184 - DEBUG - [Pod Pod ctest-pod-23487214] Cmd wget http://10.105.204.105:80/ -O - -T 5 -t 1 passed 2024-10-21 02:12:09,184 - DEBUG - [Pod Pod ctest-pod-23487214] Cmd output: ctest-pod-35811258 Connecting to 10.105.204.105:80 (10.105.204.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-21 02:12:09,272 - DEBUG - [Pod ctest-pod-23487214] Cmd: wget http://10.105.204.105:80/ -O - -T 5 -t 1 , Output: Connecting to 10.105.204.105:80 (10.105.204.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-35811258 2024-10-21 02:12:09,272 - DEBUG - [Pod Pod ctest-pod-23487214] Cmd wget http://10.105.204.105:80/ -O - -T 5 -t 1 passed 2024-10-21 02:12:09,272 - DEBUG - [Pod Pod ctest-pod-23487214] Cmd output: Connecting to 10.105.204.105:80 (10.105.204.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-35811258 2024-10-21 02:12:09,348 - DEBUG - [Pod ctest-pod-23487214] Cmd: wget http://10.105.204.105:80/ -O - -T 5 -t 1 , Output: ctest-pod-05303066 Connecting to 10.105.204.105:80 (10.105.204.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-21 02:12:09,348 - DEBUG - [Pod Pod ctest-pod-23487214] Cmd wget http://10.105.204.105:80/ -O - -T 5 -t 1 passed 2024-10-21 02:12:09,348 - DEBUG - [Pod Pod ctest-pod-23487214] Cmd output: ctest-pod-05303066 Connecting to 10.105.204.105:80 (10.105.204.105:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-10-21 02:12:09,348 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-35811258': 2, 'ctest-pod-05303066': 1} 2024-10-21 02:12:11,413 - DEBUG - [Pod ctest-pod-43216322] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.508 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.108 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.103 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.103/0.239/0.508 ms 2024-10-21 02:12:11,413 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-43216322 with expectation True passed 2024-10-21 02:12:13,482 - DEBUG - [Pod ctest-pod-79096419] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.721 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.078 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.104 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.078/0.301/0.721 ms 2024-10-21 02:12:13,482 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-79096419 with expectation True passed 2024-10-21 02:12:15,556 - DEBUG - [Pod ctest-pod-23487214] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=2.487 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.097 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.108 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.097/0.897/2.487 ms 2024-10-21 02:12:15,556 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-23487214 with expectation True passed 2024-10-21 02:12:15,645 - DEBUG - [Pod ctest-pod-43216322] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-21 02:12:15,645 - DEBUG - [Pod Pod ctest-pod-43216322] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-10-21 02:12:15,645 - DEBUG - [Pod Pod ctest-pod-43216322] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-21 02:12:15,645 - INFO - wget check of of http://10.47.255.251 from ctest-pod-43216322 passed 2024-10-21 02:12:15,724 - DEBUG - [Pod ctest-pod-43216322] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-21 02:12:15,724 - DEBUG - [Pod Pod ctest-pod-43216322] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-10-21 02:12:15,724 - DEBUG - [Pod Pod ctest-pod-43216322] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-21 02:12:15,724 - INFO - wget check of of http://10.47.255.250 from ctest-pod-43216322 passed 2024-10-21 02:12:20,801 - DEBUG - [Pod ctest-pod-79096419] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-10-21 02:12:20,801 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-10-21 02:12:20,801 - DEBUG - [Pod Pod ctest-pod-79096419] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-10-21 02:12:20,801 - INFO - wget check of of http://10.47.255.250 from ctest-pod-79096419 passed 2024-10-21 02:12:20,870 - DEBUG - [Pod ctest-pod-51224678] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-21 02:12:20,870 - DEBUG - [Pod Pod ctest-pod-51224678] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-10-21 02:12:20,870 - DEBUG - [Pod Pod ctest-pod-51224678] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-10-21 02:12:20,870 - INFO - wget check of of http://10.47.255.251 from ctest-pod-51224678 passed 2024-10-21 02:12:20,870 - INFO - Deleting Network Policy : ingress-on-service 2024-10-21 02:12:20,871 - INFO - Deleting service : ctest-nginx-svc-53817607 2024-10-21 02:12:21,070 - DEBUG - No XMPP flaps were noticed during the test 2024-10-21 02:12:21,071 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:06] 2024-10-21 02:12:21,071 - INFO - -------------------------------------------------------------------------------- 2024-10-21 02:12:21,076 - INFO - Deleting pod ctest-new-default-06562415:ctest-pod-35811258 2024-10-21 02:12:21,077 - INFO - Deleting pod ctest-new-default-06562415:ctest-pod-05303066 2024-10-21 02:12:21,077 - INFO - Deleting pod ctest-non-default-24322941:ctest-pod-76903646 2024-10-21 02:12:21,078 - INFO - Deleting pod ctest-non-default-24322941:ctest-pod-40376510 2024-10-21 02:12:21,078 - INFO - Deleting pod ctest-new-default-06562415:ctest-pod-79096419 2024-10-21 02:12:21,078 - INFO - Deleting pod ctest-new-default-06562415:ctest-pod-43216322 2024-10-21 02:12:21,079 - INFO - Deleting pod ctest-non-default-24322941:ctest-pod-23487214 2024-10-21 02:12:21,079 - INFO - Deleting pod ctest-non-default-24322941:ctest-pod-51224678 2024-10-21 02:12:21,138 - WARNING - Pod uuid 9674ffe5-c65a-48ed-baf2-e93de6628237 is still seen in agent 10.0.0.12 VM list 2024-10-21 02:12:21,232 - WARNING - Pod uuid 1802889a-28a3-46e7-adbc-01dd74230624 is still seen in agent 10.0.0.12 VM list 2024-10-21 02:12:21,233 - WARNING - Pod uuid 36772b7e-48b6-4c49-bbb4-daa3b94f016d is still seen in agent 10.0.0.12 VM list 2024-10-21 02:12:21,234 - WARNING - Pod uuid 48c578b3-99fb-407c-a469-e4a3268f3fa9 is still seen in agent 10.0.0.12 VM list 2024-10-21 02:12:21,234 - WARNING - Pod uuid 76d65ad1-98ab-4776-a567-2de5ad815df8 is still seen in agent 10.0.0.12 VM list 2024-10-21 02:12:21,235 - WARNING - Pod uuid 7c8741ad-9049-474c-94b0-a4249a94f9cb is still seen in agent 10.0.0.12 VM list 2024-10-21 02:12:21,236 - WARNING - Pod uuid 44a79a40-2900-4a78-a733-a4de94b83ba1 is still seen in agent 10.0.0.12 VM list 2024-10-21 02:12:21,236 - WARNING - Pod uuid 84c389cb-40e1-4755-9088-ee9d37c92553 is still seen in agent 10.0.0.12 VM list 2024-10-21 02:12:26,147 - DEBUG - Pod 9674ffe5-c65a-48ed-baf2-e93de6628237 is not in agent 10.0.0.12 VM list 2024-10-21 02:12:26,156 - DEBUG - VMI 6d116766-8f51-11ef-a2d3-fa163ed25c24 is removed from agent 10.0.0.12 2024-10-21 02:12:26,156 - INFO - Verified that pod ctest-pod-35811258 is removed in agent 2024-10-21 02:12:26,270 - DEBUG - Pod 76d65ad1-98ab-4776-a567-2de5ad815df8 is not in agent 10.0.0.12 VM list 2024-10-21 02:12:26,274 - WARNING - Pod uuid 84c389cb-40e1-4755-9088-ee9d37c92553 is still seen in agent 10.0.0.12 VM list 2024-10-21 02:12:26,274 - WARNING - Pod uuid 7c8741ad-9049-474c-94b0-a4249a94f9cb is still seen in agent 10.0.0.12 VM list 2024-10-21 02:12:26,275 - WARNING - Pod uuid 44a79a40-2900-4a78-a733-a4de94b83ba1 is still seen in agent 10.0.0.12 VM list 2024-10-21 02:12:26,276 - WARNING - Pod uuid 1802889a-28a3-46e7-adbc-01dd74230624 is still seen in agent 10.0.0.12 VM list 2024-10-21 02:12:26,276 - DEBUG - Pod 36772b7e-48b6-4c49-bbb4-daa3b94f016d is not in agent 10.0.0.12 VM list 2024-10-21 02:12:26,278 - DEBUG - Pod 48c578b3-99fb-407c-a469-e4a3268f3fa9 is not in agent 10.0.0.12 VM list 2024-10-21 02:12:26,290 - DEBUG - VMI 6ecc933c-8f51-11ef-a2d3-fa163ed25c24 is removed from agent 10.0.0.12 2024-10-21 02:12:26,290 - INFO - Verified that pod ctest-pod-40376510 is removed in agent 2024-10-21 02:12:26,292 - DEBUG - VMI 6e4a2b9a-8f51-11ef-a2d3-fa163ed25c24 is removed from agent 10.0.0.12 2024-10-21 02:12:26,292 - INFO - Verified that pod ctest-pod-76903646 is removed in agent 2024-10-21 02:12:26,292 - DEBUG - VMI 6d9737c4-8f51-11ef-a2d3-fa163ed25c24 is removed from agent 10.0.0.12 2024-10-21 02:12:26,292 - INFO - Verified that pod ctest-pod-05303066 is removed in agent 2024-10-21 02:12:31,295 - WARNING - Pod uuid 1802889a-28a3-46e7-adbc-01dd74230624 is still seen in agent 10.0.0.12 VM list 2024-10-21 02:12:31,296 - WARNING - Pod uuid 7c8741ad-9049-474c-94b0-a4249a94f9cb is still seen in agent 10.0.0.12 VM list 2024-10-21 02:12:31,296 - WARNING - Pod uuid 84c389cb-40e1-4755-9088-ee9d37c92553 is still seen in agent 10.0.0.12 VM list 2024-10-21 02:12:31,297 - WARNING - Pod uuid 44a79a40-2900-4a78-a733-a4de94b83ba1 is still seen in agent 10.0.0.12 VM list 2024-10-21 02:12:36,315 - WARNING - Pod uuid 7c8741ad-9049-474c-94b0-a4249a94f9cb is still seen in agent 10.0.0.12 VM list 2024-10-21 02:12:36,317 - WARNING - Pod uuid 44a79a40-2900-4a78-a733-a4de94b83ba1 is still seen in agent 10.0.0.12 VM list 2024-10-21 02:12:36,317 - WARNING - Pod uuid 84c389cb-40e1-4755-9088-ee9d37c92553 is still seen in agent 10.0.0.12 VM list 2024-10-21 02:12:36,317 - WARNING - Pod uuid 1802889a-28a3-46e7-adbc-01dd74230624 is still seen in agent 10.0.0.12 VM list 2024-10-21 02:12:41,335 - WARNING - Pod uuid 7c8741ad-9049-474c-94b0-a4249a94f9cb is still seen in agent 10.0.0.12 VM list 2024-10-21 02:12:41,337 - WARNING - Pod uuid 84c389cb-40e1-4755-9088-ee9d37c92553 is still seen in agent 10.0.0.12 VM list 2024-10-21 02:12:41,337 - WARNING - Pod uuid 44a79a40-2900-4a78-a733-a4de94b83ba1 is still seen in agent 10.0.0.12 VM list 2024-10-21 02:12:41,337 - WARNING - Pod uuid 1802889a-28a3-46e7-adbc-01dd74230624 is still seen in agent 10.0.0.12 VM list 2024-10-21 02:12:46,354 - WARNING - Pod uuid 44a79a40-2900-4a78-a733-a4de94b83ba1 is still seen in agent 10.0.0.12 VM list 2024-10-21 02:12:46,356 - WARNING - Pod uuid 1802889a-28a3-46e7-adbc-01dd74230624 is still seen in agent 10.0.0.12 VM list 2024-10-21 02:12:46,356 - WARNING - Pod uuid 84c389cb-40e1-4755-9088-ee9d37c92553 is still seen in agent 10.0.0.12 VM list 2024-10-21 02:12:46,356 - WARNING - Pod uuid 7c8741ad-9049-474c-94b0-a4249a94f9cb is still seen in agent 10.0.0.12 VM list 2024-10-21 02:12:51,374 - WARNING - Pod uuid 1802889a-28a3-46e7-adbc-01dd74230624 is still seen in agent 10.0.0.12 VM list 2024-10-21 02:12:51,375 - WARNING - Pod uuid 44a79a40-2900-4a78-a733-a4de94b83ba1 is still seen in agent 10.0.0.12 VM list 2024-10-21 02:12:51,381 - WARNING - Pod uuid 84c389cb-40e1-4755-9088-ee9d37c92553 is still seen in agent 10.0.0.12 VM list 2024-10-21 02:12:51,381 - WARNING - Pod uuid 7c8741ad-9049-474c-94b0-a4249a94f9cb is still seen in agent 10.0.0.12 VM list 2024-10-21 02:12:56,396 - DEBUG - Pod 7c8741ad-9049-474c-94b0-a4249a94f9cb is not in agent 10.0.0.12 VM list 2024-10-21 02:12:56,398 - DEBUG - Pod 84c389cb-40e1-4755-9088-ee9d37c92553 is not in agent 10.0.0.12 VM list 2024-10-21 02:12:56,400 - DEBUG - Pod 44a79a40-2900-4a78-a733-a4de94b83ba1 is not in agent 10.0.0.12 VM list 2024-10-21 02:12:56,402 - DEBUG - Pod 1802889a-28a3-46e7-adbc-01dd74230624 is not in agent 10.0.0.12 VM list 2024-10-21 02:12:56,418 - DEBUG - VMI 70fbadd2-8f51-11ef-a2d3-fa163ed25c24 is removed from agent 10.0.0.12 2024-10-21 02:12:56,418 - INFO - Verified that pod ctest-pod-51224678 is removed in agent 2024-10-21 02:12:56,420 - DEBUG - VMI 6ff6ab12-8f51-11ef-a2d3-fa163ed25c24 is removed from agent 10.0.0.12 2024-10-21 02:12:56,420 - INFO - Verified that pod ctest-pod-43216322 is removed in agent 2024-10-21 02:12:56,420 - DEBUG - VMI 6f6ecbfc-8f51-11ef-a2d3-fa163ed25c24 is removed from agent 10.0.0.12 2024-10-21 02:12:56,420 - INFO - Verified that pod ctest-pod-79096419 is removed in agent 2024-10-21 02:12:56,420 - DEBUG - VMI 707b296e-8f51-11ef-a2d3-fa163ed25c24 is removed from agent 10.0.0.12 2024-10-21 02:12:56,421 - INFO - Verified that pod ctest-pod-23487214 is removed in agent 2024-10-21 02:12:56,421 - INFO - Deleting namespace ctest-non-default-24322941 2024-10-21 02:12:56,438 - DEBUG - Namespace ctest-non-default-24322941 still in k8s 2024-10-21 02:12:58,442 - DEBUG - Namespace ctest-non-default-24322941 still in k8s 2024-10-21 02:13:00,447 - DEBUG - Namespace ctest-non-default-24322941 still in k8s 2024-10-21 02:13:02,451 - DEBUG - Namespace ctest-non-default-24322941 is not in k8s 2024-10-21 02:13:02,452 - DEBUG - No need to check project deletion in contrail-api 2024-10-21 02:13:02,452 - INFO - Deleting namespace ctest-new-default-06562415 2024-10-21 02:13:02,460 - DEBUG - Namespace ctest-new-default-06562415 still in k8s 2024-10-21 02:13:04,465 - DEBUG - Namespace ctest-new-default-06562415 still in k8s 2024-10-21 02:13:06,469 - DEBUG - Namespace ctest-new-default-06562415 still in k8s 2024-10-21 02:13:08,473 - DEBUG - Namespace ctest-new-default-06562415 is not in k8s 2024-10-21 02:13:08,473 - DEBUG - No need to check project deletion in contrail-api