2024-08-27 08:07:35,735 - INFO - Using existing project ['default-domain', 'k8s-default'](4d588b21-0a30-4336-90cd-a283c17f6a45) 2024-08-27 08:07:35,761 - DEBUG - Namespace ctest-new-default-15745934 not present 2024-08-27 08:07:35,769 - INFO - Created namespace ctest-new-default-15745934 2024-08-27 08:07:38,774 - DEBUG - Namespace ctest-non-default-80607817 not present 2024-08-27 08:07:38,781 - INFO - Created namespace ctest-non-default-80607817 2024-08-27 08:07:41,800 - DEBUG - Pod ctest-pod-15808719 not present 2024-08-27 08:07:41,800 - INFO - Creating Pod ctest-pod-15808719 2024-08-27 08:07:41,824 - DEBUG - Pod : ctest-pod-15808719 UUID is 765b9f71-890a-4b3b-a31d-9965cb6b47d4 2024-08-27 08:07:41,828 - DEBUG - Pod ctest-pod-02265345 not present 2024-08-27 08:07:41,832 - INFO - Creating Pod ctest-pod-02265345 2024-08-27 08:07:41,867 - DEBUG - Pod : ctest-pod-02265345 UUID is 01172447-7e0e-4286-8415-8c8dba78029c 2024-08-27 08:07:41,870 - DEBUG - Pod ctest-pod-12976794 not present 2024-08-27 08:07:41,870 - INFO - Creating Pod ctest-pod-12976794 2024-08-27 08:07:41,904 - DEBUG - Pod : ctest-pod-12976794 UUID is d34f0c09-b0e7-495c-8e22-f6e561762458 2024-08-27 08:07:41,908 - DEBUG - Pod ctest-pod-16284861 not present 2024-08-27 08:07:41,908 - INFO - Creating Pod ctest-pod-16284861 2024-08-27 08:07:41,924 - DEBUG - Pod : ctest-pod-16284861 UUID is dce9fa11-ad5a-40f9-96af-1a178acbabda 2024-08-27 08:07:41,927 - DEBUG - Pod ctest-pod-78102560 not present 2024-08-27 08:07:41,928 - INFO - Creating Pod ctest-pod-78102560 2024-08-27 08:07:41,945 - DEBUG - Pod : ctest-pod-78102560 UUID is 66afb697-8d47-47f0-8cd2-5a486cfb97ca 2024-08-27 08:07:41,948 - DEBUG - Pod ctest-pod-77891598 not present 2024-08-27 08:07:41,949 - INFO - Creating Pod ctest-pod-77891598 2024-08-27 08:07:41,975 - DEBUG - Pod : ctest-pod-77891598 UUID is 4730ead2-8dd3-4aaf-9421-96074713ebf1 2024-08-27 08:07:41,982 - DEBUG - Pod ctest-pod-60471887 not present 2024-08-27 08:07:41,982 - INFO - Creating Pod ctest-pod-60471887 2024-08-27 08:07:42,010 - DEBUG - Pod : ctest-pod-60471887 UUID is 6058ca58-a652-4a64-8b07-f5af80a81d34 2024-08-27 08:07:42,013 - DEBUG - Pod ctest-pod-54165326 not present 2024-08-27 08:07:42,014 - INFO - Creating Pod ctest-pod-54165326 2024-08-27 08:07:42,037 - DEBUG - Pod : ctest-pod-54165326 UUID is dc92c7d2-f9c8-4921-a415-61823f2fa39a 2024-08-27 08:07:42,322 - INFO - Project default-domain:k8s-ctest-new-default-15745934 for Namespace ctest-new-default-15745934 is seen in contrail-api 2024-08-27 08:07:42,322 - DEBUG - Project uuid in Contrail is 09469da6-db48-44b3-9083-baa7f579d107 2024-08-27 08:07:42,490 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NamespaceDatabaseList?namespace_uuid=5852c6c1-9a37-4bd0-a4c7-3bea78db5fbf 2024-08-27 08:07:42,495 - INFO - Namespace ctest-new-default-15745934 with uuid 5852c6c1-9a37-4bd0-a4c7-3bea78db5fbf found in kube manager 2024-08-27 08:07:42,495 - INFO - Namespace ctest-new-default-15745934 verification passed 2024-08-27 08:07:42,767 - INFO - Project default-domain:k8s-ctest-non-default-80607817 for Namespace ctest-non-default-80607817 is seen in contrail-api 2024-08-27 08:07:42,767 - DEBUG - Project uuid in Contrail is 709679b9-c262-427f-88c2-2dcee0728cd1 2024-08-27 08:07:42,767 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NamespaceDatabaseList?namespace_uuid=28321430-cf2f-4b69-a8c7-d0ededdb86cb 2024-08-27 08:07:42,771 - INFO - Namespace ctest-non-default-80607817 with uuid 28321430-cf2f-4b69-a8c7-d0ededdb86cb found in kube manager 2024-08-27 08:07:42,771 - INFO - Namespace ctest-non-default-80607817 verification passed 2024-08-27 08:07:42,779 - DEBUG - Pod ctest-pod-15808719 not in running state.Currently in Pending 2024-08-27 08:07:47,786 - DEBUG - Pod ctest-pod-15808719 not in running state.Currently in Pending 2024-08-27 08:07:52,792 - DEBUG - Pod ctest-pod-15808719 not in running state.Currently in Pending 2024-08-27 08:07:57,801 - INFO - Pod ctest-pod-15808719 is in running state.Got IP 10.47.255.250 2024-08-27 08:07:57,854 - DEBUG - Pod ctest-pod-15808719 has vmi 70c84cac-644b-11ef-a483-0242184ef55d 2024-08-27 08:07:57,854 - INFO - Verified pod ctest-pod-15808719 in contrail-api 2024-08-27 08:07:57,868 - DEBUG - VMI 70c84cac-644b-11ef-a483-0242184ef55d is active in agent 10.0.0.12 2024-08-27 08:07:57,868 - INFO - Verified Pod ctest-pod-15808719 in agent 10.0.0.12 2024-08-27 08:07:57,868 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=765b9f71-890a-4b3b-a31d-9965cb6b47d4 2024-08-27 08:07:57,873 - INFO - Pod ctest-pod-15808719 with uuid 765b9f71-890a-4b3b-a31d-9965cb6b47d4 found in kube manager 2024-08-27 08:07:57,873 - INFO - Pod ctest-pod-15808719 verification passed 2024-08-27 08:07:57,880 - INFO - Pod ctest-pod-02265345 is in running state.Got IP 10.47.255.249 2024-08-27 08:07:57,974 - DEBUG - Pod ctest-pod-02265345 has vmi 718801be-644b-11ef-a483-0242184ef55d 2024-08-27 08:07:57,974 - INFO - Verified pod ctest-pod-02265345 in contrail-api 2024-08-27 08:07:57,986 - DEBUG - VMI 718801be-644b-11ef-a483-0242184ef55d is active in agent 10.0.0.12 2024-08-27 08:07:57,986 - INFO - Verified Pod ctest-pod-02265345 in agent 10.0.0.12 2024-08-27 08:07:57,986 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=01172447-7e0e-4286-8415-8c8dba78029c 2024-08-27 08:07:57,991 - INFO - Pod ctest-pod-02265345 with uuid 01172447-7e0e-4286-8415-8c8dba78029c found in kube manager 2024-08-27 08:07:57,991 - INFO - Pod ctest-pod-02265345 verification passed 2024-08-27 08:07:57,996 - INFO - Pod ctest-pod-12976794 is in running state.Got IP 10.47.255.248 2024-08-27 08:07:58,088 - DEBUG - Pod ctest-pod-12976794 has vmi 727eb13a-644b-11ef-a483-0242184ef55d 2024-08-27 08:07:58,088 - INFO - Verified pod ctest-pod-12976794 in contrail-api 2024-08-27 08:07:58,099 - DEBUG - VMI 727eb13a-644b-11ef-a483-0242184ef55d is active in agent 10.0.0.12 2024-08-27 08:07:58,100 - INFO - Verified Pod ctest-pod-12976794 in agent 10.0.0.12 2024-08-27 08:07:58,100 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=d34f0c09-b0e7-495c-8e22-f6e561762458 2024-08-27 08:07:58,105 - INFO - Pod ctest-pod-12976794 with uuid d34f0c09-b0e7-495c-8e22-f6e561762458 found in kube manager 2024-08-27 08:07:58,105 - INFO - Pod ctest-pod-12976794 verification passed 2024-08-27 08:07:58,111 - INFO - Pod ctest-pod-16284861 is in running state.Got IP 10.47.255.247 2024-08-27 08:07:58,207 - DEBUG - Pod ctest-pod-16284861 has vmi 733900bc-644b-11ef-a483-0242184ef55d 2024-08-27 08:07:58,207 - INFO - Verified pod ctest-pod-16284861 in contrail-api 2024-08-27 08:07:58,221 - DEBUG - VMI 733900bc-644b-11ef-a483-0242184ef55d is active in agent 10.0.0.12 2024-08-27 08:07:58,222 - INFO - Verified Pod ctest-pod-16284861 in agent 10.0.0.12 2024-08-27 08:07:58,222 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=dce9fa11-ad5a-40f9-96af-1a178acbabda 2024-08-27 08:07:58,227 - INFO - Pod ctest-pod-16284861 with uuid dce9fa11-ad5a-40f9-96af-1a178acbabda found in kube manager 2024-08-27 08:07:58,227 - INFO - Pod ctest-pod-16284861 verification passed 2024-08-27 08:07:58,232 - INFO - Pod ctest-pod-78102560 is in running state.Got IP 10.47.255.246 2024-08-27 08:07:58,323 - DEBUG - Pod ctest-pod-78102560 has vmi 74056ab2-644b-11ef-a483-0242184ef55d 2024-08-27 08:07:58,323 - INFO - Verified pod ctest-pod-78102560 in contrail-api 2024-08-27 08:07:58,334 - DEBUG - VMI 74056ab2-644b-11ef-a483-0242184ef55d is active in agent 10.0.0.12 2024-08-27 08:07:58,334 - INFO - Verified Pod ctest-pod-78102560 in agent 10.0.0.12 2024-08-27 08:07:58,334 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=66afb697-8d47-47f0-8cd2-5a486cfb97ca 2024-08-27 08:07:58,338 - INFO - Pod ctest-pod-78102560 with uuid 66afb697-8d47-47f0-8cd2-5a486cfb97ca found in kube manager 2024-08-27 08:07:58,338 - INFO - Pod ctest-pod-78102560 verification passed 2024-08-27 08:07:58,344 - DEBUG - Pod ctest-pod-60471887 not in running state.Currently in Pending 2024-08-27 08:08:03,350 - INFO - Pod ctest-pod-60471887 is in running state.Got IP 10.47.255.244 2024-08-27 08:08:03,402 - DEBUG - Pod ctest-pod-60471887 has vmi 758a78be-644b-11ef-a483-0242184ef55d 2024-08-27 08:08:03,402 - INFO - Verified pod ctest-pod-60471887 in contrail-api 2024-08-27 08:08:03,415 - DEBUG - VMI 758a78be-644b-11ef-a483-0242184ef55d is active in agent 10.0.0.12 2024-08-27 08:08:03,416 - INFO - Verified Pod ctest-pod-60471887 in agent 10.0.0.12 2024-08-27 08:08:03,416 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=6058ca58-a652-4a64-8b07-f5af80a81d34 2024-08-27 08:08:03,420 - INFO - Pod ctest-pod-60471887 with uuid 6058ca58-a652-4a64-8b07-f5af80a81d34 found in kube manager 2024-08-27 08:08:03,420 - INFO - Pod ctest-pod-60471887 verification passed 2024-08-27 08:08:03,426 - INFO - Pod ctest-pod-77891598 is in running state.Got IP 10.47.255.245 2024-08-27 08:08:03,518 - DEBUG - Pod ctest-pod-77891598 has vmi 74c6f83a-644b-11ef-a483-0242184ef55d 2024-08-27 08:08:03,518 - INFO - Verified pod ctest-pod-77891598 in contrail-api 2024-08-27 08:08:03,532 - DEBUG - VMI 74c6f83a-644b-11ef-a483-0242184ef55d is active in agent 10.0.0.12 2024-08-27 08:08:03,533 - INFO - Verified Pod ctest-pod-77891598 in agent 10.0.0.12 2024-08-27 08:08:03,533 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=4730ead2-8dd3-4aaf-9421-96074713ebf1 2024-08-27 08:08:03,540 - INFO - Pod ctest-pod-77891598 with uuid 4730ead2-8dd3-4aaf-9421-96074713ebf1 found in kube manager 2024-08-27 08:08:03,540 - INFO - Pod ctest-pod-77891598 verification passed 2024-08-27 08:08:03,547 - INFO - Pod ctest-pod-54165326 is in running state.Got IP 10.47.255.243 2024-08-27 08:08:03,638 - DEBUG - Pod ctest-pod-54165326 has vmi 765468fe-644b-11ef-a483-0242184ef55d 2024-08-27 08:08:03,638 - INFO - Verified pod ctest-pod-54165326 in contrail-api 2024-08-27 08:08:03,652 - DEBUG - VMI 765468fe-644b-11ef-a483-0242184ef55d is active in agent 10.0.0.12 2024-08-27 08:08:03,652 - INFO - Verified Pod ctest-pod-54165326 in agent 10.0.0.12 2024-08-27 08:08:03,652 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=dc92c7d2-f9c8-4921-a415-61823f2fa39a 2024-08-27 08:08:03,657 - INFO - Pod ctest-pod-54165326 with uuid dc92c7d2-f9c8-4921-a415-61823f2fa39a found in kube manager 2024-08-27 08:08:03,657 - INFO - Pod ctest-pod-54165326 verification passed 2024-08-27 08:08:03,657 - INFO - ================================================================================ 2024-08-27 08:08:03,658 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-08-27 08:08:03,658 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-08-27 08:08:03,918 - DEBUG - Nothing to compare xmpp stats {'10.0.0.12': {'10.0.0.12': '3'}} with 2024-08-27 08:08:03,918 - INFO - Initial checks done. Running the testcase now 2024-08-27 08:08:03,918 - INFO - 2024-08-27 08:08:04,011 - DEBUG - [Pod ctest-pod-15808719] Cmd: echo ctest-pod-15808719 > /usr/share/nginx/html/index.html, Output: 2024-08-27 08:08:04,080 - DEBUG - [Pod ctest-pod-02265345] Cmd: echo ctest-pod-02265345 > /usr/share/nginx/html/index.html, Output: 2024-08-27 08:08:04,168 - DEBUG - [Pod ctest-pod-12976794] Cmd: echo ctest-pod-12976794 > /usr/share/nginx/html/index.html, Output: 2024-08-27 08:08:04,248 - DEBUG - [Pod ctest-pod-16284861] Cmd: echo ctest-pod-16284861 > /usr/share/nginx/html/index.html, Output: 2024-08-27 08:08:04,252 - DEBUG - Service ctest-nginx-svc-44402305 not present 2024-08-27 08:08:04,252 - INFO - Creating service ctest-nginx-svc-44402305 2024-08-27 08:08:04,273 - INFO - Created Service ctest-nginx-svc-44402305 2024-08-27 08:08:04,280 - WARNING - Service UUID 60ecf212-3507-402d-9d80-5368109055bb not yet found in contrail-api 2024-08-27 08:08:05,287 - INFO - Validated that Service ctest-nginx-svc-44402305 is seen in contrail-api 2024-08-27 08:08:05,288 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_LoadbalancerDatabaseList?x=60ecf212-3507-402d-9d80-5368109055bb 2024-08-27 08:08:05,295 - INFO - Service ctest-nginx-svc-44402305 with uuid 60ecf212-3507-402d-9d80-5368109055bb found in kube manager 2024-08-27 08:08:05,295 - INFO - Service ctest-nginx-svc-44402305 verification passed 2024-08-27 08:08:06,456 - DEBUG - [Pod ctest-pod-78102560] Cmd: wget http://10.104.82.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.82.233:80 (10.104.82.233:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-15808719 2024-08-27 08:08:06,456 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd wget http://10.104.82.233:80/ -O - -T 5 -t 1 passed 2024-08-27 08:08:06,456 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd output: Connecting to 10.104.82.233:80 (10.104.82.233:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-15808719 2024-08-27 08:08:06,558 - DEBUG - [Pod ctest-pod-78102560] Cmd: wget http://10.104.82.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.82.233:80 (10.104.82.233:80) writing to stdout ctest-pod-15808719 - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 08:08:06,558 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd wget http://10.104.82.233:80/ -O - -T 5 -t 1 passed 2024-08-27 08:08:06,558 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd output: Connecting to 10.104.82.233:80 (10.104.82.233:80) writing to stdout ctest-pod-15808719 - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 08:08:06,635 - DEBUG - [Pod ctest-pod-78102560] Cmd: wget http://10.104.82.233:80/ -O - -T 5 -t 1 , Output: ctest-pod-02265345 Connecting to 10.104.82.233:80 (10.104.82.233:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 08:08:06,636 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd wget http://10.104.82.233:80/ -O - -T 5 -t 1 passed 2024-08-27 08:08:06,636 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd output: ctest-pod-02265345 Connecting to 10.104.82.233:80 (10.104.82.233:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 08:08:06,636 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-15808719': 2, 'ctest-pod-02265345': 1} 2024-08-27 08:08:06,710 - DEBUG - [Pod ctest-pod-60471887] Cmd: wget http://10.104.82.233:80/ -O - -T 5 -t 1 , Output: ctest-pod-02265345 Connecting to 10.104.82.233:80 (10.104.82.233:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 08:08:06,710 - DEBUG - [Pod Pod ctest-pod-60471887] Cmd wget http://10.104.82.233:80/ -O - -T 5 -t 1 passed 2024-08-27 08:08:06,710 - DEBUG - [Pod Pod ctest-pod-60471887] Cmd output: ctest-pod-02265345 Connecting to 10.104.82.233:80 (10.104.82.233:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 08:08:06,787 - DEBUG - [Pod ctest-pod-60471887] Cmd: wget http://10.104.82.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.82.233:80 (10.104.82.233:80) ctest-pod-02265345 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 08:08:06,787 - DEBUG - [Pod Pod ctest-pod-60471887] Cmd wget http://10.104.82.233:80/ -O - -T 5 -t 1 passed 2024-08-27 08:08:06,787 - DEBUG - [Pod Pod ctest-pod-60471887] Cmd output: Connecting to 10.104.82.233:80 (10.104.82.233:80) ctest-pod-02265345 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 08:08:06,868 - DEBUG - [Pod ctest-pod-60471887] Cmd: wget http://10.104.82.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.82.233:80 (10.104.82.233:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-15808719 2024-08-27 08:08:06,869 - DEBUG - [Pod Pod ctest-pod-60471887] Cmd wget http://10.104.82.233:80/ -O - -T 5 -t 1 passed 2024-08-27 08:08:06,869 - DEBUG - [Pod Pod ctest-pod-60471887] Cmd output: Connecting to 10.104.82.233:80 (10.104.82.233:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-15808719 2024-08-27 08:08:06,869 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-15808719': 1, 'ctest-pod-02265345': 2} 2024-08-27 08:08:06,872 - DEBUG - Network policy ingress-on-service not present 2024-08-27 08:08:06,873 - INFO - Creating Network Policy ingress-on-service 2024-08-27 08:08:06,888 - INFO - Network policy found in k8s 2024-08-27 08:08:06,888 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=a2dec82a-32ff-427b-a118-48194680c285 2024-08-27 08:08:06,896 - INFO - Network Policy ingress-on-service with uuid a2dec82a-32ff-427b-a118-48194680c285 found in kube manager 2024-08-27 08:08:06,929 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-08-27 08:08:06,929 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-08-27 08:08:06,930 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=a2dec82a-32ff-427b-a118-48194680c285 2024-08-27 08:08:06,956 - WARNING - Network policy with name ingress-on-service not found in agent 2024-08-27 08:08:08,956 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=a2dec82a-32ff-427b-a118-48194680c285 2024-08-27 08:08:08,998 - WARNING - Network policy with name ingress-on-service not found in agent 2024-08-27 08:08:11,000 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=a2dec82a-32ff-427b-a118-48194680c285 2024-08-27 08:08:11,035 - INFO - Network policy with name ingress-on-service found in agent 2024-08-27 08:08:11,035 - INFO - Network Policy ingress-on-service verification passed 2024-08-27 08:08:16,108 - DEBUG - [Pod ctest-pod-78102560] Cmd: wget http://10.104.82.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:08:16,108 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd wget http://10.104.82.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:08:16,108 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:08:21,188 - DEBUG - [Pod ctest-pod-78102560] Cmd: wget http://10.104.82.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:08:21,188 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd wget http://10.104.82.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:08:21,188 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:08:26,269 - DEBUG - [Pod ctest-pod-78102560] Cmd: wget http://10.104.82.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:08:26,269 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd wget http://10.104.82.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:08:26,269 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:08:31,354 - DEBUG - [Pod ctest-pod-78102560] Cmd: wget http://10.104.82.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:08:31,354 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd wget http://10.104.82.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:08:31,354 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:08:36,435 - DEBUG - [Pod ctest-pod-78102560] Cmd: wget http://10.104.82.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:08:36,435 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd wget http://10.104.82.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:08:36,435 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:08:41,506 - DEBUG - [Pod ctest-pod-78102560] Cmd: wget http://10.104.82.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:08:41,506 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd wget http://10.104.82.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:08:41,506 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:08:46,581 - DEBUG - [Pod ctest-pod-78102560] Cmd: wget http://10.104.82.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:08:46,581 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd wget http://10.104.82.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:08:46,581 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:08:51,659 - DEBUG - [Pod ctest-pod-78102560] Cmd: wget http://10.104.82.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:08:51,659 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd wget http://10.104.82.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:08:51,659 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:08:56,742 - DEBUG - [Pod ctest-pod-78102560] Cmd: wget http://10.104.82.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:08:56,742 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd wget http://10.104.82.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:08:56,742 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:09:01,825 - DEBUG - [Pod ctest-pod-78102560] Cmd: wget http://10.104.82.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:09:01,825 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd wget http://10.104.82.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:09:01,825 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:09:01,825 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-15808719': 0, 'ctest-pod-02265345': 0} 2024-08-27 08:09:01,914 - DEBUG - [Pod ctest-pod-77891598] Cmd: wget http://10.104.82.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.82.233:80 (10.104.82.233:80) ctest-pod-02265345 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 08:09:01,914 - DEBUG - [Pod Pod ctest-pod-77891598] Cmd wget http://10.104.82.233:80/ -O - -T 5 -t 1 passed 2024-08-27 08:09:01,914 - DEBUG - [Pod Pod ctest-pod-77891598] Cmd output: Connecting to 10.104.82.233:80 (10.104.82.233:80) ctest-pod-02265345 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 08:09:01,996 - DEBUG - [Pod ctest-pod-77891598] Cmd: wget http://10.104.82.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.82.233:80 (10.104.82.233:80) writing to stdout ctest-pod-02265345 - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 08:09:01,996 - DEBUG - [Pod Pod ctest-pod-77891598] Cmd wget http://10.104.82.233:80/ -O - -T 5 -t 1 passed 2024-08-27 08:09:01,996 - DEBUG - [Pod Pod ctest-pod-77891598] Cmd output: Connecting to 10.104.82.233:80 (10.104.82.233:80) writing to stdout ctest-pod-02265345 - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 08:09:02,076 - DEBUG - [Pod ctest-pod-77891598] Cmd: wget http://10.104.82.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.82.233:80 (10.104.82.233:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-02265345 2024-08-27 08:09:02,076 - DEBUG - [Pod Pod ctest-pod-77891598] Cmd wget http://10.104.82.233:80/ -O - -T 5 -t 1 passed 2024-08-27 08:09:02,076 - DEBUG - [Pod Pod ctest-pod-77891598] Cmd output: Connecting to 10.104.82.233:80 (10.104.82.233:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-02265345 2024-08-27 08:09:02,154 - DEBUG - [Pod ctest-pod-77891598] Cmd: wget http://10.104.82.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.82.233:80 (10.104.82.233:80) ctest-pod-15808719 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 08:09:02,154 - DEBUG - [Pod Pod ctest-pod-77891598] Cmd wget http://10.104.82.233:80/ -O - -T 5 -t 1 passed 2024-08-27 08:09:02,154 - DEBUG - [Pod Pod ctest-pod-77891598] Cmd output: Connecting to 10.104.82.233:80 (10.104.82.233:80) ctest-pod-15808719 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 08:09:02,154 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-15808719': 1, 'ctest-pod-02265345': 3} 2024-08-27 08:09:07,238 - DEBUG - [Pod ctest-pod-60471887] Cmd: wget http://10.104.82.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:09:07,238 - DEBUG - [Pod Pod ctest-pod-60471887] Cmd wget http://10.104.82.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:09:07,238 - DEBUG - [Pod Pod ctest-pod-60471887] Cmd output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:09:12,327 - DEBUG - [Pod ctest-pod-60471887] Cmd: wget http://10.104.82.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:09:12,327 - DEBUG - [Pod Pod ctest-pod-60471887] Cmd wget http://10.104.82.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:09:12,327 - DEBUG - [Pod Pod ctest-pod-60471887] Cmd output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:09:17,398 - DEBUG - [Pod ctest-pod-60471887] Cmd: wget http://10.104.82.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:09:17,398 - DEBUG - [Pod Pod ctest-pod-60471887] Cmd wget http://10.104.82.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:09:17,398 - DEBUG - [Pod Pod ctest-pod-60471887] Cmd output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:09:22,477 - DEBUG - [Pod ctest-pod-60471887] Cmd: wget http://10.104.82.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:09:22,477 - DEBUG - [Pod Pod ctest-pod-60471887] Cmd wget http://10.104.82.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:09:22,478 - DEBUG - [Pod Pod ctest-pod-60471887] Cmd output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:09:27,569 - DEBUG - [Pod ctest-pod-60471887] Cmd: wget http://10.104.82.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:09:27,569 - DEBUG - [Pod Pod ctest-pod-60471887] Cmd wget http://10.104.82.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:09:27,569 - DEBUG - [Pod Pod ctest-pod-60471887] Cmd output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:09:32,634 - DEBUG - [Pod ctest-pod-60471887] Cmd: wget http://10.104.82.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:09:32,634 - DEBUG - [Pod Pod ctest-pod-60471887] Cmd wget http://10.104.82.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:09:32,634 - DEBUG - [Pod Pod ctest-pod-60471887] Cmd output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:09:37,710 - DEBUG - [Pod ctest-pod-60471887] Cmd: wget http://10.104.82.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:09:37,710 - DEBUG - [Pod Pod ctest-pod-60471887] Cmd wget http://10.104.82.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:09:37,710 - DEBUG - [Pod Pod ctest-pod-60471887] Cmd output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:09:42,797 - DEBUG - [Pod ctest-pod-60471887] Cmd: wget http://10.104.82.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:09:42,797 - DEBUG - [Pod Pod ctest-pod-60471887] Cmd wget http://10.104.82.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:09:42,797 - DEBUG - [Pod Pod ctest-pod-60471887] Cmd output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:09:47,879 - DEBUG - [Pod ctest-pod-60471887] Cmd: wget http://10.104.82.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:09:47,879 - DEBUG - [Pod Pod ctest-pod-60471887] Cmd wget http://10.104.82.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:09:47,879 - DEBUG - [Pod Pod ctest-pod-60471887] Cmd output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:09:52,964 - DEBUG - [Pod ctest-pod-60471887] Cmd: wget http://10.104.82.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:09:52,965 - DEBUG - [Pod Pod ctest-pod-60471887] Cmd wget http://10.104.82.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:09:52,965 - DEBUG - [Pod Pod ctest-pod-60471887] Cmd output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:09:52,965 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-15808719': 0, 'ctest-pod-02265345': 0} 2024-08-27 08:09:55,046 - DEBUG - [Pod ctest-pod-77891598] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.757 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.068 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.071 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.068/0.298/0.757 ms 2024-08-27 08:09:55,046 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-77891598 with expectation True passed 2024-08-27 08:09:57,137 - DEBUG - [Pod ctest-pod-78102560] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.753 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.079 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.085 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.079/0.305/0.753 ms 2024-08-27 08:09:57,137 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-78102560 with expectation True passed 2024-08-27 08:09:59,213 - DEBUG - [Pod ctest-pod-60471887] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.508 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.062 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.069 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.062/0.213/0.508 ms 2024-08-27 08:09:59,213 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-60471887 with expectation True passed 2024-08-27 08:09:59,297 - DEBUG - [Pod ctest-pod-77891598] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-27 08:09:59,297 - DEBUG - [Pod Pod ctest-pod-77891598] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-08-27 08:09:59,297 - DEBUG - [Pod Pod ctest-pod-77891598] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-27 08:09:59,297 - INFO - wget check of of http://10.47.255.250 from ctest-pod-77891598 passed 2024-08-27 08:09:59,377 - DEBUG - [Pod ctest-pod-77891598] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-27 08:09:59,377 - DEBUG - [Pod Pod ctest-pod-77891598] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 passed 2024-08-27 08:09:59,377 - DEBUG - [Pod Pod ctest-pod-77891598] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-27 08:09:59,377 - INFO - wget check of of http://10.47.255.249 from ctest-pod-77891598 passed 2024-08-27 08:10:04,458 - DEBUG - [Pod ctest-pod-78102560] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2024-08-27 08:10:04,458 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2024-08-27 08:10:04,458 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2024-08-27 08:10:04,458 - INFO - wget check of of http://10.47.255.249 from ctest-pod-78102560 passed 2024-08-27 08:10:09,600 - DEBUG - [Pod ctest-pod-54165326] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-27 08:10:09,600 - DEBUG - [Pod Pod ctest-pod-54165326] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-27 08:10:09,600 - DEBUG - [Pod Pod ctest-pod-54165326] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-27 08:10:09,600 - INFO - wget check of of http://10.47.255.250 from ctest-pod-54165326 passed 2024-08-27 08:10:09,611 - INFO - Updating Network Policy ingress-on-service 2024-08-27 08:10:14,702 - DEBUG - [Pod ctest-pod-78102560] Cmd: wget http://10.104.82.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:10:14,702 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd wget http://10.104.82.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:10:14,702 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:10:19,789 - DEBUG - [Pod ctest-pod-78102560] Cmd: wget http://10.104.82.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:10:19,789 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd wget http://10.104.82.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:10:19,789 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:10:24,864 - DEBUG - [Pod ctest-pod-78102560] Cmd: wget http://10.104.82.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:10:24,865 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd wget http://10.104.82.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:10:24,865 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:10:29,954 - DEBUG - [Pod ctest-pod-78102560] Cmd: wget http://10.104.82.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:10:29,954 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd wget http://10.104.82.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:10:29,955 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:10:35,047 - DEBUG - [Pod ctest-pod-78102560] Cmd: wget http://10.104.82.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:10:35,047 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd wget http://10.104.82.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:10:35,047 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:10:40,116 - DEBUG - [Pod ctest-pod-78102560] Cmd: wget http://10.104.82.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:10:40,116 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd wget http://10.104.82.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:10:40,116 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:10:45,204 - DEBUG - [Pod ctest-pod-78102560] Cmd: wget http://10.104.82.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:10:45,204 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd wget http://10.104.82.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:10:45,204 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:10:50,726 - DEBUG - [Pod ctest-pod-78102560] Cmd: wget http://10.104.82.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:10:50,726 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd wget http://10.104.82.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:10:50,726 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:10:55,801 - DEBUG - [Pod ctest-pod-78102560] Cmd: wget http://10.104.82.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:10:55,801 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd wget http://10.104.82.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:10:55,801 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:11:00,884 - DEBUG - [Pod ctest-pod-78102560] Cmd: wget http://10.104.82.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:11:00,884 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd wget http://10.104.82.233:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:11:00,884 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd output: Connecting to 10.104.82.233:80 (10.104.82.233:80) wget: download timed out 2024-08-27 08:11:00,884 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-15808719': 0, 'ctest-pod-02265345': 0} 2024-08-27 08:11:00,962 - DEBUG - [Pod ctest-pod-77891598] Cmd: wget http://10.104.82.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.82.233:80 (10.104.82.233:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-15808719 2024-08-27 08:11:00,962 - DEBUG - [Pod Pod ctest-pod-77891598] Cmd wget http://10.104.82.233:80/ -O - -T 5 -t 1 passed 2024-08-27 08:11:00,962 - DEBUG - [Pod Pod ctest-pod-77891598] Cmd output: Connecting to 10.104.82.233:80 (10.104.82.233:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-15808719 2024-08-27 08:11:01,040 - DEBUG - [Pod ctest-pod-77891598] Cmd: wget http://10.104.82.233:80/ -O - -T 5 -t 1 , Output: ctest-pod-15808719 Connecting to 10.104.82.233:80 (10.104.82.233:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 08:11:01,040 - DEBUG - [Pod Pod ctest-pod-77891598] Cmd wget http://10.104.82.233:80/ -O - -T 5 -t 1 passed 2024-08-27 08:11:01,040 - DEBUG - [Pod Pod ctest-pod-77891598] Cmd output: ctest-pod-15808719 Connecting to 10.104.82.233:80 (10.104.82.233:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 08:11:01,112 - DEBUG - [Pod ctest-pod-77891598] Cmd: wget http://10.104.82.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.82.233:80 (10.104.82.233:80) ctest-pod-02265345 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 08:11:01,112 - DEBUG - [Pod Pod ctest-pod-77891598] Cmd wget http://10.104.82.233:80/ -O - -T 5 -t 1 passed 2024-08-27 08:11:01,112 - DEBUG - [Pod Pod ctest-pod-77891598] Cmd output: Connecting to 10.104.82.233:80 (10.104.82.233:80) ctest-pod-02265345 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 08:11:01,112 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-15808719': 2, 'ctest-pod-02265345': 1} 2024-08-27 08:11:01,184 - DEBUG - [Pod ctest-pod-60471887] Cmd: wget http://10.104.82.233:80/ -O - -T 5 -t 1 , Output: ctest-pod-15808719 Connecting to 10.104.82.233:80 (10.104.82.233:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 08:11:01,185 - DEBUG - [Pod Pod ctest-pod-60471887] Cmd wget http://10.104.82.233:80/ -O - -T 5 -t 1 passed 2024-08-27 08:11:01,185 - DEBUG - [Pod Pod ctest-pod-60471887] Cmd output: ctest-pod-15808719 Connecting to 10.104.82.233:80 (10.104.82.233:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 08:11:01,268 - DEBUG - [Pod ctest-pod-60471887] Cmd: wget http://10.104.82.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.82.233:80 (10.104.82.233:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-15808719 2024-08-27 08:11:01,268 - DEBUG - [Pod Pod ctest-pod-60471887] Cmd wget http://10.104.82.233:80/ -O - -T 5 -t 1 passed 2024-08-27 08:11:01,268 - DEBUG - [Pod Pod ctest-pod-60471887] Cmd output: Connecting to 10.104.82.233:80 (10.104.82.233:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-15808719 2024-08-27 08:11:01,343 - DEBUG - [Pod ctest-pod-60471887] Cmd: wget http://10.104.82.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.82.233:80 (10.104.82.233:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-15808719 2024-08-27 08:11:01,343 - DEBUG - [Pod Pod ctest-pod-60471887] Cmd wget http://10.104.82.233:80/ -O - -T 5 -t 1 passed 2024-08-27 08:11:01,343 - DEBUG - [Pod Pod ctest-pod-60471887] Cmd output: Connecting to 10.104.82.233:80 (10.104.82.233:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-15808719 2024-08-27 08:11:01,420 - DEBUG - [Pod ctest-pod-60471887] Cmd: wget http://10.104.82.233:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.82.233:80 (10.104.82.233:80) ctest-pod-02265345 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 08:11:01,420 - DEBUG - [Pod Pod ctest-pod-60471887] Cmd wget http://10.104.82.233:80/ -O - -T 5 -t 1 passed 2024-08-27 08:11:01,420 - DEBUG - [Pod Pod ctest-pod-60471887] Cmd output: Connecting to 10.104.82.233:80 (10.104.82.233:80) ctest-pod-02265345 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-27 08:11:01,420 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-15808719': 3, 'ctest-pod-02265345': 1} 2024-08-27 08:11:03,491 - DEBUG - [Pod ctest-pod-77891598] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.300 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.100 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.069 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.069/0.156/0.300 ms 2024-08-27 08:11:03,491 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-77891598 with expectation True passed 2024-08-27 08:11:05,572 - DEBUG - [Pod ctest-pod-78102560] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.543 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.207 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.095 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.095/0.281/0.543 ms 2024-08-27 08:11:05,572 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-78102560 with expectation True passed 2024-08-27 08:11:07,665 - DEBUG - [Pod ctest-pod-60471887] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=1.101 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.080 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.091 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.080/0.424/1.101 ms 2024-08-27 08:11:07,666 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-60471887 with expectation True passed 2024-08-27 08:11:07,759 - DEBUG - [Pod ctest-pod-77891598] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-27 08:11:07,759 - DEBUG - [Pod Pod ctest-pod-77891598] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-08-27 08:11:07,759 - DEBUG - [Pod Pod ctest-pod-77891598] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-27 08:11:07,759 - INFO - wget check of of http://10.47.255.250 from ctest-pod-77891598 passed 2024-08-27 08:11:07,837 - DEBUG - [Pod ctest-pod-77891598] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-27 08:11:07,837 - DEBUG - [Pod Pod ctest-pod-77891598] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 passed 2024-08-27 08:11:07,837 - DEBUG - [Pod Pod ctest-pod-77891598] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-27 08:11:07,837 - INFO - wget check of of http://10.47.255.249 from ctest-pod-77891598 passed 2024-08-27 08:11:12,948 - DEBUG - [Pod ctest-pod-78102560] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2024-08-27 08:11:12,948 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2024-08-27 08:11:12,948 - DEBUG - [Pod Pod ctest-pod-78102560] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2024-08-27 08:11:12,948 - INFO - wget check of of http://10.47.255.249 from ctest-pod-78102560 passed 2024-08-27 08:11:13,032 - DEBUG - [Pod ctest-pod-54165326] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-27 08:11:13,032 - DEBUG - [Pod Pod ctest-pod-54165326] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-08-27 08:11:13,032 - DEBUG - [Pod Pod ctest-pod-54165326] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-27 08:11:13,032 - INFO - wget check of of http://10.47.255.250 from ctest-pod-54165326 passed 2024-08-27 08:11:13,032 - INFO - Deleting Network Policy : ingress-on-service 2024-08-27 08:11:13,033 - INFO - Deleting service : ctest-nginx-svc-44402305 2024-08-27 08:11:13,587 - DEBUG - No XMPP flaps were noticed during the test 2024-08-27 08:11:13,587 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:10] 2024-08-27 08:11:13,587 - INFO - -------------------------------------------------------------------------------- 2024-08-27 08:11:13,595 - INFO - Deleting pod ctest-new-default-15745934:ctest-pod-15808719 2024-08-27 08:11:13,596 - INFO - Deleting pod ctest-new-default-15745934:ctest-pod-02265345 2024-08-27 08:11:13,597 - INFO - Deleting pod ctest-non-default-80607817:ctest-pod-12976794 2024-08-27 08:11:13,597 - INFO - Deleting pod ctest-non-default-80607817:ctest-pod-16284861 2024-08-27 08:11:13,597 - INFO - Deleting pod ctest-new-default-15745934:ctest-pod-78102560 2024-08-27 08:11:13,598 - INFO - Deleting pod ctest-new-default-15745934:ctest-pod-77891598 2024-08-27 08:11:13,598 - INFO - Deleting pod ctest-non-default-80607817:ctest-pod-60471887 2024-08-27 08:11:13,598 - INFO - Deleting pod ctest-non-default-80607817:ctest-pod-54165326 2024-08-27 08:11:13,693 - WARNING - Pod uuid dc92c7d2-f9c8-4921-a415-61823f2fa39a is still seen in agent 10.0.0.12 VM list 2024-08-27 08:11:13,722 - WARNING - Pod uuid 6058ca58-a652-4a64-8b07-f5af80a81d34 is still seen in agent 10.0.0.12 VM list 2024-08-27 08:11:13,723 - WARNING - Pod uuid 4730ead2-8dd3-4aaf-9421-96074713ebf1 is still seen in agent 10.0.0.12 VM list 2024-08-27 08:11:13,724 - WARNING - Pod uuid 66afb697-8d47-47f0-8cd2-5a486cfb97ca is still seen in agent 10.0.0.12 VM list 2024-08-27 08:11:13,724 - WARNING - Pod uuid 765b9f71-890a-4b3b-a31d-9965cb6b47d4 is still seen in agent 10.0.0.12 VM list 2024-08-27 08:11:13,727 - WARNING - Pod uuid dce9fa11-ad5a-40f9-96af-1a178acbabda is still seen in agent 10.0.0.12 VM list 2024-08-27 08:11:13,729 - WARNING - Pod uuid d34f0c09-b0e7-495c-8e22-f6e561762458 is still seen in agent 10.0.0.12 VM list 2024-08-27 08:11:13,730 - WARNING - Pod uuid 01172447-7e0e-4286-8415-8c8dba78029c is still seen in agent 10.0.0.12 VM list 2024-08-27 08:11:18,705 - WARNING - Pod uuid dc92c7d2-f9c8-4921-a415-61823f2fa39a is still seen in agent 10.0.0.12 VM list 2024-08-27 08:11:18,767 - DEBUG - Pod 765b9f71-890a-4b3b-a31d-9965cb6b47d4 is not in agent 10.0.0.12 VM list 2024-08-27 08:11:18,768 - WARNING - Pod uuid 66afb697-8d47-47f0-8cd2-5a486cfb97ca is still seen in agent 10.0.0.12 VM list 2024-08-27 08:11:18,770 - WARNING - Pod uuid 6058ca58-a652-4a64-8b07-f5af80a81d34 is still seen in agent 10.0.0.12 VM list 2024-08-27 08:11:18,771 - WARNING - Pod uuid 4730ead2-8dd3-4aaf-9421-96074713ebf1 is still seen in agent 10.0.0.12 VM list 2024-08-27 08:11:18,771 - DEBUG - Pod d34f0c09-b0e7-495c-8e22-f6e561762458 is not in agent 10.0.0.12 VM list 2024-08-27 08:11:18,773 - DEBUG - Pod dce9fa11-ad5a-40f9-96af-1a178acbabda is not in agent 10.0.0.12 VM list 2024-08-27 08:11:18,777 - WARNING - Pod uuid 01172447-7e0e-4286-8415-8c8dba78029c is still seen in agent 10.0.0.12 VM list 2024-08-27 08:11:18,784 - DEBUG - VMI 70c84cac-644b-11ef-a483-0242184ef55d is removed from agent 10.0.0.12 2024-08-27 08:11:18,785 - INFO - Verified that pod ctest-pod-15808719 is removed in agent 2024-08-27 08:11:18,787 - DEBUG - VMI 727eb13a-644b-11ef-a483-0242184ef55d is removed from agent 10.0.0.12 2024-08-27 08:11:18,787 - INFO - Verified that pod ctest-pod-12976794 is removed in agent 2024-08-27 08:11:18,788 - DEBUG - VMI 733900bc-644b-11ef-a483-0242184ef55d is removed from agent 10.0.0.12 2024-08-27 08:11:18,788 - INFO - Verified that pod ctest-pod-16284861 is removed in agent 2024-08-27 08:11:23,713 - WARNING - Pod uuid dc92c7d2-f9c8-4921-a415-61823f2fa39a is still seen in agent 10.0.0.12 VM list 2024-08-27 08:11:23,781 - WARNING - Pod uuid 66afb697-8d47-47f0-8cd2-5a486cfb97ca is still seen in agent 10.0.0.12 VM list 2024-08-27 08:11:23,783 - WARNING - Pod uuid 6058ca58-a652-4a64-8b07-f5af80a81d34 is still seen in agent 10.0.0.12 VM list 2024-08-27 08:11:23,784 - WARNING - Pod uuid 4730ead2-8dd3-4aaf-9421-96074713ebf1 is still seen in agent 10.0.0.12 VM list 2024-08-27 08:11:23,788 - WARNING - Pod uuid 01172447-7e0e-4286-8415-8c8dba78029c is still seen in agent 10.0.0.12 VM list 2024-08-27 08:11:28,721 - WARNING - Pod uuid dc92c7d2-f9c8-4921-a415-61823f2fa39a is still seen in agent 10.0.0.12 VM list 2024-08-27 08:11:28,788 - WARNING - Pod uuid 66afb697-8d47-47f0-8cd2-5a486cfb97ca is still seen in agent 10.0.0.12 VM list 2024-08-27 08:11:28,796 - WARNING - Pod uuid 6058ca58-a652-4a64-8b07-f5af80a81d34 is still seen in agent 10.0.0.12 VM list 2024-08-27 08:11:28,799 - WARNING - Pod uuid 4730ead2-8dd3-4aaf-9421-96074713ebf1 is still seen in agent 10.0.0.12 VM list 2024-08-27 08:11:28,801 - WARNING - Pod uuid 01172447-7e0e-4286-8415-8c8dba78029c is still seen in agent 10.0.0.12 VM list 2024-08-27 08:11:33,728 - WARNING - Pod uuid dc92c7d2-f9c8-4921-a415-61823f2fa39a is still seen in agent 10.0.0.12 VM list 2024-08-27 08:11:33,796 - WARNING - Pod uuid 66afb697-8d47-47f0-8cd2-5a486cfb97ca is still seen in agent 10.0.0.12 VM list 2024-08-27 08:11:33,804 - WARNING - Pod uuid 6058ca58-a652-4a64-8b07-f5af80a81d34 is still seen in agent 10.0.0.12 VM list 2024-08-27 08:11:33,809 - WARNING - Pod uuid 4730ead2-8dd3-4aaf-9421-96074713ebf1 is still seen in agent 10.0.0.12 VM list 2024-08-27 08:11:33,811 - WARNING - Pod uuid 01172447-7e0e-4286-8415-8c8dba78029c is still seen in agent 10.0.0.12 VM list 2024-08-27 08:11:38,736 - WARNING - Pod uuid dc92c7d2-f9c8-4921-a415-61823f2fa39a is still seen in agent 10.0.0.12 VM list 2024-08-27 08:11:38,803 - WARNING - Pod uuid 66afb697-8d47-47f0-8cd2-5a486cfb97ca is still seen in agent 10.0.0.12 VM list 2024-08-27 08:11:38,810 - WARNING - Pod uuid 6058ca58-a652-4a64-8b07-f5af80a81d34 is still seen in agent 10.0.0.12 VM list 2024-08-27 08:11:38,820 - WARNING - Pod uuid 4730ead2-8dd3-4aaf-9421-96074713ebf1 is still seen in agent 10.0.0.12 VM list 2024-08-27 08:11:38,822 - WARNING - Pod uuid 01172447-7e0e-4286-8415-8c8dba78029c is still seen in agent 10.0.0.12 VM list 2024-08-27 08:11:43,744 - WARNING - Pod uuid dc92c7d2-f9c8-4921-a415-61823f2fa39a is still seen in agent 10.0.0.12 VM list 2024-08-27 08:11:43,810 - WARNING - Pod uuid 66afb697-8d47-47f0-8cd2-5a486cfb97ca is still seen in agent 10.0.0.12 VM list 2024-08-27 08:11:43,818 - WARNING - Pod uuid 6058ca58-a652-4a64-8b07-f5af80a81d34 is still seen in agent 10.0.0.12 VM list 2024-08-27 08:11:43,833 - WARNING - Pod uuid 4730ead2-8dd3-4aaf-9421-96074713ebf1 is still seen in agent 10.0.0.12 VM list 2024-08-27 08:11:43,834 - WARNING - Pod uuid 01172447-7e0e-4286-8415-8c8dba78029c is still seen in agent 10.0.0.12 VM list 2024-08-27 08:11:48,751 - DEBUG - Pod dc92c7d2-f9c8-4921-a415-61823f2fa39a is not in agent 10.0.0.12 VM list 2024-08-27 08:11:48,757 - DEBUG - VMI 765468fe-644b-11ef-a483-0242184ef55d is removed from agent 10.0.0.12 2024-08-27 08:11:48,757 - INFO - Verified that pod ctest-pod-54165326 is removed in agent 2024-08-27 08:11:48,817 - DEBUG - Pod 66afb697-8d47-47f0-8cd2-5a486cfb97ca is not in agent 10.0.0.12 VM list 2024-08-27 08:11:48,827 - DEBUG - VMI 74056ab2-644b-11ef-a483-0242184ef55d is removed from agent 10.0.0.12 2024-08-27 08:11:48,827 - INFO - Verified that pod ctest-pod-78102560 is removed in agent 2024-08-27 08:11:48,828 - DEBUG - Pod 6058ca58-a652-4a64-8b07-f5af80a81d34 is not in agent 10.0.0.12 VM list 2024-08-27 08:11:48,834 - DEBUG - VMI 758a78be-644b-11ef-a483-0242184ef55d is removed from agent 10.0.0.12 2024-08-27 08:11:48,834 - INFO - Verified that pod ctest-pod-60471887 is removed in agent 2024-08-27 08:11:48,843 - DEBUG - Pod 01172447-7e0e-4286-8415-8c8dba78029c is not in agent 10.0.0.12 VM list 2024-08-27 08:11:48,846 - DEBUG - Pod 4730ead2-8dd3-4aaf-9421-96074713ebf1 is not in agent 10.0.0.12 VM list 2024-08-27 08:11:48,855 - DEBUG - VMI 718801be-644b-11ef-a483-0242184ef55d is removed from agent 10.0.0.12 2024-08-27 08:11:48,855 - INFO - Verified that pod ctest-pod-02265345 is removed in agent 2024-08-27 08:11:48,857 - DEBUG - VMI 74c6f83a-644b-11ef-a483-0242184ef55d is removed from agent 10.0.0.12 2024-08-27 08:11:48,857 - INFO - Verified that pod ctest-pod-77891598 is removed in agent 2024-08-27 08:11:48,857 - INFO - Deleting namespace ctest-non-default-80607817 2024-08-27 08:11:48,867 - DEBUG - Namespace ctest-non-default-80607817 still in k8s 2024-08-27 08:11:50,872 - DEBUG - Namespace ctest-non-default-80607817 still in k8s 2024-08-27 08:11:52,878 - DEBUG - Namespace ctest-non-default-80607817 still in k8s 2024-08-27 08:11:54,882 - DEBUG - Namespace ctest-non-default-80607817 is not in k8s 2024-08-27 08:11:54,882 - DEBUG - No need to check project deletion in contrail-api 2024-08-27 08:11:54,882 - INFO - Deleting namespace ctest-new-default-15745934 2024-08-27 08:11:54,891 - DEBUG - Namespace ctest-new-default-15745934 still in k8s 2024-08-27 08:11:56,897 - DEBUG - Namespace ctest-new-default-15745934 still in k8s 2024-08-27 08:11:58,903 - DEBUG - Namespace ctest-new-default-15745934 still in k8s 2024-08-27 08:12:00,907 - DEBUG - Namespace ctest-new-default-15745934 is not in k8s 2024-08-27 08:12:00,907 - DEBUG - No need to check project deletion in contrail-api