2024-09-18 01:53:58,761 - INFO - Using existing project ['default-domain', 'k8s-default'](e5cf8efe-5dce-41ef-8953-af3705726bf8) 2024-09-18 01:53:58,779 - DEBUG - Namespace ctest-new-default-00544970 not present 2024-09-18 01:53:58,791 - INFO - Created namespace ctest-new-default-00544970 2024-09-18 01:54:01,795 - DEBUG - Namespace ctest-non-default-93873526 not present 2024-09-18 01:54:01,813 - INFO - Created namespace ctest-non-default-93873526 2024-09-18 01:54:04,834 - DEBUG - Pod ctest-pod-78405613 not present 2024-09-18 01:54:04,834 - INFO - Creating Pod ctest-pod-78405613 2024-09-18 01:54:04,876 - DEBUG - Pod : ctest-pod-78405613 UUID is 7306ccbb-06ac-486b-a3fe-6b0e0caab412 2024-09-18 01:54:04,889 - DEBUG - Pod ctest-pod-42924860 not present 2024-09-18 01:54:04,889 - INFO - Creating Pod ctest-pod-42924860 2024-09-18 01:54:04,932 - DEBUG - Pod : ctest-pod-42924860 UUID is 395cd3bb-edba-4700-9450-397c347ba4e2 2024-09-18 01:54:04,948 - DEBUG - Pod ctest-pod-99048269 not present 2024-09-18 01:54:04,950 - INFO - Creating Pod ctest-pod-99048269 2024-09-18 01:54:04,988 - DEBUG - Pod : ctest-pod-99048269 UUID is bc9a693a-92f5-4cf0-81bc-2268d0ab2285 2024-09-18 01:54:04,994 - DEBUG - Pod ctest-pod-55246883 not present 2024-09-18 01:54:04,995 - INFO - Creating Pod ctest-pod-55246883 2024-09-18 01:54:05,031 - DEBUG - Pod : ctest-pod-55246883 UUID is 2ad509ad-d886-492b-a6b5-52962bff062f 2024-09-18 01:54:05,037 - DEBUG - Pod ctest-pod-62469013 not present 2024-09-18 01:54:05,037 - INFO - Creating Pod ctest-pod-62469013 2024-09-18 01:54:05,061 - DEBUG - Pod : ctest-pod-62469013 UUID is a264d937-c8bd-4f59-a3fa-bd1898e46ac6 2024-09-18 01:54:05,063 - DEBUG - Pod ctest-pod-50319095 not present 2024-09-18 01:54:05,063 - INFO - Creating Pod ctest-pod-50319095 2024-09-18 01:54:05,086 - DEBUG - Pod : ctest-pod-50319095 UUID is 5dba06ce-c7f9-424d-a70c-dc521b6c4eb5 2024-09-18 01:54:05,088 - DEBUG - Pod ctest-pod-55491363 not present 2024-09-18 01:54:05,088 - INFO - Creating Pod ctest-pod-55491363 2024-09-18 01:54:05,137 - DEBUG - Pod : ctest-pod-55491363 UUID is e4c71362-7b52-4361-8edf-182db2e2f609 2024-09-18 01:54:05,140 - DEBUG - Pod ctest-pod-76080067 not present 2024-09-18 01:54:05,140 - INFO - Creating Pod ctest-pod-76080067 2024-09-18 01:54:05,166 - DEBUG - Pod : ctest-pod-76080067 UUID is ea596267-cb20-41ee-ae57-d8931f241dc5 2024-09-18 01:54:05,358 - INFO - Project default-domain:k8s-ctest-new-default-00544970 for Namespace ctest-new-default-00544970 is seen in contrail-api 2024-09-18 01:54:05,359 - DEBUG - Project uuid in Contrail is a63f6f56-0362-45ee-8465-8a6c4ed890a0 2024-09-18 01:54:05,502 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_NamespaceDatabaseList?namespace_uuid=971c225e-9947-4224-9cdc-21f92427db91 2024-09-18 01:54:05,541 - INFO - Namespace ctest-new-default-00544970 with uuid 971c225e-9947-4224-9cdc-21f92427db91 found in kube manager 2024-09-18 01:54:05,544 - INFO - Namespace ctest-new-default-00544970 verification passed 2024-09-18 01:54:05,897 - INFO - Project default-domain:k8s-ctest-non-default-93873526 for Namespace ctest-non-default-93873526 is seen in contrail-api 2024-09-18 01:54:05,898 - DEBUG - Project uuid in Contrail is 3b9d4a00-8c70-4c36-82dc-6d09a70bd506 2024-09-18 01:54:05,898 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_NamespaceDatabaseList?namespace_uuid=4bb74c60-5fcd-47f7-afb2-e2c655ff65d4 2024-09-18 01:54:05,904 - INFO - Namespace ctest-non-default-93873526 with uuid 4bb74c60-5fcd-47f7-afb2-e2c655ff65d4 found in kube manager 2024-09-18 01:54:05,904 - INFO - Namespace ctest-non-default-93873526 verification passed 2024-09-18 01:54:05,915 - DEBUG - Pod ctest-pod-78405613 not in running state.Currently in Pending 2024-09-18 01:54:10,921 - DEBUG - Pod ctest-pod-78405613 not in running state.Currently in Pending 2024-09-18 01:54:15,927 - DEBUG - Pod ctest-pod-78405613 not in running state.Currently in Pending 2024-09-18 01:54:20,943 - INFO - Pod ctest-pod-78405613 is in running state.Got IP 10.47.255.251 2024-09-18 01:54:21,021 - DEBUG - Pod ctest-pod-78405613 has vmi e3ed4266-7560-11ef-ae3b-fa163ecab124 2024-09-18 01:54:21,021 - INFO - Verified pod ctest-pod-78405613 in contrail-api 2024-09-18 01:54:21,040 - DEBUG - VMI e3ed4266-7560-11ef-ae3b-fa163ecab124 is active in agent 10.0.0.73 2024-09-18 01:54:21,040 - INFO - Verified Pod ctest-pod-78405613 in agent 10.0.0.73 2024-09-18 01:54:21,041 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=7306ccbb-06ac-486b-a3fe-6b0e0caab412 2024-09-18 01:54:21,048 - INFO - Pod ctest-pod-78405613 with uuid 7306ccbb-06ac-486b-a3fe-6b0e0caab412 found in kube manager 2024-09-18 01:54:21,048 - INFO - Pod ctest-pod-78405613 verification passed 2024-09-18 01:54:21,054 - INFO - Pod ctest-pod-42924860 is in running state.Got IP 10.47.255.250 2024-09-18 01:54:21,076 - DEBUG - Pod ctest-pod-42924860 has vmi e47a1722-7560-11ef-ae3b-fa163ecab124 2024-09-18 01:54:21,076 - INFO - Verified pod ctest-pod-42924860 in contrail-api 2024-09-18 01:54:21,094 - DEBUG - VMI e47a1722-7560-11ef-ae3b-fa163ecab124 is active in agent 10.0.0.73 2024-09-18 01:54:21,095 - INFO - Verified Pod ctest-pod-42924860 in agent 10.0.0.73 2024-09-18 01:54:21,095 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=395cd3bb-edba-4700-9450-397c347ba4e2 2024-09-18 01:54:21,101 - INFO - Pod ctest-pod-42924860 with uuid 395cd3bb-edba-4700-9450-397c347ba4e2 found in kube manager 2024-09-18 01:54:21,101 - INFO - Pod ctest-pod-42924860 verification passed 2024-09-18 01:54:21,106 - DEBUG - Pod ctest-pod-99048269 not in running state.Currently in Pending 2024-09-18 01:54:26,112 - INFO - Pod ctest-pod-99048269 is in running state.Got IP 10.47.255.249 2024-09-18 01:54:26,173 - DEBUG - Pod ctest-pod-99048269 has vmi e53ff1c2-7560-11ef-ae3b-fa163ecab124 2024-09-18 01:54:26,173 - INFO - Verified pod ctest-pod-99048269 in contrail-api 2024-09-18 01:54:26,187 - DEBUG - VMI e53ff1c2-7560-11ef-ae3b-fa163ecab124 is active in agent 10.0.0.73 2024-09-18 01:54:26,187 - INFO - Verified Pod ctest-pod-99048269 in agent 10.0.0.73 2024-09-18 01:54:26,187 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=bc9a693a-92f5-4cf0-81bc-2268d0ab2285 2024-09-18 01:54:26,192 - INFO - Pod ctest-pod-99048269 with uuid bc9a693a-92f5-4cf0-81bc-2268d0ab2285 found in kube manager 2024-09-18 01:54:26,192 - INFO - Pod ctest-pod-99048269 verification passed 2024-09-18 01:54:26,197 - INFO - Pod ctest-pod-55246883 is in running state.Got IP 10.47.255.248 2024-09-18 01:54:26,215 - DEBUG - Pod ctest-pod-55246883 has vmi e5db0608-7560-11ef-ae3b-fa163ecab124 2024-09-18 01:54:26,215 - INFO - Verified pod ctest-pod-55246883 in contrail-api 2024-09-18 01:54:26,227 - DEBUG - VMI e5db0608-7560-11ef-ae3b-fa163ecab124 is active in agent 10.0.0.73 2024-09-18 01:54:26,228 - INFO - Verified Pod ctest-pod-55246883 in agent 10.0.0.73 2024-09-18 01:54:26,228 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=2ad509ad-d886-492b-a6b5-52962bff062f 2024-09-18 01:54:26,233 - INFO - Pod ctest-pod-55246883 with uuid 2ad509ad-d886-492b-a6b5-52962bff062f found in kube manager 2024-09-18 01:54:26,233 - INFO - Pod ctest-pod-55246883 verification passed 2024-09-18 01:54:26,238 - INFO - Pod ctest-pod-62469013 is in running state.Got IP 10.47.255.247 2024-09-18 01:54:26,299 - DEBUG - Pod ctest-pod-62469013 has vmi e672e388-7560-11ef-ae3b-fa163ecab124 2024-09-18 01:54:26,299 - INFO - Verified pod ctest-pod-62469013 in contrail-api 2024-09-18 01:54:26,312 - DEBUG - VMI e672e388-7560-11ef-ae3b-fa163ecab124 is active in agent 10.0.0.73 2024-09-18 01:54:26,312 - INFO - Verified Pod ctest-pod-62469013 in agent 10.0.0.73 2024-09-18 01:54:26,312 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=a264d937-c8bd-4f59-a3fa-bd1898e46ac6 2024-09-18 01:54:26,317 - INFO - Pod ctest-pod-62469013 with uuid a264d937-c8bd-4f59-a3fa-bd1898e46ac6 found in kube manager 2024-09-18 01:54:26,317 - INFO - Pod ctest-pod-62469013 verification passed 2024-09-18 01:54:26,323 - INFO - Pod ctest-pod-55491363 is in running state.Got IP 10.47.255.245 2024-09-18 01:54:26,385 - DEBUG - Pod ctest-pod-55491363 has vmi e77ce850-7560-11ef-ae3b-fa163ecab124 2024-09-18 01:54:26,385 - INFO - Verified pod ctest-pod-55491363 in contrail-api 2024-09-18 01:54:26,398 - DEBUG - VMI e77ce850-7560-11ef-ae3b-fa163ecab124 is active in agent 10.0.0.73 2024-09-18 01:54:26,398 - INFO - Verified Pod ctest-pod-55491363 in agent 10.0.0.73 2024-09-18 01:54:26,398 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=e4c71362-7b52-4361-8edf-182db2e2f609 2024-09-18 01:54:26,403 - INFO - Pod ctest-pod-55491363 with uuid e4c71362-7b52-4361-8edf-182db2e2f609 found in kube manager 2024-09-18 01:54:26,403 - INFO - Pod ctest-pod-55491363 verification passed 2024-09-18 01:54:26,409 - INFO - Pod ctest-pod-50319095 is in running state.Got IP 10.47.255.246 2024-09-18 01:54:26,430 - DEBUG - Pod ctest-pod-50319095 has vmi e6f4b098-7560-11ef-ae3b-fa163ecab124 2024-09-18 01:54:26,430 - INFO - Verified pod ctest-pod-50319095 in contrail-api 2024-09-18 01:54:26,444 - DEBUG - VMI e6f4b098-7560-11ef-ae3b-fa163ecab124 is active in agent 10.0.0.73 2024-09-18 01:54:26,444 - INFO - Verified Pod ctest-pod-50319095 in agent 10.0.0.73 2024-09-18 01:54:26,444 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=5dba06ce-c7f9-424d-a70c-dc521b6c4eb5 2024-09-18 01:54:26,449 - INFO - Pod ctest-pod-50319095 with uuid 5dba06ce-c7f9-424d-a70c-dc521b6c4eb5 found in kube manager 2024-09-18 01:54:26,449 - INFO - Pod ctest-pod-50319095 verification passed 2024-09-18 01:54:26,454 - INFO - Pod ctest-pod-76080067 is in running state.Got IP 10.47.255.244 2024-09-18 01:54:26,514 - DEBUG - Pod ctest-pod-76080067 has vmi e8013d08-7560-11ef-ae3b-fa163ecab124 2024-09-18 01:54:26,514 - INFO - Verified pod ctest-pod-76080067 in contrail-api 2024-09-18 01:54:26,527 - DEBUG - VMI e8013d08-7560-11ef-ae3b-fa163ecab124 is active in agent 10.0.0.73 2024-09-18 01:54:26,527 - INFO - Verified Pod ctest-pod-76080067 in agent 10.0.0.73 2024-09-18 01:54:26,527 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=ea596267-cb20-41ee-ae57-d8931f241dc5 2024-09-18 01:54:26,532 - INFO - Pod ctest-pod-76080067 with uuid ea596267-cb20-41ee-ae57-d8931f241dc5 found in kube manager 2024-09-18 01:54:26,532 - INFO - Pod ctest-pod-76080067 verification passed 2024-09-18 01:54:26,533 - INFO - ================================================================================ 2024-09-18 01:54:26,533 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-09-18 01:54:26,533 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-09-18 01:54:26,762 - DEBUG - Nothing to compare xmpp stats {'10.0.0.73': {'10.0.0.49': '0'}} with 2024-09-18 01:54:26,763 - INFO - Initial checks done. Running the testcase now 2024-09-18 01:54:26,763 - INFO - 2024-09-18 01:54:26,820 - DEBUG - [Pod ctest-pod-78405613] Cmd: echo ctest-pod-78405613 > /usr/share/nginx/html/index.html, Output: 2024-09-18 01:54:26,877 - DEBUG - [Pod ctest-pod-42924860] Cmd: echo ctest-pod-42924860 > /usr/share/nginx/html/index.html, Output: 2024-09-18 01:54:26,933 - DEBUG - [Pod ctest-pod-99048269] Cmd: echo ctest-pod-99048269 > /usr/share/nginx/html/index.html, Output: 2024-09-18 01:54:26,998 - DEBUG - [Pod ctest-pod-55246883] Cmd: echo ctest-pod-55246883 > /usr/share/nginx/html/index.html, Output: 2024-09-18 01:54:27,001 - DEBUG - Service ctest-nginx-svc-97296293 not present 2024-09-18 01:54:27,001 - INFO - Creating service ctest-nginx-svc-97296293 2024-09-18 01:54:27,017 - INFO - Created Service ctest-nginx-svc-97296293 2024-09-18 01:54:27,022 - WARNING - Service UUID f511de2c-95d0-4dab-8ff5-f812428155c5 not yet found in contrail-api 2024-09-18 01:54:28,032 - INFO - Validated that Service ctest-nginx-svc-97296293 is seen in contrail-api 2024-09-18 01:54:28,033 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_LoadbalancerDatabaseList?x=f511de2c-95d0-4dab-8ff5-f812428155c5 2024-09-18 01:54:28,037 - INFO - Service ctest-nginx-svc-97296293 with uuid f511de2c-95d0-4dab-8ff5-f812428155c5 found in kube manager 2024-09-18 01:54:28,037 - INFO - Service ctest-nginx-svc-97296293 verification passed 2024-09-18 01:54:29,096 - DEBUG - [Pod ctest-pod-62469013] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.114.78:80 (10.108.114.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-78405613 2024-09-18 01:54:29,096 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 passed 2024-09-18 01:54:29,096 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd output: Connecting to 10.108.114.78:80 (10.108.114.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-78405613 2024-09-18 01:54:29,171 - DEBUG - [Pod ctest-pod-62469013] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: ctest-pod-78405613 Connecting to 10.108.114.78:80 (10.108.114.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 01:54:29,171 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 passed 2024-09-18 01:54:29,171 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd output: ctest-pod-78405613 Connecting to 10.108.114.78:80 (10.108.114.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 01:54:29,243 - DEBUG - [Pod ctest-pod-62469013] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: ctest-pod-42924860 Connecting to 10.108.114.78:80 (10.108.114.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 01:54:29,243 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 passed 2024-09-18 01:54:29,243 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd output: ctest-pod-42924860 Connecting to 10.108.114.78:80 (10.108.114.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 01:54:29,243 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-78405613': 2, 'ctest-pod-42924860': 1} 2024-09-18 01:54:29,304 - DEBUG - [Pod ctest-pod-55491363] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: ctest-pod-42924860 Connecting to 10.108.114.78:80 (10.108.114.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 01:54:29,304 - DEBUG - [Pod Pod ctest-pod-55491363] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 passed 2024-09-18 01:54:29,304 - DEBUG - [Pod Pod ctest-pod-55491363] Cmd output: ctest-pod-42924860 Connecting to 10.108.114.78:80 (10.108.114.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 01:54:29,361 - DEBUG - [Pod ctest-pod-55491363] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: ctest-pod-42924860 Connecting to 10.108.114.78:80 (10.108.114.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 01:54:29,362 - DEBUG - [Pod Pod ctest-pod-55491363] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 passed 2024-09-18 01:54:29,362 - DEBUG - [Pod Pod ctest-pod-55491363] Cmd output: ctest-pod-42924860 Connecting to 10.108.114.78:80 (10.108.114.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 01:54:29,425 - DEBUG - [Pod ctest-pod-55491363] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: ctest-pod-78405613 Connecting to 10.108.114.78:80 (10.108.114.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 01:54:29,425 - DEBUG - [Pod Pod ctest-pod-55491363] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 passed 2024-09-18 01:54:29,425 - DEBUG - [Pod Pod ctest-pod-55491363] Cmd output: ctest-pod-78405613 Connecting to 10.108.114.78:80 (10.108.114.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 01:54:29,425 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-78405613': 1, 'ctest-pod-42924860': 2} 2024-09-18 01:54:29,429 - DEBUG - Network policy ingress-on-service not present 2024-09-18 01:54:29,429 - INFO - Creating Network Policy ingress-on-service 2024-09-18 01:54:29,440 - INFO - Network policy found in k8s 2024-09-18 01:54:29,440 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=ff08b84d-5107-4653-a976-527ee90bab38 2024-09-18 01:54:29,447 - INFO - Network Policy ingress-on-service with uuid ff08b84d-5107-4653-a976-527ee90bab38 found in kube manager 2024-09-18 01:54:29,477 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-09-18 01:54:29,477 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-09-18 01:54:29,477 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=ff08b84d-5107-4653-a976-527ee90bab38 2024-09-18 01:54:29,508 - WARNING - Network policy with name ingress-on-service not found in agent 2024-09-18 01:54:31,509 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=ff08b84d-5107-4653-a976-527ee90bab38 2024-09-18 01:54:31,545 - INFO - Network policy with name ingress-on-service found in agent 2024-09-18 01:54:31,545 - INFO - Network Policy ingress-on-service verification passed 2024-09-18 01:54:36,601 - DEBUG - [Pod ctest-pod-62469013] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:54:36,602 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:54:36,602 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:54:41,673 - DEBUG - [Pod ctest-pod-62469013] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:54:41,673 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:54:41,673 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:54:46,737 - DEBUG - [Pod ctest-pod-62469013] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:54:46,737 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:54:46,737 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:54:51,803 - DEBUG - [Pod ctest-pod-62469013] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:54:51,803 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:54:51,803 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:54:56,872 - DEBUG - [Pod ctest-pod-62469013] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:54:56,873 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:54:56,873 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:55:01,936 - DEBUG - [Pod ctest-pod-62469013] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:55:01,937 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:55:01,937 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:55:07,004 - DEBUG - [Pod ctest-pod-62469013] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:55:07,005 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:55:07,005 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:55:12,060 - DEBUG - [Pod ctest-pod-62469013] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:55:12,061 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:55:12,061 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:55:17,128 - DEBUG - [Pod ctest-pod-62469013] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:55:17,129 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:55:17,129 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:55:22,177 - DEBUG - [Pod ctest-pod-62469013] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:55:22,177 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:55:22,177 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:55:22,177 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-78405613': 0, 'ctest-pod-42924860': 0} 2024-09-18 01:55:22,228 - DEBUG - [Pod ctest-pod-50319095] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.114.78:80 (10.108.114.78:80) ctest-pod-78405613 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 01:55:22,228 - DEBUG - [Pod Pod ctest-pod-50319095] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 passed 2024-09-18 01:55:22,228 - DEBUG - [Pod Pod ctest-pod-50319095] Cmd output: Connecting to 10.108.114.78:80 (10.108.114.78:80) ctest-pod-78405613 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 01:55:22,293 - DEBUG - [Pod ctest-pod-50319095] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: ctest-pod-78405613 Connecting to 10.108.114.78:80 (10.108.114.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 01:55:22,293 - DEBUG - [Pod Pod ctest-pod-50319095] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 passed 2024-09-18 01:55:22,293 - DEBUG - [Pod Pod ctest-pod-50319095] Cmd output: ctest-pod-78405613 Connecting to 10.108.114.78:80 (10.108.114.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 01:55:22,350 - DEBUG - [Pod ctest-pod-50319095] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.114.78:80 (10.108.114.78:80) ctest-pod-42924860 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 01:55:22,350 - DEBUG - [Pod Pod ctest-pod-50319095] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 passed 2024-09-18 01:55:22,350 - DEBUG - [Pod Pod ctest-pod-50319095] Cmd output: Connecting to 10.108.114.78:80 (10.108.114.78:80) ctest-pod-42924860 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 01:55:22,350 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-78405613': 2, 'ctest-pod-42924860': 1} 2024-09-18 01:55:27,454 - DEBUG - [Pod ctest-pod-55491363] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:55:27,454 - DEBUG - [Pod Pod ctest-pod-55491363] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:55:27,454 - DEBUG - [Pod Pod ctest-pod-55491363] Cmd output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:55:34,505 - DEBUG - [Pod ctest-pod-55491363] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:55:34,505 - DEBUG - [Pod Pod ctest-pod-55491363] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:55:34,505 - DEBUG - [Pod Pod ctest-pod-55491363] Cmd output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:55:39,576 - DEBUG - [Pod ctest-pod-55491363] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:55:39,576 - DEBUG - [Pod Pod ctest-pod-55491363] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:55:39,576 - DEBUG - [Pod Pod ctest-pod-55491363] Cmd output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:55:44,657 - DEBUG - [Pod ctest-pod-55491363] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:55:44,657 - DEBUG - [Pod Pod ctest-pod-55491363] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:55:44,657 - DEBUG - [Pod Pod ctest-pod-55491363] Cmd output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:55:50,343 - DEBUG - [Pod ctest-pod-55491363] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:55:50,343 - DEBUG - [Pod Pod ctest-pod-55491363] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:55:50,343 - DEBUG - [Pod Pod ctest-pod-55491363] Cmd output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:55:55,399 - DEBUG - [Pod ctest-pod-55491363] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:55:55,399 - DEBUG - [Pod Pod ctest-pod-55491363] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:55:55,399 - DEBUG - [Pod Pod ctest-pod-55491363] Cmd output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:56:00,476 - DEBUG - [Pod ctest-pod-55491363] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:56:00,476 - DEBUG - [Pod Pod ctest-pod-55491363] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:56:00,476 - DEBUG - [Pod Pod ctest-pod-55491363] Cmd output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:56:05,541 - DEBUG - [Pod ctest-pod-55491363] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:56:05,541 - DEBUG - [Pod Pod ctest-pod-55491363] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:56:05,541 - DEBUG - [Pod Pod ctest-pod-55491363] Cmd output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:56:10,601 - DEBUG - [Pod ctest-pod-55491363] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:56:10,601 - DEBUG - [Pod Pod ctest-pod-55491363] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:56:10,601 - DEBUG - [Pod Pod ctest-pod-55491363] Cmd output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:56:15,665 - DEBUG - [Pod ctest-pod-55491363] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:56:15,665 - DEBUG - [Pod Pod ctest-pod-55491363] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:56:15,665 - DEBUG - [Pod Pod ctest-pod-55491363] Cmd output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:56:15,665 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-78405613': 0, 'ctest-pod-42924860': 0} 2024-09-18 01:56:17,746 - DEBUG - [Pod ctest-pod-50319095] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.736 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.076 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.099 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.076/0.303/0.736 ms 2024-09-18 01:56:17,746 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-50319095 with expectation True passed 2024-09-18 01:56:19,801 - DEBUG - [Pod ctest-pod-62469013] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.690 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.093 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.083 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.083/0.288/0.690 ms 2024-09-18 01:56:19,801 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-62469013 with expectation True passed 2024-09-18 01:56:21,862 - DEBUG - [Pod ctest-pod-55491363] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.629 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.088 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.070/0.262/0.629 ms 2024-09-18 01:56:21,862 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-55491363 with expectation True passed 2024-09-18 01:56:21,913 - DEBUG - [Pod ctest-pod-50319095] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 01:56:21,913 - DEBUG - [Pod Pod ctest-pod-50319095] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-18 01:56:21,913 - DEBUG - [Pod Pod ctest-pod-50319095] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 01:56:21,913 - INFO - wget check of of http://10.47.255.251 from ctest-pod-50319095 passed 2024-09-18 01:56:21,966 - DEBUG - [Pod ctest-pod-50319095] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 01:56:21,966 - DEBUG - [Pod Pod ctest-pod-50319095] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-09-18 01:56:21,966 - DEBUG - [Pod Pod ctest-pod-50319095] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 01:56:21,966 - INFO - wget check of of http://10.47.255.250 from ctest-pod-50319095 passed 2024-09-18 01:56:27,017 - DEBUG - [Pod ctest-pod-62469013] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-18 01:56:27,017 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-18 01:56:27,017 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-18 01:56:27,017 - INFO - wget check of of http://10.47.255.250 from ctest-pod-62469013 passed 2024-09-18 01:56:32,069 - DEBUG - [Pod ctest-pod-76080067] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-18 01:56:32,070 - DEBUG - [Pod Pod ctest-pod-76080067] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-18 01:56:32,070 - DEBUG - [Pod Pod ctest-pod-76080067] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-18 01:56:32,070 - INFO - wget check of of http://10.47.255.251 from ctest-pod-76080067 passed 2024-09-18 01:56:32,088 - INFO - Updating Network Policy ingress-on-service 2024-09-18 01:56:37,192 - DEBUG - [Pod ctest-pod-62469013] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:56:37,192 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:56:37,192 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:56:42,253 - DEBUG - [Pod ctest-pod-62469013] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:56:42,253 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:56:42,253 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:56:47,305 - DEBUG - [Pod ctest-pod-62469013] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:56:47,305 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:56:47,305 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:56:52,364 - DEBUG - [Pod ctest-pod-62469013] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:56:52,365 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:56:52,365 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:56:57,432 - DEBUG - [Pod ctest-pod-62469013] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:56:57,433 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:56:57,433 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:57:02,507 - DEBUG - [Pod ctest-pod-62469013] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:57:02,507 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:57:02,507 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:57:07,561 - DEBUG - [Pod ctest-pod-62469013] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:57:07,561 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:57:07,561 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:57:12,621 - DEBUG - [Pod ctest-pod-62469013] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:57:12,621 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:57:12,621 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:57:17,698 - DEBUG - [Pod ctest-pod-62469013] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:57:17,698 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:57:17,698 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:57:22,751 - DEBUG - [Pod ctest-pod-62469013] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:57:22,751 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:57:22,751 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd output: Connecting to 10.108.114.78:80 (10.108.114.78:80) wget: download timed out 2024-09-18 01:57:22,751 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-78405613': 0, 'ctest-pod-42924860': 0} 2024-09-18 01:57:22,813 - DEBUG - [Pod ctest-pod-50319095] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.114.78:80 (10.108.114.78:80) ctest-pod-78405613 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 01:57:22,813 - DEBUG - [Pod Pod ctest-pod-50319095] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 passed 2024-09-18 01:57:22,813 - DEBUG - [Pod Pod ctest-pod-50319095] Cmd output: Connecting to 10.108.114.78:80 (10.108.114.78:80) ctest-pod-78405613 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 01:57:22,868 - DEBUG - [Pod ctest-pod-50319095] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: ctest-pod-78405613 Connecting to 10.108.114.78:80 (10.108.114.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 01:57:22,868 - DEBUG - [Pod Pod ctest-pod-50319095] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 passed 2024-09-18 01:57:22,868 - DEBUG - [Pod Pod ctest-pod-50319095] Cmd output: ctest-pod-78405613 Connecting to 10.108.114.78:80 (10.108.114.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 01:57:22,929 - DEBUG - [Pod ctest-pod-50319095] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: ctest-pod-78405613 Connecting to 10.108.114.78:80 (10.108.114.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 01:57:22,929 - DEBUG - [Pod Pod ctest-pod-50319095] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 passed 2024-09-18 01:57:22,929 - DEBUG - [Pod Pod ctest-pod-50319095] Cmd output: ctest-pod-78405613 Connecting to 10.108.114.78:80 (10.108.114.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 01:57:23,008 - DEBUG - [Pod ctest-pod-50319095] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: ctest-pod-42924860 Connecting to 10.108.114.78:80 (10.108.114.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 01:57:23,008 - DEBUG - [Pod Pod ctest-pod-50319095] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 passed 2024-09-18 01:57:23,008 - DEBUG - [Pod Pod ctest-pod-50319095] Cmd output: ctest-pod-42924860 Connecting to 10.108.114.78:80 (10.108.114.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 01:57:23,008 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-78405613': 3, 'ctest-pod-42924860': 1} 2024-09-18 01:57:23,061 - DEBUG - [Pod ctest-pod-55491363] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: ctest-pod-78405613 Connecting to 10.108.114.78:80 (10.108.114.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 01:57:23,061 - DEBUG - [Pod Pod ctest-pod-55491363] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 passed 2024-09-18 01:57:23,061 - DEBUG - [Pod Pod ctest-pod-55491363] Cmd output: ctest-pod-78405613 Connecting to 10.108.114.78:80 (10.108.114.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 01:57:23,119 - DEBUG - [Pod ctest-pod-55491363] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: ctest-pod-78405613 Connecting to 10.108.114.78:80 (10.108.114.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 01:57:23,119 - DEBUG - [Pod Pod ctest-pod-55491363] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 passed 2024-09-18 01:57:23,119 - DEBUG - [Pod Pod ctest-pod-55491363] Cmd output: ctest-pod-78405613 Connecting to 10.108.114.78:80 (10.108.114.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 01:57:23,173 - DEBUG - [Pod ctest-pod-55491363] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: ctest-pod-78405613 Connecting to 10.108.114.78:80 (10.108.114.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 01:57:23,173 - DEBUG - [Pod Pod ctest-pod-55491363] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 passed 2024-09-18 01:57:23,173 - DEBUG - [Pod Pod ctest-pod-55491363] Cmd output: ctest-pod-78405613 Connecting to 10.108.114.78:80 (10.108.114.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 01:57:23,220 - DEBUG - [Pod ctest-pod-55491363] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: ctest-pod-78405613 Connecting to 10.108.114.78:80 (10.108.114.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 01:57:23,220 - DEBUG - [Pod Pod ctest-pod-55491363] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 passed 2024-09-18 01:57:23,220 - DEBUG - [Pod Pod ctest-pod-55491363] Cmd output: ctest-pod-78405613 Connecting to 10.108.114.78:80 (10.108.114.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 01:57:23,275 - DEBUG - [Pod ctest-pod-55491363] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.114.78:80 (10.108.114.78:80) ctest-pod-78405613 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 01:57:23,276 - DEBUG - [Pod Pod ctest-pod-55491363] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 passed 2024-09-18 01:57:23,276 - DEBUG - [Pod Pod ctest-pod-55491363] Cmd output: Connecting to 10.108.114.78:80 (10.108.114.78:80) ctest-pod-78405613 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 01:57:23,342 - DEBUG - [Pod ctest-pod-55491363] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: ctest-pod-78405613 Connecting to 10.108.114.78:80 (10.108.114.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 01:57:23,342 - DEBUG - [Pod Pod ctest-pod-55491363] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 passed 2024-09-18 01:57:23,342 - DEBUG - [Pod Pod ctest-pod-55491363] Cmd output: ctest-pod-78405613 Connecting to 10.108.114.78:80 (10.108.114.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-18 01:57:23,416 - DEBUG - [Pod ctest-pod-55491363] Cmd: wget http://10.108.114.78:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.114.78:80 (10.108.114.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-42924860 2024-09-18 01:57:23,416 - DEBUG - [Pod Pod ctest-pod-55491363] Cmd wget http://10.108.114.78:80/ -O - -T 5 -t 1 passed 2024-09-18 01:57:23,416 - DEBUG - [Pod Pod ctest-pod-55491363] Cmd output: Connecting to 10.108.114.78:80 (10.108.114.78:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-42924860 2024-09-18 01:57:23,416 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-78405613': 6, 'ctest-pod-42924860': 1} 2024-09-18 01:57:25,478 - DEBUG - [Pod ctest-pod-50319095] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.554 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.072 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.077 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.072/0.234/0.554 ms 2024-09-18 01:57:25,478 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-50319095 with expectation True passed 2024-09-18 01:57:27,555 - DEBUG - [Pod ctest-pod-62469013] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.364 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.066 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.103 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.066/0.511/1.364 ms 2024-09-18 01:57:27,556 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-62469013 with expectation True passed 2024-09-18 01:57:29,624 - DEBUG - [Pod ctest-pod-55491363] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.098 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.086 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.076 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.076/0.420/1.098 ms 2024-09-18 01:57:29,624 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-55491363 with expectation True passed 2024-09-18 01:57:29,693 - DEBUG - [Pod ctest-pod-50319095] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 01:57:29,693 - DEBUG - [Pod Pod ctest-pod-50319095] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-18 01:57:29,693 - DEBUG - [Pod Pod ctest-pod-50319095] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 01:57:29,693 - INFO - wget check of of http://10.47.255.251 from ctest-pod-50319095 passed 2024-09-18 01:57:29,754 - DEBUG - [Pod ctest-pod-50319095] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 01:57:29,754 - DEBUG - [Pod Pod ctest-pod-50319095] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-09-18 01:57:29,754 - DEBUG - [Pod Pod ctest-pod-50319095] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 01:57:29,754 - INFO - wget check of of http://10.47.255.250 from ctest-pod-50319095 passed 2024-09-18 01:57:34,816 - DEBUG - [Pod ctest-pod-62469013] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-18 01:57:34,816 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-18 01:57:34,816 - DEBUG - [Pod Pod ctest-pod-62469013] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-18 01:57:34,816 - INFO - wget check of of http://10.47.255.250 from ctest-pod-62469013 passed 2024-09-18 01:57:34,873 - DEBUG - [Pod ctest-pod-76080067] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 01:57:34,874 - DEBUG - [Pod Pod ctest-pod-76080067] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-18 01:57:34,874 - DEBUG - [Pod Pod ctest-pod-76080067] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-18 01:57:34,874 - INFO - wget check of of http://10.47.255.251 from ctest-pod-76080067 passed 2024-09-18 01:57:34,874 - INFO - Deleting Network Policy : ingress-on-service 2024-09-18 01:57:34,874 - INFO - Deleting service : ctest-nginx-svc-97296293 2024-09-18 01:57:35,104 - DEBUG - No XMPP flaps were noticed during the test
2024-09-18 01:57:35,104 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:09]
2024-09-18 01:57:35,104 - INFO - -------------------------------------------------------------------------------- 2024-09-18 01:57:35,109 - INFO - Deleting pod ctest-new-default-00544970:ctest-pod-78405613 2024-09-18 01:57:35,110 - INFO - Deleting pod ctest-new-default-00544970:ctest-pod-42924860 2024-09-18 01:57:35,110 - INFO - Deleting pod ctest-non-default-93873526:ctest-pod-99048269 2024-09-18 01:57:35,111 - INFO - Deleting pod ctest-non-default-93873526:ctest-pod-55246883 2024-09-18 01:57:35,111 - INFO - Deleting pod ctest-new-default-00544970:ctest-pod-62469013 2024-09-18 01:57:35,111 - INFO - Deleting pod ctest-new-default-00544970:ctest-pod-50319095 2024-09-18 01:57:35,112 - INFO - Deleting pod ctest-non-default-93873526:ctest-pod-55491363 2024-09-18 01:57:35,112 - INFO - Deleting pod ctest-non-default-93873526:ctest-pod-76080067 2024-09-18 01:57:35,165 - WARNING - Pod uuid 7306ccbb-06ac-486b-a3fe-6b0e0caab412 is still seen in agent 10.0.0.73 VM list 2024-09-18 01:57:35,167 - WARNING - Pod uuid e4c71362-7b52-4361-8edf-182db2e2f609 is still seen in agent 10.0.0.73 VM list 2024-09-18 01:57:35,194 - WARNING - Pod uuid bc9a693a-92f5-4cf0-81bc-2268d0ab2285 is still seen in agent 10.0.0.73 VM list 2024-09-18 01:57:35,195 - WARNING - Pod uuid ea596267-cb20-41ee-ae57-d8931f241dc5 is still seen in agent 10.0.0.73 VM list 2024-09-18 01:57:35,195 - WARNING - Pod uuid 2ad509ad-d886-492b-a6b5-52962bff062f is still seen in agent 10.0.0.73 VM list 2024-09-18 01:57:35,195 - WARNING - Pod uuid a264d937-c8bd-4f59-a3fa-bd1898e46ac6 is still seen in agent 10.0.0.73 VM list 2024-09-18 01:57:35,196 - WARNING - Pod uuid 395cd3bb-edba-4700-9450-397c347ba4e2 is still seen in agent 10.0.0.73 VM list 2024-09-18 01:57:35,196 - WARNING - Pod uuid 5dba06ce-c7f9-424d-a70c-dc521b6c4eb5 is still seen in agent 10.0.0.73 VM list 2024-09-18 01:57:40,174 - DEBUG - Pod 7306ccbb-06ac-486b-a3fe-6b0e0caab412 is not in agent 10.0.0.73 VM list 2024-09-18 01:57:40,218 - DEBUG - Pod 2ad509ad-d886-492b-a6b5-52962bff062f is not in agent 10.0.0.73 VM list 2024-09-18 01:57:40,222 - WARNING - Pod uuid 5dba06ce-c7f9-424d-a70c-dc521b6c4eb5 is still seen in agent 10.0.0.73 VM list 2024-09-18 01:57:40,222 - DEBUG - Pod 395cd3bb-edba-4700-9450-397c347ba4e2 is not in agent 10.0.0.73 VM list 2024-09-18 01:57:40,224 - WARNING - Pod uuid a264d937-c8bd-4f59-a3fa-bd1898e46ac6 is still seen in agent 10.0.0.73 VM list 2024-09-18 01:57:40,224 - WARNING - Pod uuid ea596267-cb20-41ee-ae57-d8931f241dc5 is still seen in agent 10.0.0.73 VM list 2024-09-18 01:57:40,225 - DEBUG - Pod bc9a693a-92f5-4cf0-81bc-2268d0ab2285 is not in agent 10.0.0.73 VM list 2024-09-18 01:57:40,235 - DEBUG - VMI e47a1722-7560-11ef-ae3b-fa163ecab124 is removed from agent 10.0.0.73 2024-09-18 01:57:40,235 - INFO - Verified that pod ctest-pod-42924860 is removed in agent 2024-09-18 01:57:40,237 - DEBUG - VMI e53ff1c2-7560-11ef-ae3b-fa163ecab124 is removed from agent 10.0.0.73 2024-09-18 01:57:40,238 - INFO - Verified that pod ctest-pod-99048269 is removed in agent 2024-09-18 01:57:40,238 - DEBUG - VMI e5db0608-7560-11ef-ae3b-fa163ecab124 is removed from agent 10.0.0.73 2024-09-18 01:57:40,238 - INFO - Verified that pod ctest-pod-55246883 is removed in agent 2024-09-18 01:57:41,184 - WARNING - Pod uuid e4c71362-7b52-4361-8edf-182db2e2f609 is still seen in agent 10.0.0.73 VM list 2024-09-18 01:57:41,185 - DEBUG - VMI e3ed4266-7560-11ef-ae3b-fa163ecab124 is removed from agent 10.0.0.73 2024-09-18 01:57:41,185 - INFO - Verified that pod ctest-pod-78405613 is removed in agent 2024-09-18 01:57:45,237 - WARNING - Pod uuid 5dba06ce-c7f9-424d-a70c-dc521b6c4eb5 is still seen in agent 10.0.0.73 VM list 2024-09-18 01:57:45,238 - WARNING - Pod uuid ea596267-cb20-41ee-ae57-d8931f241dc5 is still seen in agent 10.0.0.73 VM list 2024-09-18 01:57:45,239 - WARNING - Pod uuid a264d937-c8bd-4f59-a3fa-bd1898e46ac6 is still seen in agent 10.0.0.73 VM list 2024-09-18 01:57:46,192 - WARNING - Pod uuid e4c71362-7b52-4361-8edf-182db2e2f609 is still seen in agent 10.0.0.73 VM list 2024-09-18 01:57:50,252 - WARNING - Pod uuid 5dba06ce-c7f9-424d-a70c-dc521b6c4eb5 is still seen in agent 10.0.0.73 VM list 2024-09-18 01:57:50,254 - WARNING - Pod uuid ea596267-cb20-41ee-ae57-d8931f241dc5 is still seen in agent 10.0.0.73 VM list 2024-09-18 01:57:50,254 - WARNING - Pod uuid a264d937-c8bd-4f59-a3fa-bd1898e46ac6 is still seen in agent 10.0.0.73 VM list 2024-09-18 01:57:51,200 - WARNING - Pod uuid e4c71362-7b52-4361-8edf-182db2e2f609 is still seen in agent 10.0.0.73 VM list 2024-09-18 01:57:55,266 - WARNING - Pod uuid 5dba06ce-c7f9-424d-a70c-dc521b6c4eb5 is still seen in agent 10.0.0.73 VM list 2024-09-18 01:57:55,267 - WARNING - Pod uuid ea596267-cb20-41ee-ae57-d8931f241dc5 is still seen in agent 10.0.0.73 VM list 2024-09-18 01:57:55,268 - WARNING - Pod uuid a264d937-c8bd-4f59-a3fa-bd1898e46ac6 is still seen in agent 10.0.0.73 VM list 2024-09-18 01:57:57,617 - WARNING - Pod uuid e4c71362-7b52-4361-8edf-182db2e2f609 is still seen in agent 10.0.0.73 VM list 2024-09-18 01:58:00,281 - WARNING - Pod uuid 5dba06ce-c7f9-424d-a70c-dc521b6c4eb5 is still seen in agent 10.0.0.73 VM list 2024-09-18 01:58:00,283 - WARNING - Pod uuid a264d937-c8bd-4f59-a3fa-bd1898e46ac6 is still seen in agent 10.0.0.73 VM list 2024-09-18 01:58:00,283 - WARNING - Pod uuid ea596267-cb20-41ee-ae57-d8931f241dc5 is still seen in agent 10.0.0.73 VM list 2024-09-18 01:58:02,624 - WARNING - Pod uuid e4c71362-7b52-4361-8edf-182db2e2f609 is still seen in agent 10.0.0.73 VM list 2024-09-18 01:58:05,301 - WARNING - Pod uuid a264d937-c8bd-4f59-a3fa-bd1898e46ac6 is still seen in agent 10.0.0.73 VM list 2024-09-18 01:58:05,302 - WARNING - Pod uuid 5dba06ce-c7f9-424d-a70c-dc521b6c4eb5 is still seen in agent 10.0.0.73 VM list 2024-09-18 01:58:05,306 - WARNING - Pod uuid ea596267-cb20-41ee-ae57-d8931f241dc5 is still seen in agent 10.0.0.73 VM list 2024-09-18 01:58:08,170 - WARNING - Pod uuid e4c71362-7b52-4361-8edf-182db2e2f609 is still seen in agent 10.0.0.73 VM list 2024-09-18 01:58:10,316 - DEBUG - Pod 5dba06ce-c7f9-424d-a70c-dc521b6c4eb5 is not in agent 10.0.0.73 VM list 2024-09-18 01:58:10,321 - DEBUG - Pod ea596267-cb20-41ee-ae57-d8931f241dc5 is not in agent 10.0.0.73 VM list 2024-09-18 01:58:10,322 - WARNING - Pod uuid a264d937-c8bd-4f59-a3fa-bd1898e46ac6 is still seen in agent 10.0.0.73 VM list 2024-09-18 01:58:10,337 - DEBUG - VMI e6f4b098-7560-11ef-ae3b-fa163ecab124 is removed from agent 10.0.0.73 2024-09-18 01:58:10,337 - INFO - Verified that pod ctest-pod-50319095 is removed in agent 2024-09-18 01:58:10,338 - DEBUG - VMI e8013d08-7560-11ef-ae3b-fa163ecab124 is removed from agent 10.0.0.73 2024-09-18 01:58:10,338 - INFO - Verified that pod ctest-pod-76080067 is removed in agent 2024-09-18 01:58:13,178 - DEBUG - Pod e4c71362-7b52-4361-8edf-182db2e2f609 is not in agent 10.0.0.73 VM list 2024-09-18 01:58:13,185 - DEBUG - VMI e77ce850-7560-11ef-ae3b-fa163ecab124 is removed from agent 10.0.0.73 2024-09-18 01:58:13,185 - INFO - Verified that pod ctest-pod-55491363 is removed in agent 2024-09-18 01:58:15,330 - DEBUG - Pod a264d937-c8bd-4f59-a3fa-bd1898e46ac6 is not in agent 10.0.0.73 VM list 2024-09-18 01:58:15,336 - DEBUG - VMI e672e388-7560-11ef-ae3b-fa163ecab124 is removed from agent 10.0.0.73 2024-09-18 01:58:15,336 - INFO - Verified that pod ctest-pod-62469013 is removed in agent 2024-09-18 01:58:15,336 - INFO - Deleting namespace ctest-non-default-93873526 2024-09-18 01:58:15,345 - DEBUG - Namespace ctest-non-default-93873526 still in k8s 2024-09-18 01:58:17,349 - DEBUG - Namespace ctest-non-default-93873526 still in k8s 2024-09-18 01:58:19,353 - DEBUG - Namespace ctest-non-default-93873526 still in k8s 2024-09-18 01:58:21,357 - DEBUG - Namespace ctest-non-default-93873526 is not in k8s 2024-09-18 01:58:21,357 - DEBUG - No need to check project deletion in contrail-api 2024-09-18 01:58:21,357 - INFO - Deleting namespace ctest-new-default-00544970 2024-09-18 01:58:21,369 - DEBUG - Namespace ctest-new-default-00544970 still in k8s 2024-09-18 01:58:23,373 - DEBUG - Namespace ctest-new-default-00544970 still in k8s 2024-09-18 01:58:25,378 - DEBUG - Namespace ctest-new-default-00544970 still in k8s 2024-09-18 01:58:27,382 - DEBUG - Namespace ctest-new-default-00544970 is not in k8s 2024-09-18 01:58:27,382 - DEBUG - No need to check project deletion in contrail-api