2024-09-15 21:46:06,504 - INFO - Using existing project ['default-domain', 'k8s-default'](979bc392-1b34-44fa-85fa-47b7772786b5) 2024-09-15 21:46:06,536 - DEBUG - Namespace ctest-new-default-68508066 not present 2024-09-15 21:46:06,546 - INFO - Created namespace ctest-new-default-68508066 2024-09-15 21:46:09,552 - DEBUG - Namespace ctest-non-default-72248007 not present 2024-09-15 21:46:09,562 - INFO - Created namespace ctest-non-default-72248007 2024-09-15 21:46:12,590 - DEBUG - Pod ctest-pod-68301205 not present 2024-09-15 21:46:12,590 - INFO - Creating Pod ctest-pod-68301205 2024-09-15 21:46:12,628 - DEBUG - Pod : ctest-pod-68301205 UUID is c8a08900-0272-487b-b9e6-da378c66dac5 2024-09-15 21:46:12,634 - DEBUG - Pod ctest-pod-48091365 not present 2024-09-15 21:46:12,634 - INFO - Creating Pod ctest-pod-48091365 2024-09-15 21:46:12,664 - DEBUG - Pod : ctest-pod-48091365 UUID is e604fa63-9dcc-41ac-8bb8-8d1e9d129d75 2024-09-15 21:46:12,669 - DEBUG - Pod ctest-pod-52479345 not present 2024-09-15 21:46:12,669 - INFO - Creating Pod ctest-pod-52479345 2024-09-15 21:46:12,703 - DEBUG - Pod : ctest-pod-52479345 UUID is 4bfa15f0-b7d8-416e-b5d0-33acda5d6fe9 2024-09-15 21:46:12,708 - DEBUG - Pod ctest-pod-85403008 not present 2024-09-15 21:46:12,709 - INFO - Creating Pod ctest-pod-85403008 2024-09-15 21:46:12,744 - DEBUG - Pod : ctest-pod-85403008 UUID is 5e9b0e6e-6be0-4f59-af75-60e9b1360880 2024-09-15 21:46:12,764 - DEBUG - Pod ctest-pod-02994553 not present 2024-09-15 21:46:12,765 - INFO - Creating Pod ctest-pod-02994553 2024-09-15 21:46:12,790 - DEBUG - Pod : ctest-pod-02994553 UUID is 20d161df-6b09-439f-9282-18c93815b867 2024-09-15 21:46:12,801 - DEBUG - Pod ctest-pod-11883755 not present 2024-09-15 21:46:12,801 - INFO - Creating Pod ctest-pod-11883755 2024-09-15 21:46:12,825 - DEBUG - Pod : ctest-pod-11883755 UUID is b8756fc5-b2b8-45ea-90e2-573e3f0c8d88 2024-09-15 21:46:12,827 - DEBUG - Pod ctest-pod-18180537 not present 2024-09-15 21:46:12,827 - INFO - Creating Pod ctest-pod-18180537 2024-09-15 21:46:12,847 - DEBUG - Pod : ctest-pod-18180537 UUID is 05324937-1d48-4f83-aa40-a0b55c2ee947 2024-09-15 21:46:12,850 - DEBUG - Pod ctest-pod-34515437 not present 2024-09-15 21:46:12,850 - INFO - Creating Pod ctest-pod-34515437 2024-09-15 21:46:12,920 - DEBUG - Pod : ctest-pod-34515437 UUID is 93ca4477-0d9f-41bf-bbbf-48f9d8e5101e 2024-09-15 21:46:13,170 - INFO - Project default-domain:k8s-ctest-new-default-68508066 for Namespace ctest-new-default-68508066 is seen in contrail-api 2024-09-15 21:46:13,170 - DEBUG - Project uuid in Contrail is 02b7b787-6ff8-457b-9e3a-e0af01687a41 2024-09-15 21:46:13,403 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_NamespaceDatabaseList?namespace_uuid=645224f7-7ec4-47ae-aaed-7f577193fc6c 2024-09-15 21:46:13,411 - INFO - Namespace ctest-new-default-68508066 with uuid 645224f7-7ec4-47ae-aaed-7f577193fc6c found in kube manager 2024-09-15 21:46:13,412 - INFO - Namespace ctest-new-default-68508066 verification passed 2024-09-15 21:46:13,640 - INFO - Project default-domain:k8s-ctest-non-default-72248007 for Namespace ctest-non-default-72248007 is seen in contrail-api 2024-09-15 21:46:13,641 - DEBUG - Project uuid in Contrail is ee466156-1406-4c33-81ce-999f55e5ef1b 2024-09-15 21:46:13,641 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_NamespaceDatabaseList?namespace_uuid=3c90fcd6-d5d0-4575-a46e-ae9f9669e4d2 2024-09-15 21:46:13,646 - INFO - Namespace ctest-non-default-72248007 with uuid 3c90fcd6-d5d0-4575-a46e-ae9f9669e4d2 found in kube manager 2024-09-15 21:46:13,646 - INFO - Namespace ctest-non-default-72248007 verification passed 2024-09-15 21:46:14,150 - DEBUG - Pod ctest-pod-68301205 not in running state.Currently in Pending 2024-09-15 21:46:19,157 - DEBUG - Pod ctest-pod-68301205 not in running state.Currently in Pending 2024-09-15 21:46:24,165 - INFO - Pod ctest-pod-68301205 is in running state.Got IP 10.47.255.251 2024-09-15 21:46:24,206 - DEBUG - Pod ctest-pod-68301205 has vmi ef6496b4-73ab-11ef-bd90-fa163ec896c5 2024-09-15 21:46:24,206 - INFO - Verified pod ctest-pod-68301205 in contrail-api 2024-09-15 21:46:24,233 - DEBUG - VMI ef6496b4-73ab-11ef-bd90-fa163ec896c5 is active in agent 10.0.0.17 2024-09-15 21:46:24,234 - INFO - Verified Pod ctest-pod-68301205 in agent 10.0.0.17 2024-09-15 21:46:24,234 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_VirtualMachineDatabaseList?x=c8a08900-0272-487b-b9e6-da378c66dac5 2024-09-15 21:46:24,242 - INFO - Pod ctest-pod-68301205 with uuid c8a08900-0272-487b-b9e6-da378c66dac5 found in kube manager 2024-09-15 21:46:24,242 - INFO - Pod ctest-pod-68301205 verification passed 2024-09-15 21:46:24,251 - INFO - Pod ctest-pod-48091365 is in running state.Got IP 10.47.255.250 2024-09-15 21:46:24,320 - DEBUG - Pod ctest-pod-48091365 has vmi eff2c164-73ab-11ef-bd90-fa163ec896c5 2024-09-15 21:46:24,320 - INFO - Verified pod ctest-pod-48091365 in contrail-api 2024-09-15 21:46:24,339 - DEBUG - VMI eff2c164-73ab-11ef-bd90-fa163ec896c5 is active in agent 10.0.0.17 2024-09-15 21:46:24,340 - INFO - Verified Pod ctest-pod-48091365 in agent 10.0.0.17 2024-09-15 21:46:24,340 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_VirtualMachineDatabaseList?x=e604fa63-9dcc-41ac-8bb8-8d1e9d129d75 2024-09-15 21:46:24,351 - INFO - Pod ctest-pod-48091365 with uuid e604fa63-9dcc-41ac-8bb8-8d1e9d129d75 found in kube manager 2024-09-15 21:46:24,351 - INFO - Pod ctest-pod-48091365 verification passed 2024-09-15 21:46:24,358 - DEBUG - Pod ctest-pod-52479345 not in running state.Currently in Pending 2024-09-15 21:46:29,367 - INFO - Pod ctest-pod-52479345 is in running state.Got IP 10.47.255.249 2024-09-15 21:46:29,396 - DEBUG - Pod ctest-pod-52479345 has vmi f0acf4a8-73ab-11ef-bd90-fa163ec896c5 2024-09-15 21:46:29,396 - INFO - Verified pod ctest-pod-52479345 in contrail-api 2024-09-15 21:46:29,416 - DEBUG - VMI f0acf4a8-73ab-11ef-bd90-fa163ec896c5 is active in agent 10.0.0.17 2024-09-15 21:46:29,416 - INFO - Verified Pod ctest-pod-52479345 in agent 10.0.0.17 2024-09-15 21:46:29,417 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_VirtualMachineDatabaseList?x=4bfa15f0-b7d8-416e-b5d0-33acda5d6fe9 2024-09-15 21:46:29,422 - INFO - Pod ctest-pod-52479345 with uuid 4bfa15f0-b7d8-416e-b5d0-33acda5d6fe9 found in kube manager 2024-09-15 21:46:29,423 - INFO - Pod ctest-pod-52479345 verification passed 2024-09-15 21:46:29,428 - DEBUG - Pod ctest-pod-85403008 not in running state.Currently in Pending 2024-09-15 21:46:34,436 - INFO - Pod ctest-pod-85403008 is in running state.Got IP 10.47.255.248 2024-09-15 21:46:34,460 - DEBUG - Pod ctest-pod-85403008 has vmi f13bbf6c-73ab-11ef-bd90-fa163ec896c5 2024-09-15 21:46:34,460 - INFO - Verified pod ctest-pod-85403008 in contrail-api 2024-09-15 21:46:34,476 - DEBUG - VMI f13bbf6c-73ab-11ef-bd90-fa163ec896c5 is active in agent 10.0.0.17 2024-09-15 21:46:34,476 - INFO - Verified Pod ctest-pod-85403008 in agent 10.0.0.17 2024-09-15 21:46:34,476 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_VirtualMachineDatabaseList?x=5e9b0e6e-6be0-4f59-af75-60e9b1360880 2024-09-15 21:46:34,481 - INFO - Pod ctest-pod-85403008 with uuid 5e9b0e6e-6be0-4f59-af75-60e9b1360880 found in kube manager 2024-09-15 21:46:34,481 - INFO - Pod ctest-pod-85403008 verification passed 2024-09-15 21:46:34,489 - INFO - Pod ctest-pod-02994553 is in running state.Got IP 10.47.255.247 2024-09-15 21:46:34,553 - DEBUG - Pod ctest-pod-02994553 has vmi f2022cc4-73ab-11ef-bd90-fa163ec896c5 2024-09-15 21:46:34,554 - INFO - Verified pod ctest-pod-02994553 in contrail-api 2024-09-15 21:46:34,573 - DEBUG - VMI f2022cc4-73ab-11ef-bd90-fa163ec896c5 is active in agent 10.0.0.17 2024-09-15 21:46:34,573 - INFO - Verified Pod ctest-pod-02994553 in agent 10.0.0.17 2024-09-15 21:46:34,573 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_VirtualMachineDatabaseList?x=20d161df-6b09-439f-9282-18c93815b867 2024-09-15 21:46:34,579 - INFO - Pod ctest-pod-02994553 with uuid 20d161df-6b09-439f-9282-18c93815b867 found in kube manager 2024-09-15 21:46:34,580 - INFO - Pod ctest-pod-02994553 verification passed 2024-09-15 21:46:34,585 - DEBUG - Pod ctest-pod-18180537 not in running state.Currently in Pending 2024-09-15 21:46:39,593 - INFO - Pod ctest-pod-18180537 is in running state.Got IP 10.47.255.245 2024-09-15 21:46:39,618 - DEBUG - Pod ctest-pod-18180537 has vmi f3dd11da-73ab-11ef-bd90-fa163ec896c5 2024-09-15 21:46:39,618 - INFO - Verified pod ctest-pod-18180537 in contrail-api 2024-09-15 21:46:39,636 - DEBUG - VMI f3dd11da-73ab-11ef-bd90-fa163ec896c5 is active in agent 10.0.0.17 2024-09-15 21:46:39,636 - INFO - Verified Pod ctest-pod-18180537 in agent 10.0.0.17 2024-09-15 21:46:39,636 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_VirtualMachineDatabaseList?x=05324937-1d48-4f83-aa40-a0b55c2ee947 2024-09-15 21:46:39,643 - INFO - Pod ctest-pod-18180537 with uuid 05324937-1d48-4f83-aa40-a0b55c2ee947 found in kube manager 2024-09-15 21:46:39,643 - INFO - Pod ctest-pod-18180537 verification passed 2024-09-15 21:46:39,652 - INFO - Pod ctest-pod-11883755 is in running state.Got IP 10.47.255.246 2024-09-15 21:46:39,735 - DEBUG - Pod ctest-pod-11883755 has vmi f33f5ca6-73ab-11ef-bd90-fa163ec896c5 2024-09-15 21:46:39,735 - INFO - Verified pod ctest-pod-11883755 in contrail-api 2024-09-15 21:46:39,750 - DEBUG - VMI f33f5ca6-73ab-11ef-bd90-fa163ec896c5 is active in agent 10.0.0.17 2024-09-15 21:46:39,751 - INFO - Verified Pod ctest-pod-11883755 in agent 10.0.0.17 2024-09-15 21:46:39,751 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_VirtualMachineDatabaseList?x=b8756fc5-b2b8-45ea-90e2-573e3f0c8d88 2024-09-15 21:46:39,757 - INFO - Pod ctest-pod-11883755 with uuid b8756fc5-b2b8-45ea-90e2-573e3f0c8d88 found in kube manager 2024-09-15 21:46:39,758 - INFO - Pod ctest-pod-11883755 verification passed 2024-09-15 21:46:39,765 - INFO - Pod ctest-pod-34515437 is in running state.Got IP 10.47.255.244 2024-09-15 21:46:39,790 - DEBUG - Pod ctest-pod-34515437 has vmi f466e892-73ab-11ef-bd90-fa163ec896c5 2024-09-15 21:46:39,790 - INFO - Verified pod ctest-pod-34515437 in contrail-api 2024-09-15 21:46:39,807 - DEBUG - VMI f466e892-73ab-11ef-bd90-fa163ec896c5 is active in agent 10.0.0.17 2024-09-15 21:46:39,807 - INFO - Verified Pod ctest-pod-34515437 in agent 10.0.0.17 2024-09-15 21:46:39,807 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_VirtualMachineDatabaseList?x=93ca4477-0d9f-41bf-bbbf-48f9d8e5101e 2024-09-15 21:46:39,813 - INFO - Pod ctest-pod-34515437 with uuid 93ca4477-0d9f-41bf-bbbf-48f9d8e5101e found in kube manager 2024-09-15 21:46:39,813 - INFO - Pod ctest-pod-34515437 verification passed 2024-09-15 21:46:39,814 - INFO - ================================================================================ 2024-09-15 21:46:39,814 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-09-15 21:46:39,814 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-09-15 21:46:40,078 - DEBUG - Nothing to compare xmpp stats {'10.0.0.17': {'10.0.0.31': '0'}} with 2024-09-15 21:46:40,078 - INFO - Initial checks done. Running the testcase now 2024-09-15 21:46:40,078 - INFO - 2024-09-15 21:46:40,136 - DEBUG - [Pod ctest-pod-68301205] Cmd: echo ctest-pod-68301205 > /usr/share/nginx/html/index.html, Output: 2024-09-15 21:46:40,193 - DEBUG - [Pod ctest-pod-48091365] Cmd: echo ctest-pod-48091365 > /usr/share/nginx/html/index.html, Output: 2024-09-15 21:46:40,246 - DEBUG - [Pod ctest-pod-52479345] Cmd: echo ctest-pod-52479345 > /usr/share/nginx/html/index.html, Output: 2024-09-15 21:46:40,312 - DEBUG - [Pod ctest-pod-85403008] Cmd: echo ctest-pod-85403008 > /usr/share/nginx/html/index.html, Output: 2024-09-15 21:46:40,316 - DEBUG - Service ctest-nginx-svc-29984293 not present 2024-09-15 21:46:40,316 - INFO - Creating service ctest-nginx-svc-29984293 2024-09-15 21:46:41,533 - INFO - Created Service ctest-nginx-svc-29984293 2024-09-15 21:46:41,549 - WARNING - Service UUID ba82d14e-cc8a-4151-a8ff-0be4089477fd not yet found in contrail-api 2024-09-15 21:46:42,561 - INFO - Validated that Service ctest-nginx-svc-29984293 is seen in contrail-api 2024-09-15 21:46:42,561 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_LoadbalancerDatabaseList?x=ba82d14e-cc8a-4151-a8ff-0be4089477fd 2024-09-15 21:46:42,572 - INFO - Service ctest-nginx-svc-29984293 with uuid ba82d14e-cc8a-4151-a8ff-0be4089477fd found in kube manager 2024-09-15 21:46:42,572 - INFO - Service ctest-nginx-svc-29984293 verification passed 2024-09-15 21:46:43,644 - DEBUG - [Pod ctest-pod-02994553] Cmd: wget http://10.102.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.188:80 (10.102.212.188:80) ctest-pod-48091365 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-15 21:46:43,644 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd wget http://10.102.212.188:80/ -O - -T 5 -t 1 passed 2024-09-15 21:46:43,644 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd output: Connecting to 10.102.212.188:80 (10.102.212.188:80) ctest-pod-48091365 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-15 21:46:43,744 - DEBUG - [Pod ctest-pod-02994553] Cmd: wget http://10.102.212.188:80/ -O - -T 5 -t 1 , Output: ctest-pod-48091365 Connecting to 10.102.212.188:80 (10.102.212.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-15 21:46:43,744 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd wget http://10.102.212.188:80/ -O - -T 5 -t 1 passed 2024-09-15 21:46:43,744 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd output: ctest-pod-48091365 Connecting to 10.102.212.188:80 (10.102.212.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-15 21:46:43,821 - DEBUG - [Pod ctest-pod-02994553] Cmd: wget http://10.102.212.188:80/ -O - -T 5 -t 1 , Output: ctest-pod-68301205 Connecting to 10.102.212.188:80 (10.102.212.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-15 21:46:43,822 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd wget http://10.102.212.188:80/ -O - -T 5 -t 1 passed 2024-09-15 21:46:43,822 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd output: ctest-pod-68301205 Connecting to 10.102.212.188:80 (10.102.212.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-15 21:46:43,822 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-68301205': 1, 'ctest-pod-48091365': 2} 2024-09-15 21:46:43,895 - DEBUG - [Pod ctest-pod-18180537] Cmd: wget http://10.102.212.188:80/ -O - -T 5 -t 1 , Output: ctest-pod-48091365 Connecting to 10.102.212.188:80 (10.102.212.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-15 21:46:43,895 - DEBUG - [Pod Pod ctest-pod-18180537] Cmd wget http://10.102.212.188:80/ -O - -T 5 -t 1 passed 2024-09-15 21:46:43,896 - DEBUG - [Pod Pod ctest-pod-18180537] Cmd output: ctest-pod-48091365 Connecting to 10.102.212.188:80 (10.102.212.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-15 21:46:43,982 - DEBUG - [Pod ctest-pod-18180537] Cmd: wget http://10.102.212.188:80/ -O - -T 5 -t 1 , Output: ctest-pod-68301205 Connecting to 10.102.212.188:80 (10.102.212.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-15 21:46:43,982 - DEBUG - [Pod Pod ctest-pod-18180537] Cmd wget http://10.102.212.188:80/ -O - -T 5 -t 1 passed 2024-09-15 21:46:43,982 - DEBUG - [Pod Pod ctest-pod-18180537] Cmd output: ctest-pod-68301205 Connecting to 10.102.212.188:80 (10.102.212.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-15 21:46:43,982 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-68301205': 1, 'ctest-pod-48091365': 1} 2024-09-15 21:46:43,987 - DEBUG - Network policy ingress-on-service not present 2024-09-15 21:46:43,988 - INFO - Creating Network Policy ingress-on-service 2024-09-15 21:46:44,012 - INFO - Network policy found in k8s 2024-09-15 21:46:44,012 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=9010fe55-d3e0-4f3a-b953-10dfc6ef1848 2024-09-15 21:46:44,018 - INFO - Network Policy ingress-on-service with uuid 9010fe55-d3e0-4f3a-b953-10dfc6ef1848 found in kube manager 2024-09-15 21:46:44,090 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-09-15 21:46:44,090 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-09-15 21:46:44,090 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=9010fe55-d3e0-4f3a-b953-10dfc6ef1848 2024-09-15 21:46:44,130 - WARNING - Network policy with name ingress-on-service not found in agent 2024-09-15 21:46:46,131 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=9010fe55-d3e0-4f3a-b953-10dfc6ef1848 2024-09-15 21:46:46,174 - WARNING - Network policy with name ingress-on-service not found in agent 2024-09-15 21:46:48,175 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=9010fe55-d3e0-4f3a-b953-10dfc6ef1848 2024-09-15 21:46:48,219 - INFO - Network policy with name ingress-on-service found in agent 2024-09-15 21:46:48,220 - INFO - Network Policy ingress-on-service verification passed 2024-09-15 21:46:53,280 - DEBUG - [Pod ctest-pod-02994553] Cmd: wget http://10.102.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:46:53,280 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd wget http://10.102.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:46:53,280 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:46:58,356 - DEBUG - [Pod ctest-pod-02994553] Cmd: wget http://10.102.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:46:58,358 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd wget http://10.102.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:46:58,358 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:47:03,432 - DEBUG - [Pod ctest-pod-02994553] Cmd: wget http://10.102.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:47:03,432 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd wget http://10.102.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:47:03,433 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:47:08,495 - DEBUG - [Pod ctest-pod-02994553] Cmd: wget http://10.102.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:47:08,495 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd wget http://10.102.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:47:08,495 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:47:13,571 - DEBUG - [Pod ctest-pod-02994553] Cmd: wget http://10.102.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:47:13,571 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd wget http://10.102.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:47:13,571 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:47:18,660 - DEBUG - [Pod ctest-pod-02994553] Cmd: wget http://10.102.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:47:18,660 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd wget http://10.102.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:47:18,660 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:47:23,726 - DEBUG - [Pod ctest-pod-02994553] Cmd: wget http://10.102.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:47:23,726 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd wget http://10.102.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:47:23,726 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:47:29,086 - DEBUG - [Pod ctest-pod-02994553] Cmd: wget http://10.102.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:47:29,086 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd wget http://10.102.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:47:29,086 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:47:34,166 - DEBUG - [Pod ctest-pod-02994553] Cmd: wget http://10.102.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:47:34,166 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd wget http://10.102.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:47:34,166 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:47:39,242 - DEBUG - [Pod ctest-pod-02994553] Cmd: wget http://10.102.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:47:39,242 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd wget http://10.102.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:47:39,242 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:47:39,242 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-68301205': 0, 'ctest-pod-48091365': 0} 2024-09-15 21:47:39,322 - DEBUG - [Pod ctest-pod-11883755] Cmd: wget http://10.102.212.188:80/ -O - -T 5 -t 1 , Output: ctest-pod-48091365 Connecting to 10.102.212.188:80 (10.102.212.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-15 21:47:39,322 - DEBUG - [Pod Pod ctest-pod-11883755] Cmd wget http://10.102.212.188:80/ -O - -T 5 -t 1 passed 2024-09-15 21:47:39,323 - DEBUG - [Pod Pod ctest-pod-11883755] Cmd output: ctest-pod-48091365 Connecting to 10.102.212.188:80 (10.102.212.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-15 21:47:39,397 - DEBUG - [Pod ctest-pod-11883755] Cmd: wget http://10.102.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.188:80 (10.102.212.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-68301205 2024-09-15 21:47:39,397 - DEBUG - [Pod Pod ctest-pod-11883755] Cmd wget http://10.102.212.188:80/ -O - -T 5 -t 1 passed 2024-09-15 21:47:39,397 - DEBUG - [Pod Pod ctest-pod-11883755] Cmd output: Connecting to 10.102.212.188:80 (10.102.212.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-68301205 2024-09-15 21:47:39,397 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-68301205': 1, 'ctest-pod-48091365': 1} 2024-09-15 21:47:44,467 - DEBUG - [Pod ctest-pod-18180537] Cmd: wget http://10.102.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:47:44,468 - DEBUG - [Pod Pod ctest-pod-18180537] Cmd wget http://10.102.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:47:44,468 - DEBUG - [Pod Pod ctest-pod-18180537] Cmd output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:47:49,538 - DEBUG - [Pod ctest-pod-18180537] Cmd: wget http://10.102.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:47:49,538 - DEBUG - [Pod Pod ctest-pod-18180537] Cmd wget http://10.102.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:47:49,538 - DEBUG - [Pod Pod ctest-pod-18180537] Cmd output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:47:54,609 - DEBUG - [Pod ctest-pod-18180537] Cmd: wget http://10.102.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:47:54,609 - DEBUG - [Pod Pod ctest-pod-18180537] Cmd wget http://10.102.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:47:54,609 - DEBUG - [Pod Pod ctest-pod-18180537] Cmd output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:47:59,680 - DEBUG - [Pod ctest-pod-18180537] Cmd: wget http://10.102.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:47:59,680 - DEBUG - [Pod Pod ctest-pod-18180537] Cmd wget http://10.102.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:47:59,680 - DEBUG - [Pod Pod ctest-pod-18180537] Cmd output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:48:04,747 - DEBUG - [Pod ctest-pod-18180537] Cmd: wget http://10.102.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:48:04,747 - DEBUG - [Pod Pod ctest-pod-18180537] Cmd wget http://10.102.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:48:04,747 - DEBUG - [Pod Pod ctest-pod-18180537] Cmd output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:48:09,822 - DEBUG - [Pod ctest-pod-18180537] Cmd: wget http://10.102.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:48:09,822 - DEBUG - [Pod Pod ctest-pod-18180537] Cmd wget http://10.102.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:48:09,822 - DEBUG - [Pod Pod ctest-pod-18180537] Cmd output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:48:15,419 - DEBUG - [Pod ctest-pod-18180537] Cmd: wget http://10.102.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:48:15,419 - DEBUG - [Pod Pod ctest-pod-18180537] Cmd wget http://10.102.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:48:15,419 - DEBUG - [Pod Pod ctest-pod-18180537] Cmd output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:48:20,494 - DEBUG - [Pod ctest-pod-18180537] Cmd: wget http://10.102.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:48:20,495 - DEBUG - [Pod Pod ctest-pod-18180537] Cmd wget http://10.102.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:48:20,495 - DEBUG - [Pod Pod ctest-pod-18180537] Cmd output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:48:25,572 - DEBUG - [Pod ctest-pod-18180537] Cmd: wget http://10.102.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:48:25,572 - DEBUG - [Pod Pod ctest-pod-18180537] Cmd wget http://10.102.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:48:25,572 - DEBUG - [Pod Pod ctest-pod-18180537] Cmd output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:48:30,632 - DEBUG - [Pod ctest-pod-18180537] Cmd: wget http://10.102.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:48:30,632 - DEBUG - [Pod Pod ctest-pod-18180537] Cmd wget http://10.102.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:48:30,632 - DEBUG - [Pod Pod ctest-pod-18180537] Cmd output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:48:30,632 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-68301205': 0, 'ctest-pod-48091365': 0} 2024-09-15 21:48:32,698 - DEBUG - [Pod ctest-pod-11883755] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.471 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.412 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.085 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.085/0.656/1.471 ms 2024-09-15 21:48:32,699 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-11883755 with expectation True passed 2024-09-15 21:48:34,763 - DEBUG - [Pod ctest-pod-02994553] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.531 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.096 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.086 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.086/0.571/1.531 ms 2024-09-15 21:48:34,764 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-02994553 with expectation True passed 2024-09-15 21:48:36,845 - DEBUG - [Pod ctest-pod-18180537] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.759 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.084 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.106 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.084/0.316/0.759 ms 2024-09-15 21:48:36,845 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-18180537 with expectation True passed 2024-09-15 21:48:38,517 - DEBUG - [Pod ctest-pod-11883755] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-15 21:48:38,517 - DEBUG - [Pod Pod ctest-pod-11883755] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-15 21:48:38,517 - DEBUG - [Pod Pod ctest-pod-11883755] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-15 21:48:38,517 - INFO - wget check of of http://10.47.255.251 from ctest-pod-11883755 passed 2024-09-15 21:48:38,589 - DEBUG - [Pod ctest-pod-11883755] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-15 21:48:38,589 - DEBUG - [Pod Pod ctest-pod-11883755] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-09-15 21:48:38,589 - DEBUG - [Pod Pod ctest-pod-11883755] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-15 21:48:38,589 - INFO - wget check of of http://10.47.255.250 from ctest-pod-11883755 passed 2024-09-15 21:48:43,650 - DEBUG - [Pod ctest-pod-02994553] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-15 21:48:43,650 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-15 21:48:43,650 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-15 21:48:43,650 - INFO - wget check of of http://10.47.255.250 from ctest-pod-02994553 passed 2024-09-15 21:48:48,715 - DEBUG - [Pod ctest-pod-34515437] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-15 21:48:48,716 - DEBUG - [Pod Pod ctest-pod-34515437] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-15 21:48:48,716 - DEBUG - [Pod Pod ctest-pod-34515437] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-15 21:48:48,716 - INFO - wget check of of http://10.47.255.251 from ctest-pod-34515437 passed 2024-09-15 21:48:48,725 - INFO - Updating Network Policy ingress-on-service 2024-09-15 21:48:53,796 - DEBUG - [Pod ctest-pod-02994553] Cmd: wget http://10.102.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:48:53,796 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd wget http://10.102.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:48:53,796 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:48:58,850 - DEBUG - [Pod ctest-pod-02994553] Cmd: wget http://10.102.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:48:58,850 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd wget http://10.102.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:48:58,850 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:49:03,903 - DEBUG - [Pod ctest-pod-02994553] Cmd: wget http://10.102.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:49:03,903 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd wget http://10.102.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:49:03,903 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:49:08,978 - DEBUG - [Pod ctest-pod-02994553] Cmd: wget http://10.102.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:49:08,978 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd wget http://10.102.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:49:08,978 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:49:14,038 - DEBUG - [Pod ctest-pod-02994553] Cmd: wget http://10.102.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:49:14,038 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd wget http://10.102.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:49:14,038 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:49:19,102 - DEBUG - [Pod ctest-pod-02994553] Cmd: wget http://10.102.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:49:19,102 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd wget http://10.102.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:49:19,102 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:49:24,174 - DEBUG - [Pod ctest-pod-02994553] Cmd: wget http://10.102.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:49:24,174 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd wget http://10.102.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:49:24,174 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:49:29,244 - DEBUG - [Pod ctest-pod-02994553] Cmd: wget http://10.102.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:49:29,244 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd wget http://10.102.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:49:29,244 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:49:34,302 - DEBUG - [Pod ctest-pod-02994553] Cmd: wget http://10.102.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:49:34,302 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd wget http://10.102.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:49:34,302 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:49:39,375 - DEBUG - [Pod ctest-pod-02994553] Cmd: wget http://10.102.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:49:39,375 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd wget http://10.102.212.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:49:39,375 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd output: Connecting to 10.102.212.188:80 (10.102.212.188:80) wget: download timed out 2024-09-15 21:49:39,375 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-68301205': 0, 'ctest-pod-48091365': 0} 2024-09-15 21:49:40,424 - DEBUG - [Pod ctest-pod-11883755] Cmd: wget http://10.102.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.188:80 (10.102.212.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-48091365 2024-09-15 21:49:40,424 - DEBUG - [Pod Pod ctest-pod-11883755] Cmd wget http://10.102.212.188:80/ -O - -T 5 -t 1 passed 2024-09-15 21:49:40,424 - DEBUG - [Pod Pod ctest-pod-11883755] Cmd output: Connecting to 10.102.212.188:80 (10.102.212.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-48091365 2024-09-15 21:49:40,526 - DEBUG - [Pod ctest-pod-11883755] Cmd: wget http://10.102.212.188:80/ -O - -T 5 -t 1 , Output: ctest-pod-48091365 Connecting to 10.102.212.188:80 (10.102.212.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-15 21:49:40,527 - DEBUG - [Pod Pod ctest-pod-11883755] Cmd wget http://10.102.212.188:80/ -O - -T 5 -t 1 passed 2024-09-15 21:49:40,527 - DEBUG - [Pod Pod ctest-pod-11883755] Cmd output: ctest-pod-48091365 Connecting to 10.102.212.188:80 (10.102.212.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-15 21:49:40,595 - DEBUG - [Pod ctest-pod-11883755] Cmd: wget http://10.102.212.188:80/ -O - -T 5 -t 1 , Output: ctest-pod-48091365 Connecting to 10.102.212.188:80 (10.102.212.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-15 21:49:40,595 - DEBUG - [Pod Pod ctest-pod-11883755] Cmd wget http://10.102.212.188:80/ -O - -T 5 -t 1 passed 2024-09-15 21:49:40,595 - DEBUG - [Pod Pod ctest-pod-11883755] Cmd output: ctest-pod-48091365 Connecting to 10.102.212.188:80 (10.102.212.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-15 21:49:40,652 - DEBUG - [Pod ctest-pod-11883755] Cmd: wget http://10.102.212.188:80/ -O - -T 5 -t 1 , Output: ctest-pod-48091365 Connecting to 10.102.212.188:80 (10.102.212.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-15 21:49:40,652 - DEBUG - [Pod Pod ctest-pod-11883755] Cmd wget http://10.102.212.188:80/ -O - -T 5 -t 1 passed 2024-09-15 21:49:40,652 - DEBUG - [Pod Pod ctest-pod-11883755] Cmd output: ctest-pod-48091365 Connecting to 10.102.212.188:80 (10.102.212.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-15 21:49:40,714 - DEBUG - [Pod ctest-pod-11883755] Cmd: wget http://10.102.212.188:80/ -O - -T 5 -t 1 , Output: ctest-pod-48091365 Connecting to 10.102.212.188:80 (10.102.212.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-15 21:49:40,714 - DEBUG - [Pod Pod ctest-pod-11883755] Cmd wget http://10.102.212.188:80/ -O - -T 5 -t 1 passed 2024-09-15 21:49:40,714 - DEBUG - [Pod Pod ctest-pod-11883755] Cmd output: ctest-pod-48091365 Connecting to 10.102.212.188:80 (10.102.212.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-15 21:49:40,777 - DEBUG - [Pod ctest-pod-11883755] Cmd: wget http://10.102.212.188:80/ -O - -T 5 -t 1 , Output: ctest-pod-68301205 Connecting to 10.102.212.188:80 (10.102.212.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-15 21:49:40,778 - DEBUG - [Pod Pod ctest-pod-11883755] Cmd wget http://10.102.212.188:80/ -O - -T 5 -t 1 passed 2024-09-15 21:49:40,778 - DEBUG - [Pod Pod ctest-pod-11883755] Cmd output: ctest-pod-68301205 Connecting to 10.102.212.188:80 (10.102.212.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-15 21:49:40,778 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-68301205': 1, 'ctest-pod-48091365': 5} 2024-09-15 21:49:40,852 - DEBUG - [Pod ctest-pod-18180537] Cmd: wget http://10.102.212.188:80/ -O - -T 5 -t 1 , Output: ctest-pod-68301205 Connecting to 10.102.212.188:80 (10.102.212.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-15 21:49:40,853 - DEBUG - [Pod Pod ctest-pod-18180537] Cmd wget http://10.102.212.188:80/ -O - -T 5 -t 1 passed 2024-09-15 21:49:40,853 - DEBUG - [Pod Pod ctest-pod-18180537] Cmd output: ctest-pod-68301205 Connecting to 10.102.212.188:80 (10.102.212.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-15 21:49:40,924 - DEBUG - [Pod ctest-pod-18180537] Cmd: wget http://10.102.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.188:80 (10.102.212.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-68301205 2024-09-15 21:49:40,924 - DEBUG - [Pod Pod ctest-pod-18180537] Cmd wget http://10.102.212.188:80/ -O - -T 5 -t 1 passed 2024-09-15 21:49:40,924 - DEBUG - [Pod Pod ctest-pod-18180537] Cmd output: Connecting to 10.102.212.188:80 (10.102.212.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-68301205 2024-09-15 21:49:41,006 - DEBUG - [Pod ctest-pod-18180537] Cmd: wget http://10.102.212.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.212.188:80 (10.102.212.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-48091365 2024-09-15 21:49:41,006 - DEBUG - [Pod Pod ctest-pod-18180537] Cmd wget http://10.102.212.188:80/ -O - -T 5 -t 1 passed 2024-09-15 21:49:41,006 - DEBUG - [Pod Pod ctest-pod-18180537] Cmd output: Connecting to 10.102.212.188:80 (10.102.212.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-48091365 2024-09-15 21:49:41,007 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-68301205': 2, 'ctest-pod-48091365': 1} 2024-09-15 21:49:43,066 - DEBUG - [Pod ctest-pod-11883755] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.806 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.103 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.105 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.103/0.338/0.806 ms 2024-09-15 21:49:43,067 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-11883755 with expectation True passed 2024-09-15 21:49:45,142 - DEBUG - [Pod ctest-pod-02994553] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.668 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.086 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.100 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.086/0.284/0.668 ms 2024-09-15 21:49:45,142 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-02994553 with expectation True passed 2024-09-15 21:49:47,200 - DEBUG - [Pod ctest-pod-18180537] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.811 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.092 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.122 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.092/0.341/0.811 ms 2024-09-15 21:49:47,200 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-18180537 with expectation True passed 2024-09-15 21:49:47,257 - DEBUG - [Pod ctest-pod-11883755] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-15 21:49:47,257 - DEBUG - [Pod Pod ctest-pod-11883755] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-15 21:49:47,257 - DEBUG - [Pod Pod ctest-pod-11883755] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-15 21:49:47,258 - INFO - wget check of of http://10.47.255.251 from ctest-pod-11883755 passed 2024-09-15 21:49:47,312 - DEBUG - [Pod ctest-pod-11883755] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-15 21:49:47,313 - DEBUG - [Pod Pod ctest-pod-11883755] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-09-15 21:49:47,313 - DEBUG - [Pod Pod ctest-pod-11883755] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-15 21:49:47,313 - INFO - wget check of of http://10.47.255.250 from ctest-pod-11883755 passed 2024-09-15 21:49:52,379 - DEBUG - [Pod ctest-pod-02994553] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-15 21:49:52,379 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-15 21:49:52,379 - DEBUG - [Pod Pod ctest-pod-02994553] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-15 21:49:52,379 - INFO - wget check of of http://10.47.255.250 from ctest-pod-02994553 passed 2024-09-15 21:49:52,494 - DEBUG - [Pod ctest-pod-34515437] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-15 21:49:52,494 - DEBUG - [Pod Pod ctest-pod-34515437] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-15 21:49:52,494 - DEBUG - [Pod Pod ctest-pod-34515437] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-15 21:49:52,494 - INFO - wget check of of http://10.47.255.251 from ctest-pod-34515437 passed 2024-09-15 21:49:52,495 - INFO - Deleting Network Policy : ingress-on-service 2024-09-15 21:49:52,495 - INFO - Deleting service : ctest-nginx-svc-29984293 2024-09-15 21:49:52,754 - DEBUG - No XMPP flaps were noticed during the test 2024-09-15 21:49:52,754 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:13] 2024-09-15 21:49:52,754 - INFO - -------------------------------------------------------------------------------- 2024-09-15 21:49:52,761 - INFO - Deleting pod ctest-new-default-68508066:ctest-pod-68301205 2024-09-15 21:49:52,762 - INFO - Deleting pod ctest-new-default-68508066:ctest-pod-48091365 2024-09-15 21:49:52,762 - INFO - Deleting pod ctest-non-default-72248007:ctest-pod-52479345 2024-09-15 21:49:52,762 - INFO - Deleting pod ctest-non-default-72248007:ctest-pod-85403008 2024-09-15 21:49:52,763 - INFO - Deleting pod ctest-new-default-68508066:ctest-pod-02994553 2024-09-15 21:49:52,763 - INFO - Deleting pod ctest-new-default-68508066:ctest-pod-11883755 2024-09-15 21:49:52,763 - INFO - Deleting pod ctest-non-default-72248007:ctest-pod-18180537 2024-09-15 21:49:52,764 - INFO - Deleting pod ctest-non-default-72248007:ctest-pod-34515437 2024-09-15 21:49:52,822 - WARNING - Pod uuid c8a08900-0272-487b-b9e6-da378c66dac5 is still seen in agent 10.0.0.17 VM list 2024-09-15 21:49:52,866 - WARNING - Pod uuid e604fa63-9dcc-41ac-8bb8-8d1e9d129d75 is still seen in agent 10.0.0.17 VM list 2024-09-15 21:49:52,909 - WARNING - Pod uuid b8756fc5-b2b8-45ea-90e2-573e3f0c8d88 is still seen in agent 10.0.0.17 VM list 2024-09-15 21:49:52,910 - WARNING - Pod uuid 5e9b0e6e-6be0-4f59-af75-60e9b1360880 is still seen in agent 10.0.0.17 VM list 2024-09-15 21:49:52,913 - WARNING - Pod uuid 93ca4477-0d9f-41bf-bbbf-48f9d8e5101e is still seen in agent 10.0.0.17 VM list 2024-09-15 21:49:52,913 - WARNING - Pod uuid 20d161df-6b09-439f-9282-18c93815b867 is still seen in agent 10.0.0.17 VM list 2024-09-15 21:49:52,913 - WARNING - Pod uuid 4bfa15f0-b7d8-416e-b5d0-33acda5d6fe9 is still seen in agent 10.0.0.17 VM list 2024-09-15 21:49:53,358 - WARNING - Pod uuid 05324937-1d48-4f83-aa40-a0b55c2ee947 is still seen in agent 10.0.0.17 VM list 2024-09-15 21:49:57,831 - DEBUG - Pod c8a08900-0272-487b-b9e6-da378c66dac5 is not in agent 10.0.0.17 VM list 2024-09-15 21:49:57,839 - DEBUG - VMI ef6496b4-73ab-11ef-bd90-fa163ec896c5 is removed from agent 10.0.0.17 2024-09-15 21:49:57,839 - INFO - Verified that pod ctest-pod-68301205 is removed in agent 2024-09-15 21:49:57,876 - DEBUG - Pod e604fa63-9dcc-41ac-8bb8-8d1e9d129d75 is not in agent 10.0.0.17 VM list 2024-09-15 21:49:57,884 - DEBUG - VMI eff2c164-73ab-11ef-bd90-fa163ec896c5 is removed from agent 10.0.0.17 2024-09-15 21:49:57,884 - INFO - Verified that pod ctest-pod-48091365 is removed in agent 2024-09-15 21:49:57,954 - WARNING - Pod uuid 20d161df-6b09-439f-9282-18c93815b867 is still seen in agent 10.0.0.17 VM list 2024-09-15 21:49:57,955 - WARNING - Pod uuid 93ca4477-0d9f-41bf-bbbf-48f9d8e5101e is still seen in agent 10.0.0.17 VM list 2024-09-15 21:49:57,956 - WARNING - Pod uuid 5e9b0e6e-6be0-4f59-af75-60e9b1360880 is still seen in agent 10.0.0.17 VM list 2024-09-15 21:49:57,957 - WARNING - Pod uuid b8756fc5-b2b8-45ea-90e2-573e3f0c8d88 is still seen in agent 10.0.0.17 VM list 2024-09-15 21:49:57,958 - DEBUG - Pod 4bfa15f0-b7d8-416e-b5d0-33acda5d6fe9 is not in agent 10.0.0.17 VM list 2024-09-15 21:49:57,966 - DEBUG - VMI f0acf4a8-73ab-11ef-bd90-fa163ec896c5 is removed from agent 10.0.0.17 2024-09-15 21:49:57,966 - INFO - Verified that pod ctest-pod-52479345 is removed in agent 2024-09-15 21:49:58,369 - WARNING - Pod uuid 05324937-1d48-4f83-aa40-a0b55c2ee947 is still seen in agent 10.0.0.17 VM list 2024-09-15 21:50:02,975 - WARNING - Pod uuid 20d161df-6b09-439f-9282-18c93815b867 is still seen in agent 10.0.0.17 VM list 2024-09-15 21:50:02,978 - DEBUG - Pod 5e9b0e6e-6be0-4f59-af75-60e9b1360880 is not in agent 10.0.0.17 VM list 2024-09-15 21:50:02,979 - WARNING - Pod uuid 93ca4477-0d9f-41bf-bbbf-48f9d8e5101e is still seen in agent 10.0.0.17 VM list 2024-09-15 21:50:02,980 - WARNING - Pod uuid b8756fc5-b2b8-45ea-90e2-573e3f0c8d88 is still seen in agent 10.0.0.17 VM list 2024-09-15 21:50:02,986 - DEBUG - VMI f13bbf6c-73ab-11ef-bd90-fa163ec896c5 is removed from agent 10.0.0.17 2024-09-15 21:50:02,986 - INFO - Verified that pod ctest-pod-85403008 is removed in agent 2024-09-15 21:50:03,379 - WARNING - Pod uuid 05324937-1d48-4f83-aa40-a0b55c2ee947 is still seen in agent 10.0.0.17 VM list 2024-09-15 21:50:07,986 - WARNING - Pod uuid 20d161df-6b09-439f-9282-18c93815b867 is still seen in agent 10.0.0.17 VM list 2024-09-15 21:50:07,992 - WARNING - Pod uuid b8756fc5-b2b8-45ea-90e2-573e3f0c8d88 is still seen in agent 10.0.0.17 VM list 2024-09-15 21:50:08,027 - WARNING - Pod uuid 93ca4477-0d9f-41bf-bbbf-48f9d8e5101e is still seen in agent 10.0.0.17 VM list 2024-09-15 21:50:08,387 - WARNING - Pod uuid 05324937-1d48-4f83-aa40-a0b55c2ee947 is still seen in agent 10.0.0.17 VM list 2024-09-15 21:50:12,998 - WARNING - Pod uuid 20d161df-6b09-439f-9282-18c93815b867 is still seen in agent 10.0.0.17 VM list 2024-09-15 21:50:13,006 - WARNING - Pod uuid b8756fc5-b2b8-45ea-90e2-573e3f0c8d88 is still seen in agent 10.0.0.17 VM list 2024-09-15 21:50:13,036 - WARNING - Pod uuid 93ca4477-0d9f-41bf-bbbf-48f9d8e5101e is still seen in agent 10.0.0.17 VM list 2024-09-15 21:50:13,400 - WARNING - Pod uuid 05324937-1d48-4f83-aa40-a0b55c2ee947 is still seen in agent 10.0.0.17 VM list 2024-09-15 21:50:18,014 - WARNING - Pod uuid 20d161df-6b09-439f-9282-18c93815b867 is still seen in agent 10.0.0.17 VM list 2024-09-15 21:50:18,016 - WARNING - Pod uuid b8756fc5-b2b8-45ea-90e2-573e3f0c8d88 is still seen in agent 10.0.0.17 VM list 2024-09-15 21:50:18,047 - WARNING - Pod uuid 93ca4477-0d9f-41bf-bbbf-48f9d8e5101e is still seen in agent 10.0.0.17 VM list 2024-09-15 21:50:18,418 - WARNING - Pod uuid 05324937-1d48-4f83-aa40-a0b55c2ee947 is still seen in agent 10.0.0.17 VM list 2024-09-15 21:50:23,062 - WARNING - Pod uuid 93ca4477-0d9f-41bf-bbbf-48f9d8e5101e is still seen in agent 10.0.0.17 VM list 2024-09-15 21:50:23,062 - WARNING - Pod uuid 20d161df-6b09-439f-9282-18c93815b867 is still seen in agent 10.0.0.17 VM list 2024-09-15 21:50:23,064 - WARNING - Pod uuid b8756fc5-b2b8-45ea-90e2-573e3f0c8d88 is still seen in agent 10.0.0.17 VM list 2024-09-15 21:50:23,431 - WARNING - Pod uuid 05324937-1d48-4f83-aa40-a0b55c2ee947 is still seen in agent 10.0.0.17 VM list 2024-09-15 21:50:28,083 - DEBUG - Pod 93ca4477-0d9f-41bf-bbbf-48f9d8e5101e is not in agent 10.0.0.17 VM list 2024-09-15 21:50:28,087 - DEBUG - Pod 20d161df-6b09-439f-9282-18c93815b867 is not in agent 10.0.0.17 VM list 2024-09-15 21:50:28,093 - DEBUG - Pod b8756fc5-b2b8-45ea-90e2-573e3f0c8d88 is not in agent 10.0.0.17 VM list 2024-09-15 21:50:28,117 - DEBUG - VMI f33f5ca6-73ab-11ef-bd90-fa163ec896c5 is removed from agent 10.0.0.17 2024-09-15 21:50:28,118 - INFO - Verified that pod ctest-pod-11883755 is removed in agent 2024-09-15 21:50:28,118 - DEBUG - VMI f2022cc4-73ab-11ef-bd90-fa163ec896c5 is removed from agent 10.0.0.17 2024-09-15 21:50:28,118 - INFO - Verified that pod ctest-pod-02994553 is removed in agent 2024-09-15 21:50:28,118 - DEBUG - VMI f466e892-73ab-11ef-bd90-fa163ec896c5 is removed from agent 10.0.0.17 2024-09-15 21:50:28,118 - INFO - Verified that pod ctest-pod-34515437 is removed in agent 2024-09-15 21:50:28,441 - DEBUG - Pod 05324937-1d48-4f83-aa40-a0b55c2ee947 is not in agent 10.0.0.17 VM list 2024-09-15 21:50:28,455 - DEBUG - VMI f3dd11da-73ab-11ef-bd90-fa163ec896c5 is removed from agent 10.0.0.17 2024-09-15 21:50:28,455 - INFO - Verified that pod ctest-pod-18180537 is removed in agent 2024-09-15 21:50:28,456 - INFO - Deleting namespace ctest-non-default-72248007 2024-09-15 21:50:28,485 - DEBUG - Namespace ctest-non-default-72248007 still in k8s 2024-09-15 21:50:30,494 - DEBUG - Namespace ctest-non-default-72248007 still in k8s 2024-09-15 21:50:33,202 - DEBUG - Namespace ctest-non-default-72248007 still in k8s 2024-09-15 21:50:35,208 - DEBUG - Namespace ctest-non-default-72248007 is not in k8s 2024-09-15 21:50:35,208 - DEBUG - No need to check project deletion in contrail-api 2024-09-15 21:50:35,208 - INFO - Deleting namespace ctest-new-default-68508066 2024-09-15 21:50:35,237 - DEBUG - Namespace ctest-new-default-68508066 still in k8s 2024-09-15 21:50:37,244 - DEBUG - Namespace ctest-new-default-68508066 still in k8s 2024-09-15 21:50:39,262 - DEBUG - Namespace ctest-new-default-68508066 still in k8s 2024-09-15 21:50:41,268 - DEBUG - Namespace ctest-new-default-68508066 still in k8s 2024-09-15 21:50:43,273 - DEBUG - Namespace ctest-new-default-68508066 is not in k8s 2024-09-15 21:50:43,273 - DEBUG - No need to check project deletion in contrail-api