2024-08-23 22:41:28,410 - INFO - Using existing project ['default-domain', 'k8s-default'](0922e5fd-0eda-4c9d-a6d5-b300b39f3b86) 2024-08-23 22:41:28,433 - DEBUG - Namespace ctest-new-default-61203526 not present 2024-08-23 22:41:28,456 - INFO - Created namespace ctest-new-default-61203526 2024-08-23 22:41:31,467 - DEBUG - Namespace ctest-non-default-61798118 not present 2024-08-23 22:41:31,519 - INFO - Created namespace ctest-non-default-61798118 2024-08-23 22:41:34,570 - DEBUG - Pod ctest-pod-23988855 not present 2024-08-23 22:41:34,571 - INFO - Creating Pod ctest-pod-23988855 2024-08-23 22:41:34,628 - DEBUG - Pod : ctest-pod-23988855 UUID is a84a1e1c-9c90-4c30-a290-f0461084cf12 2024-08-23 22:41:34,632 - DEBUG - Pod ctest-pod-82227388 not present 2024-08-23 22:41:34,633 - INFO - Creating Pod ctest-pod-82227388 2024-08-23 22:41:34,700 - DEBUG - Pod : ctest-pod-82227388 UUID is 1719eaac-a5e9-4539-9775-87f6060897a8 2024-08-23 22:41:34,709 - DEBUG - Pod ctest-pod-22357979 not present 2024-08-23 22:41:34,710 - INFO - Creating Pod ctest-pod-22357979 2024-08-23 22:41:34,749 - DEBUG - Pod : ctest-pod-22357979 UUID is 3707d7b9-40b9-45d9-bc6b-82cb995f32b8 2024-08-23 22:41:34,751 - DEBUG - Pod ctest-pod-20003189 not present 2024-08-23 22:41:34,753 - INFO - Creating Pod ctest-pod-20003189 2024-08-23 22:41:34,780 - DEBUG - Pod : ctest-pod-20003189 UUID is c7a0c84c-f984-4da2-a03a-e743f7c5c348 2024-08-23 22:41:34,786 - DEBUG - Pod ctest-pod-23751985 not present 2024-08-23 22:41:34,786 - INFO - Creating Pod ctest-pod-23751985 2024-08-23 22:41:34,808 - DEBUG - Pod : ctest-pod-23751985 UUID is 0144b677-4c2a-40fc-b817-50cda58b4c7d 2024-08-23 22:41:34,810 - DEBUG - Pod ctest-pod-41443141 not present 2024-08-23 22:41:34,810 - INFO - Creating Pod ctest-pod-41443141 2024-08-23 22:41:34,829 - DEBUG - Pod : ctest-pod-41443141 UUID is 95b959a6-e750-4f27-8dd3-cbaa90f57e1b 2024-08-23 22:41:34,838 - DEBUG - Pod ctest-pod-05386412 not present 2024-08-23 22:41:34,838 - INFO - Creating Pod ctest-pod-05386412 2024-08-23 22:41:34,871 - DEBUG - Pod : ctest-pod-05386412 UUID is 1fa02261-904c-4039-bf75-3db15d82c299 2024-08-23 22:41:34,879 - DEBUG - Pod ctest-pod-15247553 not present 2024-08-23 22:41:34,880 - INFO - Creating Pod ctest-pod-15247553 2024-08-23 22:41:34,898 - DEBUG - Pod : ctest-pod-15247553 UUID is 3fd737eb-b1e4-4e7c-ad53-b81a8ed674db 2024-08-23 22:41:35,115 - INFO - Project default-domain:k8s-ctest-new-default-61203526 for Namespace ctest-new-default-61203526 is seen in contrail-api 2024-08-23 22:41:35,115 - DEBUG - Project uuid in Contrail is 1e05e092-c190-488a-b63d-fa85cb5754ce 2024-08-23 22:41:35,267 - DEBUG - Requesting: http://10.0.0.46:8108/Snh_NamespaceDatabaseList?namespace_uuid=71fea18b-b332-48d7-a299-199aef6698e9 2024-08-23 22:41:35,271 - INFO - Namespace ctest-new-default-61203526 with uuid 71fea18b-b332-48d7-a299-199aef6698e9 found in kube manager 2024-08-23 22:41:35,271 - INFO - Namespace ctest-new-default-61203526 verification passed 2024-08-23 22:41:35,474 - INFO - Project default-domain:k8s-ctest-non-default-61798118 for Namespace ctest-non-default-61798118 is seen in contrail-api 2024-08-23 22:41:35,474 - DEBUG - Project uuid in Contrail is b66d9624-9295-4bb6-90df-6e7e1eb3e3f4 2024-08-23 22:41:35,474 - DEBUG - Requesting: http://10.0.0.46:8108/Snh_NamespaceDatabaseList?namespace_uuid=a360cb7f-9204-4909-aa7d-5aa5a71d7c0f 2024-08-23 22:41:35,479 - INFO - Namespace ctest-non-default-61798118 with uuid a360cb7f-9204-4909-aa7d-5aa5a71d7c0f found in kube manager 2024-08-23 22:41:35,479 - INFO - Namespace ctest-non-default-61798118 verification passed 2024-08-23 22:41:35,484 - DEBUG - Pod ctest-pod-23988855 not in running state.Currently in Pending 2024-08-23 22:41:40,490 - DEBUG - Pod ctest-pod-23988855 not in running state.Currently in Pending 2024-08-23 22:41:45,522 - INFO - Pod ctest-pod-23988855 is in running state.Got IP 10.47.255.251 2024-08-23 22:41:45,549 - DEBUG - Pod ctest-pod-23988855 has vmi daab156c-61a0-11ef-b7b3-fa163edb1ebd 2024-08-23 22:41:45,549 - INFO - Verified pod ctest-pod-23988855 in contrail-api 2024-08-23 22:41:45,593 - DEBUG - VMI daab156c-61a0-11ef-b7b3-fa163edb1ebd is active in agent 10.0.0.44 2024-08-23 22:41:45,593 - INFO - Verified Pod ctest-pod-23988855 in agent 10.0.0.44 2024-08-23 22:41:45,593 - DEBUG - Requesting: http://10.0.0.46:8108/Snh_VirtualMachineDatabaseList?x=a84a1e1c-9c90-4c30-a290-f0461084cf12 2024-08-23 22:41:45,601 - INFO - Pod ctest-pod-23988855 with uuid a84a1e1c-9c90-4c30-a290-f0461084cf12 found in kube manager 2024-08-23 22:41:45,601 - INFO - Pod ctest-pod-23988855 verification passed 2024-08-23 22:41:45,610 - DEBUG - Pod ctest-pod-82227388 not in running state.Currently in Pending 2024-08-23 22:41:50,629 - DEBUG - Pod ctest-pod-82227388 not in running state.Currently in Pending 2024-08-23 22:41:55,653 - INFO - Pod ctest-pod-82227388 is in running state.Got IP 10.47.255.250 2024-08-23 22:41:55,694 - DEBUG - Pod ctest-pod-82227388 has vmi db22ff50-61a0-11ef-b7b3-fa163edb1ebd 2024-08-23 22:41:55,694 - INFO - Verified pod ctest-pod-82227388 in contrail-api 2024-08-23 22:41:55,717 - DEBUG - VMI db22ff50-61a0-11ef-b7b3-fa163edb1ebd is active in agent 10.0.0.44 2024-08-23 22:41:55,718 - INFO - Verified Pod ctest-pod-82227388 in agent 10.0.0.44 2024-08-23 22:41:55,718 - DEBUG - Requesting: http://10.0.0.46:8108/Snh_VirtualMachineDatabaseList?x=1719eaac-a5e9-4539-9775-87f6060897a8 2024-08-23 22:41:55,732 - INFO - Pod ctest-pod-82227388 with uuid 1719eaac-a5e9-4539-9775-87f6060897a8 found in kube manager 2024-08-23 22:41:55,732 - INFO - Pod ctest-pod-82227388 verification passed 2024-08-23 22:41:55,740 - INFO - Pod ctest-pod-22357979 is in running state.Got IP 10.47.255.249 2024-08-23 22:41:55,798 - DEBUG - Pod ctest-pod-22357979 has vmi dbd02338-61a0-11ef-b7b3-fa163edb1ebd 2024-08-23 22:41:55,799 - INFO - Verified pod ctest-pod-22357979 in contrail-api 2024-08-23 22:41:55,820 - DEBUG - VMI dbd02338-61a0-11ef-b7b3-fa163edb1ebd is active in agent 10.0.0.44 2024-08-23 22:41:55,821 - INFO - Verified Pod ctest-pod-22357979 in agent 10.0.0.44 2024-08-23 22:41:55,821 - DEBUG - Requesting: http://10.0.0.46:8108/Snh_VirtualMachineDatabaseList?x=3707d7b9-40b9-45d9-bc6b-82cb995f32b8 2024-08-23 22:41:55,830 - INFO - Pod ctest-pod-22357979 with uuid 3707d7b9-40b9-45d9-bc6b-82cb995f32b8 found in kube manager 2024-08-23 22:41:55,830 - INFO - Pod ctest-pod-22357979 verification passed 2024-08-23 22:41:55,839 - INFO - Pod ctest-pod-20003189 is in running state.Got IP 10.47.255.248 2024-08-23 22:41:55,855 - DEBUG - Pod ctest-pod-20003189 has vmi dc5922aa-61a0-11ef-b7b3-fa163edb1ebd 2024-08-23 22:41:55,855 - INFO - Verified pod ctest-pod-20003189 in contrail-api 2024-08-23 22:41:55,870 - DEBUG - VMI dc5922aa-61a0-11ef-b7b3-fa163edb1ebd is active in agent 10.0.0.44 2024-08-23 22:41:55,870 - INFO - Verified Pod ctest-pod-20003189 in agent 10.0.0.44 2024-08-23 22:41:55,870 - DEBUG - Requesting: http://10.0.0.46:8108/Snh_VirtualMachineDatabaseList?x=c7a0c84c-f984-4da2-a03a-e743f7c5c348 2024-08-23 22:41:55,875 - INFO - Pod ctest-pod-20003189 with uuid c7a0c84c-f984-4da2-a03a-e743f7c5c348 found in kube manager 2024-08-23 22:41:55,875 - INFO - Pod ctest-pod-20003189 verification passed 2024-08-23 22:41:55,881 - INFO - Pod ctest-pod-23751985 is in running state.Got IP 10.47.255.247 2024-08-23 22:41:55,892 - DEBUG - Pod ctest-pod-23751985 has vmi dceeb1a8-61a0-11ef-b7b3-fa163edb1ebd 2024-08-23 22:41:55,892 - INFO - Verified pod ctest-pod-23751985 in contrail-api 2024-08-23 22:41:55,908 - DEBUG - VMI dceeb1a8-61a0-11ef-b7b3-fa163edb1ebd is active in agent 10.0.0.44 2024-08-23 22:41:55,908 - INFO - Verified Pod ctest-pod-23751985 in agent 10.0.0.44 2024-08-23 22:41:55,908 - DEBUG - Requesting: http://10.0.0.46:8108/Snh_VirtualMachineDatabaseList?x=0144b677-4c2a-40fc-b817-50cda58b4c7d 2024-08-23 22:41:55,913 - INFO - Pod ctest-pod-23751985 with uuid 0144b677-4c2a-40fc-b817-50cda58b4c7d found in kube manager 2024-08-23 22:41:55,913 - INFO - Pod ctest-pod-23751985 verification passed 2024-08-23 22:41:55,919 - INFO - Pod ctest-pod-05386412 is in running state.Got IP 10.47.255.245 2024-08-23 22:41:55,975 - DEBUG - Pod ctest-pod-05386412 has vmi ddc4dc7e-61a0-11ef-b7b3-fa163edb1ebd 2024-08-23 22:41:55,975 - INFO - Verified pod ctest-pod-05386412 in contrail-api 2024-08-23 22:41:55,992 - DEBUG - VMI ddc4dc7e-61a0-11ef-b7b3-fa163edb1ebd is active in agent 10.0.0.44 2024-08-23 22:41:55,992 - INFO - Verified Pod ctest-pod-05386412 in agent 10.0.0.44 2024-08-23 22:41:55,992 - DEBUG - Requesting: http://10.0.0.46:8108/Snh_VirtualMachineDatabaseList?x=1fa02261-904c-4039-bf75-3db15d82c299 2024-08-23 22:41:56,010 - INFO - Pod ctest-pod-05386412 with uuid 1fa02261-904c-4039-bf75-3db15d82c299 found in kube manager 2024-08-23 22:41:56,011 - INFO - Pod ctest-pod-05386412 verification passed 2024-08-23 22:41:56,020 - INFO - Pod ctest-pod-41443141 is in running state.Got IP 10.47.255.246 2024-08-23 22:41:56,038 - DEBUG - Pod ctest-pod-41443141 has vmi dd5c85ac-61a0-11ef-b7b3-fa163edb1ebd 2024-08-23 22:41:56,038 - INFO - Verified pod ctest-pod-41443141 in contrail-api 2024-08-23 22:41:56,055 - DEBUG - VMI dd5c85ac-61a0-11ef-b7b3-fa163edb1ebd is active in agent 10.0.0.44 2024-08-23 22:41:56,055 - INFO - Verified Pod ctest-pod-41443141 in agent 10.0.0.44 2024-08-23 22:41:56,055 - DEBUG - Requesting: http://10.0.0.46:8108/Snh_VirtualMachineDatabaseList?x=95b959a6-e750-4f27-8dd3-cbaa90f57e1b 2024-08-23 22:41:56,063 - INFO - Pod ctest-pod-41443141 with uuid 95b959a6-e750-4f27-8dd3-cbaa90f57e1b found in kube manager 2024-08-23 22:41:56,063 - INFO - Pod ctest-pod-41443141 verification passed 2024-08-23 22:41:56,071 - INFO - Pod ctest-pod-15247553 is in running state.Got IP 10.47.255.244 2024-08-23 22:41:56,135 - DEBUG - Pod ctest-pod-15247553 has vmi de2f8b64-61a0-11ef-b7b3-fa163edb1ebd 2024-08-23 22:41:56,135 - INFO - Verified pod ctest-pod-15247553 in contrail-api 2024-08-23 22:41:56,158 - DEBUG - VMI de2f8b64-61a0-11ef-b7b3-fa163edb1ebd is active in agent 10.0.0.44 2024-08-23 22:41:56,158 - INFO - Verified Pod ctest-pod-15247553 in agent 10.0.0.44 2024-08-23 22:41:56,159 - DEBUG - Requesting: http://10.0.0.46:8108/Snh_VirtualMachineDatabaseList?x=3fd737eb-b1e4-4e7c-ad53-b81a8ed674db 2024-08-23 22:41:56,168 - INFO - Pod ctest-pod-15247553 with uuid 3fd737eb-b1e4-4e7c-ad53-b81a8ed674db found in kube manager 2024-08-23 22:41:56,168 - INFO - Pod ctest-pod-15247553 verification passed 2024-08-23 22:41:56,168 - INFO - ================================================================================ 2024-08-23 22:41:56,168 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-08-23 22:41:56,169 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-08-23 22:41:56,540 - DEBUG - Nothing to compare xmpp stats {'10.0.0.44': {'10.0.0.46': '0'}} with 2024-08-23 22:41:56,541 - INFO - Initial checks done. Running the testcase now 2024-08-23 22:41:56,541 - INFO - 2024-08-23 22:41:56,624 - DEBUG - [Pod ctest-pod-23988855] Cmd: echo ctest-pod-23988855 > /usr/share/nginx/html/index.html, Output: 2024-08-23 22:41:56,701 - DEBUG - [Pod ctest-pod-82227388] Cmd: echo ctest-pod-82227388 > /usr/share/nginx/html/index.html, Output: 2024-08-23 22:41:56,781 - DEBUG - [Pod ctest-pod-22357979] Cmd: echo ctest-pod-22357979 > /usr/share/nginx/html/index.html, Output: 2024-08-23 22:41:56,860 - DEBUG - [Pod ctest-pod-20003189] Cmd: echo ctest-pod-20003189 > /usr/share/nginx/html/index.html, Output: 2024-08-23 22:41:56,867 - DEBUG - Service ctest-nginx-svc-79663426 not present 2024-08-23 22:41:56,868 - INFO - Creating service ctest-nginx-svc-79663426 2024-08-23 22:41:56,892 - INFO - Created Service ctest-nginx-svc-79663426 2024-08-23 22:41:56,917 - WARNING - Service UUID 7738dbd5-78d2-4244-8fe4-371154ef5f34 not yet found in contrail-api 2024-08-23 22:41:57,923 - INFO - Validated that Service ctest-nginx-svc-79663426 is seen in contrail-api 2024-08-23 22:41:57,923 - DEBUG - Requesting: http://10.0.0.46:8108/Snh_LoadbalancerDatabaseList?x=7738dbd5-78d2-4244-8fe4-371154ef5f34 2024-08-23 22:41:57,928 - INFO - Service ctest-nginx-svc-79663426 with uuid 7738dbd5-78d2-4244-8fe4-371154ef5f34 found in kube manager 2024-08-23 22:41:57,928 - INFO - Service ctest-nginx-svc-79663426 verification passed 2024-08-23 22:41:58,997 - DEBUG - [Pod ctest-pod-23751985] Cmd: wget http://10.100.12.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.12.188:80 (10.100.12.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-23988855 2024-08-23 22:41:58,997 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd wget http://10.100.12.188:80/ -O - -T 5 -t 1 passed 2024-08-23 22:41:58,997 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd output: Connecting to 10.100.12.188:80 (10.100.12.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-23988855 2024-08-23 22:41:59,064 - DEBUG - [Pod ctest-pod-23751985] Cmd: wget http://10.100.12.188:80/ -O - -T 5 -t 1 , Output: ctest-pod-82227388 Connecting to 10.100.12.188:80 (10.100.12.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-23 22:41:59,064 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd wget http://10.100.12.188:80/ -O - -T 5 -t 1 passed 2024-08-23 22:41:59,064 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd output: ctest-pod-82227388 Connecting to 10.100.12.188:80 (10.100.12.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-23 22:41:59,064 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-23988855': 1, 'ctest-pod-82227388': 1} 2024-08-23 22:41:59,144 - DEBUG - [Pod ctest-pod-05386412] Cmd: wget http://10.100.12.188:80/ -O - -T 5 -t 1 , Output: ctest-pod-23988855 Connecting to 10.100.12.188:80 (10.100.12.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-23 22:41:59,144 - DEBUG - [Pod Pod ctest-pod-05386412] Cmd wget http://10.100.12.188:80/ -O - -T 5 -t 1 passed 2024-08-23 22:41:59,144 - DEBUG - [Pod Pod ctest-pod-05386412] Cmd output: ctest-pod-23988855 Connecting to 10.100.12.188:80 (10.100.12.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-23 22:41:59,208 - DEBUG - [Pod ctest-pod-05386412] Cmd: wget http://10.100.12.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.12.188:80 (10.100.12.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-23988855 2024-08-23 22:41:59,208 - DEBUG - [Pod Pod ctest-pod-05386412] Cmd wget http://10.100.12.188:80/ -O - -T 5 -t 1 passed 2024-08-23 22:41:59,208 - DEBUG - [Pod Pod ctest-pod-05386412] Cmd output: Connecting to 10.100.12.188:80 (10.100.12.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-23988855 2024-08-23 22:41:59,259 - DEBUG - [Pod ctest-pod-05386412] Cmd: wget http://10.100.12.188:80/ -O - -T 5 -t 1 , Output: ctest-pod-23988855 Connecting to 10.100.12.188:80 (10.100.12.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-23 22:41:59,259 - DEBUG - [Pod Pod ctest-pod-05386412] Cmd wget http://10.100.12.188:80/ -O - -T 5 -t 1 passed 2024-08-23 22:41:59,259 - DEBUG - [Pod Pod ctest-pod-05386412] Cmd output: ctest-pod-23988855 Connecting to 10.100.12.188:80 (10.100.12.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-23 22:41:59,321 - DEBUG - [Pod ctest-pod-05386412] Cmd: wget http://10.100.12.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.12.188:80 (10.100.12.188:80) ctest-pod-82227388 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-23 22:41:59,321 - DEBUG - [Pod Pod ctest-pod-05386412] Cmd wget http://10.100.12.188:80/ -O - -T 5 -t 1 passed 2024-08-23 22:41:59,321 - DEBUG - [Pod Pod ctest-pod-05386412] Cmd output: Connecting to 10.100.12.188:80 (10.100.12.188:80) ctest-pod-82227388 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-23 22:41:59,321 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-23988855': 3, 'ctest-pod-82227388': 1} 2024-08-23 22:41:59,329 - DEBUG - Network policy ingress-on-service not present 2024-08-23 22:41:59,330 - INFO - Creating Network Policy ingress-on-service 2024-08-23 22:41:59,370 - INFO - Network policy found in k8s 2024-08-23 22:41:59,371 - DEBUG - Requesting: http://10.0.0.46:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=b542e2fd-537d-4587-a654-8c68917ab58d 2024-08-23 22:41:59,388 - INFO - Network Policy ingress-on-service with uuid b542e2fd-537d-4587-a654-8c68917ab58d found in kube manager 2024-08-23 22:41:59,445 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-08-23 22:41:59,445 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-08-23 22:41:59,445 - DEBUG - Requesting: http://10.0.0.46:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=b542e2fd-537d-4587-a654-8c68917ab58d 2024-08-23 22:41:59,493 - WARNING - Network policy with name ingress-on-service not found in agent 2024-08-23 22:42:01,494 - DEBUG - Requesting: http://10.0.0.46:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=b542e2fd-537d-4587-a654-8c68917ab58d 2024-08-23 22:42:01,600 - INFO - Network policy with name ingress-on-service found in agent 2024-08-23 22:42:01,601 - INFO - Network Policy ingress-on-service verification passed 2024-08-23 22:42:06,687 - DEBUG - [Pod ctest-pod-23751985] Cmd: wget http://10.100.12.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:42:06,687 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd wget http://10.100.12.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:42:06,687 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:42:11,772 - DEBUG - [Pod ctest-pod-23751985] Cmd: wget http://10.100.12.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:42:11,773 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd wget http://10.100.12.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:42:11,773 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:42:16,845 - DEBUG - [Pod ctest-pod-23751985] Cmd: wget http://10.100.12.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:42:16,846 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd wget http://10.100.12.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:42:16,846 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:42:22,375 - DEBUG - [Pod ctest-pod-23751985] Cmd: wget http://10.100.12.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:42:22,375 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd wget http://10.100.12.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:42:22,376 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:42:27,459 - DEBUG - [Pod ctest-pod-23751985] Cmd: wget http://10.100.12.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:42:27,459 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd wget http://10.100.12.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:42:27,459 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:42:32,531 - DEBUG - [Pod ctest-pod-23751985] Cmd: wget http://10.100.12.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:42:32,531 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd wget http://10.100.12.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:42:32,532 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:42:37,606 - DEBUG - [Pod ctest-pod-23751985] Cmd: wget http://10.100.12.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:42:37,607 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd wget http://10.100.12.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:42:37,607 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:42:42,693 - DEBUG - [Pod ctest-pod-23751985] Cmd: wget http://10.100.12.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:42:42,694 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd wget http://10.100.12.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:42:42,694 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:42:47,759 - DEBUG - [Pod ctest-pod-23751985] Cmd: wget http://10.100.12.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:42:47,759 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd wget http://10.100.12.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:42:47,759 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:42:52,821 - DEBUG - [Pod ctest-pod-23751985] Cmd: wget http://10.100.12.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:42:52,821 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd wget http://10.100.12.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:42:52,821 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:42:52,821 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-23988855': 0, 'ctest-pod-82227388': 0} 2024-08-23 22:42:52,880 - DEBUG - [Pod ctest-pod-41443141] Cmd: wget http://10.100.12.188:80/ -O - -T 5 -t 1 , Output: ctest-pod-23988855 Connecting to 10.100.12.188:80 (10.100.12.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-23 22:42:52,880 - DEBUG - [Pod Pod ctest-pod-41443141] Cmd wget http://10.100.12.188:80/ -O - -T 5 -t 1 passed 2024-08-23 22:42:52,880 - DEBUG - [Pod Pod ctest-pod-41443141] Cmd output: ctest-pod-23988855 Connecting to 10.100.12.188:80 (10.100.12.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-23 22:42:52,937 - DEBUG - [Pod ctest-pod-41443141] Cmd: wget http://10.100.12.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.12.188:80 (10.100.12.188:80) ctest-pod-82227388 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-23 22:42:52,938 - DEBUG - [Pod Pod ctest-pod-41443141] Cmd wget http://10.100.12.188:80/ -O - -T 5 -t 1 passed 2024-08-23 22:42:52,938 - DEBUG - [Pod Pod ctest-pod-41443141] Cmd output: Connecting to 10.100.12.188:80 (10.100.12.188:80) ctest-pod-82227388 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-23 22:42:52,938 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-23988855': 1, 'ctest-pod-82227388': 1} 2024-08-23 22:42:58,000 - DEBUG - [Pod ctest-pod-05386412] Cmd: wget http://10.100.12.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:42:58,000 - DEBUG - [Pod Pod ctest-pod-05386412] Cmd wget http://10.100.12.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:42:58,000 - DEBUG - [Pod Pod ctest-pod-05386412] Cmd output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:43:03,058 - DEBUG - [Pod ctest-pod-05386412] Cmd: wget http://10.100.12.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:43:03,058 - DEBUG - [Pod Pod ctest-pod-05386412] Cmd wget http://10.100.12.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:43:03,058 - DEBUG - [Pod Pod ctest-pod-05386412] Cmd output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:43:08,116 - DEBUG - [Pod ctest-pod-05386412] Cmd: wget http://10.100.12.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:43:08,116 - DEBUG - [Pod Pod ctest-pod-05386412] Cmd wget http://10.100.12.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:43:08,116 - DEBUG - [Pod Pod ctest-pod-05386412] Cmd output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:43:13,193 - DEBUG - [Pod ctest-pod-05386412] Cmd: wget http://10.100.12.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:43:13,194 - DEBUG - [Pod Pod ctest-pod-05386412] Cmd wget http://10.100.12.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:43:13,194 - DEBUG - [Pod Pod ctest-pod-05386412] Cmd output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:43:18,271 - DEBUG - [Pod ctest-pod-05386412] Cmd: wget http://10.100.12.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:43:18,271 - DEBUG - [Pod Pod ctest-pod-05386412] Cmd wget http://10.100.12.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:43:18,272 - DEBUG - [Pod Pod ctest-pod-05386412] Cmd output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:43:23,366 - DEBUG - [Pod ctest-pod-05386412] Cmd: wget http://10.100.12.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:43:23,366 - DEBUG - [Pod Pod ctest-pod-05386412] Cmd wget http://10.100.12.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:43:23,366 - DEBUG - [Pod Pod ctest-pod-05386412] Cmd output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:43:43,955 - DEBUG - [Pod ctest-pod-05386412] Cmd: wget http://10.100.12.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:43:43,955 - DEBUG - [Pod Pod ctest-pod-05386412] Cmd wget http://10.100.12.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:43:43,955 - DEBUG - [Pod Pod ctest-pod-05386412] Cmd output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:43:52,081 - DEBUG - [Pod ctest-pod-05386412] Cmd: wget http://10.100.12.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:43:52,081 - DEBUG - [Pod Pod ctest-pod-05386412] Cmd wget http://10.100.12.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:43:52,081 - DEBUG - [Pod Pod ctest-pod-05386412] Cmd output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:43:57,156 - DEBUG - [Pod ctest-pod-05386412] Cmd: wget http://10.100.12.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:43:57,157 - DEBUG - [Pod Pod ctest-pod-05386412] Cmd wget http://10.100.12.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:43:57,157 - DEBUG - [Pod Pod ctest-pod-05386412] Cmd output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:44:02,231 - DEBUG - [Pod ctest-pod-05386412] Cmd: wget http://10.100.12.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:44:02,231 - DEBUG - [Pod Pod ctest-pod-05386412] Cmd wget http://10.100.12.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:44:02,231 - DEBUG - [Pod Pod ctest-pod-05386412] Cmd output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:44:02,231 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-23988855': 0, 'ctest-pod-82227388': 0} 2024-08-23 22:44:04,321 - DEBUG - [Pod ctest-pod-41443141] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.883 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.069 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.086 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.069/0.346/0.883 ms 2024-08-23 22:44:04,321 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-41443141 with expectation True passed 2024-08-23 22:44:06,411 - DEBUG - [Pod ctest-pod-23751985] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.377 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.081 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.093 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.081/0.517/1.377 ms 2024-08-23 22:44:06,411 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-23751985 with expectation True passed 2024-08-23 22:44:08,499 - DEBUG - [Pod ctest-pod-05386412] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.725 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.093 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.092 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.092/0.303/0.725 ms 2024-08-23 22:44:08,500 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-05386412 with expectation True passed 2024-08-23 22:44:08,573 - DEBUG - [Pod ctest-pod-41443141] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-23 22:44:08,574 - DEBUG - [Pod Pod ctest-pod-41443141] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-08-23 22:44:08,574 - DEBUG - [Pod Pod ctest-pod-41443141] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-23 22:44:08,574 - INFO - wget check of of http://10.47.255.251 from ctest-pod-41443141 passed 2024-08-23 22:44:08,647 - DEBUG - [Pod ctest-pod-41443141] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-23 22:44:08,647 - DEBUG - [Pod Pod ctest-pod-41443141] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-08-23 22:44:08,647 - DEBUG - [Pod Pod ctest-pod-41443141] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-23 22:44:08,647 - INFO - wget check of of http://10.47.255.250 from ctest-pod-41443141 passed 2024-08-23 22:44:13,742 - DEBUG - [Pod ctest-pod-23751985] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-23 22:44:13,742 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-23 22:44:13,742 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-23 22:44:13,742 - INFO - wget check of of http://10.47.255.250 from ctest-pod-23751985 passed 2024-08-23 22:44:18,818 - DEBUG - [Pod ctest-pod-15247553] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-08-23 22:44:18,818 - DEBUG - [Pod Pod ctest-pod-15247553] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-08-23 22:44:18,818 - DEBUG - [Pod Pod ctest-pod-15247553] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-08-23 22:44:18,818 - INFO - wget check of of http://10.47.255.251 from ctest-pod-15247553 passed 2024-08-23 22:44:18,835 - INFO - Updating Network Policy ingress-on-service 2024-08-23 22:44:23,909 - DEBUG - [Pod ctest-pod-23751985] Cmd: wget http://10.100.12.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:44:23,909 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd wget http://10.100.12.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:44:23,909 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:44:28,972 - DEBUG - [Pod ctest-pod-23751985] Cmd: wget http://10.100.12.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:44:28,972 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd wget http://10.100.12.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:44:28,972 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:44:34,077 - DEBUG - [Pod ctest-pod-23751985] Cmd: wget http://10.100.12.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:44:34,078 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd wget http://10.100.12.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:44:34,078 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:44:39,154 - DEBUG - [Pod ctest-pod-23751985] Cmd: wget http://10.100.12.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:44:39,155 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd wget http://10.100.12.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:44:39,155 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:44:44,231 - DEBUG - [Pod ctest-pod-23751985] Cmd: wget http://10.100.12.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:44:44,231 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd wget http://10.100.12.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:44:44,231 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:44:49,322 - DEBUG - [Pod ctest-pod-23751985] Cmd: wget http://10.100.12.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:44:49,322 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd wget http://10.100.12.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:44:49,322 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:45:00,061 - DEBUG - [Pod ctest-pod-23751985] Cmd: wget http://10.100.12.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:45:00,062 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd wget http://10.100.12.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:45:00,062 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:45:05,138 - DEBUG - [Pod ctest-pod-23751985] Cmd: wget http://10.100.12.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:45:05,138 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd wget http://10.100.12.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:45:05,139 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:45:10,194 - DEBUG - [Pod ctest-pod-23751985] Cmd: wget http://10.100.12.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:45:10,195 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd wget http://10.100.12.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:45:10,195 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:45:15,265 - DEBUG - [Pod ctest-pod-23751985] Cmd: wget http://10.100.12.188:80/ -O - -T 5 -t 1 , Output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:45:15,266 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd wget http://10.100.12.188:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:45:15,266 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd output: Connecting to 10.100.12.188:80 (10.100.12.188:80) wget: download timed out 2024-08-23 22:45:15,266 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-23988855': 0, 'ctest-pod-82227388': 0} 2024-08-23 22:45:19,034 - DEBUG - [Pod ctest-pod-41443141] Cmd: wget http://10.100.12.188:80/ -O - -T 5 -t 1 , Output: ctest-pod-23988855 Connecting to 10.100.12.188:80 (10.100.12.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-23 22:45:19,035 - DEBUG - [Pod Pod ctest-pod-41443141] Cmd wget http://10.100.12.188:80/ -O - -T 5 -t 1 passed 2024-08-23 22:45:19,035 - DEBUG - [Pod Pod ctest-pod-41443141] Cmd output: ctest-pod-23988855 Connecting to 10.100.12.188:80 (10.100.12.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-23 22:45:19,172 - DEBUG - [Pod ctest-pod-41443141] Cmd: wget http://10.100.12.188:80/ -O - -T 5 -t 1 , Output: ctest-pod-82227388 Connecting to 10.100.12.188:80 (10.100.12.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-23 22:45:19,172 - DEBUG - [Pod Pod ctest-pod-41443141] Cmd wget http://10.100.12.188:80/ -O - -T 5 -t 1 passed 2024-08-23 22:45:19,172 - DEBUG - [Pod Pod ctest-pod-41443141] Cmd output: ctest-pod-82227388 Connecting to 10.100.12.188:80 (10.100.12.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-23 22:45:19,172 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-23988855': 1, 'ctest-pod-82227388': 1} 2024-08-23 22:45:19,253 - DEBUG - [Pod ctest-pod-05386412] Cmd: wget http://10.100.12.188:80/ -O - -T 5 -t 1 , Output: ctest-pod-82227388 Connecting to 10.100.12.188:80 (10.100.12.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-23 22:45:19,253 - DEBUG - [Pod Pod ctest-pod-05386412] Cmd wget http://10.100.12.188:80/ -O - -T 5 -t 1 passed 2024-08-23 22:45:19,253 - DEBUG - [Pod Pod ctest-pod-05386412] Cmd output: ctest-pod-82227388 Connecting to 10.100.12.188:80 (10.100.12.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-23 22:45:19,330 - DEBUG - [Pod ctest-pod-05386412] Cmd: wget http://10.100.12.188:80/ -O - -T 5 -t 1 , Output: ctest-pod-82227388 Connecting to 10.100.12.188:80 (10.100.12.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-23 22:45:19,330 - DEBUG - [Pod Pod ctest-pod-05386412] Cmd wget http://10.100.12.188:80/ -O - -T 5 -t 1 passed 2024-08-23 22:45:19,330 - DEBUG - [Pod Pod ctest-pod-05386412] Cmd output: ctest-pod-82227388 Connecting to 10.100.12.188:80 (10.100.12.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-23 22:45:19,410 - DEBUG - [Pod ctest-pod-05386412] Cmd: wget http://10.100.12.188:80/ -O - -T 5 -t 1 , Output: ctest-pod-23988855 Connecting to 10.100.12.188:80 (10.100.12.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-23 22:45:19,411 - DEBUG - [Pod Pod ctest-pod-05386412] Cmd wget http://10.100.12.188:80/ -O - -T 5 -t 1 passed 2024-08-23 22:45:19,411 - DEBUG - [Pod Pod ctest-pod-05386412] Cmd output: ctest-pod-23988855 Connecting to 10.100.12.188:80 (10.100.12.188:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-23 22:45:19,411 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-23988855': 1, 'ctest-pod-82227388': 2} 2024-08-23 22:45:21,491 - DEBUG - [Pod ctest-pod-41443141] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.920 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.068 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.078 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.068/0.355/0.920 ms 2024-08-23 22:45:21,491 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-41443141 with expectation True passed 2024-08-23 22:45:45,781 - DEBUG - [Pod ctest-pod-23751985] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.854 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.084 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.070/0.336/0.854 ms 2024-08-23 22:45:45,781 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-23751985 with expectation True passed 2024-08-23 22:45:47,872 - DEBUG - [Pod ctest-pod-05386412] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.826 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.206 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.079 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.079/0.370/0.826 ms 2024-08-23 22:45:47,873 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-05386412 with expectation True passed 2024-08-23 22:45:47,959 - DEBUG - [Pod ctest-pod-41443141] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-23 22:45:47,960 - DEBUG - [Pod Pod ctest-pod-41443141] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-08-23 22:45:47,960 - DEBUG - [Pod Pod ctest-pod-41443141] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-23 22:45:47,960 - INFO - wget check of of http://10.47.255.251 from ctest-pod-41443141 passed 2024-08-23 22:45:48,032 - DEBUG - [Pod ctest-pod-41443141] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-23 22:45:48,032 - DEBUG - [Pod Pod ctest-pod-41443141] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-08-23 22:45:48,032 - DEBUG - [Pod Pod ctest-pod-41443141] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-23 22:45:48,032 - INFO - wget check of of http://10.47.255.250 from ctest-pod-41443141 passed 2024-08-23 22:45:53,092 - DEBUG - [Pod ctest-pod-23751985] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-23 22:45:53,092 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-23 22:45:53,092 - DEBUG - [Pod Pod ctest-pod-23751985] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-23 22:45:53,092 - INFO - wget check of of http://10.47.255.250 from ctest-pod-23751985 passed 2024-08-23 22:45:53,167 - DEBUG - [Pod ctest-pod-15247553] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-23 22:45:53,168 - DEBUG - [Pod Pod ctest-pod-15247553] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-08-23 22:45:53,168 - DEBUG - [Pod Pod ctest-pod-15247553] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-23 22:45:53,168 - INFO - wget check of of http://10.47.255.251 from ctest-pod-15247553 passed 2024-08-23 22:45:53,169 - INFO - Deleting Network Policy : ingress-on-service 2024-08-23 22:45:53,171 - INFO - Deleting service : ctest-nginx-svc-79663426 2024-08-23 22:45:53,574 - DEBUG - No XMPP flaps were noticed during the test 2024-08-23 22:45:53,574 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:57] 2024-08-23 22:45:53,574 - INFO - -------------------------------------------------------------------------------- 2024-08-23 22:45:53,592 - INFO - Deleting pod ctest-new-default-61203526:ctest-pod-23988855 2024-08-23 22:45:53,594 - INFO - Deleting pod ctest-new-default-61203526:ctest-pod-82227388 2024-08-23 22:45:53,595 - INFO - Deleting pod ctest-non-default-61798118:ctest-pod-22357979 2024-08-23 22:45:53,596 - INFO - Deleting pod ctest-non-default-61798118:ctest-pod-20003189 2024-08-23 22:45:53,597 - INFO - Deleting pod ctest-new-default-61203526:ctest-pod-23751985 2024-08-23 22:45:53,598 - INFO - Deleting pod ctest-new-default-61203526:ctest-pod-41443141 2024-08-23 22:45:53,599 - INFO - Deleting pod ctest-non-default-61798118:ctest-pod-05386412 2024-08-23 22:45:53,600 - INFO - Deleting pod ctest-non-default-61798118:ctest-pod-15247553 2024-08-23 22:45:53,813 - WARNING - Pod uuid 1719eaac-a5e9-4539-9775-87f6060897a8 is still seen in agent 10.0.0.44 VM list 2024-08-23 22:45:53,824 - WARNING - Pod uuid 3707d7b9-40b9-45d9-bc6b-82cb995f32b8 is still seen in agent 10.0.0.44 VM list 2024-08-23 22:45:53,825 - WARNING - Pod uuid 1fa02261-904c-4039-bf75-3db15d82c299 is still seen in agent 10.0.0.44 VM list 2024-08-23 22:45:53,825 - WARNING - Pod uuid 95b959a6-e750-4f27-8dd3-cbaa90f57e1b is still seen in agent 10.0.0.44 VM list 2024-08-23 22:45:53,826 - WARNING - Pod uuid 3fd737eb-b1e4-4e7c-ad53-b81a8ed674db is still seen in agent 10.0.0.44 VM list 2024-08-23 22:45:53,832 - WARNING - Pod uuid a84a1e1c-9c90-4c30-a290-f0461084cf12 is still seen in agent 10.0.0.44 VM list 2024-08-23 22:45:53,833 - WARNING - Pod uuid c7a0c84c-f984-4da2-a03a-e743f7c5c348 is still seen in agent 10.0.0.44 VM list 2024-08-23 22:45:53,834 - WARNING - Pod uuid 0144b677-4c2a-40fc-b817-50cda58b4c7d is still seen in agent 10.0.0.44 VM list 2024-08-23 22:45:58,879 - WARNING - Pod uuid 1fa02261-904c-4039-bf75-3db15d82c299 is still seen in agent 10.0.0.44 VM list 2024-08-23 22:45:58,880 - WARNING - Pod uuid 3fd737eb-b1e4-4e7c-ad53-b81a8ed674db is still seen in agent 10.0.0.44 VM list 2024-08-23 22:45:58,881 - WARNING - Pod uuid 95b959a6-e750-4f27-8dd3-cbaa90f57e1b is still seen in agent 10.0.0.44 VM list 2024-08-23 22:45:58,883 - DEBUG - Pod 3707d7b9-40b9-45d9-bc6b-82cb995f32b8 is not in agent 10.0.0.44 VM list 2024-08-23 22:45:58,898 - DEBUG - VMI dbd02338-61a0-11ef-b7b3-fa163edb1ebd is removed from agent 10.0.0.44 2024-08-23 22:45:58,898 - INFO - Verified that pod ctest-pod-22357979 is removed in agent 2024-08-23 22:45:58,978 - DEBUG - Pod 1719eaac-a5e9-4539-9775-87f6060897a8 is not in agent 10.0.0.44 VM list 2024-08-23 22:45:59,005 - DEBUG - VMI db22ff50-61a0-11ef-b7b3-fa163edb1ebd is removed from agent 10.0.0.44 2024-08-23 22:45:59,006 - INFO - Verified that pod ctest-pod-82227388 is removed in agent 2024-08-23 22:45:59,063 - WARNING - Pod uuid 0144b677-4c2a-40fc-b817-50cda58b4c7d is still seen in agent 10.0.0.44 VM list 2024-08-23 22:45:59,068 - DEBUG - Pod c7a0c84c-f984-4da2-a03a-e743f7c5c348 is not in agent 10.0.0.44 VM list 2024-08-23 22:45:59,076 - DEBUG - Pod a84a1e1c-9c90-4c30-a290-f0461084cf12 is not in agent 10.0.0.44 VM list 2024-08-23 22:45:59,091 - DEBUG - VMI dc5922aa-61a0-11ef-b7b3-fa163edb1ebd is removed from agent 10.0.0.44 2024-08-23 22:45:59,091 - INFO - Verified that pod ctest-pod-20003189 is removed in agent 2024-08-23 22:45:59,095 - DEBUG - VMI daab156c-61a0-11ef-b7b3-fa163edb1ebd is removed from agent 10.0.0.44 2024-08-23 22:45:59,095 - INFO - Verified that pod ctest-pod-23988855 is removed in agent 2024-08-23 22:46:03,920 - WARNING - Pod uuid 95b959a6-e750-4f27-8dd3-cbaa90f57e1b is still seen in agent 10.0.0.44 VM list 2024-08-23 22:46:03,922 - WARNING - Pod uuid 3fd737eb-b1e4-4e7c-ad53-b81a8ed674db is still seen in agent 10.0.0.44 VM list 2024-08-23 22:46:03,923 - WARNING - Pod uuid 1fa02261-904c-4039-bf75-3db15d82c299 is still seen in agent 10.0.0.44 VM list 2024-08-23 22:46:04,077 - WARNING - Pod uuid 0144b677-4c2a-40fc-b817-50cda58b4c7d is still seen in agent 10.0.0.44 VM list 2024-08-23 22:46:08,967 - WARNING - Pod uuid 95b959a6-e750-4f27-8dd3-cbaa90f57e1b is still seen in agent 10.0.0.44 VM list 2024-08-23 22:46:08,969 - WARNING - Pod uuid 1fa02261-904c-4039-bf75-3db15d82c299 is still seen in agent 10.0.0.44 VM list 2024-08-23 22:46:08,969 - WARNING - Pod uuid 3fd737eb-b1e4-4e7c-ad53-b81a8ed674db is still seen in agent 10.0.0.44 VM list 2024-08-23 22:46:09,084 - WARNING - Pod uuid 0144b677-4c2a-40fc-b817-50cda58b4c7d is still seen in agent 10.0.0.44 VM list 2024-08-23 22:46:13,989 - WARNING - Pod uuid 95b959a6-e750-4f27-8dd3-cbaa90f57e1b is still seen in agent 10.0.0.44 VM list 2024-08-23 22:46:13,993 - WARNING - Pod uuid 1fa02261-904c-4039-bf75-3db15d82c299 is still seen in agent 10.0.0.44 VM list 2024-08-23 22:46:13,993 - WARNING - Pod uuid 3fd737eb-b1e4-4e7c-ad53-b81a8ed674db is still seen in agent 10.0.0.44 VM list 2024-08-23 22:46:14,099 - WARNING - Pod uuid 0144b677-4c2a-40fc-b817-50cda58b4c7d is still seen in agent 10.0.0.44 VM list 2024-08-23 22:46:19,016 - WARNING - Pod uuid 95b959a6-e750-4f27-8dd3-cbaa90f57e1b is still seen in agent 10.0.0.44 VM list 2024-08-23 22:46:19,022 - WARNING - Pod uuid 3fd737eb-b1e4-4e7c-ad53-b81a8ed674db is still seen in agent 10.0.0.44 VM list 2024-08-23 22:46:19,023 - WARNING - Pod uuid 1fa02261-904c-4039-bf75-3db15d82c299 is still seen in agent 10.0.0.44 VM list 2024-08-23 22:46:19,117 - WARNING - Pod uuid 0144b677-4c2a-40fc-b817-50cda58b4c7d is still seen in agent 10.0.0.44 VM list 2024-08-23 22:46:24,071 - WARNING - Pod uuid 95b959a6-e750-4f27-8dd3-cbaa90f57e1b is still seen in agent 10.0.0.44 VM list 2024-08-23 22:46:24,073 - WARNING - Pod uuid 1fa02261-904c-4039-bf75-3db15d82c299 is still seen in agent 10.0.0.44 VM list 2024-08-23 22:46:24,073 - WARNING - Pod uuid 3fd737eb-b1e4-4e7c-ad53-b81a8ed674db is still seen in agent 10.0.0.44 VM list 2024-08-23 22:46:24,131 - WARNING - Pod uuid 0144b677-4c2a-40fc-b817-50cda58b4c7d is still seen in agent 10.0.0.44 VM list 2024-08-23 22:46:29,107 - DEBUG - Pod 1fa02261-904c-4039-bf75-3db15d82c299 is not in agent 10.0.0.44 VM list 2024-08-23 22:46:29,113 - DEBUG - Pod 95b959a6-e750-4f27-8dd3-cbaa90f57e1b is not in agent 10.0.0.44 VM list 2024-08-23 22:46:29,124 - DEBUG - Pod 3fd737eb-b1e4-4e7c-ad53-b81a8ed674db is not in agent 10.0.0.44 VM list 2024-08-23 22:46:29,140 - DEBUG - VMI ddc4dc7e-61a0-11ef-b7b3-fa163edb1ebd is removed from agent 10.0.0.44 2024-08-23 22:46:29,140 - INFO - Verified that pod ctest-pod-05386412 is removed in agent 2024-08-23 22:46:29,144 - DEBUG - VMI de2f8b64-61a0-11ef-b7b3-fa163edb1ebd is removed from agent 10.0.0.44 2024-08-23 22:46:29,144 - INFO - Verified that pod ctest-pod-15247553 is removed in agent 2024-08-23 22:46:29,145 - DEBUG - VMI dd5c85ac-61a0-11ef-b7b3-fa163edb1ebd is removed from agent 10.0.0.44 2024-08-23 22:46:29,146 - INFO - Verified that pod ctest-pod-41443141 is removed in agent 2024-08-23 22:46:29,149 - DEBUG - Pod 0144b677-4c2a-40fc-b817-50cda58b4c7d is not in agent 10.0.0.44 VM list 2024-08-23 22:46:29,160 - DEBUG - VMI dceeb1a8-61a0-11ef-b7b3-fa163edb1ebd is removed from agent 10.0.0.44 2024-08-23 22:46:29,161 - INFO - Verified that pod ctest-pod-23751985 is removed in agent 2024-08-23 22:46:29,161 - INFO - Deleting namespace ctest-non-default-61798118 2024-08-23 22:46:29,200 - DEBUG - Namespace ctest-non-default-61798118 still in k8s 2024-08-23 22:46:31,214 - DEBUG - Namespace ctest-non-default-61798118 still in k8s 2024-08-23 22:46:33,225 - DEBUG - Namespace ctest-non-default-61798118 still in k8s 2024-08-23 22:46:35,229 - DEBUG - Namespace ctest-non-default-61798118 is not in k8s 2024-08-23 22:46:35,230 - DEBUG - No need to check project deletion in contrail-api 2024-08-23 22:46:35,230 - INFO - Deleting namespace ctest-new-default-61203526 2024-08-23 22:46:35,238 - DEBUG - Namespace ctest-new-default-61203526 still in k8s 2024-08-23 22:46:37,255 - DEBUG - Namespace ctest-new-default-61203526 still in k8s 2024-08-23 22:46:39,279 - DEBUG - Namespace ctest-new-default-61203526 still in k8s 2024-08-23 22:46:41,283 - DEBUG - Namespace ctest-new-default-61203526 is not in k8s 2024-08-23 22:46:41,283 - DEBUG - No need to check project deletion in contrail-api