2024-09-19 02:23:22,590 - INFO - Using existing project ['default-domain', 'k8s-default'](825f80b3-2317-467f-b6ea-dcb9fa167f69) 2024-09-19 02:23:22,609 - DEBUG - Namespace ctest-new-default-46850956 not present 2024-09-19 02:23:22,617 - INFO - Created namespace ctest-new-default-46850956 2024-09-19 02:23:25,620 - DEBUG - Namespace ctest-non-default-25495965 not present 2024-09-19 02:23:25,629 - INFO - Created namespace ctest-non-default-25495965 2024-09-19 02:23:28,648 - DEBUG - Pod ctest-pod-35555246 not present 2024-09-19 02:23:28,648 - INFO - Creating Pod ctest-pod-35555246 2024-09-19 02:23:28,667 - DEBUG - Pod : ctest-pod-35555246 UUID is d07ac6e6-f695-45d5-97a1-88cecfe656af 2024-09-19 02:23:28,669 - DEBUG - Pod ctest-pod-15887602 not present 2024-09-19 02:23:28,669 - INFO - Creating Pod ctest-pod-15887602 2024-09-19 02:23:28,692 - DEBUG - Pod : ctest-pod-15887602 UUID is dc74761a-8e0e-4836-ac61-64832fabf773 2024-09-19 02:23:28,698 - DEBUG - Pod ctest-pod-14423114 not present 2024-09-19 02:23:28,698 - INFO - Creating Pod ctest-pod-14423114 2024-09-19 02:23:28,732 - DEBUG - Pod : ctest-pod-14423114 UUID is 4cee00b5-a759-44d0-9e0c-c588f614ae1b 2024-09-19 02:23:28,735 - DEBUG - Pod ctest-pod-95930774 not present 2024-09-19 02:23:28,735 - INFO - Creating Pod ctest-pod-95930774 2024-09-19 02:23:28,799 - DEBUG - Pod : ctest-pod-95930774 UUID is c7e7dd67-994b-48fe-ab12-691e002ffbeb 2024-09-19 02:23:28,804 - DEBUG - Pod ctest-pod-35379097 not present 2024-09-19 02:23:28,804 - INFO - Creating Pod ctest-pod-35379097 2024-09-19 02:23:28,849 - DEBUG - Pod : ctest-pod-35379097 UUID is 0cc79abb-ef72-4cb4-89ed-481985834791 2024-09-19 02:23:28,852 - DEBUG - Pod ctest-pod-74774246 not present 2024-09-19 02:23:28,852 - INFO - Creating Pod ctest-pod-74774246 2024-09-19 02:23:28,879 - DEBUG - Pod : ctest-pod-74774246 UUID is 711e7d3e-69f0-4032-bf37-83b49b05f704 2024-09-19 02:23:28,882 - DEBUG - Pod ctest-pod-22898764 not present 2024-09-19 02:23:28,882 - INFO - Creating Pod ctest-pod-22898764 2024-09-19 02:23:28,897 - DEBUG - Pod : ctest-pod-22898764 UUID is b90ef435-d31b-48ca-856e-8c68adc44911 2024-09-19 02:23:28,899 - DEBUG - Pod ctest-pod-01639658 not present 2024-09-19 02:23:28,899 - INFO - Creating Pod ctest-pod-01639658 2024-09-19 02:23:28,918 - DEBUG - Pod : ctest-pod-01639658 UUID is 487cdbde-934e-46fa-9898-193d00b3791a 2024-09-19 02:23:29,122 - INFO - Project default-domain:k8s-ctest-new-default-46850956 for Namespace ctest-new-default-46850956 is seen in contrail-api 2024-09-19 02:23:29,123 - DEBUG - Project uuid in Contrail is 2355d2fa-040d-4850-9952-188ffa585ec7 2024-09-19 02:23:29,259 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=feb22f39-3fb8-4450-b28d-2af563e3b766 2024-09-19 02:23:29,268 - INFO - Namespace ctest-new-default-46850956 with uuid feb22f39-3fb8-4450-b28d-2af563e3b766 found in kube manager 2024-09-19 02:23:29,268 - INFO - Namespace ctest-new-default-46850956 verification passed 2024-09-19 02:23:29,538 - INFO - Project default-domain:k8s-ctest-non-default-25495965 for Namespace ctest-non-default-25495965 is seen in contrail-api 2024-09-19 02:23:29,538 - DEBUG - Project uuid in Contrail is 5f9ba48f-259b-482b-b8bd-d47fbedb8bb4 2024-09-19 02:23:29,539 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=1c96780e-c46f-4094-a3a2-805c8759023e 2024-09-19 02:23:29,543 - INFO - Namespace ctest-non-default-25495965 with uuid 1c96780e-c46f-4094-a3a2-805c8759023e found in kube manager 2024-09-19 02:23:29,543 - INFO - Namespace ctest-non-default-25495965 verification passed 2024-09-19 02:23:29,548 - DEBUG - Pod ctest-pod-35555246 not in running state.Currently in Pending 2024-09-19 02:23:34,555 - DEBUG - Pod ctest-pod-35555246 not in running state.Currently in Pending 2024-09-19 02:23:39,563 - INFO - Pod ctest-pod-35555246 is in running state.Got IP 10.47.255.251 2024-09-19 02:23:39,627 - DEBUG - Pod ctest-pod-35555246 has vmi 29a39dd2-762e-11ef-a99e-fa163e19dbc6 2024-09-19 02:23:39,627 - INFO - Verified pod ctest-pod-35555246 in contrail-api 2024-09-19 02:23:39,640 - DEBUG - VMI 29a39dd2-762e-11ef-a99e-fa163e19dbc6 is active in agent 10.0.0.37 2024-09-19 02:23:39,640 - INFO - Verified Pod ctest-pod-35555246 in agent 10.0.0.37 2024-09-19 02:23:39,641 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=d07ac6e6-f695-45d5-97a1-88cecfe656af 2024-09-19 02:23:39,646 - INFO - Pod ctest-pod-35555246 with uuid d07ac6e6-f695-45d5-97a1-88cecfe656af found in kube manager 2024-09-19 02:23:39,647 - INFO - Pod ctest-pod-35555246 verification passed 2024-09-19 02:23:39,684 - DEBUG - Pod ctest-pod-15887602 not in running state.Currently in Pending 2024-09-19 02:23:44,691 - INFO - Pod ctest-pod-15887602 is in running state.Got IP 10.47.255.250 2024-09-19 02:23:44,713 - DEBUG - Pod ctest-pod-15887602 has vmi 2a323664-762e-11ef-a99e-fa163e19dbc6 2024-09-19 02:23:44,713 - INFO - Verified pod ctest-pod-15887602 in contrail-api 2024-09-19 02:23:44,726 - DEBUG - VMI 2a323664-762e-11ef-a99e-fa163e19dbc6 is active in agent 10.0.0.37 2024-09-19 02:23:44,726 - INFO - Verified Pod ctest-pod-15887602 in agent 10.0.0.37 2024-09-19 02:23:44,726 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=dc74761a-8e0e-4836-ac61-64832fabf773 2024-09-19 02:23:44,731 - INFO - Pod ctest-pod-15887602 with uuid dc74761a-8e0e-4836-ac61-64832fabf773 found in kube manager 2024-09-19 02:23:44,731 - INFO - Pod ctest-pod-15887602 verification passed 2024-09-19 02:23:44,736 - INFO - Pod ctest-pod-14423114 is in running state.Got IP 10.47.255.249 2024-09-19 02:23:44,798 - DEBUG - Pod ctest-pod-14423114 has vmi 2b0d41d2-762e-11ef-a99e-fa163e19dbc6 2024-09-19 02:23:44,798 - INFO - Verified pod ctest-pod-14423114 in contrail-api 2024-09-19 02:23:44,811 - DEBUG - VMI 2b0d41d2-762e-11ef-a99e-fa163e19dbc6 is active in agent 10.0.0.37 2024-09-19 02:23:44,812 - INFO - Verified Pod ctest-pod-14423114 in agent 10.0.0.37 2024-09-19 02:23:44,812 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=4cee00b5-a759-44d0-9e0c-c588f614ae1b 2024-09-19 02:23:44,822 - INFO - Pod ctest-pod-14423114 with uuid 4cee00b5-a759-44d0-9e0c-c588f614ae1b found in kube manager 2024-09-19 02:23:44,822 - INFO - Pod ctest-pod-14423114 verification passed 2024-09-19 02:23:44,827 - DEBUG - Pod ctest-pod-95930774 not in running state.Currently in Pending 2024-09-19 02:23:49,834 - INFO - Pod ctest-pod-95930774 is in running state.Got IP 10.47.255.248 2024-09-19 02:23:49,860 - DEBUG - Pod ctest-pod-95930774 has vmi 2b96344c-762e-11ef-a99e-fa163e19dbc6 2024-09-19 02:23:49,860 - INFO - Verified pod ctest-pod-95930774 in contrail-api 2024-09-19 02:23:49,876 - DEBUG - VMI 2b96344c-762e-11ef-a99e-fa163e19dbc6 is active in agent 10.0.0.37 2024-09-19 02:23:49,877 - INFO - Verified Pod ctest-pod-95930774 in agent 10.0.0.37 2024-09-19 02:23:49,877 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=c7e7dd67-994b-48fe-ab12-691e002ffbeb 2024-09-19 02:23:49,881 - INFO - Pod ctest-pod-95930774 with uuid c7e7dd67-994b-48fe-ab12-691e002ffbeb found in kube manager 2024-09-19 02:23:49,881 - INFO - Pod ctest-pod-95930774 verification passed 2024-09-19 02:23:49,886 - INFO - Pod ctest-pod-35379097 is in running state.Got IP 10.47.255.247 2024-09-19 02:23:49,946 - DEBUG - Pod ctest-pod-35379097 has vmi 2c5261b2-762e-11ef-a99e-fa163e19dbc6 2024-09-19 02:23:49,946 - INFO - Verified pod ctest-pod-35379097 in contrail-api 2024-09-19 02:23:49,959 - DEBUG - VMI 2c5261b2-762e-11ef-a99e-fa163e19dbc6 is active in agent 10.0.0.37 2024-09-19 02:23:49,959 - INFO - Verified Pod ctest-pod-35379097 in agent 10.0.0.37 2024-09-19 02:23:49,960 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=0cc79abb-ef72-4cb4-89ed-481985834791 2024-09-19 02:23:49,965 - INFO - Pod ctest-pod-35379097 with uuid 0cc79abb-ef72-4cb4-89ed-481985834791 found in kube manager 2024-09-19 02:23:49,965 - INFO - Pod ctest-pod-35379097 verification passed 2024-09-19 02:23:49,972 - INFO - Pod ctest-pod-22898764 is in running state.Got IP 10.47.255.245 2024-09-19 02:23:49,996 - DEBUG - Pod ctest-pod-22898764 has vmi 2d8731ca-762e-11ef-a99e-fa163e19dbc6 2024-09-19 02:23:49,996 - INFO - Verified pod ctest-pod-22898764 in contrail-api 2024-09-19 02:23:50,010 - DEBUG - VMI 2d8731ca-762e-11ef-a99e-fa163e19dbc6 is active in agent 10.0.0.37 2024-09-19 02:23:50,010 - INFO - Verified Pod ctest-pod-22898764 in agent 10.0.0.37 2024-09-19 02:23:50,010 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=b90ef435-d31b-48ca-856e-8c68adc44911 2024-09-19 02:23:50,015 - INFO - Pod ctest-pod-22898764 with uuid b90ef435-d31b-48ca-856e-8c68adc44911 found in kube manager 2024-09-19 02:23:50,015 - INFO - Pod ctest-pod-22898764 verification passed 2024-09-19 02:23:50,020 - INFO - Pod ctest-pod-74774246 is in running state.Got IP 10.47.255.246 2024-09-19 02:23:50,082 - DEBUG - Pod ctest-pod-74774246 has vmi 2cfeb610-762e-11ef-a99e-fa163e19dbc6 2024-09-19 02:23:50,082 - INFO - Verified pod ctest-pod-74774246 in contrail-api 2024-09-19 02:23:50,095 - DEBUG - VMI 2cfeb610-762e-11ef-a99e-fa163e19dbc6 is active in agent 10.0.0.37 2024-09-19 02:23:50,095 - INFO - Verified Pod ctest-pod-74774246 in agent 10.0.0.37 2024-09-19 02:23:50,096 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=711e7d3e-69f0-4032-bf37-83b49b05f704 2024-09-19 02:23:50,100 - INFO - Pod ctest-pod-74774246 with uuid 711e7d3e-69f0-4032-bf37-83b49b05f704 found in kube manager 2024-09-19 02:23:50,101 - INFO - Pod ctest-pod-74774246 verification passed 2024-09-19 02:23:50,106 - INFO - Pod ctest-pod-01639658 is in running state.Got IP 10.47.255.244 2024-09-19 02:23:50,166 - DEBUG - Pod ctest-pod-01639658 has vmi 2e1dc590-762e-11ef-a99e-fa163e19dbc6 2024-09-19 02:23:50,166 - INFO - Verified pod ctest-pod-01639658 in contrail-api 2024-09-19 02:23:50,181 - DEBUG - VMI 2e1dc590-762e-11ef-a99e-fa163e19dbc6 is active in agent 10.0.0.37 2024-09-19 02:23:50,181 - INFO - Verified Pod ctest-pod-01639658 in agent 10.0.0.37 2024-09-19 02:23:50,181 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=487cdbde-934e-46fa-9898-193d00b3791a 2024-09-19 02:23:50,186 - INFO - Pod ctest-pod-01639658 with uuid 487cdbde-934e-46fa-9898-193d00b3791a found in kube manager 2024-09-19 02:23:50,186 - INFO - Pod ctest-pod-01639658 verification passed 2024-09-19 02:23:50,186 - INFO - ================================================================================ 2024-09-19 02:23:50,186 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-09-19 02:23:50,186 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-09-19 02:23:50,440 - DEBUG - Nothing to compare xmpp stats {'10.0.0.37': {'10.0.0.22': '0'}} with 2024-09-19 02:23:50,440 - INFO - Initial checks done. Running the testcase now 2024-09-19 02:23:50,440 - INFO - 2024-09-19 02:23:50,504 - DEBUG - [Pod ctest-pod-35555246] Cmd: echo ctest-pod-35555246 > /usr/share/nginx/html/index.html, Output: 2024-09-19 02:23:50,578 - DEBUG - [Pod ctest-pod-15887602] Cmd: echo ctest-pod-15887602 > /usr/share/nginx/html/index.html, Output: 2024-09-19 02:23:50,636 - DEBUG - [Pod ctest-pod-14423114] Cmd: echo ctest-pod-14423114 > /usr/share/nginx/html/index.html, Output: 2024-09-19 02:23:50,708 - DEBUG - [Pod ctest-pod-95930774] Cmd: echo ctest-pod-95930774 > /usr/share/nginx/html/index.html, Output: 2024-09-19 02:23:50,711 - DEBUG - Service ctest-nginx-svc-13418031 not present 2024-09-19 02:23:50,712 - INFO - Creating service ctest-nginx-svc-13418031 2024-09-19 02:23:50,734 - INFO - Created Service ctest-nginx-svc-13418031 2024-09-19 02:23:50,740 - WARNING - Service UUID 359e8cc4-1069-461a-9326-01bd1576a180 not yet found in contrail-api 2024-09-19 02:23:51,756 - INFO - Validated that Service ctest-nginx-svc-13418031 is seen in contrail-api 2024-09-19 02:23:51,756 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_LoadbalancerDatabaseList?x=359e8cc4-1069-461a-9326-01bd1576a180 2024-09-19 02:23:51,763 - INFO - Service ctest-nginx-svc-13418031 with uuid 359e8cc4-1069-461a-9326-01bd1576a180 found in kube manager 2024-09-19 02:23:51,763 - INFO - Service ctest-nginx-svc-13418031 verification passed 2024-09-19 02:23:52,835 - DEBUG - [Pod ctest-pod-35379097] Cmd: wget http://10.108.168.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.168.84:80 (10.108.168.84:80) ctest-pod-35555246 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:23:52,835 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd wget http://10.108.168.84:80/ -O - -T 5 -t 1 passed 2024-09-19 02:23:52,835 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd output: Connecting to 10.108.168.84:80 (10.108.168.84:80) ctest-pod-35555246 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:23:52,897 - DEBUG - [Pod ctest-pod-35379097] Cmd: wget http://10.108.168.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.168.84:80 (10.108.168.84:80) ctest-pod-15887602 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:23:52,897 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd wget http://10.108.168.84:80/ -O - -T 5 -t 1 passed 2024-09-19 02:23:52,897 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd output: Connecting to 10.108.168.84:80 (10.108.168.84:80) ctest-pod-15887602 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:23:52,897 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-35555246': 1, 'ctest-pod-15887602': 1} 2024-09-19 02:23:52,958 - DEBUG - [Pod ctest-pod-22898764] Cmd: wget http://10.108.168.84:80/ -O - -T 5 -t 1 , Output: ctest-pod-15887602 Connecting to 10.108.168.84:80 (10.108.168.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:23:52,958 - DEBUG - [Pod Pod ctest-pod-22898764] Cmd wget http://10.108.168.84:80/ -O - -T 5 -t 1 passed 2024-09-19 02:23:52,958 - DEBUG - [Pod Pod ctest-pod-22898764] Cmd output: ctest-pod-15887602 Connecting to 10.108.168.84:80 (10.108.168.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:23:53,017 - DEBUG - [Pod ctest-pod-22898764] Cmd: wget http://10.108.168.84:80/ -O - -T 5 -t 1 , Output: ctest-pod-15887602 Connecting to 10.108.168.84:80 (10.108.168.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:23:53,017 - DEBUG - [Pod Pod ctest-pod-22898764] Cmd wget http://10.108.168.84:80/ -O - -T 5 -t 1 passed 2024-09-19 02:23:53,017 - DEBUG - [Pod Pod ctest-pod-22898764] Cmd output: ctest-pod-15887602 Connecting to 10.108.168.84:80 (10.108.168.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:23:53,075 - DEBUG - [Pod ctest-pod-22898764] Cmd: wget http://10.108.168.84:80/ -O - -T 5 -t 1 , Output: ctest-pod-35555246 Connecting to 10.108.168.84:80 (10.108.168.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:23:53,075 - DEBUG - [Pod Pod ctest-pod-22898764] Cmd wget http://10.108.168.84:80/ -O - -T 5 -t 1 passed 2024-09-19 02:23:53,075 - DEBUG - [Pod Pod ctest-pod-22898764] Cmd output: ctest-pod-35555246 Connecting to 10.108.168.84:80 (10.108.168.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:23:53,075 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-35555246': 1, 'ctest-pod-15887602': 2} 2024-09-19 02:23:53,079 - DEBUG - Network policy ingress-on-service not present 2024-09-19 02:23:53,080 - INFO - Creating Network Policy ingress-on-service 2024-09-19 02:23:53,092 - INFO - Network policy found in k8s 2024-09-19 02:23:53,092 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=b5c39c7a-dc14-4226-8489-779dd3ea8b57 2024-09-19 02:23:53,099 - INFO - Network Policy ingress-on-service with uuid b5c39c7a-dc14-4226-8489-779dd3ea8b57 found in kube manager 2024-09-19 02:23:53,136 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-09-19 02:23:53,136 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-09-19 02:23:53,137 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=b5c39c7a-dc14-4226-8489-779dd3ea8b57 2024-09-19 02:23:53,176 - WARNING - Network policy with name ingress-on-service not found in agent 2024-09-19 02:23:55,177 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=b5c39c7a-dc14-4226-8489-779dd3ea8b57 2024-09-19 02:23:55,205 - INFO - Network policy with name ingress-on-service found in agent 2024-09-19 02:23:55,206 - INFO - Network Policy ingress-on-service verification passed 2024-09-19 02:24:00,247 - DEBUG - [Pod ctest-pod-35379097] Cmd: wget http://10.108.168.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:24:00,247 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd wget http://10.108.168.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:24:00,247 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:24:05,315 - DEBUG - [Pod ctest-pod-35379097] Cmd: wget http://10.108.168.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:24:05,316 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd wget http://10.108.168.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:24:05,316 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:24:10,368 - DEBUG - [Pod ctest-pod-35379097] Cmd: wget http://10.108.168.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:24:10,368 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd wget http://10.108.168.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:24:10,368 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:24:15,426 - DEBUG - [Pod ctest-pod-35379097] Cmd: wget http://10.108.168.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:24:15,426 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd wget http://10.108.168.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:24:15,426 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:24:20,479 - DEBUG - [Pod ctest-pod-35379097] Cmd: wget http://10.108.168.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:24:20,479 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd wget http://10.108.168.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:24:20,479 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:24:25,530 - DEBUG - [Pod ctest-pod-35379097] Cmd: wget http://10.108.168.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:24:25,531 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd wget http://10.108.168.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:24:25,531 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:24:30,593 - DEBUG - [Pod ctest-pod-35379097] Cmd: wget http://10.108.168.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:24:30,594 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd wget http://10.108.168.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:24:30,594 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:24:35,639 - DEBUG - [Pod ctest-pod-35379097] Cmd: wget http://10.108.168.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:24:35,639 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd wget http://10.108.168.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:24:35,639 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:24:40,707 - DEBUG - [Pod ctest-pod-35379097] Cmd: wget http://10.108.168.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:24:40,708 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd wget http://10.108.168.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:24:40,708 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:24:45,760 - DEBUG - [Pod ctest-pod-35379097] Cmd: wget http://10.108.168.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:24:45,760 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd wget http://10.108.168.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:24:45,760 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:24:45,760 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-35555246': 0, 'ctest-pod-15887602': 0} 2024-09-19 02:24:45,831 - DEBUG - [Pod ctest-pod-74774246] Cmd: wget http://10.108.168.84:80/ -O - -T 5 -t 1 , Output: ctest-pod-35555246 Connecting to 10.108.168.84:80 (10.108.168.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:24:45,831 - DEBUG - [Pod Pod ctest-pod-74774246] Cmd wget http://10.108.168.84:80/ -O - -T 5 -t 1 passed 2024-09-19 02:24:45,831 - DEBUG - [Pod Pod ctest-pod-74774246] Cmd output: ctest-pod-35555246 Connecting to 10.108.168.84:80 (10.108.168.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:24:45,899 - DEBUG - [Pod ctest-pod-74774246] Cmd: wget http://10.108.168.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.168.84:80 (10.108.168.84:80) ctest-pod-35555246 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:24:45,900 - DEBUG - [Pod Pod ctest-pod-74774246] Cmd wget http://10.108.168.84:80/ -O - -T 5 -t 1 passed 2024-09-19 02:24:45,900 - DEBUG - [Pod Pod ctest-pod-74774246] Cmd output: Connecting to 10.108.168.84:80 (10.108.168.84:80) ctest-pod-35555246 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:24:45,960 - DEBUG - [Pod ctest-pod-74774246] Cmd: wget http://10.108.168.84:80/ -O - -T 5 -t 1 , Output: ctest-pod-35555246 Connecting to 10.108.168.84:80 (10.108.168.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:24:45,960 - DEBUG - [Pod Pod ctest-pod-74774246] Cmd wget http://10.108.168.84:80/ -O - -T 5 -t 1 passed 2024-09-19 02:24:45,960 - DEBUG - [Pod Pod ctest-pod-74774246] Cmd output: ctest-pod-35555246 Connecting to 10.108.168.84:80 (10.108.168.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:24:46,019 - DEBUG - [Pod ctest-pod-74774246] Cmd: wget http://10.108.168.84:80/ -O - -T 5 -t 1 , Output: ctest-pod-15887602 Connecting to 10.108.168.84:80 (10.108.168.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:24:46,019 - DEBUG - [Pod Pod ctest-pod-74774246] Cmd wget http://10.108.168.84:80/ -O - -T 5 -t 1 passed 2024-09-19 02:24:46,019 - DEBUG - [Pod Pod ctest-pod-74774246] Cmd output: ctest-pod-15887602 Connecting to 10.108.168.84:80 (10.108.168.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:24:46,019 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-35555246': 3, 'ctest-pod-15887602': 1} 2024-09-19 02:24:51,076 - DEBUG - [Pod ctest-pod-22898764] Cmd: wget http://10.108.168.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:24:51,077 - DEBUG - [Pod Pod ctest-pod-22898764] Cmd wget http://10.108.168.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:24:51,077 - DEBUG - [Pod Pod ctest-pod-22898764] Cmd output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:24:56,138 - DEBUG - [Pod ctest-pod-22898764] Cmd: wget http://10.108.168.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:24:56,138 - DEBUG - [Pod Pod ctest-pod-22898764] Cmd wget http://10.108.168.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:24:56,138 - DEBUG - [Pod Pod ctest-pod-22898764] Cmd output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:25:01,194 - DEBUG - [Pod ctest-pod-22898764] Cmd: wget http://10.108.168.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:25:01,194 - DEBUG - [Pod Pod ctest-pod-22898764] Cmd wget http://10.108.168.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:25:01,194 - DEBUG - [Pod Pod ctest-pod-22898764] Cmd output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:25:06,251 - DEBUG - [Pod ctest-pod-22898764] Cmd: wget http://10.108.168.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:25:06,251 - DEBUG - [Pod Pod ctest-pod-22898764] Cmd wget http://10.108.168.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:25:06,251 - DEBUG - [Pod Pod ctest-pod-22898764] Cmd output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:25:11,319 - DEBUG - [Pod ctest-pod-22898764] Cmd: wget http://10.108.168.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:25:11,320 - DEBUG - [Pod Pod ctest-pod-22898764] Cmd wget http://10.108.168.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:25:11,320 - DEBUG - [Pod Pod ctest-pod-22898764] Cmd output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:25:16,366 - DEBUG - [Pod ctest-pod-22898764] Cmd: wget http://10.108.168.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:25:16,366 - DEBUG - [Pod Pod ctest-pod-22898764] Cmd wget http://10.108.168.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:25:16,366 - DEBUG - [Pod Pod ctest-pod-22898764] Cmd output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:25:21,420 - DEBUG - [Pod ctest-pod-22898764] Cmd: wget http://10.108.168.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:25:21,420 - DEBUG - [Pod Pod ctest-pod-22898764] Cmd wget http://10.108.168.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:25:21,420 - DEBUG - [Pod Pod ctest-pod-22898764] Cmd output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:25:26,478 - DEBUG - [Pod ctest-pod-22898764] Cmd: wget http://10.108.168.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:25:26,478 - DEBUG - [Pod Pod ctest-pod-22898764] Cmd wget http://10.108.168.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:25:26,478 - DEBUG - [Pod Pod ctest-pod-22898764] Cmd output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:25:31,540 - DEBUG - [Pod ctest-pod-22898764] Cmd: wget http://10.108.168.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:25:31,540 - DEBUG - [Pod Pod ctest-pod-22898764] Cmd wget http://10.108.168.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:25:31,540 - DEBUG - [Pod Pod ctest-pod-22898764] Cmd output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:25:35,604 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2024-09-19 02:25:45,667 - DEBUG - [Pod ctest-pod-22898764] Cmd: wget http://10.108.168.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:25:45,667 - DEBUG - [Pod Pod ctest-pod-22898764] Cmd wget http://10.108.168.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:25:45,667 - DEBUG - [Pod Pod ctest-pod-22898764] Cmd output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:25:45,667 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-35555246': 0, 'ctest-pod-15887602': 0} 2024-09-19 02:25:47,729 - DEBUG - [Pod ctest-pod-74774246] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.938 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.069 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.094 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.069/0.700/1.938 ms 2024-09-19 02:25:47,729 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-74774246 with expectation True passed 2024-09-19 02:25:49,786 - DEBUG - [Pod ctest-pod-35379097] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.644 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.077 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.098 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.077/0.273/0.644 ms 2024-09-19 02:25:49,786 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-35379097 with expectation True passed 2024-09-19 02:25:51,855 - DEBUG - [Pod ctest-pod-22898764] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.523 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.092 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.228/0.523 ms 2024-09-19 02:25:51,855 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-22898764 with expectation True passed 2024-09-19 02:25:51,922 - DEBUG - [Pod ctest-pod-74774246] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-19 02:25:51,922 - DEBUG - [Pod Pod ctest-pod-74774246] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-19 02:25:51,922 - DEBUG - [Pod Pod ctest-pod-74774246] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-19 02:25:51,922 - INFO - wget check of of http://10.47.255.251 from ctest-pod-74774246 passed 2024-09-19 02:25:51,990 - DEBUG - [Pod ctest-pod-74774246] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-19 02:25:51,990 - DEBUG - [Pod Pod ctest-pod-74774246] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-09-19 02:25:51,990 - DEBUG - [Pod Pod ctest-pod-74774246] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-19 02:25:51,990 - INFO - wget check of of http://10.47.255.250 from ctest-pod-74774246 passed 2024-09-19 02:25:57,042 - DEBUG - [Pod ctest-pod-35379097] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-19 02:25:57,042 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-19 02:25:57,043 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-19 02:25:57,043 - INFO - wget check of of http://10.47.255.250 from ctest-pod-35379097 passed 2024-09-19 02:26:02,170 - DEBUG - [Pod ctest-pod-01639658] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-19 02:26:02,171 - DEBUG - [Pod Pod ctest-pod-01639658] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-19 02:26:02,171 - DEBUG - [Pod Pod ctest-pod-01639658] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2024-09-19 02:26:02,171 - INFO - wget check of of http://10.47.255.251 from ctest-pod-01639658 passed 2024-09-19 02:26:02,178 - INFO - Updating Network Policy ingress-on-service 2024-09-19 02:26:07,251 - DEBUG - [Pod ctest-pod-35379097] Cmd: wget http://10.108.168.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:26:07,252 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd wget http://10.108.168.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:26:07,252 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:26:12,301 - DEBUG - [Pod ctest-pod-35379097] Cmd: wget http://10.108.168.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:26:12,301 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd wget http://10.108.168.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:26:12,301 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:26:17,375 - DEBUG - [Pod ctest-pod-35379097] Cmd: wget http://10.108.168.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:26:17,375 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd wget http://10.108.168.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:26:17,375 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:26:22,423 - DEBUG - [Pod ctest-pod-35379097] Cmd: wget http://10.108.168.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:26:22,424 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd wget http://10.108.168.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:26:22,424 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:26:27,488 - DEBUG - [Pod ctest-pod-35379097] Cmd: wget http://10.108.168.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:26:27,488 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd wget http://10.108.168.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:26:27,488 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:26:32,534 - DEBUG - [Pod ctest-pod-35379097] Cmd: wget http://10.108.168.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:26:32,535 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd wget http://10.108.168.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:26:32,535 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:26:37,609 - DEBUG - [Pod ctest-pod-35379097] Cmd: wget http://10.108.168.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:26:37,609 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd wget http://10.108.168.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:26:37,609 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:26:42,693 - DEBUG - [Pod ctest-pod-35379097] Cmd: wget http://10.108.168.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:26:42,693 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd wget http://10.108.168.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:26:42,693 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:26:47,758 - DEBUG - [Pod ctest-pod-35379097] Cmd: wget http://10.108.168.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:26:47,758 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd wget http://10.108.168.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:26:47,758 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:26:52,820 - DEBUG - [Pod ctest-pod-35379097] Cmd: wget http://10.108.168.84:80/ -O - -T 5 -t 1 , Output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:26:52,820 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd wget http://10.108.168.84:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:26:52,820 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd output: Connecting to 10.108.168.84:80 (10.108.168.84:80) wget: download timed out 2024-09-19 02:26:52,820 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-35555246': 0, 'ctest-pod-15887602': 0} 2024-09-19 02:26:52,883 - DEBUG - [Pod ctest-pod-74774246] Cmd: wget http://10.108.168.84:80/ -O - -T 5 -t 1 , Output: ctest-pod-35555246 Connecting to 10.108.168.84:80 (10.108.168.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:26:52,883 - DEBUG - [Pod Pod ctest-pod-74774246] Cmd wget http://10.108.168.84:80/ -O - -T 5 -t 1 passed 2024-09-19 02:26:52,883 - DEBUG - [Pod Pod ctest-pod-74774246] Cmd output: ctest-pod-35555246 Connecting to 10.108.168.84:80 (10.108.168.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:26:52,967 - DEBUG - [Pod ctest-pod-74774246] Cmd: wget http://10.108.168.84:80/ -O - -T 5 -t 1 , Output: ctest-pod-15887602 Connecting to 10.108.168.84:80 (10.108.168.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:26:52,967 - DEBUG - [Pod Pod ctest-pod-74774246] Cmd wget http://10.108.168.84:80/ -O - -T 5 -t 1 passed 2024-09-19 02:26:52,967 - DEBUG - [Pod Pod ctest-pod-74774246] Cmd output: ctest-pod-15887602 Connecting to 10.108.168.84:80 (10.108.168.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:26:52,967 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-35555246': 1, 'ctest-pod-15887602': 1} 2024-09-19 02:26:53,039 - DEBUG - [Pod ctest-pod-22898764] Cmd: wget http://10.108.168.84:80/ -O - -T 5 -t 1 , Output: ctest-pod-15887602 Connecting to 10.108.168.84:80 (10.108.168.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:26:53,039 - DEBUG - [Pod Pod ctest-pod-22898764] Cmd wget http://10.108.168.84:80/ -O - -T 5 -t 1 passed 2024-09-19 02:26:53,039 - DEBUG - [Pod Pod ctest-pod-22898764] Cmd output: ctest-pod-15887602 Connecting to 10.108.168.84:80 (10.108.168.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:26:53,111 - DEBUG - [Pod ctest-pod-22898764] Cmd: wget http://10.108.168.84:80/ -O - -T 5 -t 1 , Output: ctest-pod-35555246 Connecting to 10.108.168.84:80 (10.108.168.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:26:53,111 - DEBUG - [Pod Pod ctest-pod-22898764] Cmd wget http://10.108.168.84:80/ -O - -T 5 -t 1 passed 2024-09-19 02:26:53,111 - DEBUG - [Pod Pod ctest-pod-22898764] Cmd output: ctest-pod-35555246 Connecting to 10.108.168.84:80 (10.108.168.84:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-09-19 02:26:53,111 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-35555246': 1, 'ctest-pod-15887602': 1} 2024-09-19 02:26:55,163 - DEBUG - [Pod ctest-pod-74774246] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.292 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.083 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.086 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.083/0.487/1.292 ms 2024-09-19 02:26:55,163 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-74774246 with expectation True passed 2024-09-19 02:26:57,211 - DEBUG - [Pod ctest-pod-35379097] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.702 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.075 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.070/0.282/0.702 ms 2024-09-19 02:26:57,211 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-35379097 with expectation True passed 2024-09-19 02:26:59,266 - DEBUG - [Pod ctest-pod-22898764] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.070 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.082 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.074 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.074/0.408/1.070 ms 2024-09-19 02:26:59,266 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-22898764 with expectation True passed 2024-09-19 02:26:59,340 - DEBUG - [Pod ctest-pod-74774246] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-19 02:26:59,340 - DEBUG - [Pod Pod ctest-pod-74774246] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-19 02:26:59,340 - DEBUG - [Pod Pod ctest-pod-74774246] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-19 02:26:59,340 - INFO - wget check of of http://10.47.255.251 from ctest-pod-74774246 passed 2024-09-19 02:26:59,418 - DEBUG - [Pod ctest-pod-74774246] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-19 02:26:59,418 - DEBUG - [Pod Pod ctest-pod-74774246] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-09-19 02:26:59,418 - DEBUG - [Pod Pod ctest-pod-74774246] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-19 02:26:59,418 - INFO - wget check of of http://10.47.255.250 from ctest-pod-74774246 passed 2024-09-19 02:27:04,483 - DEBUG - [Pod ctest-pod-35379097] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-19 02:27:04,483 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-19 02:27:04,483 - DEBUG - [Pod Pod ctest-pod-35379097] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-09-19 02:27:04,483 - INFO - wget check of of http://10.47.255.250 from ctest-pod-35379097 passed 2024-09-19 02:27:04,546 - DEBUG - [Pod ctest-pod-01639658] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-19 02:27:04,546 - DEBUG - [Pod Pod ctest-pod-01639658] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2024-09-19 02:27:04,546 - DEBUG - [Pod Pod ctest-pod-01639658] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-09-19 02:27:04,546 - INFO - wget check of of http://10.47.255.251 from ctest-pod-01639658 passed 2024-09-19 02:27:04,547 - INFO - Deleting Network Policy : ingress-on-service 2024-09-19 02:27:04,547 - INFO - Deleting service : ctest-nginx-svc-13418031 2024-09-19 02:27:04,809 - DEBUG - No XMPP flaps were noticed during the test 2024-09-19 02:27:04,809 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:14] 2024-09-19 02:27:04,809 - INFO - -------------------------------------------------------------------------------- 2024-09-19 02:27:04,814 - INFO - Deleting pod ctest-new-default-46850956:ctest-pod-35555246 2024-09-19 02:27:04,814 - INFO - Deleting pod ctest-new-default-46850956:ctest-pod-15887602 2024-09-19 02:27:04,815 - INFO - Deleting pod ctest-non-default-25495965:ctest-pod-14423114 2024-09-19 02:27:04,815 - INFO - Deleting pod ctest-non-default-25495965:ctest-pod-95930774 2024-09-19 02:27:04,815 - INFO - Deleting pod ctest-new-default-46850956:ctest-pod-35379097 2024-09-19 02:27:04,816 - INFO - Deleting pod ctest-new-default-46850956:ctest-pod-74774246 2024-09-19 02:27:04,816 - INFO - Deleting pod ctest-non-default-25495965:ctest-pod-22898764 2024-09-19 02:27:04,816 - INFO - Deleting pod ctest-non-default-25495965:ctest-pod-01639658 2024-09-19 02:27:04,882 - WARNING - Pod uuid c7e7dd67-994b-48fe-ab12-691e002ffbeb is still seen in agent 10.0.0.37 VM list 2024-09-19 02:27:04,883 - WARNING - Pod uuid d07ac6e6-f695-45d5-97a1-88cecfe656af is still seen in agent 10.0.0.37 VM list 2024-09-19 02:27:04,885 - WARNING - Pod uuid 711e7d3e-69f0-4032-bf37-83b49b05f704 is still seen in agent 10.0.0.37 VM list 2024-09-19 02:27:04,887 - WARNING - Pod uuid 4cee00b5-a759-44d0-9e0c-c588f614ae1b is still seen in agent 10.0.0.37 VM list 2024-09-19 02:27:04,923 - WARNING - Pod uuid b90ef435-d31b-48ca-856e-8c68adc44911 is still seen in agent 10.0.0.37 VM list 2024-09-19 02:27:04,923 - WARNING - Pod uuid dc74761a-8e0e-4836-ac61-64832fabf773 is still seen in agent 10.0.0.37 VM list 2024-09-19 02:27:04,925 - WARNING - Pod uuid 487cdbde-934e-46fa-9898-193d00b3791a is still seen in agent 10.0.0.37 VM list 2024-09-19 02:27:04,925 - WARNING - Pod uuid 0cc79abb-ef72-4cb4-89ed-481985834791 is still seen in agent 10.0.0.37 VM list 2024-09-19 02:27:09,901 - DEBUG - Pod d07ac6e6-f695-45d5-97a1-88cecfe656af is not in agent 10.0.0.37 VM list 2024-09-19 02:27:09,903 - WARNING - Pod uuid 711e7d3e-69f0-4032-bf37-83b49b05f704 is still seen in agent 10.0.0.37 VM list 2024-09-19 02:27:09,903 - DEBUG - Pod c7e7dd67-994b-48fe-ab12-691e002ffbeb is not in agent 10.0.0.37 VM list 2024-09-19 02:27:09,906 - DEBUG - Pod 4cee00b5-a759-44d0-9e0c-c588f614ae1b is not in agent 10.0.0.37 VM list 2024-09-19 02:27:09,922 - DEBUG - VMI 29a39dd2-762e-11ef-a99e-fa163e19dbc6 is removed from agent 10.0.0.37 2024-09-19 02:27:09,922 - INFO - Verified that pod ctest-pod-35555246 is removed in agent 2024-09-19 02:27:09,924 - DEBUG - VMI 2b0d41d2-762e-11ef-a99e-fa163e19dbc6 is removed from agent 10.0.0.37 2024-09-19 02:27:09,924 - INFO - Verified that pod ctest-pod-14423114 is removed in agent 2024-09-19 02:27:09,924 - DEBUG - VMI 2b96344c-762e-11ef-a99e-fa163e19dbc6 is removed from agent 10.0.0.37 2024-09-19 02:27:09,924 - INFO - Verified that pod ctest-pod-95930774 is removed in agent 2024-09-19 02:27:09,944 - WARNING - Pod uuid 0cc79abb-ef72-4cb4-89ed-481985834791 is still seen in agent 10.0.0.37 VM list 2024-09-19 02:27:09,944 - DEBUG - Pod dc74761a-8e0e-4836-ac61-64832fabf773 is not in agent 10.0.0.37 VM list 2024-09-19 02:27:09,946 - WARNING - Pod uuid b90ef435-d31b-48ca-856e-8c68adc44911 is still seen in agent 10.0.0.37 VM list 2024-09-19 02:27:09,948 - WARNING - Pod uuid 487cdbde-934e-46fa-9898-193d00b3791a is still seen in agent 10.0.0.37 VM list 2024-09-19 02:27:09,953 - DEBUG - VMI 2a323664-762e-11ef-a99e-fa163e19dbc6 is removed from agent 10.0.0.37 2024-09-19 02:27:09,953 - INFO - Verified that pod ctest-pod-15887602 is removed in agent 2024-09-19 02:27:14,918 - WARNING - Pod uuid 711e7d3e-69f0-4032-bf37-83b49b05f704 is still seen in agent 10.0.0.37 VM list 2024-09-19 02:27:14,958 - WARNING - Pod uuid 0cc79abb-ef72-4cb4-89ed-481985834791 is still seen in agent 10.0.0.37 VM list 2024-09-19 02:27:14,959 - WARNING - Pod uuid 487cdbde-934e-46fa-9898-193d00b3791a is still seen in agent 10.0.0.37 VM list 2024-09-19 02:27:14,960 - WARNING - Pod uuid b90ef435-d31b-48ca-856e-8c68adc44911 is still seen in agent 10.0.0.37 VM list 2024-09-19 02:27:19,926 - WARNING - Pod uuid 711e7d3e-69f0-4032-bf37-83b49b05f704 is still seen in agent 10.0.0.37 VM list 2024-09-19 02:27:19,973 - WARNING - Pod uuid 0cc79abb-ef72-4cb4-89ed-481985834791 is still seen in agent 10.0.0.37 VM list 2024-09-19 02:27:19,974 - WARNING - Pod uuid b90ef435-d31b-48ca-856e-8c68adc44911 is still seen in agent 10.0.0.37 VM list 2024-09-19 02:27:19,974 - WARNING - Pod uuid 487cdbde-934e-46fa-9898-193d00b3791a is still seen in agent 10.0.0.37 VM list 2024-09-19 02:27:24,934 - WARNING - Pod uuid 711e7d3e-69f0-4032-bf37-83b49b05f704 is still seen in agent 10.0.0.37 VM list 2024-09-19 02:27:24,990 - WARNING - Pod uuid 487cdbde-934e-46fa-9898-193d00b3791a is still seen in agent 10.0.0.37 VM list 2024-09-19 02:27:24,991 - WARNING - Pod uuid 0cc79abb-ef72-4cb4-89ed-481985834791 is still seen in agent 10.0.0.37 VM list 2024-09-19 02:27:24,992 - WARNING - Pod uuid b90ef435-d31b-48ca-856e-8c68adc44911 is still seen in agent 10.0.0.37 VM list 2024-09-19 02:27:29,941 - WARNING - Pod uuid 711e7d3e-69f0-4032-bf37-83b49b05f704 is still seen in agent 10.0.0.37 VM list 2024-09-19 02:27:30,006 - WARNING - Pod uuid 487cdbde-934e-46fa-9898-193d00b3791a is still seen in agent 10.0.0.37 VM list 2024-09-19 02:27:30,007 - WARNING - Pod uuid 0cc79abb-ef72-4cb4-89ed-481985834791 is still seen in agent 10.0.0.37 VM list 2024-09-19 02:27:30,008 - WARNING - Pod uuid b90ef435-d31b-48ca-856e-8c68adc44911 is still seen in agent 10.0.0.37 VM list 2024-09-19 02:27:34,965 - WARNING - Pod uuid 711e7d3e-69f0-4032-bf37-83b49b05f704 is still seen in agent 10.0.0.37 VM list 2024-09-19 02:27:35,026 - WARNING - Pod uuid b90ef435-d31b-48ca-856e-8c68adc44911 is still seen in agent 10.0.0.37 VM list 2024-09-19 02:27:35,027 - WARNING - Pod uuid 487cdbde-934e-46fa-9898-193d00b3791a is still seen in agent 10.0.0.37 VM list 2024-09-19 02:27:35,027 - WARNING - Pod uuid 0cc79abb-ef72-4cb4-89ed-481985834791 is still seen in agent 10.0.0.37 VM list 2024-09-19 02:27:39,972 - DEBUG - Pod 711e7d3e-69f0-4032-bf37-83b49b05f704 is not in agent 10.0.0.37 VM list 2024-09-19 02:27:39,978 - DEBUG - VMI 2cfeb610-762e-11ef-a99e-fa163e19dbc6 is removed from agent 10.0.0.37 2024-09-19 02:27:39,978 - INFO - Verified that pod ctest-pod-74774246 is removed in agent 2024-09-19 02:27:40,045 - DEBUG - Pod b90ef435-d31b-48ca-856e-8c68adc44911 is not in agent 10.0.0.37 VM list 2024-09-19 02:27:40,048 - DEBUG - Pod 0cc79abb-ef72-4cb4-89ed-481985834791 is not in agent 10.0.0.37 VM list 2024-09-19 02:27:40,050 - DEBUG - Pod 487cdbde-934e-46fa-9898-193d00b3791a is not in agent 10.0.0.37 VM list 2024-09-19 02:27:40,060 - DEBUG - VMI 2e1dc590-762e-11ef-a99e-fa163e19dbc6 is removed from agent 10.0.0.37 2024-09-19 02:27:40,060 - INFO - Verified that pod ctest-pod-01639658 is removed in agent 2024-09-19 02:27:40,062 - DEBUG - VMI 2c5261b2-762e-11ef-a99e-fa163e19dbc6 is removed from agent 10.0.0.37 2024-09-19 02:27:40,062 - INFO - Verified that pod ctest-pod-35379097 is removed in agent 2024-09-19 02:27:40,062 - DEBUG - VMI 2d8731ca-762e-11ef-a99e-fa163e19dbc6 is removed from agent 10.0.0.37 2024-09-19 02:27:40,062 - INFO - Verified that pod ctest-pod-22898764 is removed in agent 2024-09-19 02:27:40,062 - INFO - Deleting namespace ctest-non-default-25495965 2024-09-19 02:27:40,083 - DEBUG - Namespace ctest-non-default-25495965 still in k8s 2024-09-19 02:27:42,088 - DEBUG - Namespace ctest-non-default-25495965 still in k8s 2024-09-19 02:27:44,093 - DEBUG - Namespace ctest-non-default-25495965 still in k8s 2024-09-19 02:27:46,097 - DEBUG - Namespace ctest-non-default-25495965 is not in k8s 2024-09-19 02:27:46,097 - DEBUG - No need to check project deletion in contrail-api 2024-09-19 02:27:46,097 - INFO - Deleting namespace ctest-new-default-46850956 2024-09-19 02:27:46,105 - DEBUG - Namespace ctest-new-default-46850956 still in k8s 2024-09-19 02:27:48,110 - DEBUG - Namespace ctest-new-default-46850956 still in k8s 2024-09-19 02:27:50,117 - DEBUG - Namespace ctest-new-default-46850956 still in k8s 2024-09-19 02:27:52,121 - DEBUG - Namespace ctest-new-default-46850956 is not in k8s 2024-09-19 02:27:52,122 - DEBUG - No need to check project deletion in contrail-api