2024-08-26 10:04:58,384 - INFO - Using existing project ['default-domain', 'k8s-default'](6e29da11-3652-4fc1-9e92-a84c9959e2a7) 2024-08-26 10:04:58,411 - DEBUG - Namespace ctest-new-default-97237387 not present 2024-08-26 10:04:58,424 - INFO - Created namespace ctest-new-default-97237387 2024-08-26 10:05:01,428 - DEBUG - Namespace ctest-non-default-12326537 not present 2024-08-26 10:05:01,437 - INFO - Created namespace ctest-non-default-12326537 2024-08-26 10:05:04,458 - DEBUG - Pod ctest-pod-69371068 not present 2024-08-26 10:05:04,459 - INFO - Creating Pod ctest-pod-69371068 2024-08-26 10:05:04,494 - DEBUG - Pod : ctest-pod-69371068 UUID is 15009890-654d-4146-840b-25b399908e6a 2024-08-26 10:05:04,498 - DEBUG - Pod ctest-pod-91457991 not present 2024-08-26 10:05:04,499 - INFO - Creating Pod ctest-pod-91457991 2024-08-26 10:05:04,536 - DEBUG - Pod : ctest-pod-91457991 UUID is 7fb8275a-8893-4a77-8d02-4a9a5f006c03 2024-08-26 10:05:04,541 - DEBUG - Pod ctest-pod-04739296 not present 2024-08-26 10:05:04,541 - INFO - Creating Pod ctest-pod-04739296 2024-08-26 10:05:04,583 - DEBUG - Pod : ctest-pod-04739296 UUID is 90fd1fc2-87ff-4e00-8f5a-47059aaed9ec 2024-08-26 10:05:04,589 - DEBUG - Pod ctest-pod-80055392 not present 2024-08-26 10:05:04,590 - INFO - Creating Pod ctest-pod-80055392 2024-08-26 10:05:04,621 - DEBUG - Pod : ctest-pod-80055392 UUID is f1052100-e546-4a18-bb5a-f90170942780 2024-08-26 10:05:04,628 - DEBUG - Pod ctest-pod-25245338 not present 2024-08-26 10:05:04,628 - INFO - Creating Pod ctest-pod-25245338 2024-08-26 10:05:04,649 - DEBUG - Pod : ctest-pod-25245338 UUID is 411bee4f-26d7-48dd-ac30-4fd4090c8c06 2024-08-26 10:05:04,654 - DEBUG - Pod ctest-pod-23943016 not present 2024-08-26 10:05:04,655 - INFO - Creating Pod ctest-pod-23943016 2024-08-26 10:05:04,686 - DEBUG - Pod : ctest-pod-23943016 UUID is 64f8231b-acff-4c0c-9462-4d1f47edff83 2024-08-26 10:05:04,700 - DEBUG - Pod ctest-pod-83146200 not present 2024-08-26 10:05:04,700 - INFO - Creating Pod ctest-pod-83146200 2024-08-26 10:05:04,749 - DEBUG - Pod : ctest-pod-83146200 UUID is 0723a711-9a1e-459e-a741-d39365eb79c6 2024-08-26 10:05:04,752 - DEBUG - Pod ctest-pod-47323798 not present 2024-08-26 10:05:04,752 - INFO - Creating Pod ctest-pod-47323798 2024-08-26 10:05:04,792 - DEBUG - Pod : ctest-pod-47323798 UUID is c6e06734-3c0e-4c62-9a82-8208351c854e 2024-08-26 10:05:05,209 - INFO - Project default-domain:k8s-ctest-new-default-97237387 for Namespace ctest-new-default-97237387 is seen in contrail-api 2024-08-26 10:05:05,209 - DEBUG - Project uuid in Contrail is 3b90572b-da97-4612-9f77-9c76379e5a81 2024-08-26 10:05:05,626 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_NamespaceDatabaseList?namespace_uuid=fa9a32c8-e466-43b2-9ff7-8ad56e38da44 2024-08-26 10:05:05,647 - INFO - Namespace ctest-new-default-97237387 with uuid fa9a32c8-e466-43b2-9ff7-8ad56e38da44 found in kube manager 2024-08-26 10:05:05,647 - INFO - Namespace ctest-new-default-97237387 verification passed 2024-08-26 10:05:06,004 - INFO - Project default-domain:k8s-ctest-non-default-12326537 for Namespace ctest-non-default-12326537 is seen in contrail-api 2024-08-26 10:05:06,004 - DEBUG - Project uuid in Contrail is 74acdf8f-6f76-4287-bcc2-fb139a4b95e8 2024-08-26 10:05:06,004 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_NamespaceDatabaseList?namespace_uuid=b5673c25-185f-4682-9092-62c4049e8f0b 2024-08-26 10:05:06,009 - INFO - Namespace ctest-non-default-12326537 with uuid b5673c25-185f-4682-9092-62c4049e8f0b found in kube manager 2024-08-26 10:05:06,009 - INFO - Namespace ctest-non-default-12326537 verification passed 2024-08-26 10:05:06,015 - DEBUG - Pod ctest-pod-69371068 not in running state.Currently in Pending 2024-08-26 10:05:11,023 - DEBUG - Pod ctest-pod-69371068 not in running state.Currently in Pending 2024-08-26 10:05:16,033 - INFO - Pod ctest-pod-69371068 is in running state.Got IP 10.47.255.250 2024-08-26 10:05:16,084 - DEBUG - Pod ctest-pod-69371068 has vmi ac35a01e-6392-11ef-9f14-024278b7efe6 2024-08-26 10:05:16,084 - INFO - Verified pod ctest-pod-69371068 in contrail-api 2024-08-26 10:05:16,096 - DEBUG - VMI ac35a01e-6392-11ef-9f14-024278b7efe6 is active in agent 10.0.0.31 2024-08-26 10:05:16,096 - INFO - Verified Pod ctest-pod-69371068 in agent 10.0.0.31 2024-08-26 10:05:16,096 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_VirtualMachineDatabaseList?x=15009890-654d-4146-840b-25b399908e6a 2024-08-26 10:05:16,101 - INFO - Pod ctest-pod-69371068 with uuid 15009890-654d-4146-840b-25b399908e6a found in kube manager 2024-08-26 10:05:16,101 - INFO - Pod ctest-pod-69371068 verification passed 2024-08-26 10:05:16,111 - DEBUG - Pod ctest-pod-91457991 not in running state.Currently in Pending 2024-08-26 10:05:22,466 - INFO - Pod ctest-pod-91457991 is in running state.Got IP 10.47.255.249 2024-08-26 10:05:22,532 - DEBUG - Pod ctest-pod-91457991 has vmi acfa1d4a-6392-11ef-9f14-024278b7efe6 2024-08-26 10:05:22,532 - INFO - Verified pod ctest-pod-91457991 in contrail-api 2024-08-26 10:05:22,556 - DEBUG - VMI acfa1d4a-6392-11ef-9f14-024278b7efe6 is active in agent 10.0.0.31 2024-08-26 10:05:22,556 - INFO - Verified Pod ctest-pod-91457991 in agent 10.0.0.31 2024-08-26 10:05:22,556 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_VirtualMachineDatabaseList?x=7fb8275a-8893-4a77-8d02-4a9a5f006c03 2024-08-26 10:05:22,573 - INFO - Pod ctest-pod-91457991 with uuid 7fb8275a-8893-4a77-8d02-4a9a5f006c03 found in kube manager 2024-08-26 10:05:22,573 - INFO - Pod ctest-pod-91457991 verification passed 2024-08-26 10:05:22,586 - DEBUG - Pod ctest-pod-04739296 not in running state.Currently in Pending 2024-08-26 10:05:27,594 - INFO - Pod ctest-pod-04739296 is in running state.Got IP 10.47.255.248 2024-08-26 10:05:27,647 - DEBUG - Pod ctest-pod-04739296 has vmi adfb5b8c-6392-11ef-9f14-024278b7efe6 2024-08-26 10:05:27,647 - INFO - Verified pod ctest-pod-04739296 in contrail-api 2024-08-26 10:05:27,659 - DEBUG - VMI adfb5b8c-6392-11ef-9f14-024278b7efe6 is active in agent 10.0.0.31 2024-08-26 10:05:27,660 - INFO - Verified Pod ctest-pod-04739296 in agent 10.0.0.31 2024-08-26 10:05:27,660 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_VirtualMachineDatabaseList?x=90fd1fc2-87ff-4e00-8f5a-47059aaed9ec 2024-08-26 10:05:27,665 - INFO - Pod ctest-pod-04739296 with uuid 90fd1fc2-87ff-4e00-8f5a-47059aaed9ec found in kube manager 2024-08-26 10:05:27,665 - INFO - Pod ctest-pod-04739296 verification passed 2024-08-26 10:05:27,674 - INFO - Pod ctest-pod-80055392 is in running state.Got IP 10.47.255.247 2024-08-26 10:05:27,768 - DEBUG - Pod ctest-pod-80055392 has vmi aeb317cc-6392-11ef-9f14-024278b7efe6 2024-08-26 10:05:27,768 - INFO - Verified pod ctest-pod-80055392 in contrail-api 2024-08-26 10:05:27,782 - DEBUG - VMI aeb317cc-6392-11ef-9f14-024278b7efe6 is active in agent 10.0.0.31 2024-08-26 10:05:27,783 - INFO - Verified Pod ctest-pod-80055392 in agent 10.0.0.31 2024-08-26 10:05:27,783 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_VirtualMachineDatabaseList?x=f1052100-e546-4a18-bb5a-f90170942780 2024-08-26 10:05:27,789 - INFO - Pod ctest-pod-80055392 with uuid f1052100-e546-4a18-bb5a-f90170942780 found in kube manager 2024-08-26 10:05:27,789 - INFO - Pod ctest-pod-80055392 verification passed 2024-08-26 10:05:27,795 - INFO - Pod ctest-pod-25245338 is in running state.Got IP 10.47.255.246 2024-08-26 10:05:27,888 - DEBUG - Pod ctest-pod-25245338 has vmi b0cfd932-6392-11ef-9f14-024278b7efe6 2024-08-26 10:05:27,888 - INFO - Verified pod ctest-pod-25245338 in contrail-api 2024-08-26 10:05:27,900 - DEBUG - VMI b0cfd932-6392-11ef-9f14-024278b7efe6 is active in agent 10.0.0.31 2024-08-26 10:05:27,901 - INFO - Verified Pod ctest-pod-25245338 in agent 10.0.0.31 2024-08-26 10:05:27,901 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_VirtualMachineDatabaseList?x=411bee4f-26d7-48dd-ac30-4fd4090c8c06 2024-08-26 10:05:27,905 - INFO - Pod ctest-pod-25245338 with uuid 411bee4f-26d7-48dd-ac30-4fd4090c8c06 found in kube manager 2024-08-26 10:05:27,905 - INFO - Pod ctest-pod-25245338 verification passed 2024-08-26 10:05:27,911 - INFO - Pod ctest-pod-83146200 is in running state.Got IP 10.47.255.244 2024-08-26 10:05:28,004 - DEBUG - Pod ctest-pod-83146200 has vmi b2804640-6392-11ef-9f14-024278b7efe6 2024-08-26 10:05:28,004 - INFO - Verified pod ctest-pod-83146200 in contrail-api 2024-08-26 10:05:28,020 - DEBUG - VMI b2804640-6392-11ef-9f14-024278b7efe6 is active in agent 10.0.0.31 2024-08-26 10:05:28,020 - INFO - Verified Pod ctest-pod-83146200 in agent 10.0.0.31 2024-08-26 10:05:28,020 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_VirtualMachineDatabaseList?x=0723a711-9a1e-459e-a741-d39365eb79c6 2024-08-26 10:05:28,026 - INFO - Pod ctest-pod-83146200 with uuid 0723a711-9a1e-459e-a741-d39365eb79c6 found in kube manager 2024-08-26 10:05:28,027 - INFO - Pod ctest-pod-83146200 verification passed 2024-08-26 10:05:28,034 - INFO - Pod ctest-pod-23943016 is in running state.Got IP 10.47.255.245 2024-08-26 10:05:28,127 - DEBUG - Pod ctest-pod-23943016 has vmi b19d0632-6392-11ef-9f14-024278b7efe6 2024-08-26 10:05:28,127 - INFO - Verified pod ctest-pod-23943016 in contrail-api 2024-08-26 10:05:28,140 - DEBUG - VMI b19d0632-6392-11ef-9f14-024278b7efe6 is active in agent 10.0.0.31 2024-08-26 10:05:28,140 - INFO - Verified Pod ctest-pod-23943016 in agent 10.0.0.31 2024-08-26 10:05:28,141 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_VirtualMachineDatabaseList?x=64f8231b-acff-4c0c-9462-4d1f47edff83 2024-08-26 10:05:28,145 - INFO - Pod ctest-pod-23943016 with uuid 64f8231b-acff-4c0c-9462-4d1f47edff83 found in kube manager 2024-08-26 10:05:28,145 - INFO - Pod ctest-pod-23943016 verification passed 2024-08-26 10:05:28,151 - INFO - Pod ctest-pod-47323798 is in running state.Got IP 10.47.255.243 2024-08-26 10:05:28,243 - DEBUG - Pod ctest-pod-47323798 has vmi b36d3252-6392-11ef-9f14-024278b7efe6 2024-08-26 10:05:28,243 - INFO - Verified pod ctest-pod-47323798 in contrail-api 2024-08-26 10:05:28,256 - DEBUG - VMI b36d3252-6392-11ef-9f14-024278b7efe6 is active in agent 10.0.0.31 2024-08-26 10:05:28,256 - INFO - Verified Pod ctest-pod-47323798 in agent 10.0.0.31 2024-08-26 10:05:28,256 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_VirtualMachineDatabaseList?x=c6e06734-3c0e-4c62-9a82-8208351c854e 2024-08-26 10:05:28,262 - INFO - Pod ctest-pod-47323798 with uuid c6e06734-3c0e-4c62-9a82-8208351c854e found in kube manager 2024-08-26 10:05:28,262 - INFO - Pod ctest-pod-47323798 verification passed 2024-08-26 10:05:28,262 - INFO - ================================================================================ 2024-08-26 10:05:28,262 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2024-08-26 10:05:28,262 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2024-08-26 10:05:28,540 - DEBUG - Nothing to compare xmpp stats {'10.0.0.31': {'10.0.0.31': '3'}} with 2024-08-26 10:05:28,540 - INFO - Initial checks done. Running the testcase now 2024-08-26 10:05:28,540 - INFO - 2024-08-26 10:05:28,631 - DEBUG - [Pod ctest-pod-69371068] Cmd: echo ctest-pod-69371068 > /usr/share/nginx/html/index.html, Output: 2024-08-26 10:05:28,736 - DEBUG - [Pod ctest-pod-91457991] Cmd: echo ctest-pod-91457991 > /usr/share/nginx/html/index.html, Output: 2024-08-26 10:05:28,849 - DEBUG - [Pod ctest-pod-04739296] Cmd: echo ctest-pod-04739296 > /usr/share/nginx/html/index.html, Output: 2024-08-26 10:05:28,926 - DEBUG - [Pod ctest-pod-80055392] Cmd: echo ctest-pod-80055392 > /usr/share/nginx/html/index.html, Output: 2024-08-26 10:05:28,930 - DEBUG - Service ctest-nginx-svc-10150460 not present 2024-08-26 10:05:28,930 - INFO - Creating service ctest-nginx-svc-10150460 2024-08-26 10:05:28,954 - INFO - Created Service ctest-nginx-svc-10150460 2024-08-26 10:05:28,960 - WARNING - Service UUID 45901d72-796e-4d9c-9cc3-fc215db26115 not yet found in contrail-api 2024-08-26 10:05:29,975 - INFO - Validated that Service ctest-nginx-svc-10150460 is seen in contrail-api 2024-08-26 10:05:29,975 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_LoadbalancerDatabaseList?x=45901d72-796e-4d9c-9cc3-fc215db26115 2024-08-26 10:05:29,981 - INFO - Service ctest-nginx-svc-10150460 with uuid 45901d72-796e-4d9c-9cc3-fc215db26115 found in kube manager 2024-08-26 10:05:29,981 - INFO - Service ctest-nginx-svc-10150460 verification passed 2024-08-26 10:05:31,092 - DEBUG - [Pod ctest-pod-25245338] Cmd: wget http://10.102.115.116:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.115.116:80 (10.102.115.116:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA ctest-pod-91457991 written to stdout 2024-08-26 10:05:31,092 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd wget http://10.102.115.116:80/ -O - -T 5 -t 1 passed 2024-08-26 10:05:31,092 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd output: Connecting to 10.102.115.116:80 (10.102.115.116:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA ctest-pod-91457991 written to stdout 2024-08-26 10:05:31,172 - DEBUG - [Pod ctest-pod-25245338] Cmd: wget http://10.102.115.116:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.115.116:80 (10.102.115.116:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-91457991 2024-08-26 10:05:31,172 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd wget http://10.102.115.116:80/ -O - -T 5 -t 1 passed 2024-08-26 10:05:31,172 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd output: Connecting to 10.102.115.116:80 (10.102.115.116:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-91457991 2024-08-26 10:05:31,270 - DEBUG - [Pod ctest-pod-25245338] Cmd: wget http://10.102.115.116:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.115.116:80 (10.102.115.116:80) writing to stdout ctest-pod-91457991 - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 10:05:31,270 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd wget http://10.102.115.116:80/ -O - -T 5 -t 1 passed 2024-08-26 10:05:31,270 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd output: Connecting to 10.102.115.116:80 (10.102.115.116:80) writing to stdout ctest-pod-91457991 - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 10:05:31,354 - DEBUG - [Pod ctest-pod-25245338] Cmd: wget http://10.102.115.116:80/ -O - -T 5 -t 1 , Output: ctest-pod-69371068 Connecting to 10.102.115.116:80 (10.102.115.116:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 10:05:31,354 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd wget http://10.102.115.116:80/ -O - -T 5 -t 1 passed 2024-08-26 10:05:31,354 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd output: ctest-pod-69371068 Connecting to 10.102.115.116:80 (10.102.115.116:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 10:05:31,354 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-69371068': 1, 'ctest-pod-91457991': 3} 2024-08-26 10:05:31,448 - DEBUG - [Pod ctest-pod-83146200] Cmd: wget http://10.102.115.116:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.115.116:80 (10.102.115.116:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-69371068 2024-08-26 10:05:31,448 - DEBUG - [Pod Pod ctest-pod-83146200] Cmd wget http://10.102.115.116:80/ -O - -T 5 -t 1 passed 2024-08-26 10:05:31,448 - DEBUG - [Pod Pod ctest-pod-83146200] Cmd output: Connecting to 10.102.115.116:80 (10.102.115.116:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-69371068 2024-08-26 10:05:31,536 - DEBUG - [Pod ctest-pod-83146200] Cmd: wget http://10.102.115.116:80/ -O - -T 5 -t 1 , Output: ctest-pod-91457991 Connecting to 10.102.115.116:80 (10.102.115.116:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 10:05:31,536 - DEBUG - [Pod Pod ctest-pod-83146200] Cmd wget http://10.102.115.116:80/ -O - -T 5 -t 1 passed 2024-08-26 10:05:31,536 - DEBUG - [Pod Pod ctest-pod-83146200] Cmd output: ctest-pod-91457991 Connecting to 10.102.115.116:80 (10.102.115.116:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 10:05:31,537 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-69371068': 1, 'ctest-pod-91457991': 1} 2024-08-26 10:05:31,540 - DEBUG - Network policy ingress-on-service not present 2024-08-26 10:05:31,541 - INFO - Creating Network Policy ingress-on-service 2024-08-26 10:05:31,562 - INFO - Network policy found in k8s 2024-08-26 10:05:31,562 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=7305de90-5a0f-4eea-95a7-71816a86f0f2 2024-08-26 10:05:31,575 - INFO - Network Policy ingress-on-service with uuid 7305de90-5a0f-4eea-95a7-71816a86f0f2 found in kube manager 2024-08-26 10:05:31,608 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2024-08-26 10:05:31,608 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2024-08-26 10:05:31,608 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=7305de90-5a0f-4eea-95a7-71816a86f0f2 2024-08-26 10:05:31,643 - WARNING - Network policy with name ingress-on-service not found in agent 2024-08-26 10:05:33,644 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=7305de90-5a0f-4eea-95a7-71816a86f0f2 2024-08-26 10:05:33,670 - WARNING - Network policy with name ingress-on-service not found in agent 2024-08-26 10:05:35,671 - DEBUG - Requesting: http://10.0.0.31:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=7305de90-5a0f-4eea-95a7-71816a86f0f2 2024-08-26 10:05:35,702 - INFO - Network policy with name ingress-on-service found in agent 2024-08-26 10:05:35,702 - INFO - Network Policy ingress-on-service verification passed 2024-08-26 10:05:40,775 - DEBUG - [Pod ctest-pod-25245338] Cmd: wget http://10.102.115.116:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:05:40,775 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd wget http://10.102.115.116:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:05:40,775 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:05:45,845 - DEBUG - [Pod ctest-pod-25245338] Cmd: wget http://10.102.115.116:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:05:45,845 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd wget http://10.102.115.116:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:05:45,845 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:05:51,746 - DEBUG - [Pod ctest-pod-25245338] Cmd: wget http://10.102.115.116:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:05:51,746 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd wget http://10.102.115.116:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:05:51,746 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:05:56,825 - DEBUG - [Pod ctest-pod-25245338] Cmd: wget http://10.102.115.116:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:05:56,825 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd wget http://10.102.115.116:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:05:56,825 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:06:01,913 - DEBUG - [Pod ctest-pod-25245338] Cmd: wget http://10.102.115.116:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:06:01,913 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd wget http://10.102.115.116:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:06:01,913 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:06:07,195 - DEBUG - [Pod ctest-pod-25245338] Cmd: wget http://10.102.115.116:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:06:07,195 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd wget http://10.102.115.116:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:06:07,195 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:06:12,274 - DEBUG - [Pod ctest-pod-25245338] Cmd: wget http://10.102.115.116:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:06:12,274 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd wget http://10.102.115.116:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:06:12,274 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:06:17,351 - DEBUG - [Pod ctest-pod-25245338] Cmd: wget http://10.102.115.116:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:06:17,351 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd wget http://10.102.115.116:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:06:17,351 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:06:22,446 - DEBUG - [Pod ctest-pod-25245338] Cmd: wget http://10.102.115.116:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:06:22,447 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd wget http://10.102.115.116:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:06:22,447 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:06:27,529 - DEBUG - [Pod ctest-pod-25245338] Cmd: wget http://10.102.115.116:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:06:27,529 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd wget http://10.102.115.116:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:06:27,529 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:06:27,530 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-69371068': 0, 'ctest-pod-91457991': 0} 2024-08-26 10:06:27,624 - DEBUG - [Pod ctest-pod-23943016] Cmd: wget http://10.102.115.116:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.115.116:80 (10.102.115.116:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-69371068 2024-08-26 10:06:27,624 - DEBUG - [Pod Pod ctest-pod-23943016] Cmd wget http://10.102.115.116:80/ -O - -T 5 -t 1 passed 2024-08-26 10:06:27,624 - DEBUG - [Pod Pod ctest-pod-23943016] Cmd output: Connecting to 10.102.115.116:80 (10.102.115.116:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-69371068 2024-08-26 10:06:27,704 - DEBUG - [Pod ctest-pod-23943016] Cmd: wget http://10.102.115.116:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.115.116:80 (10.102.115.116:80) ctest-pod-69371068 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 10:06:27,704 - DEBUG - [Pod Pod ctest-pod-23943016] Cmd wget http://10.102.115.116:80/ -O - -T 5 -t 1 passed 2024-08-26 10:06:27,704 - DEBUG - [Pod Pod ctest-pod-23943016] Cmd output: Connecting to 10.102.115.116:80 (10.102.115.116:80) ctest-pod-69371068 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 10:06:27,785 - DEBUG - [Pod ctest-pod-23943016] Cmd: wget http://10.102.115.116:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.115.116:80 (10.102.115.116:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-69371068 2024-08-26 10:06:27,785 - DEBUG - [Pod Pod ctest-pod-23943016] Cmd wget http://10.102.115.116:80/ -O - -T 5 -t 1 passed 2024-08-26 10:06:27,785 - DEBUG - [Pod Pod ctest-pod-23943016] Cmd output: Connecting to 10.102.115.116:80 (10.102.115.116:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-69371068 2024-08-26 10:06:27,872 - DEBUG - [Pod ctest-pod-23943016] Cmd: wget http://10.102.115.116:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.115.116:80 (10.102.115.116:80) ctest-pod-91457991 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 10:06:27,872 - DEBUG - [Pod Pod ctest-pod-23943016] Cmd wget http://10.102.115.116:80/ -O - -T 5 -t 1 passed 2024-08-26 10:06:27,872 - DEBUG - [Pod Pod ctest-pod-23943016] Cmd output: Connecting to 10.102.115.116:80 (10.102.115.116:80) ctest-pod-91457991 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 10:06:27,872 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-69371068': 3, 'ctest-pod-91457991': 1} 2024-08-26 10:06:32,947 - DEBUG - [Pod ctest-pod-83146200] Cmd: wget http://10.102.115.116:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:06:32,947 - DEBUG - [Pod Pod ctest-pod-83146200] Cmd wget http://10.102.115.116:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:06:32,947 - DEBUG - [Pod Pod ctest-pod-83146200] Cmd output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:06:38,033 - DEBUG - [Pod ctest-pod-83146200] Cmd: wget http://10.102.115.116:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:06:38,033 - DEBUG - [Pod Pod ctest-pod-83146200] Cmd wget http://10.102.115.116:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:06:38,033 - DEBUG - [Pod Pod ctest-pod-83146200] Cmd output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:06:43,110 - DEBUG - [Pod ctest-pod-83146200] Cmd: wget http://10.102.115.116:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:06:43,111 - DEBUG - [Pod Pod ctest-pod-83146200] Cmd wget http://10.102.115.116:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:06:43,111 - DEBUG - [Pod Pod ctest-pod-83146200] Cmd output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:06:48,189 - DEBUG - [Pod ctest-pod-83146200] Cmd: wget http://10.102.115.116:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:06:48,190 - DEBUG - [Pod Pod ctest-pod-83146200] Cmd wget http://10.102.115.116:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:06:48,190 - DEBUG - [Pod Pod ctest-pod-83146200] Cmd output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:06:53,321 - DEBUG - [Pod ctest-pod-83146200] Cmd: wget http://10.102.115.116:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:06:53,321 - DEBUG - [Pod Pod ctest-pod-83146200] Cmd wget http://10.102.115.116:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:06:53,321 - DEBUG - [Pod Pod ctest-pod-83146200] Cmd output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:06:58,406 - DEBUG - [Pod ctest-pod-83146200] Cmd: wget http://10.102.115.116:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:06:58,406 - DEBUG - [Pod Pod ctest-pod-83146200] Cmd wget http://10.102.115.116:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:06:58,406 - DEBUG - [Pod Pod ctest-pod-83146200] Cmd output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:07:03,502 - DEBUG - [Pod ctest-pod-83146200] Cmd: wget http://10.102.115.116:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:07:03,503 - DEBUG - [Pod Pod ctest-pod-83146200] Cmd wget http://10.102.115.116:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:07:03,503 - DEBUG - [Pod Pod ctest-pod-83146200] Cmd output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:07:08,583 - DEBUG - [Pod ctest-pod-83146200] Cmd: wget http://10.102.115.116:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:07:08,583 - DEBUG - [Pod Pod ctest-pod-83146200] Cmd wget http://10.102.115.116:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:07:08,583 - DEBUG - [Pod Pod ctest-pod-83146200] Cmd output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:07:13,667 - DEBUG - [Pod ctest-pod-83146200] Cmd: wget http://10.102.115.116:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:07:13,668 - DEBUG - [Pod Pod ctest-pod-83146200] Cmd wget http://10.102.115.116:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:07:13,668 - DEBUG - [Pod Pod ctest-pod-83146200] Cmd output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:07:19,185 - DEBUG - [Pod ctest-pod-83146200] Cmd: wget http://10.102.115.116:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:07:19,185 - DEBUG - [Pod Pod ctest-pod-83146200] Cmd wget http://10.102.115.116:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:07:19,185 - DEBUG - [Pod Pod ctest-pod-83146200] Cmd output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:07:19,185 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-69371068': 0, 'ctest-pod-91457991': 0} 2024-08-26 10:07:21,301 - DEBUG - [Pod ctest-pod-23943016] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.013 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.076 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.066 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.066/0.385/1.013 ms 2024-08-26 10:07:21,301 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-23943016 with expectation True passed 2024-08-26 10:07:23,670 - DEBUG - [Pod ctest-pod-25245338] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.560 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.058 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.085 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.058/0.234/0.560 ms 2024-08-26 10:07:23,670 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-25245338 with expectation True passed 2024-08-26 10:07:25,756 - DEBUG - [Pod ctest-pod-83146200] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=1.211 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.068 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.090 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.068/0.456/1.211 ms 2024-08-26 10:07:25,756 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-83146200 with expectation True passed 2024-08-26 10:07:25,846 - DEBUG - [Pod ctest-pod-23943016] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-26 10:07:25,846 - DEBUG - [Pod Pod ctest-pod-23943016] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-08-26 10:07:25,846 - DEBUG - [Pod Pod ctest-pod-23943016] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-26 10:07:25,846 - INFO - wget check of of http://10.47.255.250 from ctest-pod-23943016 passed 2024-08-26 10:07:25,937 - DEBUG - [Pod ctest-pod-23943016] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-26 10:07:25,937 - DEBUG - [Pod Pod ctest-pod-23943016] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 passed 2024-08-26 10:07:25,937 - DEBUG - [Pod Pod ctest-pod-23943016] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-26 10:07:25,937 - INFO - wget check of of http://10.47.255.249 from ctest-pod-23943016 passed 2024-08-26 10:07:31,015 - DEBUG - [Pod ctest-pod-25245338] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2024-08-26 10:07:31,015 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2024-08-26 10:07:31,016 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2024-08-26 10:07:31,016 - INFO - wget check of of http://10.47.255.249 from ctest-pod-25245338 passed 2024-08-26 10:07:36,112 - DEBUG - [Pod ctest-pod-47323798] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-26 10:07:36,112 - DEBUG - [Pod Pod ctest-pod-47323798] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-26 10:07:36,112 - DEBUG - [Pod Pod ctest-pod-47323798] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2024-08-26 10:07:36,112 - INFO - wget check of of http://10.47.255.250 from ctest-pod-47323798 passed 2024-08-26 10:07:36,124 - INFO - Updating Network Policy ingress-on-service 2024-08-26 10:07:41,211 - DEBUG - [Pod ctest-pod-25245338] Cmd: wget http://10.102.115.116:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:07:41,211 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd wget http://10.102.115.116:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:07:41,211 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:07:46,289 - DEBUG - [Pod ctest-pod-25245338] Cmd: wget http://10.102.115.116:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:07:46,289 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd wget http://10.102.115.116:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:07:46,289 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:07:51,382 - DEBUG - [Pod ctest-pod-25245338] Cmd: wget http://10.102.115.116:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:07:51,382 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd wget http://10.102.115.116:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:07:51,382 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:07:56,462 - DEBUG - [Pod ctest-pod-25245338] Cmd: wget http://10.102.115.116:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:07:56,462 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd wget http://10.102.115.116:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:07:56,462 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:08:01,539 - DEBUG - [Pod ctest-pod-25245338] Cmd: wget http://10.102.115.116:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:08:01,539 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd wget http://10.102.115.116:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:08:01,539 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:08:06,633 - DEBUG - [Pod ctest-pod-25245338] Cmd: wget http://10.102.115.116:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:08:06,633 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd wget http://10.102.115.116:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:08:06,633 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:08:11,734 - DEBUG - [Pod ctest-pod-25245338] Cmd: wget http://10.102.115.116:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:08:11,734 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd wget http://10.102.115.116:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:08:11,734 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:08:16,812 - DEBUG - [Pod ctest-pod-25245338] Cmd: wget http://10.102.115.116:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:08:16,812 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd wget http://10.102.115.116:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:08:16,812 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:08:21,941 - DEBUG - [Pod ctest-pod-25245338] Cmd: wget http://10.102.115.116:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:08:21,941 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd wget http://10.102.115.116:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:08:21,941 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:08:27,023 - DEBUG - [Pod ctest-pod-25245338] Cmd: wget http://10.102.115.116:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:08:27,023 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd wget http://10.102.115.116:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:08:27,023 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd output: Connecting to 10.102.115.116:80 (10.102.115.116:80) wget: download timed out 2024-08-26 10:08:27,023 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-69371068': 0, 'ctest-pod-91457991': 0} 2024-08-26 10:08:27,137 - DEBUG - [Pod ctest-pod-23943016] Cmd: wget http://10.102.115.116:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.115.116:80 (10.102.115.116:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-69371068 2024-08-26 10:08:27,137 - DEBUG - [Pod Pod ctest-pod-23943016] Cmd wget http://10.102.115.116:80/ -O - -T 5 -t 1 passed 2024-08-26 10:08:27,138 - DEBUG - [Pod Pod ctest-pod-23943016] Cmd output: Connecting to 10.102.115.116:80 (10.102.115.116:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-69371068 2024-08-26 10:08:27,230 - DEBUG - [Pod ctest-pod-23943016] Cmd: wget http://10.102.115.116:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.115.116:80 (10.102.115.116:80) ctest-pod-91457991 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 10:08:27,230 - DEBUG - [Pod Pod ctest-pod-23943016] Cmd wget http://10.102.115.116:80/ -O - -T 5 -t 1 passed 2024-08-26 10:08:27,230 - DEBUG - [Pod Pod ctest-pod-23943016] Cmd output: Connecting to 10.102.115.116:80 (10.102.115.116:80) ctest-pod-91457991 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 10:08:27,230 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-69371068': 1, 'ctest-pod-91457991': 1} 2024-08-26 10:08:27,308 - DEBUG - [Pod ctest-pod-83146200] Cmd: wget http://10.102.115.116:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.115.116:80 (10.102.115.116:80) ctest-pod-91457991 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 10:08:27,308 - DEBUG - [Pod Pod ctest-pod-83146200] Cmd wget http://10.102.115.116:80/ -O - -T 5 -t 1 passed 2024-08-26 10:08:27,308 - DEBUG - [Pod Pod ctest-pod-83146200] Cmd output: Connecting to 10.102.115.116:80 (10.102.115.116:80) ctest-pod-91457991 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2024-08-26 10:08:27,392 - DEBUG - [Pod ctest-pod-83146200] Cmd: wget http://10.102.115.116:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.115.116:80 (10.102.115.116:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-69371068 2024-08-26 10:08:27,392 - DEBUG - [Pod Pod ctest-pod-83146200] Cmd wget http://10.102.115.116:80/ -O - -T 5 -t 1 passed 2024-08-26 10:08:27,392 - DEBUG - [Pod Pod ctest-pod-83146200] Cmd output: Connecting to 10.102.115.116:80 (10.102.115.116:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-69371068 2024-08-26 10:08:27,392 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-69371068': 1, 'ctest-pod-91457991': 1} 2024-08-26 10:08:29,477 - DEBUG - [Pod ctest-pod-23943016] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=3.340 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.073 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/1.161/3.340 ms 2024-08-26 10:08:29,478 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-23943016 with expectation True passed 2024-08-26 10:08:31,572 - DEBUG - [Pod ctest-pod-25245338] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.702 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.061 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.079 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.061/0.280/0.702 ms 2024-08-26 10:08:31,572 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-25245338 with expectation True passed 2024-08-26 10:08:33,661 - DEBUG - [Pod ctest-pod-83146200] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes 64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.735 ms 64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.062 ms --- 10.47.255.245 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.062/0.289/0.735 ms 2024-08-26 10:08:33,661 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-83146200 with expectation True passed 2024-08-26 10:08:33,745 - DEBUG - [Pod ctest-pod-23943016] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-26 10:08:33,745 - DEBUG - [Pod Pod ctest-pod-23943016] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-08-26 10:08:33,745 - DEBUG - [Pod Pod ctest-pod-23943016] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-26 10:08:33,745 - INFO - wget check of of http://10.47.255.250 from ctest-pod-23943016 passed 2024-08-26 10:08:33,835 - DEBUG - [Pod ctest-pod-23943016] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-26 10:08:33,835 - DEBUG - [Pod Pod ctest-pod-23943016] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 passed 2024-08-26 10:08:33,835 - DEBUG - [Pod Pod ctest-pod-23943016] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-26 10:08:33,835 - INFO - wget check of of http://10.47.255.249 from ctest-pod-23943016 passed 2024-08-26 10:08:38,911 - DEBUG - [Pod ctest-pod-25245338] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2024-08-26 10:08:38,911 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2024-08-26 10:08:38,911 - DEBUG - [Pod Pod ctest-pod-25245338] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80) wget: download timed out 2024-08-26 10:08:38,912 - INFO - wget check of of http://10.47.255.249 from ctest-pod-25245338 passed 2024-08-26 10:08:39,009 - DEBUG - [Pod ctest-pod-47323798] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-26 10:08:39,009 - DEBUG - [Pod Pod ctest-pod-47323798] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2024-08-26 10:08:39,009 - DEBUG - [Pod Pod ctest-pod-47323798] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2024-08-26 10:08:39,009 - INFO - wget check of of http://10.47.255.250 from ctest-pod-47323798 passed 2024-08-26 10:08:39,009 - INFO - Deleting Network Policy : ingress-on-service 2024-08-26 10:08:39,010 - INFO - Deleting service : ctest-nginx-svc-10150460 2024-08-26 10:08:39,566 - DEBUG - No XMPP flaps were noticed during the test 2024-08-26 10:08:39,567 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:11] 2024-08-26 10:08:39,567 - INFO - -------------------------------------------------------------------------------- 2024-08-26 10:08:39,573 - INFO - Deleting pod ctest-new-default-97237387:ctest-pod-69371068 2024-08-26 10:08:39,573 - INFO - Deleting pod ctest-new-default-97237387:ctest-pod-91457991 2024-08-26 10:08:39,574 - INFO - Deleting pod ctest-non-default-12326537:ctest-pod-04739296 2024-08-26 10:08:39,574 - INFO - Deleting pod ctest-non-default-12326537:ctest-pod-80055392 2024-08-26 10:08:39,575 - INFO - Deleting pod ctest-new-default-97237387:ctest-pod-25245338 2024-08-26 10:08:39,575 - INFO - Deleting pod ctest-new-default-97237387:ctest-pod-23943016 2024-08-26 10:08:39,575 - INFO - Deleting pod ctest-non-default-12326537:ctest-pod-83146200 2024-08-26 10:08:39,576 - INFO - Deleting pod ctest-non-default-12326537:ctest-pod-47323798 2024-08-26 10:08:39,626 - WARNING - Pod uuid 15009890-654d-4146-840b-25b399908e6a is still seen in agent 10.0.0.31 VM list 2024-08-26 10:08:40,970 - WARNING - Pod uuid c6e06734-3c0e-4c62-9a82-8208351c854e is still seen in agent 10.0.0.31 VM list 2024-08-26 10:08:40,971 - WARNING - Pod uuid 90fd1fc2-87ff-4e00-8f5a-47059aaed9ec is still seen in agent 10.0.0.31 VM list 2024-08-26 10:08:40,971 - WARNING - Pod uuid 411bee4f-26d7-48dd-ac30-4fd4090c8c06 is still seen in agent 10.0.0.31 VM list 2024-08-26 10:08:40,972 - WARNING - Pod uuid 64f8231b-acff-4c0c-9462-4d1f47edff83 is still seen in agent 10.0.0.31 VM list 2024-08-26 10:08:40,972 - WARNING - Pod uuid 0723a711-9a1e-459e-a741-d39365eb79c6 is still seen in agent 10.0.0.31 VM list 2024-08-26 10:08:40,975 - WARNING - Pod uuid 7fb8275a-8893-4a77-8d02-4a9a5f006c03 is still seen in agent 10.0.0.31 VM list 2024-08-26 10:08:40,975 - WARNING - Pod uuid f1052100-e546-4a18-bb5a-f90170942780 is still seen in agent 10.0.0.31 VM list 2024-08-26 10:08:44,944 - WARNING - Pod uuid 15009890-654d-4146-840b-25b399908e6a is still seen in agent 10.0.0.31 VM list 2024-08-26 10:08:46,015 - WARNING - Pod uuid c6e06734-3c0e-4c62-9a82-8208351c854e is still seen in agent 10.0.0.31 VM list 2024-08-26 10:08:46,016 - DEBUG - Pod 90fd1fc2-87ff-4e00-8f5a-47059aaed9ec is not in agent 10.0.0.31 VM list 2024-08-26 10:08:46,020 - DEBUG - Pod f1052100-e546-4a18-bb5a-f90170942780 is not in agent 10.0.0.31 VM list 2024-08-26 10:08:46,021 - WARNING - Pod uuid 0723a711-9a1e-459e-a741-d39365eb79c6 is still seen in agent 10.0.0.31 VM list 2024-08-26 10:08:46,024 - WARNING - Pod uuid 64f8231b-acff-4c0c-9462-4d1f47edff83 is still seen in agent 10.0.0.31 VM list 2024-08-26 10:08:46,024 - WARNING - Pod uuid 411bee4f-26d7-48dd-ac30-4fd4090c8c06 is still seen in agent 10.0.0.31 VM list 2024-08-26 10:08:46,025 - DEBUG - Pod 7fb8275a-8893-4a77-8d02-4a9a5f006c03 is not in agent 10.0.0.31 VM list 2024-08-26 10:08:46,045 - DEBUG - VMI aeb317cc-6392-11ef-9f14-024278b7efe6 is removed from agent 10.0.0.31 2024-08-26 10:08:46,045 - INFO - Verified that pod ctest-pod-80055392 is removed in agent 2024-08-26 10:08:46,045 - DEBUG - VMI acfa1d4a-6392-11ef-9f14-024278b7efe6 is removed from agent 10.0.0.31 2024-08-26 10:08:46,045 - INFO - Verified that pod ctest-pod-91457991 is removed in agent 2024-08-26 10:08:46,046 - DEBUG - VMI adfb5b8c-6392-11ef-9f14-024278b7efe6 is removed from agent 10.0.0.31 2024-08-26 10:08:46,046 - INFO - Verified that pod ctest-pod-04739296 is removed in agent 2024-08-26 10:08:49,952 - DEBUG - Pod 15009890-654d-4146-840b-25b399908e6a is not in agent 10.0.0.31 VM list 2024-08-26 10:08:49,958 - DEBUG - VMI ac35a01e-6392-11ef-9f14-024278b7efe6 is removed from agent 10.0.0.31 2024-08-26 10:08:49,958 - INFO - Verified that pod ctest-pod-69371068 is removed in agent 2024-08-26 10:08:51,042 - WARNING - Pod uuid c6e06734-3c0e-4c62-9a82-8208351c854e is still seen in agent 10.0.0.31 VM list 2024-08-26 10:08:51,064 - WARNING - Pod uuid 411bee4f-26d7-48dd-ac30-4fd4090c8c06 is still seen in agent 10.0.0.31 VM list 2024-08-26 10:08:51,065 - WARNING - Pod uuid 0723a711-9a1e-459e-a741-d39365eb79c6 is still seen in agent 10.0.0.31 VM list 2024-08-26 10:08:51,066 - WARNING - Pod uuid 64f8231b-acff-4c0c-9462-4d1f47edff83 is still seen in agent 10.0.0.31 VM list 2024-08-26 10:08:56,050 - WARNING - Pod uuid c6e06734-3c0e-4c62-9a82-8208351c854e is still seen in agent 10.0.0.31 VM list 2024-08-26 10:08:56,081 - WARNING - Pod uuid 411bee4f-26d7-48dd-ac30-4fd4090c8c06 is still seen in agent 10.0.0.31 VM list 2024-08-26 10:08:56,083 - WARNING - Pod uuid 64f8231b-acff-4c0c-9462-4d1f47edff83 is still seen in agent 10.0.0.31 VM list 2024-08-26 10:08:56,084 - WARNING - Pod uuid 0723a711-9a1e-459e-a741-d39365eb79c6 is still seen in agent 10.0.0.31 VM list 2024-08-26 10:09:01,058 - WARNING - Pod uuid c6e06734-3c0e-4c62-9a82-8208351c854e is still seen in agent 10.0.0.31 VM list 2024-08-26 10:09:01,098 - WARNING - Pod uuid 411bee4f-26d7-48dd-ac30-4fd4090c8c06 is still seen in agent 10.0.0.31 VM list 2024-08-26 10:09:01,101 - WARNING - Pod uuid 64f8231b-acff-4c0c-9462-4d1f47edff83 is still seen in agent 10.0.0.31 VM list 2024-08-26 10:09:01,103 - WARNING - Pod uuid 0723a711-9a1e-459e-a741-d39365eb79c6 is still seen in agent 10.0.0.31 VM list 2024-08-26 10:09:06,064 - WARNING - Pod uuid c6e06734-3c0e-4c62-9a82-8208351c854e is still seen in agent 10.0.0.31 VM list 2024-08-26 10:09:06,110 - WARNING - Pod uuid 411bee4f-26d7-48dd-ac30-4fd4090c8c06 is still seen in agent 10.0.0.31 VM list 2024-08-26 10:09:06,112 - WARNING - Pod uuid 64f8231b-acff-4c0c-9462-4d1f47edff83 is still seen in agent 10.0.0.31 VM list 2024-08-26 10:09:06,112 - WARNING - Pod uuid 0723a711-9a1e-459e-a741-d39365eb79c6 is still seen in agent 10.0.0.31 VM list 2024-08-26 10:09:11,072 - WARNING - Pod uuid c6e06734-3c0e-4c62-9a82-8208351c854e is still seen in agent 10.0.0.31 VM list 2024-08-26 10:09:11,164 - WARNING - Pod uuid 411bee4f-26d7-48dd-ac30-4fd4090c8c06 is still seen in agent 10.0.0.31 VM list 2024-08-26 10:09:11,167 - WARNING - Pod uuid 0723a711-9a1e-459e-a741-d39365eb79c6 is still seen in agent 10.0.0.31 VM list 2024-08-26 10:09:11,167 - WARNING - Pod uuid 64f8231b-acff-4c0c-9462-4d1f47edff83 is still seen in agent 10.0.0.31 VM list 2024-08-26 10:09:16,080 - DEBUG - Pod c6e06734-3c0e-4c62-9a82-8208351c854e is not in agent 10.0.0.31 VM list 2024-08-26 10:09:16,086 - DEBUG - VMI b36d3252-6392-11ef-9f14-024278b7efe6 is removed from agent 10.0.0.31 2024-08-26 10:09:16,086 - INFO - Verified that pod ctest-pod-47323798 is removed in agent 2024-08-26 10:09:16,179 - DEBUG - Pod 411bee4f-26d7-48dd-ac30-4fd4090c8c06 is not in agent 10.0.0.31 VM list 2024-08-26 10:09:16,183 - DEBUG - Pod 64f8231b-acff-4c0c-9462-4d1f47edff83 is not in agent 10.0.0.31 VM list 2024-08-26 10:09:16,184 - DEBUG - Pod 0723a711-9a1e-459e-a741-d39365eb79c6 is not in agent 10.0.0.31 VM list 2024-08-26 10:09:16,195 - DEBUG - VMI b0cfd932-6392-11ef-9f14-024278b7efe6 is removed from agent 10.0.0.31 2024-08-26 10:09:16,195 - INFO - Verified that pod ctest-pod-25245338 is removed in agent 2024-08-26 10:09:16,197 - DEBUG - VMI b19d0632-6392-11ef-9f14-024278b7efe6 is removed from agent 10.0.0.31 2024-08-26 10:09:16,197 - INFO - Verified that pod ctest-pod-23943016 is removed in agent 2024-08-26 10:09:16,198 - DEBUG - VMI b2804640-6392-11ef-9f14-024278b7efe6 is removed from agent 10.0.0.31 2024-08-26 10:09:16,198 - INFO - Verified that pod ctest-pod-83146200 is removed in agent 2024-08-26 10:09:16,198 - INFO - Deleting namespace ctest-non-default-12326537 2024-08-26 10:09:16,689 - DEBUG - Namespace ctest-non-default-12326537 still in k8s 2024-08-26 10:09:18,695 - DEBUG - Namespace ctest-non-default-12326537 still in k8s 2024-08-26 10:09:20,700 - DEBUG - Namespace ctest-non-default-12326537 still in k8s 2024-08-26 10:09:22,706 - DEBUG - Namespace ctest-non-default-12326537 is not in k8s 2024-08-26 10:09:22,706 - DEBUG - No need to check project deletion in contrail-api 2024-08-26 10:09:22,706 - INFO - Deleting namespace ctest-new-default-97237387 2024-08-26 10:09:22,725 - DEBUG - Namespace ctest-new-default-97237387 still in k8s 2024-08-26 10:09:24,731 - DEBUG - Namespace ctest-new-default-97237387 still in k8s 2024-08-26 10:09:26,736 - DEBUG - Namespace ctest-new-default-97237387 still in k8s 2024-08-26 10:09:28,740 - DEBUG - Namespace ctest-new-default-97237387 is not in k8s 2024-08-26 10:09:28,740 - DEBUG - No need to check project deletion in contrail-api