2025-06-24 13:26:36,671 - INFO - Using existing project ['default-domain', 'k8s-default'](4e796150-8cc3-473c-97b1-581a3154c8a0)
2025-06-24 13:26:36,691 - DEBUG - Namespace ctest-new-default-37500811 not present
2025-06-24 13:26:36,699 - INFO - Created namespace ctest-new-default-37500811
2025-06-24 13:26:39,702 - DEBUG - Namespace ctest-non-default-70106837 not present
2025-06-24 13:26:39,715 - INFO - Created namespace ctest-non-default-70106837
2025-06-24 13:26:42,734 - DEBUG - Pod ctest-pod-56033060 not present
2025-06-24 13:26:42,734 - INFO - Creating Pod ctest-pod-56033060
2025-06-24 13:26:42,773 - DEBUG - Pod : ctest-pod-56033060 UUID is 89a5b4ac-b9cb-4342-bea0-305dfa5231ed
2025-06-24 13:26:42,779 - DEBUG - Pod ctest-pod-01862517 not present
2025-06-24 13:26:42,779 - INFO - Creating Pod ctest-pod-01862517
2025-06-24 13:26:42,805 - DEBUG - Pod : ctest-pod-01862517 UUID is 771d0f55-68e2-4183-b62e-de3cddcb2955
2025-06-24 13:26:42,808 - DEBUG - Pod ctest-pod-91966107 not present
2025-06-24 13:26:42,808 - INFO - Creating Pod ctest-pod-91966107
2025-06-24 13:26:42,839 - DEBUG - Pod : ctest-pod-91966107 UUID is 8cf430af-48b2-4026-9b78-d516d16a9165
2025-06-24 13:26:42,842 - DEBUG - Pod ctest-pod-10352335 not present
2025-06-24 13:26:42,843 - INFO - Creating Pod ctest-pod-10352335
2025-06-24 13:26:42,877 - DEBUG - Pod : ctest-pod-10352335 UUID is fac0c886-a12b-4b51-927c-7757eeda69db
2025-06-24 13:26:42,880 - DEBUG - Pod ctest-pod-29065705 not present
2025-06-24 13:26:42,880 - INFO - Creating Pod ctest-pod-29065705
2025-06-24 13:26:42,907 - DEBUG - Pod : ctest-pod-29065705 UUID is 276e1991-96a1-4026-b62f-c568fe21f19a
2025-06-24 13:26:42,909 - DEBUG - Pod ctest-pod-64005273 not present
2025-06-24 13:26:42,910 - INFO - Creating Pod ctest-pod-64005273
2025-06-24 13:26:42,927 - DEBUG - Pod : ctest-pod-64005273 UUID is 63c76465-3438-4134-a3f4-0f6a2178d1ea
2025-06-24 13:26:42,929 - DEBUG - Pod ctest-pod-15237523 not present
2025-06-24 13:26:42,930 - INFO - Creating Pod ctest-pod-15237523
2025-06-24 13:26:42,947 - DEBUG - Pod : ctest-pod-15237523 UUID is 63f5a693-20d3-4020-a008-375459119a1d
2025-06-24 13:26:42,950 - DEBUG - Pod ctest-pod-03524975 not present
2025-06-24 13:26:42,950 - INFO - Creating Pod ctest-pod-03524975
2025-06-24 13:26:42,966 - DEBUG - Pod : ctest-pod-03524975 UUID is 18f1dc65-b07a-418c-a054-83ad6f265a59
2025-06-24 13:26:43,156 - INFO - Project default-domain:k8s-ctest-new-default-37500811 for Namespace ctest-new-default-37500811 is seen in contrail-api
2025-06-24 13:26:43,156 - DEBUG - Project uuid in Contrail is 3e130823-8a73-4ef9-8cfa-8522a5c36d33
2025-06-24 13:26:43,351 - DEBUG - Requesting: http://10.0.0.73:8108/Snh_NamespaceDatabaseList?namespace_uuid=36bf3b20-4f4f-4d3a-9762-3a75834edae2
2025-06-24 13:26:43,357 - INFO - Namespace ctest-new-default-37500811 with uuid 36bf3b20-4f4f-4d3a-9762-3a75834edae2 found in kube manager
2025-06-24 13:26:43,357 - INFO - Namespace ctest-new-default-37500811 verification passed
2025-06-24 13:26:43,554 - INFO - Project default-domain:k8s-ctest-non-default-70106837 for Namespace ctest-non-default-70106837 is seen in contrail-api
2025-06-24 13:26:43,554 - DEBUG - Project uuid in Contrail is db145a23-b9d0-4d4a-82b1-b6a709a1af6b
2025-06-24 13:26:43,554 - DEBUG - Requesting: http://10.0.0.73:8108/Snh_NamespaceDatabaseList?namespace_uuid=88a2e42e-7f45-4c75-a4d4-20b90a9ba261
2025-06-24 13:26:43,559 - INFO - Namespace ctest-non-default-70106837 with uuid 88a2e42e-7f45-4c75-a4d4-20b90a9ba261 found in kube manager
2025-06-24 13:26:43,559 - INFO - Namespace ctest-non-default-70106837 verification passed
2025-06-24 13:26:43,570 - DEBUG - Pod ctest-pod-56033060 not in running state.Currently in Pending
2025-06-24 13:26:48,583 - DEBUG - Pod ctest-pod-56033060 not in running state.Currently in Pending
2025-06-24 13:26:53,589 - INFO - Pod ctest-pod-56033060 is in running state.Got IP 10.47.255.251
2025-06-24 13:26:53,602 - DEBUG - Pod ctest-pod-56033060 has vmi df2a7b5c-50fe-11f0-81d4-fa163e49113b
2025-06-24 13:26:53,602 - INFO - Verified pod ctest-pod-56033060 in contrail-api
2025-06-24 13:26:53,614 - DEBUG - VMI df2a7b5c-50fe-11f0-81d4-fa163e49113b is active in agent 10.0.0.129
2025-06-24 13:26:53,615 - INFO - Verified Pod ctest-pod-56033060 in agent 10.0.0.129
2025-06-24 13:26:53,615 - DEBUG - Requesting: http://10.0.0.73:8108/Snh_VirtualMachineDatabaseList?x=89a5b4ac-b9cb-4342-bea0-305dfa5231ed
2025-06-24 13:26:53,619 - INFO - Pod ctest-pod-56033060 with uuid 89a5b4ac-b9cb-4342-bea0-305dfa5231ed found in kube manager
2025-06-24 13:26:53,619 - INFO - Pod ctest-pod-56033060 verification passed
2025-06-24 13:26:53,623 - DEBUG - Pod ctest-pod-01862517 not in running state.Currently in Pending
2025-06-24 13:26:58,629 - INFO - Pod ctest-pod-01862517 is in running state.Got IP 10.47.255.250
2025-06-24 13:26:58,649 - DEBUG - Pod ctest-pod-01862517 has vmi dfa4459a-50fe-11f0-81d4-fa163e49113b
2025-06-24 13:26:58,649 - INFO - Verified pod ctest-pod-01862517 in contrail-api
2025-06-24 13:26:58,662 - DEBUG - VMI dfa4459a-50fe-11f0-81d4-fa163e49113b is active in agent 10.0.0.129
2025-06-24 13:26:58,662 - INFO - Verified Pod ctest-pod-01862517 in agent 10.0.0.129
2025-06-24 13:26:58,662 - DEBUG - Requesting: http://10.0.0.73:8108/Snh_VirtualMachineDatabaseList?x=771d0f55-68e2-4183-b62e-de3cddcb2955
2025-06-24 13:26:58,666 - INFO - Pod ctest-pod-01862517 with uuid 771d0f55-68e2-4183-b62e-de3cddcb2955 found in kube manager
2025-06-24 13:26:58,666 - INFO - Pod ctest-pod-01862517 verification passed
2025-06-24 13:26:58,671 - INFO - Pod ctest-pod-91966107 is in running state.Got IP 10.47.255.249
2025-06-24 13:26:58,729 - DEBUG - Pod ctest-pod-91966107 has vmi e049ffda-50fe-11f0-81d4-fa163e49113b
2025-06-24 13:26:58,729 - INFO - Verified pod ctest-pod-91966107 in contrail-api
2025-06-24 13:26:58,747 - DEBUG - VMI e049ffda-50fe-11f0-81d4-fa163e49113b is active in agent 10.0.0.129
2025-06-24 13:26:58,747 - INFO - Verified Pod ctest-pod-91966107 in agent 10.0.0.129
2025-06-24 13:26:58,748 - DEBUG - Requesting: http://10.0.0.73:8108/Snh_VirtualMachineDatabaseList?x=8cf430af-48b2-4026-9b78-d516d16a9165
2025-06-24 13:26:58,753 - INFO - Pod ctest-pod-91966107 with uuid 8cf430af-48b2-4026-9b78-d516d16a9165 found in kube manager
2025-06-24 13:26:58,753 - INFO - Pod ctest-pod-91966107 verification passed
2025-06-24 13:26:58,758 - INFO - Pod ctest-pod-10352335 is in running state.Got IP 10.47.255.248
2025-06-24 13:26:58,814 - DEBUG - Pod ctest-pod-10352335 has vmi e0c5adec-50fe-11f0-81d4-fa163e49113b
2025-06-24 13:26:58,814 - INFO - Verified pod ctest-pod-10352335 in contrail-api
2025-06-24 13:26:58,825 - DEBUG - VMI e0c5adec-50fe-11f0-81d4-fa163e49113b is active in agent 10.0.0.129
2025-06-24 13:26:58,826 - INFO - Verified Pod ctest-pod-10352335 in agent 10.0.0.129
2025-06-24 13:26:58,826 - DEBUG - Requesting: http://10.0.0.73:8108/Snh_VirtualMachineDatabaseList?x=fac0c886-a12b-4b51-927c-7757eeda69db
2025-06-24 13:26:58,830 - INFO - Pod ctest-pod-10352335 with uuid fac0c886-a12b-4b51-927c-7757eeda69db found in kube manager
2025-06-24 13:26:58,831 - INFO - Pod ctest-pod-10352335 verification passed
2025-06-24 13:26:58,838 - DEBUG - Pod ctest-pod-29065705 not in running state.Currently in Pending
2025-06-24 13:27:03,845 - INFO - Pod ctest-pod-29065705 is in running state.Got IP 10.47.255.247
2025-06-24 13:27:03,858 - DEBUG - Pod ctest-pod-29065705 has vmi e161a300-50fe-11f0-81d4-fa163e49113b
2025-06-24 13:27:03,858 - INFO - Verified pod ctest-pod-29065705 in contrail-api
2025-06-24 13:27:03,871 - DEBUG - VMI e161a300-50fe-11f0-81d4-fa163e49113b is active in agent 10.0.0.129
2025-06-24 13:27:03,871 - INFO - Verified Pod ctest-pod-29065705 in agent 10.0.0.129
2025-06-24 13:27:03,871 - DEBUG - Requesting: http://10.0.0.73:8108/Snh_VirtualMachineDatabaseList?x=276e1991-96a1-4026-b62f-c568fe21f19a
2025-06-24 13:27:03,876 - INFO - Pod ctest-pod-29065705 with uuid 276e1991-96a1-4026-b62f-c568fe21f19a found in kube manager
2025-06-24 13:27:03,876 - INFO - Pod ctest-pod-29065705 verification passed
2025-06-24 13:27:03,880 - INFO - Pod ctest-pod-15237523 is in running state.Got IP 10.47.255.245
2025-06-24 13:27:03,934 - DEBUG - Pod ctest-pod-15237523 has vmi e2642b88-50fe-11f0-81d4-fa163e49113b
2025-06-24 13:27:03,934 - INFO - Verified pod ctest-pod-15237523 in contrail-api
2025-06-24 13:27:03,950 - DEBUG - VMI e2642b88-50fe-11f0-81d4-fa163e49113b is active in agent 10.0.0.129
2025-06-24 13:27:03,950 - INFO - Verified Pod ctest-pod-15237523 in agent 10.0.0.129
2025-06-24 13:27:03,951 - DEBUG - Requesting: http://10.0.0.73:8108/Snh_VirtualMachineDatabaseList?x=63f5a693-20d3-4020-a008-375459119a1d
2025-06-24 13:27:03,955 - INFO - Pod ctest-pod-15237523 with uuid 63f5a693-20d3-4020-a008-375459119a1d found in kube manager
2025-06-24 13:27:03,955 - INFO - Pod ctest-pod-15237523 verification passed
2025-06-24 13:27:03,962 - INFO - Pod ctest-pod-64005273 is in running state.Got IP 10.47.255.246
2025-06-24 13:27:03,974 - DEBUG - Pod ctest-pod-64005273 has vmi e1e5c31a-50fe-11f0-81d4-fa163e49113b
2025-06-24 13:27:03,974 - INFO - Verified pod ctest-pod-64005273 in contrail-api
2025-06-24 13:27:03,986 - DEBUG - VMI e1e5c31a-50fe-11f0-81d4-fa163e49113b is active in agent 10.0.0.129
2025-06-24 13:27:03,986 - INFO - Verified Pod ctest-pod-64005273 in agent 10.0.0.129
2025-06-24 13:27:03,986 - DEBUG - Requesting: http://10.0.0.73:8108/Snh_VirtualMachineDatabaseList?x=63c76465-3438-4134-a3f4-0f6a2178d1ea
2025-06-24 13:27:03,990 - INFO - Pod ctest-pod-64005273 with uuid 63c76465-3438-4134-a3f4-0f6a2178d1ea found in kube manager
2025-06-24 13:27:03,990 - INFO - Pod ctest-pod-64005273 verification passed
2025-06-24 13:27:03,995 - INFO - Pod ctest-pod-03524975 is in running state.Got IP 10.47.255.244
2025-06-24 13:27:04,049 - DEBUG - Pod ctest-pod-03524975 has vmi e2e69b86-50fe-11f0-81d4-fa163e49113b
2025-06-24 13:27:04,050 - INFO - Verified pod ctest-pod-03524975 in contrail-api
2025-06-24 13:27:04,063 - DEBUG - VMI e2e69b86-50fe-11f0-81d4-fa163e49113b is active in agent 10.0.0.129
2025-06-24 13:27:04,063 - INFO - Verified Pod ctest-pod-03524975 in agent 10.0.0.129
2025-06-24 13:27:04,063 - DEBUG - Requesting: http://10.0.0.73:8108/Snh_VirtualMachineDatabaseList?x=18f1dc65-b07a-418c-a054-83ad6f265a59
2025-06-24 13:27:04,068 - INFO - Pod ctest-pod-03524975 with uuid 18f1dc65-b07a-418c-a054-83ad6f265a59 found in kube manager
2025-06-24 13:27:04,068 - INFO - Pod ctest-pod-03524975 verification passed
2025-06-24 13:27:04,068 - INFO - ================================================================================
2025-06-24 13:27:04,068 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-06-24 13:27:04,068 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-06-24 13:27:04,257 - DEBUG - Nothing to compare xmpp stats {'10.0.0.129': {'10.0.0.73': '0'}} with
2025-06-24 13:27:04,257 - INFO - Initial checks done. Running the testcase now
2025-06-24 13:27:04,258 - INFO -
2025-06-24 13:27:04,309 - DEBUG - [Pod ctest-pod-56033060] Cmd: echo ctest-pod-56033060 > /usr/share/nginx/html/index.html, Output:
2025-06-24 13:27:04,361 - DEBUG - [Pod ctest-pod-01862517] Cmd: echo ctest-pod-01862517 > /usr/share/nginx/html/index.html, Output:
2025-06-24 13:27:04,418 - DEBUG - [Pod ctest-pod-91966107] Cmd: echo ctest-pod-91966107 > /usr/share/nginx/html/index.html, Output:
2025-06-24 13:27:04,469 - DEBUG - [Pod ctest-pod-10352335] Cmd: echo ctest-pod-10352335 > /usr/share/nginx/html/index.html, Output:
2025-06-24 13:27:04,472 - DEBUG - Service ctest-nginx-svc-01927746 not present
2025-06-24 13:27:04,472 - INFO - Creating service ctest-nginx-svc-01927746
2025-06-24 13:27:04,499 - INFO - Created Service ctest-nginx-svc-01927746
2025-06-24 13:27:04,506 - WARNING - Service UUID 8727581d-3994-4828-bbd1-8a77514a6f8f not yet found in contrail-api
2025-06-24 13:27:05,514 - INFO - Validated that Service ctest-nginx-svc-01927746 is seen in contrail-api
2025-06-24 13:27:05,514 - DEBUG - Requesting: http://10.0.0.73:8108/Snh_LoadbalancerDatabaseList?x=8727581d-3994-4828-bbd1-8a77514a6f8f
2025-06-24 13:27:05,527 - INFO - Service ctest-nginx-svc-01927746 with uuid 8727581d-3994-4828-bbd1-8a77514a6f8f found in kube manager
2025-06-24 13:27:05,527 - INFO - Service ctest-nginx-svc-01927746 verification passed
2025-06-24 13:27:06,590 - DEBUG - [Pod ctest-pod-29065705] Cmd: wget http://10.110.218.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-01862517
2025-06-24 13:27:06,590 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd wget http://10.110.218.81:80/ -O - -T 5 -t 1 passed
2025-06-24 13:27:06,590 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-01862517
2025-06-24 13:27:06,644 - DEBUG - [Pod ctest-pod-29065705] Cmd: wget http://10.110.218.81:80/ -O - -T 5 -t 1 , Output: ctest-pod-01862517
Connecting to 10.110.218.81:80 (10.110.218.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-24 13:27:06,644 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd wget http://10.110.218.81:80/ -O - -T 5 -t 1 passed
2025-06-24 13:27:06,644 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd output: ctest-pod-01862517
Connecting to 10.110.218.81:80 (10.110.218.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-24 13:27:06,697 - DEBUG - [Pod ctest-pod-29065705] Cmd: wget http://10.110.218.81:80/ -O - -T 5 -t 1 , Output: ctest-pod-56033060
Connecting to 10.110.218.81:80 (10.110.218.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-24 13:27:06,697 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd wget http://10.110.218.81:80/ -O - -T 5 -t 1 passed
2025-06-24 13:27:06,697 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd output: ctest-pod-56033060
Connecting to 10.110.218.81:80 (10.110.218.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-24 13:27:06,697 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-56033060': 1, 'ctest-pod-01862517': 2}
2025-06-24 13:27:06,749 - DEBUG - [Pod ctest-pod-15237523] Cmd: wget http://10.110.218.81:80/ -O - -T 5 -t 1 , Output: ctest-pod-01862517
Connecting to 10.110.218.81:80 (10.110.218.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-24 13:27:06,749 - DEBUG - [Pod Pod ctest-pod-15237523] Cmd wget http://10.110.218.81:80/ -O - -T 5 -t 1 passed
2025-06-24 13:27:06,749 - DEBUG - [Pod Pod ctest-pod-15237523] Cmd output: ctest-pod-01862517
Connecting to 10.110.218.81:80 (10.110.218.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-24 13:27:06,795 - DEBUG - [Pod ctest-pod-15237523] Cmd: wget http://10.110.218.81:80/ -O - -T 5 -t 1 , Output: ctest-pod-56033060
Connecting to 10.110.218.81:80 (10.110.218.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-24 13:27:06,795 - DEBUG - [Pod Pod ctest-pod-15237523] Cmd wget http://10.110.218.81:80/ -O - -T 5 -t 1 passed
2025-06-24 13:27:06,795 - DEBUG - [Pod Pod ctest-pod-15237523] Cmd output: ctest-pod-56033060
Connecting to 10.110.218.81:80 (10.110.218.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-24 13:27:06,795 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-56033060': 1, 'ctest-pod-01862517': 1}
2025-06-24 13:27:06,798 - DEBUG - Network policy ingress-on-service not present
2025-06-24 13:27:06,799 - INFO - Creating Network Policy ingress-on-service
2025-06-24 13:27:06,873 - INFO - Network policy found in k8s
2025-06-24 13:27:06,873 - DEBUG - Requesting: http://10.0.0.73:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=8cee1d38-0b7e-49e3-8f6b-c06fc52bb04e
2025-06-24 13:27:06,879 - INFO - Network Policy ingress-on-service with uuid 8cee1d38-0b7e-49e3-8f6b-c06fc52bb04e found in kube manager
2025-06-24 13:27:06,911 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-06-24 13:27:06,911 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-06-24 13:27:06,911 - DEBUG - Requesting: http://10.0.0.73:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=8cee1d38-0b7e-49e3-8f6b-c06fc52bb04e
2025-06-24 13:27:06,938 - WARNING - Network policy with name ingress-on-service not found in agent
2025-06-24 13:27:08,939 - DEBUG - Requesting: http://10.0.0.73:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=8cee1d38-0b7e-49e3-8f6b-c06fc52bb04e
2025-06-24 13:27:08,968 - INFO - Network policy with name ingress-on-service found in agent
2025-06-24 13:27:08,969 - INFO - Network Policy ingress-on-service verification passed
2025-06-24 13:27:14,023 - DEBUG - [Pod ctest-pod-29065705] Cmd: wget http://10.110.218.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:27:14,023 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd wget http://10.110.218.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:27:14,023 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:27:19,070 - DEBUG - [Pod ctest-pod-29065705] Cmd: wget http://10.110.218.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:27:19,071 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd wget http://10.110.218.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:27:19,071 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:27:24,122 - DEBUG - [Pod ctest-pod-29065705] Cmd: wget http://10.110.218.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:27:24,123 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd wget http://10.110.218.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:27:24,123 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:27:29,170 - DEBUG - [Pod ctest-pod-29065705] Cmd: wget http://10.110.218.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:27:29,170 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd wget http://10.110.218.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:27:29,170 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:27:34,218 - DEBUG - [Pod ctest-pod-29065705] Cmd: wget http://10.110.218.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:27:34,218 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd wget http://10.110.218.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:27:34,218 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:27:39,271 - DEBUG - [Pod ctest-pod-29065705] Cmd: wget http://10.110.218.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:27:39,272 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd wget http://10.110.218.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:27:39,272 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:27:44,323 - DEBUG - [Pod ctest-pod-29065705] Cmd: wget http://10.110.218.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:27:44,323 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd wget http://10.110.218.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:27:44,323 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:27:49,373 - DEBUG - [Pod ctest-pod-29065705] Cmd: wget http://10.110.218.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:27:49,373 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd wget http://10.110.218.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:27:49,373 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:27:54,436 - DEBUG - [Pod ctest-pod-29065705] Cmd: wget http://10.110.218.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:27:54,436 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd wget http://10.110.218.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:27:54,436 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:27:59,491 - DEBUG - [Pod ctest-pod-29065705] Cmd: wget http://10.110.218.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:27:59,492 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd wget http://10.110.218.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:27:59,492 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:27:59,492 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-56033060': 0, 'ctest-pod-01862517': 0}
2025-06-24 13:27:59,554 - DEBUG - [Pod ctest-pod-64005273] Cmd: wget http://10.110.218.81:80/ -O - -T 5 -t 1 , Output: ctest-pod-01862517
Connecting to 10.110.218.81:80 (10.110.218.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-24 13:27:59,554 - DEBUG - [Pod Pod ctest-pod-64005273] Cmd wget http://10.110.218.81:80/ -O - -T 5 -t 1 passed
2025-06-24 13:27:59,554 - DEBUG - [Pod Pod ctest-pod-64005273] Cmd output: ctest-pod-01862517
Connecting to 10.110.218.81:80 (10.110.218.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-24 13:27:59,610 - DEBUG - [Pod ctest-pod-64005273] Cmd: wget http://10.110.218.81:80/ -O - -T 5 -t 1 , Output: ctest-pod-01862517
Connecting to 10.110.218.81:80 (10.110.218.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-24 13:27:59,610 - DEBUG - [Pod Pod ctest-pod-64005273] Cmd wget http://10.110.218.81:80/ -O - -T 5 -t 1 passed
2025-06-24 13:27:59,610 - DEBUG - [Pod Pod ctest-pod-64005273] Cmd output: ctest-pod-01862517
Connecting to 10.110.218.81:80 (10.110.218.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-24 13:27:59,661 - DEBUG - [Pod ctest-pod-64005273] Cmd: wget http://10.110.218.81:80/ -O - -T 5 -t 1 , Output: ctest-pod-01862517
Connecting to 10.110.218.81:80 (10.110.218.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-24 13:27:59,661 - DEBUG - [Pod Pod ctest-pod-64005273] Cmd wget http://10.110.218.81:80/ -O - -T 5 -t 1 passed
2025-06-24 13:27:59,661 - DEBUG - [Pod Pod ctest-pod-64005273] Cmd output: ctest-pod-01862517
Connecting to 10.110.218.81:80 (10.110.218.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-24 13:27:59,726 - DEBUG - [Pod ctest-pod-64005273] Cmd: wget http://10.110.218.81:80/ -O - -T 5 -t 1 , Output: ctest-pod-56033060
Connecting to 10.110.218.81:80 (10.110.218.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-24 13:27:59,727 - DEBUG - [Pod Pod ctest-pod-64005273] Cmd wget http://10.110.218.81:80/ -O - -T 5 -t 1 passed
2025-06-24 13:27:59,727 - DEBUG - [Pod Pod ctest-pod-64005273] Cmd output: ctest-pod-56033060
Connecting to 10.110.218.81:80 (10.110.218.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-24 13:27:59,727 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-56033060': 1, 'ctest-pod-01862517': 3}
2025-06-24 13:28:04,775 - DEBUG - [Pod ctest-pod-15237523] Cmd: wget http://10.110.218.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:28:04,775 - DEBUG - [Pod Pod ctest-pod-15237523] Cmd wget http://10.110.218.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:28:04,775 - DEBUG - [Pod Pod ctest-pod-15237523] Cmd output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:28:09,827 - DEBUG - [Pod ctest-pod-15237523] Cmd: wget http://10.110.218.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:28:09,827 - DEBUG - [Pod Pod ctest-pod-15237523] Cmd wget http://10.110.218.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:28:09,827 - DEBUG - [Pod Pod ctest-pod-15237523] Cmd output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:28:14,874 - DEBUG - [Pod ctest-pod-15237523] Cmd: wget http://10.110.218.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:28:14,874 - DEBUG - [Pod Pod ctest-pod-15237523] Cmd wget http://10.110.218.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:28:14,874 - DEBUG - [Pod Pod ctest-pod-15237523] Cmd output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:28:19,926 - DEBUG - [Pod ctest-pod-15237523] Cmd: wget http://10.110.218.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:28:19,926 - DEBUG - [Pod Pod ctest-pod-15237523] Cmd wget http://10.110.218.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:28:19,927 - DEBUG - [Pod Pod ctest-pod-15237523] Cmd output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:28:24,970 - DEBUG - [Pod ctest-pod-15237523] Cmd: wget http://10.110.218.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:28:24,970 - DEBUG - [Pod Pod ctest-pod-15237523] Cmd wget http://10.110.218.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:28:24,970 - DEBUG - [Pod Pod ctest-pod-15237523] Cmd output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:28:30,027 - DEBUG - [Pod ctest-pod-15237523] Cmd: wget http://10.110.218.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:28:30,027 - DEBUG - [Pod Pod ctest-pod-15237523] Cmd wget http://10.110.218.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:28:30,027 - DEBUG - [Pod Pod ctest-pod-15237523] Cmd output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:28:33,091 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2025-06-24 13:28:43,156 - DEBUG - [Pod ctest-pod-15237523] Cmd: wget http://10.110.218.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:28:43,156 - DEBUG - [Pod Pod ctest-pod-15237523] Cmd wget http://10.110.218.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:28:43,156 - DEBUG - [Pod Pod ctest-pod-15237523] Cmd output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:28:48,207 - DEBUG - [Pod ctest-pod-15237523] Cmd: wget http://10.110.218.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:28:48,213 - DEBUG - [Pod Pod ctest-pod-15237523] Cmd wget http://10.110.218.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:28:48,213 - DEBUG - [Pod Pod ctest-pod-15237523] Cmd output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:28:53,266 - DEBUG - [Pod ctest-pod-15237523] Cmd: wget http://10.110.218.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:28:53,267 - DEBUG - [Pod Pod ctest-pod-15237523] Cmd wget http://10.110.218.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:28:53,267 - DEBUG - [Pod Pod ctest-pod-15237523] Cmd output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:28:58,318 - DEBUG - [Pod ctest-pod-15237523] Cmd: wget http://10.110.218.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:28:58,318 - DEBUG - [Pod Pod ctest-pod-15237523] Cmd wget http://10.110.218.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:28:58,318 - DEBUG - [Pod Pod ctest-pod-15237523] Cmd output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:28:58,318 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-56033060': 0, 'ctest-pod-01862517': 0}
2025-06-24 13:29:00,359 - DEBUG - [Pod ctest-pod-64005273] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.514 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.077 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.079 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.077/0.223/0.514 ms
2025-06-24 13:29:00,359 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-64005273 with expectation True passed
2025-06-24 13:29:02,406 - DEBUG - [Pod ctest-pod-29065705] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.259 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.078 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.105 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.078/0.480/1.259 ms
2025-06-24 13:29:02,406 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-29065705 with expectation True passed
2025-06-24 13:29:04,450 - DEBUG - [Pod ctest-pod-15237523] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.323 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.065 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.079 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.065/0.489/1.323 ms
2025-06-24 13:29:04,450 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-15237523 with expectation True passed
2025-06-24 13:29:04,504 - DEBUG - [Pod ctest-pod-64005273] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-06-24 13:29:04,504 - DEBUG - [Pod Pod ctest-pod-64005273] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-06-24 13:29:04,505 - DEBUG - [Pod Pod ctest-pod-64005273] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-06-24 13:29:04,505 - INFO - wget check of of http://10.47.255.251 from ctest-pod-64005273 passed
2025-06-24 13:29:04,537 - DEBUG - [Pod ctest-pod-64005273] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-06-24 13:29:04,537 - DEBUG - [Pod Pod ctest-pod-64005273] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-06-24 13:29:04,537 - DEBUG - [Pod Pod ctest-pod-64005273] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-06-24 13:29:04,537 - INFO - wget check of of http://10.47.255.250 from ctest-pod-64005273 passed
2025-06-24 13:29:09,586 - DEBUG - [Pod ctest-pod-29065705] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-06-24 13:29:09,586 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-06-24 13:29:09,586 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-06-24 13:29:09,586 - INFO - wget check of of http://10.47.255.250 from ctest-pod-29065705 passed
2025-06-24 13:29:14,636 - DEBUG - [Pod ctest-pod-03524975] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-06-24 13:29:14,636 - DEBUG - [Pod Pod ctest-pod-03524975] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-06-24 13:29:14,636 - DEBUG - [Pod Pod ctest-pod-03524975] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-06-24 13:29:14,636 - INFO - wget check of of http://10.47.255.251 from ctest-pod-03524975 passed
2025-06-24 13:29:14,645 - INFO - Updating Network Policy ingress-on-service
2025-06-24 13:29:19,715 - DEBUG - [Pod ctest-pod-29065705] Cmd: wget http://10.110.218.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:29:19,715 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd wget http://10.110.218.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:29:19,715 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:29:24,765 - DEBUG - [Pod ctest-pod-29065705] Cmd: wget http://10.110.218.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:29:24,765 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd wget http://10.110.218.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:29:24,765 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:29:29,808 - DEBUG - [Pod ctest-pod-29065705] Cmd: wget http://10.110.218.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:29:29,808 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd wget http://10.110.218.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:29:29,808 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:29:34,855 - DEBUG - [Pod ctest-pod-29065705] Cmd: wget http://10.110.218.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:29:34,855 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd wget http://10.110.218.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:29:34,855 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:29:39,906 - DEBUG - [Pod ctest-pod-29065705] Cmd: wget http://10.110.218.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:29:39,907 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd wget http://10.110.218.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:29:39,907 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:29:44,959 - DEBUG - [Pod ctest-pod-29065705] Cmd: wget http://10.110.218.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:29:44,959 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd wget http://10.110.218.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:29:44,959 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:29:50,006 - DEBUG - [Pod ctest-pod-29065705] Cmd: wget http://10.110.218.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:29:50,006 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd wget http://10.110.218.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:29:50,006 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:29:55,050 - DEBUG - [Pod ctest-pod-29065705] Cmd: wget http://10.110.218.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:29:55,050 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd wget http://10.110.218.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:29:55,050 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:30:00,111 - DEBUG - [Pod ctest-pod-29065705] Cmd: wget http://10.110.218.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:30:00,111 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd wget http://10.110.218.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:30:00,111 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:30:05,166 - DEBUG - [Pod ctest-pod-29065705] Cmd: wget http://10.110.218.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:30:05,166 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd wget http://10.110.218.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:30:05,166 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
wget: download timed out
2025-06-24 13:30:05,166 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-56033060': 0, 'ctest-pod-01862517': 0}
2025-06-24 13:30:05,223 - DEBUG - [Pod ctest-pod-64005273] Cmd: wget http://10.110.218.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-01862517
2025-06-24 13:30:05,223 - DEBUG - [Pod Pod ctest-pod-64005273] Cmd wget http://10.110.218.81:80/ -O - -T 5 -t 1 passed
2025-06-24 13:30:05,223 - DEBUG - [Pod Pod ctest-pod-64005273] Cmd output: Connecting to 10.110.218.81:80 (10.110.218.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-01862517
2025-06-24 13:30:05,277 - DEBUG - [Pod ctest-pod-64005273] Cmd: wget http://10.110.218.81:80/ -O - -T 5 -t 1 , Output: ctest-pod-56033060
Connecting to 10.110.218.81:80 (10.110.218.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-24 13:30:05,277 - DEBUG - [Pod Pod ctest-pod-64005273] Cmd wget http://10.110.218.81:80/ -O - -T 5 -t 1 passed
2025-06-24 13:30:05,277 - DEBUG - [Pod Pod ctest-pod-64005273] Cmd output: ctest-pod-56033060
Connecting to 10.110.218.81:80 (10.110.218.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-24 13:30:05,277 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-56033060': 1, 'ctest-pod-01862517': 1}
2025-06-24 13:30:05,312 - DEBUG - [Pod ctest-pod-15237523] Cmd: wget http://10.110.218.81:80/ -O - -T 5 -t 1 , Output: ctest-pod-56033060
Connecting to 10.110.218.81:80 (10.110.218.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-24 13:30:05,312 - DEBUG - [Pod Pod ctest-pod-15237523] Cmd wget http://10.110.218.81:80/ -O - -T 5 -t 1 passed
2025-06-24 13:30:05,312 - DEBUG - [Pod Pod ctest-pod-15237523] Cmd output: ctest-pod-56033060
Connecting to 10.110.218.81:80 (10.110.218.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-24 13:30:05,371 - DEBUG - [Pod ctest-pod-15237523] Cmd: wget http://10.110.218.81:80/ -O - -T 5 -t 1 , Output: ctest-pod-01862517
Connecting to 10.110.218.81:80 (10.110.218.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-24 13:30:05,371 - DEBUG - [Pod Pod ctest-pod-15237523] Cmd wget http://10.110.218.81:80/ -O - -T 5 -t 1 passed
2025-06-24 13:30:05,371 - DEBUG - [Pod Pod ctest-pod-15237523] Cmd output: ctest-pod-01862517
Connecting to 10.110.218.81:80 (10.110.218.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-24 13:30:05,371 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-56033060': 1, 'ctest-pod-01862517': 1}
2025-06-24 13:30:07,426 - DEBUG - [Pod ctest-pod-64005273] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.610 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.076 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.096 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.076/0.260/0.610 ms
2025-06-24 13:30:07,427 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-64005273 with expectation True passed
2025-06-24 13:30:09,483 - DEBUG - [Pod ctest-pod-29065705] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.764 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.066 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.095 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.066/0.308/0.764 ms
2025-06-24 13:30:09,483 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-29065705 with expectation True passed
2025-06-24 13:30:11,539 - DEBUG - [Pod ctest-pod-15237523] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.809 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.074 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.094 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.074/0.325/0.809 ms
2025-06-24 13:30:11,539 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-15237523 with expectation True passed
2025-06-24 13:30:11,594 - DEBUG - [Pod ctest-pod-64005273] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-06-24 13:30:11,594 - DEBUG - [Pod Pod ctest-pod-64005273] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-06-24 13:30:11,594 - DEBUG - [Pod Pod ctest-pod-64005273] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-06-24 13:30:11,594 - INFO - wget check of of http://10.47.255.251 from ctest-pod-64005273 passed
2025-06-24 13:30:11,645 - DEBUG - [Pod ctest-pod-64005273] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-06-24 13:30:11,645 - DEBUG - [Pod Pod ctest-pod-64005273] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-06-24 13:30:11,645 - DEBUG - [Pod Pod ctest-pod-64005273] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-06-24 13:30:11,645 - INFO - wget check of of http://10.47.255.250 from ctest-pod-64005273 passed
2025-06-24 13:30:16,699 - DEBUG - [Pod ctest-pod-29065705] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-06-24 13:30:16,700 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-06-24 13:30:16,700 - DEBUG - [Pod Pod ctest-pod-29065705] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-06-24 13:30:16,700 - INFO - wget check of of http://10.47.255.250 from ctest-pod-29065705 passed
2025-06-24 13:30:16,752 - DEBUG - [Pod ctest-pod-03524975] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-06-24 13:30:16,752 - DEBUG - [Pod Pod ctest-pod-03524975] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-06-24 13:30:16,752 - DEBUG - [Pod Pod ctest-pod-03524975] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-06-24 13:30:16,752 - INFO - wget check of of http://10.47.255.251 from ctest-pod-03524975 passed
2025-06-24 13:30:16,752 - INFO - Deleting Network Policy : ingress-on-service
2025-06-24 13:30:16,753 - INFO - Deleting service : ctest-nginx-svc-01927746
2025-06-24 13:30:16,979 - DEBUG - No XMPP flaps were noticed during the test
2025-06-24 13:30:16,979 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:12]
2025-06-24 13:30:16,979 - INFO - --------------------------------------------------------------------------------
2025-06-24 13:30:16,984 - INFO - Deleting pod ctest-new-default-37500811:ctest-pod-56033060
2025-06-24 13:30:16,985 - INFO - Deleting pod ctest-new-default-37500811:ctest-pod-01862517
2025-06-24 13:30:16,985 - INFO - Deleting pod ctest-non-default-70106837:ctest-pod-91966107
2025-06-24 13:30:16,986 - INFO - Deleting pod ctest-non-default-70106837:ctest-pod-10352335
2025-06-24 13:30:16,986 - INFO - Deleting pod ctest-new-default-37500811:ctest-pod-29065705
2025-06-24 13:30:16,986 - INFO - Deleting pod ctest-new-default-37500811:ctest-pod-64005273
2025-06-24 13:30:16,987 - INFO - Deleting pod ctest-non-default-70106837:ctest-pod-15237523
2025-06-24 13:30:16,987 - INFO - Deleting pod ctest-non-default-70106837:ctest-pod-03524975
2025-06-24 13:30:17,150 - WARNING - Pod uuid 89a5b4ac-b9cb-4342-bea0-305dfa5231ed is still seen in agent 10.0.0.129 VM list
2025-06-24 13:30:17,153 - WARNING - Pod uuid 276e1991-96a1-4026-b62f-c568fe21f19a is still seen in agent 10.0.0.129 VM list
2025-06-24 13:30:17,176 - WARNING - Pod uuid 8cf430af-48b2-4026-9b78-d516d16a9165 is still seen in agent 10.0.0.129 VM list
2025-06-24 13:30:17,177 - WARNING - Pod uuid 63f5a693-20d3-4020-a008-375459119a1d is still seen in agent 10.0.0.129 VM list
2025-06-24 13:30:17,177 - WARNING - Pod uuid fac0c886-a12b-4b51-927c-7757eeda69db is still seen in agent 10.0.0.129 VM list
2025-06-24 13:30:17,177 - WARNING - Pod uuid 18f1dc65-b07a-418c-a054-83ad6f265a59 is still seen in agent 10.0.0.129 VM list
2025-06-24 13:30:17,179 - WARNING - Pod uuid 63c76465-3438-4134-a3f4-0f6a2178d1ea is still seen in agent 10.0.0.129 VM list
2025-06-24 13:30:17,179 - WARNING - Pod uuid 771d0f55-68e2-4183-b62e-de3cddcb2955 is still seen in agent 10.0.0.129 VM list
2025-06-24 13:30:22,159 - WARNING - Pod uuid 89a5b4ac-b9cb-4342-bea0-305dfa5231ed is still seen in agent 10.0.0.129 VM list
2025-06-24 13:30:22,160 - WARNING - Pod uuid 276e1991-96a1-4026-b62f-c568fe21f19a is still seen in agent 10.0.0.129 VM list
2025-06-24 13:30:22,201 - WARNING - Pod uuid 63f5a693-20d3-4020-a008-375459119a1d is still seen in agent 10.0.0.129 VM list
2025-06-24 13:30:22,204 - DEBUG - Pod 771d0f55-68e2-4183-b62e-de3cddcb2955 is not in agent 10.0.0.129 VM list
2025-06-24 13:30:22,205 - WARNING - Pod uuid 18f1dc65-b07a-418c-a054-83ad6f265a59 is still seen in agent 10.0.0.129 VM list
2025-06-24 13:30:22,206 - DEBUG - Pod fac0c886-a12b-4b51-927c-7757eeda69db is not in agent 10.0.0.129 VM list
2025-06-24 13:30:22,207 - WARNING - Pod uuid 63c76465-3438-4134-a3f4-0f6a2178d1ea is still seen in agent 10.0.0.129 VM list
2025-06-24 13:30:22,208 - DEBUG - Pod 8cf430af-48b2-4026-9b78-d516d16a9165 is not in agent 10.0.0.129 VM list
2025-06-24 13:30:22,218 - DEBUG - VMI dfa4459a-50fe-11f0-81d4-fa163e49113b is removed from agent 10.0.0.129
2025-06-24 13:30:22,218 - INFO - Verified that pod ctest-pod-01862517 is removed in agent
2025-06-24 13:30:22,219 - DEBUG - VMI e0c5adec-50fe-11f0-81d4-fa163e49113b is removed from agent 10.0.0.129
2025-06-24 13:30:22,219 - INFO - Verified that pod ctest-pod-10352335 is removed in agent
2025-06-24 13:30:22,220 - DEBUG - VMI e049ffda-50fe-11f0-81d4-fa163e49113b is removed from agent 10.0.0.129
2025-06-24 13:30:22,220 - INFO - Verified that pod ctest-pod-91966107 is removed in agent
2025-06-24 13:30:27,173 - WARNING - Pod uuid 89a5b4ac-b9cb-4342-bea0-305dfa5231ed is still seen in agent 10.0.0.129 VM list
2025-06-24 13:30:27,174 - WARNING - Pod uuid 276e1991-96a1-4026-b62f-c568fe21f19a is still seen in agent 10.0.0.129 VM list
2025-06-24 13:30:27,218 - WARNING - Pod uuid 63f5a693-20d3-4020-a008-375459119a1d is still seen in agent 10.0.0.129 VM list
2025-06-24 13:30:27,232 - WARNING - Pod uuid 63c76465-3438-4134-a3f4-0f6a2178d1ea is still seen in agent 10.0.0.129 VM list
2025-06-24 13:30:27,235 - WARNING - Pod uuid 18f1dc65-b07a-418c-a054-83ad6f265a59 is still seen in agent 10.0.0.129 VM list
2025-06-24 13:30:32,187 - WARNING - Pod uuid 276e1991-96a1-4026-b62f-c568fe21f19a is still seen in agent 10.0.0.129 VM list
2025-06-24 13:30:32,190 - WARNING - Pod uuid 89a5b4ac-b9cb-4342-bea0-305dfa5231ed is still seen in agent 10.0.0.129 VM list
2025-06-24 13:30:32,227 - WARNING - Pod uuid 63f5a693-20d3-4020-a008-375459119a1d is still seen in agent 10.0.0.129 VM list
2025-06-24 13:30:32,245 - WARNING - Pod uuid 18f1dc65-b07a-418c-a054-83ad6f265a59 is still seen in agent 10.0.0.129 VM list
2025-06-24 13:30:32,246 - WARNING - Pod uuid 63c76465-3438-4134-a3f4-0f6a2178d1ea is still seen in agent 10.0.0.129 VM list
2025-06-24 13:30:37,199 - WARNING - Pod uuid 276e1991-96a1-4026-b62f-c568fe21f19a is still seen in agent 10.0.0.129 VM list
2025-06-24 13:30:37,200 - WARNING - Pod uuid 89a5b4ac-b9cb-4342-bea0-305dfa5231ed is still seen in agent 10.0.0.129 VM list
2025-06-24 13:30:37,234 - WARNING - Pod uuid 63f5a693-20d3-4020-a008-375459119a1d is still seen in agent 10.0.0.129 VM list
2025-06-24 13:30:37,256 - WARNING - Pod uuid 63c76465-3438-4134-a3f4-0f6a2178d1ea is still seen in agent 10.0.0.129 VM list
2025-06-24 13:30:37,256 - WARNING - Pod uuid 18f1dc65-b07a-418c-a054-83ad6f265a59 is still seen in agent 10.0.0.129 VM list
2025-06-24 13:30:42,212 - WARNING - Pod uuid 89a5b4ac-b9cb-4342-bea0-305dfa5231ed is still seen in agent 10.0.0.129 VM list
2025-06-24 13:30:42,213 - WARNING - Pod uuid 276e1991-96a1-4026-b62f-c568fe21f19a is still seen in agent 10.0.0.129 VM list
2025-06-24 13:30:42,243 - WARNING - Pod uuid 63f5a693-20d3-4020-a008-375459119a1d is still seen in agent 10.0.0.129 VM list
2025-06-24 13:30:42,268 - WARNING - Pod uuid 18f1dc65-b07a-418c-a054-83ad6f265a59 is still seen in agent 10.0.0.129 VM list
2025-06-24 13:30:42,269 - WARNING - Pod uuid 63c76465-3438-4134-a3f4-0f6a2178d1ea is still seen in agent 10.0.0.129 VM list
2025-06-24 13:30:47,263 - WARNING - Pod uuid 89a5b4ac-b9cb-4342-bea0-305dfa5231ed is still seen in agent 10.0.0.129 VM list
2025-06-24 13:30:47,265 - WARNING - Pod uuid 276e1991-96a1-4026-b62f-c568fe21f19a is still seen in agent 10.0.0.129 VM list
2025-06-24 13:30:47,265 - WARNING - Pod uuid 63f5a693-20d3-4020-a008-375459119a1d is still seen in agent 10.0.0.129 VM list
2025-06-24 13:30:47,284 - WARNING - Pod uuid 63c76465-3438-4134-a3f4-0f6a2178d1ea is still seen in agent 10.0.0.129 VM list
2025-06-24 13:30:47,284 - WARNING - Pod uuid 18f1dc65-b07a-418c-a054-83ad6f265a59 is still seen in agent 10.0.0.129 VM list
2025-06-24 13:30:52,277 - DEBUG - Pod 89a5b4ac-b9cb-4342-bea0-305dfa5231ed is not in agent 10.0.0.129 VM list
2025-06-24 13:30:52,280 - DEBUG - Pod 276e1991-96a1-4026-b62f-c568fe21f19a is not in agent 10.0.0.129 VM list
2025-06-24 13:30:52,281 - DEBUG - Pod 63f5a693-20d3-4020-a008-375459119a1d is not in agent 10.0.0.129 VM list
2025-06-24 13:30:52,291 - DEBUG - VMI df2a7b5c-50fe-11f0-81d4-fa163e49113b is removed from agent 10.0.0.129
2025-06-24 13:30:52,291 - INFO - Verified that pod ctest-pod-56033060 is removed in agent
2025-06-24 13:30:52,295 - DEBUG - VMI e161a300-50fe-11f0-81d4-fa163e49113b is removed from agent 10.0.0.129
2025-06-24 13:30:52,295 - INFO - Verified that pod ctest-pod-29065705 is removed in agent
2025-06-24 13:30:52,296 - DEBUG - Pod 18f1dc65-b07a-418c-a054-83ad6f265a59 is not in agent 10.0.0.129 VM list
2025-06-24 13:30:52,298 - DEBUG - Pod 63c76465-3438-4134-a3f4-0f6a2178d1ea is not in agent 10.0.0.129 VM list
2025-06-24 13:30:52,299 - DEBUG - VMI e2642b88-50fe-11f0-81d4-fa163e49113b is removed from agent 10.0.0.129
2025-06-24 13:30:52,299 - INFO - Verified that pod ctest-pod-15237523 is removed in agent
2025-06-24 13:30:52,306 - DEBUG - VMI e2e69b86-50fe-11f0-81d4-fa163e49113b is removed from agent 10.0.0.129
2025-06-24 13:30:52,306 - INFO - Verified that pod ctest-pod-03524975 is removed in agent
2025-06-24 13:30:52,307 - DEBUG - VMI e1e5c31a-50fe-11f0-81d4-fa163e49113b is removed from agent 10.0.0.129
2025-06-24 13:30:52,307 - INFO - Verified that pod ctest-pod-64005273 is removed in agent
2025-06-24 13:30:52,307 - INFO - Deleting namespace ctest-non-default-70106837
2025-06-24 13:30:52,315 - DEBUG - Namespace ctest-non-default-70106837 still in k8s
2025-06-24 13:30:54,320 - DEBUG - Namespace ctest-non-default-70106837 still in k8s
2025-06-24 13:30:56,325 - DEBUG - Namespace ctest-non-default-70106837 still in k8s
2025-06-24 13:30:58,328 - DEBUG - Namespace ctest-non-default-70106837 is not in k8s
2025-06-24 13:30:58,328 - DEBUG - No need to check project deletion in contrail-api
2025-06-24 13:30:58,328 - INFO - Deleting namespace ctest-new-default-37500811
2025-06-24 13:30:58,336 - DEBUG - Namespace ctest-new-default-37500811 still in k8s
2025-06-24 13:31:00,341 - DEBUG - Namespace ctest-new-default-37500811 still in k8s
2025-06-24 13:31:02,353 - DEBUG - Namespace ctest-new-default-37500811 still in k8s
2025-06-24 13:31:04,357 - DEBUG - Namespace ctest-new-default-37500811 is not in k8s
2025-06-24 13:31:04,357 - DEBUG - No need to check project deletion in contrail-api