2024-10-28 02:02:45,773 - INFO - Using existing project ['default-domain', 'k8s-default'](efae2ae0-e363-473d-995e-d3c9dccce4b9)
2024-10-28 02:02:45,791 - DEBUG - Namespace ctest-new-default-02706129 not present
2024-10-28 02:02:45,800 - INFO - Created namespace ctest-new-default-02706129
2024-10-28 02:02:48,804 - DEBUG - Namespace ctest-non-default-62709788 not present
2024-10-28 02:02:48,822 - INFO - Created namespace ctest-non-default-62709788
2024-10-28 02:02:51,842 - DEBUG - Pod ctest-pod-48857856 not present
2024-10-28 02:02:51,842 - INFO - Creating Pod ctest-pod-48857856
2024-10-28 02:02:51,864 - DEBUG - Pod : ctest-pod-48857856 UUID is c87c2a24-a0c5-4c68-a594-fe8db04b597d
2024-10-28 02:02:51,875 - DEBUG - Pod ctest-pod-41047003 not present
2024-10-28 02:02:51,875 - INFO - Creating Pod ctest-pod-41047003
2024-10-28 02:02:51,897 - DEBUG - Pod : ctest-pod-41047003 UUID is 2164f122-695a-4341-86ca-09ec2e2a47f0
2024-10-28 02:02:51,900 - DEBUG - Pod ctest-pod-24730131 not present
2024-10-28 02:02:51,900 - INFO - Creating Pod ctest-pod-24730131
2024-10-28 02:02:51,924 - DEBUG - Pod : ctest-pod-24730131 UUID is 033108e9-53bd-41ed-bcce-dae8a138f063
2024-10-28 02:02:51,927 - DEBUG - Pod ctest-pod-15778048 not present
2024-10-28 02:02:51,927 - INFO - Creating Pod ctest-pod-15778048
2024-10-28 02:02:51,963 - DEBUG - Pod : ctest-pod-15778048 UUID is 4cbacf55-a790-4971-9232-3cbfb4768507
2024-10-28 02:02:51,973 - DEBUG - Pod ctest-pod-07714162 not present
2024-10-28 02:02:51,973 - INFO - Creating Pod ctest-pod-07714162
2024-10-28 02:02:51,994 - DEBUG - Pod : ctest-pod-07714162 UUID is 657aba01-6c98-4834-8fb9-c14dbb4d7de7
2024-10-28 02:02:51,998 - DEBUG - Pod ctest-pod-81144808 not present
2024-10-28 02:02:51,999 - INFO - Creating Pod ctest-pod-81144808
2024-10-28 02:02:52,014 - DEBUG - Pod : ctest-pod-81144808 UUID is 6badc876-d237-4866-9b42-125cc08e8789
2024-10-28 02:02:52,016 - DEBUG - Pod ctest-pod-84053637 not present
2024-10-28 02:02:52,016 - INFO - Creating Pod ctest-pod-84053637
2024-10-28 02:02:52,030 - DEBUG - Pod : ctest-pod-84053637 UUID is d99d545a-d7c0-4154-a718-f8b3bc6028e3
2024-10-28 02:02:52,033 - DEBUG - Pod ctest-pod-68839449 not present
2024-10-28 02:02:52,033 - INFO - Creating Pod ctest-pod-68839449
2024-10-28 02:02:52,054 - DEBUG - Pod : ctest-pod-68839449 UUID is 1e301b50-ef97-4c66-9fb2-ec6d54daca0f
2024-10-28 02:02:52,229 - INFO - Project default-domain:k8s-ctest-new-default-02706129 for Namespace ctest-new-default-02706129 is seen in contrail-api
2024-10-28 02:02:52,229 - DEBUG - Project uuid in Contrail is 962c612d-3165-44ce-bbfb-d46fddb6687c
2024-10-28 02:02:52,357 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NamespaceDatabaseList?namespace_uuid=90ec519a-fe50-474a-bf07-13b514ead05d
2024-10-28 02:02:52,382 - INFO - Namespace ctest-new-default-02706129 with uuid 90ec519a-fe50-474a-bf07-13b514ead05d found in kube manager
2024-10-28 02:02:52,382 - INFO - Namespace ctest-new-default-02706129 verification passed
2024-10-28 02:02:52,619 - INFO - Project default-domain:k8s-ctest-non-default-62709788 for Namespace ctest-non-default-62709788 is seen in contrail-api
2024-10-28 02:02:52,619 - DEBUG - Project uuid in Contrail is 76eae52b-db4a-4f50-9d70-bd90af5eb6e8
2024-10-28 02:02:52,619 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NamespaceDatabaseList?namespace_uuid=494bd65a-d59d-4c31-872e-ecf36dfe131c
2024-10-28 02:02:52,625 - INFO - Namespace ctest-non-default-62709788 with uuid 494bd65a-d59d-4c31-872e-ecf36dfe131c found in kube manager
2024-10-28 02:02:52,625 - INFO - Namespace ctest-non-default-62709788 verification passed
2024-10-28 02:02:52,643 - DEBUG - Pod ctest-pod-48857856 not in running state.Currently in Pending
2024-10-28 02:02:57,658 - DEBUG - Pod ctest-pod-48857856 not in running state.Currently in Pending
2024-10-28 02:03:02,664 - DEBUG - Pod ctest-pod-48857856 not in running state.Currently in Pending
2024-10-28 02:03:07,681 - INFO - Pod ctest-pod-48857856 is in running state.Got IP 10.47.255.251
2024-10-28 02:03:07,750 - DEBUG - Pod ctest-pod-48857856 has vmi be73b742-94d0-11ef-b36a-fa163e8c8802
2024-10-28 02:03:07,750 - INFO - Verified pod ctest-pod-48857856 in contrail-api
2024-10-28 02:03:07,765 - DEBUG - VMI be73b742-94d0-11ef-b36a-fa163e8c8802 is active in agent 10.0.0.27
2024-10-28 02:03:07,766 - INFO - Verified Pod ctest-pod-48857856 in agent 10.0.0.27
2024-10-28 02:03:07,766 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=c87c2a24-a0c5-4c68-a594-fe8db04b597d
2024-10-28 02:03:07,771 - INFO - Pod ctest-pod-48857856 with uuid c87c2a24-a0c5-4c68-a594-fe8db04b597d found in kube manager
2024-10-28 02:03:07,771 - INFO - Pod ctest-pod-48857856 verification passed
2024-10-28 02:03:07,777 - INFO - Pod ctest-pod-41047003 is in running state.Got IP 10.47.255.250
2024-10-28 02:03:07,795 - DEBUG - Pod ctest-pod-41047003 has vmi befb28d0-94d0-11ef-b36a-fa163e8c8802
2024-10-28 02:03:07,795 - INFO - Verified pod ctest-pod-41047003 in contrail-api
2024-10-28 02:03:07,811 - DEBUG - VMI befb28d0-94d0-11ef-b36a-fa163e8c8802 is active in agent 10.0.0.27
2024-10-28 02:03:07,811 - INFO - Verified Pod ctest-pod-41047003 in agent 10.0.0.27
2024-10-28 02:03:07,811 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=2164f122-695a-4341-86ca-09ec2e2a47f0
2024-10-28 02:03:07,817 - INFO - Pod ctest-pod-41047003 with uuid 2164f122-695a-4341-86ca-09ec2e2a47f0 found in kube manager
2024-10-28 02:03:07,817 - INFO - Pod ctest-pod-41047003 verification passed
2024-10-28 02:03:07,822 - INFO - Pod ctest-pod-24730131 is in running state.Got IP 10.47.255.249
2024-10-28 02:03:07,882 - DEBUG - Pod ctest-pod-24730131 has vmi bfb8eafa-94d0-11ef-b36a-fa163e8c8802
2024-10-28 02:03:07,882 - INFO - Verified pod ctest-pod-24730131 in contrail-api
2024-10-28 02:03:07,896 - DEBUG - VMI bfb8eafa-94d0-11ef-b36a-fa163e8c8802 is active in agent 10.0.0.27
2024-10-28 02:03:07,897 - INFO - Verified Pod ctest-pod-24730131 in agent 10.0.0.27
2024-10-28 02:03:07,897 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=033108e9-53bd-41ed-bcce-dae8a138f063
2024-10-28 02:03:07,901 - INFO - Pod ctest-pod-24730131 with uuid 033108e9-53bd-41ed-bcce-dae8a138f063 found in kube manager
2024-10-28 02:03:07,901 - INFO - Pod ctest-pod-24730131 verification passed
2024-10-28 02:03:07,908 - INFO - Pod ctest-pod-15778048 is in running state.Got IP 10.47.255.248
2024-10-28 02:03:07,970 - DEBUG - Pod ctest-pod-15778048 has vmi c03d7464-94d0-11ef-b36a-fa163e8c8802
2024-10-28 02:03:07,970 - INFO - Verified pod ctest-pod-15778048 in contrail-api
2024-10-28 02:03:07,988 - DEBUG - VMI c03d7464-94d0-11ef-b36a-fa163e8c8802 is active in agent 10.0.0.27
2024-10-28 02:03:07,988 - INFO - Verified Pod ctest-pod-15778048 in agent 10.0.0.27
2024-10-28 02:03:07,989 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=4cbacf55-a790-4971-9232-3cbfb4768507
2024-10-28 02:03:07,997 - INFO - Pod ctest-pod-15778048 with uuid 4cbacf55-a790-4971-9232-3cbfb4768507 found in kube manager
2024-10-28 02:03:07,997 - INFO - Pod ctest-pod-15778048 verification passed
2024-10-28 02:03:08,005 - DEBUG - Pod ctest-pod-07714162 not in running state.Currently in Pending
2024-10-28 02:03:13,011 - INFO - Pod ctest-pod-07714162 is in running state.Got IP 10.47.255.247
2024-10-28 02:03:13,032 - DEBUG - Pod ctest-pod-07714162 has vmi c0e0a904-94d0-11ef-b36a-fa163e8c8802
2024-10-28 02:03:13,032 - INFO - Verified pod ctest-pod-07714162 in contrail-api
2024-10-28 02:03:13,048 - DEBUG - VMI c0e0a904-94d0-11ef-b36a-fa163e8c8802 is active in agent 10.0.0.27
2024-10-28 02:03:13,048 - INFO - Verified Pod ctest-pod-07714162 in agent 10.0.0.27
2024-10-28 02:03:13,048 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=657aba01-6c98-4834-8fb9-c14dbb4d7de7
2024-10-28 02:03:13,054 - INFO - Pod ctest-pod-07714162 with uuid 657aba01-6c98-4834-8fb9-c14dbb4d7de7 found in kube manager
2024-10-28 02:03:13,054 - INFO - Pod ctest-pod-07714162 verification passed
2024-10-28 02:03:13,060 - INFO - Pod ctest-pod-84053637 is in running state.Got IP 10.47.255.245
2024-10-28 02:03:13,126 - DEBUG - Pod ctest-pod-84053637 has vmi c1e9ace2-94d0-11ef-b36a-fa163e8c8802
2024-10-28 02:03:13,126 - INFO - Verified pod ctest-pod-84053637 in contrail-api
2024-10-28 02:03:13,139 - DEBUG - VMI c1e9ace2-94d0-11ef-b36a-fa163e8c8802 is active in agent 10.0.0.27
2024-10-28 02:03:13,140 - INFO - Verified Pod ctest-pod-84053637 in agent 10.0.0.27
2024-10-28 02:03:13,140 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=d99d545a-d7c0-4154-a718-f8b3bc6028e3
2024-10-28 02:03:13,144 - INFO - Pod ctest-pod-84053637 with uuid d99d545a-d7c0-4154-a718-f8b3bc6028e3 found in kube manager
2024-10-28 02:03:13,145 - INFO - Pod ctest-pod-84053637 verification passed
2024-10-28 02:03:13,150 - INFO - Pod ctest-pod-81144808 is in running state.Got IP 10.47.255.246
2024-10-28 02:03:13,170 - DEBUG - Pod ctest-pod-81144808 has vmi c1639f44-94d0-11ef-b36a-fa163e8c8802
2024-10-28 02:03:13,170 - INFO - Verified pod ctest-pod-81144808 in contrail-api
2024-10-28 02:03:13,184 - DEBUG - VMI c1639f44-94d0-11ef-b36a-fa163e8c8802 is active in agent 10.0.0.27
2024-10-28 02:03:13,184 - INFO - Verified Pod ctest-pod-81144808 in agent 10.0.0.27
2024-10-28 02:03:13,184 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=6badc876-d237-4866-9b42-125cc08e8789
2024-10-28 02:03:13,189 - INFO - Pod ctest-pod-81144808 with uuid 6badc876-d237-4866-9b42-125cc08e8789 found in kube manager
2024-10-28 02:03:13,189 - INFO - Pod ctest-pod-81144808 verification passed
2024-10-28 02:03:13,194 - INFO - Pod ctest-pod-68839449 is in running state.Got IP 10.47.255.244
2024-10-28 02:03:13,253 - DEBUG - Pod ctest-pod-68839449 has vmi c269041a-94d0-11ef-b36a-fa163e8c8802
2024-10-28 02:03:13,253 - INFO - Verified pod ctest-pod-68839449 in contrail-api
2024-10-28 02:03:13,266 - DEBUG - VMI c269041a-94d0-11ef-b36a-fa163e8c8802 is active in agent 10.0.0.27
2024-10-28 02:03:13,266 - INFO - Verified Pod ctest-pod-68839449 in agent 10.0.0.27
2024-10-28 02:03:13,266 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_VirtualMachineDatabaseList?x=1e301b50-ef97-4c66-9fb2-ec6d54daca0f
2024-10-28 02:03:13,270 - INFO - Pod ctest-pod-68839449 with uuid 1e301b50-ef97-4c66-9fb2-ec6d54daca0f found in kube manager
2024-10-28 02:03:13,270 - INFO - Pod ctest-pod-68839449 verification passed
2024-10-28 02:03:13,271 - INFO - ================================================================================
2024-10-28 02:03:13,271 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2024-10-28 02:03:13,271 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2024-10-28 02:03:13,520 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.0.0.12': '0'}} with
2024-10-28 02:03:13,520 - INFO - Initial checks done. Running the testcase now
2024-10-28 02:03:13,520 - INFO -
2024-10-28 02:03:13,586 - DEBUG - [Pod ctest-pod-48857856] Cmd: echo ctest-pod-48857856 > /usr/share/nginx/html/index.html, Output:
2024-10-28 02:03:13,662 - DEBUG - [Pod ctest-pod-41047003] Cmd: echo ctest-pod-41047003 > /usr/share/nginx/html/index.html, Output:
2024-10-28 02:03:13,714 - DEBUG - [Pod ctest-pod-24730131] Cmd: echo ctest-pod-24730131 > /usr/share/nginx/html/index.html, Output:
2024-10-28 02:03:13,785 - DEBUG - [Pod ctest-pod-15778048] Cmd: echo ctest-pod-15778048 > /usr/share/nginx/html/index.html, Output:
2024-10-28 02:03:13,788 - DEBUG - Service ctest-nginx-svc-57239763 not present
2024-10-28 02:03:13,788 - INFO - Creating service ctest-nginx-svc-57239763
2024-10-28 02:03:13,808 - INFO - Created Service ctest-nginx-svc-57239763
2024-10-28 02:03:13,818 - WARNING - Service UUID d6c8a40d-af9c-41ca-8af3-eb7f8128f1fe not yet found in contrail-api
2024-10-28 02:03:14,828 - INFO - Validated that Service ctest-nginx-svc-57239763 is seen in contrail-api
2024-10-28 02:03:14,829 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_LoadbalancerDatabaseList?x=d6c8a40d-af9c-41ca-8af3-eb7f8128f1fe
2024-10-28 02:03:14,834 - INFO - Service ctest-nginx-svc-57239763 with uuid d6c8a40d-af9c-41ca-8af3-eb7f8128f1fe found in kube manager
2024-10-28 02:03:14,835 - INFO - Service ctest-nginx-svc-57239763 verification passed
2024-10-28 02:03:15,938 - DEBUG - [Pod ctest-pod-07714162] Cmd: wget http://10.99.198.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-41047003
2024-10-28 02:03:15,938 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd wget http://10.99.198.245:80/ -O - -T 5 -t 1 passed
2024-10-28 02:03:15,939 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-41047003
2024-10-28 02:03:16,007 - DEBUG - [Pod ctest-pod-07714162] Cmd: wget http://10.99.198.245:80/ -O - -T 5 -t 1 , Output: ctest-pod-41047003
Connecting to 10.99.198.245:80 (10.99.198.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-28 02:03:16,008 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd wget http://10.99.198.245:80/ -O - -T 5 -t 1 passed
2024-10-28 02:03:16,008 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd output: ctest-pod-41047003
Connecting to 10.99.198.245:80 (10.99.198.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-28 02:03:16,081 - DEBUG - [Pod ctest-pod-07714162] Cmd: wget http://10.99.198.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-41047003
2024-10-28 02:03:16,081 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd wget http://10.99.198.245:80/ -O - -T 5 -t 1 passed
2024-10-28 02:03:16,081 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-41047003
2024-10-28 02:03:16,150 - DEBUG - [Pod ctest-pod-07714162] Cmd: wget http://10.99.198.245:80/ -O - -T 5 -t 1 , Output: ctest-pod-41047003
Connecting to 10.99.198.245:80 (10.99.198.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-28 02:03:16,150 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd wget http://10.99.198.245:80/ -O - -T 5 -t 1 passed
2024-10-28 02:03:16,150 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd output: ctest-pod-41047003
Connecting to 10.99.198.245:80 (10.99.198.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-28 02:03:16,214 - DEBUG - [Pod ctest-pod-07714162] Cmd: wget http://10.99.198.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-41047003
2024-10-28 02:03:16,214 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd wget http://10.99.198.245:80/ -O - -T 5 -t 1 passed
2024-10-28 02:03:16,214 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-41047003
2024-10-28 02:03:16,286 - DEBUG - [Pod ctest-pod-07714162] Cmd: wget http://10.99.198.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
ctest-pod-48857856
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-28 02:03:16,286 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd wget http://10.99.198.245:80/ -O - -T 5 -t 1 passed
2024-10-28 02:03:16,286 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
ctest-pod-48857856
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-28 02:03:16,287 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-48857856': 1, 'ctest-pod-41047003': 5}
2024-10-28 02:03:16,353 - DEBUG - [Pod ctest-pod-84053637] Cmd: wget http://10.99.198.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-48857856
2024-10-28 02:03:16,353 - DEBUG - [Pod Pod ctest-pod-84053637] Cmd wget http://10.99.198.245:80/ -O - -T 5 -t 1 passed
2024-10-28 02:03:16,353 - DEBUG - [Pod Pod ctest-pod-84053637] Cmd output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-48857856
2024-10-28 02:03:16,421 - DEBUG - [Pod ctest-pod-84053637] Cmd: wget http://10.99.198.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-48857856
2024-10-28 02:03:16,422 - DEBUG - [Pod Pod ctest-pod-84053637] Cmd wget http://10.99.198.245:80/ -O - -T 5 -t 1 passed
2024-10-28 02:03:16,422 - DEBUG - [Pod Pod ctest-pod-84053637] Cmd output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-48857856
2024-10-28 02:03:16,488 - DEBUG - [Pod ctest-pod-84053637] Cmd: wget http://10.99.198.245:80/ -O - -T 5 -t 1 , Output: ctest-pod-48857856
Connecting to 10.99.198.245:80 (10.99.198.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-28 02:03:16,488 - DEBUG - [Pod Pod ctest-pod-84053637] Cmd wget http://10.99.198.245:80/ -O - -T 5 -t 1 passed
2024-10-28 02:03:16,488 - DEBUG - [Pod Pod ctest-pod-84053637] Cmd output: ctest-pod-48857856
Connecting to 10.99.198.245:80 (10.99.198.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-28 02:03:16,556 - DEBUG - [Pod ctest-pod-84053637] Cmd: wget http://10.99.198.245:80/ -O - -T 5 -t 1 , Output: ctest-pod-41047003
Connecting to 10.99.198.245:80 (10.99.198.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-28 02:03:16,556 - DEBUG - [Pod Pod ctest-pod-84053637] Cmd wget http://10.99.198.245:80/ -O - -T 5 -t 1 passed
2024-10-28 02:03:16,556 - DEBUG - [Pod Pod ctest-pod-84053637] Cmd output: ctest-pod-41047003
Connecting to 10.99.198.245:80 (10.99.198.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-28 02:03:16,556 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-48857856': 3, 'ctest-pod-41047003': 1}
2024-10-28 02:03:16,559 - DEBUG - Network policy ingress-on-service not present
2024-10-28 02:03:16,560 - INFO - Creating Network Policy ingress-on-service
2024-10-28 02:03:16,571 - INFO - Network policy found in k8s
2024-10-28 02:03:16,572 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=450b85ab-49ac-4dfa-8e41-f92ffe30af76
2024-10-28 02:03:16,579 - INFO - Network Policy ingress-on-service with uuid 450b85ab-49ac-4dfa-8e41-f92ffe30af76 found in kube manager
2024-10-28 02:03:16,625 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2024-10-28 02:03:16,625 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2024-10-28 02:03:16,626 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=450b85ab-49ac-4dfa-8e41-f92ffe30af76
2024-10-28 02:03:16,660 - WARNING - Network policy with name ingress-on-service not found in agent
2024-10-28 02:03:18,661 - DEBUG - Requesting: http://10.0.0.12:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=450b85ab-49ac-4dfa-8e41-f92ffe30af76
2024-10-28 02:03:18,693 - INFO - Network policy with name ingress-on-service found in agent
2024-10-28 02:03:18,694 - INFO - Network Policy ingress-on-service verification passed
2024-10-28 02:03:23,756 - DEBUG - [Pod ctest-pod-07714162] Cmd: wget http://10.99.198.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:03:23,756 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd wget http://10.99.198.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:03:23,756 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:03:28,812 - DEBUG - [Pod ctest-pod-07714162] Cmd: wget http://10.99.198.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:03:28,812 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd wget http://10.99.198.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:03:28,812 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:03:33,875 - DEBUG - [Pod ctest-pod-07714162] Cmd: wget http://10.99.198.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:03:33,875 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd wget http://10.99.198.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:03:33,875 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:03:38,928 - DEBUG - [Pod ctest-pod-07714162] Cmd: wget http://10.99.198.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:03:38,928 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd wget http://10.99.198.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:03:38,928 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:03:43,996 - DEBUG - [Pod ctest-pod-07714162] Cmd: wget http://10.99.198.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:03:43,996 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd wget http://10.99.198.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:03:43,996 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:03:49,071 - DEBUG - [Pod ctest-pod-07714162] Cmd: wget http://10.99.198.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:03:49,072 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd wget http://10.99.198.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:03:49,072 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:03:54,144 - DEBUG - [Pod ctest-pod-07714162] Cmd: wget http://10.99.198.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:03:54,144 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd wget http://10.99.198.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:03:54,144 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:03:59,205 - DEBUG - [Pod ctest-pod-07714162] Cmd: wget http://10.99.198.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:03:59,205 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd wget http://10.99.198.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:03:59,205 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:04:04,262 - DEBUG - [Pod ctest-pod-07714162] Cmd: wget http://10.99.198.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:04:04,262 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd wget http://10.99.198.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:04:04,262 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:04:09,322 - DEBUG - [Pod ctest-pod-07714162] Cmd: wget http://10.99.198.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:04:09,322 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd wget http://10.99.198.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:04:09,322 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:04:09,322 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-48857856': 0, 'ctest-pod-41047003': 0}
2024-10-28 02:04:09,405 - DEBUG - [Pod ctest-pod-81144808] Cmd: wget http://10.99.198.245:80/ -O - -T 5 -t 1 , Output: ctest-pod-41047003
Connecting to 10.99.198.245:80 (10.99.198.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-28 02:04:09,405 - DEBUG - [Pod Pod ctest-pod-81144808] Cmd wget http://10.99.198.245:80/ -O - -T 5 -t 1 passed
2024-10-28 02:04:09,405 - DEBUG - [Pod Pod ctest-pod-81144808] Cmd output: ctest-pod-41047003
Connecting to 10.99.198.245:80 (10.99.198.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-28 02:04:09,471 - DEBUG - [Pod ctest-pod-81144808] Cmd: wget http://10.99.198.245:80/ -O - -T 5 -t 1 , Output: ctest-pod-48857856
Connecting to 10.99.198.245:80 (10.99.198.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-28 02:04:09,471 - DEBUG - [Pod Pod ctest-pod-81144808] Cmd wget http://10.99.198.245:80/ -O - -T 5 -t 1 passed
2024-10-28 02:04:09,471 - DEBUG - [Pod Pod ctest-pod-81144808] Cmd output: ctest-pod-48857856
Connecting to 10.99.198.245:80 (10.99.198.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-28 02:04:09,471 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-48857856': 1, 'ctest-pod-41047003': 1}
2024-10-28 02:04:14,523 - DEBUG - [Pod ctest-pod-84053637] Cmd: wget http://10.99.198.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:04:14,523 - DEBUG - [Pod Pod ctest-pod-84053637] Cmd wget http://10.99.198.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:04:14,523 - DEBUG - [Pod Pod ctest-pod-84053637] Cmd output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:04:19,577 - DEBUG - [Pod ctest-pod-84053637] Cmd: wget http://10.99.198.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:04:19,577 - DEBUG - [Pod Pod ctest-pod-84053637] Cmd wget http://10.99.198.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:04:19,578 - DEBUG - [Pod Pod ctest-pod-84053637] Cmd output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:04:24,631 - DEBUG - [Pod ctest-pod-84053637] Cmd: wget http://10.99.198.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:04:24,631 - DEBUG - [Pod Pod ctest-pod-84053637] Cmd wget http://10.99.198.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:04:24,631 - DEBUG - [Pod Pod ctest-pod-84053637] Cmd output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:04:29,695 - DEBUG - [Pod ctest-pod-84053637] Cmd: wget http://10.99.198.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:04:29,695 - DEBUG - [Pod Pod ctest-pod-84053637] Cmd wget http://10.99.198.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:04:29,695 - DEBUG - [Pod Pod ctest-pod-84053637] Cmd output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:04:34,760 - DEBUG - [Pod ctest-pod-84053637] Cmd: wget http://10.99.198.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:04:34,760 - DEBUG - [Pod Pod ctest-pod-84053637] Cmd wget http://10.99.198.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:04:34,760 - DEBUG - [Pod Pod ctest-pod-84053637] Cmd output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:04:39,823 - DEBUG - [Pod ctest-pod-84053637] Cmd: wget http://10.99.198.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:04:39,824 - DEBUG - [Pod Pod ctest-pod-84053637] Cmd wget http://10.99.198.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:04:39,824 - DEBUG - [Pod Pod ctest-pod-84053637] Cmd output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:04:44,884 - DEBUG - [Pod ctest-pod-84053637] Cmd: wget http://10.99.198.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:04:44,884 - DEBUG - [Pod Pod ctest-pod-84053637] Cmd wget http://10.99.198.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:04:44,884 - DEBUG - [Pod Pod ctest-pod-84053637] Cmd output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:04:49,937 - DEBUG - [Pod ctest-pod-84053637] Cmd: wget http://10.99.198.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:04:49,937 - DEBUG - [Pod Pod ctest-pod-84053637] Cmd wget http://10.99.198.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:04:49,937 - DEBUG - [Pod Pod ctest-pod-84053637] Cmd output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:04:54,998 - DEBUG - [Pod ctest-pod-84053637] Cmd: wget http://10.99.198.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:04:54,998 - DEBUG - [Pod Pod ctest-pod-84053637] Cmd wget http://10.99.198.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:04:54,998 - DEBUG - [Pod Pod ctest-pod-84053637] Cmd output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:05:00,068 - DEBUG - [Pod ctest-pod-84053637] Cmd: wget http://10.99.198.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:05:00,068 - DEBUG - [Pod Pod ctest-pod-84053637] Cmd wget http://10.99.198.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:05:00,068 - DEBUG - [Pod Pod ctest-pod-84053637] Cmd output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:05:00,068 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-48857856': 0, 'ctest-pod-41047003': 0}
2024-10-28 02:05:02,127 - DEBUG - [Pod ctest-pod-81144808] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=2.437 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.071 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.079 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.071/0.862/2.437 ms
2024-10-28 02:05:02,127 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-81144808 with expectation True passed
2024-10-28 02:05:04,185 - DEBUG - [Pod ctest-pod-07714162] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.401 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.090 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.070/0.520/1.401 ms
2024-10-28 02:05:04,185 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-07714162 with expectation True passed
2024-10-28 02:05:06,246 - DEBUG - [Pod ctest-pod-84053637] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.234 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.069 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.077 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.069/0.460/1.234 ms
2024-10-28 02:05:06,246 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-84053637 with expectation True passed
2024-10-28 02:05:06,308 - DEBUG - [Pod ctest-pod-81144808] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-28 02:05:06,308 - DEBUG - [Pod Pod ctest-pod-81144808] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-10-28 02:05:06,308 - DEBUG - [Pod Pod ctest-pod-81144808] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-28 02:05:06,308 - INFO - wget check of of http://10.47.255.251 from ctest-pod-81144808 passed
2024-10-28 02:05:06,364 - DEBUG - [Pod ctest-pod-81144808] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-28 02:05:06,365 - DEBUG - [Pod Pod ctest-pod-81144808] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-10-28 02:05:06,365 - DEBUG - [Pod Pod ctest-pod-81144808] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-28 02:05:06,365 - INFO - wget check of of http://10.47.255.250 from ctest-pod-81144808 passed
2024-10-28 02:05:11,433 - DEBUG - [Pod ctest-pod-07714162] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-10-28 02:05:11,433 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-10-28 02:05:11,433 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-10-28 02:05:11,433 - INFO - wget check of of http://10.47.255.250 from ctest-pod-07714162 passed
2024-10-28 02:05:16,505 - DEBUG - [Pod ctest-pod-68839449] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-10-28 02:05:16,505 - DEBUG - [Pod Pod ctest-pod-68839449] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-10-28 02:05:16,505 - DEBUG - [Pod Pod ctest-pod-68839449] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-10-28 02:05:16,505 - INFO - wget check of of http://10.47.255.251 from ctest-pod-68839449 passed
2024-10-28 02:05:16,513 - INFO - Updating Network Policy ingress-on-service
2024-10-28 02:05:21,584 - DEBUG - [Pod ctest-pod-07714162] Cmd: wget http://10.99.198.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:05:21,584 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd wget http://10.99.198.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:05:21,584 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:05:26,667 - DEBUG - [Pod ctest-pod-07714162] Cmd: wget http://10.99.198.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:05:26,667 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd wget http://10.99.198.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:05:26,667 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:05:31,720 - DEBUG - [Pod ctest-pod-07714162] Cmd: wget http://10.99.198.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:05:31,720 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd wget http://10.99.198.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:05:31,720 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:05:36,790 - DEBUG - [Pod ctest-pod-07714162] Cmd: wget http://10.99.198.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:05:36,790 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd wget http://10.99.198.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:05:36,790 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:05:41,858 - DEBUG - [Pod ctest-pod-07714162] Cmd: wget http://10.99.198.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:05:41,858 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd wget http://10.99.198.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:05:41,858 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:05:46,919 - DEBUG - [Pod ctest-pod-07714162] Cmd: wget http://10.99.198.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:05:46,920 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd wget http://10.99.198.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:05:46,920 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:05:51,975 - DEBUG - [Pod ctest-pod-07714162] Cmd: wget http://10.99.198.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:05:51,976 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd wget http://10.99.198.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:05:51,976 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:05:57,026 - DEBUG - [Pod ctest-pod-07714162] Cmd: wget http://10.99.198.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:05:57,026 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd wget http://10.99.198.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:05:57,026 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:06:02,080 - DEBUG - [Pod ctest-pod-07714162] Cmd: wget http://10.99.198.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:06:02,080 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd wget http://10.99.198.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:06:02,080 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:06:07,157 - DEBUG - [Pod ctest-pod-07714162] Cmd: wget http://10.99.198.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:06:07,157 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd wget http://10.99.198.245:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:06:07,157 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
wget: download timed out
2024-10-28 02:06:07,157 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-48857856': 0, 'ctest-pod-41047003': 0}
2024-10-28 02:06:07,212 - DEBUG - [Pod ctest-pod-81144808] Cmd: wget http://10.99.198.245:80/ -O - -T 5 -t 1 , Output: ctest-pod-41047003
Connecting to 10.99.198.245:80 (10.99.198.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-28 02:06:07,212 - DEBUG - [Pod Pod ctest-pod-81144808] Cmd wget http://10.99.198.245:80/ -O - -T 5 -t 1 passed
2024-10-28 02:06:07,212 - DEBUG - [Pod Pod ctest-pod-81144808] Cmd output: ctest-pod-41047003
Connecting to 10.99.198.245:80 (10.99.198.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-28 02:06:07,263 - DEBUG - [Pod ctest-pod-81144808] Cmd: wget http://10.99.198.245:80/ -O - -T 5 -t 1 , Output: ctest-pod-48857856
Connecting to 10.99.198.245:80 (10.99.198.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-28 02:06:07,263 - DEBUG - [Pod Pod ctest-pod-81144808] Cmd wget http://10.99.198.245:80/ -O - -T 5 -t 1 passed
2024-10-28 02:06:07,263 - DEBUG - [Pod Pod ctest-pod-81144808] Cmd output: ctest-pod-48857856
Connecting to 10.99.198.245:80 (10.99.198.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-28 02:06:07,263 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-48857856': 1, 'ctest-pod-41047003': 1}
2024-10-28 02:06:07,320 - DEBUG - [Pod ctest-pod-84053637] Cmd: wget http://10.99.198.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-48857856
2024-10-28 02:06:07,320 - DEBUG - [Pod Pod ctest-pod-84053637] Cmd wget http://10.99.198.245:80/ -O - -T 5 -t 1 passed
2024-10-28 02:06:07,320 - DEBUG - [Pod Pod ctest-pod-84053637] Cmd output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-48857856
2024-10-28 02:06:07,389 - DEBUG - [Pod ctest-pod-84053637] Cmd: wget http://10.99.198.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
ctest-pod-48857856
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-28 02:06:07,389 - DEBUG - [Pod Pod ctest-pod-84053637] Cmd wget http://10.99.198.245:80/ -O - -T 5 -t 1 passed
2024-10-28 02:06:07,389 - DEBUG - [Pod Pod ctest-pod-84053637] Cmd output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
ctest-pod-48857856
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-10-28 02:06:07,465 - DEBUG - [Pod ctest-pod-84053637] Cmd: wget http://10.99.198.245:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-41047003
2024-10-28 02:06:07,466 - DEBUG - [Pod Pod ctest-pod-84053637] Cmd wget http://10.99.198.245:80/ -O - -T 5 -t 1 passed
2024-10-28 02:06:07,466 - DEBUG - [Pod Pod ctest-pod-84053637] Cmd output: Connecting to 10.99.198.245:80 (10.99.198.245:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-41047003
2024-10-28 02:06:07,466 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-48857856': 2, 'ctest-pod-41047003': 1}
2024-10-28 02:06:09,536 - DEBUG - [Pod ctest-pod-81144808] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.619 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.073 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.109 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.073/0.267/0.619 ms
2024-10-28 02:06:09,537 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-81144808 with expectation True passed
2024-10-28 02:06:11,610 - DEBUG - [Pod ctest-pod-07714162] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.820 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.072 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.102 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.072/0.331/0.820 ms
2024-10-28 02:06:11,610 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-07714162 with expectation True passed
2024-10-28 02:06:13,666 - DEBUG - [Pod ctest-pod-84053637] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.884 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.073 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.067 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.067/0.341/0.884 ms
2024-10-28 02:06:13,667 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-84053637 with expectation True passed
2024-10-28 02:06:13,730 - DEBUG - [Pod ctest-pod-81144808] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-28 02:06:13,730 - DEBUG - [Pod Pod ctest-pod-81144808] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-10-28 02:06:13,730 - DEBUG - [Pod Pod ctest-pod-81144808] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-28 02:06:13,730 - INFO - wget check of of http://10.47.255.251 from ctest-pod-81144808 passed
2024-10-28 02:06:13,799 - DEBUG - [Pod ctest-pod-81144808] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-28 02:06:13,799 - DEBUG - [Pod Pod ctest-pod-81144808] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-10-28 02:06:13,799 - DEBUG - [Pod Pod ctest-pod-81144808] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-28 02:06:13,799 - INFO - wget check of of http://10.47.255.250 from ctest-pod-81144808 passed
2024-10-28 02:06:18,865 - DEBUG - [Pod ctest-pod-07714162] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-10-28 02:06:18,865 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-10-28 02:06:18,865 - DEBUG - [Pod Pod ctest-pod-07714162] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-10-28 02:06:18,865 - INFO - wget check of of http://10.47.255.250 from ctest-pod-07714162 passed
2024-10-28 02:06:18,926 - DEBUG - [Pod ctest-pod-68839449] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-28 02:06:18,926 - DEBUG - [Pod Pod ctest-pod-68839449] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-10-28 02:06:18,926 - DEBUG - [Pod Pod ctest-pod-68839449] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-10-28 02:06:18,926 - INFO - wget check of of http://10.47.255.251 from ctest-pod-68839449 passed
2024-10-28 02:06:18,927 - INFO - Deleting Network Policy : ingress-on-service
2024-10-28 02:06:18,927 - INFO - Deleting service : ctest-nginx-svc-57239763
2024-10-28 02:06:19,180 - DEBUG - No XMPP flaps were noticed during the test
2024-10-28 02:06:19,180 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:06]
2024-10-28 02:06:19,180 - INFO - --------------------------------------------------------------------------------
2024-10-28 02:06:19,186 - INFO - Deleting pod ctest-new-default-02706129:ctest-pod-48857856
2024-10-28 02:06:19,187 - INFO - Deleting pod ctest-new-default-02706129:ctest-pod-41047003
2024-10-28 02:06:19,188 - INFO - Deleting pod ctest-non-default-62709788:ctest-pod-24730131
2024-10-28 02:06:19,188 - INFO - Deleting pod ctest-non-default-62709788:ctest-pod-15778048
2024-10-28 02:06:19,188 - INFO - Deleting pod ctest-new-default-02706129:ctest-pod-07714162
2024-10-28 02:06:19,189 - INFO - Deleting pod ctest-new-default-02706129:ctest-pod-81144808
2024-10-28 02:06:19,189 - INFO - Deleting pod ctest-non-default-62709788:ctest-pod-84053637
2024-10-28 02:06:19,189 - INFO - Deleting pod ctest-non-default-62709788:ctest-pod-68839449
2024-10-28 02:06:19,443 - WARNING - Pod uuid 6badc876-d237-4866-9b42-125cc08e8789 is still seen in agent 10.0.0.27 VM list
2024-10-28 02:06:19,448 - WARNING - Pod uuid 033108e9-53bd-41ed-bcce-dae8a138f063 is still seen in agent 10.0.0.27 VM list
2024-10-28 02:06:19,449 - WARNING - Pod uuid c87c2a24-a0c5-4c68-a594-fe8db04b597d is still seen in agent 10.0.0.27 VM list
2024-10-28 02:06:19,449 - WARNING - Pod uuid 2164f122-695a-4341-86ca-09ec2e2a47f0 is still seen in agent 10.0.0.27 VM list
2024-10-28 02:06:19,449 - WARNING - Pod uuid d99d545a-d7c0-4154-a718-f8b3bc6028e3 is still seen in agent 10.0.0.27 VM list
2024-10-28 02:06:19,450 - WARNING - Pod uuid 4cbacf55-a790-4971-9232-3cbfb4768507 is still seen in agent 10.0.0.27 VM list
2024-10-28 02:06:19,450 - WARNING - Pod uuid 657aba01-6c98-4834-8fb9-c14dbb4d7de7 is still seen in agent 10.0.0.27 VM list
2024-10-28 02:06:19,450 - WARNING - Pod uuid 1e301b50-ef97-4c66-9fb2-ec6d54daca0f is still seen in agent 10.0.0.27 VM list
2024-10-28 02:06:24,461 - WARNING - Pod uuid 6badc876-d237-4866-9b42-125cc08e8789 is still seen in agent 10.0.0.27 VM list
2024-10-28 02:06:24,478 - WARNING - Pod uuid d99d545a-d7c0-4154-a718-f8b3bc6028e3 is still seen in agent 10.0.0.27 VM list
2024-10-28 02:06:24,479 - DEBUG - Pod 2164f122-695a-4341-86ca-09ec2e2a47f0 is not in agent 10.0.0.27 VM list
2024-10-28 02:06:24,483 - WARNING - Pod uuid 1e301b50-ef97-4c66-9fb2-ec6d54daca0f is still seen in agent 10.0.0.27 VM list
2024-10-28 02:06:24,483 - WARNING - Pod uuid 657aba01-6c98-4834-8fb9-c14dbb4d7de7 is still seen in agent 10.0.0.27 VM list
2024-10-28 02:06:24,483 - DEBUG - Pod 4cbacf55-a790-4971-9232-3cbfb4768507 is not in agent 10.0.0.27 VM list
2024-10-28 02:06:24,485 - DEBUG - Pod c87c2a24-a0c5-4c68-a594-fe8db04b597d is not in agent 10.0.0.27 VM list
2024-10-28 02:06:24,486 - DEBUG - Pod 033108e9-53bd-41ed-bcce-dae8a138f063 is not in agent 10.0.0.27 VM list
2024-10-28 02:06:24,501 - DEBUG - VMI bfb8eafa-94d0-11ef-b36a-fa163e8c8802 is removed from agent 10.0.0.27
2024-10-28 02:06:24,501 - INFO - Verified that pod ctest-pod-24730131 is removed in agent
2024-10-28 02:06:24,502 - DEBUG - VMI befb28d0-94d0-11ef-b36a-fa163e8c8802 is removed from agent 10.0.0.27
2024-10-28 02:06:24,502 - INFO - Verified that pod ctest-pod-41047003 is removed in agent
2024-10-28 02:06:24,503 - DEBUG - VMI be73b742-94d0-11ef-b36a-fa163e8c8802 is removed from agent 10.0.0.27
2024-10-28 02:06:24,503 - INFO - Verified that pod ctest-pod-48857856 is removed in agent
2024-10-28 02:06:24,503 - DEBUG - VMI c03d7464-94d0-11ef-b36a-fa163e8c8802 is removed from agent 10.0.0.27
2024-10-28 02:06:24,504 - INFO - Verified that pod ctest-pod-15778048 is removed in agent
2024-10-28 02:06:29,469 - WARNING - Pod uuid 6badc876-d237-4866-9b42-125cc08e8789 is still seen in agent 10.0.0.27 VM list
2024-10-28 02:06:29,488 - WARNING - Pod uuid d99d545a-d7c0-4154-a718-f8b3bc6028e3 is still seen in agent 10.0.0.27 VM list
2024-10-28 02:06:29,496 - WARNING - Pod uuid 1e301b50-ef97-4c66-9fb2-ec6d54daca0f is still seen in agent 10.0.0.27 VM list
2024-10-28 02:06:29,496 - WARNING - Pod uuid 657aba01-6c98-4834-8fb9-c14dbb4d7de7 is still seen in agent 10.0.0.27 VM list
2024-10-28 02:06:34,478 - WARNING - Pod uuid 6badc876-d237-4866-9b42-125cc08e8789 is still seen in agent 10.0.0.27 VM list
2024-10-28 02:06:34,496 - WARNING - Pod uuid d99d545a-d7c0-4154-a718-f8b3bc6028e3 is still seen in agent 10.0.0.27 VM list
2024-10-28 02:06:34,507 - WARNING - Pod uuid 1e301b50-ef97-4c66-9fb2-ec6d54daca0f is still seen in agent 10.0.0.27 VM list
2024-10-28 02:06:34,508 - WARNING - Pod uuid 657aba01-6c98-4834-8fb9-c14dbb4d7de7 is still seen in agent 10.0.0.27 VM list
2024-10-28 02:06:39,492 - WARNING - Pod uuid 6badc876-d237-4866-9b42-125cc08e8789 is still seen in agent 10.0.0.27 VM list
2024-10-28 02:06:39,504 - WARNING - Pod uuid d99d545a-d7c0-4154-a718-f8b3bc6028e3 is still seen in agent 10.0.0.27 VM list
2024-10-28 02:06:39,519 - WARNING - Pod uuid 657aba01-6c98-4834-8fb9-c14dbb4d7de7 is still seen in agent 10.0.0.27 VM list
2024-10-28 02:06:39,521 - WARNING - Pod uuid 1e301b50-ef97-4c66-9fb2-ec6d54daca0f is still seen in agent 10.0.0.27 VM list
2024-10-28 02:06:44,501 - WARNING - Pod uuid 6badc876-d237-4866-9b42-125cc08e8789 is still seen in agent 10.0.0.27 VM list
2024-10-28 02:06:44,513 - WARNING - Pod uuid d99d545a-d7c0-4154-a718-f8b3bc6028e3 is still seen in agent 10.0.0.27 VM list
2024-10-28 02:06:44,532 - WARNING - Pod uuid 657aba01-6c98-4834-8fb9-c14dbb4d7de7 is still seen in agent 10.0.0.27 VM list
2024-10-28 02:06:44,532 - WARNING - Pod uuid 1e301b50-ef97-4c66-9fb2-ec6d54daca0f is still seen in agent 10.0.0.27 VM list
2024-10-28 02:06:49,548 - WARNING - Pod uuid d99d545a-d7c0-4154-a718-f8b3bc6028e3 is still seen in agent 10.0.0.27 VM list
2024-10-28 02:06:49,549 - WARNING - Pod uuid 6badc876-d237-4866-9b42-125cc08e8789 is still seen in agent 10.0.0.27 VM list
2024-10-28 02:06:49,550 - WARNING - Pod uuid 1e301b50-ef97-4c66-9fb2-ec6d54daca0f is still seen in agent 10.0.0.27 VM list
2024-10-28 02:06:49,550 - WARNING - Pod uuid 657aba01-6c98-4834-8fb9-c14dbb4d7de7 is still seen in agent 10.0.0.27 VM list
2024-10-28 02:06:54,568 - DEBUG - Pod d99d545a-d7c0-4154-a718-f8b3bc6028e3 is not in agent 10.0.0.27 VM list
2024-10-28 02:06:54,572 - DEBUG - Pod 1e301b50-ef97-4c66-9fb2-ec6d54daca0f is not in agent 10.0.0.27 VM list
2024-10-28 02:06:54,574 - DEBUG - Pod 657aba01-6c98-4834-8fb9-c14dbb4d7de7 is not in agent 10.0.0.27 VM list
2024-10-28 02:06:54,576 - DEBUG - Pod 6badc876-d237-4866-9b42-125cc08e8789 is not in agent 10.0.0.27 VM list
2024-10-28 02:06:54,590 - DEBUG - VMI c0e0a904-94d0-11ef-b36a-fa163e8c8802 is removed from agent 10.0.0.27
2024-10-28 02:06:54,590 - INFO - Verified that pod ctest-pod-07714162 is removed in agent
2024-10-28 02:06:54,590 - DEBUG - VMI c269041a-94d0-11ef-b36a-fa163e8c8802 is removed from agent 10.0.0.27
2024-10-28 02:06:54,590 - INFO - Verified that pod ctest-pod-68839449 is removed in agent
2024-10-28 02:06:54,591 - DEBUG - VMI c1e9ace2-94d0-11ef-b36a-fa163e8c8802 is removed from agent 10.0.0.27
2024-10-28 02:06:54,591 - INFO - Verified that pod ctest-pod-84053637 is removed in agent
2024-10-28 02:06:54,592 - DEBUG - VMI c1639f44-94d0-11ef-b36a-fa163e8c8802 is removed from agent 10.0.0.27
2024-10-28 02:06:54,592 - INFO - Verified that pod ctest-pod-81144808 is removed in agent
2024-10-28 02:06:54,592 - INFO - Deleting namespace ctest-non-default-62709788
2024-10-28 02:06:54,609 - DEBUG - Namespace ctest-non-default-62709788 still in k8s
2024-10-28 02:06:56,618 - DEBUG - Namespace ctest-non-default-62709788 still in k8s
2024-10-28 02:06:58,623 - DEBUG - Namespace ctest-non-default-62709788 still in k8s
2024-10-28 02:07:00,627 - DEBUG - Namespace ctest-non-default-62709788 is not in k8s
2024-10-28 02:07:00,627 - DEBUG - No need to check project deletion in contrail-api
2024-10-28 02:07:00,627 - INFO - Deleting namespace ctest-new-default-02706129
2024-10-28 02:07:00,637 - DEBUG - Namespace ctest-new-default-02706129 still in k8s
2024-10-28 02:07:02,648 - DEBUG - Namespace ctest-new-default-02706129 still in k8s
2024-10-28 02:07:04,653 - DEBUG - Namespace ctest-new-default-02706129 still in k8s
2024-10-28 02:07:06,658 - DEBUG - Namespace ctest-new-default-02706129 is not in k8s
2024-10-28 02:07:06,658 - DEBUG - No need to check project deletion in contrail-api