2024-09-18 02:35:08,665 - INFO - Using existing project ['default-domain', 'k8s-default'](e05c0edc-c352-4ad1-90b2-3710853c5251)
2024-09-18 02:35:08,694 - DEBUG - Namespace ctest-new-default-41319572 not present
2024-09-18 02:35:08,702 - INFO - Created namespace ctest-new-default-41319572
2024-09-18 02:35:11,708 - DEBUG - Namespace ctest-non-default-22326540 not present
2024-09-18 02:35:11,719 - INFO - Created namespace ctest-non-default-22326540
2024-09-18 02:35:14,777 - DEBUG - Pod ctest-pod-18358323 not present
2024-09-18 02:35:14,778 - INFO - Creating Pod ctest-pod-18358323
2024-09-18 02:35:14,805 - DEBUG - Node for Pod ctest-pod-18358323 not yet populated
2024-09-18 02:35:17,812 - DEBUG - Pod : ctest-pod-18358323 UUID is 9b83eef9-3c77-4f1f-b935-fa82c63db370
2024-09-18 02:35:17,815 - DEBUG - Pod ctest-pod-24292437 not present
2024-09-18 02:35:17,815 - INFO - Creating Pod ctest-pod-24292437
2024-09-18 02:35:17,841 - DEBUG - Pod : ctest-pod-24292437 UUID is 7be3621d-5c54-4204-8f43-d6944cdbf99e
2024-09-18 02:35:17,848 - DEBUG - Pod ctest-pod-84426815 not present
2024-09-18 02:35:17,848 - INFO - Creating Pod ctest-pod-84426815
2024-09-18 02:35:17,875 - DEBUG - Pod : ctest-pod-84426815 UUID is 2ff5bfd9-ad4c-4c38-9ce1-756938dd1d23
2024-09-18 02:35:17,877 - DEBUG - Pod ctest-pod-94894299 not present
2024-09-18 02:35:17,878 - INFO - Creating Pod ctest-pod-94894299
2024-09-18 02:35:17,898 - DEBUG - Pod : ctest-pod-94894299 UUID is 1d434e23-e4ba-4145-a0d5-8753acd27518
2024-09-18 02:35:17,900 - DEBUG - Pod ctest-pod-70366422 not present
2024-09-18 02:35:17,900 - INFO - Creating Pod ctest-pod-70366422
2024-09-18 02:35:17,917 - DEBUG - Pod : ctest-pod-70366422 UUID is c800b3ef-369b-4da1-8593-0693a0f6219a
2024-09-18 02:35:17,928 - DEBUG - Pod ctest-pod-97904453 not present
2024-09-18 02:35:17,929 - INFO - Creating Pod ctest-pod-97904453
2024-09-18 02:35:17,955 - DEBUG - Pod : ctest-pod-97904453 UUID is 2702a244-cd3b-4125-bf35-75c3344ad5d8
2024-09-18 02:35:17,958 - DEBUG - Pod ctest-pod-42852892 not present
2024-09-18 02:35:17,958 - INFO - Creating Pod ctest-pod-42852892
2024-09-18 02:35:17,995 - DEBUG - Pod : ctest-pod-42852892 UUID is d02edaec-2db6-4c7e-8827-5df1ddc15b32
2024-09-18 02:35:17,997 - DEBUG - Pod ctest-pod-03424992 not present
2024-09-18 02:35:17,998 - INFO - Creating Pod ctest-pod-03424992
2024-09-18 02:35:18,025 - DEBUG - Pod : ctest-pod-03424992 UUID is ea672723-75ce-4f10-8c68-11ac75dbda85
2024-09-18 02:35:18,268 - INFO - Project default-domain:k8s-ctest-new-default-41319572 for Namespace ctest-new-default-41319572 is seen in contrail-api
2024-09-18 02:35:18,268 - DEBUG - Project uuid in Contrail is e0b9cefd-1577-46f6-b786-92e1b16de398
2024-09-18 02:35:18,429 - DEBUG - Requesting: http://10.0.0.32:8108/Snh_NamespaceDatabaseList?namespace_uuid=5aa0403d-533c-435f-acfa-f375bac5e9fe
2024-09-18 02:35:18,444 - INFO - Namespace ctest-new-default-41319572 with uuid 5aa0403d-533c-435f-acfa-f375bac5e9fe found in kube manager
2024-09-18 02:35:18,444 - INFO - Namespace ctest-new-default-41319572 verification passed
2024-09-18 02:35:18,712 - INFO - Project default-domain:k8s-ctest-non-default-22326540 for Namespace ctest-non-default-22326540 is seen in contrail-api
2024-09-18 02:35:18,712 - DEBUG - Project uuid in Contrail is e947d4e3-0121-43c2-af1b-22563729b590
2024-09-18 02:35:18,712 - DEBUG - Requesting: http://10.0.0.32:8108/Snh_NamespaceDatabaseList?namespace_uuid=f5aa0e9a-42ce-41cf-b86d-1479f5fb492d
2024-09-18 02:35:18,717 - INFO - Namespace ctest-non-default-22326540 with uuid f5aa0e9a-42ce-41cf-b86d-1479f5fb492d found in kube manager
2024-09-18 02:35:18,717 - INFO - Namespace ctest-non-default-22326540 verification passed
2024-09-18 02:35:18,722 - DEBUG - Pod ctest-pod-18358323 not in running state.Currently in Pending
2024-09-18 02:35:23,736 - DEBUG - Pod ctest-pod-18358323 not in running state.Currently in Pending
2024-09-18 02:35:28,751 - INFO - Pod ctest-pod-18358323 is in running state.Got IP 10.47.255.251
2024-09-18 02:35:28,817 - DEBUG - Pod ctest-pod-18358323 has vmi a3bde9e2-7566-11ef-b85a-fa163e213c18
2024-09-18 02:35:28,817 - INFO - Verified pod ctest-pod-18358323 in contrail-api
2024-09-18 02:35:28,830 - DEBUG - VMI a3bde9e2-7566-11ef-b85a-fa163e213c18 is active in agent 10.0.0.66
2024-09-18 02:35:28,831 - INFO - Verified Pod ctest-pod-18358323 in agent 10.0.0.66
2024-09-18 02:35:28,831 - DEBUG - Requesting: http://10.0.0.32:8108/Snh_VirtualMachineDatabaseList?x=9b83eef9-3c77-4f1f-b935-fa82c63db370
2024-09-18 02:35:28,836 - INFO - Pod ctest-pod-18358323 with uuid 9b83eef9-3c77-4f1f-b935-fa82c63db370 found in kube manager
2024-09-18 02:35:28,836 - INFO - Pod ctest-pod-18358323 verification passed
2024-09-18 02:35:28,841 - INFO - Pod ctest-pod-24292437 is in running state.Got IP 10.47.255.250
2024-09-18 02:35:28,861 - DEBUG - Pod ctest-pod-24292437 has vmi a4a2b5a4-7566-11ef-b85a-fa163e213c18
2024-09-18 02:35:28,861 - INFO - Verified pod ctest-pod-24292437 in contrail-api
2024-09-18 02:35:28,873 - DEBUG - VMI a4a2b5a4-7566-11ef-b85a-fa163e213c18 is active in agent 10.0.0.66
2024-09-18 02:35:28,874 - INFO - Verified Pod ctest-pod-24292437 in agent 10.0.0.66
2024-09-18 02:35:28,875 - DEBUG - Requesting: http://10.0.0.32:8108/Snh_VirtualMachineDatabaseList?x=7be3621d-5c54-4204-8f43-d6944cdbf99e
2024-09-18 02:35:28,880 - INFO - Pod ctest-pod-24292437 with uuid 7be3621d-5c54-4204-8f43-d6944cdbf99e found in kube manager
2024-09-18 02:35:28,880 - INFO - Pod ctest-pod-24292437 verification passed
2024-09-18 02:35:28,885 - INFO - Pod ctest-pod-84426815 is in running state.Got IP 10.47.255.249
2024-09-18 02:35:28,946 - DEBUG - Pod ctest-pod-84426815 has vmi a575a6da-7566-11ef-b85a-fa163e213c18
2024-09-18 02:35:28,946 - INFO - Verified pod ctest-pod-84426815 in contrail-api
2024-09-18 02:35:28,961 - DEBUG - VMI a575a6da-7566-11ef-b85a-fa163e213c18 is active in agent 10.0.0.66
2024-09-18 02:35:28,961 - INFO - Verified Pod ctest-pod-84426815 in agent 10.0.0.66
2024-09-18 02:35:28,962 - DEBUG - Requesting: http://10.0.0.32:8108/Snh_VirtualMachineDatabaseList?x=2ff5bfd9-ad4c-4c38-9ce1-756938dd1d23
2024-09-18 02:35:28,967 - INFO - Pod ctest-pod-84426815 with uuid 2ff5bfd9-ad4c-4c38-9ce1-756938dd1d23 found in kube manager
2024-09-18 02:35:28,967 - INFO - Pod ctest-pod-84426815 verification passed
2024-09-18 02:35:28,974 - DEBUG - Pod ctest-pod-94894299 not in running state.Currently in Pending
2024-09-18 02:35:33,983 - INFO - Pod ctest-pod-94894299 is in running state.Got IP 10.47.255.248
2024-09-18 02:35:34,009 - DEBUG - Pod ctest-pod-94894299 has vmi a6046122-7566-11ef-b85a-fa163e213c18
2024-09-18 02:35:34,010 - INFO - Verified pod ctest-pod-94894299 in contrail-api
2024-09-18 02:35:34,023 - DEBUG - VMI a6046122-7566-11ef-b85a-fa163e213c18 is active in agent 10.0.0.66
2024-09-18 02:35:34,023 - INFO - Verified Pod ctest-pod-94894299 in agent 10.0.0.66
2024-09-18 02:35:34,024 - DEBUG - Requesting: http://10.0.0.32:8108/Snh_VirtualMachineDatabaseList?x=1d434e23-e4ba-4145-a0d5-8753acd27518
2024-09-18 02:35:34,029 - INFO - Pod ctest-pod-94894299 with uuid 1d434e23-e4ba-4145-a0d5-8753acd27518 found in kube manager
2024-09-18 02:35:34,030 - INFO - Pod ctest-pod-94894299 verification passed
2024-09-18 02:35:34,034 - INFO - Pod ctest-pod-70366422 is in running state.Got IP 10.47.255.247
2024-09-18 02:35:34,097 - DEBUG - Pod ctest-pod-70366422 has vmi a69dc998-7566-11ef-b85a-fa163e213c18
2024-09-18 02:35:34,097 - INFO - Verified pod ctest-pod-70366422 in contrail-api
2024-09-18 02:35:34,113 - DEBUG - VMI a69dc998-7566-11ef-b85a-fa163e213c18 is active in agent 10.0.0.66
2024-09-18 02:35:34,114 - INFO - Verified Pod ctest-pod-70366422 in agent 10.0.0.66
2024-09-18 02:35:34,114 - DEBUG - Requesting: http://10.0.0.32:8108/Snh_VirtualMachineDatabaseList?x=c800b3ef-369b-4da1-8593-0693a0f6219a
2024-09-18 02:35:34,119 - INFO - Pod ctest-pod-70366422 with uuid c800b3ef-369b-4da1-8593-0693a0f6219a found in kube manager
2024-09-18 02:35:34,119 - INFO - Pod ctest-pod-70366422 verification passed
2024-09-18 02:35:34,126 - INFO - Pod ctest-pod-42852892 is in running state.Got IP 10.47.255.245
2024-09-18 02:35:34,189 - DEBUG - Pod ctest-pod-42852892 has vmi a7b2e692-7566-11ef-b85a-fa163e213c18
2024-09-18 02:35:34,189 - INFO - Verified pod ctest-pod-42852892 in contrail-api
2024-09-18 02:35:34,204 - DEBUG - VMI a7b2e692-7566-11ef-b85a-fa163e213c18 is active in agent 10.0.0.66
2024-09-18 02:35:34,204 - INFO - Verified Pod ctest-pod-42852892 in agent 10.0.0.66
2024-09-18 02:35:34,204 - DEBUG - Requesting: http://10.0.0.32:8108/Snh_VirtualMachineDatabaseList?x=d02edaec-2db6-4c7e-8827-5df1ddc15b32
2024-09-18 02:35:34,209 - INFO - Pod ctest-pod-42852892 with uuid d02edaec-2db6-4c7e-8827-5df1ddc15b32 found in kube manager
2024-09-18 02:35:34,209 - INFO - Pod ctest-pod-42852892 verification passed
2024-09-18 02:35:34,214 - INFO - Pod ctest-pod-97904453 is in running state.Got IP 10.47.255.246
2024-09-18 02:35:34,232 - DEBUG - Pod ctest-pod-97904453 has vmi a72e3eba-7566-11ef-b85a-fa163e213c18
2024-09-18 02:35:34,232 - INFO - Verified pod ctest-pod-97904453 in contrail-api
2024-09-18 02:35:34,245 - DEBUG - VMI a72e3eba-7566-11ef-b85a-fa163e213c18 is active in agent 10.0.0.66
2024-09-18 02:35:34,245 - INFO - Verified Pod ctest-pod-97904453 in agent 10.0.0.66
2024-09-18 02:35:34,246 - DEBUG - Requesting: http://10.0.0.32:8108/Snh_VirtualMachineDatabaseList?x=2702a244-cd3b-4125-bf35-75c3344ad5d8
2024-09-18 02:35:34,250 - INFO - Pod ctest-pod-97904453 with uuid 2702a244-cd3b-4125-bf35-75c3344ad5d8 found in kube manager
2024-09-18 02:35:34,250 - INFO - Pod ctest-pod-97904453 verification passed
2024-09-18 02:35:34,255 - DEBUG - Pod ctest-pod-03424992 not in running state.Currently in Pending
2024-09-18 02:35:39,262 - INFO - Pod ctest-pod-03424992 is in running state.Got IP 10.47.255.244
2024-09-18 02:35:39,329 - DEBUG - Pod ctest-pod-03424992 has vmi a8383914-7566-11ef-b85a-fa163e213c18
2024-09-18 02:35:39,329 - INFO - Verified pod ctest-pod-03424992 in contrail-api
2024-09-18 02:35:39,347 - DEBUG - VMI a8383914-7566-11ef-b85a-fa163e213c18 is active in agent 10.0.0.66
2024-09-18 02:35:39,347 - INFO - Verified Pod ctest-pod-03424992 in agent 10.0.0.66
2024-09-18 02:35:39,347 - DEBUG - Requesting: http://10.0.0.32:8108/Snh_VirtualMachineDatabaseList?x=ea672723-75ce-4f10-8c68-11ac75dbda85
2024-09-18 02:35:39,354 - INFO - Pod ctest-pod-03424992 with uuid ea672723-75ce-4f10-8c68-11ac75dbda85 found in kube manager
2024-09-18 02:35:39,354 - INFO - Pod ctest-pod-03424992 verification passed
2024-09-18 02:35:39,354 - INFO - ================================================================================
2024-09-18 02:35:39,354 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2024-09-18 02:35:39,354 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2024-09-18 02:35:39,608 - DEBUG - Nothing to compare xmpp stats {'10.0.0.66': {'10.0.0.32': '0'}} with
2024-09-18 02:35:39,608 - INFO - Initial checks done. Running the testcase now
2024-09-18 02:35:39,608 - INFO -
2024-09-18 02:35:39,664 - DEBUG - [Pod ctest-pod-18358323] Cmd: echo ctest-pod-18358323 > /usr/share/nginx/html/index.html, Output:
2024-09-18 02:35:39,719 - DEBUG - [Pod ctest-pod-24292437] Cmd: echo ctest-pod-24292437 > /usr/share/nginx/html/index.html, Output:
2024-09-18 02:35:39,785 - DEBUG - [Pod ctest-pod-84426815] Cmd: echo ctest-pod-84426815 > /usr/share/nginx/html/index.html, Output:
2024-09-18 02:35:39,835 - DEBUG - [Pod ctest-pod-94894299] Cmd: echo ctest-pod-94894299 > /usr/share/nginx/html/index.html, Output:
2024-09-18 02:35:39,838 - DEBUG - Service ctest-nginx-svc-88653459 not present
2024-09-18 02:35:39,838 - INFO - Creating service ctest-nginx-svc-88653459
2024-09-18 02:35:39,853 - INFO - Created Service ctest-nginx-svc-88653459
2024-09-18 02:35:39,863 - WARNING - Service UUID 7492ad60-d402-4246-aa4d-bc7489cde687 not yet found in contrail-api
2024-09-18 02:35:40,871 - INFO - Validated that Service ctest-nginx-svc-88653459 is seen in contrail-api
2024-09-18 02:35:40,872 - DEBUG - Requesting: http://10.0.0.32:8108/Snh_LoadbalancerDatabaseList?x=7492ad60-d402-4246-aa4d-bc7489cde687
2024-09-18 02:35:40,876 - INFO - Service ctest-nginx-svc-88653459 with uuid 7492ad60-d402-4246-aa4d-bc7489cde687 found in kube manager
2024-09-18 02:35:40,876 - INFO - Service ctest-nginx-svc-88653459 verification passed
2024-09-18 02:35:41,946 - DEBUG - [Pod ctest-pod-70366422] Cmd: wget http://10.102.78.0:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-24292437
2024-09-18 02:35:41,946 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd wget http://10.102.78.0:80/ -O - -T 5 -t 1 passed
2024-09-18 02:35:41,946 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-24292437
2024-09-18 02:35:42,016 - DEBUG - [Pod ctest-pod-70366422] Cmd: wget http://10.102.78.0:80/ -O - -T 5 -t 1 , Output: ctest-pod-18358323
Connecting to 10.102.78.0:80 (10.102.78.0:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 02:35:42,016 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd wget http://10.102.78.0:80/ -O - -T 5 -t 1 passed
2024-09-18 02:35:42,016 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd output: ctest-pod-18358323
Connecting to 10.102.78.0:80 (10.102.78.0:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 02:35:42,016 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-18358323': 1, 'ctest-pod-24292437': 1}
2024-09-18 02:35:42,069 - DEBUG - [Pod ctest-pod-42852892] Cmd: wget http://10.102.78.0:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-18358323
2024-09-18 02:35:42,069 - DEBUG - [Pod Pod ctest-pod-42852892] Cmd wget http://10.102.78.0:80/ -O - -T 5 -t 1 passed
2024-09-18 02:35:42,069 - DEBUG - [Pod Pod ctest-pod-42852892] Cmd output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-18358323
2024-09-18 02:35:42,136 - DEBUG - [Pod ctest-pod-42852892] Cmd: wget http://10.102.78.0:80/ -O - -T 5 -t 1 , Output: ctest-pod-18358323
Connecting to 10.102.78.0:80 (10.102.78.0:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 02:35:42,136 - DEBUG - [Pod Pod ctest-pod-42852892] Cmd wget http://10.102.78.0:80/ -O - -T 5 -t 1 passed
2024-09-18 02:35:42,136 - DEBUG - [Pod Pod ctest-pod-42852892] Cmd output: ctest-pod-18358323
Connecting to 10.102.78.0:80 (10.102.78.0:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 02:35:42,195 - DEBUG - [Pod ctest-pod-42852892] Cmd: wget http://10.102.78.0:80/ -O - -T 5 -t 1 , Output: ctest-pod-18358323
Connecting to 10.102.78.0:80 (10.102.78.0:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 02:35:42,195 - DEBUG - [Pod Pod ctest-pod-42852892] Cmd wget http://10.102.78.0:80/ -O - -T 5 -t 1 passed
2024-09-18 02:35:42,195 - DEBUG - [Pod Pod ctest-pod-42852892] Cmd output: ctest-pod-18358323
Connecting to 10.102.78.0:80 (10.102.78.0:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 02:35:42,261 - DEBUG - [Pod ctest-pod-42852892] Cmd: wget http://10.102.78.0:80/ -O - -T 5 -t 1 , Output: ctest-pod-18358323
Connecting to 10.102.78.0:80 (10.102.78.0:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 02:35:42,261 - DEBUG - [Pod Pod ctest-pod-42852892] Cmd wget http://10.102.78.0:80/ -O - -T 5 -t 1 passed
2024-09-18 02:35:42,261 - DEBUG - [Pod Pod ctest-pod-42852892] Cmd output: ctest-pod-18358323
Connecting to 10.102.78.0:80 (10.102.78.0:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 02:35:42,325 - DEBUG - [Pod ctest-pod-42852892] Cmd: wget http://10.102.78.0:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-24292437
2024-09-18 02:35:42,325 - DEBUG - [Pod Pod ctest-pod-42852892] Cmd wget http://10.102.78.0:80/ -O - -T 5 -t 1 passed
2024-09-18 02:35:42,325 - DEBUG - [Pod Pod ctest-pod-42852892] Cmd output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-24292437
2024-09-18 02:35:42,325 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-18358323': 4, 'ctest-pod-24292437': 1}
2024-09-18 02:35:42,329 - DEBUG - Network policy ingress-on-service not present
2024-09-18 02:35:42,330 - INFO - Creating Network Policy ingress-on-service
2024-09-18 02:35:42,342 - INFO - Network policy found in k8s
2024-09-18 02:35:42,342 - DEBUG - Requesting: http://10.0.0.32:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=c3c0582a-ee83-4bef-9ca1-27ac82e30c18
2024-09-18 02:35:42,356 - INFO - Network Policy ingress-on-service with uuid c3c0582a-ee83-4bef-9ca1-27ac82e30c18 found in kube manager
2024-09-18 02:35:42,397 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2024-09-18 02:35:42,397 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2024-09-18 02:35:42,397 - DEBUG - Requesting: http://10.0.0.32:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=c3c0582a-ee83-4bef-9ca1-27ac82e30c18
2024-09-18 02:35:42,432 - WARNING - Network policy with name ingress-on-service not found in agent
2024-09-18 02:35:44,433 - DEBUG - Requesting: http://10.0.0.32:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=c3c0582a-ee83-4bef-9ca1-27ac82e30c18
2024-09-18 02:35:44,464 - INFO - Network policy with name ingress-on-service found in agent
2024-09-18 02:35:44,465 - INFO - Network Policy ingress-on-service verification passed
2024-09-18 02:35:49,518 - DEBUG - [Pod ctest-pod-70366422] Cmd: wget http://10.102.78.0:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:35:49,518 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd wget http://10.102.78.0:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:35:49,518 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:35:54,578 - DEBUG - [Pod ctest-pod-70366422] Cmd: wget http://10.102.78.0:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:35:54,578 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd wget http://10.102.78.0:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:35:54,578 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:35:59,634 - DEBUG - [Pod ctest-pod-70366422] Cmd: wget http://10.102.78.0:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:35:59,635 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd wget http://10.102.78.0:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:35:59,635 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:36:04,702 - DEBUG - [Pod ctest-pod-70366422] Cmd: wget http://10.102.78.0:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:36:04,703 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd wget http://10.102.78.0:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:36:04,703 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:36:09,767 - DEBUG - [Pod ctest-pod-70366422] Cmd: wget http://10.102.78.0:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:36:09,767 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd wget http://10.102.78.0:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:36:09,767 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:36:14,821 - DEBUG - [Pod ctest-pod-70366422] Cmd: wget http://10.102.78.0:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:36:14,821 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd wget http://10.102.78.0:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:36:14,821 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:36:19,873 - DEBUG - [Pod ctest-pod-70366422] Cmd: wget http://10.102.78.0:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:36:19,873 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd wget http://10.102.78.0:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:36:19,873 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:36:24,923 - DEBUG - [Pod ctest-pod-70366422] Cmd: wget http://10.102.78.0:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:36:24,924 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd wget http://10.102.78.0:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:36:24,924 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:36:29,982 - DEBUG - [Pod ctest-pod-70366422] Cmd: wget http://10.102.78.0:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:36:29,982 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd wget http://10.102.78.0:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:36:29,982 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:36:35,058 - DEBUG - [Pod ctest-pod-70366422] Cmd: wget http://10.102.78.0:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:36:35,059 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd wget http://10.102.78.0:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:36:35,059 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:36:35,059 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-18358323': 0, 'ctest-pod-24292437': 0}
2024-09-18 02:36:35,121 - DEBUG - [Pod ctest-pod-97904453] Cmd: wget http://10.102.78.0:80/ -O - -T 5 -t 1 , Output: ctest-pod-18358323
Connecting to 10.102.78.0:80 (10.102.78.0:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 02:36:35,121 - DEBUG - [Pod Pod ctest-pod-97904453] Cmd wget http://10.102.78.0:80/ -O - -T 5 -t 1 passed
2024-09-18 02:36:35,121 - DEBUG - [Pod Pod ctest-pod-97904453] Cmd output: ctest-pod-18358323
Connecting to 10.102.78.0:80 (10.102.78.0:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 02:36:35,194 - DEBUG - [Pod ctest-pod-97904453] Cmd: wget http://10.102.78.0:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-24292437
2024-09-18 02:36:35,194 - DEBUG - [Pod Pod ctest-pod-97904453] Cmd wget http://10.102.78.0:80/ -O - -T 5 -t 1 passed
2024-09-18 02:36:35,194 - DEBUG - [Pod Pod ctest-pod-97904453] Cmd output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-24292437
2024-09-18 02:36:35,195 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-18358323': 1, 'ctest-pod-24292437': 1}
2024-09-18 02:36:40,251 - DEBUG - [Pod ctest-pod-42852892] Cmd: wget http://10.102.78.0:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:36:40,251 - DEBUG - [Pod Pod ctest-pod-42852892] Cmd wget http://10.102.78.0:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:36:40,251 - DEBUG - [Pod Pod ctest-pod-42852892] Cmd output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:36:45,315 - DEBUG - [Pod ctest-pod-42852892] Cmd: wget http://10.102.78.0:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:36:45,315 - DEBUG - [Pod Pod ctest-pod-42852892] Cmd wget http://10.102.78.0:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:36:45,316 - DEBUG - [Pod Pod ctest-pod-42852892] Cmd output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:36:50,374 - DEBUG - [Pod ctest-pod-42852892] Cmd: wget http://10.102.78.0:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:36:50,375 - DEBUG - [Pod Pod ctest-pod-42852892] Cmd wget http://10.102.78.0:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:36:50,375 - DEBUG - [Pod Pod ctest-pod-42852892] Cmd output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:36:55,435 - DEBUG - [Pod ctest-pod-42852892] Cmd: wget http://10.102.78.0:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:36:55,436 - DEBUG - [Pod Pod ctest-pod-42852892] Cmd wget http://10.102.78.0:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:36:55,436 - DEBUG - [Pod Pod ctest-pod-42852892] Cmd output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:37:00,505 - DEBUG - [Pod ctest-pod-42852892] Cmd: wget http://10.102.78.0:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:37:00,505 - DEBUG - [Pod Pod ctest-pod-42852892] Cmd wget http://10.102.78.0:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:37:00,505 - DEBUG - [Pod Pod ctest-pod-42852892] Cmd output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:37:05,582 - DEBUG - [Pod ctest-pod-42852892] Cmd: wget http://10.102.78.0:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:37:05,583 - DEBUG - [Pod Pod ctest-pod-42852892] Cmd wget http://10.102.78.0:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:37:05,583 - DEBUG - [Pod Pod ctest-pod-42852892] Cmd output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:37:10,642 - DEBUG - [Pod ctest-pod-42852892] Cmd: wget http://10.102.78.0:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:37:10,642 - DEBUG - [Pod Pod ctest-pod-42852892] Cmd wget http://10.102.78.0:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:37:10,642 - DEBUG - [Pod Pod ctest-pod-42852892] Cmd output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:37:15,694 - DEBUG - [Pod ctest-pod-42852892] Cmd: wget http://10.102.78.0:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:37:15,694 - DEBUG - [Pod Pod ctest-pod-42852892] Cmd wget http://10.102.78.0:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:37:15,694 - DEBUG - [Pod Pod ctest-pod-42852892] Cmd output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:37:20,812 - DEBUG - [Pod ctest-pod-42852892] Cmd: wget http://10.102.78.0:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:37:20,812 - DEBUG - [Pod Pod ctest-pod-42852892] Cmd wget http://10.102.78.0:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:37:20,812 - DEBUG - [Pod Pod ctest-pod-42852892] Cmd output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:37:25,875 - DEBUG - [Pod ctest-pod-42852892] Cmd: wget http://10.102.78.0:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:37:25,875 - DEBUG - [Pod Pod ctest-pod-42852892] Cmd wget http://10.102.78.0:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:37:25,875 - DEBUG - [Pod Pod ctest-pod-42852892] Cmd output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:37:25,875 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-18358323': 0, 'ctest-pod-24292437': 0}
2024-09-18 02:37:27,936 - DEBUG - [Pod ctest-pod-97904453] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.617 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.070 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.092 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.070/0.259/0.617 ms
2024-09-18 02:37:27,937 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-97904453 with expectation True passed
2024-09-18 02:37:29,995 - DEBUG - [Pod ctest-pod-70366422] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.747 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.063 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.071 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.063/0.293/0.747 ms
2024-09-18 02:37:29,995 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-70366422 with expectation True passed
2024-09-18 02:37:32,047 - DEBUG - [Pod ctest-pod-42852892] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.882 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.069 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.078 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.069/0.343/0.882 ms
2024-09-18 02:37:32,047 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-42852892 with expectation True passed
2024-09-18 02:37:32,117 - DEBUG - [Pod ctest-pod-97904453] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-18 02:37:32,117 - DEBUG - [Pod Pod ctest-pod-97904453] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-09-18 02:37:32,117 - DEBUG - [Pod Pod ctest-pod-97904453] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-18 02:37:32,117 - INFO - wget check of of http://10.47.255.251 from ctest-pod-97904453 passed
2024-09-18 02:37:32,178 - DEBUG - [Pod ctest-pod-97904453] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-18 02:37:32,178 - DEBUG - [Pod Pod ctest-pod-97904453] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-09-18 02:37:32,178 - DEBUG - [Pod Pod ctest-pod-97904453] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-18 02:37:32,178 - INFO - wget check of of http://10.47.255.250 from ctest-pod-97904453 passed
2024-09-18 02:37:37,237 - DEBUG - [Pod ctest-pod-70366422] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-18 02:37:37,237 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-18 02:37:37,237 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-18 02:37:37,237 - INFO - wget check of of http://10.47.255.250 from ctest-pod-70366422 passed
2024-09-18 02:37:42,306 - DEBUG - [Pod ctest-pod-03424992] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-09-18 02:37:42,307 - DEBUG - [Pod Pod ctest-pod-03424992] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-09-18 02:37:42,307 - DEBUG - [Pod Pod ctest-pod-03424992] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-09-18 02:37:42,307 - INFO - wget check of of http://10.47.255.251 from ctest-pod-03424992 passed
2024-09-18 02:37:42,315 - INFO - Updating Network Policy ingress-on-service
2024-09-18 02:37:47,369 - DEBUG - [Pod ctest-pod-70366422] Cmd: wget http://10.102.78.0:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:37:47,369 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd wget http://10.102.78.0:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:37:47,369 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:37:52,418 - DEBUG - [Pod ctest-pod-70366422] Cmd: wget http://10.102.78.0:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:37:52,418 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd wget http://10.102.78.0:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:37:52,418 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:37:57,482 - DEBUG - [Pod ctest-pod-70366422] Cmd: wget http://10.102.78.0:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:37:57,482 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd wget http://10.102.78.0:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:37:57,482 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:38:02,535 - DEBUG - [Pod ctest-pod-70366422] Cmd: wget http://10.102.78.0:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:38:02,535 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd wget http://10.102.78.0:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:38:02,535 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:38:07,602 - DEBUG - [Pod ctest-pod-70366422] Cmd: wget http://10.102.78.0:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:38:07,602 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd wget http://10.102.78.0:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:38:07,602 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:38:12,661 - DEBUG - [Pod ctest-pod-70366422] Cmd: wget http://10.102.78.0:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:38:12,661 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd wget http://10.102.78.0:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:38:12,661 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:38:17,725 - DEBUG - [Pod ctest-pod-70366422] Cmd: wget http://10.102.78.0:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:38:17,726 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd wget http://10.102.78.0:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:38:17,726 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:38:22,787 - DEBUG - [Pod ctest-pod-70366422] Cmd: wget http://10.102.78.0:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:38:22,787 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd wget http://10.102.78.0:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:38:22,787 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:38:27,858 - DEBUG - [Pod ctest-pod-70366422] Cmd: wget http://10.102.78.0:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:38:27,858 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd wget http://10.102.78.0:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:38:27,858 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:38:32,931 - DEBUG - [Pod ctest-pod-70366422] Cmd: wget http://10.102.78.0:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:38:32,931 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd wget http://10.102.78.0:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:38:32,931 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
wget: download timed out
2024-09-18 02:38:32,931 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-18358323': 0, 'ctest-pod-24292437': 0}
2024-09-18 02:38:32,989 - DEBUG - [Pod ctest-pod-97904453] Cmd: wget http://10.102.78.0:80/ -O - -T 5 -t 1 , Output: ctest-pod-24292437
Connecting to 10.102.78.0:80 (10.102.78.0:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 02:38:32,990 - DEBUG - [Pod Pod ctest-pod-97904453] Cmd wget http://10.102.78.0:80/ -O - -T 5 -t 1 passed
2024-09-18 02:38:32,990 - DEBUG - [Pod Pod ctest-pod-97904453] Cmd output: ctest-pod-24292437
Connecting to 10.102.78.0:80 (10.102.78.0:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 02:38:33,052 - DEBUG - [Pod ctest-pod-97904453] Cmd: wget http://10.102.78.0:80/ -O - -T 5 -t 1 , Output: ctest-pod-18358323
Connecting to 10.102.78.0:80 (10.102.78.0:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 02:38:33,052 - DEBUG - [Pod Pod ctest-pod-97904453] Cmd wget http://10.102.78.0:80/ -O - -T 5 -t 1 passed
2024-09-18 02:38:33,052 - DEBUG - [Pod Pod ctest-pod-97904453] Cmd output: ctest-pod-18358323
Connecting to 10.102.78.0:80 (10.102.78.0:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 02:38:33,053 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-18358323': 1, 'ctest-pod-24292437': 1}
2024-09-18 02:38:33,109 - DEBUG - [Pod ctest-pod-42852892] Cmd: wget http://10.102.78.0:80/ -O - -T 5 -t 1 , Output: ctest-pod-24292437
Connecting to 10.102.78.0:80 (10.102.78.0:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 02:38:33,109 - DEBUG - [Pod Pod ctest-pod-42852892] Cmd wget http://10.102.78.0:80/ -O - -T 5 -t 1 passed
2024-09-18 02:38:33,109 - DEBUG - [Pod Pod ctest-pod-42852892] Cmd output: ctest-pod-24292437
Connecting to 10.102.78.0:80 (10.102.78.0:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 02:38:33,171 - DEBUG - [Pod ctest-pod-42852892] Cmd: wget http://10.102.78.0:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-24292437
2024-09-18 02:38:33,171 - DEBUG - [Pod Pod ctest-pod-42852892] Cmd wget http://10.102.78.0:80/ -O - -T 5 -t 1 passed
2024-09-18 02:38:33,171 - DEBUG - [Pod Pod ctest-pod-42852892] Cmd output: Connecting to 10.102.78.0:80 (10.102.78.0:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-24292437
2024-09-18 02:38:33,240 - DEBUG - [Pod ctest-pod-42852892] Cmd: wget http://10.102.78.0:80/ -O - -T 5 -t 1 , Output: ctest-pod-24292437
Connecting to 10.102.78.0:80 (10.102.78.0:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 02:38:33,240 - DEBUG - [Pod Pod ctest-pod-42852892] Cmd wget http://10.102.78.0:80/ -O - -T 5 -t 1 passed
2024-09-18 02:38:33,240 - DEBUG - [Pod Pod ctest-pod-42852892] Cmd output: ctest-pod-24292437
Connecting to 10.102.78.0:80 (10.102.78.0:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 02:38:33,285 - DEBUG - [Pod ctest-pod-42852892] Cmd: wget http://10.102.78.0:80/ -O - -T 5 -t 1 , Output: ctest-pod-18358323
Connecting to 10.102.78.0:80 (10.102.78.0:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 02:38:33,285 - DEBUG - [Pod Pod ctest-pod-42852892] Cmd wget http://10.102.78.0:80/ -O - -T 5 -t 1 passed
2024-09-18 02:38:33,285 - DEBUG - [Pod Pod ctest-pod-42852892] Cmd output: ctest-pod-18358323
Connecting to 10.102.78.0:80 (10.102.78.0:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-18 02:38:33,285 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-18358323': 1, 'ctest-pod-24292437': 3}
2024-09-18 02:38:35,344 - DEBUG - [Pod ctest-pod-97904453] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.785 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.073 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.076 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.073/0.311/0.785 ms
2024-09-18 02:38:35,344 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-97904453 with expectation True passed
2024-09-18 02:38:37,401 - DEBUG - [Pod ctest-pod-70366422] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.739 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.079 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.080 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.079/0.299/0.739 ms
2024-09-18 02:38:37,401 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-70366422 with expectation True passed
2024-09-18 02:38:39,462 - DEBUG - [Pod ctest-pod-42852892] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.600 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.087 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.089 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.087/0.258/0.600 ms
2024-09-18 02:38:39,462 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-42852892 with expectation True passed
2024-09-18 02:38:39,534 - DEBUG - [Pod ctest-pod-97904453] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-18 02:38:39,534 - DEBUG - [Pod Pod ctest-pod-97904453] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-09-18 02:38:39,534 - DEBUG - [Pod Pod ctest-pod-97904453] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-18 02:38:39,534 - INFO - wget check of of http://10.47.255.251 from ctest-pod-97904453 passed
2024-09-18 02:38:39,607 - DEBUG - [Pod ctest-pod-97904453] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-18 02:38:39,607 - DEBUG - [Pod Pod ctest-pod-97904453] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-09-18 02:38:39,607 - DEBUG - [Pod Pod ctest-pod-97904453] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-18 02:38:39,607 - INFO - wget check of of http://10.47.255.250 from ctest-pod-97904453 passed
2024-09-18 02:38:44,663 - DEBUG - [Pod ctest-pod-70366422] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-18 02:38:44,663 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-18 02:38:44,663 - DEBUG - [Pod Pod ctest-pod-70366422] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-18 02:38:44,664 - INFO - wget check of of http://10.47.255.250 from ctest-pod-70366422 passed
2024-09-18 02:38:44,724 - DEBUG - [Pod ctest-pod-03424992] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-18 02:38:44,724 - DEBUG - [Pod Pod ctest-pod-03424992] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-09-18 02:38:44,724 - DEBUG - [Pod Pod ctest-pod-03424992] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-18 02:38:44,724 - INFO - wget check of of http://10.47.255.251 from ctest-pod-03424992 passed
2024-09-18 02:38:44,724 - INFO - Deleting Network Policy : ingress-on-service
2024-09-18 02:38:44,725 - INFO - Deleting service : ctest-nginx-svc-88653459
2024-09-18 02:38:44,972 - DEBUG - No XMPP flaps were noticed during the test
2024-09-18 02:38:44,972 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:05]
2024-09-18 02:38:44,972 - INFO - --------------------------------------------------------------------------------
2024-09-18 02:38:44,980 - INFO - Deleting pod ctest-new-default-41319572:ctest-pod-18358323
2024-09-18 02:38:44,981 - INFO - Deleting pod ctest-new-default-41319572:ctest-pod-24292437
2024-09-18 02:38:44,981 - INFO - Deleting pod ctest-non-default-22326540:ctest-pod-84426815
2024-09-18 02:38:44,982 - INFO - Deleting pod ctest-non-default-22326540:ctest-pod-94894299
2024-09-18 02:38:44,982 - INFO - Deleting pod ctest-new-default-41319572:ctest-pod-70366422
2024-09-18 02:38:44,982 - INFO - Deleting pod ctest-new-default-41319572:ctest-pod-97904453
2024-09-18 02:38:44,983 - INFO - Deleting pod ctest-non-default-22326540:ctest-pod-42852892
2024-09-18 02:38:44,983 - INFO - Deleting pod ctest-non-default-22326540:ctest-pod-03424992
2024-09-18 02:38:45,084 - WARNING - Pod uuid 9b83eef9-3c77-4f1f-b935-fa82c63db370 is still seen in agent 10.0.0.66 VM list
2024-09-18 02:38:45,094 - WARNING - Pod uuid 1d434e23-e4ba-4145-a0d5-8753acd27518 is still seen in agent 10.0.0.66 VM list
2024-09-18 02:38:45,130 - WARNING - Pod uuid 2ff5bfd9-ad4c-4c38-9ce1-756938dd1d23 is still seen in agent 10.0.0.66 VM list
2024-09-18 02:38:45,131 - WARNING - Pod uuid c800b3ef-369b-4da1-8593-0693a0f6219a is still seen in agent 10.0.0.66 VM list
2024-09-18 02:38:45,132 - WARNING - Pod uuid ea672723-75ce-4f10-8c68-11ac75dbda85 is still seen in agent 10.0.0.66 VM list
2024-09-18 02:38:45,132 - WARNING - Pod uuid 2702a244-cd3b-4125-bf35-75c3344ad5d8 is still seen in agent 10.0.0.66 VM list
2024-09-18 02:38:45,132 - WARNING - Pod uuid d02edaec-2db6-4c7e-8827-5df1ddc15b32 is still seen in agent 10.0.0.66 VM list
2024-09-18 02:38:45,133 - WARNING - Pod uuid 7be3621d-5c54-4204-8f43-d6944cdbf99e is still seen in agent 10.0.0.66 VM list
2024-09-18 02:38:50,093 - DEBUG - Pod 9b83eef9-3c77-4f1f-b935-fa82c63db370 is not in agent 10.0.0.66 VM list
2024-09-18 02:38:50,103 - DEBUG - VMI a3bde9e2-7566-11ef-b85a-fa163e213c18 is removed from agent 10.0.0.66
2024-09-18 02:38:50,103 - INFO - Verified that pod ctest-pod-18358323 is removed in agent
2024-09-18 02:38:50,104 - DEBUG - Pod 1d434e23-e4ba-4145-a0d5-8753acd27518 is not in agent 10.0.0.66 VM list
2024-09-18 02:38:50,110 - DEBUG - VMI a6046122-7566-11ef-b85a-fa163e213c18 is removed from agent 10.0.0.66
2024-09-18 02:38:50,110 - INFO - Verified that pod ctest-pod-94894299 is removed in agent
2024-09-18 02:38:50,163 - WARNING - Pod uuid c800b3ef-369b-4da1-8593-0693a0f6219a is still seen in agent 10.0.0.66 VM list
2024-09-18 02:38:50,164 - WARNING - Pod uuid ea672723-75ce-4f10-8c68-11ac75dbda85 is still seen in agent 10.0.0.66 VM list
2024-09-18 02:38:50,165 - DEBUG - Pod 7be3621d-5c54-4204-8f43-d6944cdbf99e is not in agent 10.0.0.66 VM list
2024-09-18 02:38:50,167 - WARNING - Pod uuid d02edaec-2db6-4c7e-8827-5df1ddc15b32 is still seen in agent 10.0.0.66 VM list
2024-09-18 02:38:50,167 - WARNING - Pod uuid 2702a244-cd3b-4125-bf35-75c3344ad5d8 is still seen in agent 10.0.0.66 VM list
2024-09-18 02:38:50,168 - DEBUG - Pod 2ff5bfd9-ad4c-4c38-9ce1-756938dd1d23 is not in agent 10.0.0.66 VM list
2024-09-18 02:38:50,177 - DEBUG - VMI a575a6da-7566-11ef-b85a-fa163e213c18 is removed from agent 10.0.0.66
2024-09-18 02:38:50,177 - INFO - Verified that pod ctest-pod-84426815 is removed in agent
2024-09-18 02:38:50,178 - DEBUG - VMI a4a2b5a4-7566-11ef-b85a-fa163e213c18 is removed from agent 10.0.0.66
2024-09-18 02:38:50,178 - INFO - Verified that pod ctest-pod-24292437 is removed in agent
2024-09-18 02:38:55,181 - WARNING - Pod uuid ea672723-75ce-4f10-8c68-11ac75dbda85 is still seen in agent 10.0.0.66 VM list
2024-09-18 02:38:55,182 - WARNING - Pod uuid c800b3ef-369b-4da1-8593-0693a0f6219a is still seen in agent 10.0.0.66 VM list
2024-09-18 02:38:55,183 - WARNING - Pod uuid 2702a244-cd3b-4125-bf35-75c3344ad5d8 is still seen in agent 10.0.0.66 VM list
2024-09-18 02:38:55,183 - WARNING - Pod uuid d02edaec-2db6-4c7e-8827-5df1ddc15b32 is still seen in agent 10.0.0.66 VM list
2024-09-18 02:39:00,201 - WARNING - Pod uuid ea672723-75ce-4f10-8c68-11ac75dbda85 is still seen in agent 10.0.0.66 VM list
2024-09-18 02:39:00,202 - WARNING - Pod uuid c800b3ef-369b-4da1-8593-0693a0f6219a is still seen in agent 10.0.0.66 VM list
2024-09-18 02:39:00,203 - WARNING - Pod uuid d02edaec-2db6-4c7e-8827-5df1ddc15b32 is still seen in agent 10.0.0.66 VM list
2024-09-18 02:39:00,203 - WARNING - Pod uuid 2702a244-cd3b-4125-bf35-75c3344ad5d8 is still seen in agent 10.0.0.66 VM list
2024-09-18 02:39:05,228 - WARNING - Pod uuid ea672723-75ce-4f10-8c68-11ac75dbda85 is still seen in agent 10.0.0.66 VM list
2024-09-18 02:39:05,230 - WARNING - Pod uuid 2702a244-cd3b-4125-bf35-75c3344ad5d8 is still seen in agent 10.0.0.66 VM list
2024-09-18 02:39:05,231 - WARNING - Pod uuid d02edaec-2db6-4c7e-8827-5df1ddc15b32 is still seen in agent 10.0.0.66 VM list
2024-09-18 02:39:05,231 - WARNING - Pod uuid c800b3ef-369b-4da1-8593-0693a0f6219a is still seen in agent 10.0.0.66 VM list
2024-09-18 02:39:10,241 - WARNING - Pod uuid ea672723-75ce-4f10-8c68-11ac75dbda85 is still seen in agent 10.0.0.66 VM list
2024-09-18 02:39:10,249 - WARNING - Pod uuid 2702a244-cd3b-4125-bf35-75c3344ad5d8 is still seen in agent 10.0.0.66 VM list
2024-09-18 02:39:10,251 - WARNING - Pod uuid c800b3ef-369b-4da1-8593-0693a0f6219a is still seen in agent 10.0.0.66 VM list
2024-09-18 02:39:10,251 - WARNING - Pod uuid d02edaec-2db6-4c7e-8827-5df1ddc15b32 is still seen in agent 10.0.0.66 VM list
2024-09-18 02:39:15,250 - WARNING - Pod uuid ea672723-75ce-4f10-8c68-11ac75dbda85 is still seen in agent 10.0.0.66 VM list
2024-09-18 02:39:15,269 - WARNING - Pod uuid 2702a244-cd3b-4125-bf35-75c3344ad5d8 is still seen in agent 10.0.0.66 VM list
2024-09-18 02:39:15,270 - WARNING - Pod uuid d02edaec-2db6-4c7e-8827-5df1ddc15b32 is still seen in agent 10.0.0.66 VM list
2024-09-18 02:39:15,271 - WARNING - Pod uuid c800b3ef-369b-4da1-8593-0693a0f6219a is still seen in agent 10.0.0.66 VM list
2024-09-18 02:39:20,260 - DEBUG - Pod ea672723-75ce-4f10-8c68-11ac75dbda85 is not in agent 10.0.0.66 VM list
2024-09-18 02:39:20,267 - DEBUG - VMI a8383914-7566-11ef-b85a-fa163e213c18 is removed from agent 10.0.0.66
2024-09-18 02:39:20,267 - INFO - Verified that pod ctest-pod-03424992 is removed in agent
2024-09-18 02:39:20,284 - DEBUG - Pod 2702a244-cd3b-4125-bf35-75c3344ad5d8 is not in agent 10.0.0.66 VM list
2024-09-18 02:39:20,287 - DEBUG - Pod d02edaec-2db6-4c7e-8827-5df1ddc15b32 is not in agent 10.0.0.66 VM list
2024-09-18 02:39:20,289 - DEBUG - Pod c800b3ef-369b-4da1-8593-0693a0f6219a is not in agent 10.0.0.66 VM list
2024-09-18 02:39:20,299 - DEBUG - VMI a72e3eba-7566-11ef-b85a-fa163e213c18 is removed from agent 10.0.0.66
2024-09-18 02:39:20,299 - INFO - Verified that pod ctest-pod-97904453 is removed in agent
2024-09-18 02:39:20,300 - DEBUG - VMI a7b2e692-7566-11ef-b85a-fa163e213c18 is removed from agent 10.0.0.66
2024-09-18 02:39:20,300 - INFO - Verified that pod ctest-pod-42852892 is removed in agent
2024-09-18 02:39:20,301 - DEBUG - VMI a69dc998-7566-11ef-b85a-fa163e213c18 is removed from agent 10.0.0.66
2024-09-18 02:39:20,301 - INFO - Verified that pod ctest-pod-70366422 is removed in agent
2024-09-18 02:39:20,301 - INFO - Deleting namespace ctest-non-default-22326540
2024-09-18 02:39:20,314 - DEBUG - Namespace ctest-non-default-22326540 still in k8s
2024-09-18 02:39:22,320 - DEBUG - Namespace ctest-non-default-22326540 still in k8s
2024-09-18 02:39:24,326 - DEBUG - Namespace ctest-non-default-22326540 still in k8s
2024-09-18 02:39:26,330 - DEBUG - Namespace ctest-non-default-22326540 is not in k8s
2024-09-18 02:39:26,331 - DEBUG - No need to check project deletion in contrail-api
2024-09-18 02:39:26,331 - INFO - Deleting namespace ctest-new-default-41319572
2024-09-18 02:39:26,343 - DEBUG - Namespace ctest-new-default-41319572 still in k8s
2024-09-18 02:39:28,350 - DEBUG - Namespace ctest-new-default-41319572 still in k8s
2024-09-18 02:39:30,355 - DEBUG - Namespace ctest-new-default-41319572 still in k8s
2024-09-18 02:39:32,360 - DEBUG - Namespace ctest-new-default-41319572 is not in k8s
2024-09-18 02:39:32,360 - DEBUG - No need to check project deletion in contrail-api