2024-09-13 21:08:26,093 - INFO - Using existing project ['default-domain', 'k8s-default'](85a562c5-b473-488c-848f-b3692688dbcb)
2024-09-13 21:08:26,115 - DEBUG - Namespace ctest-new-default-58722540 not present
2024-09-13 21:08:26,140 - INFO - Created namespace ctest-new-default-58722540
2024-09-13 21:08:29,144 - DEBUG - Namespace ctest-non-default-00820998 not present
2024-09-13 21:08:29,151 - INFO - Created namespace ctest-non-default-00820998
2024-09-13 21:08:32,177 - DEBUG - Pod ctest-pod-49643381 not present
2024-09-13 21:08:32,177 - INFO - Creating Pod ctest-pod-49643381
2024-09-13 21:08:32,203 - DEBUG - Node for Pod ctest-pod-49643381 not yet populated
2024-09-13 21:08:35,209 - DEBUG - Pod : ctest-pod-49643381 UUID is 34578383-1162-4377-ae46-6ac449713bba
2024-09-13 21:08:35,211 - DEBUG - Pod ctest-pod-93441282 not present
2024-09-13 21:08:35,212 - INFO - Creating Pod ctest-pod-93441282
2024-09-13 21:08:35,256 - DEBUG - Pod : ctest-pod-93441282 UUID is 0ff09adc-fc94-44ab-83df-3e9c2be16022
2024-09-13 21:08:35,259 - DEBUG - Pod ctest-pod-94420166 not present
2024-09-13 21:08:35,259 - INFO - Creating Pod ctest-pod-94420166
2024-09-13 21:08:35,288 - DEBUG - Pod : ctest-pod-94420166 UUID is 5a9aff69-26c8-4a53-89df-9bc785148a13
2024-09-13 21:08:35,290 - DEBUG - Pod ctest-pod-23504572 not present
2024-09-13 21:08:35,290 - INFO - Creating Pod ctest-pod-23504572
2024-09-13 21:08:35,308 - DEBUG - Pod : ctest-pod-23504572 UUID is 64874fdd-68f5-40a6-8002-fec2e3fa6782
2024-09-13 21:08:35,313 - DEBUG - Pod ctest-pod-72335017 not present
2024-09-13 21:08:35,314 - INFO - Creating Pod ctest-pod-72335017
2024-09-13 21:08:35,327 - DEBUG - Pod : ctest-pod-72335017 UUID is 1483a3dd-9d6b-421c-957e-9c07494caf41
2024-09-13 21:08:35,330 - DEBUG - Pod ctest-pod-19651890 not present
2024-09-13 21:08:35,330 - INFO - Creating Pod ctest-pod-19651890
2024-09-13 21:08:35,376 - DEBUG - Pod : ctest-pod-19651890 UUID is b77960bb-698f-4aa0-94c1-20877e2abf05
2024-09-13 21:08:35,379 - DEBUG - Pod ctest-pod-07021306 not present
2024-09-13 21:08:35,380 - INFO - Creating Pod ctest-pod-07021306
2024-09-13 21:08:35,413 - DEBUG - Pod : ctest-pod-07021306 UUID is 61fbd67a-d0c3-449e-96a6-a101e356d481
2024-09-13 21:08:35,429 - DEBUG - Pod ctest-pod-89046352 not present
2024-09-13 21:08:35,430 - INFO - Creating Pod ctest-pod-89046352
2024-09-13 21:08:35,455 - DEBUG - Pod : ctest-pod-89046352 UUID is 510e9ef7-320e-45ef-bbad-476ffe7fd4d1
2024-09-13 21:08:35,773 - INFO - Project default-domain:k8s-ctest-new-default-58722540 for Namespace ctest-new-default-58722540 is seen in contrail-api
2024-09-13 21:08:35,774 - DEBUG - Project uuid in Contrail is 765b68f9-3336-4cbc-a548-3d657b7cb146
2024-09-13 21:08:35,964 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_NamespaceDatabaseList?namespace_uuid=813092d5-c859-4634-88ad-7d1e304346c4
2024-09-13 21:08:35,983 - INFO - Namespace ctest-new-default-58722540 with uuid 813092d5-c859-4634-88ad-7d1e304346c4 found in kube manager
2024-09-13 21:08:35,986 - INFO - Namespace ctest-new-default-58722540 verification passed
2024-09-13 21:08:36,183 - INFO - Project default-domain:k8s-ctest-non-default-00820998 for Namespace ctest-non-default-00820998 is seen in contrail-api
2024-09-13 21:08:36,183 - DEBUG - Project uuid in Contrail is f365cb22-8cd1-45f0-934b-26ff67d1354b
2024-09-13 21:08:36,183 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_NamespaceDatabaseList?namespace_uuid=590e9750-d8e5-4307-9d4a-863084c13942
2024-09-13 21:08:36,190 - INFO - Namespace ctest-non-default-00820998 with uuid 590e9750-d8e5-4307-9d4a-863084c13942 found in kube manager
2024-09-13 21:08:36,190 - INFO - Namespace ctest-non-default-00820998 verification passed
2024-09-13 21:08:36,196 - DEBUG - Pod ctest-pod-49643381 not in running state.Currently in Pending
2024-09-13 21:08:41,203 - DEBUG - Pod ctest-pod-49643381 not in running state.Currently in Pending
2024-09-13 21:08:46,211 - INFO - Pod ctest-pod-49643381 is in running state.Got IP 10.47.255.251
2024-09-13 21:08:46,280 - DEBUG - Pod ctest-pod-49643381 has vmi 5635b826-7214-11ef-bef4-fa163ee8f531
2024-09-13 21:08:46,280 - INFO - Verified pod ctest-pod-49643381 in contrail-api
2024-09-13 21:08:46,296 - DEBUG - VMI 5635b826-7214-11ef-bef4-fa163ee8f531 is active in agent 10.0.0.40
2024-09-13 21:08:46,296 - INFO - Verified Pod ctest-pod-49643381 in agent 10.0.0.40
2024-09-13 21:08:46,296 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=34578383-1162-4377-ae46-6ac449713bba
2024-09-13 21:08:46,308 - INFO - Pod ctest-pod-49643381 with uuid 34578383-1162-4377-ae46-6ac449713bba found in kube manager
2024-09-13 21:08:46,308 - INFO - Pod ctest-pod-49643381 verification passed
2024-09-13 21:08:46,313 - DEBUG - Pod ctest-pod-93441282 not in running state.Currently in Pending
2024-09-13 21:08:51,320 - INFO - Pod ctest-pod-93441282 is in running state.Got IP 10.47.255.250
2024-09-13 21:08:51,337 - DEBUG - Pod ctest-pod-93441282 has vmi 56e92cda-7214-11ef-bef4-fa163ee8f531
2024-09-13 21:08:51,338 - INFO - Verified pod ctest-pod-93441282 in contrail-api
2024-09-13 21:08:51,353 - DEBUG - VMI 56e92cda-7214-11ef-bef4-fa163ee8f531 is active in agent 10.0.0.40
2024-09-13 21:08:51,353 - INFO - Verified Pod ctest-pod-93441282 in agent 10.0.0.40
2024-09-13 21:08:51,353 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=0ff09adc-fc94-44ab-83df-3e9c2be16022
2024-09-13 21:08:51,358 - INFO - Pod ctest-pod-93441282 with uuid 0ff09adc-fc94-44ab-83df-3e9c2be16022 found in kube manager
2024-09-13 21:08:51,358 - INFO - Pod ctest-pod-93441282 verification passed
2024-09-13 21:08:51,363 - INFO - Pod ctest-pod-94420166 is in running state.Got IP 10.47.255.249
2024-09-13 21:08:51,420 - DEBUG - Pod ctest-pod-94420166 has vmi 57c2a5f0-7214-11ef-bef4-fa163ee8f531
2024-09-13 21:08:51,420 - INFO - Verified pod ctest-pod-94420166 in contrail-api
2024-09-13 21:08:51,432 - DEBUG - VMI 57c2a5f0-7214-11ef-bef4-fa163ee8f531 is active in agent 10.0.0.40
2024-09-13 21:08:51,432 - INFO - Verified Pod ctest-pod-94420166 in agent 10.0.0.40
2024-09-13 21:08:51,433 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=5a9aff69-26c8-4a53-89df-9bc785148a13
2024-09-13 21:08:51,437 - INFO - Pod ctest-pod-94420166 with uuid 5a9aff69-26c8-4a53-89df-9bc785148a13 found in kube manager
2024-09-13 21:08:51,437 - INFO - Pod ctest-pod-94420166 verification passed
2024-09-13 21:08:51,443 - INFO - Pod ctest-pod-23504572 is in running state.Got IP 10.47.255.248
2024-09-13 21:08:51,460 - DEBUG - Pod ctest-pod-23504572 has vmi 5847d23e-7214-11ef-bef4-fa163ee8f531
2024-09-13 21:08:51,461 - INFO - Verified pod ctest-pod-23504572 in contrail-api
2024-09-13 21:08:51,476 - DEBUG - VMI 5847d23e-7214-11ef-bef4-fa163ee8f531 is active in agent 10.0.0.40
2024-09-13 21:08:51,476 - INFO - Verified Pod ctest-pod-23504572 in agent 10.0.0.40
2024-09-13 21:08:51,476 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=64874fdd-68f5-40a6-8002-fec2e3fa6782
2024-09-13 21:08:51,481 - INFO - Pod ctest-pod-23504572 with uuid 64874fdd-68f5-40a6-8002-fec2e3fa6782 found in kube manager
2024-09-13 21:08:51,481 - INFO - Pod ctest-pod-23504572 verification passed
2024-09-13 21:08:51,485 - INFO - Pod ctest-pod-72335017 is in running state.Got IP 10.47.255.247
2024-09-13 21:08:51,544 - DEBUG - Pod ctest-pod-72335017 has vmi 58ec7ab4-7214-11ef-bef4-fa163ee8f531
2024-09-13 21:08:51,544 - INFO - Verified pod ctest-pod-72335017 in contrail-api
2024-09-13 21:08:51,556 - DEBUG - VMI 58ec7ab4-7214-11ef-bef4-fa163ee8f531 is active in agent 10.0.0.40
2024-09-13 21:08:51,556 - INFO - Verified Pod ctest-pod-72335017 in agent 10.0.0.40
2024-09-13 21:08:51,557 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=1483a3dd-9d6b-421c-957e-9c07494caf41
2024-09-13 21:08:51,561 - INFO - Pod ctest-pod-72335017 with uuid 1483a3dd-9d6b-421c-957e-9c07494caf41 found in kube manager
2024-09-13 21:08:51,561 - INFO - Pod ctest-pod-72335017 verification passed
2024-09-13 21:08:51,566 - DEBUG - Pod ctest-pod-07021306 not in running state.Currently in Pending
2024-09-13 21:08:56,572 - INFO - Pod ctest-pod-07021306 is in running state.Got IP 10.47.255.245
2024-09-13 21:08:56,589 - DEBUG - Pod ctest-pod-07021306 has vmi 5a615dd8-7214-11ef-bef4-fa163ee8f531
2024-09-13 21:08:56,589 - INFO - Verified pod ctest-pod-07021306 in contrail-api
2024-09-13 21:08:56,601 - DEBUG - VMI 5a615dd8-7214-11ef-bef4-fa163ee8f531 is active in agent 10.0.0.40
2024-09-13 21:08:56,602 - INFO - Verified Pod ctest-pod-07021306 in agent 10.0.0.40
2024-09-13 21:08:56,602 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=61fbd67a-d0c3-449e-96a6-a101e356d481
2024-09-13 21:08:56,606 - INFO - Pod ctest-pod-07021306 with uuid 61fbd67a-d0c3-449e-96a6-a101e356d481 found in kube manager
2024-09-13 21:08:56,606 - INFO - Pod ctest-pod-07021306 verification passed
2024-09-13 21:08:56,611 - INFO - Pod ctest-pod-19651890 is in running state.Got IP 10.47.255.246
2024-09-13 21:08:56,677 - DEBUG - Pod ctest-pod-19651890 has vmi 59bb78be-7214-11ef-bef4-fa163ee8f531
2024-09-13 21:08:56,677 - INFO - Verified pod ctest-pod-19651890 in contrail-api
2024-09-13 21:08:56,690 - DEBUG - VMI 59bb78be-7214-11ef-bef4-fa163ee8f531 is active in agent 10.0.0.40
2024-09-13 21:08:56,690 - INFO - Verified Pod ctest-pod-19651890 in agent 10.0.0.40
2024-09-13 21:08:56,690 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=b77960bb-698f-4aa0-94c1-20877e2abf05
2024-09-13 21:08:56,695 - INFO - Pod ctest-pod-19651890 with uuid b77960bb-698f-4aa0-94c1-20877e2abf05 found in kube manager
2024-09-13 21:08:56,695 - INFO - Pod ctest-pod-19651890 verification passed
2024-09-13 21:08:56,701 - INFO - Pod ctest-pod-89046352 is in running state.Got IP 10.47.255.244
2024-09-13 21:08:56,760 - DEBUG - Pod ctest-pod-89046352 has vmi 5b065874-7214-11ef-bef4-fa163ee8f531
2024-09-13 21:08:56,760 - INFO - Verified pod ctest-pod-89046352 in contrail-api
2024-09-13 21:08:56,773 - DEBUG - VMI 5b065874-7214-11ef-bef4-fa163ee8f531 is active in agent 10.0.0.40
2024-09-13 21:08:56,773 - INFO - Verified Pod ctest-pod-89046352 in agent 10.0.0.40
2024-09-13 21:08:56,774 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_VirtualMachineDatabaseList?x=510e9ef7-320e-45ef-bbad-476ffe7fd4d1
2024-09-13 21:08:56,778 - INFO - Pod ctest-pod-89046352 with uuid 510e9ef7-320e-45ef-bbad-476ffe7fd4d1 found in kube manager
2024-09-13 21:08:56,778 - INFO - Pod ctest-pod-89046352 verification passed
2024-09-13 21:08:56,778 - INFO - ================================================================================
2024-09-13 21:08:56,778 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2024-09-13 21:08:56,778 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2024-09-13 21:08:57,007 - DEBUG - Nothing to compare xmpp stats {'10.0.0.40': {'10.0.0.37': '0'}} with
2024-09-13 21:08:57,007 - INFO - Initial checks done. Running the testcase now
2024-09-13 21:08:57,007 - INFO -
2024-09-13 21:08:57,067 - DEBUG - [Pod ctest-pod-49643381] Cmd: echo ctest-pod-49643381 > /usr/share/nginx/html/index.html, Output:
2024-09-13 21:08:57,119 - DEBUG - [Pod ctest-pod-93441282] Cmd: echo ctest-pod-93441282 > /usr/share/nginx/html/index.html, Output:
2024-09-13 21:08:57,168 - DEBUG - [Pod ctest-pod-94420166] Cmd: echo ctest-pod-94420166 > /usr/share/nginx/html/index.html, Output:
2024-09-13 21:08:57,231 - DEBUG - [Pod ctest-pod-23504572] Cmd: echo ctest-pod-23504572 > /usr/share/nginx/html/index.html, Output:
2024-09-13 21:08:57,234 - DEBUG - Service ctest-nginx-svc-34191574 not present
2024-09-13 21:08:57,234 - INFO - Creating service ctest-nginx-svc-34191574
2024-09-13 21:08:57,248 - INFO - Created Service ctest-nginx-svc-34191574
2024-09-13 21:08:57,256 - WARNING - Service UUID 8ed2ecc2-25ee-413c-af2e-5842f9e0fed4 not yet found in contrail-api
2024-09-13 21:08:58,266 - INFO - Validated that Service ctest-nginx-svc-34191574 is seen in contrail-api
2024-09-13 21:08:58,267 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_LoadbalancerDatabaseList?x=8ed2ecc2-25ee-413c-af2e-5842f9e0fed4
2024-09-13 21:08:58,275 - INFO - Service ctest-nginx-svc-34191574 with uuid 8ed2ecc2-25ee-413c-af2e-5842f9e0fed4 found in kube manager
2024-09-13 21:08:58,275 - INFO - Service ctest-nginx-svc-34191574 verification passed
2024-09-13 21:08:59,356 - DEBUG - [Pod ctest-pod-72335017] Cmd: wget http://10.104.180.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-93441282
2024-09-13 21:08:59,356 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd wget http://10.104.180.58:80/ -O - -T 5 -t 1 passed
2024-09-13 21:08:59,356 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-93441282
2024-09-13 21:08:59,416 - DEBUG - [Pod ctest-pod-72335017] Cmd: wget http://10.104.180.58:80/ -O - -T 5 -t 1 , Output: ctest-pod-49643381
Connecting to 10.104.180.58:80 (10.104.180.58:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-13 21:08:59,416 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd wget http://10.104.180.58:80/ -O - -T 5 -t 1 passed
2024-09-13 21:08:59,416 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd output: ctest-pod-49643381
Connecting to 10.104.180.58:80 (10.104.180.58:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-13 21:08:59,417 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-49643381': 1, 'ctest-pod-93441282': 1}
2024-09-13 21:08:59,477 - DEBUG - [Pod ctest-pod-07021306] Cmd: wget http://10.104.180.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-49643381
2024-09-13 21:08:59,477 - DEBUG - [Pod Pod ctest-pod-07021306] Cmd wget http://10.104.180.58:80/ -O - -T 5 -t 1 passed
2024-09-13 21:08:59,477 - DEBUG - [Pod Pod ctest-pod-07021306] Cmd output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-49643381
2024-09-13 21:08:59,538 - DEBUG - [Pod ctest-pod-07021306] Cmd: wget http://10.104.180.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
ctest-pod-49643381
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-13 21:08:59,538 - DEBUG - [Pod Pod ctest-pod-07021306] Cmd wget http://10.104.180.58:80/ -O - -T 5 -t 1 passed
2024-09-13 21:08:59,538 - DEBUG - [Pod Pod ctest-pod-07021306] Cmd output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
ctest-pod-49643381
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-13 21:08:59,595 - DEBUG - [Pod ctest-pod-07021306] Cmd: wget http://10.104.180.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-49643381
2024-09-13 21:08:59,595 - DEBUG - [Pod Pod ctest-pod-07021306] Cmd wget http://10.104.180.58:80/ -O - -T 5 -t 1 passed
2024-09-13 21:08:59,595 - DEBUG - [Pod Pod ctest-pod-07021306] Cmd output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-49643381
2024-09-13 21:08:59,669 - DEBUG - [Pod ctest-pod-07021306] Cmd: wget http://10.104.180.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-93441282
2024-09-13 21:08:59,669 - DEBUG - [Pod Pod ctest-pod-07021306] Cmd wget http://10.104.180.58:80/ -O - -T 5 -t 1 passed
2024-09-13 21:08:59,669 - DEBUG - [Pod Pod ctest-pod-07021306] Cmd output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-93441282
2024-09-13 21:08:59,669 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-49643381': 3, 'ctest-pod-93441282': 1}
2024-09-13 21:08:59,673 - DEBUG - Network policy ingress-on-service not present
2024-09-13 21:08:59,673 - INFO - Creating Network Policy ingress-on-service
2024-09-13 21:08:59,684 - INFO - Network policy found in k8s
2024-09-13 21:08:59,685 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=a225e3ec-f295-41a7-9a00-3675250ec12f
2024-09-13 21:08:59,692 - INFO - Network Policy ingress-on-service with uuid a225e3ec-f295-41a7-9a00-3675250ec12f found in kube manager
2024-09-13 21:08:59,726 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2024-09-13 21:08:59,726 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2024-09-13 21:08:59,727 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=a225e3ec-f295-41a7-9a00-3675250ec12f
2024-09-13 21:08:59,756 - WARNING - Network policy with name ingress-on-service not found in agent
2024-09-13 21:09:01,757 - DEBUG - Requesting: http://10.0.0.37:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=a225e3ec-f295-41a7-9a00-3675250ec12f
2024-09-13 21:09:01,788 - INFO - Network policy with name ingress-on-service found in agent
2024-09-13 21:09:01,788 - INFO - Network Policy ingress-on-service verification passed
2024-09-13 21:09:06,856 - DEBUG - [Pod ctest-pod-72335017] Cmd: wget http://10.104.180.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:09:06,856 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd wget http://10.104.180.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:09:06,856 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:09:11,912 - DEBUG - [Pod ctest-pod-72335017] Cmd: wget http://10.104.180.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:09:11,912 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd wget http://10.104.180.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:09:11,912 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:09:16,977 - DEBUG - [Pod ctest-pod-72335017] Cmd: wget http://10.104.180.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:09:16,977 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd wget http://10.104.180.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:09:16,977 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:09:22,036 - DEBUG - [Pod ctest-pod-72335017] Cmd: wget http://10.104.180.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:09:22,036 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd wget http://10.104.180.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:09:22,036 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:09:27,095 - DEBUG - [Pod ctest-pod-72335017] Cmd: wget http://10.104.180.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:09:27,095 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd wget http://10.104.180.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:09:27,095 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:09:32,152 - DEBUG - [Pod ctest-pod-72335017] Cmd: wget http://10.104.180.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:09:32,152 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd wget http://10.104.180.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:09:32,152 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:09:37,219 - DEBUG - [Pod ctest-pod-72335017] Cmd: wget http://10.104.180.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:09:37,220 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd wget http://10.104.180.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:09:37,220 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:09:42,271 - DEBUG - [Pod ctest-pod-72335017] Cmd: wget http://10.104.180.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:09:42,271 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd wget http://10.104.180.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:09:42,272 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:09:47,330 - DEBUG - [Pod ctest-pod-72335017] Cmd: wget http://10.104.180.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:09:47,330 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd wget http://10.104.180.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:09:47,330 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:09:52,390 - DEBUG - [Pod ctest-pod-72335017] Cmd: wget http://10.104.180.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:09:52,390 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd wget http://10.104.180.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:09:52,390 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:09:52,390 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-49643381': 0, 'ctest-pod-93441282': 0}
2024-09-13 21:09:52,453 - DEBUG - [Pod ctest-pod-19651890] Cmd: wget http://10.104.180.58:80/ -O - -T 5 -t 1 , Output: ctest-pod-93441282
Connecting to 10.104.180.58:80 (10.104.180.58:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-13 21:09:52,453 - DEBUG - [Pod Pod ctest-pod-19651890] Cmd wget http://10.104.180.58:80/ -O - -T 5 -t 1 passed
2024-09-13 21:09:52,453 - DEBUG - [Pod Pod ctest-pod-19651890] Cmd output: ctest-pod-93441282
Connecting to 10.104.180.58:80 (10.104.180.58:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-13 21:09:52,513 - DEBUG - [Pod ctest-pod-19651890] Cmd: wget http://10.104.180.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-49643381
2024-09-13 21:09:52,514 - DEBUG - [Pod Pod ctest-pod-19651890] Cmd wget http://10.104.180.58:80/ -O - -T 5 -t 1 passed
2024-09-13 21:09:52,514 - DEBUG - [Pod Pod ctest-pod-19651890] Cmd output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-49643381
2024-09-13 21:09:52,514 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-49643381': 1, 'ctest-pod-93441282': 1}
2024-09-13 21:09:57,569 - DEBUG - [Pod ctest-pod-07021306] Cmd: wget http://10.104.180.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:09:57,569 - DEBUG - [Pod Pod ctest-pod-07021306] Cmd wget http://10.104.180.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:09:57,569 - DEBUG - [Pod Pod ctest-pod-07021306] Cmd output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:10:02,628 - DEBUG - [Pod ctest-pod-07021306] Cmd: wget http://10.104.180.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:10:02,628 - DEBUG - [Pod Pod ctest-pod-07021306] Cmd wget http://10.104.180.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:10:02,628 - DEBUG - [Pod Pod ctest-pod-07021306] Cmd output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:10:07,693 - DEBUG - [Pod ctest-pod-07021306] Cmd: wget http://10.104.180.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:10:07,693 - DEBUG - [Pod Pod ctest-pod-07021306] Cmd wget http://10.104.180.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:10:07,693 - DEBUG - [Pod Pod ctest-pod-07021306] Cmd output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:10:12,753 - DEBUG - [Pod ctest-pod-07021306] Cmd: wget http://10.104.180.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:10:12,753 - DEBUG - [Pod Pod ctest-pod-07021306] Cmd wget http://10.104.180.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:10:12,753 - DEBUG - [Pod Pod ctest-pod-07021306] Cmd output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:10:17,831 - DEBUG - [Pod ctest-pod-07021306] Cmd: wget http://10.104.180.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:10:17,831 - DEBUG - [Pod Pod ctest-pod-07021306] Cmd wget http://10.104.180.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:10:17,831 - DEBUG - [Pod Pod ctest-pod-07021306] Cmd output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:10:22,902 - DEBUG - [Pod ctest-pod-07021306] Cmd: wget http://10.104.180.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:10:22,902 - DEBUG - [Pod Pod ctest-pod-07021306] Cmd wget http://10.104.180.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:10:22,902 - DEBUG - [Pod Pod ctest-pod-07021306] Cmd output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:10:27,960 - DEBUG - [Pod ctest-pod-07021306] Cmd: wget http://10.104.180.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:10:27,960 - DEBUG - [Pod Pod ctest-pod-07021306] Cmd wget http://10.104.180.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:10:27,960 - DEBUG - [Pod Pod ctest-pod-07021306] Cmd output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:10:33,032 - DEBUG - [Pod ctest-pod-07021306] Cmd: wget http://10.104.180.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:10:33,032 - DEBUG - [Pod Pod ctest-pod-07021306] Cmd wget http://10.104.180.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:10:33,032 - DEBUG - [Pod Pod ctest-pod-07021306] Cmd output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:10:38,100 - DEBUG - [Pod ctest-pod-07021306] Cmd: wget http://10.104.180.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:10:38,100 - DEBUG - [Pod Pod ctest-pod-07021306] Cmd wget http://10.104.180.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:10:38,100 - DEBUG - [Pod Pod ctest-pod-07021306] Cmd output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:10:43,160 - DEBUG - [Pod ctest-pod-07021306] Cmd: wget http://10.104.180.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:10:43,160 - DEBUG - [Pod Pod ctest-pod-07021306] Cmd wget http://10.104.180.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:10:43,160 - DEBUG - [Pod Pod ctest-pod-07021306] Cmd output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:10:43,160 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-49643381': 0, 'ctest-pod-93441282': 0}
2024-09-13 21:10:45,212 - DEBUG - [Pod ctest-pod-19651890] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.167 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.080 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.074 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.074/0.440/1.167 ms
2024-09-13 21:10:45,212 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-19651890 with expectation True passed
2024-09-13 21:10:47,272 - DEBUG - [Pod ctest-pod-72335017] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.250 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.069 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.075 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.069/0.464/1.250 ms
2024-09-13 21:10:47,272 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-72335017 with expectation True passed
2024-09-13 21:10:49,336 - DEBUG - [Pod ctest-pod-07021306] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.336 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.059 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.065 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.059/0.486/1.336 ms
2024-09-13 21:10:49,336 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-07021306 with expectation True passed
2024-09-13 21:10:49,402 - DEBUG - [Pod ctest-pod-19651890] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-13 21:10:49,403 - DEBUG - [Pod Pod ctest-pod-19651890] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-09-13 21:10:49,403 - DEBUG - [Pod Pod ctest-pod-19651890] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-13 21:10:49,403 - INFO - wget check of of http://10.47.255.251 from ctest-pod-19651890 passed
2024-09-13 21:10:49,462 - DEBUG - [Pod ctest-pod-19651890] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-13 21:10:49,462 - DEBUG - [Pod Pod ctest-pod-19651890] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-09-13 21:10:49,462 - DEBUG - [Pod Pod ctest-pod-19651890] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-13 21:10:49,462 - INFO - wget check of of http://10.47.255.250 from ctest-pod-19651890 passed
2024-09-13 21:10:54,520 - DEBUG - [Pod ctest-pod-72335017] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-13 21:10:54,520 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-13 21:10:54,520 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-13 21:10:54,520 - INFO - wget check of of http://10.47.255.250 from ctest-pod-72335017 passed
2024-09-13 21:10:59,580 - DEBUG - [Pod ctest-pod-89046352] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-09-13 21:10:59,580 - DEBUG - [Pod Pod ctest-pod-89046352] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-09-13 21:10:59,580 - DEBUG - [Pod Pod ctest-pod-89046352] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-09-13 21:10:59,581 - INFO - wget check of of http://10.47.255.251 from ctest-pod-89046352 passed
2024-09-13 21:10:59,589 - INFO - Updating Network Policy ingress-on-service
2024-09-13 21:11:04,651 - DEBUG - [Pod ctest-pod-72335017] Cmd: wget http://10.104.180.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:11:04,651 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd wget http://10.104.180.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:11:04,651 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:11:09,715 - DEBUG - [Pod ctest-pod-72335017] Cmd: wget http://10.104.180.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:11:09,715 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd wget http://10.104.180.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:11:09,715 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:11:14,790 - DEBUG - [Pod ctest-pod-72335017] Cmd: wget http://10.104.180.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:11:14,790 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd wget http://10.104.180.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:11:14,790 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:11:19,859 - DEBUG - [Pod ctest-pod-72335017] Cmd: wget http://10.104.180.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:11:19,859 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd wget http://10.104.180.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:11:19,860 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:11:24,925 - DEBUG - [Pod ctest-pod-72335017] Cmd: wget http://10.104.180.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:11:24,925 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd wget http://10.104.180.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:11:24,925 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:11:29,991 - DEBUG - [Pod ctest-pod-72335017] Cmd: wget http://10.104.180.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:11:29,991 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd wget http://10.104.180.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:11:29,992 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:11:35,047 - DEBUG - [Pod ctest-pod-72335017] Cmd: wget http://10.104.180.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:11:35,048 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd wget http://10.104.180.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:11:35,048 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:11:40,121 - DEBUG - [Pod ctest-pod-72335017] Cmd: wget http://10.104.180.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:11:40,121 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd wget http://10.104.180.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:11:40,121 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:11:45,185 - DEBUG - [Pod ctest-pod-72335017] Cmd: wget http://10.104.180.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:11:45,186 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd wget http://10.104.180.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:11:45,186 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:11:50,234 - DEBUG - [Pod ctest-pod-72335017] Cmd: wget http://10.104.180.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:11:50,234 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd wget http://10.104.180.58:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:11:50,234 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
wget: download timed out
2024-09-13 21:11:50,234 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-49643381': 0, 'ctest-pod-93441282': 0}
2024-09-13 21:11:50,291 - DEBUG - [Pod ctest-pod-19651890] Cmd: wget http://10.104.180.58:80/ -O - -T 5 -t 1 , Output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-49643381
2024-09-13 21:11:50,291 - DEBUG - [Pod Pod ctest-pod-19651890] Cmd wget http://10.104.180.58:80/ -O - -T 5 -t 1 passed
2024-09-13 21:11:50,291 - DEBUG - [Pod Pod ctest-pod-19651890] Cmd output: Connecting to 10.104.180.58:80 (10.104.180.58:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-49643381
2024-09-13 21:11:50,346 - DEBUG - [Pod ctest-pod-19651890] Cmd: wget http://10.104.180.58:80/ -O - -T 5 -t 1 , Output: ctest-pod-93441282
Connecting to 10.104.180.58:80 (10.104.180.58:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-13 21:11:50,346 - DEBUG - [Pod Pod ctest-pod-19651890] Cmd wget http://10.104.180.58:80/ -O - -T 5 -t 1 passed
2024-09-13 21:11:50,346 - DEBUG - [Pod Pod ctest-pod-19651890] Cmd output: ctest-pod-93441282
Connecting to 10.104.180.58:80 (10.104.180.58:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-13 21:11:50,346 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-49643381': 1, 'ctest-pod-93441282': 1}
2024-09-13 21:11:50,397 - DEBUG - [Pod ctest-pod-07021306] Cmd: wget http://10.104.180.58:80/ -O - -T 5 -t 1 , Output: ctest-pod-49643381
Connecting to 10.104.180.58:80 (10.104.180.58:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-13 21:11:50,397 - DEBUG - [Pod Pod ctest-pod-07021306] Cmd wget http://10.104.180.58:80/ -O - -T 5 -t 1 passed
2024-09-13 21:11:50,397 - DEBUG - [Pod Pod ctest-pod-07021306] Cmd output: ctest-pod-49643381
Connecting to 10.104.180.58:80 (10.104.180.58:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-13 21:11:50,438 - DEBUG - [Pod ctest-pod-07021306] Cmd: wget http://10.104.180.58:80/ -O - -T 5 -t 1 , Output: ctest-pod-49643381
Connecting to 10.104.180.58:80 (10.104.180.58:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-13 21:11:50,438 - DEBUG - [Pod Pod ctest-pod-07021306] Cmd wget http://10.104.180.58:80/ -O - -T 5 -t 1 passed
2024-09-13 21:11:50,438 - DEBUG - [Pod Pod ctest-pod-07021306] Cmd output: ctest-pod-49643381
Connecting to 10.104.180.58:80 (10.104.180.58:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-13 21:11:50,497 - DEBUG - [Pod ctest-pod-07021306] Cmd: wget http://10.104.180.58:80/ -O - -T 5 -t 1 , Output: ctest-pod-93441282
Connecting to 10.104.180.58:80 (10.104.180.58:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-13 21:11:50,497 - DEBUG - [Pod Pod ctest-pod-07021306] Cmd wget http://10.104.180.58:80/ -O - -T 5 -t 1 passed
2024-09-13 21:11:50,497 - DEBUG - [Pod Pod ctest-pod-07021306] Cmd output: ctest-pod-93441282
Connecting to 10.104.180.58:80 (10.104.180.58:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-13 21:11:50,497 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-49643381': 2, 'ctest-pod-93441282': 1}
2024-09-13 21:11:52,550 - DEBUG - [Pod ctest-pod-19651890] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.663 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.073 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.083 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.073/0.273/0.663 ms
2024-09-13 21:11:52,551 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-19651890 with expectation True passed
2024-09-13 21:11:54,604 - DEBUG - [Pod ctest-pod-72335017] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.116 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.080 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.086 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.080/0.427/1.116 ms
2024-09-13 21:11:54,604 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-72335017 with expectation True passed
2024-09-13 21:11:56,655 - DEBUG - [Pod ctest-pod-07021306] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.098 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.069 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.111 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.069/0.426/1.098 ms
2024-09-13 21:11:56,656 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-07021306 with expectation True passed
2024-09-13 21:11:56,714 - DEBUG - [Pod ctest-pod-19651890] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-13 21:11:56,714 - DEBUG - [Pod Pod ctest-pod-19651890] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-09-13 21:11:56,714 - DEBUG - [Pod Pod ctest-pod-19651890] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-13 21:11:56,714 - INFO - wget check of of http://10.47.255.251 from ctest-pod-19651890 passed
2024-09-13 21:11:56,788 - DEBUG - [Pod ctest-pod-19651890] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-13 21:11:56,789 - DEBUG - [Pod Pod ctest-pod-19651890] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-09-13 21:11:56,789 - DEBUG - [Pod Pod ctest-pod-19651890] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-13 21:11:56,789 - INFO - wget check of of http://10.47.255.250 from ctest-pod-19651890 passed
2024-09-13 21:12:01,860 - DEBUG - [Pod ctest-pod-72335017] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-13 21:12:01,860 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-13 21:12:01,860 - DEBUG - [Pod Pod ctest-pod-72335017] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-13 21:12:01,860 - INFO - wget check of of http://10.47.255.250 from ctest-pod-72335017 passed
2024-09-13 21:12:01,937 - DEBUG - [Pod ctest-pod-89046352] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-13 21:12:01,937 - DEBUG - [Pod Pod ctest-pod-89046352] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-09-13 21:12:01,937 - DEBUG - [Pod Pod ctest-pod-89046352] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-13 21:12:01,938 - INFO - wget check of of http://10.47.255.251 from ctest-pod-89046352 passed
2024-09-13 21:12:01,938 - INFO - Deleting Network Policy : ingress-on-service
2024-09-13 21:12:01,938 - INFO - Deleting service : ctest-nginx-svc-34191574
2024-09-13 21:12:02,162 - DEBUG - No XMPP flaps were noticed during the test
2024-09-13 21:12:02,162 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:06]
2024-09-13 21:12:02,162 - INFO - --------------------------------------------------------------------------------
2024-09-13 21:12:02,167 - INFO - Deleting pod ctest-new-default-58722540:ctest-pod-49643381
2024-09-13 21:12:02,168 - INFO - Deleting pod ctest-new-default-58722540:ctest-pod-93441282
2024-09-13 21:12:02,168 - INFO - Deleting pod ctest-non-default-00820998:ctest-pod-94420166
2024-09-13 21:12:02,169 - INFO - Deleting pod ctest-non-default-00820998:ctest-pod-23504572
2024-09-13 21:12:02,169 - INFO - Deleting pod ctest-new-default-58722540:ctest-pod-72335017
2024-09-13 21:12:02,169 - INFO - Deleting pod ctest-new-default-58722540:ctest-pod-19651890
2024-09-13 21:12:02,170 - INFO - Deleting pod ctest-non-default-00820998:ctest-pod-07021306
2024-09-13 21:12:02,170 - INFO - Deleting pod ctest-non-default-00820998:ctest-pod-89046352
2024-09-13 21:12:02,282 - WARNING - Pod uuid 34578383-1162-4377-ae46-6ac449713bba is still seen in agent 10.0.0.40 VM list
2024-09-13 21:12:02,284 - WARNING - Pod uuid 61fbd67a-d0c3-449e-96a6-a101e356d481 is still seen in agent 10.0.0.40 VM list
2024-09-13 21:12:02,285 - WARNING - Pod uuid 5a9aff69-26c8-4a53-89df-9bc785148a13 is still seen in agent 10.0.0.40 VM list
2024-09-13 21:12:02,285 - WARNING - Pod uuid 0ff09adc-fc94-44ab-83df-3e9c2be16022 is still seen in agent 10.0.0.40 VM list
2024-09-13 21:12:02,286 - WARNING - Pod uuid 64874fdd-68f5-40a6-8002-fec2e3fa6782 is still seen in agent 10.0.0.40 VM list
2024-09-13 21:12:02,316 - WARNING - Pod uuid 510e9ef7-320e-45ef-bbad-476ffe7fd4d1 is still seen in agent 10.0.0.40 VM list
2024-09-13 21:12:02,317 - WARNING - Pod uuid b77960bb-698f-4aa0-94c1-20877e2abf05 is still seen in agent 10.0.0.40 VM list
2024-09-13 21:12:02,318 - WARNING - Pod uuid 1483a3dd-9d6b-421c-957e-9c07494caf41 is still seen in agent 10.0.0.40 VM list
2024-09-13 21:12:07,307 - WARNING - Pod uuid 61fbd67a-d0c3-449e-96a6-a101e356d481 is still seen in agent 10.0.0.40 VM list
2024-09-13 21:12:07,308 - DEBUG - Pod 34578383-1162-4377-ae46-6ac449713bba is not in agent 10.0.0.40 VM list
2024-09-13 21:12:07,311 - DEBUG - Pod 5a9aff69-26c8-4a53-89df-9bc785148a13 is not in agent 10.0.0.40 VM list
2024-09-13 21:12:07,313 - DEBUG - Pod 0ff09adc-fc94-44ab-83df-3e9c2be16022 is not in agent 10.0.0.40 VM list
2024-09-13 21:12:07,314 - DEBUG - Pod 64874fdd-68f5-40a6-8002-fec2e3fa6782 is not in agent 10.0.0.40 VM list
2024-09-13 21:12:07,337 - WARNING - Pod uuid 510e9ef7-320e-45ef-bbad-476ffe7fd4d1 is still seen in agent 10.0.0.40 VM list
2024-09-13 21:12:07,340 - WARNING - Pod uuid b77960bb-698f-4aa0-94c1-20877e2abf05 is still seen in agent 10.0.0.40 VM list
2024-09-13 21:12:07,340 - WARNING - Pod uuid 1483a3dd-9d6b-421c-957e-9c07494caf41 is still seen in agent 10.0.0.40 VM list
2024-09-13 21:12:07,340 - DEBUG - VMI 5847d23e-7214-11ef-bef4-fa163ee8f531 is removed from agent 10.0.0.40
2024-09-13 21:12:07,341 - INFO - Verified that pod ctest-pod-23504572 is removed in agent
2024-09-13 21:12:07,341 - DEBUG - VMI 56e92cda-7214-11ef-bef4-fa163ee8f531 is removed from agent 10.0.0.40
2024-09-13 21:12:07,341 - INFO - Verified that pod ctest-pod-93441282 is removed in agent
2024-09-13 21:12:07,341 - DEBUG - VMI 57c2a5f0-7214-11ef-bef4-fa163ee8f531 is removed from agent 10.0.0.40
2024-09-13 21:12:07,341 - INFO - Verified that pod ctest-pod-94420166 is removed in agent
2024-09-13 21:12:07,342 - DEBUG - VMI 5635b826-7214-11ef-bef4-fa163ee8f531 is removed from agent 10.0.0.40
2024-09-13 21:12:07,342 - INFO - Verified that pod ctest-pod-49643381 is removed in agent
2024-09-13 21:12:12,317 - WARNING - Pod uuid 61fbd67a-d0c3-449e-96a6-a101e356d481 is still seen in agent 10.0.0.40 VM list
2024-09-13 21:12:12,355 - WARNING - Pod uuid 510e9ef7-320e-45ef-bbad-476ffe7fd4d1 is still seen in agent 10.0.0.40 VM list
2024-09-13 21:12:12,358 - WARNING - Pod uuid 1483a3dd-9d6b-421c-957e-9c07494caf41 is still seen in agent 10.0.0.40 VM list
2024-09-13 21:12:12,359 - WARNING - Pod uuid b77960bb-698f-4aa0-94c1-20877e2abf05 is still seen in agent 10.0.0.40 VM list
2024-09-13 21:12:17,324 - WARNING - Pod uuid 61fbd67a-d0c3-449e-96a6-a101e356d481 is still seen in agent 10.0.0.40 VM list
2024-09-13 21:12:17,371 - WARNING - Pod uuid 510e9ef7-320e-45ef-bbad-476ffe7fd4d1 is still seen in agent 10.0.0.40 VM list
2024-09-13 21:12:17,372 - WARNING - Pod uuid b77960bb-698f-4aa0-94c1-20877e2abf05 is still seen in agent 10.0.0.40 VM list
2024-09-13 21:12:17,373 - WARNING - Pod uuid 1483a3dd-9d6b-421c-957e-9c07494caf41 is still seen in agent 10.0.0.40 VM list
2024-09-13 21:12:22,332 - WARNING - Pod uuid 61fbd67a-d0c3-449e-96a6-a101e356d481 is still seen in agent 10.0.0.40 VM list
2024-09-13 21:12:22,385 - WARNING - Pod uuid 510e9ef7-320e-45ef-bbad-476ffe7fd4d1 is still seen in agent 10.0.0.40 VM list
2024-09-13 21:12:22,386 - WARNING - Pod uuid b77960bb-698f-4aa0-94c1-20877e2abf05 is still seen in agent 10.0.0.40 VM list
2024-09-13 21:12:22,387 - WARNING - Pod uuid 1483a3dd-9d6b-421c-957e-9c07494caf41 is still seen in agent 10.0.0.40 VM list
2024-09-13 21:12:27,341 - WARNING - Pod uuid 61fbd67a-d0c3-449e-96a6-a101e356d481 is still seen in agent 10.0.0.40 VM list
2024-09-13 21:12:27,400 - WARNING - Pod uuid 510e9ef7-320e-45ef-bbad-476ffe7fd4d1 is still seen in agent 10.0.0.40 VM list
2024-09-13 21:12:27,401 - WARNING - Pod uuid 1483a3dd-9d6b-421c-957e-9c07494caf41 is still seen in agent 10.0.0.40 VM list
2024-09-13 21:12:27,401 - WARNING - Pod uuid b77960bb-698f-4aa0-94c1-20877e2abf05 is still seen in agent 10.0.0.40 VM list
2024-09-13 21:12:32,417 - WARNING - Pod uuid 510e9ef7-320e-45ef-bbad-476ffe7fd4d1 is still seen in agent 10.0.0.40 VM list
2024-09-13 21:12:32,418 - WARNING - Pod uuid 61fbd67a-d0c3-449e-96a6-a101e356d481 is still seen in agent 10.0.0.40 VM list
2024-09-13 21:12:32,420 - WARNING - Pod uuid b77960bb-698f-4aa0-94c1-20877e2abf05 is still seen in agent 10.0.0.40 VM list
2024-09-13 21:12:32,420 - WARNING - Pod uuid 1483a3dd-9d6b-421c-957e-9c07494caf41 is still seen in agent 10.0.0.40 VM list
2024-09-13 21:12:37,436 - DEBUG - Pod 510e9ef7-320e-45ef-bbad-476ffe7fd4d1 is not in agent 10.0.0.40 VM list
2024-09-13 21:12:37,437 - DEBUG - Pod 61fbd67a-d0c3-449e-96a6-a101e356d481 is not in agent 10.0.0.40 VM list
2024-09-13 21:12:37,441 - DEBUG - Pod 1483a3dd-9d6b-421c-957e-9c07494caf41 is not in agent 10.0.0.40 VM list
2024-09-13 21:12:37,442 - DEBUG - Pod b77960bb-698f-4aa0-94c1-20877e2abf05 is not in agent 10.0.0.40 VM list
2024-09-13 21:12:37,455 - DEBUG - VMI 59bb78be-7214-11ef-bef4-fa163ee8f531 is removed from agent 10.0.0.40
2024-09-13 21:12:37,455 - INFO - Verified that pod ctest-pod-19651890 is removed in agent
2024-09-13 21:12:37,455 - DEBUG - VMI 5a615dd8-7214-11ef-bef4-fa163ee8f531 is removed from agent 10.0.0.40
2024-09-13 21:12:37,455 - INFO - Verified that pod ctest-pod-07021306 is removed in agent
2024-09-13 21:12:37,455 - DEBUG - VMI 5b065874-7214-11ef-bef4-fa163ee8f531 is removed from agent 10.0.0.40
2024-09-13 21:12:37,455 - INFO - Verified that pod ctest-pod-89046352 is removed in agent
2024-09-13 21:12:37,456 - DEBUG - VMI 58ec7ab4-7214-11ef-bef4-fa163ee8f531 is removed from agent 10.0.0.40
2024-09-13 21:12:37,456 - INFO - Verified that pod ctest-pod-72335017 is removed in agent
2024-09-13 21:12:37,457 - INFO - Deleting namespace ctest-non-default-00820998
2024-09-13 21:12:37,479 - DEBUG - Namespace ctest-non-default-00820998 still in k8s
2024-09-13 21:12:39,485 - DEBUG - Namespace ctest-non-default-00820998 still in k8s
2024-09-13 21:12:41,491 - DEBUG - Namespace ctest-non-default-00820998 still in k8s
2024-09-13 21:12:43,494 - DEBUG - Namespace ctest-non-default-00820998 is not in k8s
2024-09-13 21:12:43,494 - DEBUG - No need to check project deletion in contrail-api
2024-09-13 21:12:43,494 - INFO - Deleting namespace ctest-new-default-58722540
2024-09-13 21:12:43,505 - DEBUG - Namespace ctest-new-default-58722540 still in k8s
2024-09-13 21:12:45,510 - DEBUG - Namespace ctest-new-default-58722540 still in k8s
2024-09-13 21:12:47,515 - DEBUG - Namespace ctest-new-default-58722540 still in k8s
2024-09-13 21:12:49,519 - DEBUG - Namespace ctest-new-default-58722540 is not in k8s
2024-09-13 21:12:49,519 - DEBUG - No need to check project deletion in contrail-api