2025-03-20 16:47:35,373 - INFO - Using existing project ['default-domain', 'k8s-default'](57dfef26-7629-410c-b18c-a227264552f3)
2025-03-20 16:47:35,392 - DEBUG - Namespace ctest-new-default-04057795 not present
2025-03-20 16:47:35,408 - INFO - Created namespace ctest-new-default-04057795
2025-03-20 16:47:38,413 - DEBUG - Namespace ctest-non-default-66429036 not present
2025-03-20 16:47:38,420 - INFO - Created namespace ctest-non-default-66429036
2025-03-20 16:47:41,441 - DEBUG - Pod ctest-pod-95318195 not present
2025-03-20 16:47:41,441 - INFO - Creating Pod ctest-pod-95318195
2025-03-20 16:47:41,484 - DEBUG - Pod : ctest-pod-95318195 UUID is 788aa784-f2b4-40a4-87c7-ba029d450425
2025-03-20 16:47:41,486 - DEBUG - Pod ctest-pod-60059436 not present
2025-03-20 16:47:41,486 - INFO - Creating Pod ctest-pod-60059436
2025-03-20 16:47:41,525 - DEBUG - Pod : ctest-pod-60059436 UUID is 179228d6-41a6-46d8-942a-d49fc57a20cf
2025-03-20 16:47:41,532 - DEBUG - Pod ctest-pod-80862463 not present
2025-03-20 16:47:41,533 - INFO - Creating Pod ctest-pod-80862463
2025-03-20 16:47:41,583 - DEBUG - Pod : ctest-pod-80862463 UUID is 8bb193c0-6053-4bea-bc69-a3ed5d81cad2
2025-03-20 16:47:41,588 - DEBUG - Pod ctest-pod-75467051 not present
2025-03-20 16:47:41,589 - INFO - Creating Pod ctest-pod-75467051
2025-03-20 16:47:41,620 - DEBUG - Pod : ctest-pod-75467051 UUID is 4d6315eb-b64b-49a5-a6fd-7944c61c639b
2025-03-20 16:47:41,624 - DEBUG - Pod ctest-pod-37463106 not present
2025-03-20 16:47:41,625 - INFO - Creating Pod ctest-pod-37463106
2025-03-20 16:47:41,639 - DEBUG - Pod : ctest-pod-37463106 UUID is 02f461fc-3624-41d5-adbd-beaf4490e84c
2025-03-20 16:47:41,642 - DEBUG - Pod ctest-pod-92411385 not present
2025-03-20 16:47:41,642 - INFO - Creating Pod ctest-pod-92411385
2025-03-20 16:47:41,669 - DEBUG - Pod : ctest-pod-92411385 UUID is 2d02ab3b-ca51-417b-bfaa-50bd967328f4
2025-03-20 16:47:41,671 - DEBUG - Pod ctest-pod-21404360 not present
2025-03-20 16:47:41,672 - INFO - Creating Pod ctest-pod-21404360
2025-03-20 16:47:41,691 - DEBUG - Pod : ctest-pod-21404360 UUID is 6d773a74-d29a-4237-9040-7b543524dbc3
2025-03-20 16:47:41,694 - DEBUG - Pod ctest-pod-04946158 not present
2025-03-20 16:47:41,694 - INFO - Creating Pod ctest-pod-04946158
2025-03-20 16:47:41,734 - DEBUG - Pod : ctest-pod-04946158 UUID is 41dbd8d0-f01c-4f15-8ce7-3af81f3c4038
2025-03-20 16:47:41,923 - INFO - Project default-domain:k8s-ctest-new-default-04057795 for Namespace ctest-new-default-04057795 is seen in contrail-api
2025-03-20 16:47:41,923 - DEBUG - Project uuid in Contrail is 49f6a9cc-aecd-4bd2-9782-b7aee6903d76
2025-03-20 16:47:42,118 - DEBUG - Requesting: http://10.0.0.46:8108/Snh_NamespaceDatabaseList?namespace_uuid=cf0ce930-6322-4382-9c32-b02c4d27a262
2025-03-20 16:47:42,123 - INFO - Namespace ctest-new-default-04057795 with uuid cf0ce930-6322-4382-9c32-b02c4d27a262 found in kube manager
2025-03-20 16:47:42,124 - INFO - Namespace ctest-new-default-04057795 verification passed
2025-03-20 16:47:42,312 - INFO - Project default-domain:k8s-ctest-non-default-66429036 for Namespace ctest-non-default-66429036 is seen in contrail-api
2025-03-20 16:47:42,313 - DEBUG - Project uuid in Contrail is 0becff5d-92a6-4111-acf8-1b44ae913047
2025-03-20 16:47:42,313 - DEBUG - Requesting: http://10.0.0.46:8108/Snh_NamespaceDatabaseList?namespace_uuid=15de375c-687d-4d94-93bb-465edf4e8474
2025-03-20 16:47:42,324 - INFO - Namespace ctest-non-default-66429036 with uuid 15de375c-687d-4d94-93bb-465edf4e8474 found in kube manager
2025-03-20 16:47:42,324 - INFO - Namespace ctest-non-default-66429036 verification passed
2025-03-20 16:47:42,330 - DEBUG - Pod ctest-pod-95318195 not in running state.Currently in Pending
2025-03-20 16:47:47,336 - DEBUG - Pod ctest-pod-95318195 not in running state.Currently in Pending
2025-03-20 16:47:52,350 - DEBUG - Pod ctest-pod-95318195 not in running state.Currently in Pending
2025-03-20 16:47:57,358 - INFO - Pod ctest-pod-95318195 is in running state.Got IP 10.47.255.251
2025-03-20 16:47:57,413 - DEBUG - Pod ctest-pod-95318195 has vmi 0b2287ee-05ab-11f0-a10d-fa163e0c3e02
2025-03-20 16:47:57,413 - INFO - Verified pod ctest-pod-95318195 in contrail-api
2025-03-20 16:47:57,432 - DEBUG - VMI 0b2287ee-05ab-11f0-a10d-fa163e0c3e02 is active in agent 10.0.0.12
2025-03-20 16:47:57,432 - INFO - Verified Pod ctest-pod-95318195 in agent 10.0.0.12
2025-03-20 16:47:57,432 - DEBUG - Requesting: http://10.0.0.46:8108/Snh_VirtualMachineDatabaseList?x=788aa784-f2b4-40a4-87c7-ba029d450425
2025-03-20 16:47:57,438 - INFO - Pod ctest-pod-95318195 with uuid 788aa784-f2b4-40a4-87c7-ba029d450425 found in kube manager
2025-03-20 16:47:57,438 - INFO - Pod ctest-pod-95318195 verification passed
2025-03-20 16:47:57,443 - INFO - Pod ctest-pod-60059436 is in running state.Got IP 10.47.255.250
2025-03-20 16:47:57,457 - DEBUG - Pod ctest-pod-60059436 has vmi 0ba5b0ce-05ab-11f0-a10d-fa163e0c3e02
2025-03-20 16:47:57,457 - INFO - Verified pod ctest-pod-60059436 in contrail-api
2025-03-20 16:47:57,473 - DEBUG - VMI 0ba5b0ce-05ab-11f0-a10d-fa163e0c3e02 is active in agent 10.0.0.12
2025-03-20 16:47:57,473 - INFO - Verified Pod ctest-pod-60059436 in agent 10.0.0.12
2025-03-20 16:47:57,473 - DEBUG - Requesting: http://10.0.0.46:8108/Snh_VirtualMachineDatabaseList?x=179228d6-41a6-46d8-942a-d49fc57a20cf
2025-03-20 16:47:57,494 - INFO - Pod ctest-pod-60059436 with uuid 179228d6-41a6-46d8-942a-d49fc57a20cf found in kube manager
2025-03-20 16:47:57,494 - INFO - Pod ctest-pod-60059436 verification passed
2025-03-20 16:47:57,499 - INFO - Pod ctest-pod-80862463 is in running state.Got IP 10.47.255.249
2025-03-20 16:47:57,561 - DEBUG - Pod ctest-pod-80862463 has vmi 0c513e08-05ab-11f0-a10d-fa163e0c3e02
2025-03-20 16:47:57,561 - INFO - Verified pod ctest-pod-80862463 in contrail-api
2025-03-20 16:47:57,578 - DEBUG - VMI 0c513e08-05ab-11f0-a10d-fa163e0c3e02 is active in agent 10.0.0.12
2025-03-20 16:47:57,578 - INFO - Verified Pod ctest-pod-80862463 in agent 10.0.0.12
2025-03-20 16:47:57,578 - DEBUG - Requesting: http://10.0.0.46:8108/Snh_VirtualMachineDatabaseList?x=8bb193c0-6053-4bea-bc69-a3ed5d81cad2
2025-03-20 16:47:57,583 - INFO - Pod ctest-pod-80862463 with uuid 8bb193c0-6053-4bea-bc69-a3ed5d81cad2 found in kube manager
2025-03-20 16:47:57,584 - INFO - Pod ctest-pod-80862463 verification passed
2025-03-20 16:47:57,590 - INFO - Pod ctest-pod-75467051 is in running state.Got IP 10.47.255.248
2025-03-20 16:47:57,609 - DEBUG - Pod ctest-pod-75467051 has vmi 0cd28602-05ab-11f0-a10d-fa163e0c3e02
2025-03-20 16:47:57,609 - INFO - Verified pod ctest-pod-75467051 in contrail-api
2025-03-20 16:47:57,623 - DEBUG - VMI 0cd28602-05ab-11f0-a10d-fa163e0c3e02 is active in agent 10.0.0.12
2025-03-20 16:47:57,623 - INFO - Verified Pod ctest-pod-75467051 in agent 10.0.0.12
2025-03-20 16:47:57,623 - DEBUG - Requesting: http://10.0.0.46:8108/Snh_VirtualMachineDatabaseList?x=4d6315eb-b64b-49a5-a6fd-7944c61c639b
2025-03-20 16:47:57,628 - INFO - Pod ctest-pod-75467051 with uuid 4d6315eb-b64b-49a5-a6fd-7944c61c639b found in kube manager
2025-03-20 16:47:57,629 - INFO - Pod ctest-pod-75467051 verification passed
2025-03-20 16:47:57,633 - INFO - Pod ctest-pod-37463106 is in running state.Got IP 10.47.255.247
2025-03-20 16:47:57,690 - DEBUG - Pod ctest-pod-37463106 has vmi 0d62cc62-05ab-11f0-a10d-fa163e0c3e02
2025-03-20 16:47:57,690 - INFO - Verified pod ctest-pod-37463106 in contrail-api
2025-03-20 16:47:57,706 - DEBUG - VMI 0d62cc62-05ab-11f0-a10d-fa163e0c3e02 is active in agent 10.0.0.12
2025-03-20 16:47:57,706 - INFO - Verified Pod ctest-pod-37463106 in agent 10.0.0.12
2025-03-20 16:47:57,706 - DEBUG - Requesting: http://10.0.0.46:8108/Snh_VirtualMachineDatabaseList?x=02f461fc-3624-41d5-adbd-beaf4490e84c
2025-03-20 16:47:57,712 - INFO - Pod ctest-pod-37463106 with uuid 02f461fc-3624-41d5-adbd-beaf4490e84c found in kube manager
2025-03-20 16:47:57,712 - INFO - Pod ctest-pod-37463106 verification passed
2025-03-20 16:47:57,719 - DEBUG - Pod ctest-pod-21404360 not in running state.Currently in Pending
2025-03-20 16:48:02,726 - INFO - Pod ctest-pod-21404360 is in running state.Got IP 10.47.255.245
2025-03-20 16:48:02,740 - DEBUG - Pod ctest-pod-21404360 has vmi 0e63bc66-05ab-11f0-a10d-fa163e0c3e02
2025-03-20 16:48:02,740 - INFO - Verified pod ctest-pod-21404360 in contrail-api
2025-03-20 16:48:02,754 - DEBUG - VMI 0e63bc66-05ab-11f0-a10d-fa163e0c3e02 is active in agent 10.0.0.12
2025-03-20 16:48:02,754 - INFO - Verified Pod ctest-pod-21404360 in agent 10.0.0.12
2025-03-20 16:48:02,754 - DEBUG - Requesting: http://10.0.0.46:8108/Snh_VirtualMachineDatabaseList?x=6d773a74-d29a-4237-9040-7b543524dbc3
2025-03-20 16:48:02,759 - INFO - Pod ctest-pod-21404360 with uuid 6d773a74-d29a-4237-9040-7b543524dbc3 found in kube manager
2025-03-20 16:48:02,759 - INFO - Pod ctest-pod-21404360 verification passed
2025-03-20 16:48:02,832 - INFO - Pod ctest-pod-92411385 is in running state.Got IP 10.47.255.246
2025-03-20 16:48:02,889 - DEBUG - Pod ctest-pod-92411385 has vmi 0deafb96-05ab-11f0-a10d-fa163e0c3e02
2025-03-20 16:48:02,889 - INFO - Verified pod ctest-pod-92411385 in contrail-api
2025-03-20 16:48:02,904 - DEBUG - VMI 0deafb96-05ab-11f0-a10d-fa163e0c3e02 is active in agent 10.0.0.12
2025-03-20 16:48:02,904 - INFO - Verified Pod ctest-pod-92411385 in agent 10.0.0.12
2025-03-20 16:48:02,904 - DEBUG - Requesting: http://10.0.0.46:8108/Snh_VirtualMachineDatabaseList?x=2d02ab3b-ca51-417b-bfaa-50bd967328f4
2025-03-20 16:48:02,910 - INFO - Pod ctest-pod-92411385 with uuid 2d02ab3b-ca51-417b-bfaa-50bd967328f4 found in kube manager
2025-03-20 16:48:02,910 - INFO - Pod ctest-pod-92411385 verification passed
2025-03-20 16:48:02,916 - INFO - Pod ctest-pod-04946158 is in running state.Got IP 10.47.255.244
2025-03-20 16:48:02,934 - DEBUG - Pod ctest-pod-04946158 has vmi 0ed84040-05ab-11f0-a10d-fa163e0c3e02
2025-03-20 16:48:02,934 - INFO - Verified pod ctest-pod-04946158 in contrail-api
2025-03-20 16:48:02,950 - DEBUG - VMI 0ed84040-05ab-11f0-a10d-fa163e0c3e02 is active in agent 10.0.0.12
2025-03-20 16:48:02,950 - INFO - Verified Pod ctest-pod-04946158 in agent 10.0.0.12
2025-03-20 16:48:02,950 - DEBUG - Requesting: http://10.0.0.46:8108/Snh_VirtualMachineDatabaseList?x=41dbd8d0-f01c-4f15-8ce7-3af81f3c4038
2025-03-20 16:48:02,955 - INFO - Pod ctest-pod-04946158 with uuid 41dbd8d0-f01c-4f15-8ce7-3af81f3c4038 found in kube manager
2025-03-20 16:48:02,955 - INFO - Pod ctest-pod-04946158 verification passed
2025-03-20 16:48:02,955 - INFO - ================================================================================
2025-03-20 16:48:02,955 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-03-20 16:48:02,955 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-03-20 16:48:03,207 - DEBUG - Nothing to compare xmpp stats {'10.0.0.12': {'10.0.0.46': '0'}} with
2025-03-20 16:48:03,207 - INFO - Initial checks done. Running the testcase now
2025-03-20 16:48:03,208 - INFO -
2025-03-20 16:48:03,268 - DEBUG - [Pod ctest-pod-95318195] Cmd: echo ctest-pod-95318195 > /usr/share/nginx/html/index.html, Output:
2025-03-20 16:48:03,336 - DEBUG - [Pod ctest-pod-60059436] Cmd: echo ctest-pod-60059436 > /usr/share/nginx/html/index.html, Output:
2025-03-20 16:48:03,399 - DEBUG - [Pod ctest-pod-80862463] Cmd: echo ctest-pod-80862463 > /usr/share/nginx/html/index.html, Output:
2025-03-20 16:48:03,469 - DEBUG - [Pod ctest-pod-75467051] Cmd: echo ctest-pod-75467051 > /usr/share/nginx/html/index.html, Output:
2025-03-20 16:48:03,472 - DEBUG - Service ctest-nginx-svc-49909918 not present
2025-03-20 16:48:03,473 - INFO - Creating service ctest-nginx-svc-49909918
2025-03-20 16:48:03,500 - INFO - Created Service ctest-nginx-svc-49909918
2025-03-20 16:48:03,507 - WARNING - Service UUID 587b5219-53b2-4acd-89a5-2970730d281a not yet found in contrail-api
2025-03-20 16:48:04,514 - INFO - Validated that Service ctest-nginx-svc-49909918 is seen in contrail-api
2025-03-20 16:48:04,514 - DEBUG - Requesting: http://10.0.0.46:8108/Snh_LoadbalancerDatabaseList?x=587b5219-53b2-4acd-89a5-2970730d281a
2025-03-20 16:48:04,518 - INFO - Service ctest-nginx-svc-49909918 with uuid 587b5219-53b2-4acd-89a5-2970730d281a found in kube manager
2025-03-20 16:48:04,518 - INFO - Service ctest-nginx-svc-49909918 verification passed
2025-03-20 16:48:05,587 - DEBUG - [Pod ctest-pod-37463106] Cmd: wget http://10.96.108.129:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
ctest-pod-95318195
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-20 16:48:05,588 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd wget http://10.96.108.129:80/ -O - -T 5 -t 1 passed
2025-03-20 16:48:05,588 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
ctest-pod-95318195
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-20 16:48:05,649 - DEBUG - [Pod ctest-pod-37463106] Cmd: wget http://10.96.108.129:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-60059436
2025-03-20 16:48:05,649 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd wget http://10.96.108.129:80/ -O - -T 5 -t 1 passed
2025-03-20 16:48:05,649 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-60059436
2025-03-20 16:48:05,649 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-95318195': 1, 'ctest-pod-60059436': 1}
2025-03-20 16:48:05,722 - DEBUG - [Pod ctest-pod-21404360] Cmd: wget http://10.96.108.129:80/ -O - -T 5 -t 1 , Output: ctest-pod-60059436
Connecting to 10.96.108.129:80 (10.96.108.129:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-20 16:48:05,722 - DEBUG - [Pod Pod ctest-pod-21404360] Cmd wget http://10.96.108.129:80/ -O - -T 5 -t 1 passed
2025-03-20 16:48:05,722 - DEBUG - [Pod Pod ctest-pod-21404360] Cmd output: ctest-pod-60059436
Connecting to 10.96.108.129:80 (10.96.108.129:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-20 16:48:05,786 - DEBUG - [Pod ctest-pod-21404360] Cmd: wget http://10.96.108.129:80/ -O - -T 5 -t 1 , Output: ctest-pod-95318195
Connecting to 10.96.108.129:80 (10.96.108.129:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-20 16:48:05,786 - DEBUG - [Pod Pod ctest-pod-21404360] Cmd wget http://10.96.108.129:80/ -O - -T 5 -t 1 passed
2025-03-20 16:48:05,786 - DEBUG - [Pod Pod ctest-pod-21404360] Cmd output: ctest-pod-95318195
Connecting to 10.96.108.129:80 (10.96.108.129:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-20 16:48:05,786 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-95318195': 1, 'ctest-pod-60059436': 1}
2025-03-20 16:48:05,789 - DEBUG - Network policy ingress-on-service not present
2025-03-20 16:48:05,789 - INFO - Creating Network Policy ingress-on-service
2025-03-20 16:48:05,800 - INFO - Network policy found in k8s
2025-03-20 16:48:05,800 - DEBUG - Requesting: http://10.0.0.46:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=d7302ae2-cce9-4ea0-b405-a35cfcee19e8
2025-03-20 16:48:05,805 - INFO - Network Policy ingress-on-service with uuid d7302ae2-cce9-4ea0-b405-a35cfcee19e8 found in kube manager
2025-03-20 16:48:05,847 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-03-20 16:48:05,848 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-03-20 16:48:05,848 - DEBUG - Requesting: http://10.0.0.46:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=d7302ae2-cce9-4ea0-b405-a35cfcee19e8
2025-03-20 16:48:05,877 - WARNING - Network policy with name ingress-on-service not found in agent
2025-03-20 16:48:07,878 - DEBUG - Requesting: http://10.0.0.46:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=d7302ae2-cce9-4ea0-b405-a35cfcee19e8
2025-03-20 16:48:07,909 - INFO - Network policy with name ingress-on-service found in agent
2025-03-20 16:48:07,910 - INFO - Network Policy ingress-on-service verification passed
2025-03-20 16:48:12,978 - DEBUG - [Pod ctest-pod-37463106] Cmd: wget http://10.96.108.129:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:48:12,978 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd wget http://10.96.108.129:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:48:12,979 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:48:18,057 - DEBUG - [Pod ctest-pod-37463106] Cmd: wget http://10.96.108.129:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:48:18,057 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd wget http://10.96.108.129:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:48:18,057 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:48:23,118 - DEBUG - [Pod ctest-pod-37463106] Cmd: wget http://10.96.108.129:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:48:23,119 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd wget http://10.96.108.129:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:48:23,119 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:48:28,190 - DEBUG - [Pod ctest-pod-37463106] Cmd: wget http://10.96.108.129:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:48:28,190 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd wget http://10.96.108.129:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:48:28,190 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:48:33,257 - DEBUG - [Pod ctest-pod-37463106] Cmd: wget http://10.96.108.129:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:48:33,257 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd wget http://10.96.108.129:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:48:33,257 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:48:38,303 - DEBUG - [Pod ctest-pod-37463106] Cmd: wget http://10.96.108.129:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:48:38,304 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd wget http://10.96.108.129:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:48:38,304 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:48:43,366 - DEBUG - [Pod ctest-pod-37463106] Cmd: wget http://10.96.108.129:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:48:43,366 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd wget http://10.96.108.129:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:48:43,366 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:48:48,429 - DEBUG - [Pod ctest-pod-37463106] Cmd: wget http://10.96.108.129:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:48:48,429 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd wget http://10.96.108.129:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:48:48,429 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:48:53,487 - DEBUG - [Pod ctest-pod-37463106] Cmd: wget http://10.96.108.129:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:48:53,487 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd wget http://10.96.108.129:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:48:53,487 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:48:58,545 - DEBUG - [Pod ctest-pod-37463106] Cmd: wget http://10.96.108.129:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:48:58,545 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd wget http://10.96.108.129:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:48:58,545 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:48:58,546 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-95318195': 0, 'ctest-pod-60059436': 0}
2025-03-20 16:48:58,613 - DEBUG - [Pod ctest-pod-92411385] Cmd: wget http://10.96.108.129:80/ -O - -T 5 -t 1 , Output: ctest-pod-95318195
Connecting to 10.96.108.129:80 (10.96.108.129:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-20 16:48:58,613 - DEBUG - [Pod Pod ctest-pod-92411385] Cmd wget http://10.96.108.129:80/ -O - -T 5 -t 1 passed
2025-03-20 16:48:58,613 - DEBUG - [Pod Pod ctest-pod-92411385] Cmd output: ctest-pod-95318195
Connecting to 10.96.108.129:80 (10.96.108.129:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-20 16:48:58,687 - DEBUG - [Pod ctest-pod-92411385] Cmd: wget http://10.96.108.129:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-95318195
2025-03-20 16:48:58,687 - DEBUG - [Pod Pod ctest-pod-92411385] Cmd wget http://10.96.108.129:80/ -O - -T 5 -t 1 passed
2025-03-20 16:48:58,687 - DEBUG - [Pod Pod ctest-pod-92411385] Cmd output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-95318195
2025-03-20 16:48:58,750 - DEBUG - [Pod ctest-pod-92411385] Cmd: wget http://10.96.108.129:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-60059436
2025-03-20 16:48:58,750 - DEBUG - [Pod Pod ctest-pod-92411385] Cmd wget http://10.96.108.129:80/ -O - -T 5 -t 1 passed
2025-03-20 16:48:58,750 - DEBUG - [Pod Pod ctest-pod-92411385] Cmd output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-60059436
2025-03-20 16:48:58,750 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-95318195': 2, 'ctest-pod-60059436': 1}
2025-03-20 16:49:03,818 - DEBUG - [Pod ctest-pod-21404360] Cmd: wget http://10.96.108.129:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:49:03,818 - DEBUG - [Pod Pod ctest-pod-21404360] Cmd wget http://10.96.108.129:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:49:03,819 - DEBUG - [Pod Pod ctest-pod-21404360] Cmd output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:49:08,873 - DEBUG - [Pod ctest-pod-21404360] Cmd: wget http://10.96.108.129:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:49:08,873 - DEBUG - [Pod Pod ctest-pod-21404360] Cmd wget http://10.96.108.129:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:49:08,873 - DEBUG - [Pod Pod ctest-pod-21404360] Cmd output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:49:13,944 - DEBUG - [Pod ctest-pod-21404360] Cmd: wget http://10.96.108.129:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:49:13,944 - DEBUG - [Pod Pod ctest-pod-21404360] Cmd wget http://10.96.108.129:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:49:13,944 - DEBUG - [Pod Pod ctest-pod-21404360] Cmd output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:49:19,006 - DEBUG - [Pod ctest-pod-21404360] Cmd: wget http://10.96.108.129:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:49:19,006 - DEBUG - [Pod Pod ctest-pod-21404360] Cmd wget http://10.96.108.129:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:49:19,007 - DEBUG - [Pod Pod ctest-pod-21404360] Cmd output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:49:24,069 - DEBUG - [Pod ctest-pod-21404360] Cmd: wget http://10.96.108.129:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:49:24,069 - DEBUG - [Pod Pod ctest-pod-21404360] Cmd wget http://10.96.108.129:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:49:24,069 - DEBUG - [Pod Pod ctest-pod-21404360] Cmd output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:49:29,126 - DEBUG - [Pod ctest-pod-21404360] Cmd: wget http://10.96.108.129:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:49:29,126 - DEBUG - [Pod Pod ctest-pod-21404360] Cmd wget http://10.96.108.129:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:49:29,126 - DEBUG - [Pod Pod ctest-pod-21404360] Cmd output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:49:34,303 - DEBUG - [Pod ctest-pod-21404360] Cmd: wget http://10.96.108.129:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:49:34,303 - DEBUG - [Pod Pod ctest-pod-21404360] Cmd wget http://10.96.108.129:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:49:34,303 - DEBUG - [Pod Pod ctest-pod-21404360] Cmd output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:49:39,363 - DEBUG - [Pod ctest-pod-21404360] Cmd: wget http://10.96.108.129:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:49:39,363 - DEBUG - [Pod Pod ctest-pod-21404360] Cmd wget http://10.96.108.129:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:49:39,363 - DEBUG - [Pod Pod ctest-pod-21404360] Cmd output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:49:44,424 - DEBUG - [Pod ctest-pod-21404360] Cmd: wget http://10.96.108.129:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:49:44,424 - DEBUG - [Pod Pod ctest-pod-21404360] Cmd wget http://10.96.108.129:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:49:44,424 - DEBUG - [Pod Pod ctest-pod-21404360] Cmd output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:49:49,482 - DEBUG - [Pod ctest-pod-21404360] Cmd: wget http://10.96.108.129:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:49:49,482 - DEBUG - [Pod Pod ctest-pod-21404360] Cmd wget http://10.96.108.129:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:49:49,482 - DEBUG - [Pod Pod ctest-pod-21404360] Cmd output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:49:49,483 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-95318195': 0, 'ctest-pod-60059436': 0}
2025-03-20 16:49:51,556 - DEBUG - [Pod ctest-pod-92411385] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.333 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.077 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.103 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.077/0.504/1.333 ms
2025-03-20 16:49:51,556 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-92411385 with expectation True passed
2025-03-20 16:49:53,614 - DEBUG - [Pod ctest-pod-37463106] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.240 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.075 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.098 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.075/0.471/1.240 ms
2025-03-20 16:49:53,614 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-37463106 with expectation True passed
2025-03-20 16:49:55,683 - DEBUG - [Pod ctest-pod-21404360] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.777 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.083 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.100 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.083/0.320/0.777 ms
2025-03-20 16:49:55,683 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-21404360 with expectation True passed
2025-03-20 16:49:55,741 - DEBUG - [Pod ctest-pod-92411385] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-20 16:49:55,741 - DEBUG - [Pod Pod ctest-pod-92411385] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-03-20 16:49:55,741 - DEBUG - [Pod Pod ctest-pod-92411385] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-20 16:49:55,741 - INFO - wget check of of http://10.47.255.251 from ctest-pod-92411385 passed
2025-03-20 16:49:55,799 - DEBUG - [Pod ctest-pod-92411385] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-20 16:49:55,799 - DEBUG - [Pod Pod ctest-pod-92411385] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-03-20 16:49:55,799 - DEBUG - [Pod Pod ctest-pod-92411385] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-20 16:49:55,799 - INFO - wget check of of http://10.47.255.250 from ctest-pod-92411385 passed
2025-03-20 16:50:00,859 - DEBUG - [Pod ctest-pod-37463106] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-20 16:50:00,860 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-20 16:50:00,860 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-20 16:50:00,860 - INFO - wget check of of http://10.47.255.250 from ctest-pod-37463106 passed
2025-03-20 16:50:05,932 - DEBUG - [Pod ctest-pod-04946158] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-03-20 16:50:05,932 - DEBUG - [Pod Pod ctest-pod-04946158] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-03-20 16:50:05,932 - DEBUG - [Pod Pod ctest-pod-04946158] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-03-20 16:50:05,932 - INFO - wget check of of http://10.47.255.251 from ctest-pod-04946158 passed
2025-03-20 16:50:05,939 - INFO - Updating Network Policy ingress-on-service
2025-03-20 16:50:11,003 - DEBUG - [Pod ctest-pod-37463106] Cmd: wget http://10.96.108.129:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:50:11,003 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd wget http://10.96.108.129:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:50:11,003 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:50:16,054 - DEBUG - [Pod ctest-pod-37463106] Cmd: wget http://10.96.108.129:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:50:16,054 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd wget http://10.96.108.129:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:50:16,054 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:50:21,113 - DEBUG - [Pod ctest-pod-37463106] Cmd: wget http://10.96.108.129:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:50:21,114 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd wget http://10.96.108.129:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:50:21,114 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:50:26,179 - DEBUG - [Pod ctest-pod-37463106] Cmd: wget http://10.96.108.129:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:50:26,179 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd wget http://10.96.108.129:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:50:26,179 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:50:31,238 - DEBUG - [Pod ctest-pod-37463106] Cmd: wget http://10.96.108.129:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:50:31,238 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd wget http://10.96.108.129:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:50:31,238 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:50:36,305 - DEBUG - [Pod ctest-pod-37463106] Cmd: wget http://10.96.108.129:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:50:36,305 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd wget http://10.96.108.129:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:50:36,305 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:50:41,362 - DEBUG - [Pod ctest-pod-37463106] Cmd: wget http://10.96.108.129:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:50:41,362 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd wget http://10.96.108.129:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:50:41,362 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:50:46,438 - DEBUG - [Pod ctest-pod-37463106] Cmd: wget http://10.96.108.129:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:50:46,438 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd wget http://10.96.108.129:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:50:46,439 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:50:51,495 - DEBUG - [Pod ctest-pod-37463106] Cmd: wget http://10.96.108.129:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:50:51,495 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd wget http://10.96.108.129:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:50:51,495 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:50:56,551 - DEBUG - [Pod ctest-pod-37463106] Cmd: wget http://10.96.108.129:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:50:56,551 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd wget http://10.96.108.129:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:50:56,551 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
wget: download timed out
2025-03-20 16:50:56,551 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-95318195': 0, 'ctest-pod-60059436': 0}
2025-03-20 16:50:56,628 - DEBUG - [Pod ctest-pod-92411385] Cmd: wget http://10.96.108.129:80/ -O - -T 5 -t 1 , Output: ctest-pod-95318195
Connecting to 10.96.108.129:80 (10.96.108.129:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-20 16:50:56,628 - DEBUG - [Pod Pod ctest-pod-92411385] Cmd wget http://10.96.108.129:80/ -O - -T 5 -t 1 passed
2025-03-20 16:50:56,628 - DEBUG - [Pod Pod ctest-pod-92411385] Cmd output: ctest-pod-95318195
Connecting to 10.96.108.129:80 (10.96.108.129:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-20 16:50:56,700 - DEBUG - [Pod ctest-pod-92411385] Cmd: wget http://10.96.108.129:80/ -O - -T 5 -t 1 , Output: ctest-pod-95318195
Connecting to 10.96.108.129:80 (10.96.108.129:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-20 16:50:56,700 - DEBUG - [Pod Pod ctest-pod-92411385] Cmd wget http://10.96.108.129:80/ -O - -T 5 -t 1 passed
2025-03-20 16:50:56,700 - DEBUG - [Pod Pod ctest-pod-92411385] Cmd output: ctest-pod-95318195
Connecting to 10.96.108.129:80 (10.96.108.129:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-20 16:50:56,772 - DEBUG - [Pod ctest-pod-92411385] Cmd: wget http://10.96.108.129:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-60059436
2025-03-20 16:50:56,772 - DEBUG - [Pod Pod ctest-pod-92411385] Cmd wget http://10.96.108.129:80/ -O - -T 5 -t 1 passed
2025-03-20 16:50:56,772 - DEBUG - [Pod Pod ctest-pod-92411385] Cmd output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-60059436
2025-03-20 16:50:56,772 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-95318195': 2, 'ctest-pod-60059436': 1}
2025-03-20 16:50:56,844 - DEBUG - [Pod ctest-pod-21404360] Cmd: wget http://10.96.108.129:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-95318195
2025-03-20 16:50:56,844 - DEBUG - [Pod Pod ctest-pod-21404360] Cmd wget http://10.96.108.129:80/ -O - -T 5 -t 1 passed
2025-03-20 16:50:56,844 - DEBUG - [Pod Pod ctest-pod-21404360] Cmd output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-95318195
2025-03-20 16:50:56,916 - DEBUG - [Pod ctest-pod-21404360] Cmd: wget http://10.96.108.129:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-60059436
2025-03-20 16:50:56,916 - DEBUG - [Pod Pod ctest-pod-21404360] Cmd wget http://10.96.108.129:80/ -O - -T 5 -t 1 passed
2025-03-20 16:50:56,916 - DEBUG - [Pod Pod ctest-pod-21404360] Cmd output: Connecting to 10.96.108.129:80 (10.96.108.129:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-60059436
2025-03-20 16:50:56,916 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-95318195': 1, 'ctest-pod-60059436': 1}
2025-03-20 16:50:58,978 - DEBUG - [Pod ctest-pod-92411385] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.862 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.077 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.076 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.076/0.338/0.862 ms
2025-03-20 16:50:58,978 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-92411385 with expectation True passed
2025-03-20 16:51:00,891 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2025-03-20 16:51:07,969 - DEBUG - [Pod ctest-pod-37463106] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.598 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.079 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.096 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.079/0.257/0.598 ms
2025-03-20 16:51:07,969 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-37463106 with expectation True passed
2025-03-20 16:51:10,020 - DEBUG - [Pod ctest-pod-21404360] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.498 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.082 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.078 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.078/0.219/0.498 ms
2025-03-20 16:51:10,020 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-21404360 with expectation True passed
2025-03-20 16:51:10,089 - DEBUG - [Pod ctest-pod-92411385] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-20 16:51:10,090 - DEBUG - [Pod Pod ctest-pod-92411385] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-03-20 16:51:10,090 - DEBUG - [Pod Pod ctest-pod-92411385] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-20 16:51:10,090 - INFO - wget check of of http://10.47.255.251 from ctest-pod-92411385 passed
2025-03-20 16:51:10,177 - DEBUG - [Pod ctest-pod-92411385] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-20 16:51:10,177 - DEBUG - [Pod Pod ctest-pod-92411385] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-03-20 16:51:10,177 - DEBUG - [Pod Pod ctest-pod-92411385] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-20 16:51:10,177 - INFO - wget check of of http://10.47.255.250 from ctest-pod-92411385 passed
2025-03-20 16:51:15,247 - DEBUG - [Pod ctest-pod-37463106] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-20 16:51:15,247 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-20 16:51:15,247 - DEBUG - [Pod Pod ctest-pod-37463106] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-20 16:51:15,247 - INFO - wget check of of http://10.47.255.250 from ctest-pod-37463106 passed
2025-03-20 16:51:15,309 - DEBUG - [Pod ctest-pod-04946158] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-20 16:51:15,309 - DEBUG - [Pod Pod ctest-pod-04946158] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-03-20 16:51:15,309 - DEBUG - [Pod Pod ctest-pod-04946158] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-20 16:51:15,310 - INFO - wget check of of http://10.47.255.251 from ctest-pod-04946158 passed
2025-03-20 16:51:15,310 - INFO - Deleting Network Policy : ingress-on-service
2025-03-20 16:51:15,310 - INFO - Deleting service : ctest-nginx-svc-49909918
2025-03-20 16:51:15,540 - DEBUG - No XMPP flaps were noticed during the test
2025-03-20 16:51:15,540 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:13]
2025-03-20 16:51:15,540 - INFO - --------------------------------------------------------------------------------
2025-03-20 16:51:15,545 - INFO - Deleting pod ctest-new-default-04057795:ctest-pod-95318195
2025-03-20 16:51:15,546 - INFO - Deleting pod ctest-new-default-04057795:ctest-pod-60059436
2025-03-20 16:51:15,546 - INFO - Deleting pod ctest-non-default-66429036:ctest-pod-80862463
2025-03-20 16:51:15,547 - INFO - Deleting pod ctest-non-default-66429036:ctest-pod-75467051
2025-03-20 16:51:15,547 - INFO - Deleting pod ctest-new-default-04057795:ctest-pod-37463106
2025-03-20 16:51:15,547 - INFO - Deleting pod ctest-new-default-04057795:ctest-pod-92411385
2025-03-20 16:51:15,547 - INFO - Deleting pod ctest-non-default-66429036:ctest-pod-21404360
2025-03-20 16:51:15,548 - INFO - Deleting pod ctest-non-default-66429036:ctest-pod-04946158
2025-03-20 16:51:15,673 - WARNING - Pod uuid 788aa784-f2b4-40a4-87c7-ba029d450425 is still seen in agent 10.0.0.12 VM list
2025-03-20 16:51:15,752 - WARNING - Pod uuid 2d02ab3b-ca51-417b-bfaa-50bd967328f4 is still seen in agent 10.0.0.12 VM list
2025-03-20 16:51:15,753 - WARNING - Pod uuid 6d773a74-d29a-4237-9040-7b543524dbc3 is still seen in agent 10.0.0.12 VM list
2025-03-20 16:51:15,753 - WARNING - Pod uuid 4d6315eb-b64b-49a5-a6fd-7944c61c639b is still seen in agent 10.0.0.12 VM list
2025-03-20 16:51:15,754 - WARNING - Pod uuid 41dbd8d0-f01c-4f15-8ce7-3af81f3c4038 is still seen in agent 10.0.0.12 VM list
2025-03-20 16:51:15,755 - WARNING - Pod uuid 179228d6-41a6-46d8-942a-d49fc57a20cf is still seen in agent 10.0.0.12 VM list
2025-03-20 16:51:15,755 - WARNING - Pod uuid 02f461fc-3624-41d5-adbd-beaf4490e84c is still seen in agent 10.0.0.12 VM list
2025-03-20 16:51:15,755 - WARNING - Pod uuid 8bb193c0-6053-4bea-bc69-a3ed5d81cad2 is still seen in agent 10.0.0.12 VM list
2025-03-20 16:51:20,681 - DEBUG - Pod 788aa784-f2b4-40a4-87c7-ba029d450425 is not in agent 10.0.0.12 VM list
2025-03-20 16:51:20,687 - DEBUG - VMI 0b2287ee-05ab-11f0-a10d-fa163e0c3e02 is removed from agent 10.0.0.12
2025-03-20 16:51:20,687 - INFO - Verified that pod ctest-pod-95318195 is removed in agent
2025-03-20 16:51:20,780 - WARNING - Pod uuid 41dbd8d0-f01c-4f15-8ce7-3af81f3c4038 is still seen in agent 10.0.0.12 VM list
2025-03-20 16:51:20,781 - WARNING - Pod uuid 6d773a74-d29a-4237-9040-7b543524dbc3 is still seen in agent 10.0.0.12 VM list
2025-03-20 16:51:20,784 - WARNING - Pod uuid 02f461fc-3624-41d5-adbd-beaf4490e84c is still seen in agent 10.0.0.12 VM list
2025-03-20 16:51:20,784 - DEBUG - Pod 4d6315eb-b64b-49a5-a6fd-7944c61c639b is not in agent 10.0.0.12 VM list
2025-03-20 16:51:20,785 - DEBUG - Pod 8bb193c0-6053-4bea-bc69-a3ed5d81cad2 is not in agent 10.0.0.12 VM list
2025-03-20 16:51:20,787 - DEBUG - Pod 179228d6-41a6-46d8-942a-d49fc57a20cf is not in agent 10.0.0.12 VM list
2025-03-20 16:51:20,788 - WARNING - Pod uuid 2d02ab3b-ca51-417b-bfaa-50bd967328f4 is still seen in agent 10.0.0.12 VM list
2025-03-20 16:51:20,798 - DEBUG - VMI 0cd28602-05ab-11f0-a10d-fa163e0c3e02 is removed from agent 10.0.0.12
2025-03-20 16:51:20,798 - INFO - Verified that pod ctest-pod-75467051 is removed in agent
2025-03-20 16:51:20,799 - DEBUG - VMI 0ba5b0ce-05ab-11f0-a10d-fa163e0c3e02 is removed from agent 10.0.0.12
2025-03-20 16:51:20,799 - INFO - Verified that pod ctest-pod-60059436 is removed in agent
2025-03-20 16:51:20,800 - DEBUG - VMI 0c513e08-05ab-11f0-a10d-fa163e0c3e02 is removed from agent 10.0.0.12
2025-03-20 16:51:20,800 - INFO - Verified that pod ctest-pod-80862463 is removed in agent
2025-03-20 16:51:25,839 - WARNING - Pod uuid 41dbd8d0-f01c-4f15-8ce7-3af81f3c4038 is still seen in agent 10.0.0.12 VM list
2025-03-20 16:51:25,840 - WARNING - Pod uuid 2d02ab3b-ca51-417b-bfaa-50bd967328f4 is still seen in agent 10.0.0.12 VM list
2025-03-20 16:51:25,840 - WARNING - Pod uuid 02f461fc-3624-41d5-adbd-beaf4490e84c is still seen in agent 10.0.0.12 VM list
2025-03-20 16:51:25,840 - WARNING - Pod uuid 6d773a74-d29a-4237-9040-7b543524dbc3 is still seen in agent 10.0.0.12 VM list
2025-03-20 16:51:30,857 - WARNING - Pod uuid 2d02ab3b-ca51-417b-bfaa-50bd967328f4 is still seen in agent 10.0.0.12 VM list
2025-03-20 16:51:30,858 - WARNING - Pod uuid 41dbd8d0-f01c-4f15-8ce7-3af81f3c4038 is still seen in agent 10.0.0.12 VM list
2025-03-20 16:51:30,859 - WARNING - Pod uuid 6d773a74-d29a-4237-9040-7b543524dbc3 is still seen in agent 10.0.0.12 VM list
2025-03-20 16:51:30,860 - WARNING - Pod uuid 02f461fc-3624-41d5-adbd-beaf4490e84c is still seen in agent 10.0.0.12 VM list
2025-03-20 16:51:35,876 - WARNING - Pod uuid 2d02ab3b-ca51-417b-bfaa-50bd967328f4 is still seen in agent 10.0.0.12 VM list
2025-03-20 16:51:35,879 - WARNING - Pod uuid 6d773a74-d29a-4237-9040-7b543524dbc3 is still seen in agent 10.0.0.12 VM list
2025-03-20 16:51:35,879 - WARNING - Pod uuid 02f461fc-3624-41d5-adbd-beaf4490e84c is still seen in agent 10.0.0.12 VM list
2025-03-20 16:51:35,880 - WARNING - Pod uuid 41dbd8d0-f01c-4f15-8ce7-3af81f3c4038 is still seen in agent 10.0.0.12 VM list
2025-03-20 16:51:40,899 - WARNING - Pod uuid 02f461fc-3624-41d5-adbd-beaf4490e84c is still seen in agent 10.0.0.12 VM list
2025-03-20 16:51:40,899 - WARNING - Pod uuid 2d02ab3b-ca51-417b-bfaa-50bd967328f4 is still seen in agent 10.0.0.12 VM list
2025-03-20 16:51:40,901 - WARNING - Pod uuid 41dbd8d0-f01c-4f15-8ce7-3af81f3c4038 is still seen in agent 10.0.0.12 VM list
2025-03-20 16:51:40,901 - WARNING - Pod uuid 6d773a74-d29a-4237-9040-7b543524dbc3 is still seen in agent 10.0.0.12 VM list
2025-03-20 16:51:45,999 - WARNING - Pod uuid 2d02ab3b-ca51-417b-bfaa-50bd967328f4 is still seen in agent 10.0.0.12 VM list
2025-03-20 16:51:46,004 - WARNING - Pod uuid 02f461fc-3624-41d5-adbd-beaf4490e84c is still seen in agent 10.0.0.12 VM list
2025-03-20 16:51:46,006 - WARNING - Pod uuid 41dbd8d0-f01c-4f15-8ce7-3af81f3c4038 is still seen in agent 10.0.0.12 VM list
2025-03-20 16:51:46,006 - WARNING - Pod uuid 6d773a74-d29a-4237-9040-7b543524dbc3 is still seen in agent 10.0.0.12 VM list
2025-03-20 16:51:51,024 - DEBUG - Pod 2d02ab3b-ca51-417b-bfaa-50bd967328f4 is not in agent 10.0.0.12 VM list
2025-03-20 16:51:51,027 - DEBUG - Pod 41dbd8d0-f01c-4f15-8ce7-3af81f3c4038 is not in agent 10.0.0.12 VM list
2025-03-20 16:51:51,029 - DEBUG - Pod 6d773a74-d29a-4237-9040-7b543524dbc3 is not in agent 10.0.0.12 VM list
2025-03-20 16:51:51,030 - DEBUG - Pod 02f461fc-3624-41d5-adbd-beaf4490e84c is not in agent 10.0.0.12 VM list
2025-03-20 16:51:51,046 - DEBUG - VMI 0ed84040-05ab-11f0-a10d-fa163e0c3e02 is removed from agent 10.0.0.12
2025-03-20 16:51:51,046 - INFO - Verified that pod ctest-pod-04946158 is removed in agent
2025-03-20 16:51:51,046 - DEBUG - VMI 0deafb96-05ab-11f0-a10d-fa163e0c3e02 is removed from agent 10.0.0.12
2025-03-20 16:51:51,046 - INFO - Verified that pod ctest-pod-92411385 is removed in agent
2025-03-20 16:51:51,048 - DEBUG - VMI 0e63bc66-05ab-11f0-a10d-fa163e0c3e02 is removed from agent 10.0.0.12
2025-03-20 16:51:51,048 - INFO - Verified that pod ctest-pod-21404360 is removed in agent
2025-03-20 16:51:51,049 - DEBUG - VMI 0d62cc62-05ab-11f0-a10d-fa163e0c3e02 is removed from agent 10.0.0.12
2025-03-20 16:51:51,049 - INFO - Verified that pod ctest-pod-37463106 is removed in agent
2025-03-20 16:51:51,049 - INFO - Deleting namespace ctest-non-default-66429036
2025-03-20 16:51:51,069 - DEBUG - Namespace ctest-non-default-66429036 still in k8s
2025-03-20 16:51:53,074 - DEBUG - Namespace ctest-non-default-66429036 still in k8s
2025-03-20 16:51:55,079 - DEBUG - Namespace ctest-non-default-66429036 still in k8s
2025-03-20 16:51:57,084 - DEBUG - Namespace ctest-non-default-66429036 is not in k8s
2025-03-20 16:51:57,084 - DEBUG - No need to check project deletion in contrail-api
2025-03-20 16:51:57,084 - INFO - Deleting namespace ctest-new-default-04057795
2025-03-20 16:51:57,098 - DEBUG - Namespace ctest-new-default-04057795 still in k8s
2025-03-20 16:51:59,104 - DEBUG - Namespace ctest-new-default-04057795 still in k8s
2025-03-20 16:52:01,109 - DEBUG - Namespace ctest-new-default-04057795 still in k8s
2025-03-20 16:52:03,112 - DEBUG - Namespace ctest-new-default-04057795 is not in k8s
2025-03-20 16:52:03,113 - DEBUG - No need to check project deletion in contrail-api