2025-03-29 20:48:58,286 - INFO - Using existing project ['default-domain', 'k8s-default'](ebbf0c3a-6ec9-4ca7-b7e0-03cb7a0959b9)
2025-03-29 20:48:58,304 - DEBUG - Namespace ctest-new-default-27306340 not present
2025-03-29 20:48:58,324 - INFO - Created namespace ctest-new-default-27306340
2025-03-29 20:49:01,328 - DEBUG - Namespace ctest-non-default-89435831 not present
2025-03-29 20:49:01,344 - INFO - Created namespace ctest-non-default-89435831
2025-03-29 20:49:04,364 - DEBUG - Pod ctest-pod-78574039 not present
2025-03-29 20:49:04,365 - INFO - Creating Pod ctest-pod-78574039
2025-03-29 20:49:04,405 - DEBUG - Pod : ctest-pod-78574039 UUID is d4057f5b-6adf-49d6-b4f6-bd24dd537606
2025-03-29 20:49:04,413 - DEBUG - Pod ctest-pod-98397799 not present
2025-03-29 20:49:04,413 - INFO - Creating Pod ctest-pod-98397799
2025-03-29 20:49:04,448 - DEBUG - Pod : ctest-pod-98397799 UUID is bbb033cd-2039-487b-8300-8831c2a7821d
2025-03-29 20:49:04,451 - DEBUG - Pod ctest-pod-95442308 not present
2025-03-29 20:49:04,451 - INFO - Creating Pod ctest-pod-95442308
2025-03-29 20:49:04,494 - DEBUG - Pod : ctest-pod-95442308 UUID is 5dd66f8d-cd93-4c6c-bce4-3771c9c97c1a
2025-03-29 20:49:04,501 - DEBUG - Pod ctest-pod-15885664 not present
2025-03-29 20:49:04,503 - INFO - Creating Pod ctest-pod-15885664
2025-03-29 20:49:04,532 - DEBUG - Pod : ctest-pod-15885664 UUID is 463bc9c0-9beb-446e-a74b-5f611c64d854
2025-03-29 20:49:04,535 - DEBUG - Pod ctest-pod-09066980 not present
2025-03-29 20:49:04,536 - INFO - Creating Pod ctest-pod-09066980
2025-03-29 20:49:04,558 - DEBUG - Pod : ctest-pod-09066980 UUID is ad05de2e-eadc-49cc-bbbc-720d6e4981d5
2025-03-29 20:49:04,560 - DEBUG - Pod ctest-pod-28761951 not present
2025-03-29 20:49:04,560 - INFO - Creating Pod ctest-pod-28761951
2025-03-29 20:49:04,580 - DEBUG - Pod : ctest-pod-28761951 UUID is 2ac31e89-1c45-4f18-8ffc-5e7f485878b1
2025-03-29 20:49:04,582 - DEBUG - Pod ctest-pod-66009077 not present
2025-03-29 20:49:04,583 - INFO - Creating Pod ctest-pod-66009077
2025-03-29 20:49:04,603 - DEBUG - Pod : ctest-pod-66009077 UUID is c7024a8a-d124-4196-a586-6d095b7e1a16
2025-03-29 20:49:04,607 - DEBUG - Pod ctest-pod-69155852 not present
2025-03-29 20:49:04,607 - INFO - Creating Pod ctest-pod-69155852
2025-03-29 20:49:04,632 - DEBUG - Pod : ctest-pod-69155852 UUID is d4543adb-d47c-40a2-b3d9-3c2a46338de9
2025-03-29 20:49:04,909 - INFO - Project default-domain:k8s-ctest-new-default-27306340 for Namespace ctest-new-default-27306340 is seen in contrail-api
2025-03-29 20:49:04,910 - DEBUG - Project uuid in Contrail is 10016b7d-ff30-47c8-8563-5cda097745c8
2025-03-29 20:49:05,190 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_NamespaceDatabaseList?namespace_uuid=0335575a-a124-47cd-9e0b-be379d4d6c2b
2025-03-29 20:49:05,196 - INFO - Namespace ctest-new-default-27306340 with uuid 0335575a-a124-47cd-9e0b-be379d4d6c2b found in kube manager
2025-03-29 20:49:05,196 - INFO - Namespace ctest-new-default-27306340 verification passed
2025-03-29 20:49:05,443 - INFO - Project default-domain:k8s-ctest-non-default-89435831 for Namespace ctest-non-default-89435831 is seen in contrail-api
2025-03-29 20:49:05,443 - DEBUG - Project uuid in Contrail is ac21c7b2-1ba6-4091-acd5-cc0a740958bd
2025-03-29 20:49:05,443 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_NamespaceDatabaseList?namespace_uuid=d51e6b9c-9f2b-46d7-9761-0aa0412e4309
2025-03-29 20:49:05,448 - INFO - Namespace ctest-non-default-89435831 with uuid d51e6b9c-9f2b-46d7-9761-0aa0412e4309 found in kube manager
2025-03-29 20:49:05,448 - INFO - Namespace ctest-non-default-89435831 verification passed
2025-03-29 20:49:05,456 - DEBUG - Pod ctest-pod-78574039 not in running state.Currently in Pending
2025-03-29 20:49:10,462 - DEBUG - Pod ctest-pod-78574039 not in running state.Currently in Pending
2025-03-29 20:49:15,470 - DEBUG - Pod ctest-pod-78574039 not in running state.Currently in Pending
2025-03-29 20:49:20,476 - INFO - Pod ctest-pod-78574039 is in running state.Got IP 10.47.255.251
2025-03-29 20:49:20,532 - DEBUG - Pod ctest-pod-78574039 has vmi 4195dc14-0cdf-11f0-9750-fa163ed352eb
2025-03-29 20:49:20,532 - INFO - Verified pod ctest-pod-78574039 in contrail-api
2025-03-29 20:49:20,548 - DEBUG - VMI 4195dc14-0cdf-11f0-9750-fa163ed352eb is active in agent 10.0.0.46
2025-03-29 20:49:20,548 - INFO - Verified Pod ctest-pod-78574039 in agent 10.0.0.46
2025-03-29 20:49:20,549 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_VirtualMachineDatabaseList?x=d4057f5b-6adf-49d6-b4f6-bd24dd537606
2025-03-29 20:49:20,555 - INFO - Pod ctest-pod-78574039 with uuid d4057f5b-6adf-49d6-b4f6-bd24dd537606 found in kube manager
2025-03-29 20:49:20,555 - INFO - Pod ctest-pod-78574039 verification passed
2025-03-29 20:49:20,562 - INFO - Pod ctest-pod-98397799 is in running state.Got IP 10.47.255.250
2025-03-29 20:49:20,577 - DEBUG - Pod ctest-pod-98397799 has vmi 421cb20c-0cdf-11f0-9750-fa163ed352eb
2025-03-29 20:49:20,577 - INFO - Verified pod ctest-pod-98397799 in contrail-api
2025-03-29 20:49:20,594 - DEBUG - VMI 421cb20c-0cdf-11f0-9750-fa163ed352eb is active in agent 10.0.0.46
2025-03-29 20:49:20,595 - INFO - Verified Pod ctest-pod-98397799 in agent 10.0.0.46
2025-03-29 20:49:20,595 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_VirtualMachineDatabaseList?x=bbb033cd-2039-487b-8300-8831c2a7821d
2025-03-29 20:49:20,601 - INFO - Pod ctest-pod-98397799 with uuid bbb033cd-2039-487b-8300-8831c2a7821d found in kube manager
2025-03-29 20:49:20,602 - INFO - Pod ctest-pod-98397799 verification passed
2025-03-29 20:49:20,612 - INFO - Pod ctest-pod-95442308 is in running state.Got IP 10.47.255.249
2025-03-29 20:49:20,674 - DEBUG - Pod ctest-pod-95442308 has vmi 42ecd644-0cdf-11f0-9750-fa163ed352eb
2025-03-29 20:49:20,674 - INFO - Verified pod ctest-pod-95442308 in contrail-api
2025-03-29 20:49:20,688 - DEBUG - VMI 42ecd644-0cdf-11f0-9750-fa163ed352eb is active in agent 10.0.0.46
2025-03-29 20:49:20,689 - INFO - Verified Pod ctest-pod-95442308 in agent 10.0.0.46
2025-03-29 20:49:20,689 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_VirtualMachineDatabaseList?x=5dd66f8d-cd93-4c6c-bce4-3771c9c97c1a
2025-03-29 20:49:20,694 - INFO - Pod ctest-pod-95442308 with uuid 5dd66f8d-cd93-4c6c-bce4-3771c9c97c1a found in kube manager
2025-03-29 20:49:20,694 - INFO - Pod ctest-pod-95442308 verification passed
2025-03-29 20:49:20,699 - INFO - Pod ctest-pod-15885664 is in running state.Got IP 10.47.255.248
2025-03-29 20:49:20,756 - DEBUG - Pod ctest-pod-15885664 has vmi 43791e42-0cdf-11f0-9750-fa163ed352eb
2025-03-29 20:49:20,756 - INFO - Verified pod ctest-pod-15885664 in contrail-api
2025-03-29 20:49:20,773 - DEBUG - VMI 43791e42-0cdf-11f0-9750-fa163ed352eb is active in agent 10.0.0.46
2025-03-29 20:49:20,773 - INFO - Verified Pod ctest-pod-15885664 in agent 10.0.0.46
2025-03-29 20:49:20,773 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_VirtualMachineDatabaseList?x=463bc9c0-9beb-446e-a74b-5f611c64d854
2025-03-29 20:49:20,780 - INFO - Pod ctest-pod-15885664 with uuid 463bc9c0-9beb-446e-a74b-5f611c64d854 found in kube manager
2025-03-29 20:49:20,780 - INFO - Pod ctest-pod-15885664 verification passed
2025-03-29 20:49:20,787 - INFO - Pod ctest-pod-09066980 is in running state.Got IP 10.47.255.247
2025-03-29 20:49:20,804 - DEBUG - Pod ctest-pod-09066980 has vmi 4411fb08-0cdf-11f0-9750-fa163ed352eb
2025-03-29 20:49:20,804 - INFO - Verified pod ctest-pod-09066980 in contrail-api
2025-03-29 20:49:20,821 - DEBUG - VMI 4411fb08-0cdf-11f0-9750-fa163ed352eb is active in agent 10.0.0.46
2025-03-29 20:49:20,821 - INFO - Verified Pod ctest-pod-09066980 in agent 10.0.0.46
2025-03-29 20:49:20,822 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_VirtualMachineDatabaseList?x=ad05de2e-eadc-49cc-bbbc-720d6e4981d5
2025-03-29 20:49:20,827 - INFO - Pod ctest-pod-09066980 with uuid ad05de2e-eadc-49cc-bbbc-720d6e4981d5 found in kube manager
2025-03-29 20:49:20,828 - INFO - Pod ctest-pod-09066980 verification passed
2025-03-29 20:49:20,936 - INFO - Pod ctest-pod-66009077 is in running state.Got IP 10.47.255.245
2025-03-29 20:49:20,996 - DEBUG - Pod ctest-pod-66009077 has vmi 45198534-0cdf-11f0-9750-fa163ed352eb
2025-03-29 20:49:20,996 - INFO - Verified pod ctest-pod-66009077 in contrail-api
2025-03-29 20:49:21,014 - DEBUG - VMI 45198534-0cdf-11f0-9750-fa163ed352eb is active in agent 10.0.0.46
2025-03-29 20:49:21,014 - INFO - Verified Pod ctest-pod-66009077 in agent 10.0.0.46
2025-03-29 20:49:21,014 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_VirtualMachineDatabaseList?x=c7024a8a-d124-4196-a586-6d095b7e1a16
2025-03-29 20:49:21,036 - INFO - Pod ctest-pod-66009077 with uuid c7024a8a-d124-4196-a586-6d095b7e1a16 found in kube manager
2025-03-29 20:49:21,036 - INFO - Pod ctest-pod-66009077 verification passed
2025-03-29 20:49:21,040 - DEBUG - Pod ctest-pod-28761951 not in running state.Currently in Pending
2025-03-29 20:49:26,048 - INFO - Pod ctest-pod-28761951 is in running state.Got IP 10.47.255.246
2025-03-29 20:49:26,066 - DEBUG - Pod ctest-pod-28761951 has vmi 4493fa2c-0cdf-11f0-9750-fa163ed352eb
2025-03-29 20:49:26,066 - INFO - Verified pod ctest-pod-28761951 in contrail-api
2025-03-29 20:49:26,082 - DEBUG - VMI 4493fa2c-0cdf-11f0-9750-fa163ed352eb is active in agent 10.0.0.46
2025-03-29 20:49:26,082 - INFO - Verified Pod ctest-pod-28761951 in agent 10.0.0.46
2025-03-29 20:49:26,082 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_VirtualMachineDatabaseList?x=2ac31e89-1c45-4f18-8ffc-5e7f485878b1
2025-03-29 20:49:26,088 - INFO - Pod ctest-pod-28761951 with uuid 2ac31e89-1c45-4f18-8ffc-5e7f485878b1 found in kube manager
2025-03-29 20:49:26,088 - INFO - Pod ctest-pod-28761951 verification passed
2025-03-29 20:49:26,098 - INFO - Pod ctest-pod-69155852 is in running state.Got IP 10.47.255.244
2025-03-29 20:49:26,156 - DEBUG - Pod ctest-pod-69155852 has vmi 45984374-0cdf-11f0-9750-fa163ed352eb
2025-03-29 20:49:26,156 - INFO - Verified pod ctest-pod-69155852 in contrail-api
2025-03-29 20:49:26,171 - DEBUG - VMI 45984374-0cdf-11f0-9750-fa163ed352eb is active in agent 10.0.0.46
2025-03-29 20:49:26,172 - INFO - Verified Pod ctest-pod-69155852 in agent 10.0.0.46
2025-03-29 20:49:26,172 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_VirtualMachineDatabaseList?x=d4543adb-d47c-40a2-b3d9-3c2a46338de9
2025-03-29 20:49:26,177 - INFO - Pod ctest-pod-69155852 with uuid d4543adb-d47c-40a2-b3d9-3c2a46338de9 found in kube manager
2025-03-29 20:49:26,177 - INFO - Pod ctest-pod-69155852 verification passed
2025-03-29 20:49:26,178 - INFO - ================================================================================
2025-03-29 20:49:26,178 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-03-29 20:49:26,178 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-03-29 20:49:26,469 - DEBUG - Nothing to compare xmpp stats {'10.0.0.46': {'10.0.0.40': '0'}} with
2025-03-29 20:49:26,469 - INFO - Initial checks done. Running the testcase now
2025-03-29 20:49:26,469 - INFO -
2025-03-29 20:49:26,551 - DEBUG - [Pod ctest-pod-78574039] Cmd: echo ctest-pod-78574039 > /usr/share/nginx/html/index.html, Output:
2025-03-29 20:49:26,621 - DEBUG - [Pod ctest-pod-98397799] Cmd: echo ctest-pod-98397799 > /usr/share/nginx/html/index.html, Output:
2025-03-29 20:49:26,691 - DEBUG - [Pod ctest-pod-95442308] Cmd: echo ctest-pod-95442308 > /usr/share/nginx/html/index.html, Output:
2025-03-29 20:49:26,747 - DEBUG - [Pod ctest-pod-15885664] Cmd: echo ctest-pod-15885664 > /usr/share/nginx/html/index.html, Output:
2025-03-29 20:49:26,751 - DEBUG - Service ctest-nginx-svc-92341336 not present
2025-03-29 20:49:26,751 - INFO - Creating service ctest-nginx-svc-92341336
2025-03-29 20:49:26,776 - INFO - Created Service ctest-nginx-svc-92341336
2025-03-29 20:49:26,788 - WARNING - Service UUID e38ab39a-5b35-49bb-9995-1ce3eba82e68 not yet found in contrail-api
2025-03-29 20:49:27,820 - INFO - Validated that Service ctest-nginx-svc-92341336 is seen in contrail-api
2025-03-29 20:49:27,820 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_LoadbalancerDatabaseList?x=e38ab39a-5b35-49bb-9995-1ce3eba82e68
2025-03-29 20:49:27,829 - INFO - Service ctest-nginx-svc-92341336 with uuid e38ab39a-5b35-49bb-9995-1ce3eba82e68 found in kube manager
2025-03-29 20:49:27,829 - INFO - Service ctest-nginx-svc-92341336 verification passed
2025-03-29 20:49:28,924 - DEBUG - [Pod ctest-pod-09066980] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-98397799
2025-03-29 20:49:28,924 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 passed
2025-03-29 20:49:28,924 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-98397799
2025-03-29 20:49:28,984 - DEBUG - [Pod ctest-pod-09066980] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: ctest-pod-78574039
Connecting to 10.107.6.62:80 (10.107.6.62:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 20:49:28,984 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 passed
2025-03-29 20:49:28,984 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd output: ctest-pod-78574039
Connecting to 10.107.6.62:80 (10.107.6.62:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 20:49:28,984 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-78574039': 1, 'ctest-pod-98397799': 1}
2025-03-29 20:49:29,057 - DEBUG - [Pod ctest-pod-66009077] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: ctest-pod-78574039
Connecting to 10.107.6.62:80 (10.107.6.62:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 20:49:29,057 - DEBUG - [Pod Pod ctest-pod-66009077] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 passed
2025-03-29 20:49:29,057 - DEBUG - [Pod Pod ctest-pod-66009077] Cmd output: ctest-pod-78574039
Connecting to 10.107.6.62:80 (10.107.6.62:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 20:49:29,119 - DEBUG - [Pod ctest-pod-66009077] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: ctest-pod-78574039
Connecting to 10.107.6.62:80 (10.107.6.62:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 20:49:29,119 - DEBUG - [Pod Pod ctest-pod-66009077] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 passed
2025-03-29 20:49:29,119 - DEBUG - [Pod Pod ctest-pod-66009077] Cmd output: ctest-pod-78574039
Connecting to 10.107.6.62:80 (10.107.6.62:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 20:49:29,183 - DEBUG - [Pod ctest-pod-66009077] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: ctest-pod-78574039
Connecting to 10.107.6.62:80 (10.107.6.62:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 20:49:29,183 - DEBUG - [Pod Pod ctest-pod-66009077] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 passed
2025-03-29 20:49:29,183 - DEBUG - [Pod Pod ctest-pod-66009077] Cmd output: ctest-pod-78574039
Connecting to 10.107.6.62:80 (10.107.6.62:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 20:49:29,240 - DEBUG - [Pod ctest-pod-66009077] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: ctest-pod-98397799
Connecting to 10.107.6.62:80 (10.107.6.62:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 20:49:29,241 - DEBUG - [Pod Pod ctest-pod-66009077] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 passed
2025-03-29 20:49:29,241 - DEBUG - [Pod Pod ctest-pod-66009077] Cmd output: ctest-pod-98397799
Connecting to 10.107.6.62:80 (10.107.6.62:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 20:49:29,241 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-78574039': 3, 'ctest-pod-98397799': 1}
2025-03-29 20:49:29,244 - DEBUG - Network policy ingress-on-service not present
2025-03-29 20:49:29,244 - INFO - Creating Network Policy ingress-on-service
2025-03-29 20:49:29,264 - INFO - Network policy found in k8s
2025-03-29 20:49:29,264 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=83f88d0f-5c88-4e43-a671-b6b9c1a81f67
2025-03-29 20:49:29,271 - INFO - Network Policy ingress-on-service with uuid 83f88d0f-5c88-4e43-a671-b6b9c1a81f67 found in kube manager
2025-03-29 20:49:29,312 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-03-29 20:49:29,313 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-03-29 20:49:29,313 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=83f88d0f-5c88-4e43-a671-b6b9c1a81f67
2025-03-29 20:49:29,344 - WARNING - Network policy with name ingress-on-service not found in agent
2025-03-29 20:49:31,348 - DEBUG - Requesting: http://10.0.0.40:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=83f88d0f-5c88-4e43-a671-b6b9c1a81f67
2025-03-29 20:49:31,383 - INFO - Network policy with name ingress-on-service found in agent
2025-03-29 20:49:31,383 - INFO - Network Policy ingress-on-service verification passed
2025-03-29 20:49:36,458 - DEBUG - [Pod ctest-pod-09066980] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:49:36,458 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:49:36,458 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:49:41,532 - DEBUG - [Pod ctest-pod-09066980] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:49:41,532 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:49:41,532 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:49:46,600 - DEBUG - [Pod ctest-pod-09066980] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:49:46,601 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:49:46,601 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:49:51,666 - DEBUG - [Pod ctest-pod-09066980] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:49:51,666 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:49:51,666 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:49:56,730 - DEBUG - [Pod ctest-pod-09066980] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:49:56,730 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:49:56,730 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:50:01,791 - DEBUG - [Pod ctest-pod-09066980] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:50:01,792 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:50:01,792 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:50:06,865 - DEBUG - [Pod ctest-pod-09066980] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:50:06,866 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:50:06,866 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:50:11,927 - DEBUG - [Pod ctest-pod-09066980] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:50:11,927 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:50:11,927 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:50:16,989 - DEBUG - [Pod ctest-pod-09066980] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:50:16,989 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:50:16,989 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:50:22,050 - DEBUG - [Pod ctest-pod-09066980] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:50:22,050 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:50:22,050 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:50:22,050 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-78574039': 0, 'ctest-pod-98397799': 0}
2025-03-29 20:50:22,119 - DEBUG - [Pod ctest-pod-28761951] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: ctest-pod-98397799
Connecting to 10.107.6.62:80 (10.107.6.62:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 20:50:22,119 - DEBUG - [Pod Pod ctest-pod-28761951] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 passed
2025-03-29 20:50:22,119 - DEBUG - [Pod Pod ctest-pod-28761951] Cmd output: ctest-pod-98397799
Connecting to 10.107.6.62:80 (10.107.6.62:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 20:50:22,178 - DEBUG - [Pod ctest-pod-28761951] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: ctest-pod-78574039
Connecting to 10.107.6.62:80 (10.107.6.62:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 20:50:22,179 - DEBUG - [Pod Pod ctest-pod-28761951] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 passed
2025-03-29 20:50:22,179 - DEBUG - [Pod Pod ctest-pod-28761951] Cmd output: ctest-pod-78574039
Connecting to 10.107.6.62:80 (10.107.6.62:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 20:50:22,179 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-78574039': 1, 'ctest-pod-98397799': 1}
2025-03-29 20:50:27,240 - DEBUG - [Pod ctest-pod-66009077] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:50:27,240 - DEBUG - [Pod Pod ctest-pod-66009077] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:50:27,240 - DEBUG - [Pod Pod ctest-pod-66009077] Cmd output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:50:32,318 - DEBUG - [Pod ctest-pod-66009077] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:50:32,319 - DEBUG - [Pod Pod ctest-pod-66009077] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:50:32,319 - DEBUG - [Pod Pod ctest-pod-66009077] Cmd output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:50:37,402 - DEBUG - [Pod ctest-pod-66009077] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:50:37,402 - DEBUG - [Pod Pod ctest-pod-66009077] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:50:37,402 - DEBUG - [Pod Pod ctest-pod-66009077] Cmd output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:50:42,477 - DEBUG - [Pod ctest-pod-66009077] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:50:42,477 - DEBUG - [Pod Pod ctest-pod-66009077] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:50:42,478 - DEBUG - [Pod Pod ctest-pod-66009077] Cmd output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:50:47,543 - DEBUG - [Pod ctest-pod-66009077] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:50:47,543 - DEBUG - [Pod Pod ctest-pod-66009077] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:50:47,543 - DEBUG - [Pod Pod ctest-pod-66009077] Cmd output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:50:52,609 - DEBUG - [Pod ctest-pod-66009077] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:50:52,609 - DEBUG - [Pod Pod ctest-pod-66009077] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:50:52,609 - DEBUG - [Pod Pod ctest-pod-66009077] Cmd output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:50:57,665 - DEBUG - [Pod ctest-pod-66009077] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:50:57,665 - DEBUG - [Pod Pod ctest-pod-66009077] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:50:57,665 - DEBUG - [Pod Pod ctest-pod-66009077] Cmd output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:51:02,740 - DEBUG - [Pod ctest-pod-66009077] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:51:02,740 - DEBUG - [Pod Pod ctest-pod-66009077] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:51:02,740 - DEBUG - [Pod Pod ctest-pod-66009077] Cmd output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:51:07,807 - DEBUG - [Pod ctest-pod-66009077] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:51:07,807 - DEBUG - [Pod Pod ctest-pod-66009077] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:51:07,807 - DEBUG - [Pod Pod ctest-pod-66009077] Cmd output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:51:12,874 - DEBUG - [Pod ctest-pod-66009077] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:51:12,874 - DEBUG - [Pod Pod ctest-pod-66009077] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:51:12,874 - DEBUG - [Pod Pod ctest-pod-66009077] Cmd output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:51:12,874 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-78574039': 0, 'ctest-pod-98397799': 0}
2025-03-29 20:51:14,932 - DEBUG - [Pod ctest-pod-28761951] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.381 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.070 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.102 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.070/0.517/1.381 ms
2025-03-29 20:51:14,932 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-28761951 with expectation True passed
2025-03-29 20:51:16,985 - DEBUG - [Pod ctest-pod-09066980] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.197 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.086 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.097 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.086/0.460/1.197 ms
2025-03-29 20:51:16,985 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-09066980 with expectation True passed
2025-03-29 20:51:19,045 - DEBUG - [Pod ctest-pod-66009077] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.612 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.085 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.104 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.085/0.267/0.612 ms
2025-03-29 20:51:19,045 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-66009077 with expectation True passed
2025-03-29 20:51:19,103 - DEBUG - [Pod ctest-pod-28761951] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-29 20:51:19,104 - DEBUG - [Pod Pod ctest-pod-28761951] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-03-29 20:51:19,104 - DEBUG - [Pod Pod ctest-pod-28761951] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-29 20:51:19,104 - INFO - wget check of of http://10.47.255.251 from ctest-pod-28761951 passed
2025-03-29 20:51:19,179 - DEBUG - [Pod ctest-pod-28761951] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-29 20:51:19,179 - DEBUG - [Pod Pod ctest-pod-28761951] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-03-29 20:51:19,179 - DEBUG - [Pod Pod ctest-pod-28761951] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-29 20:51:19,179 - INFO - wget check of of http://10.47.255.250 from ctest-pod-28761951 passed
2025-03-29 20:51:24,245 - DEBUG - [Pod ctest-pod-09066980] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-29 20:51:24,245 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-29 20:51:24,245 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-29 20:51:24,245 - INFO - wget check of of http://10.47.255.250 from ctest-pod-09066980 passed
2025-03-29 20:51:29,310 - DEBUG - [Pod ctest-pod-69155852] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-03-29 20:51:29,310 - DEBUG - [Pod Pod ctest-pod-69155852] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-03-29 20:51:29,310 - DEBUG - [Pod Pod ctest-pod-69155852] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-03-29 20:51:29,310 - INFO - wget check of of http://10.47.255.251 from ctest-pod-69155852 passed
2025-03-29 20:51:29,319 - INFO - Updating Network Policy ingress-on-service
2025-03-29 20:51:34,397 - DEBUG - [Pod ctest-pod-09066980] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:51:34,397 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:51:34,397 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:51:39,465 - DEBUG - [Pod ctest-pod-09066980] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:51:39,465 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:51:39,465 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:51:44,529 - DEBUG - [Pod ctest-pod-09066980] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:51:44,529 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:51:44,529 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:51:49,628 - DEBUG - [Pod ctest-pod-09066980] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:51:49,628 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:51:49,628 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:51:50,448 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2025-03-29 20:52:00,822 - DEBUG - [Pod ctest-pod-09066980] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:52:00,822 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:52:00,822 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:52:05,894 - DEBUG - [Pod ctest-pod-09066980] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:52:05,894 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:52:05,894 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:52:10,970 - DEBUG - [Pod ctest-pod-09066980] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:52:10,970 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:52:10,970 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:52:16,060 - DEBUG - [Pod ctest-pod-09066980] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:52:16,060 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:52:16,060 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:52:21,123 - DEBUG - [Pod ctest-pod-09066980] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:52:21,123 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:52:21,123 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:52:26,195 - DEBUG - [Pod ctest-pod-09066980] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:52:26,196 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:52:26,196 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
wget: download timed out
2025-03-29 20:52:26,196 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-78574039': 0, 'ctest-pod-98397799': 0}
2025-03-29 20:52:26,271 - DEBUG - [Pod ctest-pod-28761951] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: ctest-pod-98397799
Connecting to 10.107.6.62:80 (10.107.6.62:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 20:52:26,271 - DEBUG - [Pod Pod ctest-pod-28761951] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 passed
2025-03-29 20:52:26,271 - DEBUG - [Pod Pod ctest-pod-28761951] Cmd output: ctest-pod-98397799
Connecting to 10.107.6.62:80 (10.107.6.62:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 20:52:26,343 - DEBUG - [Pod ctest-pod-28761951] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: ctest-pod-98397799
Connecting to 10.107.6.62:80 (10.107.6.62:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 20:52:26,343 - DEBUG - [Pod Pod ctest-pod-28761951] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 passed
2025-03-29 20:52:26,343 - DEBUG - [Pod Pod ctest-pod-28761951] Cmd output: ctest-pod-98397799
Connecting to 10.107.6.62:80 (10.107.6.62:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 20:52:26,432 - DEBUG - [Pod ctest-pod-28761951] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: ctest-pod-98397799
Connecting to 10.107.6.62:80 (10.107.6.62:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 20:52:26,432 - DEBUG - [Pod Pod ctest-pod-28761951] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 passed
2025-03-29 20:52:26,432 - DEBUG - [Pod Pod ctest-pod-28761951] Cmd output: ctest-pod-98397799
Connecting to 10.107.6.62:80 (10.107.6.62:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 20:52:26,508 - DEBUG - [Pod ctest-pod-28761951] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: ctest-pod-98397799
Connecting to 10.107.6.62:80 (10.107.6.62:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 20:52:26,508 - DEBUG - [Pod Pod ctest-pod-28761951] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 passed
2025-03-29 20:52:26,508 - DEBUG - [Pod Pod ctest-pod-28761951] Cmd output: ctest-pod-98397799
Connecting to 10.107.6.62:80 (10.107.6.62:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 20:52:26,585 - DEBUG - [Pod ctest-pod-28761951] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: ctest-pod-78574039
Connecting to 10.107.6.62:80 (10.107.6.62:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 20:52:26,585 - DEBUG - [Pod Pod ctest-pod-28761951] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 passed
2025-03-29 20:52:26,585 - DEBUG - [Pod Pod ctest-pod-28761951] Cmd output: ctest-pod-78574039
Connecting to 10.107.6.62:80 (10.107.6.62:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 20:52:26,585 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-78574039': 1, 'ctest-pod-98397799': 4}
2025-03-29 20:52:26,657 - DEBUG - [Pod ctest-pod-66009077] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: ctest-pod-78574039
Connecting to 10.107.6.62:80 (10.107.6.62:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 20:52:26,657 - DEBUG - [Pod Pod ctest-pod-66009077] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 passed
2025-03-29 20:52:26,657 - DEBUG - [Pod Pod ctest-pod-66009077] Cmd output: ctest-pod-78574039
Connecting to 10.107.6.62:80 (10.107.6.62:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 20:52:26,731 - DEBUG - [Pod ctest-pod-66009077] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-78574039
2025-03-29 20:52:26,731 - DEBUG - [Pod Pod ctest-pod-66009077] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 passed
2025-03-29 20:52:26,731 - DEBUG - [Pod Pod ctest-pod-66009077] Cmd output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-78574039
2025-03-29 20:52:26,830 - DEBUG - [Pod ctest-pod-66009077] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: ctest-pod-78574039
Connecting to 10.107.6.62:80 (10.107.6.62:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 20:52:26,830 - DEBUG - [Pod Pod ctest-pod-66009077] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 passed
2025-03-29 20:52:26,830 - DEBUG - [Pod Pod ctest-pod-66009077] Cmd output: ctest-pod-78574039
Connecting to 10.107.6.62:80 (10.107.6.62:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 20:52:26,905 - DEBUG - [Pod ctest-pod-66009077] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: ctest-pod-78574039
Connecting to 10.107.6.62:80 (10.107.6.62:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 20:52:26,905 - DEBUG - [Pod Pod ctest-pod-66009077] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 passed
2025-03-29 20:52:26,905 - DEBUG - [Pod Pod ctest-pod-66009077] Cmd output: ctest-pod-78574039
Connecting to 10.107.6.62:80 (10.107.6.62:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-03-29 20:52:26,978 - DEBUG - [Pod ctest-pod-66009077] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-78574039
2025-03-29 20:52:26,978 - DEBUG - [Pod Pod ctest-pod-66009077] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 passed
2025-03-29 20:52:26,978 - DEBUG - [Pod Pod ctest-pod-66009077] Cmd output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-78574039
2025-03-29 20:52:27,035 - DEBUG - [Pod ctest-pod-66009077] Cmd: wget http://10.107.6.62:80/ -O - -T 5 -t 1 , Output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-98397799
2025-03-29 20:52:27,035 - DEBUG - [Pod Pod ctest-pod-66009077] Cmd wget http://10.107.6.62:80/ -O - -T 5 -t 1 passed
2025-03-29 20:52:27,035 - DEBUG - [Pod Pod ctest-pod-66009077] Cmd output: Connecting to 10.107.6.62:80 (10.107.6.62:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-98397799
2025-03-29 20:52:27,035 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-78574039': 5, 'ctest-pod-98397799': 1}
2025-03-29 20:52:29,098 - DEBUG - [Pod ctest-pod-28761951] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.281 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.076 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.103 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.076/0.486/1.281 ms
2025-03-29 20:52:29,098 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-28761951 with expectation True passed
2025-03-29 20:52:31,161 - DEBUG - [Pod ctest-pod-09066980] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.617 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.084 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.078 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.078/0.259/0.617 ms
2025-03-29 20:52:31,161 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-09066980 with expectation True passed
2025-03-29 20:52:33,219 - DEBUG - [Pod ctest-pod-66009077] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.761 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.090 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.112 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.090/0.321/0.761 ms
2025-03-29 20:52:33,219 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-66009077 with expectation True passed
2025-03-29 20:52:33,293 - DEBUG - [Pod ctest-pod-28761951] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-29 20:52:33,293 - DEBUG - [Pod Pod ctest-pod-28761951] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-03-29 20:52:33,293 - DEBUG - [Pod Pod ctest-pod-28761951] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-29 20:52:33,293 - INFO - wget check of of http://10.47.255.251 from ctest-pod-28761951 passed
2025-03-29 20:52:33,365 - DEBUG - [Pod ctest-pod-28761951] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-29 20:52:33,366 - DEBUG - [Pod Pod ctest-pod-28761951] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-03-29 20:52:33,366 - DEBUG - [Pod Pod ctest-pod-28761951] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-29 20:52:33,366 - INFO - wget check of of http://10.47.255.250 from ctest-pod-28761951 passed
2025-03-29 20:52:38,437 - DEBUG - [Pod ctest-pod-09066980] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-29 20:52:38,437 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-29 20:52:38,437 - DEBUG - [Pod Pod ctest-pod-09066980] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-03-29 20:52:38,437 - INFO - wget check of of http://10.47.255.250 from ctest-pod-09066980 passed
2025-03-29 20:52:38,536 - DEBUG - [Pod ctest-pod-69155852] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-29 20:52:38,536 - DEBUG - [Pod Pod ctest-pod-69155852] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-03-29 20:52:38,536 - DEBUG - [Pod Pod ctest-pod-69155852] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-03-29 20:52:38,536 - INFO - wget check of of http://10.47.255.251 from ctest-pod-69155852 passed
2025-03-29 20:52:38,537 - INFO - Deleting Network Policy : ingress-on-service
2025-03-29 20:52:38,538 - INFO - Deleting service : ctest-nginx-svc-92341336
2025-03-29 20:52:38,805 - DEBUG - No XMPP flaps were noticed during the test
2025-03-29 20:52:38,805 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:12]
2025-03-29 20:52:38,805 - INFO - --------------------------------------------------------------------------------
2025-03-29 20:52:38,814 - INFO - Deleting pod ctest-new-default-27306340:ctest-pod-78574039
2025-03-29 20:52:38,815 - INFO - Deleting pod ctest-new-default-27306340:ctest-pod-98397799
2025-03-29 20:52:38,815 - INFO - Deleting pod ctest-non-default-89435831:ctest-pod-95442308
2025-03-29 20:52:38,816 - INFO - Deleting pod ctest-non-default-89435831:ctest-pod-15885664
2025-03-29 20:52:38,816 - INFO - Deleting pod ctest-new-default-27306340:ctest-pod-09066980
2025-03-29 20:52:38,817 - INFO - Deleting pod ctest-new-default-27306340:ctest-pod-28761951
2025-03-29 20:52:38,817 - INFO - Deleting pod ctest-non-default-89435831:ctest-pod-66009077
2025-03-29 20:52:38,818 - INFO - Deleting pod ctest-non-default-89435831:ctest-pod-69155852
2025-03-29 20:52:38,934 - WARNING - Pod uuid d4057f5b-6adf-49d6-b4f6-bd24dd537606 is still seen in agent 10.0.0.46 VM list
2025-03-29 20:52:38,935 - WARNING - Pod uuid c7024a8a-d124-4196-a586-6d095b7e1a16 is still seen in agent 10.0.0.46 VM list
2025-03-29 20:52:39,033 - WARNING - Pod uuid d4543adb-d47c-40a2-b3d9-3c2a46338de9 is still seen in agent 10.0.0.46 VM list
2025-03-29 20:52:39,034 - WARNING - Pod uuid 463bc9c0-9beb-446e-a74b-5f611c64d854 is still seen in agent 10.0.0.46 VM list
2025-03-29 20:52:39,034 - WARNING - Pod uuid 5dd66f8d-cd93-4c6c-bce4-3771c9c97c1a is still seen in agent 10.0.0.46 VM list
2025-03-29 20:52:39,034 - WARNING - Pod uuid bbb033cd-2039-487b-8300-8831c2a7821d is still seen in agent 10.0.0.46 VM list
2025-03-29 20:52:39,034 - WARNING - Pod uuid ad05de2e-eadc-49cc-bbbc-720d6e4981d5 is still seen in agent 10.0.0.46 VM list
2025-03-29 20:52:39,035 - WARNING - Pod uuid 2ac31e89-1c45-4f18-8ffc-5e7f485878b1 is still seen in agent 10.0.0.46 VM list
2025-03-29 20:52:43,947 - WARNING - Pod uuid c7024a8a-d124-4196-a586-6d095b7e1a16 is still seen in agent 10.0.0.46 VM list
2025-03-29 20:52:43,948 - DEBUG - Pod d4057f5b-6adf-49d6-b4f6-bd24dd537606 is not in agent 10.0.0.46 VM list
2025-03-29 20:52:43,955 - DEBUG - VMI 4195dc14-0cdf-11f0-9750-fa163ed352eb is removed from agent 10.0.0.46
2025-03-29 20:52:43,955 - INFO - Verified that pod ctest-pod-78574039 is removed in agent
2025-03-29 20:52:44,060 - DEBUG - Pod 5dd66f8d-cd93-4c6c-bce4-3771c9c97c1a is not in agent 10.0.0.46 VM list
2025-03-29 20:52:44,064 - WARNING - Pod uuid 2ac31e89-1c45-4f18-8ffc-5e7f485878b1 is still seen in agent 10.0.0.46 VM list
2025-03-29 20:52:44,065 - WARNING - Pod uuid ad05de2e-eadc-49cc-bbbc-720d6e4981d5 is still seen in agent 10.0.0.46 VM list
2025-03-29 20:52:44,065 - DEBUG - Pod bbb033cd-2039-487b-8300-8831c2a7821d is not in agent 10.0.0.46 VM list
2025-03-29 20:52:44,066 - DEBUG - Pod 463bc9c0-9beb-446e-a74b-5f611c64d854 is not in agent 10.0.0.46 VM list
2025-03-29 20:52:44,068 - WARNING - Pod uuid d4543adb-d47c-40a2-b3d9-3c2a46338de9 is still seen in agent 10.0.0.46 VM list
2025-03-29 20:52:44,078 - DEBUG - VMI 42ecd644-0cdf-11f0-9750-fa163ed352eb is removed from agent 10.0.0.46
2025-03-29 20:52:44,078 - INFO - Verified that pod ctest-pod-95442308 is removed in agent
2025-03-29 20:52:44,080 - DEBUG - VMI 43791e42-0cdf-11f0-9750-fa163ed352eb is removed from agent 10.0.0.46
2025-03-29 20:52:44,080 - INFO - Verified that pod ctest-pod-15885664 is removed in agent
2025-03-29 20:52:44,081 - DEBUG - VMI 421cb20c-0cdf-11f0-9750-fa163ed352eb is removed from agent 10.0.0.46
2025-03-29 20:52:44,081 - INFO - Verified that pod ctest-pod-98397799 is removed in agent
2025-03-29 20:52:48,967 - WARNING - Pod uuid c7024a8a-d124-4196-a586-6d095b7e1a16 is still seen in agent 10.0.0.46 VM list
2025-03-29 20:52:49,080 - WARNING - Pod uuid 2ac31e89-1c45-4f18-8ffc-5e7f485878b1 is still seen in agent 10.0.0.46 VM list
2025-03-29 20:52:49,082 - WARNING - Pod uuid d4543adb-d47c-40a2-b3d9-3c2a46338de9 is still seen in agent 10.0.0.46 VM list
2025-03-29 20:52:49,082 - WARNING - Pod uuid ad05de2e-eadc-49cc-bbbc-720d6e4981d5 is still seen in agent 10.0.0.46 VM list
2025-03-29 20:52:53,976 - WARNING - Pod uuid c7024a8a-d124-4196-a586-6d095b7e1a16 is still seen in agent 10.0.0.46 VM list
2025-03-29 20:52:54,096 - WARNING - Pod uuid 2ac31e89-1c45-4f18-8ffc-5e7f485878b1 is still seen in agent 10.0.0.46 VM list
2025-03-29 20:52:54,097 - WARNING - Pod uuid d4543adb-d47c-40a2-b3d9-3c2a46338de9 is still seen in agent 10.0.0.46 VM list
2025-03-29 20:52:54,098 - WARNING - Pod uuid ad05de2e-eadc-49cc-bbbc-720d6e4981d5 is still seen in agent 10.0.0.46 VM list
2025-03-29 20:52:58,985 - WARNING - Pod uuid c7024a8a-d124-4196-a586-6d095b7e1a16 is still seen in agent 10.0.0.46 VM list
2025-03-29 20:52:59,112 - WARNING - Pod uuid 2ac31e89-1c45-4f18-8ffc-5e7f485878b1 is still seen in agent 10.0.0.46 VM list
2025-03-29 20:52:59,114 - WARNING - Pod uuid ad05de2e-eadc-49cc-bbbc-720d6e4981d5 is still seen in agent 10.0.0.46 VM list
2025-03-29 20:52:59,115 - WARNING - Pod uuid d4543adb-d47c-40a2-b3d9-3c2a46338de9 is still seen in agent 10.0.0.46 VM list
2025-03-29 20:53:03,995 - WARNING - Pod uuid c7024a8a-d124-4196-a586-6d095b7e1a16 is still seen in agent 10.0.0.46 VM list
2025-03-29 20:53:04,134 - WARNING - Pod uuid 2ac31e89-1c45-4f18-8ffc-5e7f485878b1 is still seen in agent 10.0.0.46 VM list
2025-03-29 20:53:04,135 - WARNING - Pod uuid d4543adb-d47c-40a2-b3d9-3c2a46338de9 is still seen in agent 10.0.0.46 VM list
2025-03-29 20:53:04,136 - WARNING - Pod uuid ad05de2e-eadc-49cc-bbbc-720d6e4981d5 is still seen in agent 10.0.0.46 VM list
2025-03-29 20:53:09,006 - WARNING - Pod uuid c7024a8a-d124-4196-a586-6d095b7e1a16 is still seen in agent 10.0.0.46 VM list
2025-03-29 20:53:09,154 - WARNING - Pod uuid ad05de2e-eadc-49cc-bbbc-720d6e4981d5 is still seen in agent 10.0.0.46 VM list
2025-03-29 20:53:09,155 - WARNING - Pod uuid 2ac31e89-1c45-4f18-8ffc-5e7f485878b1 is still seen in agent 10.0.0.46 VM list
2025-03-29 20:53:09,155 - WARNING - Pod uuid d4543adb-d47c-40a2-b3d9-3c2a46338de9 is still seen in agent 10.0.0.46 VM list
2025-03-29 20:53:14,014 - DEBUG - Pod c7024a8a-d124-4196-a586-6d095b7e1a16 is not in agent 10.0.0.46 VM list
2025-03-29 20:53:14,021 - DEBUG - VMI 45198534-0cdf-11f0-9750-fa163ed352eb is removed from agent 10.0.0.46
2025-03-29 20:53:14,021 - INFO - Verified that pod ctest-pod-66009077 is removed in agent
2025-03-29 20:53:14,171 - DEBUG - Pod ad05de2e-eadc-49cc-bbbc-720d6e4981d5 is not in agent 10.0.0.46 VM list
2025-03-29 20:53:14,175 - DEBUG - Pod d4543adb-d47c-40a2-b3d9-3c2a46338de9 is not in agent 10.0.0.46 VM list
2025-03-29 20:53:14,178 - DEBUG - Pod 2ac31e89-1c45-4f18-8ffc-5e7f485878b1 is not in agent 10.0.0.46 VM list
2025-03-29 20:53:14,191 - DEBUG - VMI 4411fb08-0cdf-11f0-9750-fa163ed352eb is removed from agent 10.0.0.46
2025-03-29 20:53:14,191 - INFO - Verified that pod ctest-pod-09066980 is removed in agent
2025-03-29 20:53:14,193 - DEBUG - VMI 45984374-0cdf-11f0-9750-fa163ed352eb is removed from agent 10.0.0.46
2025-03-29 20:53:14,193 - INFO - Verified that pod ctest-pod-69155852 is removed in agent
2025-03-29 20:53:14,193 - DEBUG - VMI 4493fa2c-0cdf-11f0-9750-fa163ed352eb is removed from agent 10.0.0.46
2025-03-29 20:53:14,193 - INFO - Verified that pod ctest-pod-28761951 is removed in agent
2025-03-29 20:53:14,193 - INFO - Deleting namespace ctest-non-default-89435831
2025-03-29 20:53:14,309 - DEBUG - Namespace ctest-non-default-89435831 still in k8s
2025-03-29 20:53:16,315 - DEBUG - Namespace ctest-non-default-89435831 still in k8s
2025-03-29 20:53:18,321 - DEBUG - Namespace ctest-non-default-89435831 still in k8s
2025-03-29 20:53:20,326 - DEBUG - Namespace ctest-non-default-89435831 is not in k8s
2025-03-29 20:53:20,326 - DEBUG - No need to check project deletion in contrail-api
2025-03-29 20:53:20,327 - INFO - Deleting namespace ctest-new-default-27306340
2025-03-29 20:53:20,340 - DEBUG - Namespace ctest-new-default-27306340 still in k8s
2025-03-29 20:53:22,346 - DEBUG - Namespace ctest-new-default-27306340 still in k8s
2025-03-29 20:53:24,354 - DEBUG - Namespace ctest-new-default-27306340 still in k8s
2025-03-29 20:53:26,362 - DEBUG - Namespace ctest-new-default-27306340 is not in k8s
2025-03-29 20:53:26,362 - DEBUG - No need to check project deletion in contrail-api