2024-09-05 01:51:08,563 - INFO - Using existing project ['default-domain', 'k8s-default'](e86ffb6f-8265-433e-9ce2-db055e6c2b81)
2024-09-05 01:51:08,616 - DEBUG - Namespace ctest-new-default-47619721 not present
2024-09-05 01:51:08,645 - INFO - Created namespace ctest-new-default-47619721
2024-09-05 01:51:12,641 - DEBUG - Namespace ctest-non-default-38950195 not present
2024-09-05 01:51:12,663 - INFO - Created namespace ctest-non-default-38950195
2024-09-05 01:51:15,690 - DEBUG - Pod ctest-pod-19534551 not present
2024-09-05 01:51:15,690 - INFO - Creating Pod ctest-pod-19534551
2024-09-05 01:51:15,744 - DEBUG - Pod : ctest-pod-19534551 UUID is 1547b72a-a36a-4ea9-9de9-ffc8c0fb5b30
2024-09-05 01:51:15,762 - DEBUG - Pod ctest-pod-79752868 not present
2024-09-05 01:51:15,762 - INFO - Creating Pod ctest-pod-79752868
2024-09-05 01:51:15,821 - DEBUG - Pod : ctest-pod-79752868 UUID is 9a2975d9-f4ee-433c-a59c-591dbad2a5bc
2024-09-05 01:51:15,825 - DEBUG - Pod ctest-pod-16986002 not present
2024-09-05 01:51:15,826 - INFO - Creating Pod ctest-pod-16986002
2024-09-05 01:51:15,862 - DEBUG - Pod : ctest-pod-16986002 UUID is 9519d528-5e91-4048-a0c3-8501f3e83c87
2024-09-05 01:51:15,873 - DEBUG - Pod ctest-pod-75129936 not present
2024-09-05 01:51:15,873 - INFO - Creating Pod ctest-pod-75129936
2024-09-05 01:51:15,919 - DEBUG - Pod : ctest-pod-75129936 UUID is ddc11e8e-8193-484d-9110-969c7d30b513
2024-09-05 01:51:15,924 - DEBUG - Pod ctest-pod-80303885 not present
2024-09-05 01:51:15,924 - INFO - Creating Pod ctest-pod-80303885
2024-09-05 01:51:15,957 - DEBUG - Pod : ctest-pod-80303885 UUID is 4e9f5d1f-baa8-4f05-9892-79b784d3f786
2024-09-05 01:51:15,972 - DEBUG - Pod ctest-pod-98272129 not present
2024-09-05 01:51:15,974 - INFO - Creating Pod ctest-pod-98272129
2024-09-05 01:51:16,016 - DEBUG - Pod : ctest-pod-98272129 UUID is 3ec964cc-888f-4af0-9550-94007e356f19
2024-09-05 01:51:16,028 - DEBUG - Pod ctest-pod-81931380 not present
2024-09-05 01:51:16,029 - INFO - Creating Pod ctest-pod-81931380
2024-09-05 01:51:16,074 - DEBUG - Pod : ctest-pod-81931380 UUID is 5bd4553c-7c41-4ee9-b5b3-dc56202f8218
2024-09-05 01:51:16,080 - DEBUG - Pod ctest-pod-45739068 not present
2024-09-05 01:51:16,080 - INFO - Creating Pod ctest-pod-45739068
2024-09-05 01:51:16,118 - DEBUG - Pod : ctest-pod-45739068 UUID is 0f73b26a-868d-4962-8510-20d37a15c435
2024-09-05 01:51:16,417 - INFO - Project default-domain:k8s-ctest-new-default-47619721 for Namespace ctest-new-default-47619721 is seen in contrail-api
2024-09-05 01:51:16,417 - DEBUG - Project uuid in Contrail is a93de38d-5df3-411d-92e3-e628c6c9c2ac
2024-09-05 01:51:17,046 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_NamespaceDatabaseList?namespace_uuid=8136fc9d-91e9-4a84-a816-cc541679b51b
2024-09-05 01:51:17,052 - INFO - Namespace ctest-new-default-47619721 with uuid 8136fc9d-91e9-4a84-a816-cc541679b51b found in kube manager
2024-09-05 01:51:17,052 - INFO - Namespace ctest-new-default-47619721 verification passed
2024-09-05 01:51:17,297 - INFO - Project default-domain:k8s-ctest-non-default-38950195 for Namespace ctest-non-default-38950195 is seen in contrail-api
2024-09-05 01:51:17,297 - DEBUG - Project uuid in Contrail is 03034b92-5709-400e-b7dc-0fd5eec7cfaa
2024-09-05 01:51:17,297 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_NamespaceDatabaseList?namespace_uuid=e33f1c86-5832-40a8-981f-ccf53a39a05d
2024-09-05 01:51:17,303 - INFO - Namespace ctest-non-default-38950195 with uuid e33f1c86-5832-40a8-981f-ccf53a39a05d found in kube manager
2024-09-05 01:51:17,303 - INFO - Namespace ctest-non-default-38950195 verification passed
2024-09-05 01:51:17,309 - DEBUG - Pod ctest-pod-19534551 not in running state.Currently in Pending
2024-09-05 01:51:22,320 - DEBUG - Pod ctest-pod-19534551 not in running state.Currently in Pending
2024-09-05 01:51:27,328 - DEBUG - Pod ctest-pod-19534551 not in running state.Currently in Pending
2024-09-05 01:51:32,337 - INFO - Pod ctest-pod-19534551 is in running state.Got IP 10.47.255.251
2024-09-05 01:51:32,396 - DEBUG - Pod ctest-pod-19534551 has vmi 57c21528-6b29-11ef-955d-fa163e1bcd04
2024-09-05 01:51:32,396 - INFO - Verified pod ctest-pod-19534551 in contrail-api
2024-09-05 01:51:32,426 - DEBUG - VMI 57c21528-6b29-11ef-955d-fa163e1bcd04 is active in agent 10.0.0.22
2024-09-05 01:51:32,426 - INFO - Verified Pod ctest-pod-19534551 in agent 10.0.0.22
2024-09-05 01:51:32,426 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=1547b72a-a36a-4ea9-9de9-ffc8c0fb5b30
2024-09-05 01:51:32,433 - INFO - Pod ctest-pod-19534551 with uuid 1547b72a-a36a-4ea9-9de9-ffc8c0fb5b30 found in kube manager
2024-09-05 01:51:32,433 - INFO - Pod ctest-pod-19534551 verification passed
2024-09-05 01:51:32,439 - INFO - Pod ctest-pod-79752868 is in running state.Got IP 10.47.255.250
2024-09-05 01:51:32,452 - DEBUG - Pod ctest-pod-79752868 has vmi 5850609e-6b29-11ef-955d-fa163e1bcd04
2024-09-05 01:51:32,452 - INFO - Verified pod ctest-pod-79752868 in contrail-api
2024-09-05 01:51:32,468 - DEBUG - VMI 5850609e-6b29-11ef-955d-fa163e1bcd04 is active in agent 10.0.0.22
2024-09-05 01:51:32,468 - INFO - Verified Pod ctest-pod-79752868 in agent 10.0.0.22
2024-09-05 01:51:32,469 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=9a2975d9-f4ee-433c-a59c-591dbad2a5bc
2024-09-05 01:51:32,476 - INFO - Pod ctest-pod-79752868 with uuid 9a2975d9-f4ee-433c-a59c-591dbad2a5bc found in kube manager
2024-09-05 01:51:32,477 - INFO - Pod ctest-pod-79752868 verification passed
2024-09-05 01:51:32,483 - INFO - Pod ctest-pod-16986002 is in running state.Got IP 10.47.255.249
2024-09-05 01:51:32,496 - DEBUG - Pod ctest-pod-16986002 has vmi 590457b6-6b29-11ef-955d-fa163e1bcd04
2024-09-05 01:51:32,497 - INFO - Verified pod ctest-pod-16986002 in contrail-api
2024-09-05 01:51:32,511 - DEBUG - VMI 590457b6-6b29-11ef-955d-fa163e1bcd04 is active in agent 10.0.0.22
2024-09-05 01:51:32,512 - INFO - Verified Pod ctest-pod-16986002 in agent 10.0.0.22
2024-09-05 01:51:32,512 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=9519d528-5e91-4048-a0c3-8501f3e83c87
2024-09-05 01:51:32,521 - INFO - Pod ctest-pod-16986002 with uuid 9519d528-5e91-4048-a0c3-8501f3e83c87 found in kube manager
2024-09-05 01:51:32,521 - INFO - Pod ctest-pod-16986002 verification passed
2024-09-05 01:51:32,528 - INFO - Pod ctest-pod-75129936 is in running state.Got IP 10.47.255.248
2024-09-05 01:51:32,583 - DEBUG - Pod ctest-pod-75129936 has vmi 59a11452-6b29-11ef-955d-fa163e1bcd04
2024-09-05 01:51:32,584 - INFO - Verified pod ctest-pod-75129936 in contrail-api
2024-09-05 01:51:32,603 - DEBUG - VMI 59a11452-6b29-11ef-955d-fa163e1bcd04 is active in agent 10.0.0.22
2024-09-05 01:51:32,603 - INFO - Verified Pod ctest-pod-75129936 in agent 10.0.0.22
2024-09-05 01:51:32,603 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=ddc11e8e-8193-484d-9110-969c7d30b513
2024-09-05 01:51:32,610 - INFO - Pod ctest-pod-75129936 with uuid ddc11e8e-8193-484d-9110-969c7d30b513 found in kube manager
2024-09-05 01:51:32,610 - INFO - Pod ctest-pod-75129936 verification passed
2024-09-05 01:51:32,617 - DEBUG - Pod ctest-pod-80303885 not in running state.Currently in Pending
2024-09-05 01:51:37,625 - INFO - Pod ctest-pod-80303885 is in running state.Got IP 10.47.255.247
2024-09-05 01:51:37,640 - DEBUG - Pod ctest-pod-80303885 has vmi 5a4696d4-6b29-11ef-955d-fa163e1bcd04
2024-09-05 01:51:37,640 - INFO - Verified pod ctest-pod-80303885 in contrail-api
2024-09-05 01:51:37,656 - DEBUG - VMI 5a4696d4-6b29-11ef-955d-fa163e1bcd04 is active in agent 10.0.0.22
2024-09-05 01:51:37,657 - INFO - Verified Pod ctest-pod-80303885 in agent 10.0.0.22
2024-09-05 01:51:37,657 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=4e9f5d1f-baa8-4f05-9892-79b784d3f786
2024-09-05 01:51:37,664 - INFO - Pod ctest-pod-80303885 with uuid 4e9f5d1f-baa8-4f05-9892-79b784d3f786 found in kube manager
2024-09-05 01:51:37,665 - INFO - Pod ctest-pod-80303885 verification passed
2024-09-05 01:51:37,672 - INFO - Pod ctest-pod-81931380 is in running state.Got IP 10.47.255.245
2024-09-05 01:51:37,731 - DEBUG - Pod ctest-pod-81931380 has vmi 5b4a2e4c-6b29-11ef-955d-fa163e1bcd04
2024-09-05 01:51:37,731 - INFO - Verified pod ctest-pod-81931380 in contrail-api
2024-09-05 01:51:37,749 - DEBUG - VMI 5b4a2e4c-6b29-11ef-955d-fa163e1bcd04 is active in agent 10.0.0.22
2024-09-05 01:51:37,749 - INFO - Verified Pod ctest-pod-81931380 in agent 10.0.0.22
2024-09-05 01:51:37,749 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=5bd4553c-7c41-4ee9-b5b3-dc56202f8218
2024-09-05 01:51:37,756 - INFO - Pod ctest-pod-81931380 with uuid 5bd4553c-7c41-4ee9-b5b3-dc56202f8218 found in kube manager
2024-09-05 01:51:37,756 - INFO - Pod ctest-pod-81931380 verification passed
2024-09-05 01:51:37,763 - INFO - Pod ctest-pod-98272129 is in running state.Got IP 10.47.255.246
2024-09-05 01:51:37,821 - DEBUG - Pod ctest-pod-98272129 has vmi 5ac6dc18-6b29-11ef-955d-fa163e1bcd04
2024-09-05 01:51:37,821 - INFO - Verified pod ctest-pod-98272129 in contrail-api
2024-09-05 01:51:37,841 - DEBUG - VMI 5ac6dc18-6b29-11ef-955d-fa163e1bcd04 is active in agent 10.0.0.22
2024-09-05 01:51:37,842 - INFO - Verified Pod ctest-pod-98272129 in agent 10.0.0.22
2024-09-05 01:51:37,842 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=3ec964cc-888f-4af0-9550-94007e356f19
2024-09-05 01:51:37,850 - INFO - Pod ctest-pod-98272129 with uuid 3ec964cc-888f-4af0-9550-94007e356f19 found in kube manager
2024-09-05 01:51:37,850 - INFO - Pod ctest-pod-98272129 verification passed
2024-09-05 01:51:37,858 - INFO - Pod ctest-pod-45739068 is in running state.Got IP 10.47.255.244
2024-09-05 01:51:37,876 - DEBUG - Pod ctest-pod-45739068 has vmi 5bce6fae-6b29-11ef-955d-fa163e1bcd04
2024-09-05 01:51:37,876 - INFO - Verified pod ctest-pod-45739068 in contrail-api
2024-09-05 01:51:37,894 - DEBUG - VMI 5bce6fae-6b29-11ef-955d-fa163e1bcd04 is active in agent 10.0.0.22
2024-09-05 01:51:37,895 - INFO - Verified Pod ctest-pod-45739068 in agent 10.0.0.22
2024-09-05 01:51:37,895 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_VirtualMachineDatabaseList?x=0f73b26a-868d-4962-8510-20d37a15c435
2024-09-05 01:51:37,903 - INFO - Pod ctest-pod-45739068 with uuid 0f73b26a-868d-4962-8510-20d37a15c435 found in kube manager
2024-09-05 01:51:37,903 - INFO - Pod ctest-pod-45739068 verification passed
2024-09-05 01:51:37,903 - INFO - ================================================================================
2024-09-05 01:51:37,904 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2024-09-05 01:51:37,904 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2024-09-05 01:51:38,162 - DEBUG - Nothing to compare xmpp stats {'10.0.0.22': {'10.0.0.23': '0'}} with
2024-09-05 01:51:38,162 - INFO - Initial checks done. Running the testcase now
2024-09-05 01:51:38,162 - INFO -
2024-09-05 01:51:38,247 - DEBUG - [Pod ctest-pod-19534551] Cmd: echo ctest-pod-19534551 > /usr/share/nginx/html/index.html, Output:
2024-09-05 01:51:38,309 - DEBUG - [Pod ctest-pod-79752868] Cmd: echo ctest-pod-79752868 > /usr/share/nginx/html/index.html, Output:
2024-09-05 01:51:38,377 - DEBUG - [Pod ctest-pod-16986002] Cmd: echo ctest-pod-16986002 > /usr/share/nginx/html/index.html, Output:
2024-09-05 01:51:38,439 - DEBUG - [Pod ctest-pod-75129936] Cmd: echo ctest-pod-75129936 > /usr/share/nginx/html/index.html, Output:
2024-09-05 01:51:38,442 - DEBUG - Service ctest-nginx-svc-55798855 not present
2024-09-05 01:51:38,443 - INFO - Creating service ctest-nginx-svc-55798855
2024-09-05 01:51:38,459 - INFO - Created Service ctest-nginx-svc-55798855
2024-09-05 01:51:38,477 - WARNING - Service UUID 991c9fcc-1aee-42a7-b789-46aa295a72dd not yet found in contrail-api
2024-09-05 01:51:39,500 - INFO - Validated that Service ctest-nginx-svc-55798855 is seen in contrail-api
2024-09-05 01:51:39,500 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_LoadbalancerDatabaseList?x=991c9fcc-1aee-42a7-b789-46aa295a72dd
2024-09-05 01:51:39,507 - INFO - Service ctest-nginx-svc-55798855 with uuid 991c9fcc-1aee-42a7-b789-46aa295a72dd found in kube manager
2024-09-05 01:51:39,507 - INFO - Service ctest-nginx-svc-55798855 verification passed
2024-09-05 01:51:40,593 - DEBUG - [Pod ctest-pod-80303885] Cmd: wget http://10.103.46.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-79752868
2024-09-05 01:51:40,593 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd wget http://10.103.46.81:80/ -O - -T 5 -t 1 passed
2024-09-05 01:51:40,593 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-79752868
2024-09-05 01:51:40,676 - DEBUG - [Pod ctest-pod-80303885] Cmd: wget http://10.103.46.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-19534551
2024-09-05 01:51:40,676 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd wget http://10.103.46.81:80/ -O - -T 5 -t 1 passed
2024-09-05 01:51:40,676 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-19534551
2024-09-05 01:51:40,676 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-19534551': 1, 'ctest-pod-79752868': 1}
2024-09-05 01:51:40,742 - DEBUG - [Pod ctest-pod-81931380] Cmd: wget http://10.103.46.81:80/ -O - -T 5 -t 1 , Output: ctest-pod-79752868
Connecting to 10.103.46.81:80 (10.103.46.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-05 01:51:40,742 - DEBUG - [Pod Pod ctest-pod-81931380] Cmd wget http://10.103.46.81:80/ -O - -T 5 -t 1 passed
2024-09-05 01:51:40,742 - DEBUG - [Pod Pod ctest-pod-81931380] Cmd output: ctest-pod-79752868
Connecting to 10.103.46.81:80 (10.103.46.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-05 01:51:40,818 - DEBUG - [Pod ctest-pod-81931380] Cmd: wget http://10.103.46.81:80/ -O - -T 5 -t 1 , Output: ctest-pod-19534551
Connecting to 10.103.46.81:80 (10.103.46.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-05 01:51:40,818 - DEBUG - [Pod Pod ctest-pod-81931380] Cmd wget http://10.103.46.81:80/ -O - -T 5 -t 1 passed
2024-09-05 01:51:40,818 - DEBUG - [Pod Pod ctest-pod-81931380] Cmd output: ctest-pod-19534551
Connecting to 10.103.46.81:80 (10.103.46.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-05 01:51:40,818 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-19534551': 1, 'ctest-pod-79752868': 1}
2024-09-05 01:51:40,821 - DEBUG - Network policy ingress-on-service not present
2024-09-05 01:51:40,822 - INFO - Creating Network Policy ingress-on-service
2024-09-05 01:51:40,850 - INFO - Network policy found in k8s
2024-09-05 01:51:40,850 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=0f1b3e0a-ef6e-49ad-8ae4-5f41248d4d9c
2024-09-05 01:51:40,859 - INFO - Network Policy ingress-on-service with uuid 0f1b3e0a-ef6e-49ad-8ae4-5f41248d4d9c found in kube manager
2024-09-05 01:51:40,897 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2024-09-05 01:51:40,898 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2024-09-05 01:51:40,898 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=0f1b3e0a-ef6e-49ad-8ae4-5f41248d4d9c
2024-09-05 01:51:40,963 - WARNING - Network policy with name ingress-on-service not found in agent
2024-09-05 01:51:42,965 - DEBUG - Requesting: http://10.0.0.23:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=0f1b3e0a-ef6e-49ad-8ae4-5f41248d4d9c
2024-09-05 01:51:43,011 - INFO - Network policy with name ingress-on-service found in agent
2024-09-05 01:51:43,012 - INFO - Network Policy ingress-on-service verification passed
2024-09-05 01:51:48,063 - DEBUG - [Pod ctest-pod-80303885] Cmd: wget http://10.103.46.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:51:48,063 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd wget http://10.103.46.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:51:48,064 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:51:53,123 - DEBUG - [Pod ctest-pod-80303885] Cmd: wget http://10.103.46.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:51:53,124 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd wget http://10.103.46.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:51:53,124 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:51:58,186 - DEBUG - [Pod ctest-pod-80303885] Cmd: wget http://10.103.46.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:51:58,186 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd wget http://10.103.46.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:51:58,186 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:52:03,249 - DEBUG - [Pod ctest-pod-80303885] Cmd: wget http://10.103.46.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:52:03,249 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd wget http://10.103.46.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:52:03,249 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:52:08,293 - DEBUG - [Pod ctest-pod-80303885] Cmd: wget http://10.103.46.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:52:08,293 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd wget http://10.103.46.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:52:08,293 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:52:13,368 - DEBUG - [Pod ctest-pod-80303885] Cmd: wget http://10.103.46.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:52:13,369 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd wget http://10.103.46.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:52:13,369 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:52:18,425 - DEBUG - [Pod ctest-pod-80303885] Cmd: wget http://10.103.46.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:52:18,425 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd wget http://10.103.46.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:52:18,425 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:52:23,492 - DEBUG - [Pod ctest-pod-80303885] Cmd: wget http://10.103.46.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:52:23,492 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd wget http://10.103.46.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:52:23,493 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:52:28,561 - DEBUG - [Pod ctest-pod-80303885] Cmd: wget http://10.103.46.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:52:28,561 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd wget http://10.103.46.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:52:28,562 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:52:33,642 - DEBUG - [Pod ctest-pod-80303885] Cmd: wget http://10.103.46.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:52:33,642 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd wget http://10.103.46.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:52:33,642 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:52:33,642 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-19534551': 0, 'ctest-pod-79752868': 0}
2024-09-05 01:52:33,714 - DEBUG - [Pod ctest-pod-98272129] Cmd: wget http://10.103.46.81:80/ -O - -T 5 -t 1 , Output: ctest-pod-19534551
Connecting to 10.103.46.81:80 (10.103.46.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-05 01:52:33,714 - DEBUG - [Pod Pod ctest-pod-98272129] Cmd wget http://10.103.46.81:80/ -O - -T 5 -t 1 passed
2024-09-05 01:52:33,714 - DEBUG - [Pod Pod ctest-pod-98272129] Cmd output: ctest-pod-19534551
Connecting to 10.103.46.81:80 (10.103.46.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-05 01:52:33,784 - DEBUG - [Pod ctest-pod-98272129] Cmd: wget http://10.103.46.81:80/ -O - -T 5 -t 1 , Output: ctest-pod-79752868
Connecting to 10.103.46.81:80 (10.103.46.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-05 01:52:33,784 - DEBUG - [Pod Pod ctest-pod-98272129] Cmd wget http://10.103.46.81:80/ -O - -T 5 -t 1 passed
2024-09-05 01:52:33,784 - DEBUG - [Pod Pod ctest-pod-98272129] Cmd output: ctest-pod-79752868
Connecting to 10.103.46.81:80 (10.103.46.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-05 01:52:33,784 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-19534551': 1, 'ctest-pod-79752868': 1}
2024-09-05 01:52:38,853 - DEBUG - [Pod ctest-pod-81931380] Cmd: wget http://10.103.46.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:52:38,853 - DEBUG - [Pod Pod ctest-pod-81931380] Cmd wget http://10.103.46.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:52:38,853 - DEBUG - [Pod Pod ctest-pod-81931380] Cmd output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:52:43,922 - DEBUG - [Pod ctest-pod-81931380] Cmd: wget http://10.103.46.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:52:43,922 - DEBUG - [Pod Pod ctest-pod-81931380] Cmd wget http://10.103.46.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:52:43,922 - DEBUG - [Pod Pod ctest-pod-81931380] Cmd output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:52:49,000 - DEBUG - [Pod ctest-pod-81931380] Cmd: wget http://10.103.46.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:52:49,000 - DEBUG - [Pod Pod ctest-pod-81931380] Cmd wget http://10.103.46.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:52:49,000 - DEBUG - [Pod Pod ctest-pod-81931380] Cmd output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:52:54,051 - DEBUG - [Pod ctest-pod-81931380] Cmd: wget http://10.103.46.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:52:54,051 - DEBUG - [Pod Pod ctest-pod-81931380] Cmd wget http://10.103.46.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:52:54,051 - DEBUG - [Pod Pod ctest-pod-81931380] Cmd output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:52:59,110 - DEBUG - [Pod ctest-pod-81931380] Cmd: wget http://10.103.46.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:52:59,110 - DEBUG - [Pod Pod ctest-pod-81931380] Cmd wget http://10.103.46.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:52:59,111 - DEBUG - [Pod Pod ctest-pod-81931380] Cmd output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:53:04,173 - DEBUG - [Pod ctest-pod-81931380] Cmd: wget http://10.103.46.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:53:04,173 - DEBUG - [Pod Pod ctest-pod-81931380] Cmd wget http://10.103.46.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:53:04,174 - DEBUG - [Pod Pod ctest-pod-81931380] Cmd output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:53:09,229 - DEBUG - [Pod ctest-pod-81931380] Cmd: wget http://10.103.46.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:53:09,229 - DEBUG - [Pod Pod ctest-pod-81931380] Cmd wget http://10.103.46.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:53:09,229 - DEBUG - [Pod Pod ctest-pod-81931380] Cmd output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:53:14,318 - DEBUG - [Pod ctest-pod-81931380] Cmd: wget http://10.103.46.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:53:14,318 - DEBUG - [Pod Pod ctest-pod-81931380] Cmd wget http://10.103.46.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:53:14,318 - DEBUG - [Pod Pod ctest-pod-81931380] Cmd output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:53:19,385 - DEBUG - [Pod ctest-pod-81931380] Cmd: wget http://10.103.46.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:53:19,385 - DEBUG - [Pod Pod ctest-pod-81931380] Cmd wget http://10.103.46.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:53:19,385 - DEBUG - [Pod Pod ctest-pod-81931380] Cmd output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:53:24,457 - DEBUG - [Pod ctest-pod-81931380] Cmd: wget http://10.103.46.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:53:24,457 - DEBUG - [Pod Pod ctest-pod-81931380] Cmd wget http://10.103.46.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:53:24,457 - DEBUG - [Pod Pod ctest-pod-81931380] Cmd output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:53:24,457 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-19534551': 0, 'ctest-pod-79752868': 0}
2024-09-05 01:53:26,524 - DEBUG - [Pod ctest-pod-98272129] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.463 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.085 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.075 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.075/0.541/1.463 ms
2024-09-05 01:53:26,524 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-98272129 with expectation True passed
2024-09-05 01:53:28,594 - DEBUG - [Pod ctest-pod-80303885] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.885 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.069 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.080 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.069/0.344/0.885 ms
2024-09-05 01:53:28,594 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-80303885 with expectation True passed
2024-09-05 01:53:30,659 - DEBUG - [Pod ctest-pod-81931380] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.324 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.065 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.073 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.065/0.487/1.324 ms
2024-09-05 01:53:30,659 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-81931380 with expectation True passed
2024-09-05 01:53:30,734 - DEBUG - [Pod ctest-pod-98272129] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-05 01:53:30,734 - DEBUG - [Pod Pod ctest-pod-98272129] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-09-05 01:53:30,734 - DEBUG - [Pod Pod ctest-pod-98272129] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-05 01:53:30,734 - INFO - wget check of of http://10.47.255.251 from ctest-pod-98272129 passed
2024-09-05 01:53:30,802 - DEBUG - [Pod ctest-pod-98272129] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-05 01:53:30,803 - DEBUG - [Pod Pod ctest-pod-98272129] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-09-05 01:53:30,803 - DEBUG - [Pod Pod ctest-pod-98272129] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-05 01:53:30,803 - INFO - wget check of of http://10.47.255.250 from ctest-pod-98272129 passed
2024-09-05 01:53:35,878 - DEBUG - [Pod ctest-pod-80303885] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-05 01:53:35,879 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-05 01:53:35,879 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-05 01:53:35,879 - INFO - wget check of of http://10.47.255.250 from ctest-pod-80303885 passed
2024-09-05 01:53:40,937 - DEBUG - [Pod ctest-pod-45739068] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-09-05 01:53:40,937 - DEBUG - [Pod Pod ctest-pod-45739068] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-09-05 01:53:40,937 - DEBUG - [Pod Pod ctest-pod-45739068] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2024-09-05 01:53:40,937 - INFO - wget check of of http://10.47.255.251 from ctest-pod-45739068 passed
2024-09-05 01:53:40,946 - INFO - Updating Network Policy ingress-on-service
2024-09-05 01:53:46,024 - DEBUG - [Pod ctest-pod-80303885] Cmd: wget http://10.103.46.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:53:46,024 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd wget http://10.103.46.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:53:46,024 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:53:51,104 - DEBUG - [Pod ctest-pod-80303885] Cmd: wget http://10.103.46.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:53:51,104 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd wget http://10.103.46.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:53:51,104 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:53:56,172 - DEBUG - [Pod ctest-pod-80303885] Cmd: wget http://10.103.46.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:53:56,172 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd wget http://10.103.46.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:53:56,172 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:54:01,245 - DEBUG - [Pod ctest-pod-80303885] Cmd: wget http://10.103.46.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:54:01,245 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd wget http://10.103.46.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:54:01,245 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:54:06,319 - DEBUG - [Pod ctest-pod-80303885] Cmd: wget http://10.103.46.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:54:06,320 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd wget http://10.103.46.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:54:06,320 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:54:11,457 - DEBUG - [Pod ctest-pod-80303885] Cmd: wget http://10.103.46.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:54:11,458 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd wget http://10.103.46.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:54:11,458 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:54:16,532 - DEBUG - [Pod ctest-pod-80303885] Cmd: wget http://10.103.46.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:54:16,532 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd wget http://10.103.46.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:54:16,532 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:54:21,602 - DEBUG - [Pod ctest-pod-80303885] Cmd: wget http://10.103.46.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:54:21,602 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd wget http://10.103.46.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:54:21,602 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:54:26,675 - DEBUG - [Pod ctest-pod-80303885] Cmd: wget http://10.103.46.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:54:26,675 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd wget http://10.103.46.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:54:26,676 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:54:31,742 - DEBUG - [Pod ctest-pod-80303885] Cmd: wget http://10.103.46.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:54:31,742 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd wget http://10.103.46.81:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:54:31,742 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
wget: download timed out
2024-09-05 01:54:31,743 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-19534551': 0, 'ctest-pod-79752868': 0}
2024-09-05 01:54:31,805 - DEBUG - [Pod ctest-pod-98272129] Cmd: wget http://10.103.46.81:80/ -O - -T 5 -t 1 , Output: ctest-pod-79752868
Connecting to 10.103.46.81:80 (10.103.46.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-05 01:54:31,805 - DEBUG - [Pod Pod ctest-pod-98272129] Cmd wget http://10.103.46.81:80/ -O - -T 5 -t 1 passed
2024-09-05 01:54:31,805 - DEBUG - [Pod Pod ctest-pod-98272129] Cmd output: ctest-pod-79752868
Connecting to 10.103.46.81:80 (10.103.46.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-05 01:54:31,869 - DEBUG - [Pod ctest-pod-98272129] Cmd: wget http://10.103.46.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-79752868
2024-09-05 01:54:31,869 - DEBUG - [Pod Pod ctest-pod-98272129] Cmd wget http://10.103.46.81:80/ -O - -T 5 -t 1 passed
2024-09-05 01:54:31,869 - DEBUG - [Pod Pod ctest-pod-98272129] Cmd output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-79752868
2024-09-05 01:54:31,960 - DEBUG - [Pod ctest-pod-98272129] Cmd: wget http://10.103.46.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-19534551
2024-09-05 01:54:31,960 - DEBUG - [Pod Pod ctest-pod-98272129] Cmd wget http://10.103.46.81:80/ -O - -T 5 -t 1 passed
2024-09-05 01:54:31,960 - DEBUG - [Pod Pod ctest-pod-98272129] Cmd output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-19534551
2024-09-05 01:54:31,960 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-19534551': 1, 'ctest-pod-79752868': 2}
2024-09-05 01:54:32,026 - DEBUG - [Pod ctest-pod-81931380] Cmd: wget http://10.103.46.81:80/ -O - -T 5 -t 1 , Output: ctest-pod-79752868
Connecting to 10.103.46.81:80 (10.103.46.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-05 01:54:32,026 - DEBUG - [Pod Pod ctest-pod-81931380] Cmd wget http://10.103.46.81:80/ -O - -T 5 -t 1 passed
2024-09-05 01:54:32,026 - DEBUG - [Pod Pod ctest-pod-81931380] Cmd output: ctest-pod-79752868
Connecting to 10.103.46.81:80 (10.103.46.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-05 01:54:32,888 - DEBUG - [Pod ctest-pod-81931380] Cmd: wget http://10.103.46.81:80/ -O - -T 5 -t 1 , Output: ctest-pod-79752868
Connecting to 10.103.46.81:80 (10.103.46.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-05 01:54:32,888 - DEBUG - [Pod Pod ctest-pod-81931380] Cmd wget http://10.103.46.81:80/ -O - -T 5 -t 1 passed
2024-09-05 01:54:32,888 - DEBUG - [Pod Pod ctest-pod-81931380] Cmd output: ctest-pod-79752868
Connecting to 10.103.46.81:80 (10.103.46.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2024-09-05 01:54:32,971 - DEBUG - [Pod ctest-pod-81931380] Cmd: wget http://10.103.46.81:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-19534551
2024-09-05 01:54:32,971 - DEBUG - [Pod Pod ctest-pod-81931380] Cmd wget http://10.103.46.81:80/ -O - -T 5 -t 1 passed
2024-09-05 01:54:32,972 - DEBUG - [Pod Pod ctest-pod-81931380] Cmd output: Connecting to 10.103.46.81:80 (10.103.46.81:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-19534551
2024-09-05 01:54:32,972 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-19534551': 1, 'ctest-pod-79752868': 2}
2024-09-05 01:54:35,052 - DEBUG - [Pod ctest-pod-98272129] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.382 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.074 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.088 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.074/0.181/0.382 ms
2024-09-05 01:54:35,053 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-98272129 with expectation True passed
2024-09-05 01:54:37,113 - DEBUG - [Pod ctest-pod-80303885] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.967 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.072 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.081 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.072/0.373/0.967 ms
2024-09-05 01:54:37,113 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-80303885 with expectation True passed
2024-09-05 01:54:39,194 - DEBUG - [Pod ctest-pod-81931380] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.772 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.089 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.070/0.310/0.772 ms
2024-09-05 01:54:39,194 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-81931380 with expectation True passed
2024-09-05 01:54:39,259 - DEBUG - [Pod ctest-pod-98272129] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-05 01:54:39,259 - DEBUG - [Pod Pod ctest-pod-98272129] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-09-05 01:54:39,260 - DEBUG - [Pod Pod ctest-pod-98272129] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-05 01:54:39,260 - INFO - wget check of of http://10.47.255.251 from ctest-pod-98272129 passed
2024-09-05 01:54:39,333 - DEBUG - [Pod ctest-pod-98272129] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-05 01:54:39,333 - DEBUG - [Pod Pod ctest-pod-98272129] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2024-09-05 01:54:39,333 - DEBUG - [Pod Pod ctest-pod-98272129] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-05 01:54:39,333 - INFO - wget check of of http://10.47.255.250 from ctest-pod-98272129 passed
2024-09-05 01:54:44,400 - DEBUG - [Pod ctest-pod-80303885] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-05 01:54:44,400 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-05 01:54:44,400 - DEBUG - [Pod Pod ctest-pod-80303885] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2024-09-05 01:54:44,400 - INFO - wget check of of http://10.47.255.250 from ctest-pod-80303885 passed
2024-09-05 01:54:44,473 - DEBUG - [Pod ctest-pod-45739068] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-05 01:54:44,473 - DEBUG - [Pod Pod ctest-pod-45739068] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2024-09-05 01:54:44,473 - DEBUG - [Pod Pod ctest-pod-45739068] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2024-09-05 01:54:44,473 - INFO - wget check of of http://10.47.255.251 from ctest-pod-45739068 passed
2024-09-05 01:54:44,473 - INFO - Deleting Network Policy : ingress-on-service
2024-09-05 01:54:44,474 - INFO - Deleting service : ctest-nginx-svc-55798855
2024-09-05 01:54:44,731 - DEBUG - No XMPP flaps were noticed during the test
2024-09-05 01:54:44,731 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:07]
2024-09-05 01:54:44,731 - INFO - --------------------------------------------------------------------------------
2024-09-05 01:54:44,738 - INFO - Deleting pod ctest-new-default-47619721:ctest-pod-19534551
2024-09-05 01:54:44,739 - INFO - Deleting pod ctest-new-default-47619721:ctest-pod-79752868
2024-09-05 01:54:44,740 - INFO - Deleting pod ctest-non-default-38950195:ctest-pod-16986002
2024-09-05 01:54:44,740 - INFO - Deleting pod ctest-non-default-38950195:ctest-pod-75129936
2024-09-05 01:54:44,740 - INFO - Deleting pod ctest-new-default-47619721:ctest-pod-80303885
2024-09-05 01:54:44,741 - INFO - Deleting pod ctest-new-default-47619721:ctest-pod-98272129
2024-09-05 01:54:44,741 - INFO - Deleting pod ctest-non-default-38950195:ctest-pod-81931380
2024-09-05 01:54:44,742 - INFO - Deleting pod ctest-non-default-38950195:ctest-pod-45739068
2024-09-05 01:54:44,862 - WARNING - Pod uuid 1547b72a-a36a-4ea9-9de9-ffc8c0fb5b30 is still seen in agent 10.0.0.22 VM list
2024-09-05 01:54:44,886 - WARNING - Pod uuid 0f73b26a-868d-4962-8510-20d37a15c435 is still seen in agent 10.0.0.22 VM list
2024-09-05 01:54:44,886 - WARNING - Pod uuid 3ec964cc-888f-4af0-9550-94007e356f19 is still seen in agent 10.0.0.22 VM list
2024-09-05 01:54:44,887 - WARNING - Pod uuid 9a2975d9-f4ee-433c-a59c-591dbad2a5bc is still seen in agent 10.0.0.22 VM list
2024-09-05 01:54:44,889 - WARNING - Pod uuid 4e9f5d1f-baa8-4f05-9892-79b784d3f786 is still seen in agent 10.0.0.22 VM list
2024-09-05 01:54:44,889 - WARNING - Pod uuid ddc11e8e-8193-484d-9110-969c7d30b513 is still seen in agent 10.0.0.22 VM list
2024-09-05 01:54:44,890 - WARNING - Pod uuid 5bd4553c-7c41-4ee9-b5b3-dc56202f8218 is still seen in agent 10.0.0.22 VM list
2024-09-05 01:54:44,893 - WARNING - Pod uuid 9519d528-5e91-4048-a0c3-8501f3e83c87 is still seen in agent 10.0.0.22 VM list
2024-09-05 01:54:49,871 - DEBUG - Pod 1547b72a-a36a-4ea9-9de9-ffc8c0fb5b30 is not in agent 10.0.0.22 VM list
2024-09-05 01:54:49,879 - DEBUG - VMI 57c21528-6b29-11ef-955d-fa163e1bcd04 is removed from agent 10.0.0.22
2024-09-05 01:54:49,879 - INFO - Verified that pod ctest-pod-19534551 is removed in agent
2024-09-05 01:54:49,925 - WARNING - Pod uuid 3ec964cc-888f-4af0-9550-94007e356f19 is still seen in agent 10.0.0.22 VM list
2024-09-05 01:54:49,925 - DEBUG - Pod 9519d528-5e91-4048-a0c3-8501f3e83c87 is not in agent 10.0.0.22 VM list
2024-09-05 01:54:49,928 - WARNING - Pod uuid 0f73b26a-868d-4962-8510-20d37a15c435 is still seen in agent 10.0.0.22 VM list
2024-09-05 01:54:49,928 - DEBUG - Pod 9a2975d9-f4ee-433c-a59c-591dbad2a5bc is not in agent 10.0.0.22 VM list
2024-09-05 01:54:49,933 - WARNING - Pod uuid 4e9f5d1f-baa8-4f05-9892-79b784d3f786 is still seen in agent 10.0.0.22 VM list
2024-09-05 01:54:49,935 - WARNING - Pod uuid 5bd4553c-7c41-4ee9-b5b3-dc56202f8218 is still seen in agent 10.0.0.22 VM list
2024-09-05 01:54:49,936 - DEBUG - Pod ddc11e8e-8193-484d-9110-969c7d30b513 is not in agent 10.0.0.22 VM list
2024-09-05 01:54:49,950 - DEBUG - VMI 590457b6-6b29-11ef-955d-fa163e1bcd04 is removed from agent 10.0.0.22
2024-09-05 01:54:49,950 - INFO - Verified that pod ctest-pod-16986002 is removed in agent
2024-09-05 01:54:49,953 - DEBUG - VMI 59a11452-6b29-11ef-955d-fa163e1bcd04 is removed from agent 10.0.0.22
2024-09-05 01:54:49,953 - INFO - Verified that pod ctest-pod-75129936 is removed in agent
2024-09-05 01:54:49,953 - DEBUG - VMI 5850609e-6b29-11ef-955d-fa163e1bcd04 is removed from agent 10.0.0.22
2024-09-05 01:54:49,954 - INFO - Verified that pod ctest-pod-79752868 is removed in agent
2024-09-05 01:54:54,939 - WARNING - Pod uuid 0f73b26a-868d-4962-8510-20d37a15c435 is still seen in agent 10.0.0.22 VM list
2024-09-05 01:54:54,940 - WARNING - Pod uuid 3ec964cc-888f-4af0-9550-94007e356f19 is still seen in agent 10.0.0.22 VM list
2024-09-05 01:54:54,947 - WARNING - Pod uuid 4e9f5d1f-baa8-4f05-9892-79b784d3f786 is still seen in agent 10.0.0.22 VM list
2024-09-05 01:54:54,949 - WARNING - Pod uuid 5bd4553c-7c41-4ee9-b5b3-dc56202f8218 is still seen in agent 10.0.0.22 VM list
2024-09-05 01:54:59,955 - WARNING - Pod uuid 3ec964cc-888f-4af0-9550-94007e356f19 is still seen in agent 10.0.0.22 VM list
2024-09-05 01:54:59,956 - WARNING - Pod uuid 0f73b26a-868d-4962-8510-20d37a15c435 is still seen in agent 10.0.0.22 VM list
2024-09-05 01:54:59,963 - WARNING - Pod uuid 5bd4553c-7c41-4ee9-b5b3-dc56202f8218 is still seen in agent 10.0.0.22 VM list
2024-09-05 01:54:59,964 - WARNING - Pod uuid 4e9f5d1f-baa8-4f05-9892-79b784d3f786 is still seen in agent 10.0.0.22 VM list
2024-09-05 01:55:04,976 - WARNING - Pod uuid 0f73b26a-868d-4962-8510-20d37a15c435 is still seen in agent 10.0.0.22 VM list
2024-09-05 01:55:04,977 - WARNING - Pod uuid 3ec964cc-888f-4af0-9550-94007e356f19 is still seen in agent 10.0.0.22 VM list
2024-09-05 01:55:04,985 - WARNING - Pod uuid 5bd4553c-7c41-4ee9-b5b3-dc56202f8218 is still seen in agent 10.0.0.22 VM list
2024-09-05 01:55:04,987 - WARNING - Pod uuid 4e9f5d1f-baa8-4f05-9892-79b784d3f786 is still seen in agent 10.0.0.22 VM list
2024-09-05 01:55:10,002 - WARNING - Pod uuid 0f73b26a-868d-4962-8510-20d37a15c435 is still seen in agent 10.0.0.22 VM list
2024-09-05 01:55:10,003 - WARNING - Pod uuid 3ec964cc-888f-4af0-9550-94007e356f19 is still seen in agent 10.0.0.22 VM list
2024-09-05 01:55:10,004 - WARNING - Pod uuid 4e9f5d1f-baa8-4f05-9892-79b784d3f786 is still seen in agent 10.0.0.22 VM list
2024-09-05 01:55:10,004 - WARNING - Pod uuid 5bd4553c-7c41-4ee9-b5b3-dc56202f8218 is still seen in agent 10.0.0.22 VM list
2024-09-05 01:55:15,046 - WARNING - Pod uuid 5bd4553c-7c41-4ee9-b5b3-dc56202f8218 is still seen in agent 10.0.0.22 VM list
2024-09-05 01:55:15,053 - WARNING - Pod uuid 4e9f5d1f-baa8-4f05-9892-79b784d3f786 is still seen in agent 10.0.0.22 VM list
2024-09-05 01:55:15,054 - WARNING - Pod uuid 0f73b26a-868d-4962-8510-20d37a15c435 is still seen in agent 10.0.0.22 VM list
2024-09-05 01:55:15,054 - WARNING - Pod uuid 3ec964cc-888f-4af0-9550-94007e356f19 is still seen in agent 10.0.0.22 VM list
2024-09-05 01:55:20,059 - DEBUG - Pod 5bd4553c-7c41-4ee9-b5b3-dc56202f8218 is not in agent 10.0.0.22 VM list
2024-09-05 01:55:20,074 - DEBUG - Pod 4e9f5d1f-baa8-4f05-9892-79b784d3f786 is not in agent 10.0.0.22 VM list
2024-09-05 01:55:20,082 - DEBUG - VMI 5b4a2e4c-6b29-11ef-955d-fa163e1bcd04 is removed from agent 10.0.0.22
2024-09-05 01:55:20,082 - INFO - Verified that pod ctest-pod-81931380 is removed in agent
2024-09-05 01:55:20,083 - DEBUG - Pod 3ec964cc-888f-4af0-9550-94007e356f19 is not in agent 10.0.0.22 VM list
2024-09-05 01:55:20,086 - DEBUG - Pod 0f73b26a-868d-4962-8510-20d37a15c435 is not in agent 10.0.0.22 VM list
2024-09-05 01:55:20,098 - DEBUG - VMI 5ac6dc18-6b29-11ef-955d-fa163e1bcd04 is removed from agent 10.0.0.22
2024-09-05 01:55:20,098 - INFO - Verified that pod ctest-pod-98272129 is removed in agent
2024-09-05 01:55:20,100 - DEBUG - VMI 5a4696d4-6b29-11ef-955d-fa163e1bcd04 is removed from agent 10.0.0.22
2024-09-05 01:55:20,100 - INFO - Verified that pod ctest-pod-80303885 is removed in agent
2024-09-05 01:55:20,226 - DEBUG - VMI 5bce6fae-6b29-11ef-955d-fa163e1bcd04 is removed from agent 10.0.0.22
2024-09-05 01:55:20,226 - INFO - Verified that pod ctest-pod-45739068 is removed in agent
2024-09-05 01:55:20,226 - INFO - Deleting namespace ctest-non-default-38950195
2024-09-05 01:55:20,251 - DEBUG - Namespace ctest-non-default-38950195 still in k8s
2024-09-05 01:55:22,436 - DEBUG - Namespace ctest-non-default-38950195 still in k8s
2024-09-05 01:55:24,442 - DEBUG - Namespace ctest-non-default-38950195 still in k8s
2024-09-05 01:55:26,446 - DEBUG - Namespace ctest-non-default-38950195 is not in k8s
2024-09-05 01:55:26,447 - DEBUG - No need to check project deletion in contrail-api
2024-09-05 01:55:26,447 - INFO - Deleting namespace ctest-new-default-47619721
2024-09-05 01:55:26,465 - DEBUG - Namespace ctest-new-default-47619721 still in k8s
2024-09-05 01:55:28,470 - DEBUG - Namespace ctest-new-default-47619721 still in k8s
2024-09-05 01:55:30,484 - DEBUG - Namespace ctest-new-default-47619721 still in k8s
2024-09-05 01:55:32,494 - DEBUG - Namespace ctest-new-default-47619721 is not in k8s
2024-09-05 01:55:32,494 - DEBUG - No need to check project deletion in contrail-api