2024-10-31 02:10:54,262 - DEBUG - [10.0.0.27]: Running cmd : hostname
2024-10-31 02:10:54,512 - DEBUG - Output : cn-jenkins-deploy-platform-juju-k8s-751-1
2024-10-31 02:10:54,513 - DEBUG - [10.0.0.27]: Running cmd : hostname -f
2024-10-31 02:10:54,547 - DEBUG - Output : cn-jenkins-deploy-platform-juju-k8s-751-1
2024-10-31 02:10:54,547 - DEBUG - [10.0.0.27]: Running cmd : docker ps -a 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}'
2024-10-31 02:10:54,622 - DEBUG - Output : NAMES
contrail_test_c7MFApzXe
contrail-kubernetes-master_kubemanager_1
webui_job_1
webui_web_1
control_named_1
control_dns_1
control_control_1
control_nodemgr_1
config_database_nodemgr_1
config_database_cassandra_1
config_database_rabbitmq_1
config_database_zookeeper_1
config_api_devicemgr_1
config_api_nodemgr_1
config_api_api_1
config_api_dnsmasq_1
config_api_schema_1
config_api_svcmonitor_1
redis_redis_1
analytics_snmp_topology_1
analytics_snmp_nodemgr_1
analytics_snmp_snmp-collector_1
analytics_alarm_alarm-gen_1
analytics_alarm_nodemgr_1
analytics_alarm_kafka_1
analytics_nodemgr_1
analytics_api_1
analytics_collector_1
analytics_database_query-engine_1
analytics_database_nodemgr_1
analytics_database_cassandra_1
2024-10-31 02:10:54,622 - DEBUG - [10.0.0.27]: Running cmd : ip addr show | grep 'inet .*/.* brd ' | awk '{print $2}'
2024-10-31 02:10:54,656 - DEBUG - Output : 10.0.0.27/24
172.17.0.1/16
2024-10-31 02:10:54,656 - DEBUG - [10.0.0.27]: Running cmd : getent hosts 10.0.0.27 | head -n 1 | awk '{print $2}'
2024-10-31 02:10:54,731 - DEBUG - Output : cn-jenkins-deploy-platform-juju-k8s-751-1
2024-10-31 02:10:54,780 - DEBUG - [10.0.0.58]: Running cmd : hostname
2024-10-31 02:10:55,007 - DEBUG - Output : an-jenkins-deploy-platform-juju-k8s-751-1
2024-10-31 02:10:55,008 - DEBUG - [10.0.0.58]: Running cmd : hostname -f
2024-10-31 02:10:55,032 - DEBUG - Output : an-jenkins-deploy-platform-juju-k8s-751-1
2024-10-31 02:10:55,032 - DEBUG - [10.0.0.58]: Running cmd : docker ps -a 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}'
2024-10-31 02:10:55,077 - DEBUG - Output : NAMES
vrouter_nodemgr_1
vrouter_vrouter-agent_1
2024-10-31 02:10:55,077 - DEBUG - [10.0.0.58]: Running cmd : ip addr show dev vhost0 | grep 'inet .*/.* brd ' | awk '{print $2}'
2024-10-31 02:10:55,155 - DEBUG - Output : 10.0.0.58/24
2024-10-31 02:10:55,155 - DEBUG - [10.0.0.58]: Running cmd : getent hosts 10.0.0.58 | head -n 1 | awk '{print $2}'
2024-10-31 02:10:55,192 - DEBUG - Output : an-jenkins-deploy-platform-juju-k8s-751-1
2024-10-31 02:10:55,291 - INFO - Using existing project ['default-domain', 'k8s-default'](f92acdaf-6681-4608-a7cf-7f32f669307a)
2024-10-31 02:10:55,363 - INFO - Using existing project ['default-domain', 'k8s-default'](f92acdaf-6681-4608-a7cf-7f32f669307a)
2024-10-31 02:10:55,504 - INFO - ================================================================================
2024-10-31 02:10:55,505 - INFO - STARTING TEST : test_ingress_ip_assignment
2024-10-31 02:10:55,505 - INFO - TEST DESCRIPTION :
Verify that Ingress gets a CLuster IP which is reachable to Pods in same
namespace. Also verify that a Floating IP is assigned to the Ingress
from the Public FIP poo.
Steps:
1. Create a service with 2 pods running nginx
2. Create an ingress out of this service
3. From another Pod do a wget on the ingress Cluster ip
Validate that Ingress get a IP from Public FIP pool which might/might not be accessible.
Validate that service and its loadbalancing work
2024-10-31 02:10:55,721 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_AgentXmppConnectionStatusReq?
2024-10-31 02:10:55,730 - DEBUG - Nothing to compare xmpp stats {'10.0.0.58': {'10.0.0.27': '0'}} with
2024-10-31 02:10:55,730 - INFO - Initial checks done. Running the testcase now
2024-10-31 02:10:55,730 - INFO -
2024-10-31 02:10:55,734 - INFO - Namespace default already exists
2024-10-31 02:10:55,734 - DEBUG - [10.0.0.27]: Running cmd : docker exec --privileged -it contrail-kubernetes-master_kubemanager_1 /bin/bash -c 'grep "^[ ]*cluster_project" /etc/contrail/contrail-kubernetes.conf'
2024-10-31 02:10:55,850 - DEBUG - Output : cluster_project={}
2024-10-31 02:10:55,907 - INFO - Project default-domain:k8s-default for Namespace default is seen in contrail-api
2024-10-31 02:10:55,907 - DEBUG - Project uuid in Contrail is f92acdaf-6681-4608-a7cf-7f32f669307a
2024-10-31 02:10:55,907 - DEBUG - [10.0.0.27]: Running cmd : docker exec --privileged -it contrail-kubernetes-master_kubemanager_1 /bin/bash -c 'netstat -antp | grep :8108 | grep LISTEN'
2024-10-31 02:10:56,021 - DEBUG - Output : tcp 0 0 0.0.0.0:8108 0.0.0.0:* LISTEN 1/python3
2024-10-31 02:10:56,022 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NamespaceDatabaseList?namespace_uuid=ea94084b-fea4-4aff-8157-2de0f5ee28db
2024-10-31 02:10:56,026 - INFO - Namespace default with uuid ea94084b-fea4-4aff-8157-2de0f5ee28db found in kube manager
2024-10-31 02:10:56,027 - INFO - Namespace default verification passed
2024-10-31 02:10:56,033 - DEBUG - Service ctest-nginx-svc-80940577 not present
2024-10-31 02:10:56,033 - INFO - Creating service ctest-nginx-svc-80940577
2024-10-31 02:10:56,060 - INFO - Created Service ctest-nginx-svc-80940577
2024-10-31 02:10:56,074 - DEBUG - Pod ctest-nginx-pod-20302420 not present
2024-10-31 02:10:56,075 - INFO - Creating Pod ctest-nginx-pod-20302420
2024-10-31 02:10:56,155 - DEBUG - Pod : ctest-nginx-pod-20302420 UUID is 42bf9360-855f-447c-a032-7f808628e6cd
2024-10-31 02:10:56,158 - DEBUG - Pod ctest-nginx-pod-91140083 not present
2024-10-31 02:10:56,158 - INFO - Creating Pod ctest-nginx-pod-91140083
2024-10-31 02:10:56,178 - DEBUG - Pod : ctest-nginx-pod-91140083 UUID is 55d62b41-0eea-4041-96ab-6ca5cd88b3d4
2024-10-31 02:10:56,411 - INFO - Created VN __public__, UUID :9e2730c7-0fb7-4a3a-bef6-561dd40e0944
2024-10-31 02:10:56,709 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2024-10-31 02:10:56,719 - DEBUG - Requesting: http://10.0.0.27:8082/domain/ca6e2dc8-29ef-403b-9710-4b0ebf5afee5
2024-10-31 02:10:56,767 - DEBUG - Requesting: http://10.0.0.27:8082/project/f92acdaf-6681-4608-a7cf-7f32f669307a
2024-10-31 02:10:56,886 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/9e2730c7-0fb7-4a3a-bef6-561dd40e0944
2024-10-31 02:10:56,904 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/9e2730c7-0fb7-4a3a-bef6-561dd40e0944
2024-10-31 02:10:56,945 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/599cf04e-f640-4f43-b98b-ad131f94aae1
2024-10-31 02:10:56,972 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/599cf04e-f640-4f43-b98b-ad131f94aae1
2024-10-31 02:10:56,987 - DEBUG - Route Targets: []
2024-10-31 02:10:56,987 - DEBUG - RT names not yet present for VN __public__
2024-10-31 02:11:01,988 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2024-10-31 02:11:01,994 - DEBUG - Requesting: http://10.0.0.27:8082/domain/ca6e2dc8-29ef-403b-9710-4b0ebf5afee5
2024-10-31 02:11:02,006 - DEBUG - Requesting: http://10.0.0.27:8082/project/f92acdaf-6681-4608-a7cf-7f32f669307a
2024-10-31 02:11:02,060 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/9e2730c7-0fb7-4a3a-bef6-561dd40e0944
2024-10-31 02:11:02,073 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/9e2730c7-0fb7-4a3a-bef6-561dd40e0944
2024-10-31 02:11:02,087 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/599cf04e-f640-4f43-b98b-ad131f94aae1
2024-10-31 02:11:02,097 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/599cf04e-f640-4f43-b98b-ad131f94aae1
2024-10-31 02:11:02,104 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/943c1e9a-85a2-4090-8ba9-1a1eceed5647
2024-10-31 02:11:02,111 - DEBUG - Route Targets: ['target:64512:8000007']
2024-10-31 02:11:02,111 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/9e2730c7-0fb7-4a3a-bef6-561dd40e0944
2024-10-31 02:11:02,125 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/599cf04e-f640-4f43-b98b-ad131f94aae1
2024-10-31 02:11:02,145 - INFO - Verified VN network id 13 for VN 9e2730c7-0fb7-4a3a-bef6-561dd40e0944
2024-10-31 02:11:02,145 - INFO - Verifications in API Server for VN __public__ passed
2024-10-31 02:11:02,145 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/9e2730c7-0fb7-4a3a-bef6-561dd40e0944
2024-10-31 02:11:02,158 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/599cf04e-f640-4f43-b98b-ad131f94aae1
2024-10-31 02:11:02,165 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/599cf04e-f640-4f43-b98b-ad131f94aae1
2024-10-31 02:11:02,174 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/943c1e9a-85a2-4090-8ba9-1a1eceed5647
2024-10-31 02:11:02,183 - DEBUG - Requesting: http://10.0.0.27:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:k8s-default:__public__
2024-10-31 02:11:02,191 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:k8s-default:__public__', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'cloud-admin', 'owner-access': '7', 'group': 'cloud-admin-group', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11396131013604624954', 'uuid-lslong': '13760280397588859204'}, 'enable': 'true', 'created': '2024-10-31T02:10:56', 'last-modified': '2024-10-31T02:10:56', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:05.571549'}
2024-10-31 02:11:02,191 - DEBUG - Requesting: http://10.0.0.27:8083/Snh_ShowRoutingInstanceReq?name=default-domain:k8s-default:__public__:__public__
2024-10-31 02:11:02,197 - DEBUG - Route Targets: ['target:64512:8000007']
2024-10-31 02:11:02,197 - INFO - On all control nodes, Config, RI and RT verification for VN __public__ passed
2024-10-31 02:11:02,198 - DEBUG - ====Verifying policy data for __public__ in API_Server ======
2024-10-31 02:11:02,198 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2024-10-31 02:11:02,205 - DEBUG - Requesting: http://10.0.0.27:8082/domain/ca6e2dc8-29ef-403b-9710-4b0ebf5afee5
2024-10-31 02:11:02,214 - DEBUG - Requesting: http://10.0.0.27:8082/project/f92acdaf-6681-4608-a7cf-7f32f669307a
2024-10-31 02:11:02,259 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/9e2730c7-0fb7-4a3a-bef6-561dd40e0944
2024-10-31 02:11:02,273 - DEBUG - =>VN __public__ has no policy to be verified
2024-10-31 02:11:02,273 - DEBUG - Verifying the vn in opserver
2024-10-31 02:11:02,273 - DEBUG - Verifying the default-domain:k8s-default:__public__ virtual network link through opserver 10.0.0.27
2024-10-31 02:11:02,273 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2024-10-31 02:11:02,278 - DEBUG - vn link and name as {'name': 'default-domain:k8s-default:__public__', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:k8s-default:__public__?flat'}
2024-10-31 02:11:02,278 - INFO - Validated that VN default-domain:k8s-default:__public__ is found in opserver
2024-10-31 02:11:02,279 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__
2024-10-31 02:11:02,286 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__
2024-10-31 02:11:02,294 - DEBUG - Do not have enough data to verify VN in agent
2024-10-31 02:11:02,294 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__
2024-10-31 02:11:02,300 - DEBUG - VRF ids for VN __public__: {}
2024-10-31 02:11:02,417 - INFO - Creating Floating IP pool __fip_pool_public__ in API Server
2024-10-31 02:11:02,534 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2024-10-31 02:11:02,540 - DEBUG - Requesting: http://10.0.0.27:8082/domain/ca6e2dc8-29ef-403b-9710-4b0ebf5afee5
2024-10-31 02:11:02,553 - DEBUG - Requesting: http://10.0.0.27:8082/project/f92acdaf-6681-4608-a7cf-7f32f669307a
2024-10-31 02:11:02,599 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/9e2730c7-0fb7-4a3a-bef6-561dd40e0944
2024-10-31 02:11:02,620 - DEBUG - Requesting: http://10.0.0.27:8082/floating-ip-pool/525973ad-183d-4cf3-9f59-6f3206c945c4
2024-10-31 02:11:02,627 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2024-10-31 02:11:02,633 - DEBUG - Requesting: http://10.0.0.27:8082/domain/ca6e2dc8-29ef-403b-9710-4b0ebf5afee5
2024-10-31 02:11:02,642 - DEBUG - Requesting: http://10.0.0.27:8082/project/f92acdaf-6681-4608-a7cf-7f32f669307a
2024-10-31 02:11:02,696 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/9e2730c7-0fb7-4a3a-bef6-561dd40e0944
2024-10-31 02:11:02,710 - DEBUG - FIP Pool __fip_pool_public__ found in API Server
2024-10-31 02:11:02,710 - INFO - Verification for FIP pool __fip_pool_public__ in API Server passed
2024-10-31 02:11:02,723 - DEBUG - Requesting: http://10.0.0.27:8083/Snh_IFMapTableShowReq?table_name=floating-ip-pool&search_string=floating-ip-pool:default-domain:k8s-default:__public__:__fip_pool_public__
2024-10-31 02:11:02,730 - DEBUG - Control-node Ifmap-view has FIP pool __fip_pool_public__ information
2024-10-31 02:11:02,731 - INFO - Verification for FIP pool __fip_pool_public__ in Control-node passed
2024-10-31 02:11:02,734 - DEBUG - Ingress ctest-nginx-ingress-62461699 not present
2024-10-31 02:11:02,734 - INFO - Creating Ingress ctest-nginx-ingress-62461699
2024-10-31 02:11:02,742 - INFO - Created Ingress ctest-nginx-ingress-62461699
2024-10-31 02:11:02,745 - DEBUG - Cluster IP not yet seen for Ingress ctest-nginx-ingress-62461699
2024-10-31 02:11:05,751 - DEBUG - For Ingress ctest-nginx-ingress-62461699, Cluster IP: 10.47.255.249, External IPs ['18.75.199.252']
2024-10-31 02:11:05,751 - INFO - Verifications in k8s passed for Ingress ctest-nginx-ingress-62461699
2024-10-31 02:11:05,751 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_LoadbalancerDatabaseList?x=d6b8cb3b-2d9a-49c8-ae0a-dfd7675b93de
2024-10-31 02:11:05,776 - INFO - Ingress ctest-nginx-ingress-62461699 with uuid d6b8cb3b-2d9a-49c8-ae0a-dfd7675b93de found in kube manager
2024-10-31 02:11:05,776 - INFO - Ingress ctest-nginx-ingress-62461699 verification passed
2024-10-31 02:11:05,780 - DEBUG - Pod ctest-busybox-pod-89120467 not present
2024-10-31 02:11:05,780 - INFO - Creating Pod ctest-busybox-pod-89120467
2024-10-31 02:11:05,827 - DEBUG - Pod : ctest-busybox-pod-89120467 UUID is 1801685f-0da5-4900-8226-be44bd49de87
2024-10-31 02:11:05,836 - DEBUG - Pod ctest-nginx-pod-20302420 not in running state.Currently in Pending
2024-10-31 02:11:10,842 - INFO - Pod ctest-nginx-pod-20302420 is in running state.Got IP 10.47.255.251
2024-10-31 02:11:10,863 - DEBUG - Pod ctest-nginx-pod-20302420 has vmi 5e084576-972d-11ef-9ae2-fa163e7222e9
2024-10-31 02:11:10,863 - INFO - Verified pod ctest-nginx-pod-20302420 in contrail-api
2024-10-31 02:11:10,863 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2024-10-31 02:11:10,874 - DEBUG - VMI 5e084576-972d-11ef-9ae2-fa163e7222e9 is active in agent 10.0.0.58
2024-10-31 02:11:10,875 - INFO - Verified Pod ctest-nginx-pod-20302420 in agent 10.0.0.58
2024-10-31 02:11:10,875 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=42bf9360-855f-447c-a032-7f808628e6cd
2024-10-31 02:11:10,880 - INFO - Pod ctest-nginx-pod-20302420 with uuid 42bf9360-855f-447c-a032-7f808628e6cd found in kube manager
2024-10-31 02:11:10,880 - INFO - Pod ctest-nginx-pod-20302420 verification passed
2024-10-31 02:11:10,956 - DEBUG - [Pod ctest-nginx-pod-20302420] Cmd: echo ctest-nginx-pod-20302420 > /usr/share/nginx/html/index.html, Output:
2024-10-31 02:11:10,962 - INFO - Pod ctest-nginx-pod-91140083 is in running state.Got IP 10.47.255.250
2024-10-31 02:11:11,025 - DEBUG - Pod ctest-nginx-pod-91140083 has vmi 5e8506a6-972d-11ef-9ae2-fa163e7222e9
2024-10-31 02:11:11,025 - INFO - Verified pod ctest-nginx-pod-91140083 in contrail-api
2024-10-31 02:11:11,025 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2024-10-31 02:11:11,045 - DEBUG - VMI 5e8506a6-972d-11ef-9ae2-fa163e7222e9 is active in agent 10.0.0.58
2024-10-31 02:11:11,045 - INFO - Verified Pod ctest-nginx-pod-91140083 in agent 10.0.0.58
2024-10-31 02:11:11,046 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=55d62b41-0eea-4041-96ab-6ca5cd88b3d4
2024-10-31 02:11:11,057 - INFO - Pod ctest-nginx-pod-91140083 with uuid 55d62b41-0eea-4041-96ab-6ca5cd88b3d4 found in kube manager
2024-10-31 02:11:11,058 - INFO - Pod ctest-nginx-pod-91140083 verification passed
2024-10-31 02:11:11,122 - DEBUG - [Pod ctest-nginx-pod-91140083] Cmd: echo ctest-nginx-pod-91140083 > /usr/share/nginx/html/index.html, Output:
2024-10-31 02:11:11,127 - DEBUG - Pod ctest-busybox-pod-89120467 not in running state.Currently in Pending
2024-10-31 02:11:16,135 - INFO - Pod ctest-busybox-pod-89120467 is in running state.Got IP 10.47.255.248
2024-10-31 02:11:16,154 - DEBUG - Pod ctest-busybox-pod-89120467 has vmi 630371ae-972d-11ef-9ae2-fa163e7222e9
2024-10-31 02:11:16,154 - INFO - Verified pod ctest-busybox-pod-89120467 in contrail-api
2024-10-31 02:11:16,154 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2024-10-31 02:11:16,165 - DEBUG - VMI 630371ae-972d-11ef-9ae2-fa163e7222e9 is active in agent 10.0.0.58
2024-10-31 02:11:16,165 - INFO - Verified Pod ctest-busybox-pod-89120467 in agent 10.0.0.58
2024-10-31 02:11:16,165 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=1801685f-0da5-4900-8226-be44bd49de87
2024-10-31 02:11:16,169 - INFO - Pod ctest-busybox-pod-89120467 with uuid 1801685f-0da5-4900-8226-be44bd49de87 found in kube manager
2024-10-31 02:11:16,169 - INFO - Pod ctest-busybox-pod-89120467 verification passed
2024-10-31 02:11:16,226 - DEBUG - [Pod ctest-busybox-pod-89120467] Cmd: wget http://10.47.255.249:80/ -O - -T 5 -t 1 , Output: ctest-nginx-pod-20302420
Connecting to 10.47.255.249:80 (10.47.255.249:80)
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
2024-10-31 02:11:16,227 - DEBUG - [Pod Pod ctest-busybox-pod-89120467] Cmd wget http://10.47.255.249:80/ -O - -T 5 -t 1 passed
2024-10-31 02:11:16,227 - DEBUG - [Pod Pod ctest-busybox-pod-89120467] Cmd output: ctest-nginx-pod-20302420
Connecting to 10.47.255.249:80 (10.47.255.249:80)
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
2024-10-31 02:11:16,299 - DEBUG - [Pod ctest-busybox-pod-89120467] Cmd: wget http://10.47.255.249:80/ -O - -T 5 -t 1 , Output: ctest-nginx-pod-20302420
Connecting to 10.47.255.249:80 (10.47.255.249:80)
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
2024-10-31 02:11:16,299 - DEBUG - [Pod Pod ctest-busybox-pod-89120467] Cmd wget http://10.47.255.249:80/ -O - -T 5 -t 1 passed
2024-10-31 02:11:16,299 - DEBUG - [Pod Pod ctest-busybox-pod-89120467] Cmd output: ctest-nginx-pod-20302420
Connecting to 10.47.255.249:80 (10.47.255.249:80)
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
2024-10-31 02:11:16,362 - DEBUG - [Pod ctest-busybox-pod-89120467] Cmd: wget http://10.47.255.249:80/ -O - -T 5 -t 1 , Output: Connecting to 10.47.255.249:80 (10.47.255.249:80)
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
ctest-nginx-pod-20302420
2024-10-31 02:11:16,362 - DEBUG - [Pod Pod ctest-busybox-pod-89120467] Cmd wget http://10.47.255.249:80/ -O - -T 5 -t 1 passed
2024-10-31 02:11:16,362 - DEBUG - [Pod Pod ctest-busybox-pod-89120467] Cmd output: Connecting to 10.47.255.249:80 (10.47.255.249:80)
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
ctest-nginx-pod-20302420
2024-10-31 02:11:16,418 - DEBUG - [Pod ctest-busybox-pod-89120467] Cmd: wget http://10.47.255.249:80/ -O - -T 5 -t 1 , Output: Connecting to 10.47.255.249:80 (10.47.255.249:80)
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
ctest-nginx-pod-91140083
2024-10-31 02:11:16,419 - DEBUG - [Pod Pod ctest-busybox-pod-89120467] Cmd wget http://10.47.255.249:80/ -O - -T 5 -t 1 passed
2024-10-31 02:11:16,419 - DEBUG - [Pod Pod ctest-busybox-pod-89120467] Cmd output: Connecting to 10.47.255.249:80 (10.47.255.249:80)
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
ctest-nginx-pod-91140083
2024-10-31 02:11:16,419 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-nginx-pod-20302420': 3, 'ctest-nginx-pod-91140083': 1}
2024-10-31 02:11:16,419 - WARNING - Nothing to delete parallely
2024-10-31 02:11:16,420 - INFO - Deleting pod default:ctest-busybox-pod-89120467
2024-10-31 02:11:16,434 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=1801685f-0da5-4900-8226-be44bd49de87
2024-10-31 02:11:16,441 - WARNING - Pod uuid 1801685f-0da5-4900-8226-be44bd49de87 is still seen in agent 10.0.0.58 VM list
2024-10-31 02:11:21,442 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=1801685f-0da5-4900-8226-be44bd49de87
2024-10-31 02:11:21,449 - WARNING - Pod uuid 1801685f-0da5-4900-8226-be44bd49de87 is still seen in agent 10.0.0.58 VM list
2024-10-31 02:11:26,450 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=1801685f-0da5-4900-8226-be44bd49de87
2024-10-31 02:11:26,459 - WARNING - Pod uuid 1801685f-0da5-4900-8226-be44bd49de87 is still seen in agent 10.0.0.58 VM list
2024-10-31 02:11:31,460 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=1801685f-0da5-4900-8226-be44bd49de87
2024-10-31 02:11:31,469 - WARNING - Pod uuid 1801685f-0da5-4900-8226-be44bd49de87 is still seen in agent 10.0.0.58 VM list
2024-10-31 02:11:36,470 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=1801685f-0da5-4900-8226-be44bd49de87
2024-10-31 02:11:36,481 - WARNING - Pod uuid 1801685f-0da5-4900-8226-be44bd49de87 is still seen in agent 10.0.0.58 VM list
2024-10-31 02:11:41,481 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=1801685f-0da5-4900-8226-be44bd49de87
2024-10-31 02:11:41,489 - WARNING - Pod uuid 1801685f-0da5-4900-8226-be44bd49de87 is still seen in agent 10.0.0.58 VM list
2024-10-31 02:11:46,490 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=1801685f-0da5-4900-8226-be44bd49de87
2024-10-31 02:11:46,496 - WARNING - Pod uuid 1801685f-0da5-4900-8226-be44bd49de87 is still seen in agent 10.0.0.58 VM list
2024-10-31 02:11:51,497 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=1801685f-0da5-4900-8226-be44bd49de87
2024-10-31 02:11:51,504 - DEBUG - Pod 1801685f-0da5-4900-8226-be44bd49de87 is not in agent 10.0.0.58 VM list
2024-10-31 02:11:51,504 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:630371ae-972d-11ef-9ae2-fa163e7222e9
2024-10-31 02:11:51,510 - DEBUG - VMI 630371ae-972d-11ef-9ae2-fa163e7222e9 is removed from agent 10.0.0.58
2024-10-31 02:11:51,510 - INFO - Verified that pod ctest-busybox-pod-89120467 is removed in agent
2024-10-31 02:11:51,510 - INFO - Deleting Ingress : ctest-nginx-ingress-62461699
2024-10-31 02:11:51,515 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_LoadbalancerDatabaseList?x=d6b8cb3b-2d9a-49c8-ae0a-dfd7675b93de
2024-10-31 02:11:51,521 - ERROR - Ingress ctest-nginx-ingress-62461699 with uuid d6b8cb3b-2d9a-49c8-ae0a-dfd7675b93de still found in kube manager
2024-10-31 02:11:52,522 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_LoadbalancerDatabaseList?x=d6b8cb3b-2d9a-49c8-ae0a-dfd7675b93de
2024-10-31 02:11:52,526 - INFO - Ingress ctest-nginx-ingress-62461699 with uuid d6b8cb3b-2d9a-49c8-ae0a-dfd7675b93de deleted successfully from kube manager
2024-10-31 02:11:52,526 - INFO - Verifications on Ingress %s cleanup passed
2024-10-31 02:11:52,527 - INFO - Deleting the FIP pool __fip_pool_public__
2024-10-31 02:11:52,644 - DEBUG - Requesting: http://10.0.0.27:8083/Snh_IFMapTableShowReq?table_name=floating-ip-pool&search_string=floating-ip-pool:default-domain:k8s-default:__public__:__fip_pool_public__
2024-10-31 02:11:52,653 - DEBUG - Control-node Ifmap-view does not have FIP pool __fip_pool_public__ information
2024-10-31 02:11:52,653 - INFO - Deleting VN __public__
2024-10-31 02:11:52,798 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/599cf04e-f640-4f43-b98b-ad131f94aae1
2024-10-31 02:11:52,807 - DEBUG - Response Code: 404
2024-10-31 02:11:52,807 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2024-10-31 02:11:52,813 - DEBUG - Requesting: http://10.0.0.27:8082/domain/ca6e2dc8-29ef-403b-9710-4b0ebf5afee5
2024-10-31 02:11:52,830 - DEBUG - Requesting: http://10.0.0.27:8082/project/f92acdaf-6681-4608-a7cf-7f32f669307a
2024-10-31 02:11:52,929 - INFO - Validated that VN __public__ is not found in API Server
2024-10-31 02:11:52,930 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VnListReq?name=default-domain:k8s-default:__public__
2024-10-31 02:11:52,945 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__
2024-10-31 02:11:52,958 - DEBUG - VN __public__ is not present in Agent 10.0.0.58
2024-10-31 02:11:52,958 - INFO - Validated that VN __public__ is not in any agent
2024-10-31 02:11:52,958 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__
2024-10-31 02:11:52,967 - DEBUG - Requesting: http://10.0.0.27:8083/Snh_ShowRoutingInstanceReq?name=default-domain:k8s-default:__public__:__public__
2024-10-31 02:11:52,973 - DEBUG - Requesting: http://10.0.0.27:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:k8s-default:__public__
2024-10-31 02:11:52,978 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN __public__ info
2024-10-31 02:11:52,979 - INFO - Deleting pod default:ctest-nginx-pod-91140083
2024-10-31 02:11:52,990 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=55d62b41-0eea-4041-96ab-6ca5cd88b3d4
2024-10-31 02:11:53,005 - WARNING - Pod uuid 55d62b41-0eea-4041-96ab-6ca5cd88b3d4 is still seen in agent 10.0.0.58 VM list
2024-10-31 02:11:58,007 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=55d62b41-0eea-4041-96ab-6ca5cd88b3d4
2024-10-31 02:11:58,014 - DEBUG - Pod 55d62b41-0eea-4041-96ab-6ca5cd88b3d4 is not in agent 10.0.0.58 VM list
2024-10-31 02:11:58,015 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:5e8506a6-972d-11ef-9ae2-fa163e7222e9
2024-10-31 02:11:58,021 - DEBUG - VMI 5e8506a6-972d-11ef-9ae2-fa163e7222e9 is removed from agent 10.0.0.58
2024-10-31 02:11:58,021 - INFO - Verified that pod ctest-nginx-pod-91140083 is removed in agent
2024-10-31 02:11:58,021 - INFO - Deleting pod default:ctest-nginx-pod-20302420
2024-10-31 02:11:58,032 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=42bf9360-855f-447c-a032-7f808628e6cd
2024-10-31 02:11:58,042 - WARNING - Pod uuid 42bf9360-855f-447c-a032-7f808628e6cd is still seen in agent 10.0.0.58 VM list
2024-10-31 02:12:03,042 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=42bf9360-855f-447c-a032-7f808628e6cd
2024-10-31 02:12:03,049 - DEBUG - Pod 42bf9360-855f-447c-a032-7f808628e6cd is not in agent 10.0.0.58 VM list
2024-10-31 02:12:03,049 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:5e084576-972d-11ef-9ae2-fa163e7222e9
2024-10-31 02:12:03,062 - DEBUG - VMI 5e084576-972d-11ef-9ae2-fa163e7222e9 is removed from agent 10.0.0.58
2024-10-31 02:12:03,062 - INFO - Verified that pod ctest-nginx-pod-20302420 is removed in agent
2024-10-31 02:12:03,062 - INFO - Deleting service : ctest-nginx-svc-80940577
2024-10-31 02:12:03,328 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_AgentXmppConnectionStatusReq?
2024-10-31 02:12:03,336 - DEBUG - No XMPP flaps were noticed during the test
2024-10-31 02:12:03,336 - INFO - END TEST : test_ingress_ip_assignment : PASSED[0:01:08]
2024-10-31 02:12:03,336 - INFO - --------------------------------------------------------------------------------
2024-10-31 02:12:09,736 - DEBUG - [10.0.0.27]: Running cmd : docker exec --privileged -it contrail-kubernetes-master_kubemanager_1 /bin/bash -c 'grep "^[ ]*cluster_project" /etc/contrail/contrail-kubernetes.conf'
2024-10-31 02:12:09,878 - DEBUG - Output : cluster_project={}
2024-10-31 02:12:09,942 - DEBUG - [10.0.0.27]: Running cmd : docker exec --privileged -it contrail-kubernetes-master_kubemanager_1 /bin/bash -c 'netstat -antp | grep :8108 | grep LISTEN'
2024-10-31 02:12:10,073 - DEBUG - Output : tcp 0 0 0.0.0.0:8108 0.0.0.0:* LISTEN 1/python3
2024-10-31 02:12:10,078 - DEBUG - [10.0.0.27]: Running cmd : docker exec --privileged -it contrail-kubernetes-master_kubemanager_1 /bin/bash -c 'grep "^[ ]*cluster_project" /etc/contrail/contrail-kubernetes.conf'
2024-10-31 02:12:10,243 - DEBUG - Output : cluster_project={}
2024-10-31 02:12:25,410 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2024-10-31 02:12:25,497 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2024-10-31 02:12:25,543 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2024-10-31 02:12:25,641 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2024-10-31 02:12:25,730 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2024-10-31 02:12:25,801 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2024-10-31 02:12:30,852 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2024-10-31 02:12:30,941 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2024-10-31 02:12:31,216 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_AgentXmppConnectionStatusReq?
2024-10-31 02:12:33,905 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_ApplicationPolicySetReq?
2024-10-31 02:12:33,912 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_AclReq?
2024-10-31 02:12:33,941 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_AclReq?
2024-10-31 02:12:35,977 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_AclReq?
2024-10-31 02:15:46,077 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_AgentXmppConnectionStatusReq?
2024-10-31 02:15:46,125 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=c5d66852-f78d-41d2-8789-5fb5505e8481
2024-10-31 02:15:46,146 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=e71d1720-3381-42b8-82a8-07b119e4cc3d
2024-10-31 02:15:46,172 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=1fa342da-6aea-4187-b4e2-bef6ce674e87
2024-10-31 02:15:46,186 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=1e40a657-b7cb-4a1b-b5c4-d7503aa1bc59
2024-10-31 02:15:46,196 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=87299684-cf05-448f-912e-05f7d68df2a3
2024-10-31 02:15:46,214 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=913b41bc-ba53-4121-a13a-c55ffce14ab5
2024-10-31 02:15:46,226 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=4671fdb8-14f6-4f83-9dbc-6c59a97a1505
2024-10-31 02:15:46,231 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=0f5039cd-35b9-4e7f-bce7-01d7bc0198c0
2024-10-31 02:15:51,165 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=c5d66852-f78d-41d2-8789-5fb5505e8481
2024-10-31 02:15:51,173 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:89fdcdae-972d-11ef-9ae2-fa163e7222e9
2024-10-31 02:15:51,242 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=e71d1720-3381-42b8-82a8-07b119e4cc3d
2024-10-31 02:15:51,287 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=4671fdb8-14f6-4f83-9dbc-6c59a97a1505
2024-10-31 02:15:51,289 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=87299684-cf05-448f-912e-05f7d68df2a3
2024-10-31 02:15:51,291 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=0f5039cd-35b9-4e7f-bce7-01d7bc0198c0
2024-10-31 02:15:51,292 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=1fa342da-6aea-4187-b4e2-bef6ce674e87
2024-10-31 02:15:51,294 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=1e40a657-b7cb-4a1b-b5c4-d7503aa1bc59
2024-10-31 02:15:51,308 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=913b41bc-ba53-4121-a13a-c55ffce14ab5
2024-10-31 02:15:51,315 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:8bf9f664-972d-11ef-9ae2-fa163e7222e9
2024-10-31 02:15:51,324 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:8b638d00-972d-11ef-9ae2-fa163e7222e9
2024-10-31 02:15:56,250 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=e71d1720-3381-42b8-82a8-07b119e4cc3d
2024-10-31 02:15:56,315 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=0f5039cd-35b9-4e7f-bce7-01d7bc0198c0
2024-10-31 02:15:56,316 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=1e40a657-b7cb-4a1b-b5c4-d7503aa1bc59
2024-10-31 02:15:56,317 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=87299684-cf05-448f-912e-05f7d68df2a3
2024-10-31 02:15:56,319 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=4671fdb8-14f6-4f83-9dbc-6c59a97a1505
2024-10-31 02:16:01,257 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=e71d1720-3381-42b8-82a8-07b119e4cc3d
2024-10-31 02:16:01,331 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=0f5039cd-35b9-4e7f-bce7-01d7bc0198c0
2024-10-31 02:16:01,333 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=4671fdb8-14f6-4f83-9dbc-6c59a97a1505
2024-10-31 02:16:01,334 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=1e40a657-b7cb-4a1b-b5c4-d7503aa1bc59
2024-10-31 02:16:01,972 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=87299684-cf05-448f-912e-05f7d68df2a3
2024-10-31 02:16:06,266 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=e71d1720-3381-42b8-82a8-07b119e4cc3d
2024-10-31 02:16:06,345 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=0f5039cd-35b9-4e7f-bce7-01d7bc0198c0
2024-10-31 02:16:06,347 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=1e40a657-b7cb-4a1b-b5c4-d7503aa1bc59
2024-10-31 02:16:06,348 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=4671fdb8-14f6-4f83-9dbc-6c59a97a1505
2024-10-31 02:16:06,985 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=87299684-cf05-448f-912e-05f7d68df2a3
2024-10-31 02:16:11,276 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=e71d1720-3381-42b8-82a8-07b119e4cc3d
2024-10-31 02:16:11,359 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=0f5039cd-35b9-4e7f-bce7-01d7bc0198c0
2024-10-31 02:16:11,361 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=4671fdb8-14f6-4f83-9dbc-6c59a97a1505
2024-10-31 02:16:11,632 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=1e40a657-b7cb-4a1b-b5c4-d7503aa1bc59
2024-10-31 02:16:11,993 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=87299684-cf05-448f-912e-05f7d68df2a3
2024-10-31 02:16:16,286 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=e71d1720-3381-42b8-82a8-07b119e4cc3d
2024-10-31 02:16:16,370 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=4671fdb8-14f6-4f83-9dbc-6c59a97a1505
2024-10-31 02:16:16,372 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=0f5039cd-35b9-4e7f-bce7-01d7bc0198c0
2024-10-31 02:16:16,640 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=1e40a657-b7cb-4a1b-b5c4-d7503aa1bc59
2024-10-31 02:16:17,009 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=87299684-cf05-448f-912e-05f7d68df2a3
2024-10-31 02:16:21,355 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=e71d1720-3381-42b8-82a8-07b119e4cc3d
2024-10-31 02:16:21,362 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:8e5089aa-972d-11ef-9ae2-fa163e7222e9
2024-10-31 02:16:21,382 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=4671fdb8-14f6-4f83-9dbc-6c59a97a1505
2024-10-31 02:16:21,385 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=0f5039cd-35b9-4e7f-bce7-01d7bc0198c0
2024-10-31 02:16:21,394 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:8d33acb4-972d-11ef-9ae2-fa163e7222e9
2024-10-31 02:16:21,398 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:8a8ea572-972d-11ef-9ae2-fa163e7222e9
2024-10-31 02:16:21,651 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=1e40a657-b7cb-4a1b-b5c4-d7503aa1bc59
2024-10-31 02:16:21,660 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:8ca05f22-972d-11ef-9ae2-fa163e7222e9
2024-10-31 02:16:22,016 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_VmListReq?uuid=87299684-cf05-448f-912e-05f7d68df2a3
2024-10-31 02:16:22,025 - DEBUG - Requesting: http://10.0.0.58:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:8dc14fe2-972d-11ef-9ae2-fa163e7222e9