2024-11-03 22:03:00,534 - DEBUG - [10.0.0.33]: Running cmd : hostname
2024-11-03 22:03:00,843 - DEBUG - Output : cn-jenkins-deploy-platform-juju-k8s-754-1
2024-11-03 22:03:00,844 - DEBUG - [10.0.0.33]: Running cmd : hostname -f
2024-11-03 22:03:00,887 - DEBUG - Output : cn-jenkins-deploy-platform-juju-k8s-754-1
2024-11-03 22:03:00,887 - DEBUG - [10.0.0.33]: Running cmd : docker ps -a 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}'
2024-11-03 22:03:01,046 - DEBUG - Output : NAMES
contrail_test_0aHh8CbIf
contrail-kubernetes-master_kubemanager_1
analytics_database_cassandra_1
analytics_database_query-engine_1
analytics_database_nodemgr_1
analytics_snmp_snmp-collector_1
analytics_snmp_nodemgr_1
analytics_snmp_topology_1
analytics_alarm_alarm-gen_1
analytics_alarm_kafka_1
analytics_alarm_nodemgr_1
analytics_collector_1
analytics_api_1
analytics_nodemgr_1
redis_redis_1
webui_job_1
webui_web_1
control_named_1
control_control_1
control_dns_1
control_nodemgr_1
config_database_zookeeper_1
config_database_nodemgr_1
config_database_cassandra_1
config_database_rabbitmq_1
config_api_devicemgr_1
config_api_dnsmasq_1
config_api_svcmonitor_1
config_api_api_1
config_api_schema_1
config_api_nodemgr_1
2024-11-03 22:03:01,047 - DEBUG - [10.0.0.33]: Running cmd : ip addr show | grep 'inet .*/.* brd ' | awk '{print $2}'
2024-11-03 22:03:01,126 - DEBUG - Output : 10.0.0.33/24
172.17.0.1/16
2024-11-03 22:03:01,126 - DEBUG - [10.0.0.33]: Running cmd : getent hosts 10.0.0.33 | head -n 1 | awk '{print $2}'
2024-11-03 22:03:01,182 - DEBUG - Output : cn-jenkins-deploy-platform-juju-k8s-754-1
2024-11-03 22:03:01,308 - DEBUG - [10.0.0.12]: Running cmd : hostname
2024-11-03 22:03:01,525 - DEBUG - Output : an-jenkins-deploy-platform-juju-k8s-754-1
2024-11-03 22:03:01,526 - DEBUG - [10.0.0.12]: Running cmd : hostname -f
2024-11-03 22:03:01,563 - DEBUG - Output : an-jenkins-deploy-platform-juju-k8s-754-1
2024-11-03 22:03:01,564 - DEBUG - [10.0.0.12]: Running cmd : docker ps -a 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}'
2024-11-03 22:03:01,621 - DEBUG - Output : NAMES
vrouter_nodemgr_1
vrouter_vrouter-agent_1
2024-11-03 22:03:01,622 - DEBUG - [10.0.0.12]: Running cmd : ip addr show dev vhost0 | grep 'inet .*/.* brd ' | awk '{print $2}'
2024-11-03 22:03:01,682 - DEBUG - Output : 10.0.0.12/24
2024-11-03 22:03:01,682 - DEBUG - [10.0.0.12]: Running cmd : getent hosts 10.0.0.12 | head -n 1 | awk '{print $2}'
2024-11-03 22:03:01,709 - DEBUG - Output : an-jenkins-deploy-platform-juju-k8s-754-1
2024-11-03 22:03:01,939 - INFO - Using existing project ['default-domain', 'k8s-default'](c90c3e85-ed99-4593-9698-0334746906d8)
2024-11-03 22:03:02,094 - INFO - Using existing project ['default-domain', 'k8s-default'](c90c3e85-ed99-4593-9698-0334746906d8)
2024-11-03 22:03:02,257 - INFO - ================================================================================
2024-11-03 22:03:02,257 - INFO - STARTING TEST : test_ingress_ip_assignment
2024-11-03 22:03:02,258 - INFO - TEST DESCRIPTION :
Verify that Ingress gets a CLuster IP which is reachable to Pods in same
namespace. Also verify that a Floating IP is assigned to the Ingress
from the Public FIP poo.
Steps:
1. Create a service with 2 pods running nginx
2. Create an ingress out of this service
3. From another Pod do a wget on the ingress Cluster ip
Validate that Ingress get a IP from Public FIP pool which might/might not be accessible.
Validate that service and its loadbalancing work
2024-11-03 22:03:02,487 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_AgentXmppConnectionStatusReq?
2024-11-03 22:03:02,496 - DEBUG - Nothing to compare xmpp stats {'10.0.0.12': {'10.0.0.33': '0'}} with
2024-11-03 22:03:02,496 - INFO - Initial checks done. Running the testcase now
2024-11-03 22:03:02,496 - INFO -
2024-11-03 22:03:02,500 - INFO - Namespace default already exists
2024-11-03 22:03:02,501 - DEBUG - [10.0.0.33]: Running cmd : docker exec --privileged -it contrail-kubernetes-master_kubemanager_1 /bin/bash -c 'grep "^[ ]*cluster_project" /etc/contrail/contrail-kubernetes.conf'
2024-11-03 22:03:02,705 - DEBUG - Output : cluster_project={}
2024-11-03 22:03:02,791 - INFO - Project default-domain:k8s-default for Namespace default is seen in contrail-api
2024-11-03 22:03:02,791 - DEBUG - Project uuid in Contrail is c90c3e85-ed99-4593-9698-0334746906d8
2024-11-03 22:03:02,791 - DEBUG - [10.0.0.33]: Running cmd : docker exec --privileged -it contrail-kubernetes-master_kubemanager_1 /bin/bash -c 'netstat -antp | grep :8108 | grep LISTEN'
2024-11-03 22:03:02,950 - DEBUG - Output : tcp 0 0 0.0.0.0:8108 0.0.0.0:* LISTEN 1/python3
2024-11-03 22:03:02,950 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NamespaceDatabaseList?namespace_uuid=75448025-3b7d-479a-a9c4-7afd981368c0
2024-11-03 22:03:02,955 - INFO - Namespace default with uuid 75448025-3b7d-479a-a9c4-7afd981368c0 found in kube manager
2024-11-03 22:03:02,956 - INFO - Namespace default verification passed
2024-11-03 22:03:02,959 - DEBUG - Service ctest-nginx-svc-07001503 not present
2024-11-03 22:03:02,959 - INFO - Creating service ctest-nginx-svc-07001503
2024-11-03 22:03:02,979 - INFO - Created Service ctest-nginx-svc-07001503
2024-11-03 22:03:02,999 - DEBUG - Pod ctest-nginx-pod-89409741 not present
2024-11-03 22:03:02,999 - INFO - Creating Pod ctest-nginx-pod-89409741
2024-11-03 22:03:03,053 - DEBUG - Pod : ctest-nginx-pod-89409741 UUID is 163ffbf9-7f27-4747-a1b8-d9d12d8b6afb
2024-11-03 22:03:03,067 - DEBUG - Pod ctest-nginx-pod-04831669 not present
2024-11-03 22:03:03,068 - INFO - Creating Pod ctest-nginx-pod-04831669
2024-11-03 22:03:03,122 - DEBUG - Pod : ctest-nginx-pod-04831669 UUID is 1b638359-d43c-4900-813e-20e85f019ea5
2024-11-03 22:03:03,440 - INFO - Created VN __public__, UUID :1a3db006-1055-447e-ab26-46c75998a108
2024-11-03 22:03:03,750 - DEBUG - Requesting: http://10.0.0.33:8082/domains
2024-11-03 22:03:03,758 - DEBUG - Requesting: http://10.0.0.33:8082/domain/e89d1633-c1ad-42ee-853e-07229e93b454
2024-11-03 22:03:03,796 - DEBUG - Requesting: http://10.0.0.33:8082/project/c90c3e85-ed99-4593-9698-0334746906d8
2024-11-03 22:03:03,922 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/1a3db006-1055-447e-ab26-46c75998a108
2024-11-03 22:03:03,987 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/1a3db006-1055-447e-ab26-46c75998a108
2024-11-03 22:03:04,037 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/07999983-9fb6-4676-8312-ef96ad6e58a5
2024-11-03 22:03:04,048 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/07999983-9fb6-4676-8312-ef96ad6e58a5
2024-11-03 22:03:04,093 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/ca2a40c2-5efd-4817-a9a0-28b591b9d7dc
2024-11-03 22:03:04,110 - DEBUG - Route Targets: ['target:64512:8000007']
2024-11-03 22:03:04,111 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/1a3db006-1055-447e-ab26-46c75998a108
2024-11-03 22:03:04,164 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/07999983-9fb6-4676-8312-ef96ad6e58a5
2024-11-03 22:03:04,240 - INFO - Verified VN network id 13 for VN 1a3db006-1055-447e-ab26-46c75998a108
2024-11-03 22:03:04,240 - INFO - Verifications in API Server for VN __public__ passed
2024-11-03 22:03:04,241 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/1a3db006-1055-447e-ab26-46c75998a108
2024-11-03 22:03:04,269 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/07999983-9fb6-4676-8312-ef96ad6e58a5
2024-11-03 22:03:04,304 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/07999983-9fb6-4676-8312-ef96ad6e58a5
2024-11-03 22:03:04,316 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/ca2a40c2-5efd-4817-a9a0-28b591b9d7dc
2024-11-03 22:03:04,339 - DEBUG - Requesting: http://10.0.0.33:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:k8s-default:__public__
2024-11-03 22:03:04,355 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:k8s-default:__public__', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'cloud-admin', 'owner-access': '7', 'group': 'cloud-admin-group', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1890860958655792254', 'uuid-lslong': '12332622451616293128'}, 'enable': 'true', 'created': '2024-11-03T22:03:03', 'last-modified': '2024-11-03T22:03:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.675979'}
2024-11-03 22:03:04,355 - DEBUG - Requesting: http://10.0.0.33:8083/Snh_ShowRoutingInstanceReq?name=default-domain:k8s-default:__public__:__public__
2024-11-03 22:03:04,367 - DEBUG - Route Targets: ['target:64512:8000007']
2024-11-03 22:03:04,367 - INFO - On all control nodes, Config, RI and RT verification for VN __public__ passed
2024-11-03 22:03:04,368 - DEBUG - ====Verifying policy data for __public__ in API_Server ======
2024-11-03 22:03:04,368 - DEBUG - Requesting: http://10.0.0.33:8082/domains
2024-11-03 22:03:04,380 - DEBUG - Requesting: http://10.0.0.33:8082/domain/e89d1633-c1ad-42ee-853e-07229e93b454
2024-11-03 22:03:04,402 - DEBUG - Requesting: http://10.0.0.33:8082/project/c90c3e85-ed99-4593-9698-0334746906d8
2024-11-03 22:03:04,486 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/1a3db006-1055-447e-ab26-46c75998a108
2024-11-03 22:03:04,507 - DEBUG - =>VN __public__ has no policy to be verified
2024-11-03 22:03:04,508 - DEBUG - Verifying the vn in opserver
2024-11-03 22:03:04,508 - DEBUG - Verifying the default-domain:k8s-default:__public__ virtual network link through opserver 10.0.0.33
2024-11-03 22:03:04,508 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks
2024-11-03 22:03:04,514 - DEBUG - vn link and name as {'name': 'default-domain:k8s-default:__public__', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:k8s-default:__public__?flat'}
2024-11-03 22:03:04,514 - INFO - Validated that VN default-domain:k8s-default:__public__ is found in opserver
2024-11-03 22:03:04,514 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__
2024-11-03 22:03:04,525 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__
2024-11-03 22:03:04,532 - DEBUG - Do not have enough data to verify VN in agent
2024-11-03 22:03:04,532 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__
2024-11-03 22:03:04,545 - DEBUG - VRF ids for VN __public__: {}
2024-11-03 22:03:04,763 - INFO - Creating Floating IP pool __fip_pool_public__ in API Server
2024-11-03 22:03:04,998 - DEBUG - Requesting: http://10.0.0.33:8082/domains
2024-11-03 22:03:05,010 - DEBUG - Requesting: http://10.0.0.33:8082/domain/e89d1633-c1ad-42ee-853e-07229e93b454
2024-11-03 22:03:05,022 - DEBUG - Requesting: http://10.0.0.33:8082/project/c90c3e85-ed99-4593-9698-0334746906d8
2024-11-03 22:03:05,119 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/1a3db006-1055-447e-ab26-46c75998a108
2024-11-03 22:03:05,175 - DEBUG - Requesting: http://10.0.0.33:8082/floating-ip-pool/081e29c6-a04c-43a3-b6b4-24e79438faf9
2024-11-03 22:03:05,182 - DEBUG - Requesting: http://10.0.0.33:8082/domains
2024-11-03 22:03:05,192 - DEBUG - Requesting: http://10.0.0.33:8082/domain/e89d1633-c1ad-42ee-853e-07229e93b454
2024-11-03 22:03:05,202 - DEBUG - Requesting: http://10.0.0.33:8082/project/c90c3e85-ed99-4593-9698-0334746906d8
2024-11-03 22:03:05,256 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/1a3db006-1055-447e-ab26-46c75998a108
2024-11-03 22:03:05,303 - DEBUG - FIP Pool __fip_pool_public__ found in API Server
2024-11-03 22:03:05,303 - INFO - Verification for FIP pool __fip_pool_public__ in API Server passed
2024-11-03 22:03:05,316 - DEBUG - Requesting: http://10.0.0.33:8083/Snh_IFMapTableShowReq?table_name=floating-ip-pool&search_string=floating-ip-pool:default-domain:k8s-default:__public__:__fip_pool_public__
2024-11-03 22:03:05,324 - DEBUG - Control-node Ifmap-view has FIP pool __fip_pool_public__ information
2024-11-03 22:03:05,324 - INFO - Verification for FIP pool __fip_pool_public__ in Control-node passed
2024-11-03 22:03:05,330 - DEBUG - Ingress ctest-nginx-ingress-25627056 not present
2024-11-03 22:03:05,330 - INFO - Creating Ingress ctest-nginx-ingress-25627056
2024-11-03 22:03:05,342 - INFO - Created Ingress ctest-nginx-ingress-25627056
2024-11-03 22:03:05,355 - DEBUG - Cluster IP not yet seen for Ingress ctest-nginx-ingress-25627056
2024-11-03 22:03:08,362 - DEBUG - Cluster IP not yet seen for Ingress ctest-nginx-ingress-25627056
2024-11-03 22:03:11,368 - DEBUG - For Ingress ctest-nginx-ingress-25627056, Cluster IP: 10.47.255.249, External IPs ['47.215.127.60']
2024-11-03 22:03:11,369 - INFO - Verifications in k8s passed for Ingress ctest-nginx-ingress-25627056
2024-11-03 22:03:11,371 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_LoadbalancerDatabaseList?x=430f83d4-2ce2-45dc-bc9a-ee4039e8bece
2024-11-03 22:03:11,378 - INFO - Ingress ctest-nginx-ingress-25627056 with uuid 430f83d4-2ce2-45dc-bc9a-ee4039e8bece found in kube manager
2024-11-03 22:03:11,378 - INFO - Ingress ctest-nginx-ingress-25627056 verification passed
2024-11-03 22:03:11,381 - DEBUG - Pod ctest-busybox-pod-44412997 not present
2024-11-03 22:03:11,381 - INFO - Creating Pod ctest-busybox-pod-44412997
2024-11-03 22:03:11,412 - DEBUG - Pod : ctest-busybox-pod-44412997 UUID is ca4df364-80a5-49d0-898d-a2a4a8aa88cb
2024-11-03 22:03:11,421 - DEBUG - Pod ctest-nginx-pod-89409741 not in running state.Currently in Pending
2024-11-03 22:03:16,439 - DEBUG - Pod ctest-nginx-pod-89409741 not in running state.Currently in Pending
2024-11-03 22:03:21,448 - INFO - Pod ctest-nginx-pod-89409741 is in running state.Got IP 10.47.255.251
2024-11-03 22:03:21,473 - DEBUG - Pod ctest-nginx-pod-89409741 has vmi 6716c020-9a2f-11ef-921e-fa163eca6fed
2024-11-03 22:03:21,473 - INFO - Verified pod ctest-nginx-pod-89409741 in contrail-api
2024-11-03 22:03:21,473 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2024-11-03 22:03:21,493 - DEBUG - VMI 6716c020-9a2f-11ef-921e-fa163eca6fed is active in agent 10.0.0.12
2024-11-03 22:03:21,493 - INFO - Verified Pod ctest-nginx-pod-89409741 in agent 10.0.0.12
2024-11-03 22:03:21,493 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=163ffbf9-7f27-4747-a1b8-d9d12d8b6afb
2024-11-03 22:03:21,499 - INFO - Pod ctest-nginx-pod-89409741 with uuid 163ffbf9-7f27-4747-a1b8-d9d12d8b6afb found in kube manager
2024-11-03 22:03:21,499 - INFO - Pod ctest-nginx-pod-89409741 verification passed
2024-11-03 22:03:21,578 - DEBUG - [Pod ctest-nginx-pod-89409741] Cmd: echo ctest-nginx-pod-89409741 > /usr/share/nginx/html/index.html, Output:
2024-11-03 22:03:21,589 - INFO - Pod ctest-nginx-pod-04831669 is in running state.Got IP 10.47.255.250
2024-11-03 22:03:21,611 - DEBUG - Pod ctest-nginx-pod-04831669 has vmi 67a3fd46-9a2f-11ef-921e-fa163eca6fed
2024-11-03 22:03:21,611 - INFO - Verified pod ctest-nginx-pod-04831669 in contrail-api
2024-11-03 22:03:21,611 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2024-11-03 22:03:21,636 - DEBUG - VMI 67a3fd46-9a2f-11ef-921e-fa163eca6fed is active in agent 10.0.0.12
2024-11-03 22:03:21,636 - INFO - Verified Pod ctest-nginx-pod-04831669 in agent 10.0.0.12
2024-11-03 22:03:21,636 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=1b638359-d43c-4900-813e-20e85f019ea5
2024-11-03 22:03:21,650 - INFO - Pod ctest-nginx-pod-04831669 with uuid 1b638359-d43c-4900-813e-20e85f019ea5 found in kube manager
2024-11-03 22:03:21,650 - INFO - Pod ctest-nginx-pod-04831669 verification passed
2024-11-03 22:03:21,731 - DEBUG - [Pod ctest-nginx-pod-04831669] Cmd: echo ctest-nginx-pod-04831669 > /usr/share/nginx/html/index.html, Output:
2024-11-03 22:03:21,739 - DEBUG - Pod ctest-busybox-pod-44412997 not in running state.Currently in Pending
2024-11-03 22:03:26,747 - INFO - Pod ctest-busybox-pod-44412997 is in running state.Got IP 10.47.255.248
2024-11-03 22:03:26,814 - DEBUG - Pod ctest-busybox-pod-44412997 has vmi 6abd868c-9a2f-11ef-921e-fa163eca6fed
2024-11-03 22:03:26,814 - INFO - Verified pod ctest-busybox-pod-44412997 in contrail-api
2024-11-03 22:03:26,814 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2024-11-03 22:03:26,828 - DEBUG - VMI 6abd868c-9a2f-11ef-921e-fa163eca6fed is active in agent 10.0.0.12
2024-11-03 22:03:26,828 - INFO - Verified Pod ctest-busybox-pod-44412997 in agent 10.0.0.12
2024-11-03 22:03:26,828 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=ca4df364-80a5-49d0-898d-a2a4a8aa88cb
2024-11-03 22:03:26,834 - INFO - Pod ctest-busybox-pod-44412997 with uuid ca4df364-80a5-49d0-898d-a2a4a8aa88cb found in kube manager
2024-11-03 22:03:26,834 - INFO - Pod ctest-busybox-pod-44412997 verification passed
2024-11-03 22:03:26,904 - DEBUG - [Pod ctest-busybox-pod-44412997] Cmd: wget http://10.47.255.249:80/ -O - -T 5 -t 1 , Output: ctest-nginx-pod-04831669
Connecting to 10.47.255.249:80 (10.47.255.249:80)
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
2024-11-03 22:03:26,904 - DEBUG - [Pod Pod ctest-busybox-pod-44412997] Cmd wget http://10.47.255.249:80/ -O - -T 5 -t 1 passed
2024-11-03 22:03:26,904 - DEBUG - [Pod Pod ctest-busybox-pod-44412997] Cmd output: ctest-nginx-pod-04831669
Connecting to 10.47.255.249:80 (10.47.255.249:80)
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
2024-11-03 22:03:26,962 - DEBUG - [Pod ctest-busybox-pod-44412997] Cmd: wget http://10.47.255.249:80/ -O - -T 5 -t 1 , Output: Connecting to 10.47.255.249:80 (10.47.255.249:80)
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
ctest-nginx-pod-89409741
2024-11-03 22:03:26,962 - DEBUG - [Pod Pod ctest-busybox-pod-44412997] Cmd wget http://10.47.255.249:80/ -O - -T 5 -t 1 passed
2024-11-03 22:03:26,962 - DEBUG - [Pod Pod ctest-busybox-pod-44412997] Cmd output: Connecting to 10.47.255.249:80 (10.47.255.249:80)
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
ctest-nginx-pod-89409741
2024-11-03 22:03:26,962 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-nginx-pod-89409741': 1, 'ctest-nginx-pod-04831669': 1}
2024-11-03 22:03:26,963 - WARNING - Nothing to delete parallely
2024-11-03 22:03:26,963 - INFO - Deleting pod default:ctest-busybox-pod-44412997
2024-11-03 22:03:26,977 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=ca4df364-80a5-49d0-898d-a2a4a8aa88cb
2024-11-03 22:03:26,988 - WARNING - Pod uuid ca4df364-80a5-49d0-898d-a2a4a8aa88cb is still seen in agent 10.0.0.12 VM list
2024-11-03 22:03:31,989 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=ca4df364-80a5-49d0-898d-a2a4a8aa88cb
2024-11-03 22:03:31,997 - WARNING - Pod uuid ca4df364-80a5-49d0-898d-a2a4a8aa88cb is still seen in agent 10.0.0.12 VM list
2024-11-03 22:03:36,999 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=ca4df364-80a5-49d0-898d-a2a4a8aa88cb
2024-11-03 22:03:37,007 - WARNING - Pod uuid ca4df364-80a5-49d0-898d-a2a4a8aa88cb is still seen in agent 10.0.0.12 VM list
2024-11-03 22:03:42,008 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=ca4df364-80a5-49d0-898d-a2a4a8aa88cb
2024-11-03 22:03:42,016 - WARNING - Pod uuid ca4df364-80a5-49d0-898d-a2a4a8aa88cb is still seen in agent 10.0.0.12 VM list
2024-11-03 22:03:47,016 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=ca4df364-80a5-49d0-898d-a2a4a8aa88cb
2024-11-03 22:03:47,025 - WARNING - Pod uuid ca4df364-80a5-49d0-898d-a2a4a8aa88cb is still seen in agent 10.0.0.12 VM list
2024-11-03 22:03:52,025 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=ca4df364-80a5-49d0-898d-a2a4a8aa88cb
2024-11-03 22:03:52,033 - WARNING - Pod uuid ca4df364-80a5-49d0-898d-a2a4a8aa88cb is still seen in agent 10.0.0.12 VM list
2024-11-03 22:03:57,035 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=ca4df364-80a5-49d0-898d-a2a4a8aa88cb
2024-11-03 22:03:57,044 - WARNING - Pod uuid ca4df364-80a5-49d0-898d-a2a4a8aa88cb is still seen in agent 10.0.0.12 VM list
2024-11-03 22:04:02,045 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=ca4df364-80a5-49d0-898d-a2a4a8aa88cb
2024-11-03 22:04:02,055 - DEBUG - Pod ca4df364-80a5-49d0-898d-a2a4a8aa88cb is not in agent 10.0.0.12 VM list
2024-11-03 22:04:02,055 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:6abd868c-9a2f-11ef-921e-fa163eca6fed
2024-11-03 22:04:02,063 - DEBUG - VMI 6abd868c-9a2f-11ef-921e-fa163eca6fed is removed from agent 10.0.0.12
2024-11-03 22:04:02,063 - INFO - Verified that pod ctest-busybox-pod-44412997 is removed in agent
2024-11-03 22:04:02,063 - INFO - Deleting Ingress : ctest-nginx-ingress-25627056
2024-11-03 22:04:02,070 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_LoadbalancerDatabaseList?x=430f83d4-2ce2-45dc-bc9a-ee4039e8bece
2024-11-03 22:04:02,085 - ERROR - Ingress ctest-nginx-ingress-25627056 with uuid 430f83d4-2ce2-45dc-bc9a-ee4039e8bece still found in kube manager
2024-11-03 22:04:03,086 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_LoadbalancerDatabaseList?x=430f83d4-2ce2-45dc-bc9a-ee4039e8bece
2024-11-03 22:04:03,091 - ERROR - Ingress ctest-nginx-ingress-25627056 with uuid 430f83d4-2ce2-45dc-bc9a-ee4039e8bece still found in kube manager
2024-11-03 22:04:04,092 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_LoadbalancerDatabaseList?x=430f83d4-2ce2-45dc-bc9a-ee4039e8bece
2024-11-03 22:04:04,107 - INFO - Ingress ctest-nginx-ingress-25627056 with uuid 430f83d4-2ce2-45dc-bc9a-ee4039e8bece deleted successfully from kube manager
2024-11-03 22:04:04,107 - INFO - Verifications on Ingress %s cleanup passed
2024-11-03 22:04:04,108 - INFO - Deleting the FIP pool __fip_pool_public__
2024-11-03 22:04:04,316 - DEBUG - Requesting: http://10.0.0.33:8083/Snh_IFMapTableShowReq?table_name=floating-ip-pool&search_string=floating-ip-pool:default-domain:k8s-default:__public__:__fip_pool_public__
2024-11-03 22:04:04,330 - DEBUG - Control-node Ifmap-view does not have FIP pool __fip_pool_public__ information
2024-11-03 22:04:04,330 - INFO - Deleting VN __public__
2024-11-03 22:04:04,580 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/07999983-9fb6-4676-8312-ef96ad6e58a5
2024-11-03 22:04:04,595 - DEBUG - Response Code: 404
2024-11-03 22:04:04,595 - DEBUG - Requesting: http://10.0.0.33:8082/domains
2024-11-03 22:04:04,602 - DEBUG - Requesting: http://10.0.0.33:8082/domain/e89d1633-c1ad-42ee-853e-07229e93b454
2024-11-03 22:04:04,622 - DEBUG - Requesting: http://10.0.0.33:8082/project/c90c3e85-ed99-4593-9698-0334746906d8
2024-11-03 22:04:04,753 - INFO - Validated that VN __public__ is not found in API Server
2024-11-03 22:04:04,753 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VnListReq?name=default-domain:k8s-default:__public__
2024-11-03 22:04:04,761 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__
2024-11-03 22:04:04,771 - DEBUG - VN __public__ is not present in Agent 10.0.0.12
2024-11-03 22:04:04,771 - INFO - Validated that VN __public__ is not in any agent
2024-11-03 22:04:04,772 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__
2024-11-03 22:04:04,784 - DEBUG - Requesting: http://10.0.0.33:8083/Snh_ShowRoutingInstanceReq?name=default-domain:k8s-default:__public__:__public__
2024-11-03 22:04:04,798 - DEBUG - Requesting: http://10.0.0.33:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:k8s-default:__public__
2024-11-03 22:04:04,847 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN __public__ info
2024-11-03 22:04:04,848 - INFO - Deleting pod default:ctest-nginx-pod-04831669
2024-11-03 22:04:04,875 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=1b638359-d43c-4900-813e-20e85f019ea5
2024-11-03 22:04:04,899 - WARNING - Pod uuid 1b638359-d43c-4900-813e-20e85f019ea5 is still seen in agent 10.0.0.12 VM list
2024-11-03 22:04:09,903 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=1b638359-d43c-4900-813e-20e85f019ea5
2024-11-03 22:04:09,911 - DEBUG - Pod 1b638359-d43c-4900-813e-20e85f019ea5 is not in agent 10.0.0.12 VM list
2024-11-03 22:04:09,911 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:67a3fd46-9a2f-11ef-921e-fa163eca6fed
2024-11-03 22:04:09,919 - DEBUG - VMI 67a3fd46-9a2f-11ef-921e-fa163eca6fed is removed from agent 10.0.0.12
2024-11-03 22:04:09,920 - INFO - Verified that pod ctest-nginx-pod-04831669 is removed in agent
2024-11-03 22:04:09,920 - INFO - Deleting pod default:ctest-nginx-pod-89409741
2024-11-03 22:04:09,952 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=163ffbf9-7f27-4747-a1b8-d9d12d8b6afb
2024-11-03 22:04:09,961 - WARNING - Pod uuid 163ffbf9-7f27-4747-a1b8-d9d12d8b6afb is still seen in agent 10.0.0.12 VM list
2024-11-03 22:04:14,963 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=163ffbf9-7f27-4747-a1b8-d9d12d8b6afb
2024-11-03 22:04:14,971 - DEBUG - Pod 163ffbf9-7f27-4747-a1b8-d9d12d8b6afb is not in agent 10.0.0.12 VM list
2024-11-03 22:04:14,972 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:6716c020-9a2f-11ef-921e-fa163eca6fed
2024-11-03 22:04:14,978 - DEBUG - VMI 6716c020-9a2f-11ef-921e-fa163eca6fed is removed from agent 10.0.0.12
2024-11-03 22:04:14,978 - INFO - Verified that pod ctest-nginx-pod-89409741 is removed in agent
2024-11-03 22:04:14,979 - INFO - Deleting service : ctest-nginx-svc-07001503
2024-11-03 22:04:15,201 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_AgentXmppConnectionStatusReq?
2024-11-03 22:04:15,210 - DEBUG - No XMPP flaps were noticed during the test
2024-11-03 22:04:15,210 - INFO - END TEST : test_ingress_ip_assignment : PASSED[0:01:13]
2024-11-03 22:04:15,210 - INFO - --------------------------------------------------------------------------------
2024-11-03 22:04:21,672 - DEBUG - [10.0.0.33]: Running cmd : docker exec --privileged -it contrail-kubernetes-master_kubemanager_1 /bin/bash -c 'grep "^[ ]*cluster_project" /etc/contrail/contrail-kubernetes.conf'
2024-11-03 22:04:21,807 - DEBUG - Output : cluster_project={}
2024-11-03 22:04:21,899 - DEBUG - [10.0.0.33]: Running cmd : docker exec --privileged -it contrail-kubernetes-master_kubemanager_1 /bin/bash -c 'netstat -antp | grep :8108 | grep LISTEN'
2024-11-03 22:04:22,072 - DEBUG - Output : tcp 0 0 0.0.0.0:8108 0.0.0.0:* LISTEN 1/python3
2024-11-03 22:04:22,085 - DEBUG - [10.0.0.33]: Running cmd : docker exec --privileged -it contrail-kubernetes-master_kubemanager_1 /bin/bash -c 'grep "^[ ]*cluster_project" /etc/contrail/contrail-kubernetes.conf'
2024-11-03 22:04:22,277 - DEBUG - Output : cluster_project={}
2024-11-03 22:04:34,422 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2024-11-03 22:04:39,487 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2024-11-03 22:04:40,442 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2024-11-03 22:04:40,681 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2024-11-03 22:04:40,740 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2024-11-03 22:04:45,842 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2024-11-03 22:04:45,893 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2024-11-03 22:04:45,985 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2024-11-03 22:04:46,209 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_AgentXmppConnectionStatusReq?
2024-11-03 22:04:49,539 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_ApplicationPolicySetReq?
2024-11-03 22:04:49,547 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_AclReq?
2024-11-03 22:04:51,283 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_AclReq?
2024-11-03 22:07:54,615 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_AgentXmppConnectionStatusReq?
2024-11-03 22:07:54,674 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=25a4fa64-c2e2-42c4-aa8a-9e73a33b3337
2024-11-03 22:07:54,682 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=d65fbe4b-abae-44e7-8f83-83a02e45c9b9
2024-11-03 22:07:54,713 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=fdad47c7-4da8-4837-a4ea-985f2cb787b0
2024-11-03 22:07:54,720 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=0321ebda-138e-40d9-92c3-79a0fc6b7692
2024-11-03 22:07:54,727 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=5fa348c9-2e91-4aac-bf89-f8013b115c7d
2024-11-03 22:07:54,733 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=eccb9286-8d7d-4c4e-a815-1b37d7036e18
2024-11-03 22:07:54,738 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=822228e6-dfcb-4866-b855-da1db179e408
2024-11-03 22:07:54,747 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=650722e2-415b-49ed-bd04-53f170ebee5e
2024-11-03 22:07:59,758 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=d65fbe4b-abae-44e7-8f83-83a02e45c9b9
2024-11-03 22:07:59,775 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=5fa348c9-2e91-4aac-bf89-f8013b115c7d
2024-11-03 22:07:59,777 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=822228e6-dfcb-4866-b855-da1db179e408
2024-11-03 22:07:59,778 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=0321ebda-138e-40d9-92c3-79a0fc6b7692
2024-11-03 22:07:59,779 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=fdad47c7-4da8-4837-a4ea-985f2cb787b0
2024-11-03 22:07:59,780 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=25a4fa64-c2e2-42c4-aa8a-9e73a33b3337
2024-11-03 22:07:59,783 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=650722e2-415b-49ed-bd04-53f170ebee5e
2024-11-03 22:07:59,810 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:97e20d04-9a2f-11ef-921e-fa163eca6fed
2024-11-03 22:08:01,593 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=eccb9286-8d7d-4c4e-a815-1b37d7036e18
2024-11-03 22:08:01,608 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:97493f5c-9a2f-11ef-921e-fa163eca6fed
2024-11-03 22:08:04,766 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=d65fbe4b-abae-44e7-8f83-83a02e45c9b9
2024-11-03 22:08:04,808 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=0321ebda-138e-40d9-92c3-79a0fc6b7692
2024-11-03 22:08:04,811 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=25a4fa64-c2e2-42c4-aa8a-9e73a33b3337
2024-11-03 22:08:04,820 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=650722e2-415b-49ed-bd04-53f170ebee5e
2024-11-03 22:08:04,824 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=822228e6-dfcb-4866-b855-da1db179e408
2024-11-03 22:08:04,826 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=fdad47c7-4da8-4837-a4ea-985f2cb787b0
2024-11-03 22:08:04,829 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:95ca41c6-9a2f-11ef-921e-fa163eca6fed
2024-11-03 22:08:09,825 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=0321ebda-138e-40d9-92c3-79a0fc6b7692
2024-11-03 22:08:09,847 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=fdad47c7-4da8-4837-a4ea-985f2cb787b0
2024-11-03 22:08:09,849 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=650722e2-415b-49ed-bd04-53f170ebee5e
2024-11-03 22:08:09,851 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=822228e6-dfcb-4866-b855-da1db179e408
2024-11-03 22:08:11,643 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=d65fbe4b-abae-44e7-8f83-83a02e45c9b9
2024-11-03 22:08:14,835 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=0321ebda-138e-40d9-92c3-79a0fc6b7692
2024-11-03 22:08:14,863 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=fdad47c7-4da8-4837-a4ea-985f2cb787b0
2024-11-03 22:08:14,866 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=822228e6-dfcb-4866-b855-da1db179e408
2024-11-03 22:08:14,867 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=650722e2-415b-49ed-bd04-53f170ebee5e
2024-11-03 22:08:16,653 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=d65fbe4b-abae-44e7-8f83-83a02e45c9b9
2024-11-03 22:08:19,850 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=0321ebda-138e-40d9-92c3-79a0fc6b7692
2024-11-03 22:08:19,885 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=650722e2-415b-49ed-bd04-53f170ebee5e
2024-11-03 22:08:19,888 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=822228e6-dfcb-4866-b855-da1db179e408
2024-11-03 22:08:21,235 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=fdad47c7-4da8-4837-a4ea-985f2cb787b0
2024-11-03 22:08:21,663 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=d65fbe4b-abae-44e7-8f83-83a02e45c9b9
2024-11-03 22:08:24,861 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=0321ebda-138e-40d9-92c3-79a0fc6b7692
2024-11-03 22:08:24,907 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=822228e6-dfcb-4866-b855-da1db179e408
2024-11-03 22:08:24,909 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=650722e2-415b-49ed-bd04-53f170ebee5e
2024-11-03 22:08:26,244 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=fdad47c7-4da8-4837-a4ea-985f2cb787b0
2024-11-03 22:08:26,674 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=d65fbe4b-abae-44e7-8f83-83a02e45c9b9
2024-11-03 22:08:29,870 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=0321ebda-138e-40d9-92c3-79a0fc6b7692
2024-11-03 22:08:30,784 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=650722e2-415b-49ed-bd04-53f170ebee5e
2024-11-03 22:08:30,785 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=822228e6-dfcb-4866-b855-da1db179e408
2024-11-03 22:08:30,814 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:966c209a-9a2f-11ef-921e-fa163eca6fed
2024-11-03 22:08:31,254 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=fdad47c7-4da8-4837-a4ea-985f2cb787b0
2024-11-03 22:08:31,262 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:9c5b873e-9a2f-11ef-921e-fa163eca6fed
2024-11-03 22:08:31,684 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=d65fbe4b-abae-44e7-8f83-83a02e45c9b9
2024-11-03 22:08:35,818 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=0321ebda-138e-40d9-92c3-79a0fc6b7692
2024-11-03 22:08:35,820 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=650722e2-415b-49ed-bd04-53f170ebee5e
2024-11-03 22:08:35,831 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:9a8a4db4-9a2f-11ef-921e-fa163eca6fed
2024-11-03 22:08:35,833 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:9b2fc316-9a2f-11ef-921e-fa163eca6fed
2024-11-03 22:08:36,694 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_VmListReq?uuid=d65fbe4b-abae-44e7-8f83-83a02e45c9b9
2024-11-03 22:08:36,703 - DEBUG - Requesting: http://10.0.0.12:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:9bc8153a-9a2f-11ef-921e-fa163eca6fed