2024-10-24 02:28:21,284 - DEBUG - [10.0.0.45]: Running cmd : hostname 2024-10-24 02:28:21,562 - DEBUG - Output : cn-jenkins-deploy-platform-juju-k8s-737-1 2024-10-24 02:28:21,562 - DEBUG - [10.0.0.45]: Running cmd : hostname -f 2024-10-24 02:28:21,597 - DEBUG - Output : cn-jenkins-deploy-platform-juju-k8s-737-1 2024-10-24 02:28:21,597 - DEBUG - [10.0.0.45]: Running cmd : docker ps -a 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}' 2024-10-24 02:28:21,684 - DEBUG - Output : NAMES contrail_test_0et2GbsOS contrail-kubernetes-master_kubemanager_1 analytics_database_nodemgr_1 analytics_database_query-engine_1 analytics_database_cassandra_1 analytics_snmp_topology_1 analytics_snmp_nodemgr_1 analytics_snmp_snmp-collector_1 analytics_alarm_kafka_1 analytics_alarm_nodemgr_1 analytics_alarm_alarm-gen_1 analytics_nodemgr_1 analytics_api_1 analytics_collector_1 redis_redis_1 webui_job_1 webui_web_1 control_named_1 control_dns_1 control_nodemgr_1 control_control_1 config_database_zookeeper_1 config_database_nodemgr_1 config_database_cassandra_1 config_database_rabbitmq_1 config_api_devicemgr_1 config_api_svcmonitor_1 config_api_schema_1 config_api_nodemgr_1 config_api_dnsmasq_1 config_api_api_1 2024-10-24 02:28:21,684 - DEBUG - [10.0.0.45]: Running cmd : ip addr show | grep 'inet .*/.* brd ' | awk '{print $2}' 2024-10-24 02:28:21,753 - DEBUG - Output : 10.0.0.45/24 172.17.0.1/16 2024-10-24 02:28:21,754 - DEBUG - [10.0.0.45]: Running cmd : getent hosts 10.0.0.45 | head -n 1 | awk '{print $2}' 2024-10-24 02:28:21,787 - DEBUG - Output : cn-jenkins-deploy-platform-juju-k8s-737-1 2024-10-24 02:28:21,890 - DEBUG - [10.0.0.23]: Running cmd : hostname 2024-10-24 02:28:22,110 - DEBUG - Output : an-jenkins-deploy-platform-juju-k8s-737-1 2024-10-24 02:28:22,110 - DEBUG - [10.0.0.23]: Running cmd : hostname -f 2024-10-24 02:28:22,134 - DEBUG - Output : an-jenkins-deploy-platform-juju-k8s-737-1 2024-10-24 02:28:22,134 - DEBUG - [10.0.0.23]: Running cmd : docker ps -a 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}' 2024-10-24 02:28:22,179 - DEBUG - Output : NAMES vrouter_nodemgr_1 vrouter_vrouter-agent_1 2024-10-24 02:28:22,180 - DEBUG - [10.0.0.23]: Running cmd : ip addr show dev vhost0 | grep 'inet .*/.* brd ' | awk '{print $2}' 2024-10-24 02:28:22,255 - DEBUG - Output : 10.0.0.23/24 2024-10-24 02:28:22,256 - DEBUG - [10.0.0.23]: Running cmd : getent hosts 10.0.0.23 | head -n 1 | awk '{print $2}' 2024-10-24 02:28:22,281 - DEBUG - Output : an-jenkins-deploy-platform-juju-k8s-737-1 2024-10-24 02:28:22,402 - INFO - Using existing project ['default-domain', 'k8s-default'](13a482c9-08c1-4160-9cd9-e33278309c80) 2024-10-24 02:28:22,535 - INFO - Using existing project ['default-domain', 'k8s-default'](13a482c9-08c1-4160-9cd9-e33278309c80) 2024-10-24 02:28:22,738 - INFO - ================================================================================ 2024-10-24 02:28:22,738 - INFO - STARTING TEST : test_ingress_ip_assignment 2024-10-24 02:28:22,739 - INFO - TEST DESCRIPTION : Verify that Ingress gets a CLuster IP which is reachable to Pods in same namespace. Also verify that a Floating IP is assigned to the Ingress from the Public FIP poo. Steps: 1. Create a service with 2 pods running nginx 2. Create an ingress out of this service 3. From another Pod do a wget on the ingress Cluster ip Validate that Ingress get a IP from Public FIP pool which might/might not be accessible. Validate that service and its loadbalancing work 2024-10-24 02:28:22,965 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_AgentXmppConnectionStatusReq? 2024-10-24 02:28:22,974 - DEBUG - Nothing to compare xmpp stats {'10.0.0.23': {'10.0.0.45': '0'}} with 2024-10-24 02:28:22,974 - INFO - Initial checks done. Running the testcase now 2024-10-24 02:28:22,974 - INFO - 2024-10-24 02:28:22,978 - INFO - Namespace default already exists 2024-10-24 02:28:22,979 - DEBUG - [10.0.0.45]: Running cmd : docker exec --privileged -it contrail-kubernetes-master_kubemanager_1 /bin/bash -c 'grep "^[ ]*cluster_project" /etc/contrail/contrail-kubernetes.conf' 2024-10-24 02:28:23,116 - DEBUG - Output : cluster_project={} 2024-10-24 02:28:23,197 - INFO - Project default-domain:k8s-default for Namespace default is seen in contrail-api 2024-10-24 02:28:23,197 - DEBUG - Project uuid in Contrail is 13a482c9-08c1-4160-9cd9-e33278309c80 2024-10-24 02:28:23,197 - DEBUG - [10.0.0.45]: Running cmd : docker exec --privileged -it contrail-kubernetes-master_kubemanager_1 /bin/bash -c 'netstat -antp | grep :8108 | grep LISTEN' 2024-10-24 02:28:23,322 - DEBUG - Output : tcp 0 0 0.0.0.0:8108 0.0.0.0:* LISTEN 1/python3 2024-10-24 02:28:23,322 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_NamespaceDatabaseList?namespace_uuid=92105b56-2300-4f2b-b5e9-fa3682e725ec 2024-10-24 02:28:23,327 - INFO - Namespace default with uuid 92105b56-2300-4f2b-b5e9-fa3682e725ec found in kube manager 2024-10-24 02:28:23,327 - INFO - Namespace default verification passed 2024-10-24 02:28:23,330 - DEBUG - Service ctest-nginx-svc-84088344 not present 2024-10-24 02:28:23,330 - INFO - Creating service ctest-nginx-svc-84088344 2024-10-24 02:28:23,347 - INFO - Created Service ctest-nginx-svc-84088344 2024-10-24 02:28:23,354 - DEBUG - Pod ctest-nginx-pod-82554294 not present 2024-10-24 02:28:23,354 - INFO - Creating Pod ctest-nginx-pod-82554294 2024-10-24 02:28:23,389 - DEBUG - Node for Pod ctest-nginx-pod-82554294 not yet populated 2024-10-24 02:28:26,397 - DEBUG - Pod : ctest-nginx-pod-82554294 UUID is dbb52b6a-6d86-4678-b2d3-93a74d174217 2024-10-24 02:28:26,400 - DEBUG - Pod ctest-nginx-pod-19974531 not present 2024-10-24 02:28:26,400 - INFO - Creating Pod ctest-nginx-pod-19974531 2024-10-24 02:28:26,440 - DEBUG - Pod : ctest-nginx-pod-19974531 UUID is c4a1eec3-52d9-4cab-8387-5892ba69ae35 2024-10-24 02:28:26,699 - INFO - Created VN __public__, UUID :c1192b18-3a66-4898-99a3-c5b49cc7b6a7 2024-10-24 02:28:27,012 - DEBUG - Requesting: http://10.0.0.45:8082/domains 2024-10-24 02:28:27,046 - DEBUG - Requesting: http://10.0.0.45:8082/domain/51e16bdb-67fc-4af2-a215-64b4ab2afd28 2024-10-24 02:28:27,094 - DEBUG - Requesting: http://10.0.0.45:8082/project/13a482c9-08c1-4160-9cd9-e33278309c80 2024-10-24 02:28:27,196 - DEBUG - Requesting: http://10.0.0.45:8082/virtual-network/c1192b18-3a66-4898-99a3-c5b49cc7b6a7 2024-10-24 02:28:27,214 - DEBUG - Requesting: http://10.0.0.45:8082/virtual-network/c1192b18-3a66-4898-99a3-c5b49cc7b6a7 2024-10-24 02:28:27,246 - DEBUG - Requesting: http://10.0.0.45:8082/routing-instance/fc6cf961-8f50-4c91-abc5-ac77da410d7f 2024-10-24 02:28:27,270 - DEBUG - Requesting: http://10.0.0.45:8082/routing-instance/fc6cf961-8f50-4c91-abc5-ac77da410d7f 2024-10-24 02:28:27,295 - DEBUG - Requesting: http://10.0.0.45:8082/route-target/e0c5fdd6-8f47-4214-9dcd-1c6f239b23d4 2024-10-24 02:28:27,302 - DEBUG - Route Targets: ['target:64512:8000007'] 2024-10-24 02:28:27,302 - DEBUG - Requesting: http://10.0.0.45:8082/virtual-network/c1192b18-3a66-4898-99a3-c5b49cc7b6a7 2024-10-24 02:28:27,316 - DEBUG - Requesting: http://10.0.0.45:8082/routing-instance/fc6cf961-8f50-4c91-abc5-ac77da410d7f 2024-10-24 02:28:27,350 - INFO - Verified VN network id 13 for VN c1192b18-3a66-4898-99a3-c5b49cc7b6a7 2024-10-24 02:28:27,350 - INFO - Verifications in API Server for VN __public__ passed 2024-10-24 02:28:27,350 - DEBUG - Requesting: http://10.0.0.45:8082/virtual-network/c1192b18-3a66-4898-99a3-c5b49cc7b6a7 2024-10-24 02:28:27,367 - DEBUG - Requesting: http://10.0.0.45:8082/routing-instance/fc6cf961-8f50-4c91-abc5-ac77da410d7f 2024-10-24 02:28:27,387 - DEBUG - Requesting: http://10.0.0.45:8082/routing-instance/fc6cf961-8f50-4c91-abc5-ac77da410d7f 2024-10-24 02:28:27,397 - DEBUG - Requesting: http://10.0.0.45:8082/route-target/e0c5fdd6-8f47-4214-9dcd-1c6f239b23d4 2024-10-24 02:28:27,421 - DEBUG - Requesting: http://10.0.0.45:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:k8s-default:__public__ 2024-10-24 02:28:27,449 - DEBUG - Control-node 10.0.0.45 : VN object is : {'node_name': 'virtual-network:default-domain:k8s-default:__public__', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'cloud-admin', 'owner-access': '7', 'group': 'cloud-admin-group', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13914199906796849304', 'uuid-lslong': '11070909688521930407'}, 'enable': 'true', 'created': '2024-10-24T02:28:26', 'last-modified': '2024-10-24T02:28:26', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.554417'} 2024-10-24 02:28:27,449 - DEBUG - Requesting: http://10.0.0.45:8083/Snh_ShowRoutingInstanceReq?name=default-domain:k8s-default:__public__:__public__ 2024-10-24 02:28:27,471 - DEBUG - Route Targets: ['target:64512:8000007'] 2024-10-24 02:28:27,472 - INFO - On all control nodes, Config, RI and RT verification for VN __public__ passed 2024-10-24 02:28:27,473 - DEBUG - ====Verifying policy data for __public__ in API_Server ====== 2024-10-24 02:28:27,473 - DEBUG - Requesting: http://10.0.0.45:8082/domains 2024-10-24 02:28:27,482 - DEBUG - Requesting: http://10.0.0.45:8082/domain/51e16bdb-67fc-4af2-a215-64b4ab2afd28 2024-10-24 02:28:27,492 - DEBUG - Requesting: http://10.0.0.45:8082/project/13a482c9-08c1-4160-9cd9-e33278309c80 2024-10-24 02:28:27,613 - DEBUG - Requesting: http://10.0.0.45:8082/virtual-network/c1192b18-3a66-4898-99a3-c5b49cc7b6a7 2024-10-24 02:28:27,636 - DEBUG - =>VN __public__ has no policy to be verified 2024-10-24 02:28:27,637 - DEBUG - Verifying the vn in opserver 2024-10-24 02:28:27,637 - DEBUG - Verifying the default-domain:k8s-default:__public__ virtual network link through opserver 10.0.0.45 2024-10-24 02:28:27,637 - DEBUG - Requesting: http://10.0.0.45:8081/analytics/uves/virtual-networks 2024-10-24 02:28:27,644 - DEBUG - vn link and name as {'name': 'default-domain:k8s-default:__public__', 'href': 'http://10.0.0.45:8081/analytics/uves/virtual-network/default-domain:k8s-default:__public__?flat'} 2024-10-24 02:28:27,644 - INFO - Validated that VN default-domain:k8s-default:__public__ is found in opserver 2024-10-24 02:28:27,644 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__ 2024-10-24 02:28:27,652 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__ 2024-10-24 02:28:27,659 - DEBUG - Do not have enough data to verify VN in agent 2024-10-24 02:28:27,659 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__ 2024-10-24 02:28:27,668 - DEBUG - VRF ids for VN __public__: {} 2024-10-24 02:28:27,784 - INFO - Creating Floating IP pool __fip_pool_public__ in API Server 2024-10-24 02:28:27,912 - DEBUG - Requesting: http://10.0.0.45:8082/domains 2024-10-24 02:28:27,918 - DEBUG - Requesting: http://10.0.0.45:8082/domain/51e16bdb-67fc-4af2-a215-64b4ab2afd28 2024-10-24 02:28:27,929 - DEBUG - Requesting: http://10.0.0.45:8082/project/13a482c9-08c1-4160-9cd9-e33278309c80 2024-10-24 02:28:27,990 - DEBUG - Requesting: http://10.0.0.45:8082/virtual-network/c1192b18-3a66-4898-99a3-c5b49cc7b6a7 2024-10-24 02:28:28,005 - DEBUG - Requesting: http://10.0.0.45:8082/floating-ip-pool/a6f4db52-14d7-44e2-99f4-8da4274e5758 2024-10-24 02:28:28,014 - DEBUG - Requesting: http://10.0.0.45:8082/domains 2024-10-24 02:28:28,023 - DEBUG - Requesting: http://10.0.0.45:8082/domain/51e16bdb-67fc-4af2-a215-64b4ab2afd28 2024-10-24 02:28:28,049 - DEBUG - Requesting: http://10.0.0.45:8082/project/13a482c9-08c1-4160-9cd9-e33278309c80 2024-10-24 02:28:28,099 - DEBUG - Requesting: http://10.0.0.45:8082/virtual-network/c1192b18-3a66-4898-99a3-c5b49cc7b6a7 2024-10-24 02:28:28,115 - DEBUG - FIP Pool __fip_pool_public__ found in API Server 2024-10-24 02:28:28,115 - INFO - Verification for FIP pool __fip_pool_public__ in API Server passed 2024-10-24 02:28:28,127 - DEBUG - Requesting: http://10.0.0.45:8083/Snh_IFMapTableShowReq?table_name=floating-ip-pool&search_string=floating-ip-pool:default-domain:k8s-default:__public__:__fip_pool_public__ 2024-10-24 02:28:28,134 - DEBUG - Control-node Ifmap-view has FIP pool __fip_pool_public__ information 2024-10-24 02:28:28,134 - INFO - Verification for FIP pool __fip_pool_public__ in Control-node passed 2024-10-24 02:28:28,137 - DEBUG - Ingress ctest-nginx-ingress-92250834 not present 2024-10-24 02:28:28,138 - INFO - Creating Ingress ctest-nginx-ingress-92250834 2024-10-24 02:28:28,145 - INFO - Created Ingress ctest-nginx-ingress-92250834 2024-10-24 02:28:28,148 - DEBUG - Cluster IP not yet seen for Ingress ctest-nginx-ingress-92250834 2024-10-24 02:28:31,152 - DEBUG - For Ingress ctest-nginx-ingress-92250834, Cluster IP: 10.47.255.249, External IPs ['199.167.186.60'] 2024-10-24 02:28:31,152 - INFO - Verifications in k8s passed for Ingress ctest-nginx-ingress-92250834 2024-10-24 02:28:31,152 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_LoadbalancerDatabaseList?x=d19043f1-d730-4d9d-84cb-ea7b372f78d1 2024-10-24 02:28:31,161 - INFO - Ingress ctest-nginx-ingress-92250834 with uuid d19043f1-d730-4d9d-84cb-ea7b372f78d1 found in kube manager 2024-10-24 02:28:31,161 - INFO - Ingress ctest-nginx-ingress-92250834 verification passed 2024-10-24 02:28:31,166 - DEBUG - Pod ctest-busybox-pod-90012669 not present 2024-10-24 02:28:31,166 - INFO - Creating Pod ctest-busybox-pod-90012669 2024-10-24 02:28:31,211 - DEBUG - Pod : ctest-busybox-pod-90012669 UUID is c2156911-3e41-4c14-b84c-22cb64747be9 2024-10-24 02:28:31,216 - DEBUG - Pod ctest-nginx-pod-82554294 not in running state.Currently in Pending 2024-10-24 02:28:36,222 - INFO - Pod ctest-nginx-pod-82554294 is in running state.Got IP 10.47.255.251 2024-10-24 02:28:36,257 - DEBUG - Pod ctest-nginx-pod-82554294 has vmi a55ae1e6-91af-11ef-8e4c-fa163ecb9fc5 2024-10-24 02:28:36,258 - INFO - Verified pod ctest-nginx-pod-82554294 in contrail-api 2024-10-24 02:28:36,258 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-10-24 02:28:36,284 - DEBUG - VMI a55ae1e6-91af-11ef-8e4c-fa163ecb9fc5 is active in agent 10.0.0.23 2024-10-24 02:28:36,284 - INFO - Verified Pod ctest-nginx-pod-82554294 in agent 10.0.0.23 2024-10-24 02:28:36,284 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_VirtualMachineDatabaseList?x=dbb52b6a-6d86-4678-b2d3-93a74d174217 2024-10-24 02:28:36,291 - INFO - Pod ctest-nginx-pod-82554294 with uuid dbb52b6a-6d86-4678-b2d3-93a74d174217 found in kube manager 2024-10-24 02:28:36,291 - INFO - Pod ctest-nginx-pod-82554294 verification passed 2024-10-24 02:28:36,366 - DEBUG - [Pod ctest-nginx-pod-82554294] Cmd: echo ctest-nginx-pod-82554294 > /usr/share/nginx/html/index.html, Output: 2024-10-24 02:28:36,375 - DEBUG - Pod ctest-nginx-pod-19974531 not in running state.Currently in Pending 2024-10-24 02:28:41,383 - INFO - Pod ctest-nginx-pod-19974531 is in running state.Got IP 10.47.255.250 2024-10-24 02:28:41,448 - DEBUG - Pod ctest-nginx-pod-19974531 has vmi a6463ede-91af-11ef-8e4c-fa163ecb9fc5 2024-10-24 02:28:41,448 - INFO - Verified pod ctest-nginx-pod-19974531 in contrail-api 2024-10-24 02:28:41,449 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-10-24 02:28:41,462 - DEBUG - VMI a6463ede-91af-11ef-8e4c-fa163ecb9fc5 is active in agent 10.0.0.23 2024-10-24 02:28:41,462 - INFO - Verified Pod ctest-nginx-pod-19974531 in agent 10.0.0.23 2024-10-24 02:28:41,463 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_VirtualMachineDatabaseList?x=c4a1eec3-52d9-4cab-8387-5892ba69ae35 2024-10-24 02:28:41,476 - INFO - Pod ctest-nginx-pod-19974531 with uuid c4a1eec3-52d9-4cab-8387-5892ba69ae35 found in kube manager 2024-10-24 02:28:41,476 - INFO - Pod ctest-nginx-pod-19974531 verification passed 2024-10-24 02:28:41,548 - DEBUG - [Pod ctest-nginx-pod-19974531] Cmd: echo ctest-nginx-pod-19974531 > /usr/share/nginx/html/index.html, Output: 2024-10-24 02:28:41,555 - DEBUG - Pod ctest-busybox-pod-90012669 not in running state.Currently in Pending 2024-10-24 02:28:46,562 - INFO - Pod ctest-busybox-pod-90012669 is in running state.Got IP 10.47.255.248 2024-10-24 02:28:46,580 - DEBUG - Pod ctest-busybox-pod-90012669 has vmi a9460f9c-91af-11ef-8e4c-fa163ecb9fc5 2024-10-24 02:28:46,580 - INFO - Verified pod ctest-busybox-pod-90012669 in contrail-api 2024-10-24 02:28:46,580 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-10-24 02:28:46,593 - DEBUG - VMI a9460f9c-91af-11ef-8e4c-fa163ecb9fc5 is active in agent 10.0.0.23 2024-10-24 02:28:46,593 - INFO - Verified Pod ctest-busybox-pod-90012669 in agent 10.0.0.23 2024-10-24 02:28:46,593 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_VirtualMachineDatabaseList?x=c2156911-3e41-4c14-b84c-22cb64747be9 2024-10-24 02:28:46,598 - INFO - Pod ctest-busybox-pod-90012669 with uuid c2156911-3e41-4c14-b84c-22cb64747be9 found in kube manager 2024-10-24 02:28:46,598 - INFO - Pod ctest-busybox-pod-90012669 verification passed 2024-10-24 02:28:46,670 - DEBUG - [Pod ctest-busybox-pod-90012669] Cmd: wget http://10.47.255.249:80/ -O - -T 5 -t 1 , Output: ctest-nginx-pod-19974531 Connecting to 10.47.255.249:80 (10.47.255.249:80) writing to stdout - 100% |********************************| 25 0:00:00 ETA written to stdout 2024-10-24 02:28:46,670 - DEBUG - [Pod Pod ctest-busybox-pod-90012669] Cmd wget http://10.47.255.249:80/ -O - -T 5 -t 1 passed 2024-10-24 02:28:46,670 - DEBUG - [Pod Pod ctest-busybox-pod-90012669] Cmd output: ctest-nginx-pod-19974531 Connecting to 10.47.255.249:80 (10.47.255.249:80) writing to stdout - 100% |********************************| 25 0:00:00 ETA written to stdout 2024-10-24 02:28:46,741 - DEBUG - [Pod ctest-busybox-pod-90012669] Cmd: wget http://10.47.255.249:80/ -O - -T 5 -t 1 , Output: ctest-nginx-pod-82554294 Connecting to 10.47.255.249:80 (10.47.255.249:80) writing to stdout - 100% |********************************| 25 0:00:00 ETA written to stdout 2024-10-24 02:28:46,741 - DEBUG - [Pod Pod ctest-busybox-pod-90012669] Cmd wget http://10.47.255.249:80/ -O - -T 5 -t 1 passed 2024-10-24 02:28:46,741 - DEBUG - [Pod Pod ctest-busybox-pod-90012669] Cmd output: ctest-nginx-pod-82554294 Connecting to 10.47.255.249:80 (10.47.255.249:80) writing to stdout - 100% |********************************| 25 0:00:00 ETA written to stdout 2024-10-24 02:28:46,741 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-nginx-pod-82554294': 1, 'ctest-nginx-pod-19974531': 1} 2024-10-24 02:28:46,741 - WARNING - Nothing to delete parallely 2024-10-24 02:28:46,741 - INFO - Deleting pod default:ctest-busybox-pod-90012669 2024-10-24 02:28:46,756 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=c2156911-3e41-4c14-b84c-22cb64747be9 2024-10-24 02:28:46,770 - WARNING - Pod uuid c2156911-3e41-4c14-b84c-22cb64747be9 is still seen in agent 10.0.0.23 VM list 2024-10-24 02:28:51,771 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=c2156911-3e41-4c14-b84c-22cb64747be9 2024-10-24 02:28:51,779 - WARNING - Pod uuid c2156911-3e41-4c14-b84c-22cb64747be9 is still seen in agent 10.0.0.23 VM list 2024-10-24 02:28:56,780 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=c2156911-3e41-4c14-b84c-22cb64747be9 2024-10-24 02:28:56,788 - WARNING - Pod uuid c2156911-3e41-4c14-b84c-22cb64747be9 is still seen in agent 10.0.0.23 VM list 2024-10-24 02:29:01,788 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=c2156911-3e41-4c14-b84c-22cb64747be9 2024-10-24 02:29:01,798 - WARNING - Pod uuid c2156911-3e41-4c14-b84c-22cb64747be9 is still seen in agent 10.0.0.23 VM list 2024-10-24 02:29:06,799 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=c2156911-3e41-4c14-b84c-22cb64747be9 2024-10-24 02:29:06,808 - WARNING - Pod uuid c2156911-3e41-4c14-b84c-22cb64747be9 is still seen in agent 10.0.0.23 VM list 2024-10-24 02:29:11,808 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=c2156911-3e41-4c14-b84c-22cb64747be9 2024-10-24 02:29:11,824 - WARNING - Pod uuid c2156911-3e41-4c14-b84c-22cb64747be9 is still seen in agent 10.0.0.23 VM list 2024-10-24 02:29:16,824 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=c2156911-3e41-4c14-b84c-22cb64747be9 2024-10-24 02:29:16,835 - WARNING - Pod uuid c2156911-3e41-4c14-b84c-22cb64747be9 is still seen in agent 10.0.0.23 VM list 2024-10-24 02:29:21,836 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=c2156911-3e41-4c14-b84c-22cb64747be9 2024-10-24 02:29:21,843 - DEBUG - Pod c2156911-3e41-4c14-b84c-22cb64747be9 is not in agent 10.0.0.23 VM list 2024-10-24 02:29:21,844 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:a9460f9c-91af-11ef-8e4c-fa163ecb9fc5 2024-10-24 02:29:21,851 - DEBUG - VMI a9460f9c-91af-11ef-8e4c-fa163ecb9fc5 is removed from agent 10.0.0.23 2024-10-24 02:29:21,851 - INFO - Verified that pod ctest-busybox-pod-90012669 is removed in agent 2024-10-24 02:29:21,852 - INFO - Deleting Ingress : ctest-nginx-ingress-92250834 2024-10-24 02:29:21,864 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_LoadbalancerDatabaseList?x=d19043f1-d730-4d9d-84cb-ea7b372f78d1 2024-10-24 02:29:21,877 - ERROR - Ingress ctest-nginx-ingress-92250834 with uuid d19043f1-d730-4d9d-84cb-ea7b372f78d1 still found in kube manager 2024-10-24 02:29:22,878 - DEBUG - Requesting: http://10.0.0.45:8108/Snh_LoadbalancerDatabaseList?x=d19043f1-d730-4d9d-84cb-ea7b372f78d1 2024-10-24 02:29:22,882 - INFO - Ingress ctest-nginx-ingress-92250834 with uuid d19043f1-d730-4d9d-84cb-ea7b372f78d1 deleted successfully from kube manager 2024-10-24 02:29:22,882 - INFO - Verifications on Ingress %s cleanup passed 2024-10-24 02:29:22,883 - INFO - Deleting the FIP pool __fip_pool_public__ 2024-10-24 02:29:23,056 - DEBUG - Requesting: http://10.0.0.45:8083/Snh_IFMapTableShowReq?table_name=floating-ip-pool&search_string=floating-ip-pool:default-domain:k8s-default:__public__:__fip_pool_public__ 2024-10-24 02:29:23,078 - DEBUG - Control-node Ifmap-view does not have FIP pool __fip_pool_public__ information 2024-10-24 02:29:23,078 - INFO - Deleting VN __public__ 2024-10-24 02:29:23,330 - DEBUG - Requesting: http://10.0.0.45:8082/routing-instance/fc6cf961-8f50-4c91-abc5-ac77da410d7f 2024-10-24 02:29:23,348 - DEBUG - Response Code: 404 2024-10-24 02:29:23,348 - DEBUG - Requesting: http://10.0.0.45:8082/domains 2024-10-24 02:29:23,355 - DEBUG - Requesting: http://10.0.0.45:8082/domain/51e16bdb-67fc-4af2-a215-64b4ab2afd28 2024-10-24 02:29:23,384 - DEBUG - Requesting: http://10.0.0.45:8082/project/13a482c9-08c1-4160-9cd9-e33278309c80 2024-10-24 02:29:23,468 - INFO - Validated that VN __public__ is not found in API Server 2024-10-24 02:29:23,469 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VnListReq?name=default-domain:k8s-default:__public__ 2024-10-24 02:29:23,477 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__ 2024-10-24 02:29:23,485 - DEBUG - VN __public__ is not present in Agent 10.0.0.23 2024-10-24 02:29:23,485 - INFO - Validated that VN __public__ is not in any agent 2024-10-24 02:29:23,486 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__ 2024-10-24 02:29:23,493 - DEBUG - Requesting: http://10.0.0.45:8083/Snh_ShowRoutingInstanceReq?name=default-domain:k8s-default:__public__:__public__ 2024-10-24 02:29:23,500 - DEBUG - Requesting: http://10.0.0.45:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:k8s-default:__public__ 2024-10-24 02:29:23,508 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN __public__ info 2024-10-24 02:29:23,509 - INFO - Deleting pod default:ctest-nginx-pod-19974531 2024-10-24 02:29:23,544 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=c4a1eec3-52d9-4cab-8387-5892ba69ae35 2024-10-24 02:29:23,559 - WARNING - Pod uuid c4a1eec3-52d9-4cab-8387-5892ba69ae35 is still seen in agent 10.0.0.23 VM list 2024-10-24 02:29:28,561 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=c4a1eec3-52d9-4cab-8387-5892ba69ae35 2024-10-24 02:29:28,569 - DEBUG - Pod c4a1eec3-52d9-4cab-8387-5892ba69ae35 is not in agent 10.0.0.23 VM list 2024-10-24 02:29:28,569 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:a6463ede-91af-11ef-8e4c-fa163ecb9fc5 2024-10-24 02:29:28,576 - DEBUG - VMI a6463ede-91af-11ef-8e4c-fa163ecb9fc5 is removed from agent 10.0.0.23 2024-10-24 02:29:28,576 - INFO - Verified that pod ctest-nginx-pod-19974531 is removed in agent 2024-10-24 02:29:28,576 - INFO - Deleting pod default:ctest-nginx-pod-82554294 2024-10-24 02:29:28,594 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=dbb52b6a-6d86-4678-b2d3-93a74d174217 2024-10-24 02:29:28,612 - WARNING - Pod uuid dbb52b6a-6d86-4678-b2d3-93a74d174217 is still seen in agent 10.0.0.23 VM list 2024-10-24 02:29:33,614 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=dbb52b6a-6d86-4678-b2d3-93a74d174217 2024-10-24 02:29:33,621 - DEBUG - Pod dbb52b6a-6d86-4678-b2d3-93a74d174217 is not in agent 10.0.0.23 VM list 2024-10-24 02:29:33,621 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:a55ae1e6-91af-11ef-8e4c-fa163ecb9fc5 2024-10-24 02:29:33,630 - DEBUG - VMI a55ae1e6-91af-11ef-8e4c-fa163ecb9fc5 is removed from agent 10.0.0.23 2024-10-24 02:29:33,630 - INFO - Verified that pod ctest-nginx-pod-82554294 is removed in agent 2024-10-24 02:29:33,630 - INFO - Deleting service : ctest-nginx-svc-84088344 2024-10-24 02:29:33,842 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_AgentXmppConnectionStatusReq? 2024-10-24 02:29:33,850 - DEBUG - No XMPP flaps were noticed during the test 2024-10-24 02:29:33,850 - INFO - END TEST : test_ingress_ip_assignment : PASSED[0:01:11] 2024-10-24 02:29:33,850 - INFO - -------------------------------------------------------------------------------- 2024-10-24 02:29:40,341 - DEBUG - [10.0.0.45]: Running cmd : docker exec --privileged -it contrail-kubernetes-master_kubemanager_1 /bin/bash -c 'grep "^[ ]*cluster_project" /etc/contrail/contrail-kubernetes.conf' 2024-10-24 02:29:40,524 - DEBUG - Output : cluster_project={} 2024-10-24 02:29:40,592 - DEBUG - [10.0.0.45]: Running cmd : docker exec --privileged -it contrail-kubernetes-master_kubemanager_1 /bin/bash -c 'netstat -antp | grep :8108 | grep LISTEN' 2024-10-24 02:29:40,794 - DEBUG - Output : tcp 0 0 0.0.0.0:8108 0.0.0.0:* LISTEN 1/python3 2024-10-24 02:29:40,801 - DEBUG - [10.0.0.45]: Running cmd : docker exec --privileged -it contrail-kubernetes-master_kubemanager_1 /bin/bash -c 'grep "^[ ]*cluster_project" /etc/contrail/contrail-kubernetes.conf' 2024-10-24 02:29:40,962 - DEBUG - Output : cluster_project={} 2024-10-24 02:29:51,132 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-10-24 02:29:51,220 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-10-24 02:29:56,274 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-10-24 02:29:56,372 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-10-24 02:30:01,497 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-10-24 02:30:01,596 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-10-24 02:30:01,657 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-10-24 02:30:01,756 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-10-24 02:30:01,988 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_AgentXmppConnectionStatusReq? 2024-10-24 02:30:04,712 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_ApplicationPolicySetReq? 2024-10-24 02:30:04,724 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_AclReq? 2024-10-24 02:30:04,773 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_AclReq? 2024-10-24 02:30:06,817 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_AclReq? 2024-10-24 02:33:07,259 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_AgentXmppConnectionStatusReq? 2024-10-24 02:33:07,293 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=e31b4bb0-b9a7-4617-8c8d-5c100a38a036 2024-10-24 02:33:07,321 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=3a8b67ee-51b7-4a32-90f9-cc2e8acbb2bd 2024-10-24 02:33:07,342 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=d8a59447-62e6-481d-8707-4efdf701f7ca 2024-10-24 02:33:07,351 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=63707bf2-18bb-43a0-9f09-4be119f7044b 2024-10-24 02:33:07,366 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=270b96be-103b-4ad5-823e-8793395a07a3 2024-10-24 02:33:07,371 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=283eb6cb-4c62-484c-bc8d-facefa2aa7a8 2024-10-24 02:33:07,375 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=bdaa295e-131f-4f93-9172-699bb5e2cd28 2024-10-24 02:33:07,379 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=9f52d719-88f0-41d7-9f45-168eeb191024 2024-10-24 02:33:12,303 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=e31b4bb0-b9a7-4617-8c8d-5c100a38a036 2024-10-24 02:33:12,385 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=3a8b67ee-51b7-4a32-90f9-cc2e8acbb2bd 2024-10-24 02:33:12,391 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=d8a59447-62e6-481d-8707-4efdf701f7ca 2024-10-24 02:33:12,406 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=9f52d719-88f0-41d7-9f45-168eeb191024 2024-10-24 02:33:12,408 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=bdaa295e-131f-4f93-9172-699bb5e2cd28 2024-10-24 02:33:12,409 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=283eb6cb-4c62-484c-bc8d-facefa2aa7a8 2024-10-24 02:33:12,410 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=63707bf2-18bb-43a0-9f09-4be119f7044b 2024-10-24 02:33:12,428 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:d4ae9e9c-91af-11ef-8e4c-fa163ecb9fc5 2024-10-24 02:33:12,430 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:d538719e-91af-11ef-8e4c-fa163ecb9fc5 2024-10-24 02:33:12,488 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=270b96be-103b-4ad5-823e-8793395a07a3 2024-10-24 02:33:17,311 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=e31b4bb0-b9a7-4617-8c8d-5c100a38a036 2024-10-24 02:33:17,395 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=3a8b67ee-51b7-4a32-90f9-cc2e8acbb2bd 2024-10-24 02:33:17,400 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=d8a59447-62e6-481d-8707-4efdf701f7ca 2024-10-24 02:33:17,425 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=bdaa295e-131f-4f93-9172-699bb5e2cd28 2024-10-24 02:33:17,434 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=9f52d719-88f0-41d7-9f45-168eeb191024 2024-10-24 02:33:17,499 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=270b96be-103b-4ad5-823e-8793395a07a3 2024-10-24 02:33:22,321 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=e31b4bb0-b9a7-4617-8c8d-5c100a38a036 2024-10-24 02:33:22,404 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=3a8b67ee-51b7-4a32-90f9-cc2e8acbb2bd 2024-10-24 02:33:22,410 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=d8a59447-62e6-481d-8707-4efdf701f7ca 2024-10-24 02:33:22,439 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=bdaa295e-131f-4f93-9172-699bb5e2cd28 2024-10-24 02:33:22,442 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=9f52d719-88f0-41d7-9f45-168eeb191024 2024-10-24 02:33:22,507 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=270b96be-103b-4ad5-823e-8793395a07a3 2024-10-24 02:33:27,331 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=e31b4bb0-b9a7-4617-8c8d-5c100a38a036 2024-10-24 02:33:27,414 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=3a8b67ee-51b7-4a32-90f9-cc2e8acbb2bd 2024-10-24 02:33:27,418 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=d8a59447-62e6-481d-8707-4efdf701f7ca 2024-10-24 02:33:27,452 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=9f52d719-88f0-41d7-9f45-168eeb191024 2024-10-24 02:33:27,454 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=bdaa295e-131f-4f93-9172-699bb5e2cd28 2024-10-24 02:33:27,516 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=270b96be-103b-4ad5-823e-8793395a07a3 2024-10-24 02:33:32,340 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=e31b4bb0-b9a7-4617-8c8d-5c100a38a036 2024-10-24 02:33:32,426 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=d8a59447-62e6-481d-8707-4efdf701f7ca 2024-10-24 02:33:32,428 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=3a8b67ee-51b7-4a32-90f9-cc2e8acbb2bd 2024-10-24 02:33:32,465 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=bdaa295e-131f-4f93-9172-699bb5e2cd28 2024-10-24 02:33:32,467 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=9f52d719-88f0-41d7-9f45-168eeb191024 2024-10-24 02:33:32,526 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=270b96be-103b-4ad5-823e-8793395a07a3 2024-10-24 02:33:37,351 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=e31b4bb0-b9a7-4617-8c8d-5c100a38a036 2024-10-24 02:33:37,438 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=3a8b67ee-51b7-4a32-90f9-cc2e8acbb2bd 2024-10-24 02:33:37,440 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=d8a59447-62e6-481d-8707-4efdf701f7ca 2024-10-24 02:33:37,478 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=bdaa295e-131f-4f93-9172-699bb5e2cd28 2024-10-24 02:33:37,480 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=9f52d719-88f0-41d7-9f45-168eeb191024 2024-10-24 02:33:37,535 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=270b96be-103b-4ad5-823e-8793395a07a3 2024-10-24 02:33:42,369 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=e31b4bb0-b9a7-4617-8c8d-5c100a38a036 2024-10-24 02:33:42,377 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:d34d39dc-91af-11ef-8e4c-fa163ecb9fc5 2024-10-24 02:33:42,451 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=d8a59447-62e6-481d-8707-4efdf701f7ca 2024-10-24 02:33:42,453 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=3a8b67ee-51b7-4a32-90f9-cc2e8acbb2bd 2024-10-24 02:33:42,463 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:d3ec1f0c-91af-11ef-8e4c-fa163ecb9fc5 2024-10-24 02:33:42,475 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:d5dc7ba4-91af-11ef-8e4c-fa163ecb9fc5 2024-10-24 02:33:42,504 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=9f52d719-88f0-41d7-9f45-168eeb191024 2024-10-24 02:33:42,506 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=bdaa295e-131f-4f93-9172-699bb5e2cd28 2024-10-24 02:33:42,516 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:d700f0b4-91af-11ef-8e4c-fa163ecb9fc5 2024-10-24 02:33:42,518 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:d78e58c8-91af-11ef-8e4c-fa163ecb9fc5 2024-10-24 02:33:42,546 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_VmListReq?uuid=270b96be-103b-4ad5-823e-8793395a07a3 2024-10-24 02:33:42,555 - DEBUG - Requesting: http://10.0.0.23:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:d669e3f4-91af-11ef-8e4c-fa163ecb9fc5