2024-09-12 01:56:10,274 - DEBUG - [10.0.0.27]: Running cmd : hostname 2024-09-12 01:56:10,576 - DEBUG - Output : cn-jenkins-deploy-platform-k8s-manifests-87-1 2024-09-12 01:56:10,577 - DEBUG - [10.0.0.27]: Running cmd : hostname -f 2024-09-12 01:56:10,746 - DEBUG - Output : cn-jenkins-deploy-platform-k8s-manifests-87-1.cluster.local 2024-09-12 01:56:10,746 - DEBUG - [10.0.0.27]: Running cmd : docker ps -a 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}' 2024-09-12 01:56:11,061 - DEBUG - Output : NAMES contrail_test_tigxxf6BH k8s_coredns_coredns-77f7cc69db-xq8th_kube-system_cd75a34f-2495-4082-a8a3-853a883930ea_0 k8s_autoscaler_dns-autoscaler-595558c478-lhxcb_kube-system_ebabcf5e-1f47-4af8-9ea0-5ef06a9b2fa3_0 k8s_contrail-controller-config-nodemgr_contrail-controller-config-6852c_kube-system_e55b39c7-5c2a-42d2-893e-3751fd907730_0 k8s_contrail-controller-config-svcmonitor_contrail-controller-config-6852c_kube-system_e55b39c7-5c2a-42d2-893e-3751fd907730_0 k8s_contrail-controller-nodemgr_contrail-controller-control-jpsr9_kube-system_a90e5db8-e56b-4f0a-882a-ce4ce1921717_0 k8s_contrail-controller-control-named_contrail-controller-control-jpsr9_kube-system_a90e5db8-e56b-4f0a-882a-ce4ce1921717_0 k8s_contrail-controller-config-schema_contrail-controller-config-6852c_kube-system_e55b39c7-5c2a-42d2-893e-3751fd907730_0 k8s_contrail-analytics-query-engine_contrail-analyticsdb-7t28z_kube-system_4200ff47-9373-4467-ad34-ca768a7f0ca8_0 k8s_contrail-analytics-snmp-nodemgr_contrail-analytics-snmp-4t5j7_kube-system_413f25d6-0fe2-490b-980f-18d95618cdec_0 k8s_contrail-analytics-snmp-topology_contrail-analytics-snmp-4t5j7_kube-system_413f25d6-0fe2-490b-980f-18d95618cdec_0 k8s_contrail-analytics-alarm-nodemgr_contrail-analytics-alarm-jc7lw_kube-system_9ffbeb30-62da-4fb0-afee-9df4c1de9f22_0 k8s_contrail-analytics-alarm-gen_contrail-analytics-alarm-jc7lw_kube-system_9ffbeb30-62da-4fb0-afee-9df4c1de9f22_0 k8s_contrail-controller-control-dns_contrail-controller-control-jpsr9_kube-system_a90e5db8-e56b-4f0a-882a-ce4ce1921717_0 k8s_contrail-controller-config-devicemgr_contrail-controller-config-6852c_kube-system_e55b39c7-5c2a-42d2-893e-3751fd907730_0 k8s_contrail-analyticsdb_contrail-analyticsdb-7t28z_kube-system_4200ff47-9373-4467-ad34-ca768a7f0ca8_0 k8s_contrail-controller-webui-web_contrail-controller-webui-krfbb_kube-system_6dc20df5-d18e-4300-94d5-c1c21d587665_0 k8s_contrail-analytics-nodemgr_contrail-analytics-sdpnw_kube-system_8cd497e9-f4f3-4376-9c1e-7eeea2af50ad_0 k8s_contrail-analytics-collector_contrail-analytics-sdpnw_kube-system_8cd497e9-f4f3-4376-9c1e-7eeea2af50ad_0 k8s_contrail-analytics-snmp-collector_contrail-analytics-snmp-4t5j7_kube-system_413f25d6-0fe2-490b-980f-18d95618cdec_0 k8s_kafka_contrail-analytics-alarm-jc7lw_kube-system_9ffbeb30-62da-4fb0-afee-9df4c1de9f22_0 k8s_contrail-controller-control_contrail-controller-control-jpsr9_kube-system_a90e5db8-e56b-4f0a-882a-ce4ce1921717_0 k8s_contrail-analyticsdb-nodemgr_contrail-analyticsdb-7t28z_kube-system_4200ff47-9373-4467-ad34-ca768a7f0ca8_0 k8s_contrail-controller-config-api_contrail-controller-config-6852c_kube-system_e55b39c7-5c2a-42d2-893e-3751fd907730_0 k8s_contrail-controller-webui-job_contrail-controller-webui-krfbb_kube-system_6dc20df5-d18e-4300-94d5-c1c21d587665_0 k8s_contrail-analytics-api_contrail-analytics-sdpnw_kube-system_8cd497e9-f4f3-4376-9c1e-7eeea2af50ad_0 k8s_config-zookeeper_config-zookeeper-c6pts_kube-system_11c79af8-a96c-4d60-aab0-758f790ec048_0 k8s_redis_redis-wpx98_kube-system_5db2b192-8975-4302-8b77-43eaec150704_0 k8s_rabbitmq_rabbitmq-jrzq5_kube-system_5250039c-e5a4-4fd3-a4c0-73b96af1ac75_0 k8s_contrail-config-database-nodemgr_contrail-configdb-sw7cf_kube-system_07eb8ede-6840-456b-85e0-3e93acb85e2f_0 k8s_contrail-configdb_contrail-configdb-sw7cf_kube-system_07eb8ede-6840-456b-85e0-3e93acb85e2f_0 k8s_contrail-agent-nodemgr_contrail-agent-9m8fd_kube-system_7587d6a2-0774-4c84-a427-17b28fa3e3a8_0 k8s_contrail-vrouter-agent_contrail-agent-9m8fd_kube-system_7587d6a2-0774-4c84-a427-17b28fa3e3a8_0 k8s_contrail-kube-manager_contrail-kube-manager-z4swm_kube-system_c118b27c-3e6b-4b5f-b7bd-393152742dff_0 k8s_kube-proxy_kube-proxy-9v9tr_kube-system_a3108608-8bd3-4d8c-ae3c-d2a2d808a294_0 k8s_kube-controller-manager_kube-controller-manager-cn-jenkins-deploy-platform-k8s-manifests-87-1_kube-system_8a8018f42aafa29e17224ba82e863a83_1 k8s_kube-scheduler_kube-scheduler-cn-jenkins-deploy-platform-k8s-manifests-87-1_kube-system_9b02da2d1787cd994425426983d36112_1 k8s_kube-apiserver_kube-apiserver-cn-jenkins-deploy-platform-k8s-manifests-87-1_kube-system_48f64aadbc935c98ec766c79b6c85a4c_0 2024-09-12 01:56:11,062 - DEBUG - [10.0.0.27]: Running cmd : ip addr show | grep 'inet .*/.* brd ' | awk '{print $2}' 2024-09-12 01:56:11,332 - DEBUG - Output : 172.17.0.1/16 10.0.0.27/24 2024-09-12 01:56:11,333 - DEBUG - [10.0.0.27]: Running cmd : getent hosts 10.0.0.27 | head -n 1 | awk '{print $2}' 2024-09-12 01:56:11,546 - DEBUG - Output : cn-jenkins-deploy-platform-k8s-manifests-87-1.cluster.local 2024-09-12 01:56:11,546 - DEBUG - [10.0.0.27]: Running cmd : ip addr show dev vhost0 | grep 'inet .*/.* brd ' | awk '{print $2}' 2024-09-12 01:56:11,794 - DEBUG - Output : 10.0.0.27/24 2024-09-12 01:56:12,377 - INFO - Using existing project ['default-domain', 'k8s-default'](d55cb5b7-fac0-4cb9-8da8-05d332fe5722) 2024-09-12 01:56:12,573 - INFO - Using existing project ['default-domain', 'k8s-default'](d55cb5b7-fac0-4cb9-8da8-05d332fe5722) 2024-09-12 01:56:12,832 - INFO - ================================================================================ 2024-09-12 01:56:12,832 - INFO - STARTING TEST : test_ingress_ip_assignment 2024-09-12 01:56:12,833 - INFO - TEST DESCRIPTION : Verify that Ingress gets a CLuster IP which is reachable to Pods in same namespace. Also verify that a Floating IP is assigned to the Ingress from the Public FIP poo. Steps: 1. Create a service with 2 pods running nginx 2. Create an ingress out of this service 3. From another Pod do a wget on the ingress Cluster ip Validate that Ingress get a IP from Public FIP pool which might/might not be accessible. Validate that service and its loadbalancing work 2024-09-12 01:56:13,127 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_AgentXmppConnectionStatusReq? 2024-09-12 01:56:13,134 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.0.0.27': '1'}} with 2024-09-12 01:56:13,134 - INFO - Initial checks done. Running the testcase now 2024-09-12 01:56:13,134 - INFO - 2024-09-12 01:56:13,139 - INFO - Namespace default already exists 2024-09-12 01:56:13,139 - DEBUG - [10.0.0.27]: Running cmd : docker exec --privileged -it k8s_contrail-kube-manager_contrail-kube-manager-z4swm_kube-system_c118b27c-3e6b-4b5f-b7bd-393152742dff_0 /bin/bash -c 'grep "^[ ]*cluster_project" /etc/contrail/contrail-kubernetes.conf' 2024-09-12 01:56:13,367 - DEBUG - Output : cluster_project={} 2024-09-12 01:56:13,447 - INFO - Project default-domain:k8s-default for Namespace default is seen in contrail-api 2024-09-12 01:56:13,447 - DEBUG - Project uuid in Contrail is d55cb5b7-fac0-4cb9-8da8-05d332fe5722 2024-09-12 01:56:13,448 - DEBUG - [10.0.0.27]: Running cmd : docker exec --privileged -it k8s_contrail-kube-manager_contrail-kube-manager-z4swm_kube-system_c118b27c-3e6b-4b5f-b7bd-393152742dff_0 /bin/bash -c 'netstat -antp | grep :8108 | grep LISTEN' 2024-09-12 01:56:13,606 - DEBUG - Output : tcp 0 0 0.0.0.0:8108 0.0.0.0:* LISTEN 1/python3 2024-09-12 01:56:13,607 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NamespaceDatabaseList?namespace_uuid=df347962-782b-48e8-ab89-ec9334a3c022 2024-09-12 01:56:13,613 - INFO - Namespace default with uuid df347962-782b-48e8-ab89-ec9334a3c022 found in kube manager 2024-09-12 01:56:13,613 - INFO - Namespace default verification passed 2024-09-12 01:56:13,616 - DEBUG - Service ctest-nginx-svc-97011173 not present 2024-09-12 01:56:13,617 - INFO - Creating service ctest-nginx-svc-97011173 2024-09-12 01:56:13,634 - INFO - Created Service ctest-nginx-svc-97011173 2024-09-12 01:56:13,641 - DEBUG - Pod ctest-nginx-pod-48106126 not present 2024-09-12 01:56:13,642 - INFO - Creating Pod ctest-nginx-pod-48106126 2024-09-12 01:56:13,673 - DEBUG - Pod : ctest-nginx-pod-48106126 UUID is 28d40682-28c9-48da-b557-be9f2f0c90b1 2024-09-12 01:56:13,678 - DEBUG - Pod ctest-nginx-pod-16162725 not present 2024-09-12 01:56:13,678 - INFO - Creating Pod ctest-nginx-pod-16162725 2024-09-12 01:56:13,707 - DEBUG - Pod : ctest-nginx-pod-16162725 UUID is 9ba8b051-140d-4dad-a190-f2d8c4cabc65 2024-09-12 01:56:14,078 - INFO - Created VN __public__, UUID :93886814-7afb-4d44-bb16-3de678228c0f 2024-09-12 01:56:14,399 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2024-09-12 01:56:14,407 - DEBUG - Requesting: http://10.0.0.27:8082/domain/771de695-9207-40a4-ac3d-18aae1b1edd9 2024-09-12 01:56:14,469 - DEBUG - Requesting: http://10.0.0.27:8082/project/d55cb5b7-fac0-4cb9-8da8-05d332fe5722 2024-09-12 01:56:14,578 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/93886814-7afb-4d44-bb16-3de678228c0f 2024-09-12 01:56:14,619 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/93886814-7afb-4d44-bb16-3de678228c0f 2024-09-12 01:56:14,642 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/94e8f427-56c3-49fa-9567-927a4576ebfd 2024-09-12 01:56:14,655 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/94e8f427-56c3-49fa-9567-927a4576ebfd 2024-09-12 01:56:14,665 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/0e0ceb2c-ceb8-4e06-b233-b3be5d605fb3 2024-09-12 01:56:14,677 - DEBUG - Route Targets: ['target:64512:8000007'] 2024-09-12 01:56:14,677 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/93886814-7afb-4d44-bb16-3de678228c0f 2024-09-12 01:56:14,707 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/94e8f427-56c3-49fa-9567-927a4576ebfd 2024-09-12 01:56:14,729 - INFO - Verified VN network id 12 for VN 93886814-7afb-4d44-bb16-3de678228c0f 2024-09-12 01:56:14,730 - INFO - Verifications in API Server for VN __public__ passed 2024-09-12 01:56:14,730 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/93886814-7afb-4d44-bb16-3de678228c0f 2024-09-12 01:56:14,743 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/94e8f427-56c3-49fa-9567-927a4576ebfd 2024-09-12 01:56:14,751 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/94e8f427-56c3-49fa-9567-927a4576ebfd 2024-09-12 01:56:14,758 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/0e0ceb2c-ceb8-4e06-b233-b3be5d605fb3 2024-09-12 01:56:14,772 - DEBUG - Requesting: http://10.0.0.27:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:k8s-default:__public__ 2024-09-12 01:56:14,793 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:k8s-default:__public__', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'cloud-admin', 'owner-access': '7', 'group': 'cloud-admin-group', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '10630861357579980100', 'uuid-lslong': '13481030594647460879'}, 'enable': 'true', 'created': '2024-09-12T01:56:13', 'last-modified': '2024-09-12T01:56:14', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.516486'} 2024-09-12 01:56:14,793 - DEBUG - Requesting: http://10.0.0.27:8083/Snh_ShowRoutingInstanceReq?name=default-domain:k8s-default:__public__:__public__ 2024-09-12 01:56:14,804 - DEBUG - Route Targets: ['target:64512:8000007'] 2024-09-12 01:56:14,804 - INFO - On all control nodes, Config, RI and RT verification for VN __public__ passed 2024-09-12 01:56:14,805 - DEBUG - ====Verifying policy data for __public__ in API_Server ====== 2024-09-12 01:56:14,805 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2024-09-12 01:56:14,814 - DEBUG - Requesting: http://10.0.0.27:8082/domain/771de695-9207-40a4-ac3d-18aae1b1edd9 2024-09-12 01:56:14,825 - DEBUG - Requesting: http://10.0.0.27:8082/project/d55cb5b7-fac0-4cb9-8da8-05d332fe5722 2024-09-12 01:56:14,875 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/93886814-7afb-4d44-bb16-3de678228c0f 2024-09-12 01:56:14,894 - DEBUG - =>VN __public__ has no policy to be verified 2024-09-12 01:56:14,894 - DEBUG - Verifying the vn in opserver 2024-09-12 01:56:14,895 - DEBUG - Verifying the default-domain:k8s-default:__public__ virtual network link through opserver 10.0.0.27 2024-09-12 01:56:14,895 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2024-09-12 01:56:14,899 - DEBUG - vn link and name as {'name': 'default-domain:k8s-default:__public__', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:k8s-default:__public__?flat'} 2024-09-12 01:56:14,899 - INFO - Validated that VN default-domain:k8s-default:__public__ is found in opserver 2024-09-12 01:56:14,899 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__ 2024-09-12 01:56:14,909 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__ 2024-09-12 01:56:14,915 - DEBUG - Do not have enough data to verify VN in agent 2024-09-12 01:56:14,915 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__ 2024-09-12 01:56:14,921 - DEBUG - VRF ids for VN __public__: {} 2024-09-12 01:56:15,157 - INFO - Creating Floating IP pool __fip_pool_public__ in API Server 2024-09-12 01:56:15,534 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2024-09-12 01:56:15,542 - DEBUG - Requesting: http://10.0.0.27:8082/domain/771de695-9207-40a4-ac3d-18aae1b1edd9 2024-09-12 01:56:15,551 - DEBUG - Requesting: http://10.0.0.27:8082/project/d55cb5b7-fac0-4cb9-8da8-05d332fe5722 2024-09-12 01:56:15,607 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/93886814-7afb-4d44-bb16-3de678228c0f 2024-09-12 01:56:15,627 - DEBUG - Requesting: http://10.0.0.27:8082/floating-ip-pool/b80ca567-9446-4886-88dc-566c51c483c1 2024-09-12 01:56:15,638 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2024-09-12 01:56:15,645 - DEBUG - Requesting: http://10.0.0.27:8082/domain/771de695-9207-40a4-ac3d-18aae1b1edd9 2024-09-12 01:56:15,655 - DEBUG - Requesting: http://10.0.0.27:8082/project/d55cb5b7-fac0-4cb9-8da8-05d332fe5722 2024-09-12 01:56:15,699 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/93886814-7afb-4d44-bb16-3de678228c0f 2024-09-12 01:56:15,721 - DEBUG - FIP Pool __fip_pool_public__ found in API Server 2024-09-12 01:56:15,722 - INFO - Verification for FIP pool __fip_pool_public__ in API Server passed 2024-09-12 01:56:15,736 - DEBUG - Requesting: http://10.0.0.27:8083/Snh_IFMapTableShowReq?table_name=floating-ip-pool&search_string=floating-ip-pool:default-domain:k8s-default:__public__:__fip_pool_public__ 2024-09-12 01:56:15,745 - DEBUG - Control-node Ifmap-view has FIP pool __fip_pool_public__ information 2024-09-12 01:56:15,746 - INFO - Verification for FIP pool __fip_pool_public__ in Control-node passed 2024-09-12 01:56:15,749 - DEBUG - Ingress ctest-nginx-ingress-53293935 not present 2024-09-12 01:56:15,750 - INFO - Creating Ingress ctest-nginx-ingress-53293935 2024-09-12 01:56:15,757 - INFO - Created Ingress ctest-nginx-ingress-53293935 2024-09-12 01:56:15,763 - DEBUG - Cluster IP not yet seen for Ingress ctest-nginx-ingress-53293935 2024-09-12 01:56:18,769 - DEBUG - Cluster IP not yet seen for Ingress ctest-nginx-ingress-53293935 2024-09-12 01:56:21,776 - DEBUG - For Ingress ctest-nginx-ingress-53293935, Cluster IP: 10.47.255.248, External IPs ['8.239.221.188'] 2024-09-12 01:56:21,776 - INFO - Verifications in k8s passed for Ingress ctest-nginx-ingress-53293935 2024-09-12 01:56:21,776 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_LoadbalancerDatabaseList?x=93f4440d-f971-4aef-b40a-2b48883144b5 2024-09-12 01:56:21,782 - INFO - Ingress ctest-nginx-ingress-53293935 with uuid 93f4440d-f971-4aef-b40a-2b48883144b5 found in kube manager 2024-09-12 01:56:21,782 - INFO - Ingress ctest-nginx-ingress-53293935 verification passed 2024-09-12 01:56:21,786 - DEBUG - Pod ctest-busybox-pod-26129115 not present 2024-09-12 01:56:21,787 - INFO - Creating Pod ctest-busybox-pod-26129115 2024-09-12 01:56:21,813 - DEBUG - Pod : ctest-busybox-pod-26129115 UUID is ca28b9e3-302a-44b3-9f9f-da0e8c7ca51c 2024-09-12 01:56:21,822 - DEBUG - Pod ctest-nginx-pod-48106126 not in running state.Currently in Pending 2024-09-12 01:56:26,830 - DEBUG - Pod ctest-nginx-pod-48106126 not in running state.Currently in Pending 2024-09-12 01:56:31,844 - INFO - Pod ctest-nginx-pod-48106126 is in running state.Got IP 10.47.255.250 2024-09-12 01:56:31,915 - DEBUG - Pod ctest-nginx-pod-48106126 has vmi 32abc1ea-70aa-11ef-ada5-0242ec0c41c5 2024-09-12 01:56:31,915 - INFO - Verified pod ctest-nginx-pod-48106126 in contrail-api 2024-09-12 01:56:31,915 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-09-12 01:56:31,938 - DEBUG - VMI 32abc1ea-70aa-11ef-ada5-0242ec0c41c5 is active in agent 10.0.0.27 2024-09-12 01:56:31,938 - INFO - Verified Pod ctest-nginx-pod-48106126 in agent 10.0.0.27 2024-09-12 01:56:31,938 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=28d40682-28c9-48da-b557-be9f2f0c90b1 2024-09-12 01:56:31,946 - INFO - Pod ctest-nginx-pod-48106126 with uuid 28d40682-28c9-48da-b557-be9f2f0c90b1 found in kube manager 2024-09-12 01:56:31,946 - INFO - Pod ctest-nginx-pod-48106126 verification passed 2024-09-12 01:56:32,108 - DEBUG - [Pod ctest-nginx-pod-48106126] Cmd: echo ctest-nginx-pod-48106126 > /usr/share/nginx/html/index.html, Output: 2024-09-12 01:56:32,115 - INFO - Pod ctest-nginx-pod-16162725 is in running state.Got IP 10.47.255.249 2024-09-12 01:56:32,176 - DEBUG - Pod ctest-nginx-pod-16162725 has vmi 338c73e8-70aa-11ef-ada5-0242ec0c41c5 2024-09-12 01:56:32,176 - INFO - Verified pod ctest-nginx-pod-16162725 in contrail-api 2024-09-12 01:56:32,176 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-09-12 01:56:32,204 - DEBUG - VMI 338c73e8-70aa-11ef-ada5-0242ec0c41c5 is active in agent 10.0.0.27 2024-09-12 01:56:32,204 - INFO - Verified Pod ctest-nginx-pod-16162725 in agent 10.0.0.27 2024-09-12 01:56:32,205 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=9ba8b051-140d-4dad-a190-f2d8c4cabc65 2024-09-12 01:56:32,215 - INFO - Pod ctest-nginx-pod-16162725 with uuid 9ba8b051-140d-4dad-a190-f2d8c4cabc65 found in kube manager 2024-09-12 01:56:32,216 - INFO - Pod ctest-nginx-pod-16162725 verification passed 2024-09-12 01:56:32,354 - DEBUG - [Pod ctest-nginx-pod-16162725] Cmd: echo ctest-nginx-pod-16162725 > /usr/share/nginx/html/index.html, Output: 2024-09-12 01:56:32,365 - DEBUG - Pod ctest-busybox-pod-26129115 not in running state.Currently in Pending 2024-09-12 01:56:37,385 - INFO - Pod ctest-busybox-pod-26129115 is in running state.Got IP 10.47.255.247 2024-09-12 01:56:37,474 - DEBUG - Pod ctest-busybox-pod-26129115 has vmi 37db7cb4-70aa-11ef-ada5-0242ec0c41c5 2024-09-12 01:56:37,475 - INFO - Verified pod ctest-busybox-pod-26129115 in contrail-api 2024-09-12 01:56:37,475 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-09-12 01:56:37,521 - DEBUG - VMI 37db7cb4-70aa-11ef-ada5-0242ec0c41c5 is active in agent 10.0.0.27 2024-09-12 01:56:37,522 - INFO - Verified Pod ctest-busybox-pod-26129115 in agent 10.0.0.27 2024-09-12 01:56:37,522 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=ca28b9e3-302a-44b3-9f9f-da0e8c7ca51c 2024-09-12 01:56:37,535 - INFO - Pod ctest-busybox-pod-26129115 with uuid ca28b9e3-302a-44b3-9f9f-da0e8c7ca51c found in kube manager 2024-09-12 01:56:37,536 - INFO - Pod ctest-busybox-pod-26129115 verification passed 2024-09-12 01:56:37,717 - DEBUG - [Pod ctest-busybox-pod-26129115] Cmd: wget http://10.47.255.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.47.255.248:80 (10.47.255.248:80) ctest-nginx-pod-48106126 writing to stdout - 100% |********************************| 25 0:00:00 ETA written to stdout 2024-09-12 01:56:37,717 - DEBUG - [Pod Pod ctest-busybox-pod-26129115] Cmd wget http://10.47.255.248:80/ -O - -T 5 -t 1 passed 2024-09-12 01:56:37,717 - DEBUG - [Pod Pod ctest-busybox-pod-26129115] Cmd output: Connecting to 10.47.255.248:80 (10.47.255.248:80) ctest-nginx-pod-48106126 writing to stdout - 100% |********************************| 25 0:00:00 ETA written to stdout 2024-09-12 01:56:37,799 - DEBUG - [Pod ctest-busybox-pod-26129115] Cmd: wget http://10.47.255.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.47.255.248:80 (10.47.255.248:80) ctest-nginx-pod-16162725 writing to stdout - 100% |********************************| 25 0:00:00 ETA written to stdout 2024-09-12 01:56:37,799 - DEBUG - [Pod Pod ctest-busybox-pod-26129115] Cmd wget http://10.47.255.248:80/ -O - -T 5 -t 1 passed 2024-09-12 01:56:37,799 - DEBUG - [Pod Pod ctest-busybox-pod-26129115] Cmd output: Connecting to 10.47.255.248:80 (10.47.255.248:80) ctest-nginx-pod-16162725 writing to stdout - 100% |********************************| 25 0:00:00 ETA written to stdout 2024-09-12 01:56:37,799 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-nginx-pod-48106126': 1, 'ctest-nginx-pod-16162725': 1} 2024-09-12 01:56:37,799 - WARNING - Nothing to delete parallely 2024-09-12 01:56:37,799 - INFO - Deleting pod default:ctest-busybox-pod-26129115 2024-09-12 01:56:37,815 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=ca28b9e3-302a-44b3-9f9f-da0e8c7ca51c 2024-09-12 01:56:37,823 - WARNING - Pod uuid ca28b9e3-302a-44b3-9f9f-da0e8c7ca51c is still seen in agent 10.0.0.27 VM list 2024-09-12 01:56:42,824 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=ca28b9e3-302a-44b3-9f9f-da0e8c7ca51c 2024-09-12 01:56:42,846 - WARNING - Pod uuid ca28b9e3-302a-44b3-9f9f-da0e8c7ca51c is still seen in agent 10.0.0.27 VM list 2024-09-12 01:56:47,847 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=ca28b9e3-302a-44b3-9f9f-da0e8c7ca51c 2024-09-12 01:56:47,860 - WARNING - Pod uuid ca28b9e3-302a-44b3-9f9f-da0e8c7ca51c is still seen in agent 10.0.0.27 VM list 2024-09-12 01:56:52,861 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=ca28b9e3-302a-44b3-9f9f-da0e8c7ca51c 2024-09-12 01:56:52,870 - WARNING - Pod uuid ca28b9e3-302a-44b3-9f9f-da0e8c7ca51c is still seen in agent 10.0.0.27 VM list 2024-09-12 01:56:57,872 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=ca28b9e3-302a-44b3-9f9f-da0e8c7ca51c 2024-09-12 01:56:57,892 - WARNING - Pod uuid ca28b9e3-302a-44b3-9f9f-da0e8c7ca51c is still seen in agent 10.0.0.27 VM list 2024-09-12 01:57:02,894 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=ca28b9e3-302a-44b3-9f9f-da0e8c7ca51c 2024-09-12 01:57:02,910 - WARNING - Pod uuid ca28b9e3-302a-44b3-9f9f-da0e8c7ca51c is still seen in agent 10.0.0.27 VM list 2024-09-12 01:57:07,912 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=ca28b9e3-302a-44b3-9f9f-da0e8c7ca51c 2024-09-12 01:57:07,931 - WARNING - Pod uuid ca28b9e3-302a-44b3-9f9f-da0e8c7ca51c is still seen in agent 10.0.0.27 VM list 2024-09-12 01:57:12,932 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=ca28b9e3-302a-44b3-9f9f-da0e8c7ca51c 2024-09-12 01:57:12,939 - DEBUG - Pod ca28b9e3-302a-44b3-9f9f-da0e8c7ca51c is not in agent 10.0.0.27 VM list 2024-09-12 01:57:12,939 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:37db7cb4-70aa-11ef-ada5-0242ec0c41c5 2024-09-12 01:57:12,946 - DEBUG - VMI 37db7cb4-70aa-11ef-ada5-0242ec0c41c5 is removed from agent 10.0.0.27 2024-09-12 01:57:12,946 - INFO - Verified that pod ctest-busybox-pod-26129115 is removed in agent 2024-09-12 01:57:12,947 - INFO - Deleting Ingress : ctest-nginx-ingress-53293935 2024-09-12 01:57:12,955 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_LoadbalancerDatabaseList?x=93f4440d-f971-4aef-b40a-2b48883144b5 2024-09-12 01:57:12,960 - ERROR - Ingress ctest-nginx-ingress-53293935 with uuid 93f4440d-f971-4aef-b40a-2b48883144b5 still found in kube manager 2024-09-12 01:57:13,961 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_LoadbalancerDatabaseList?x=93f4440d-f971-4aef-b40a-2b48883144b5 2024-09-12 01:57:14,044 - ERROR - Ingress ctest-nginx-ingress-53293935 with uuid 93f4440d-f971-4aef-b40a-2b48883144b5 still found in kube manager 2024-09-12 01:57:15,045 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_LoadbalancerDatabaseList?x=93f4440d-f971-4aef-b40a-2b48883144b5 2024-09-12 01:57:15,050 - INFO - Ingress ctest-nginx-ingress-53293935 with uuid 93f4440d-f971-4aef-b40a-2b48883144b5 deleted successfully from kube manager 2024-09-12 01:57:15,050 - INFO - Verifications on Ingress %s cleanup passed 2024-09-12 01:57:15,050 - INFO - Deleting the FIP pool __fip_pool_public__ 2024-09-12 01:57:15,259 - DEBUG - Requesting: http://10.0.0.27:8083/Snh_IFMapTableShowReq?table_name=floating-ip-pool&search_string=floating-ip-pool:default-domain:k8s-default:__public__:__fip_pool_public__ 2024-09-12 01:57:15,302 - WARNING - Control-node ifmap object for FIP pool __fip_pool_public__ , VN __public__ is found! 2024-09-12 01:57:20,304 - DEBUG - Requesting: http://10.0.0.27:8083/Snh_IFMapTableShowReq?table_name=floating-ip-pool&search_string=floating-ip-pool:default-domain:k8s-default:__public__:__fip_pool_public__ 2024-09-12 01:57:20,326 - DEBUG - Control-node Ifmap-view does not have FIP pool __fip_pool_public__ information 2024-09-12 01:57:20,327 - INFO - Deleting VN __public__ 2024-09-12 01:57:20,491 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/94e8f427-56c3-49fa-9567-927a4576ebfd 2024-09-12 01:57:20,504 - DEBUG - Response Code: 404 2024-09-12 01:57:20,505 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2024-09-12 01:57:20,514 - DEBUG - Requesting: http://10.0.0.27:8082/domain/771de695-9207-40a4-ac3d-18aae1b1edd9 2024-09-12 01:57:20,536 - DEBUG - Requesting: http://10.0.0.27:8082/project/d55cb5b7-fac0-4cb9-8da8-05d332fe5722 2024-09-12 01:57:20,616 - INFO - Validated that VN __public__ is not found in API Server 2024-09-12 01:57:20,617 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VnListReq?name=default-domain:k8s-default:__public__ 2024-09-12 01:57:20,625 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__ 2024-09-12 01:57:20,632 - DEBUG - VN __public__ is not present in Agent 10.0.0.27 2024-09-12 01:57:20,632 - INFO - Validated that VN __public__ is not in any agent 2024-09-12 01:57:20,632 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__ 2024-09-12 01:57:20,640 - DEBUG - Requesting: http://10.0.0.27:8083/Snh_ShowRoutingInstanceReq?name=default-domain:k8s-default:__public__:__public__ 2024-09-12 01:57:20,663 - DEBUG - Requesting: http://10.0.0.27:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:k8s-default:__public__ 2024-09-12 01:57:20,670 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN __public__ info 2024-09-12 01:57:20,671 - INFO - Deleting pod default:ctest-nginx-pod-16162725 2024-09-12 01:57:20,685 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=9ba8b051-140d-4dad-a190-f2d8c4cabc65 2024-09-12 01:57:20,692 - WARNING - Pod uuid 9ba8b051-140d-4dad-a190-f2d8c4cabc65 is still seen in agent 10.0.0.27 VM list 2024-09-12 01:57:25,693 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=9ba8b051-140d-4dad-a190-f2d8c4cabc65 2024-09-12 01:57:25,706 - DEBUG - Pod 9ba8b051-140d-4dad-a190-f2d8c4cabc65 is not in agent 10.0.0.27 VM list 2024-09-12 01:57:25,707 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:338c73e8-70aa-11ef-ada5-0242ec0c41c5 2024-09-12 01:57:25,718 - WARNING - VMI 338c73e8-70aa-11ef-ada5-0242ec0c41c5 of Pod ctest-nginx-pod-16162725 is still seen in agent 10.0.0.27 2024-09-12 01:57:25,718 - DEBUG - [{'index': '6', 'name': 'tapeth0-9ba8b0', 'uuid': '338c73e8-70aa-11ef-ada5-0242ec0c41c5', 'vrf_name': '--ERROR--', 'active': 'Inactive < vn-null vrf-null os-state-down ipv4_inactive ipv6_inactive l2_inactive >', 'ipv4_active': 'Ipv4 Inactive < vn-null vrf-null os-state-down l3-disabled >', 'l2_active': 'L2 Inactive < vn-null vrf-null os-state-down l2-disabled >', 'ip6_active': 'Ipv6 Inactive < vn-null vrf-null os-state-down l3-disabled no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '-1', 'l2_label': '-1', 'vxlan_id': '0', 'vn_name': None, 'vm_uuid': None, 'vm_name': None, 'ip_addr': '10.47.255.249', 'mac_addr': '02:33:8c:73:e8:70', 'policy': 'Disable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.6', 'service_vlan_list': None, 'os_ifindex': '17', 'fabric_port': 'FabricPort', 'alloc_linklocal_ip': 'LL-Disable', 'analyzer_name': None, 'config_name': None, 'sg_uuid_list': [], 'static_route_list': None, 'vm_project_uuid': '00000000-0000-0000-0000-000000000000', 'admin_state': 'Enabled', 'flow_key_idx': '0', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Invalid', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Inactive', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []}] 2024-09-12 01:57:30,719 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=9ba8b051-140d-4dad-a190-f2d8c4cabc65 2024-09-12 01:57:30,736 - DEBUG - Pod 9ba8b051-140d-4dad-a190-f2d8c4cabc65 is not in agent 10.0.0.27 VM list 2024-09-12 01:57:30,736 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:338c73e8-70aa-11ef-ada5-0242ec0c41c5 2024-09-12 01:57:30,750 - DEBUG - VMI 338c73e8-70aa-11ef-ada5-0242ec0c41c5 is removed from agent 10.0.0.27 2024-09-12 01:57:30,751 - INFO - Verified that pod ctest-nginx-pod-16162725 is removed in agent 2024-09-12 01:57:30,751 - INFO - Deleting pod default:ctest-nginx-pod-48106126 2024-09-12 01:57:30,780 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=28d40682-28c9-48da-b557-be9f2f0c90b1 2024-09-12 01:57:30,791 - WARNING - Pod uuid 28d40682-28c9-48da-b557-be9f2f0c90b1 is still seen in agent 10.0.0.27 VM list 2024-09-12 01:57:35,792 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=28d40682-28c9-48da-b557-be9f2f0c90b1 2024-09-12 01:57:35,800 - DEBUG - Pod 28d40682-28c9-48da-b557-be9f2f0c90b1 is not in agent 10.0.0.27 VM list 2024-09-12 01:57:35,800 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:32abc1ea-70aa-11ef-ada5-0242ec0c41c5 2024-09-12 01:57:35,809 - DEBUG - VMI 32abc1ea-70aa-11ef-ada5-0242ec0c41c5 is removed from agent 10.0.0.27 2024-09-12 01:57:35,809 - INFO - Verified that pod ctest-nginx-pod-48106126 is removed in agent 2024-09-12 01:57:35,809 - INFO - Deleting service : ctest-nginx-svc-97011173 2024-09-12 01:57:36,702 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_AgentXmppConnectionStatusReq? 2024-09-12 01:57:36,722 - DEBUG - No XMPP flaps were noticed during the test 2024-09-12 01:57:36,722 - INFO - END TEST : test_ingress_ip_assignment : PASSED[0:01:24] 2024-09-12 01:57:36,722 - INFO - -------------------------------------------------------------------------------- 2024-09-12 01:57:43,291 - DEBUG - [10.0.0.27]: Running cmd : docker exec --privileged -it k8s_contrail-kube-manager_contrail-kube-manager-z4swm_kube-system_c118b27c-3e6b-4b5f-b7bd-393152742dff_0 /bin/bash -c 'grep "^[ ]*cluster_project" /etc/contrail/contrail-kubernetes.conf' 2024-09-12 01:57:43,514 - DEBUG - Output : cluster_project={} 2024-09-12 01:57:43,716 - DEBUG - [10.0.0.27]: Running cmd : docker exec --privileged -it k8s_contrail-kube-manager_contrail-kube-manager-z4swm_kube-system_c118b27c-3e6b-4b5f-b7bd-393152742dff_0 /bin/bash -c 'netstat -antp | grep :8108 | grep LISTEN' 2024-09-12 01:57:44,148 - DEBUG - Output : tcp 0 0 0.0.0.0:8108 0.0.0.0:* LISTEN 1/python3 2024-09-12 01:57:44,183 - DEBUG - [10.0.0.27]: Running cmd : docker exec --privileged -it k8s_contrail-kube-manager_contrail-kube-manager-z4swm_kube-system_c118b27c-3e6b-4b5f-b7bd-393152742dff_0 /bin/bash -c 'grep "^[ ]*cluster_project" /etc/contrail/contrail-kubernetes.conf' 2024-09-12 01:57:44,456 - DEBUG - Output : cluster_project={} 2024-09-12 01:57:59,712 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-09-12 01:58:04,807 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-09-12 01:58:04,952 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-09-12 01:58:05,073 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-09-12 01:58:05,214 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-09-12 01:58:10,416 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-09-12 01:58:10,593 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-09-12 01:58:10,737 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-09-12 01:58:11,301 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_AgentXmppConnectionStatusReq? 2024-09-12 01:58:16,523 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_ApplicationPolicySetReq? 2024-09-12 01:58:16,531 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_AclReq? 2024-09-12 01:58:16,561 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_AclReq? 2024-09-12 01:58:18,607 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_AclReq? 2024-09-12 01:58:20,661 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_AclReq? 2024-09-12 02:01:26,035 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_AgentXmppConnectionStatusReq? 2024-09-12 02:01:26,148 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=b75b06fa-593f-44c7-beb2-2748f492f89f 2024-09-12 02:01:26,158 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=42cdf242-3bfa-415e-bd6f-1e91338e91c9 2024-09-12 02:01:26,168 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=28704b95-a4aa-495d-98e1-115892caf892 2024-09-12 02:01:26,175 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=a5c8533d-2ae9-4052-a699-c143570da37e 2024-09-12 02:01:26,181 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=f772e2cb-c186-4b60-8d00-5489e5f2c316 2024-09-12 02:01:26,185 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=a468c416-c6ee-4958-b9ac-6d4e319dd031 2024-09-12 02:01:26,190 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=2ae7cf04-c14e-4f12-ae0a-a4db6b3a9c45 2024-09-12 02:01:26,194 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=8aace0d7-df8c-407b-91d8-a2b00071db67 2024-09-12 02:01:31,245 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=f772e2cb-c186-4b60-8d00-5489e5f2c316 2024-09-12 02:01:31,247 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=a5c8533d-2ae9-4052-a699-c143570da37e 2024-09-12 02:01:31,249 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=28704b95-a4aa-495d-98e1-115892caf892 2024-09-12 02:01:31,250 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=a468c416-c6ee-4958-b9ac-6d4e319dd031 2024-09-12 02:01:31,251 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=42cdf242-3bfa-415e-bd6f-1e91338e91c9 2024-09-12 02:01:31,253 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=b75b06fa-593f-44c7-beb2-2748f492f89f 2024-09-12 02:01:31,262 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=8aace0d7-df8c-407b-91d8-a2b00071db67 2024-09-12 02:01:31,264 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=2ae7cf04-c14e-4f12-ae0a-a4db6b3a9c45 2024-09-12 02:01:31,276 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:6b3c84a4-70aa-11ef-ada5-0242ec0c41c5 2024-09-12 02:01:31,282 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:68711294-70aa-11ef-ada5-0242ec0c41c5 2024-09-12 02:01:31,293 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:6a7330fe-70aa-11ef-ada5-0242ec0c41c5 2024-09-12 02:01:36,279 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=28704b95-a4aa-495d-98e1-115892caf892 2024-09-12 02:01:36,286 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=a5c8533d-2ae9-4052-a699-c143570da37e 2024-09-12 02:01:36,290 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=42cdf242-3bfa-415e-bd6f-1e91338e91c9 2024-09-12 02:01:36,295 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=f772e2cb-c186-4b60-8d00-5489e5f2c316 2024-09-12 02:01:36,304 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=8aace0d7-df8c-407b-91d8-a2b00071db67 2024-09-12 02:01:41,362 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=42cdf242-3bfa-415e-bd6f-1e91338e91c9 2024-09-12 02:01:41,369 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=a5c8533d-2ae9-4052-a699-c143570da37e 2024-09-12 02:01:41,375 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=f772e2cb-c186-4b60-8d00-5489e5f2c316 2024-09-12 02:01:41,380 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=28704b95-a4aa-495d-98e1-115892caf892 2024-09-12 02:01:41,384 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=8aace0d7-df8c-407b-91d8-a2b00071db67 2024-09-12 02:01:46,445 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=a5c8533d-2ae9-4052-a699-c143570da37e 2024-09-12 02:01:46,452 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=8aace0d7-df8c-407b-91d8-a2b00071db67 2024-09-12 02:01:46,456 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=42cdf242-3bfa-415e-bd6f-1e91338e91c9 2024-09-12 02:01:46,463 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=28704b95-a4aa-495d-98e1-115892caf892 2024-09-12 02:01:46,467 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=f772e2cb-c186-4b60-8d00-5489e5f2c316 2024-09-12 02:01:51,521 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=42cdf242-3bfa-415e-bd6f-1e91338e91c9 2024-09-12 02:01:51,523 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=8aace0d7-df8c-407b-91d8-a2b00071db67 2024-09-12 02:01:51,527 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=28704b95-a4aa-495d-98e1-115892caf892 2024-09-12 02:01:51,529 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=f772e2cb-c186-4b60-8d00-5489e5f2c316 2024-09-12 02:01:51,531 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=a5c8533d-2ae9-4052-a699-c143570da37e 2024-09-12 02:01:56,539 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=42cdf242-3bfa-415e-bd6f-1e91338e91c9 2024-09-12 02:01:56,540 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=8aace0d7-df8c-407b-91d8-a2b00071db67 2024-09-12 02:01:56,547 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=a5c8533d-2ae9-4052-a699-c143570da37e 2024-09-12 02:01:56,548 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=f772e2cb-c186-4b60-8d00-5489e5f2c316 2024-09-12 02:01:56,549 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=28704b95-a4aa-495d-98e1-115892caf892 2024-09-12 02:01:56,575 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:69393f62-70aa-11ef-ada5-0242ec0c41c5 2024-09-12 02:02:01,566 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=8aace0d7-df8c-407b-91d8-a2b00071db67 2024-09-12 02:02:01,569 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=42cdf242-3bfa-415e-bd6f-1e91338e91c9 2024-09-12 02:02:01,574 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=a5c8533d-2ae9-4052-a699-c143570da37e 2024-09-12 02:02:01,578 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_VmListReq?uuid=28704b95-a4aa-495d-98e1-115892caf892 2024-09-12 02:02:01,602 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:6d1a632c-70aa-11ef-ada5-0242ec0c41c5 2024-09-12 02:02:01,604 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:6f098c4e-70aa-11ef-ada5-0242ec0c41c5 2024-09-12 02:02:01,608 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:6e153efa-70aa-11ef-ada5-0242ec0c41c5 2024-09-12 02:02:01,611 - DEBUG - Requesting: http://10.0.0.27:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:6c2b4198-70aa-11ef-ada5-0242ec0c41c5