2024-12-30 01:47:36,232 - DEBUG - [10.0.0.41]: Running cmd : hostname 2024-12-30 01:47:36,480 - DEBUG - Output : cn-jenkins-deploy-platform-k8s-manifests-122-1 2024-12-30 01:47:36,480 - DEBUG - [10.0.0.41]: Running cmd : hostname -f 2024-12-30 01:47:36,605 - DEBUG - Output : cn-jenkins-deploy-platform-k8s-manifests-122-1.cluster.local 2024-12-30 01:47:36,605 - DEBUG - [10.0.0.41]: Running cmd : docker ps -a 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}' 2024-12-30 01:47:36,779 - DEBUG - Output : NAMES contrail_test_7XXQQR0V1 k8s_coredns_coredns-77f7cc69db-rpqh8_kube-system_e123552d-cb3b-4999-abb3-a9447de431b3_0 k8s_autoscaler_dns-autoscaler-595558c478-r828c_kube-system_60328dd7-b60f-410f-8cf6-574bba91369b_0 k8s_contrail-controller-config-nodemgr_contrail-controller-config-lnlf8_kube-system_93ad649e-ad31-4505-bb60-00dd344d8105_0 k8s_contrail-controller-config-svcmonitor_contrail-controller-config-lnlf8_kube-system_93ad649e-ad31-4505-bb60-00dd344d8105_0 k8s_contrail-controller-nodemgr_contrail-controller-control-jh9qm_kube-system_bc272e89-66c2-45a5-bcf3-2145c2596d18_0 k8s_contrail-controller-control-named_contrail-controller-control-jh9qm_kube-system_bc272e89-66c2-45a5-bcf3-2145c2596d18_0 k8s_contrail-analytics-query-engine_contrail-analyticsdb-jt49m_kube-system_f57e8c9f-74a2-4571-a03a-6b72f1cb9896_0 k8s_contrail-controller-config-schema_contrail-controller-config-lnlf8_kube-system_93ad649e-ad31-4505-bb60-00dd344d8105_0 k8s_contrail-analytics-snmp-nodemgr_contrail-analytics-snmp-xndjk_kube-system_fb30d2b2-aa51-4917-b8b9-b089adf3b4b2_0 k8s_contrail-analytics-snmp-topology_contrail-analytics-snmp-xndjk_kube-system_fb30d2b2-aa51-4917-b8b9-b089adf3b4b2_0 k8s_contrail-analytics-nodemgr_contrail-analytics-kkgl8_kube-system_42c3314b-7acb-472d-870b-4988ad684e2e_0 k8s_contrail-analytics-collector_contrail-analytics-kkgl8_kube-system_42c3314b-7acb-472d-870b-4988ad684e2e_0 k8s_contrail-controller-control-dns_contrail-controller-control-jh9qm_kube-system_bc272e89-66c2-45a5-bcf3-2145c2596d18_0 k8s_contrail-controller-webui-web_contrail-controller-webui-lrnq6_kube-system_fd21f2e8-1fe5-4a99-a610-3be8a9503189_0 k8s_contrail-analyticsdb_contrail-analyticsdb-jt49m_kube-system_f57e8c9f-74a2-4571-a03a-6b72f1cb9896_0 k8s_contrail-analytics-alarm-nodemgr_contrail-analytics-alarm-r5cs6_kube-system_7df80f34-0ff1-4206-8600-cb9b6f05d87a_0 k8s_contrail-analytics-alarm-gen_contrail-analytics-alarm-r5cs6_kube-system_7df80f34-0ff1-4206-8600-cb9b6f05d87a_0 k8s_contrail-controller-config-devicemgr_contrail-controller-config-lnlf8_kube-system_93ad649e-ad31-4505-bb60-00dd344d8105_0 k8s_contrail-analytics-snmp-collector_contrail-analytics-snmp-xndjk_kube-system_fb30d2b2-aa51-4917-b8b9-b089adf3b4b2_0 k8s_contrail-analytics-api_contrail-analytics-kkgl8_kube-system_42c3314b-7acb-472d-870b-4988ad684e2e_0 k8s_contrail-controller-control_contrail-controller-control-jh9qm_kube-system_bc272e89-66c2-45a5-bcf3-2145c2596d18_0 k8s_contrail-controller-webui-job_contrail-controller-webui-lrnq6_kube-system_fd21f2e8-1fe5-4a99-a610-3be8a9503189_0 k8s_contrail-analyticsdb-nodemgr_contrail-analyticsdb-jt49m_kube-system_f57e8c9f-74a2-4571-a03a-6b72f1cb9896_0 k8s_kafka_contrail-analytics-alarm-r5cs6_kube-system_7df80f34-0ff1-4206-8600-cb9b6f05d87a_0 k8s_contrail-controller-config-api_contrail-controller-config-lnlf8_kube-system_93ad649e-ad31-4505-bb60-00dd344d8105_0 k8s_redis_redis-qtn5f_kube-system_35932d43-3493-4158-bd4b-770fd8c8ae08_0 k8s_contrail-config-database-nodemgr_contrail-configdb-vqsrh_kube-system_21574752-8b54-4f85-810f-05e3f41f1cfd_0 k8s_contrail-configdb_contrail-configdb-vqsrh_kube-system_21574752-8b54-4f85-810f-05e3f41f1cfd_0 k8s_config-zookeeper_config-zookeeper-qslv8_kube-system_f3e6515c-0b34-42e3-8b9d-bf3c1f472035_0 k8s_rabbitmq_rabbitmq-c9qwt_kube-system_52777401-77a0-4deb-91a4-a9cb28cf275c_0 k8s_contrail-agent-nodemgr_contrail-agent-jhqbf_kube-system_b2f27387-eada-43e2-a623-e6aa45df42c4_0 k8s_contrail-vrouter-agent_contrail-agent-jhqbf_kube-system_b2f27387-eada-43e2-a623-e6aa45df42c4_0 k8s_contrail-kube-manager_contrail-kube-manager-xqskg_kube-system_18477eb1-9e5c-46b2-a5a2-ccaeb234c041_0 k8s_kube-proxy_kube-proxy-dlhgf_kube-system_00b2c56d-bce2-4645-9ca0-339e8a664adf_0 k8s_kube-controller-manager_kube-controller-manager-cn-jenkins-deploy-platform-k8s-manifests-122-1_kube-system_5346f442eb80ddf3d07f05850007e6dc_1 k8s_kube-scheduler_kube-scheduler-cn-jenkins-deploy-platform-k8s-manifests-122-1_kube-system_a59c59f065bf4abd162f434703c95484_1 k8s_kube-apiserver_kube-apiserver-cn-jenkins-deploy-platform-k8s-manifests-122-1_kube-system_8e63277f2b6ab027fc7040a9419aa333_0 2024-12-30 01:47:36,779 - DEBUG - [10.0.0.41]: Running cmd : ip addr show | grep 'inet .*/.* brd ' | awk '{print $2}' 2024-12-30 01:47:36,902 - DEBUG - Output : 172.17.0.1/16 10.0.0.41/24 2024-12-30 01:47:36,903 - DEBUG - [10.0.0.41]: Running cmd : getent hosts 10.0.0.41 | head -n 1 | awk '{print $2}' 2024-12-30 01:47:37,036 - DEBUG - Output : cn-jenkins-deploy-platform-k8s-manifests-122-1.cluster.local 2024-12-30 01:47:37,036 - DEBUG - [10.0.0.41]: Running cmd : ip addr show dev vhost0 | grep 'inet .*/.* brd ' | awk '{print $2}' 2024-12-30 01:47:37,152 - DEBUG - Output : 10.0.0.41/24 2024-12-30 01:47:37,486 - INFO - Using existing project ['default-domain', 'k8s-default'](b788b535-fcf7-42a1-9788-07156b7fa420) 2024-12-30 01:47:37,642 - INFO - Using existing project ['default-domain', 'k8s-default'](b788b535-fcf7-42a1-9788-07156b7fa420) 2024-12-30 01:47:37,789 - INFO - ================================================================================ 2024-12-30 01:47:37,789 - INFO - STARTING TEST : test_ingress_ip_assignment 2024-12-30 01:47:37,790 - INFO - TEST DESCRIPTION : Verify that Ingress gets a CLuster IP which is reachable to Pods in same namespace. Also verify that a Floating IP is assigned to the Ingress from the Public FIP poo. Steps: 1. Create a service with 2 pods running nginx 2. Create an ingress out of this service 3. From another Pod do a wget on the ingress Cluster ip Validate that Ingress get a IP from Public FIP pool which might/might not be accessible. Validate that service and its loadbalancing work 2024-12-30 01:47:38,017 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq? 2024-12-30 01:47:38,024 - DEBUG - Nothing to compare xmpp stats {'10.0.0.41': {'10.0.0.41': '2'}} with 2024-12-30 01:47:38,024 - INFO - Initial checks done. Running the testcase now 2024-12-30 01:47:38,024 - INFO - 2024-12-30 01:47:38,028 - INFO - Namespace default already exists 2024-12-30 01:47:38,028 - DEBUG - [10.0.0.41]: Running cmd : docker exec --privileged -it k8s_contrail-kube-manager_contrail-kube-manager-xqskg_kube-system_18477eb1-9e5c-46b2-a5a2-ccaeb234c041_0 /bin/bash -c 'grep "^[ ]*cluster_project" /etc/contrail/contrail-kubernetes.conf' 2024-12-30 01:47:38,185 - DEBUG - Output : cluster_project={} 2024-12-30 01:47:38,263 - INFO - Project default-domain:k8s-default for Namespace default is seen in contrail-api 2024-12-30 01:47:38,263 - DEBUG - Project uuid in Contrail is b788b535-fcf7-42a1-9788-07156b7fa420 2024-12-30 01:47:38,263 - DEBUG - [10.0.0.41]: Running cmd : docker exec --privileged -it k8s_contrail-kube-manager_contrail-kube-manager-xqskg_kube-system_18477eb1-9e5c-46b2-a5a2-ccaeb234c041_0 /bin/bash -c 'netstat -antp | grep :8108 | grep LISTEN' 2024-12-30 01:47:38,400 - DEBUG - Output : tcp 0 0 0.0.0.0:8108 0.0.0.0:* LISTEN 1/python3 2024-12-30 01:47:38,400 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_NamespaceDatabaseList?namespace_uuid=e944d06a-dee7-4fff-8960-4484fabc9633 2024-12-30 01:47:38,405 - INFO - Namespace default with uuid e944d06a-dee7-4fff-8960-4484fabc9633 found in kube manager 2024-12-30 01:47:38,405 - INFO - Namespace default verification passed 2024-12-30 01:47:38,408 - DEBUG - Service ctest-nginx-svc-94731268 not present 2024-12-30 01:47:38,409 - INFO - Creating service ctest-nginx-svc-94731268 2024-12-30 01:47:38,422 - INFO - Created Service ctest-nginx-svc-94731268 2024-12-30 01:47:38,427 - DEBUG - Pod ctest-nginx-pod-31914324 not present 2024-12-30 01:47:38,428 - INFO - Creating Pod ctest-nginx-pod-31914324 2024-12-30 01:47:38,459 - DEBUG - Pod : ctest-nginx-pod-31914324 UUID is 369e1ca4-137e-402e-806d-22845665acb9 2024-12-30 01:47:38,463 - DEBUG - Pod ctest-nginx-pod-76731543 not present 2024-12-30 01:47:38,463 - INFO - Creating Pod ctest-nginx-pod-76731543 2024-12-30 01:47:38,487 - DEBUG - Pod : ctest-nginx-pod-76731543 UUID is 44d46ec4-88aa-479e-aefc-7c97e4b59a36 2024-12-30 01:47:38,742 - INFO - Created VN __public__, UUID :4d79ca39-b867-4679-af4b-629888dfc64a 2024-12-30 01:47:39,022 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2024-12-30 01:47:39,032 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9282f800-04d3-4eb7-b17e-f96800e4cf76 2024-12-30 01:47:39,119 - DEBUG - Requesting: http://10.0.0.41:8082/project/b788b535-fcf7-42a1-9788-07156b7fa420 2024-12-30 01:47:39,215 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/4d79ca39-b867-4679-af4b-629888dfc64a 2024-12-30 01:47:39,225 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/4d79ca39-b867-4679-af4b-629888dfc64a 2024-12-30 01:47:39,234 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/dd448315-88a9-4878-bee4-19667cbdb1b0 2024-12-30 01:47:39,240 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/dd448315-88a9-4878-bee4-19667cbdb1b0 2024-12-30 01:47:39,245 - DEBUG - Route Targets: [] 2024-12-30 01:47:39,245 - DEBUG - RT names not yet present for VN __public__ 2024-12-30 01:47:44,246 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2024-12-30 01:47:44,256 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9282f800-04d3-4eb7-b17e-f96800e4cf76 2024-12-30 01:47:44,266 - DEBUG - Requesting: http://10.0.0.41:8082/project/b788b535-fcf7-42a1-9788-07156b7fa420 2024-12-30 01:47:44,327 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/4d79ca39-b867-4679-af4b-629888dfc64a 2024-12-30 01:47:44,338 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/4d79ca39-b867-4679-af4b-629888dfc64a 2024-12-30 01:47:44,346 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/dd448315-88a9-4878-bee4-19667cbdb1b0 2024-12-30 01:47:44,354 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/dd448315-88a9-4878-bee4-19667cbdb1b0 2024-12-30 01:47:44,360 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/03dfff95-3e3e-40e2-8f9f-0212d06cca67 2024-12-30 01:47:44,365 - DEBUG - Route Targets: ['target:64512:8000007'] 2024-12-30 01:47:44,366 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/4d79ca39-b867-4679-af4b-629888dfc64a 2024-12-30 01:47:44,373 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/dd448315-88a9-4878-bee4-19667cbdb1b0 2024-12-30 01:47:44,386 - INFO - Verified VN network id 12 for VN 4d79ca39-b867-4679-af4b-629888dfc64a 2024-12-30 01:47:44,386 - INFO - Verifications in API Server for VN __public__ passed 2024-12-30 01:47:44,386 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/4d79ca39-b867-4679-af4b-629888dfc64a 2024-12-30 01:47:44,394 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/dd448315-88a9-4878-bee4-19667cbdb1b0 2024-12-30 01:47:44,402 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/dd448315-88a9-4878-bee4-19667cbdb1b0 2024-12-30 01:47:44,410 - DEBUG - Requesting: http://10.0.0.41:8082/route-target/03dfff95-3e3e-40e2-8f9f-0212d06cca67 2024-12-30 01:47:44,419 - DEBUG - Requesting: http://10.0.0.41:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:k8s-default:__public__ 2024-12-30 01:47:44,428 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:k8s-default:__public__', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'cloud-admin', 'owner-access': '7', 'group': 'cloud-admin-group', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '5582715562358163065', 'uuid-lslong': '12631297987161605706'}, 'enable': 'true', 'created': '2024-12-30T01:47:38', 'last-modified': '2024-12-30T01:47:38', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:05.531137'} 2024-12-30 01:47:44,431 - DEBUG - Requesting: http://10.0.0.41:8083/Snh_ShowRoutingInstanceReq?name=default-domain:k8s-default:__public__:__public__ 2024-12-30 01:47:44,438 - DEBUG - Route Targets: ['target:64512:8000007'] 2024-12-30 01:47:44,439 - INFO - On all control nodes, Config, RI and RT verification for VN __public__ passed 2024-12-30 01:47:44,440 - DEBUG - ====Verifying policy data for __public__ in API_Server ====== 2024-12-30 01:47:44,440 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2024-12-30 01:47:44,459 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9282f800-04d3-4eb7-b17e-f96800e4cf76 2024-12-30 01:47:44,468 - DEBUG - Requesting: http://10.0.0.41:8082/project/b788b535-fcf7-42a1-9788-07156b7fa420 2024-12-30 01:47:44,494 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/4d79ca39-b867-4679-af4b-629888dfc64a 2024-12-30 01:47:44,507 - DEBUG - =>VN __public__ has no policy to be verified 2024-12-30 01:47:44,507 - DEBUG - Verifying the vn in opserver 2024-12-30 01:47:44,507 - DEBUG - Verifying the default-domain:k8s-default:__public__ virtual network link through opserver 10.0.0.41 2024-12-30 01:47:44,508 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2024-12-30 01:47:44,512 - DEBUG - vn link and name as {'name': 'default-domain:k8s-default:__public__', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:k8s-default:__public__?flat'} 2024-12-30 01:47:44,512 - INFO - Validated that VN default-domain:k8s-default:__public__ is found in opserver 2024-12-30 01:47:44,512 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__ 2024-12-30 01:47:44,518 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__ 2024-12-30 01:47:44,523 - DEBUG - Do not have enough data to verify VN in agent 2024-12-30 01:47:44,523 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__ 2024-12-30 01:47:44,527 - DEBUG - VRF ids for VN __public__: {} 2024-12-30 01:47:44,690 - INFO - Creating Floating IP pool __fip_pool_public__ in API Server 2024-12-30 01:47:44,903 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2024-12-30 01:47:44,908 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9282f800-04d3-4eb7-b17e-f96800e4cf76 2024-12-30 01:47:44,917 - DEBUG - Requesting: http://10.0.0.41:8082/project/b788b535-fcf7-42a1-9788-07156b7fa420 2024-12-30 01:47:44,950 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/4d79ca39-b867-4679-af4b-629888dfc64a 2024-12-30 01:47:44,961 - DEBUG - Requesting: http://10.0.0.41:8082/floating-ip-pool/cd8f302c-5ba0-4a69-be61-e7bd12ef6ff8 2024-12-30 01:47:44,967 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2024-12-30 01:47:44,971 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9282f800-04d3-4eb7-b17e-f96800e4cf76 2024-12-30 01:47:44,977 - DEBUG - Requesting: http://10.0.0.41:8082/project/b788b535-fcf7-42a1-9788-07156b7fa420 2024-12-30 01:47:45,006 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-network/4d79ca39-b867-4679-af4b-629888dfc64a 2024-12-30 01:47:45,028 - DEBUG - FIP Pool __fip_pool_public__ found in API Server 2024-12-30 01:47:45,028 - INFO - Verification for FIP pool __fip_pool_public__ in API Server passed 2024-12-30 01:47:45,035 - DEBUG - Requesting: http://10.0.0.41:8083/Snh_IFMapTableShowReq?table_name=floating-ip-pool&search_string=floating-ip-pool:default-domain:k8s-default:__public__:__fip_pool_public__ 2024-12-30 01:47:45,040 - DEBUG - Control-node Ifmap-view has FIP pool __fip_pool_public__ information 2024-12-30 01:47:45,040 - INFO - Verification for FIP pool __fip_pool_public__ in Control-node passed 2024-12-30 01:47:45,043 - DEBUG - Ingress ctest-nginx-ingress-66427534 not present 2024-12-30 01:47:45,044 - INFO - Creating Ingress ctest-nginx-ingress-66427534 2024-12-30 01:47:45,050 - INFO - Created Ingress ctest-nginx-ingress-66427534 2024-12-30 01:47:45,053 - DEBUG - Cluster IP not yet seen for Ingress ctest-nginx-ingress-66427534 2024-12-30 01:47:48,057 - DEBUG - For Ingress ctest-nginx-ingress-66427534, Cluster IP: 10.47.255.248, External IPs ['29.85.97.124'] 2024-12-30 01:47:48,058 - INFO - Verifications in k8s passed for Ingress ctest-nginx-ingress-66427534 2024-12-30 01:47:48,058 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_LoadbalancerDatabaseList?x=b61e52b8-0da1-4b77-a97f-50d6b4c0ac58 2024-12-30 01:47:48,064 - INFO - Ingress ctest-nginx-ingress-66427534 with uuid b61e52b8-0da1-4b77-a97f-50d6b4c0ac58 found in kube manager 2024-12-30 01:47:48,064 - INFO - Ingress ctest-nginx-ingress-66427534 verification passed 2024-12-30 01:47:48,067 - DEBUG - Pod ctest-busybox-pod-56737516 not present 2024-12-30 01:47:48,068 - INFO - Creating Pod ctest-busybox-pod-56737516 2024-12-30 01:47:48,087 - DEBUG - Pod : ctest-busybox-pod-56737516 UUID is 93188a22-1ed7-4e99-99d7-ef4e8f2d8c8a 2024-12-30 01:47:48,103 - DEBUG - Pod ctest-nginx-pod-31914324 not in running state.Currently in Pending 2024-12-30 01:47:53,110 - DEBUG - Pod ctest-nginx-pod-31914324 not in running state.Currently in Pending 2024-12-30 01:47:58,117 - INFO - Pod ctest-nginx-pod-31914324 is in running state.Got IP 10.47.255.250 2024-12-30 01:47:58,172 - DEBUG - Pod ctest-nginx-pod-31914324 has vmi 0e2da490-c650-11ef-b81a-02420bb50ca0 2024-12-30 01:47:58,172 - INFO - Verified pod ctest-nginx-pod-31914324 in contrail-api 2024-12-30 01:47:58,172 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-12-30 01:47:58,184 - DEBUG - VMI 0e2da490-c650-11ef-b81a-02420bb50ca0 is active in agent 10.0.0.41 2024-12-30 01:47:58,184 - INFO - Verified Pod ctest-nginx-pod-31914324 in agent 10.0.0.41 2024-12-30 01:47:58,184 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=369e1ca4-137e-402e-806d-22845665acb9 2024-12-30 01:47:58,188 - INFO - Pod ctest-nginx-pod-31914324 with uuid 369e1ca4-137e-402e-806d-22845665acb9 found in kube manager 2024-12-30 01:47:58,188 - INFO - Pod ctest-nginx-pod-31914324 verification passed 2024-12-30 01:47:58,257 - DEBUG - [Pod ctest-nginx-pod-31914324] Cmd: echo ctest-nginx-pod-31914324 > /usr/share/nginx/html/index.html, Output: 2024-12-30 01:47:58,263 - INFO - Pod ctest-nginx-pod-76731543 is in running state.Got IP 10.47.255.249 2024-12-30 01:47:58,316 - DEBUG - Pod ctest-nginx-pod-76731543 has vmi 0edc57c4-c650-11ef-b81a-02420bb50ca0 2024-12-30 01:47:58,316 - INFO - Verified pod ctest-nginx-pod-76731543 in contrail-api 2024-12-30 01:47:58,316 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-12-30 01:47:58,326 - DEBUG - VMI 0edc57c4-c650-11ef-b81a-02420bb50ca0 is active in agent 10.0.0.41 2024-12-30 01:47:58,326 - INFO - Verified Pod ctest-nginx-pod-76731543 in agent 10.0.0.41 2024-12-30 01:47:58,326 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=44d46ec4-88aa-479e-aefc-7c97e4b59a36 2024-12-30 01:47:58,330 - INFO - Pod ctest-nginx-pod-76731543 with uuid 44d46ec4-88aa-479e-aefc-7c97e4b59a36 found in kube manager 2024-12-30 01:47:58,330 - INFO - Pod ctest-nginx-pod-76731543 verification passed 2024-12-30 01:47:58,398 - DEBUG - [Pod ctest-nginx-pod-76731543] Cmd: echo ctest-nginx-pod-76731543 > /usr/share/nginx/html/index.html, Output: 2024-12-30 01:47:58,403 - DEBUG - Pod ctest-busybox-pod-56737516 not in running state.Currently in Pending 2024-12-30 01:48:03,409 - INFO - Pod ctest-busybox-pod-56737516 is in running state.Got IP 10.47.255.247 2024-12-30 01:48:03,479 - DEBUG - Pod ctest-busybox-pod-56737516 has vmi 137393ec-c650-11ef-b81a-02420bb50ca0 2024-12-30 01:48:03,479 - INFO - Verified pod ctest-busybox-pod-56737516 in contrail-api 2024-12-30 01:48:03,479 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-12-30 01:48:03,489 - DEBUG - VMI 137393ec-c650-11ef-b81a-02420bb50ca0 is active in agent 10.0.0.41 2024-12-30 01:48:03,489 - INFO - Verified Pod ctest-busybox-pod-56737516 in agent 10.0.0.41 2024-12-30 01:48:03,489 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_VirtualMachineDatabaseList?x=93188a22-1ed7-4e99-99d7-ef4e8f2d8c8a 2024-12-30 01:48:03,493 - INFO - Pod ctest-busybox-pod-56737516 with uuid 93188a22-1ed7-4e99-99d7-ef4e8f2d8c8a found in kube manager 2024-12-30 01:48:03,493 - INFO - Pod ctest-busybox-pod-56737516 verification passed 2024-12-30 01:48:03,568 - DEBUG - [Pod ctest-busybox-pod-56737516] Cmd: wget http://10.47.255.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.47.255.248:80 (10.47.255.248:80) ctest-nginx-pod-76731543 writing to stdout - 100% |********************************| 25 0:00:00 ETA written to stdout 2024-12-30 01:48:03,568 - DEBUG - [Pod Pod ctest-busybox-pod-56737516] Cmd wget http://10.47.255.248:80/ -O - -T 5 -t 1 passed 2024-12-30 01:48:03,568 - DEBUG - [Pod Pod ctest-busybox-pod-56737516] Cmd output: Connecting to 10.47.255.248:80 (10.47.255.248:80) ctest-nginx-pod-76731543 writing to stdout - 100% |********************************| 25 0:00:00 ETA written to stdout 2024-12-30 01:48:03,639 - DEBUG - [Pod ctest-busybox-pod-56737516] Cmd: wget http://10.47.255.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.47.255.248:80 (10.47.255.248:80) writing to stdout - 100% |********************************| 25 0:00:00 ETA written to stdout ctest-nginx-pod-76731543 2024-12-30 01:48:03,639 - DEBUG - [Pod Pod ctest-busybox-pod-56737516] Cmd wget http://10.47.255.248:80/ -O - -T 5 -t 1 passed 2024-12-30 01:48:03,639 - DEBUG - [Pod Pod ctest-busybox-pod-56737516] Cmd output: Connecting to 10.47.255.248:80 (10.47.255.248:80) writing to stdout - 100% |********************************| 25 0:00:00 ETA written to stdout ctest-nginx-pod-76731543 2024-12-30 01:48:03,701 - DEBUG - [Pod ctest-busybox-pod-56737516] Cmd: wget http://10.47.255.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.47.255.248:80 (10.47.255.248:80) ctest-nginx-pod-31914324 writing to stdout - 100% |********************************| 25 0:00:00 ETA written to stdout 2024-12-30 01:48:03,701 - DEBUG - [Pod Pod ctest-busybox-pod-56737516] Cmd wget http://10.47.255.248:80/ -O - -T 5 -t 1 passed 2024-12-30 01:48:03,701 - DEBUG - [Pod Pod ctest-busybox-pod-56737516] Cmd output: Connecting to 10.47.255.248:80 (10.47.255.248:80) ctest-nginx-pod-31914324 writing to stdout - 100% |********************************| 25 0:00:00 ETA written to stdout 2024-12-30 01:48:03,701 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-nginx-pod-31914324': 1, 'ctest-nginx-pod-76731543': 2} 2024-12-30 01:48:03,701 - WARNING - Nothing to delete parallely 2024-12-30 01:48:03,702 - INFO - Deleting pod default:ctest-busybox-pod-56737516 2024-12-30 01:48:03,713 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=93188a22-1ed7-4e99-99d7-ef4e8f2d8c8a 2024-12-30 01:48:03,723 - WARNING - Pod uuid 93188a22-1ed7-4e99-99d7-ef4e8f2d8c8a is still seen in agent 10.0.0.41 VM list 2024-12-30 01:48:08,724 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=93188a22-1ed7-4e99-99d7-ef4e8f2d8c8a 2024-12-30 01:48:08,730 - WARNING - Pod uuid 93188a22-1ed7-4e99-99d7-ef4e8f2d8c8a is still seen in agent 10.0.0.41 VM list 2024-12-30 01:48:13,731 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=93188a22-1ed7-4e99-99d7-ef4e8f2d8c8a 2024-12-30 01:48:13,736 - WARNING - Pod uuid 93188a22-1ed7-4e99-99d7-ef4e8f2d8c8a is still seen in agent 10.0.0.41 VM list 2024-12-30 01:48:18,738 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=93188a22-1ed7-4e99-99d7-ef4e8f2d8c8a 2024-12-30 01:48:18,743 - WARNING - Pod uuid 93188a22-1ed7-4e99-99d7-ef4e8f2d8c8a is still seen in agent 10.0.0.41 VM list 2024-12-30 01:48:23,744 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=93188a22-1ed7-4e99-99d7-ef4e8f2d8c8a 2024-12-30 01:48:23,749 - WARNING - Pod uuid 93188a22-1ed7-4e99-99d7-ef4e8f2d8c8a is still seen in agent 10.0.0.41 VM list 2024-12-30 01:48:28,751 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=93188a22-1ed7-4e99-99d7-ef4e8f2d8c8a 2024-12-30 01:48:28,757 - WARNING - Pod uuid 93188a22-1ed7-4e99-99d7-ef4e8f2d8c8a is still seen in agent 10.0.0.41 VM list 2024-12-30 01:48:33,759 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=93188a22-1ed7-4e99-99d7-ef4e8f2d8c8a 2024-12-30 01:48:33,767 - WARNING - Pod uuid 93188a22-1ed7-4e99-99d7-ef4e8f2d8c8a is still seen in agent 10.0.0.41 VM list 2024-12-30 01:48:38,768 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=93188a22-1ed7-4e99-99d7-ef4e8f2d8c8a 2024-12-30 01:48:38,774 - DEBUG - Pod 93188a22-1ed7-4e99-99d7-ef4e8f2d8c8a is not in agent 10.0.0.41 VM list 2024-12-30 01:48:38,774 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:137393ec-c650-11ef-b81a-02420bb50ca0 2024-12-30 01:48:38,779 - DEBUG - VMI 137393ec-c650-11ef-b81a-02420bb50ca0 is removed from agent 10.0.0.41 2024-12-30 01:48:38,779 - INFO - Verified that pod ctest-busybox-pod-56737516 is removed in agent 2024-12-30 01:48:38,779 - INFO - Deleting Ingress : ctest-nginx-ingress-66427534 2024-12-30 01:48:38,784 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_LoadbalancerDatabaseList?x=b61e52b8-0da1-4b77-a97f-50d6b4c0ac58 2024-12-30 01:48:38,789 - ERROR - Ingress ctest-nginx-ingress-66427534 with uuid b61e52b8-0da1-4b77-a97f-50d6b4c0ac58 still found in kube manager 2024-12-30 01:48:39,790 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_LoadbalancerDatabaseList?x=b61e52b8-0da1-4b77-a97f-50d6b4c0ac58 2024-12-30 01:48:39,795 - ERROR - Ingress ctest-nginx-ingress-66427534 with uuid b61e52b8-0da1-4b77-a97f-50d6b4c0ac58 still found in kube manager 2024-12-30 01:48:40,796 - DEBUG - Requesting: http://10.0.0.41:8108/Snh_LoadbalancerDatabaseList?x=b61e52b8-0da1-4b77-a97f-50d6b4c0ac58 2024-12-30 01:48:40,800 - INFO - Ingress ctest-nginx-ingress-66427534 with uuid b61e52b8-0da1-4b77-a97f-50d6b4c0ac58 deleted successfully from kube manager 2024-12-30 01:48:40,800 - INFO - Verifications on Ingress %s cleanup passed 2024-12-30 01:48:40,801 - INFO - Deleting the FIP pool __fip_pool_public__ 2024-12-30 01:48:40,878 - DEBUG - Requesting: http://10.0.0.41:8083/Snh_IFMapTableShowReq?table_name=floating-ip-pool&search_string=floating-ip-pool:default-domain:k8s-default:__public__:__fip_pool_public__ 2024-12-30 01:48:40,883 - DEBUG - Control-node Ifmap-view does not have FIP pool __fip_pool_public__ information 2024-12-30 01:48:40,883 - INFO - Deleting VN __public__ 2024-12-30 01:48:40,965 - DEBUG - Requesting: http://10.0.0.41:8082/routing-instance/dd448315-88a9-4878-bee4-19667cbdb1b0 2024-12-30 01:48:40,970 - DEBUG - Response Code: 404 2024-12-30 01:48:40,970 - DEBUG - Requesting: http://10.0.0.41:8082/domains 2024-12-30 01:48:40,979 - DEBUG - Requesting: http://10.0.0.41:8082/domain/9282f800-04d3-4eb7-b17e-f96800e4cf76 2024-12-30 01:48:40,994 - DEBUG - Requesting: http://10.0.0.41:8082/project/b788b535-fcf7-42a1-9788-07156b7fa420 2024-12-30 01:48:41,037 - INFO - Validated that VN __public__ is not found in API Server 2024-12-30 01:48:41,037 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VnListReq?name=default-domain:k8s-default:__public__ 2024-12-30 01:48:41,045 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__ 2024-12-30 01:48:41,051 - DEBUG - VN __public__ is not present in Agent 10.0.0.41 2024-12-30 01:48:41,051 - INFO - Validated that VN __public__ is not in any agent 2024-12-30 01:48:41,051 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__ 2024-12-30 01:48:41,057 - DEBUG - Requesting: http://10.0.0.41:8083/Snh_ShowRoutingInstanceReq?name=default-domain:k8s-default:__public__:__public__ 2024-12-30 01:48:41,062 - DEBUG - Requesting: http://10.0.0.41:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:k8s-default:__public__ 2024-12-30 01:48:41,066 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN __public__ info 2024-12-30 01:48:41,067 - INFO - Deleting pod default:ctest-nginx-pod-76731543 2024-12-30 01:48:41,077 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=44d46ec4-88aa-479e-aefc-7c97e4b59a36 2024-12-30 01:48:41,086 - WARNING - Pod uuid 44d46ec4-88aa-479e-aefc-7c97e4b59a36 is still seen in agent 10.0.0.41 VM list 2024-12-30 01:48:46,087 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=44d46ec4-88aa-479e-aefc-7c97e4b59a36 2024-12-30 01:48:46,093 - DEBUG - Pod 44d46ec4-88aa-479e-aefc-7c97e4b59a36 is not in agent 10.0.0.41 VM list 2024-12-30 01:48:46,093 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:0edc57c4-c650-11ef-b81a-02420bb50ca0 2024-12-30 01:48:46,099 - DEBUG - VMI 0edc57c4-c650-11ef-b81a-02420bb50ca0 is removed from agent 10.0.0.41 2024-12-30 01:48:46,099 - INFO - Verified that pod ctest-nginx-pod-76731543 is removed in agent 2024-12-30 01:48:46,099 - INFO - Deleting pod default:ctest-nginx-pod-31914324 2024-12-30 01:48:46,109 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=369e1ca4-137e-402e-806d-22845665acb9 2024-12-30 01:48:46,117 - WARNING - Pod uuid 369e1ca4-137e-402e-806d-22845665acb9 is still seen in agent 10.0.0.41 VM list 2024-12-30 01:48:51,118 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=369e1ca4-137e-402e-806d-22845665acb9 2024-12-30 01:48:51,124 - DEBUG - Pod 369e1ca4-137e-402e-806d-22845665acb9 is not in agent 10.0.0.41 VM list 2024-12-30 01:48:51,124 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:0e2da490-c650-11ef-b81a-02420bb50ca0 2024-12-30 01:48:51,130 - DEBUG - VMI 0e2da490-c650-11ef-b81a-02420bb50ca0 is removed from agent 10.0.0.41 2024-12-30 01:48:51,130 - INFO - Verified that pod ctest-nginx-pod-31914324 is removed in agent 2024-12-30 01:48:51,130 - INFO - Deleting service : ctest-nginx-svc-94731268 2024-12-30 01:48:51,605 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq? 2024-12-30 01:48:51,611 - DEBUG - No XMPP flaps were noticed during the test 2024-12-30 01:48:51,611 - INFO - END TEST : test_ingress_ip_assignment : PASSED[0:01:14] 2024-12-30 01:48:51,611 - INFO - -------------------------------------------------------------------------------- 2024-12-30 01:48:57,954 - DEBUG - [10.0.0.41]: Running cmd : docker exec --privileged -it k8s_contrail-kube-manager_contrail-kube-manager-xqskg_kube-system_18477eb1-9e5c-46b2-a5a2-ccaeb234c041_0 /bin/bash -c 'grep "^[ ]*cluster_project" /etc/contrail/contrail-kubernetes.conf' 2024-12-30 01:48:58,145 - DEBUG - Output : cluster_project={} 2024-12-30 01:48:58,229 - DEBUG - [10.0.0.41]: Running cmd : docker exec --privileged -it k8s_contrail-kube-manager_contrail-kube-manager-xqskg_kube-system_18477eb1-9e5c-46b2-a5a2-ccaeb234c041_0 /bin/bash -c 'netstat -antp | grep :8108 | grep LISTEN' 2024-12-30 01:48:58,426 - DEBUG - Output : tcp 0 0 0.0.0.0:8108 0.0.0.0:* LISTEN 1/python3 2024-12-30 01:48:58,433 - DEBUG - [10.0.0.41]: Running cmd : docker exec --privileged -it k8s_contrail-kube-manager_contrail-kube-manager-xqskg_kube-system_18477eb1-9e5c-46b2-a5a2-ccaeb234c041_0 /bin/bash -c 'grep "^[ ]*cluster_project" /etc/contrail/contrail-kubernetes.conf' 2024-12-30 01:48:58,768 - DEBUG - Output : cluster_project={} 2024-12-30 01:49:08,946 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-12-30 01:49:14,032 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-12-30 01:49:19,123 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-12-30 01:49:19,252 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-12-30 01:49:19,377 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-12-30 01:49:24,457 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-12-30 01:49:24,571 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-12-30 01:49:24,684 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0, 2024-12-30 01:49:24,945 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq? 2024-12-30 01:49:27,825 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_ApplicationPolicySetReq? 2024-12-30 01:49:27,833 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AclReq? 2024-12-30 01:49:27,859 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AclReq? 2024-12-30 01:49:29,886 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AclReq? 2024-12-30 01:49:31,924 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AclReq? 2024-12-30 01:52:36,576 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_AgentXmppConnectionStatusReq? 2024-12-30 01:52:36,619 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=fce93dea-a7e7-4b6e-b250-13086b01f0da 2024-12-30 01:52:36,654 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=eb2ad6f7-de77-49cc-a606-a0cb3dcf5866 2024-12-30 01:52:36,662 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=dd857a4f-3abd-4de7-bbc4-0c76b6de41cf 2024-12-30 01:52:36,679 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=b77a5ad3-944f-42ee-bfcb-bf7ba1c07d37 2024-12-30 01:52:36,687 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=99adf395-cdcb-4e5f-94af-4acebfdaca7e 2024-12-30 01:52:36,694 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=1d5d069a-df58-487c-a01f-1a730b2c5fe3 2024-12-30 01:52:36,700 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=2d688fad-5daa-4e0d-b518-e81e8ebe7b7a 2024-12-30 01:52:36,706 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=83a03599-6c68-487a-81d8-41ba68696345 2024-12-30 01:52:41,720 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=fce93dea-a7e7-4b6e-b250-13086b01f0da 2024-12-30 01:52:41,726 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:3dc1fb7a-c650-11ef-b81a-02420bb50ca0 2024-12-30 01:52:41,752 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=83a03599-6c68-487a-81d8-41ba68696345 2024-12-30 01:52:41,753 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=2d688fad-5daa-4e0d-b518-e81e8ebe7b7a 2024-12-30 01:52:41,755 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=1d5d069a-df58-487c-a01f-1a730b2c5fe3 2024-12-30 01:52:41,756 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=99adf395-cdcb-4e5f-94af-4acebfdaca7e 2024-12-30 01:52:41,757 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=b77a5ad3-944f-42ee-bfcb-bf7ba1c07d37 2024-12-30 01:52:41,758 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=dd857a4f-3abd-4de7-bbc4-0c76b6de41cf 2024-12-30 01:52:41,759 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=eb2ad6f7-de77-49cc-a606-a0cb3dcf5866 2024-12-30 01:52:41,778 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:402101c2-c650-11ef-b81a-02420bb50ca0 2024-12-30 01:52:41,782 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:3f6af7ec-c650-11ef-b81a-02420bb50ca0 2024-12-30 01:52:41,783 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:3e75c34e-c650-11ef-b81a-02420bb50ca0 2024-12-30 01:52:46,782 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=dd857a4f-3abd-4de7-bbc4-0c76b6de41cf 2024-12-30 01:52:46,783 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=eb2ad6f7-de77-49cc-a606-a0cb3dcf5866 2024-12-30 01:52:46,784 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=83a03599-6c68-487a-81d8-41ba68696345 2024-12-30 01:52:46,786 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=b77a5ad3-944f-42ee-bfcb-bf7ba1c07d37 2024-12-30 01:52:51,806 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=eb2ad6f7-de77-49cc-a606-a0cb3dcf5866 2024-12-30 01:52:51,808 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=b77a5ad3-944f-42ee-bfcb-bf7ba1c07d37 2024-12-30 01:52:51,809 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=83a03599-6c68-487a-81d8-41ba68696345 2024-12-30 01:52:51,810 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=dd857a4f-3abd-4de7-bbc4-0c76b6de41cf 2024-12-30 01:52:56,822 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=eb2ad6f7-de77-49cc-a606-a0cb3dcf5866 2024-12-30 01:52:56,824 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=dd857a4f-3abd-4de7-bbc4-0c76b6de41cf 2024-12-30 01:52:56,826 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=83a03599-6c68-487a-81d8-41ba68696345 2024-12-30 01:52:56,827 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=b77a5ad3-944f-42ee-bfcb-bf7ba1c07d37 2024-12-30 01:53:01,842 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=83a03599-6c68-487a-81d8-41ba68696345 2024-12-30 01:53:01,843 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=b77a5ad3-944f-42ee-bfcb-bf7ba1c07d37 2024-12-30 01:53:01,845 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=eb2ad6f7-de77-49cc-a606-a0cb3dcf5866 2024-12-30 01:53:01,846 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=dd857a4f-3abd-4de7-bbc4-0c76b6de41cf 2024-12-30 01:53:06,858 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=83a03599-6c68-487a-81d8-41ba68696345 2024-12-30 01:53:06,861 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=b77a5ad3-944f-42ee-bfcb-bf7ba1c07d37 2024-12-30 01:53:06,863 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=dd857a4f-3abd-4de7-bbc4-0c76b6de41cf 2024-12-30 01:53:06,866 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=eb2ad6f7-de77-49cc-a606-a0cb3dcf5866 2024-12-30 01:53:11,873 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=83a03599-6c68-487a-81d8-41ba68696345 2024-12-30 01:53:11,880 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:4357b43a-c650-11ef-b81a-02420bb50ca0 2024-12-30 01:53:11,882 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=b77a5ad3-944f-42ee-bfcb-bf7ba1c07d37 2024-12-30 01:53:11,884 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=dd857a4f-3abd-4de7-bbc4-0c76b6de41cf 2024-12-30 01:53:11,885 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_VmListReq?uuid=eb2ad6f7-de77-49cc-a606-a0cb3dcf5866 2024-12-30 01:53:11,896 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:40ed0ace-c650-11ef-b81a-02420bb50ca0 2024-12-30 01:53:11,901 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:41b4485a-c650-11ef-b81a-02420bb50ca0 2024-12-30 01:53:11,903 - DEBUG - Requesting: http://10.0.0.41:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:42881388-c650-11ef-b81a-02420bb50ca0