2025-07-31 02:00:08,763 - DEBUG - [10.0.0.48]: Running cmd : hostname
2025-07-31 02:00:09,014 - DEBUG - Output : cn-jenkins-deploy-platform-k8s-manifests-232-1
2025-07-31 02:00:09,014 - DEBUG - [10.0.0.48]: Running cmd : hostname -f
2025-07-31 02:00:09,151 - DEBUG - Output : cn-jenkins-deploy-platform-k8s-manifests-232-1.cluster.local
2025-07-31 02:00:09,152 - DEBUG - [10.0.0.48]: Running cmd : docker ps 2>/dev/null | grep -v "/pause\|/usr/bin/pod\|nova_api_\|contrail.*init\|init.*contrail\|provisioner\|placement" | awk '{print $NF}'
2025-07-31 02:00:09,339 - DEBUG - Output : NAMES
contrail_test_UBSy8Dmj7
k8s_autoscaler_dns-autoscaler-595558c478-c5bkr_kube-system_3bfc350a-290c-44ad-8c68-c555b87d9dc9_0
k8s_coredns_coredns-77f7cc69db-8dd9d_kube-system_7f86b2c8-0cdf-461c-a01b-ed8b099ce7a8_0
k8s_opensdn-controller-config-nodemgr_opensdn-controller-config-4dk9q_kube-system_ecc93567-3edc-493b-a8cc-390432a33b8c_0
k8s_opensdn-controller-config-svcmonitor_opensdn-controller-config-4dk9q_kube-system_ecc93567-3edc-493b-a8cc-390432a33b8c_0
k8s_opensdn-controller-nodemgr_opensdn-controller-control-w2pd8_kube-system_dd3ddaa1-3f52-4bc4-ac17-c6c9fa8d251f_0
k8s_opensdn-controller-control-named_opensdn-controller-control-w2pd8_kube-system_dd3ddaa1-3f52-4bc4-ac17-c6c9fa8d251f_0
k8s_opensdn-controller-config-schema_opensdn-controller-config-4dk9q_kube-system_ecc93567-3edc-493b-a8cc-390432a33b8c_0
k8s_opensdn-analytics-query-engine_opensdn-analyticsdb-bx5fc_kube-system_7fbc9e5d-22f7-45d0-8e45-0b9ecce8852f_0
k8s_opensdn-analytics-snmp-nodemgr_opensdn-analytics-snmp-8d5vh_kube-system_74791af1-bbfd-466d-8286-1ae4b73a4a5e_0
k8s_opensdn-analytics-snmp-topology_opensdn-analytics-snmp-8d5vh_kube-system_74791af1-bbfd-466d-8286-1ae4b73a4a5e_0
k8s_opensdn-controller-control-dns_opensdn-controller-control-w2pd8_kube-system_dd3ddaa1-3f52-4bc4-ac17-c6c9fa8d251f_0
k8s_opensdn-analytics-alarm-nodemgr_opensdn-analytics-alarm-jwhq8_kube-system_65c1d79e-8ea6-4c3a-9a93-3095ee9bdde2_0
k8s_opensdn-analytics-alarm-gen_opensdn-analytics-alarm-jwhq8_kube-system_65c1d79e-8ea6-4c3a-9a93-3095ee9bdde2_0
k8s_opensdn-analytics-nodemgr_opensdn-analytics-rmnfb_kube-system_a4d4cbf6-49af-4787-88df-952c8decc626_0
k8s_opensdn-analytics-collector_opensdn-analytics-rmnfb_kube-system_a4d4cbf6-49af-4787-88df-952c8decc626_0
k8s_opensdn-controller-config-devicemgr_opensdn-controller-config-4dk9q_kube-system_ecc93567-3edc-493b-a8cc-390432a33b8c_0
k8s_opensdn-analyticsdb_opensdn-analyticsdb-bx5fc_kube-system_7fbc9e5d-22f7-45d0-8e45-0b9ecce8852f_0
k8s_opensdn-controller-webui-web_opensdn-controller-webui-629th_kube-system_424c07b0-de18-4c39-a29c-22d96214f6ea_0
k8s_opensdn-analytics-snmp-collector_opensdn-analytics-snmp-8d5vh_kube-system_74791af1-bbfd-466d-8286-1ae4b73a4a5e_0
k8s_opensdn-controller-control_opensdn-controller-control-w2pd8_kube-system_dd3ddaa1-3f52-4bc4-ac17-c6c9fa8d251f_0
k8s_kafka_opensdn-analytics-alarm-jwhq8_kube-system_65c1d79e-8ea6-4c3a-9a93-3095ee9bdde2_0
k8s_opensdn-analytics-api_opensdn-analytics-rmnfb_kube-system_a4d4cbf6-49af-4787-88df-952c8decc626_0
k8s_opensdn-controller-config-api_opensdn-controller-config-4dk9q_kube-system_ecc93567-3edc-493b-a8cc-390432a33b8c_0
k8s_opensdn-analyticsdb-nodemgr_opensdn-analyticsdb-bx5fc_kube-system_7fbc9e5d-22f7-45d0-8e45-0b9ecce8852f_0
k8s_opensdn-controller-webui-job_opensdn-controller-webui-629th_kube-system_424c07b0-de18-4c39-a29c-22d96214f6ea_0
k8s_config-zookeeper_config-zookeeper-jmgds_kube-system_d01aeb9b-e698-4179-bcff-1fb85ba420dd_0
k8s_rabbitmq_rabbitmq-h6vd5_kube-system_2441498b-82ec-49bf-aad7-4c622deaadac_0
k8s_opensdn-config-database-nodemgr_opensdn-configdb-dtggp_kube-system_6bd1d379-7397-4542-bcd1-7a13d9beeb3f_0
k8s_opensdn-configdb_opensdn-configdb-dtggp_kube-system_6bd1d379-7397-4542-bcd1-7a13d9beeb3f_0
k8s_opensdn-agent-nodemgr_opensdn-agent-7dlvk_kube-system_65d68676-be83-4129-ba18-72207b493ea2_0
k8s_redis_redis-df792_kube-system_ac604505-5f42-46cd-8a02-dfc106b3e783_0
k8s_opensdn-vrouter-agent_opensdn-agent-7dlvk_kube-system_65d68676-be83-4129-ba18-72207b493ea2_0
k8s_opensdn-kube-manager_opensdn-kube-manager-q8ksm_kube-system_9b7f0c23-9102-409d-aec5-d8f447b2587f_0
k8s_kube-proxy_kube-proxy-zc9hp_kube-system_694394e2-cd2d-41b5-a433-aff4becd7a02_0
k8s_kube-controller-manager_kube-controller-manager-cn-jenkins-deploy-platform-k8s-manifests-232-1_kube-system_cc889a2347adcae3384b0629843ee919_1
k8s_kube-scheduler_kube-scheduler-cn-jenkins-deploy-platform-k8s-manifests-232-1_kube-system_093e0836dfa20857043ba02605d90ebf_1
k8s_kube-apiserver_kube-apiserver-cn-jenkins-deploy-platform-k8s-manifests-232-1_kube-system_bbb3e4e2227350aa2b656f197e4634db_0
2025-07-31 02:00:09,340 - DEBUG - [10.0.0.48]: Running cmd : ip addr show | grep 'inet .*/.* brd ' | awk '{print $2}'
2025-07-31 02:00:09,465 - DEBUG - Output : 172.17.0.1/16
10.0.0.48/24
2025-07-31 02:00:09,465 - DEBUG - [10.0.0.48]: Running cmd : getent hosts 10.0.0.48 | head -n 1 | awk '{print $2}'
2025-07-31 02:00:09,598 - DEBUG - Output : cn-jenkins-deploy-platform-k8s-manifests-232-1.cluster.local
2025-07-31 02:00:09,598 - DEBUG - [10.0.0.48]: Running cmd : ip addr show dev vhost0 | grep 'inet .*/.* brd ' | awk '{print $2}'
2025-07-31 02:00:09,711 - DEBUG - Output : 10.0.0.48/24
2025-07-31 02:00:10,112 - INFO - Using existing project ['default-domain', 'k8s-default'](7ee4f5b4-61d6-4ba5-9200-a1925e8d7146)
2025-07-31 02:00:10,281 - INFO - Using existing project ['default-domain', 'k8s-default'](7ee4f5b4-61d6-4ba5-9200-a1925e8d7146)
2025-07-31 02:00:10,479 - INFO - ================================================================================
2025-07-31 02:00:10,480 - INFO - STARTING TEST : test_ingress_ip_assignment
2025-07-31 02:00:10,481 - INFO - TEST DESCRIPTION :
Verify that Ingress gets a CLuster IP which is reachable to Pods in same
namespace. Also verify that a Floating IP is assigned to the Ingress
from the Public FIP poo.
Steps:
1. Create a service with 2 pods running nginx
2. Create an ingress out of this service
3. From another Pod do a wget on the ingress Cluster ip
Validate that Ingress get a IP from Public FIP pool which might/might not be accessible.
Validate that service and its loadbalancing work
2025-07-31 02:00:10,791 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-31 02:00:10,798 - DEBUG - Nothing to compare xmpp stats {'10.0.0.48': {'10.0.0.48': '2'}} with
2025-07-31 02:00:10,798 - INFO - Initial checks done. Running the testcase now
2025-07-31 02:00:10,798 - INFO -
2025-07-31 02:00:10,803 - INFO - Namespace default already exists
2025-07-31 02:00:10,803 - DEBUG - [10.0.0.48]: Running cmd : docker exec --privileged -it k8s_opensdn-kube-manager_opensdn-kube-manager-q8ksm_kube-system_9b7f0c23-9102-409d-aec5-d8f447b2587f_0 /bin/bash -c 'grep "^[ ]*cluster_project" /etc/contrail/contrail-kubernetes.conf'
2025-07-31 02:00:10,973 - DEBUG - Output : cluster_project={}
2025-07-31 02:00:11,047 - INFO - Project default-domain:k8s-default for Namespace default is seen in contrail-api
2025-07-31 02:00:11,047 - DEBUG - Project uuid in Contrail is 7ee4f5b4-61d6-4ba5-9200-a1925e8d7146
2025-07-31 02:00:11,048 - DEBUG - [10.0.0.48]: Running cmd : docker exec --privileged -it k8s_opensdn-kube-manager_opensdn-kube-manager-q8ksm_kube-system_9b7f0c23-9102-409d-aec5-d8f447b2587f_0 /bin/bash -c 'netstat -antp | grep :8108 | grep LISTEN'
2025-07-31 02:00:11,207 - DEBUG - Output : tcp 0 0 0.0.0.0:8108 0.0.0.0:* LISTEN 1/python3
2025-07-31 02:00:11,207 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NamespaceDatabaseList?namespace_uuid=95245f88-ae28-4d55-8bca-826180a280fc
2025-07-31 02:00:11,213 - INFO - Namespace default with uuid 95245f88-ae28-4d55-8bca-826180a280fc found in kube manager
2025-07-31 02:00:11,213 - INFO - Namespace default verification passed
2025-07-31 02:00:11,217 - DEBUG - Service ctest-nginx-svc-71953627 not present
2025-07-31 02:00:11,218 - INFO - Creating service ctest-nginx-svc-71953627
2025-07-31 02:00:11,231 - INFO - Created Service ctest-nginx-svc-71953627
2025-07-31 02:00:11,240 - DEBUG - Pod ctest-nginx-pod-50633076 not present
2025-07-31 02:00:11,240 - INFO - Creating Pod ctest-nginx-pod-50633076
2025-07-31 02:00:11,264 - DEBUG - Pod : ctest-nginx-pod-50633076 UUID is 7a57af97-273c-4e9a-802e-d05a5b6a3893
2025-07-31 02:00:11,271 - DEBUG - Pod ctest-nginx-pod-26103685 not present
2025-07-31 02:00:11,271 - INFO - Creating Pod ctest-nginx-pod-26103685
2025-07-31 02:00:11,298 - DEBUG - Pod : ctest-nginx-pod-26103685 UUID is aaefdc7a-05e5-4f7d-9090-3cd2e1fb22a9
2025-07-31 02:00:11,553 - INFO - Created VN __public__, UUID :55380d33-589f-406e-886e-28226d8ee7ee
2025-07-31 02:00:11,894 - DEBUG - Requesting: http://10.0.0.48:8082/domains
2025-07-31 02:00:11,901 - DEBUG - Requesting: http://10.0.0.48:8082/domain/b8a8ba5d-fdb1-49c2-bb6d-baf421bd9a06
2025-07-31 02:00:11,953 - DEBUG - Requesting: http://10.0.0.48:8082/project/7ee4f5b4-61d6-4ba5-9200-a1925e8d7146
2025-07-31 02:00:12,007 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/55380d33-589f-406e-886e-28226d8ee7ee
2025-07-31 02:00:12,017 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/55380d33-589f-406e-886e-28226d8ee7ee
2025-07-31 02:00:12,026 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/b94e652b-4f40-4851-a0da-36ed2e7b6cd5
2025-07-31 02:00:12,033 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/b94e652b-4f40-4851-a0da-36ed2e7b6cd5
2025-07-31 02:00:12,038 - DEBUG - Requesting: http://10.0.0.48:8082/route-target/3844857e-2dfe-456d-8b08-19c523a67083
2025-07-31 02:00:12,044 - DEBUG - Route Targets: ['target:64512:8000007']
2025-07-31 02:00:12,044 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/55380d33-589f-406e-886e-28226d8ee7ee
2025-07-31 02:00:12,053 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/b94e652b-4f40-4851-a0da-36ed2e7b6cd5
2025-07-31 02:00:12,072 - INFO - Verified VN network id 12 for VN 55380d33-589f-406e-886e-28226d8ee7ee
2025-07-31 02:00:12,072 - INFO - Verifications in API Server for VN __public__ passed
2025-07-31 02:00:12,072 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/55380d33-589f-406e-886e-28226d8ee7ee
2025-07-31 02:00:12,080 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/b94e652b-4f40-4851-a0da-36ed2e7b6cd5
2025-07-31 02:00:12,089 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/b94e652b-4f40-4851-a0da-36ed2e7b6cd5
2025-07-31 02:00:12,099 - DEBUG - Requesting: http://10.0.0.48:8082/route-target/3844857e-2dfe-456d-8b08-19c523a67083
2025-07-31 02:00:12,113 - DEBUG - Requesting: http://10.0.0.48:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:k8s-default:__public__
2025-07-31 02:00:12,123 - DEBUG - Control-node 10.0.0.48 : VN object is : {'node_name': 'virtual-network:default-domain:k8s-default:__public__', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'cloud-admin', 'owner-access': '7', 'group': 'cloud-admin-group', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6140672606100996206', 'uuid-lslong': '9830839164928452590'}, 'enable': 'true', 'created': '2025-07-31T02:00:11', 'last-modified': '2025-07-31T02:00:11', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.353511'}
2025-07-31 02:00:12,123 - DEBUG - Requesting: http://10.0.0.48:8083/Snh_ShowRoutingInstanceReq?name=default-domain:k8s-default:__public__:__public__
2025-07-31 02:00:12,132 - DEBUG - Route Targets: ['target:64512:8000007']
2025-07-31 02:00:12,132 - INFO - On all control nodes, Config, RI and RT verification for VN __public__ passed
2025-07-31 02:00:12,133 - DEBUG - ====Verifying policy data for __public__ in API_Server ======
2025-07-31 02:00:12,133 - DEBUG - Requesting: http://10.0.0.48:8082/domains
2025-07-31 02:00:12,138 - DEBUG - Requesting: http://10.0.0.48:8082/domain/b8a8ba5d-fdb1-49c2-bb6d-baf421bd9a06
2025-07-31 02:00:12,146 - DEBUG - Requesting: http://10.0.0.48:8082/project/7ee4f5b4-61d6-4ba5-9200-a1925e8d7146
2025-07-31 02:00:12,183 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/55380d33-589f-406e-886e-28226d8ee7ee
2025-07-31 02:00:12,208 - DEBUG - =>VN __public__ has no policy to be verified
2025-07-31 02:00:12,208 - DEBUG - Verifying the vn in opserver
2025-07-31 02:00:12,208 - DEBUG - Verifying the default-domain:k8s-default:__public__ virtual network link through opserver 10.0.0.48
2025-07-31 02:00:12,208 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-networks
2025-07-31 02:00:12,217 - DEBUG - vn link and name as {'name': 'default-domain:k8s-default:__public__', 'href': 'http://10.0.0.48:8081/analytics/uves/virtual-network/default-domain:k8s-default:__public__?flat'}
2025-07-31 02:00:12,217 - INFO - Validated that VN default-domain:k8s-default:__public__ is found in opserver
2025-07-31 02:00:12,217 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__
2025-07-31 02:00:12,224 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__
2025-07-31 02:00:12,231 - DEBUG - Do not have enough data to verify VN in agent
2025-07-31 02:00:12,231 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__
2025-07-31 02:00:12,237 - DEBUG - VRF ids for VN __public__: {}
2025-07-31 02:00:12,452 - INFO - Creating Floating IP pool __fip_pool_public__ in API Server
2025-07-31 02:00:12,852 - DEBUG - Requesting: http://10.0.0.48:8082/domains
2025-07-31 02:00:12,865 - DEBUG - Requesting: http://10.0.0.48:8082/domain/b8a8ba5d-fdb1-49c2-bb6d-baf421bd9a06
2025-07-31 02:00:12,877 - DEBUG - Requesting: http://10.0.0.48:8082/project/7ee4f5b4-61d6-4ba5-9200-a1925e8d7146
2025-07-31 02:00:12,937 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/55380d33-589f-406e-886e-28226d8ee7ee
2025-07-31 02:00:12,982 - DEBUG - Requesting: http://10.0.0.48:8082/floating-ip-pool/b47615ce-a667-482a-aaed-8140d777a5f9
2025-07-31 02:00:12,990 - DEBUG - Requesting: http://10.0.0.48:8082/domains
2025-07-31 02:00:12,995 - DEBUG - Requesting: http://10.0.0.48:8082/domain/b8a8ba5d-fdb1-49c2-bb6d-baf421bd9a06
2025-07-31 02:00:13,003 - DEBUG - Requesting: http://10.0.0.48:8082/project/7ee4f5b4-61d6-4ba5-9200-a1925e8d7146
2025-07-31 02:00:13,042 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/55380d33-589f-406e-886e-28226d8ee7ee
2025-07-31 02:00:13,056 - DEBUG - FIP Pool __fip_pool_public__ found in API Server
2025-07-31 02:00:13,056 - INFO - Verification for FIP pool __fip_pool_public__ in API Server passed
2025-07-31 02:00:13,070 - DEBUG - Requesting: http://10.0.0.48:8083/Snh_IFMapTableShowReq?table_name=floating-ip-pool&search_string=floating-ip-pool:default-domain:k8s-default:__public__:__fip_pool_public__
2025-07-31 02:00:13,091 - DEBUG - Control-node Ifmap-view has FIP pool __fip_pool_public__ information
2025-07-31 02:00:13,092 - INFO - Verification for FIP pool __fip_pool_public__ in Control-node passed
2025-07-31 02:00:13,096 - DEBUG - Ingress ctest-nginx-ingress-73632090 not present
2025-07-31 02:00:13,097 - INFO - Creating Ingress ctest-nginx-ingress-73632090
2025-07-31 02:00:13,105 - INFO - Created Ingress ctest-nginx-ingress-73632090
2025-07-31 02:00:13,110 - DEBUG - Cluster IP not yet seen for Ingress ctest-nginx-ingress-73632090
2025-07-31 02:00:16,116 - DEBUG - Cluster IP not yet seen for Ingress ctest-nginx-ingress-73632090
2025-07-31 02:00:19,122 - DEBUG - For Ingress ctest-nginx-ingress-73632090, Cluster IP: 10.47.255.248, External IPs ['197.119.244.252']
2025-07-31 02:00:19,122 - INFO - Verifications in k8s passed for Ingress ctest-nginx-ingress-73632090
2025-07-31 02:00:19,122 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_LoadbalancerDatabaseList?x=7314c48a-b2f6-465e-b934-9e582af9697f
2025-07-31 02:00:19,127 - INFO - Ingress ctest-nginx-ingress-73632090 with uuid 7314c48a-b2f6-465e-b934-9e582af9697f found in kube manager
2025-07-31 02:00:19,128 - INFO - Ingress ctest-nginx-ingress-73632090 verification passed
2025-07-31 02:00:19,132 - DEBUG - Pod ctest-busybox-pod-47448662 not present
2025-07-31 02:00:19,133 - INFO - Creating Pod ctest-busybox-pod-47448662
2025-07-31 02:00:19,171 - DEBUG - Pod : ctest-busybox-pod-47448662 UUID is 8a17f619-3f53-4fa0-b4bd-a32c3f536771
2025-07-31 02:00:19,191 - DEBUG - Pod ctest-nginx-pod-50633076 not in running state.Currently in Pending
2025-07-31 02:00:24,199 - DEBUG - Pod ctest-nginx-pod-50633076 not in running state.Currently in Pending
2025-07-31 02:00:29,206 - DEBUG - Pod ctest-nginx-pod-50633076 not in running state.Currently in Pending
2025-07-31 02:00:34,213 - INFO - Pod ctest-nginx-pod-50633076 is in running state.Got IP 10.47.255.250
2025-07-31 02:00:34,271 - DEBUG - Pod ctest-nginx-pod-50633076 has vmi 1922623c-6db2-11f0-95fa-024268e783be
2025-07-31 02:00:34,271 - INFO - Verified pod ctest-nginx-pod-50633076 in contrail-api
2025-07-31 02:00:34,272 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-07-31 02:00:34,285 - DEBUG - VMI 1922623c-6db2-11f0-95fa-024268e783be is active in agent 10.0.0.48
2025-07-31 02:00:34,285 - INFO - Verified Pod ctest-nginx-pod-50633076 in agent 10.0.0.48
2025-07-31 02:00:34,285 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=7a57af97-273c-4e9a-802e-d05a5b6a3893
2025-07-31 02:00:34,290 - INFO - Pod ctest-nginx-pod-50633076 with uuid 7a57af97-273c-4e9a-802e-d05a5b6a3893 found in kube manager
2025-07-31 02:00:34,290 - INFO - Pod ctest-nginx-pod-50633076 verification passed
2025-07-31 02:00:34,387 - DEBUG - [Pod ctest-nginx-pod-50633076] Cmd: echo ctest-nginx-pod-50633076 > /usr/share/nginx/html/index.html, Output:
2025-07-31 02:00:34,394 - INFO - Pod ctest-nginx-pod-26103685 is in running state.Got IP 10.47.255.249
2025-07-31 02:00:34,449 - DEBUG - Pod ctest-nginx-pod-26103685 has vmi 19d7c276-6db2-11f0-95fa-024268e783be
2025-07-31 02:00:34,449 - INFO - Verified pod ctest-nginx-pod-26103685 in contrail-api
2025-07-31 02:00:34,450 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-07-31 02:00:34,462 - DEBUG - VMI 19d7c276-6db2-11f0-95fa-024268e783be is active in agent 10.0.0.48
2025-07-31 02:00:34,462 - INFO - Verified Pod ctest-nginx-pod-26103685 in agent 10.0.0.48
2025-07-31 02:00:34,463 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=aaefdc7a-05e5-4f7d-9090-3cd2e1fb22a9
2025-07-31 02:00:34,468 - INFO - Pod ctest-nginx-pod-26103685 with uuid aaefdc7a-05e5-4f7d-9090-3cd2e1fb22a9 found in kube manager
2025-07-31 02:00:34,468 - INFO - Pod ctest-nginx-pod-26103685 verification passed
2025-07-31 02:00:34,561 - DEBUG - [Pod ctest-nginx-pod-26103685] Cmd: echo ctest-nginx-pod-26103685 > /usr/share/nginx/html/index.html, Output:
2025-07-31 02:00:34,568 - INFO - Pod ctest-busybox-pod-47448662 is in running state.Got IP 10.47.255.247
2025-07-31 02:00:34,621 - DEBUG - Pod ctest-busybox-pod-47448662 has vmi 1d8e13a2-6db2-11f0-95fa-024268e783be
2025-07-31 02:00:34,621 - INFO - Verified pod ctest-busybox-pod-47448662 in contrail-api
2025-07-31 02:00:34,622 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-07-31 02:00:34,634 - DEBUG - VMI 1d8e13a2-6db2-11f0-95fa-024268e783be is active in agent 10.0.0.48
2025-07-31 02:00:34,634 - INFO - Verified Pod ctest-busybox-pod-47448662 in agent 10.0.0.48
2025-07-31 02:00:34,634 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=8a17f619-3f53-4fa0-b4bd-a32c3f536771
2025-07-31 02:00:34,639 - INFO - Pod ctest-busybox-pod-47448662 with uuid 8a17f619-3f53-4fa0-b4bd-a32c3f536771 found in kube manager
2025-07-31 02:00:34,639 - INFO - Pod ctest-busybox-pod-47448662 verification passed
2025-07-31 02:00:34,734 - DEBUG - [Pod ctest-busybox-pod-47448662] Cmd: wget http://10.47.255.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.47.255.248:80 (10.47.255.248:80)
ctest-nginx-pod-50633076
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
2025-07-31 02:00:34,734 - DEBUG - [Pod Pod ctest-busybox-pod-47448662] Cmd wget http://10.47.255.248:80/ -O - -T 5 -t 1 passed
2025-07-31 02:00:34,734 - DEBUG - [Pod Pod ctest-busybox-pod-47448662] Cmd output: Connecting to 10.47.255.248:80 (10.47.255.248:80)
ctest-nginx-pod-50633076
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
2025-07-31 02:00:34,818 - DEBUG - [Pod ctest-busybox-pod-47448662] Cmd: wget http://10.47.255.248:80/ -O - -T 5 -t 1 , Output: ctest-nginx-pod-50633076
Connecting to 10.47.255.248:80 (10.47.255.248:80)
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
2025-07-31 02:00:34,819 - DEBUG - [Pod Pod ctest-busybox-pod-47448662] Cmd wget http://10.47.255.248:80/ -O - -T 5 -t 1 passed
2025-07-31 02:00:34,819 - DEBUG - [Pod Pod ctest-busybox-pod-47448662] Cmd output: ctest-nginx-pod-50633076
Connecting to 10.47.255.248:80 (10.47.255.248:80)
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
2025-07-31 02:00:34,901 - DEBUG - [Pod ctest-busybox-pod-47448662] Cmd: wget http://10.47.255.248:80/ -O - -T 5 -t 1 , Output: ctest-nginx-pod-50633076
Connecting to 10.47.255.248:80 (10.47.255.248:80)
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
2025-07-31 02:00:34,901 - DEBUG - [Pod Pod ctest-busybox-pod-47448662] Cmd wget http://10.47.255.248:80/ -O - -T 5 -t 1 passed
2025-07-31 02:00:34,901 - DEBUG - [Pod Pod ctest-busybox-pod-47448662] Cmd output: ctest-nginx-pod-50633076
Connecting to 10.47.255.248:80 (10.47.255.248:80)
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
2025-07-31 02:00:34,995 - DEBUG - [Pod ctest-busybox-pod-47448662] Cmd: wget http://10.47.255.248:80/ -O - -T 5 -t 1 , Output: Connecting to 10.47.255.248:80 (10.47.255.248:80)
ctest-nginx-pod-26103685
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
2025-07-31 02:00:34,996 - DEBUG - [Pod Pod ctest-busybox-pod-47448662] Cmd wget http://10.47.255.248:80/ -O - -T 5 -t 1 passed
2025-07-31 02:00:34,996 - DEBUG - [Pod Pod ctest-busybox-pod-47448662] Cmd output: Connecting to 10.47.255.248:80 (10.47.255.248:80)
ctest-nginx-pod-26103685
writing to stdout
- 100% |********************************| 25 0:00:00 ETA
written to stdout
2025-07-31 02:00:34,996 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-nginx-pod-50633076': 3, 'ctest-nginx-pod-26103685': 1}
2025-07-31 02:00:34,996 - WARNING - Nothing to delete parallely
2025-07-31 02:00:34,996 - INFO - Deleting pod default:ctest-busybox-pod-47448662
2025-07-31 02:00:35,014 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=8a17f619-3f53-4fa0-b4bd-a32c3f536771
2025-07-31 02:00:35,026 - WARNING - Pod uuid 8a17f619-3f53-4fa0-b4bd-a32c3f536771 is still seen in agent 10.0.0.48 VM list
2025-07-31 02:00:40,027 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=8a17f619-3f53-4fa0-b4bd-a32c3f536771
2025-07-31 02:00:40,034 - WARNING - Pod uuid 8a17f619-3f53-4fa0-b4bd-a32c3f536771 is still seen in agent 10.0.0.48 VM list
2025-07-31 02:00:45,035 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=8a17f619-3f53-4fa0-b4bd-a32c3f536771
2025-07-31 02:00:45,041 - WARNING - Pod uuid 8a17f619-3f53-4fa0-b4bd-a32c3f536771 is still seen in agent 10.0.0.48 VM list
2025-07-31 02:00:50,042 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=8a17f619-3f53-4fa0-b4bd-a32c3f536771
2025-07-31 02:00:50,050 - WARNING - Pod uuid 8a17f619-3f53-4fa0-b4bd-a32c3f536771 is still seen in agent 10.0.0.48 VM list
2025-07-31 02:00:55,051 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=8a17f619-3f53-4fa0-b4bd-a32c3f536771
2025-07-31 02:00:55,059 - WARNING - Pod uuid 8a17f619-3f53-4fa0-b4bd-a32c3f536771 is still seen in agent 10.0.0.48 VM list
2025-07-31 02:01:00,060 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=8a17f619-3f53-4fa0-b4bd-a32c3f536771
2025-07-31 02:01:00,068 - WARNING - Pod uuid 8a17f619-3f53-4fa0-b4bd-a32c3f536771 is still seen in agent 10.0.0.48 VM list
2025-07-31 02:01:05,069 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=8a17f619-3f53-4fa0-b4bd-a32c3f536771
2025-07-31 02:01:05,077 - WARNING - Pod uuid 8a17f619-3f53-4fa0-b4bd-a32c3f536771 is still seen in agent 10.0.0.48 VM list
2025-07-31 02:01:10,078 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=8a17f619-3f53-4fa0-b4bd-a32c3f536771
2025-07-31 02:01:10,086 - DEBUG - Pod 8a17f619-3f53-4fa0-b4bd-a32c3f536771 is not in agent 10.0.0.48 VM list
2025-07-31 02:01:10,086 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:1d8e13a2-6db2-11f0-95fa-024268e783be
2025-07-31 02:01:10,092 - DEBUG - VMI 1d8e13a2-6db2-11f0-95fa-024268e783be is removed from agent 10.0.0.48
2025-07-31 02:01:10,092 - INFO - Verified that pod ctest-busybox-pod-47448662 is removed in agent
2025-07-31 02:01:10,092 - INFO - Deleting Ingress : ctest-nginx-ingress-73632090
2025-07-31 02:01:10,099 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_LoadbalancerDatabaseList?x=7314c48a-b2f6-465e-b934-9e582af9697f
2025-07-31 02:01:10,104 - ERROR - Ingress ctest-nginx-ingress-73632090 with uuid 7314c48a-b2f6-465e-b934-9e582af9697f still found in kube manager
2025-07-31 02:01:11,105 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_LoadbalancerDatabaseList?x=7314c48a-b2f6-465e-b934-9e582af9697f
2025-07-31 02:01:11,117 - ERROR - Ingress ctest-nginx-ingress-73632090 with uuid 7314c48a-b2f6-465e-b934-9e582af9697f still found in kube manager
2025-07-31 02:01:12,118 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_LoadbalancerDatabaseList?x=7314c48a-b2f6-465e-b934-9e582af9697f
2025-07-31 02:01:12,122 - INFO - Ingress ctest-nginx-ingress-73632090 with uuid 7314c48a-b2f6-465e-b934-9e582af9697f deleted successfully from kube manager
2025-07-31 02:01:12,123 - INFO - Verifications on Ingress %s cleanup passed
2025-07-31 02:01:12,123 - INFO - Deleting the FIP pool __fip_pool_public__
2025-07-31 02:01:12,233 - DEBUG - Requesting: http://10.0.0.48:8083/Snh_IFMapTableShowReq?table_name=floating-ip-pool&search_string=floating-ip-pool:default-domain:k8s-default:__public__:__fip_pool_public__
2025-07-31 02:01:12,240 - DEBUG - Control-node Ifmap-view does not have FIP pool __fip_pool_public__ information
2025-07-31 02:01:12,240 - INFO - Deleting VN __public__
2025-07-31 02:01:12,363 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/b94e652b-4f40-4851-a0da-36ed2e7b6cd5
2025-07-31 02:01:12,368 - DEBUG - Response Code: 404
2025-07-31 02:01:12,368 - DEBUG - Requesting: http://10.0.0.48:8082/domains
2025-07-31 02:01:12,382 - DEBUG - Requesting: http://10.0.0.48:8082/domain/b8a8ba5d-fdb1-49c2-bb6d-baf421bd9a06
2025-07-31 02:01:12,391 - DEBUG - Requesting: http://10.0.0.48:8082/project/7ee4f5b4-61d6-4ba5-9200-a1925e8d7146
2025-07-31 02:01:12,434 - INFO - Validated that VN __public__ is not found in API Server
2025-07-31 02:01:12,435 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VnListReq?name=default-domain:k8s-default:__public__
2025-07-31 02:01:12,440 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__
2025-07-31 02:01:12,447 - DEBUG - VN __public__ is not present in Agent 10.0.0.48
2025-07-31 02:01:12,447 - INFO - Validated that VN __public__ is not in any agent
2025-07-31 02:01:12,447 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VrfListReq?name=default-domain:k8s-default:__public__:__public__
2025-07-31 02:01:12,454 - DEBUG - Requesting: http://10.0.0.48:8083/Snh_ShowRoutingInstanceReq?name=default-domain:k8s-default:__public__:__public__
2025-07-31 02:01:12,460 - DEBUG - Requesting: http://10.0.0.48:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:k8s-default:__public__
2025-07-31 02:01:12,466 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN __public__ info
2025-07-31 02:01:12,467 - INFO - Deleting pod default:ctest-nginx-pod-26103685
2025-07-31 02:01:12,479 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=aaefdc7a-05e5-4f7d-9090-3cd2e1fb22a9
2025-07-31 02:01:12,494 - WARNING - Pod uuid aaefdc7a-05e5-4f7d-9090-3cd2e1fb22a9 is still seen in agent 10.0.0.48 VM list
2025-07-31 02:01:17,494 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=aaefdc7a-05e5-4f7d-9090-3cd2e1fb22a9
2025-07-31 02:01:17,501 - DEBUG - Pod aaefdc7a-05e5-4f7d-9090-3cd2e1fb22a9 is not in agent 10.0.0.48 VM list
2025-07-31 02:01:17,501 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:19d7c276-6db2-11f0-95fa-024268e783be
2025-07-31 02:01:17,508 - DEBUG - VMI 19d7c276-6db2-11f0-95fa-024268e783be is removed from agent 10.0.0.48
2025-07-31 02:01:17,508 - INFO - Verified that pod ctest-nginx-pod-26103685 is removed in agent
2025-07-31 02:01:17,509 - INFO - Deleting pod default:ctest-nginx-pod-50633076
2025-07-31 02:01:17,522 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=7a57af97-273c-4e9a-802e-d05a5b6a3893
2025-07-31 02:01:17,535 - WARNING - Pod uuid 7a57af97-273c-4e9a-802e-d05a5b6a3893 is still seen in agent 10.0.0.48 VM list
2025-07-31 02:01:22,536 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=7a57af97-273c-4e9a-802e-d05a5b6a3893
2025-07-31 02:01:22,543 - DEBUG - Pod 7a57af97-273c-4e9a-802e-d05a5b6a3893 is not in agent 10.0.0.48 VM list
2025-07-31 02:01:22,543 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:1922623c-6db2-11f0-95fa-024268e783be
2025-07-31 02:01:22,548 - DEBUG - VMI 1922623c-6db2-11f0-95fa-024268e783be is removed from agent 10.0.0.48
2025-07-31 02:01:22,548 - INFO - Verified that pod ctest-nginx-pod-50633076 is removed in agent
2025-07-31 02:01:22,548 - INFO - Deleting service : ctest-nginx-svc-71953627
2025-07-31 02:01:23,127 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-31 02:01:23,134 - DEBUG - No XMPP flaps were noticed during the test
2025-07-31 02:01:23,134 - INFO - END TEST : test_ingress_ip_assignment : PASSED[0:01:13]
2025-07-31 02:01:23,134 - INFO - --------------------------------------------------------------------------------
2025-07-31 02:01:29,605 - DEBUG - [10.0.0.48]: Running cmd : docker exec --privileged -it k8s_opensdn-kube-manager_opensdn-kube-manager-q8ksm_kube-system_9b7f0c23-9102-409d-aec5-d8f447b2587f_0 /bin/bash -c 'grep "^[ ]*cluster_project" /etc/contrail/contrail-kubernetes.conf'
2025-07-31 02:01:29,896 - DEBUG - Output : cluster_project={}
2025-07-31 02:01:29,982 - DEBUG - [10.0.0.48]: Running cmd : docker exec --privileged -it k8s_opensdn-kube-manager_opensdn-kube-manager-q8ksm_kube-system_9b7f0c23-9102-409d-aec5-d8f447b2587f_0 /bin/bash -c 'netstat -antp | grep :8108 | grep LISTEN'
2025-07-31 02:01:30,172 - DEBUG - Output : tcp 0 0 0.0.0.0:8108 0.0.0.0:* LISTEN 1/python3
2025-07-31 02:01:30,179 - DEBUG - [10.0.0.48]: Running cmd : docker exec --privileged -it k8s_opensdn-kube-manager_opensdn-kube-manager-q8ksm_kube-system_9b7f0c23-9102-409d-aec5-d8f447b2587f_0 /bin/bash -c 'grep "^[ ]*cluster_project" /etc/contrail/contrail-kubernetes.conf'
2025-07-31 02:01:30,403 - DEBUG - Output : cluster_project={}
2025-07-31 02:01:45,575 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-07-31 02:01:45,700 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-07-31 02:01:50,799 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-07-31 02:01:50,927 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-07-31 02:01:51,045 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-07-31 02:01:56,130 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-07-31 02:01:56,258 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-07-31 02:01:56,384 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,
2025-07-31 02:01:56,686 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-31 02:01:59,983 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_ApplicationPolicySetReq?
2025-07-31 02:01:59,992 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_AclReq?
2025-07-31 02:02:00,029 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_AclReq?
2025-07-31 02:02:02,059 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_AclReq?
2025-07-31 02:02:04,092 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_AclReq?
2025-07-31 02:05:06,669 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_AgentXmppConnectionStatusReq?
2025-07-31 02:05:06,723 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=858694e3-c0be-4756-bb73-64d9961cddbd
2025-07-31 02:05:06,727 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=6c599865-cb9a-4ac6-8c35-00f36a5b4ed6
2025-07-31 02:05:06,738 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=22a8b2ed-9d07-44d2-bf64-fc14f3eb5b38
2025-07-31 02:05:06,744 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=efa6b6b5-c9f8-4eac-a4fa-4d25baea76c6
2025-07-31 02:05:06,749 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=6768392b-b0a2-4822-b948-90c7b9f1c917
2025-07-31 02:05:06,757 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=a8d6aa72-4537-4c0f-9b79-c80962e7bdbf
2025-07-31 02:05:06,764 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=b230f638-25bf-4e68-9b78-cb21d625c99c
2025-07-31 02:05:06,772 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=b0b52239-9f8f-4153-9c80-c809925cc009
2025-07-31 02:05:11,828 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=6768392b-b0a2-4822-b948-90c7b9f1c917
2025-07-31 02:05:11,829 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=efa6b6b5-c9f8-4eac-a4fa-4d25baea76c6
2025-07-31 02:05:11,833 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=a8d6aa72-4537-4c0f-9b79-c80962e7bdbf
2025-07-31 02:05:11,834 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=b230f638-25bf-4e68-9b78-cb21d625c99c
2025-07-31 02:05:11,835 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=b0b52239-9f8f-4153-9c80-c809925cc009
2025-07-31 02:05:11,836 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=22a8b2ed-9d07-44d2-bf64-fc14f3eb5b38
2025-07-31 02:05:11,837 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=6c599865-cb9a-4ac6-8c35-00f36a5b4ed6
2025-07-31 02:05:11,838 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=858694e3-c0be-4756-bb73-64d9961cddbd
2025-07-31 02:05:11,880 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:47efc906-6db2-11f0-95fa-024268e783be
2025-07-31 02:05:11,884 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:49c8b03a-6db2-11f0-95fa-024268e783be
2025-07-31 02:05:11,888 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:48baa7b6-6db2-11f0-95fa-024268e783be
2025-07-31 02:05:11,890 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:4a8892a6-6db2-11f0-95fa-024268e783be
2025-07-31 02:05:16,883 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=6c599865-cb9a-4ac6-8c35-00f36a5b4ed6
2025-07-31 02:05:16,887 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=a8d6aa72-4537-4c0f-9b79-c80962e7bdbf
2025-07-31 02:05:16,893 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=b0b52239-9f8f-4153-9c80-c809925cc009
2025-07-31 02:05:16,895 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=b230f638-25bf-4e68-9b78-cb21d625c99c
2025-07-31 02:05:21,902 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=6c599865-cb9a-4ac6-8c35-00f36a5b4ed6
2025-07-31 02:05:21,904 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=a8d6aa72-4537-4c0f-9b79-c80962e7bdbf
2025-07-31 02:05:21,910 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=b0b52239-9f8f-4153-9c80-c809925cc009
2025-07-31 02:05:21,912 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=b230f638-25bf-4e68-9b78-cb21d625c99c
2025-07-31 02:05:26,917 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=6c599865-cb9a-4ac6-8c35-00f36a5b4ed6
2025-07-31 02:05:26,919 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=a8d6aa72-4537-4c0f-9b79-c80962e7bdbf
2025-07-31 02:05:26,924 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=b0b52239-9f8f-4153-9c80-c809925cc009
2025-07-31 02:05:26,925 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=b230f638-25bf-4e68-9b78-cb21d625c99c
2025-07-31 02:05:31,930 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=6c599865-cb9a-4ac6-8c35-00f36a5b4ed6
2025-07-31 02:05:31,932 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=a8d6aa72-4537-4c0f-9b79-c80962e7bdbf
2025-07-31 02:05:31,936 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=b230f638-25bf-4e68-9b78-cb21d625c99c
2025-07-31 02:05:31,938 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=b0b52239-9f8f-4153-9c80-c809925cc009
2025-07-31 02:05:36,950 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=a8d6aa72-4537-4c0f-9b79-c80962e7bdbf
2025-07-31 02:05:36,953 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=b230f638-25bf-4e68-9b78-cb21d625c99c
2025-07-31 02:05:36,954 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=b0b52239-9f8f-4153-9c80-c809925cc009
2025-07-31 02:05:36,955 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=6c599865-cb9a-4ac6-8c35-00f36a5b4ed6
2025-07-31 02:05:41,971 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=a8d6aa72-4537-4c0f-9b79-c80962e7bdbf
2025-07-31 02:05:41,972 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=b230f638-25bf-4e68-9b78-cb21d625c99c
2025-07-31 02:05:41,973 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=6c599865-cb9a-4ac6-8c35-00f36a5b4ed6
2025-07-31 02:05:41,975 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_VmListReq?uuid=b0b52239-9f8f-4153-9c80-c809925cc009
2025-07-31 02:05:41,988 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:4b65a808-6db2-11f0-95fa-024268e783be
2025-07-31 02:05:41,991 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:4d383c40-6db2-11f0-95fa-024268e783be
2025-07-31 02:05:41,993 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:4e3f02fe-6db2-11f0-95fa-024268e783be
2025-07-31 02:05:41,994 - DEBUG - Requesting: http://10.0.0.48:8085/Snh_PageReq?x=begin:-1,end:-1,table:db.interface.0,uuid:4c449cb6-6db2-11f0-95fa-024268e783be